2023-05-10T00:54:28.965 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-10T00:54:28.966 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --name yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972 --verbose -- /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/orig.config.yaml 2023-05-10T00:54:29.011 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-10T00:54:29.086 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972 branch: wip-yuri4-testing-2023-05-08-0846-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7268972' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri4-testing-2023-05-08-0846-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: c814f3c7f7433199e106dca4409cff1756915911 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c814f3c7f7433199e106dca4409cff1756915911 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-05-08-0846-pacific sha1: c814f3c7f7433199e106dca4409cff1756915911 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 84 sha1: c814f3c7f7433199e106dca4409cff1756915911 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2023-05-08-0846-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_c814f3c7f7433199e106dca4409cff1756915911/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: c814f3c7f7433199e106dca4409cff1756915911 targets: smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn8M4DEYMBQSaidVZ9ULUvt4ddwZSTnajhnGeFjLTr3dHVIkJH+6t0Ei/g4hw5sxumtoQ/tCQ0FdY6enwgPfuXdv3Nj9vfIH9iciOOkGyE1CjX3Nw4GWJRu7pZlCMQrA6vbB5+A0GVr183koWPnrOFpEAYbErtOWj8Apb4AMfxKqfZ9rHk5kXD9J63AMUVUuxe/oWR3n6/4NjV/5ii9FaaaJeVCAMqy9sSCLk04+ghJOsn2EbieCohBOzWoAANzyhMO+l+jHnzvsr3BIN+jLnI7w07ULCcowJknhAIHytMBfGSyBhK3iZvvY6xtv7/b1H3A0Tl8sji6RYhFa6xDFD3cg9WUzdZH2L6Xrty3ahBpGwfrAstsAxm6xIEfgNmVv8CBH/xcHAKWAdVvLjCzQVsfXKt2yBm8GPmL3DlYKn5+GOGDjk53hwZ3SURtdlWPBBQntX9IZyZKt/1LL4cvOuO2NLcijDD94mO66A2G8Qs/16/NuZ2DUn+cxAcTssPzQU= smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHRORxFf3uSeBh7H+Iem6myfyxzSL3Cg3zOXur0Bk+jd3kU0T4nrlGHnFGi7DCFReNvkn/LqSgTT3TP0gr60KTaAPRthH+8H4Fr5XdbBX+ch7gbpSROZcSn7bKcEmxDk6Mz7TX8doSB7wb17Jg1gbEjr6es3+daitdC/H4Jl62jOKCOF64xA+F6oMl4d2bi8QyxFvfefOTwtY5CffgXIZfkEL6HqceVgnONw1xvMH8EC8PUrDr7ZR4SiVtz9cCHvFwODEf0oG6XyoOCT6BFpHwLGtY3Bet6frVguKwaLpSgLN87071SAxpvxTMOMiao3AIAtBIp6NgDy2vhjZpilmtIym3p3uak63cTL5FRN8Hm+snqFna9gqwjeNYBNZ+yCl4hk/zE+5CuzWe8RGhsZZUyPgxBAQnD1/sPvRaTMWKPIRR/e8e+4k/yOqifwrxgjDcofnAQq83IkyAxvh8gkkc5Ws5mS0jxBTmI9BQlzAzPnC39VtDR/HcoXr9MGy8Ga0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-09_19:39:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-10T00:54:29.087 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_c814f3c7f7433199e106dca4409cff1756915911/qa; will attempt to use it 2023-05-10T00:54:29.088 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_c814f3c7f7433199e106dca4409cff1756915911/qa/tasks 2023-05-10T00:54:29.088 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-10T00:54:29.090 INFO:teuthology.task.internal:Checking packages... 2023-05-10T00:54:29.119 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'c814f3c7f7433199e106dca4409cff1756915911' 2023-05-10T00:54:29.120 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-10T00:54:29.120 INFO:teuthology.packaging:ref: None 2023-05-10T00:54:29.120 INFO:teuthology.packaging:tag: None 2023-05-10T00:54:29.121 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-05-08-0846-pacific 2023-05-10T00:54:29.121 INFO:teuthology.packaging:sha1: c814f3c7f7433199e106dca4409cff1756915911 2023-05-10T00:54:29.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2023-05-08-0846-pacific 2023-05-10T00:54:29.261 INFO:teuthology.task.internal:Found packages for ceph version 16.2.12-163.gc814f3c7 2023-05-10T00:54:29.261 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-10T00:54:29.268 INFO:teuthology.task.internal:no buildpackages task found 2023-05-10T00:54:29.268 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-10T00:54:29.274 INFO:teuthology.task.internal:Saving configuration 2023-05-10T00:54:29.291 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-10T00:54:29.301 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-10T00:54:29.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 00:49:07.266148', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd9BP7QC2b50PwjBlz7IzvldObLU9oZ2x4m3F4vQkmzjIlVPF44unLcnIuzC2FhXlvkLqBkkzl3k11sd9NDH3A='} 2023-05-10T00:54:29.360 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 00:49:07.267944', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOf6sPqm3rY3EPGR2K06zBhYUBF7nIKaWQSxhhLdgZi/dX18NgdD3Z3fVxNqIe1FF3YpohXqeLblSaBs/eVWKQ4='} 2023-05-10T00:54:29.360 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-10T00:54:29.368 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-10T00:54:29.369 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-10T00:54:29.369 INFO:teuthology.run_tasks:Running task console_log... 2023-05-10T00:54:29.466 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff928d24ee0>, signals=[15]) 2023-05-10T00:54:29.468 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-10T00:54:29.475 INFO:teuthology.task.internal:Opening connections... 2023-05-10T00:54:29.476 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T00:54:29.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T00:54:29.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T00:54:29.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T00:54:29.626 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-10T00:54:29.633 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-05-10T00:54:29.652 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-05-10T00:54:29.653 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-05-10T00:54:29.710 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T00:54:29.711 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.4 (Ootpa)" 2023-05-10T00:54:29.711 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-05-10T00:54:29.711 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-05-10T00:54:29.712 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.4" 2023-05-10T00:54:29.712 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-05-10T00:54:29.712 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-05-10T00:54:29.712 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-05-10T00:54:29.713 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-05-10T00:54:29.713 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T00:54:29.713 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T00:54:29.713 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T00:54:29.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T00:54:29.714 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T00:54:29.716 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-05-10T00:54:29.716 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T00:54:29.716 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-05-10T00:54:29.717 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-05-10T00:54:29.749 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-05-10T00:54:29.767 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-05-10T00:54:29.768 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-05-10T00:54:29.824 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T00:54:29.825 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.4 (Ootpa)" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.4" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-05-10T00:54:29.826 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T00:54:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-05-10T00:54:29.828 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T00:54:29.828 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-05-10T00:54:29.828 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-05-10T00:54:29.852 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-10T00:54:29.867 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-10T00:54:29.879 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-10T00:54:29.879 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2023-05-10T00:54:29.882 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-05-10T00:54:29.897 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-10T00:54:29.904 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-10T00:54:29.904 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2023-05-10T00:54:29.939 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-05-10T00:54:29.953 INFO:teuthology.orchestra.run.smithi052.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-05-10T00:54:29.954 INFO:teuthology.orchestra.run.smithi172.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-05-10T00:54:29.955 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-10T00:54:30.034 INFO:teuthology.run_tasks:Running task kernel... 2023-05-10T00:54:30.059 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-05-10T00:54:30.060 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-05-10T00:54:30.060 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-05-10T00:54:30.060 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-10T00:54:30.061 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-10T00:54:30.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T00:54:30.077 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-05-10T00:54:30.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T00:54:30.079 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-05-10T00:54:30.133 INFO:teuthology.orchestra.run.smithi172.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:30.134 INFO:teuthology.task.kernel:Running kernel on smithi172: 4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:30.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2023-05-10T00:54:30.136 INFO:teuthology.orchestra.run.smithi052.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:30.136 INFO:teuthology.task.kernel:Running kernel on smithi052: 4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:30.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2023-05-10T00:54:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-05-10T00:54:31.635 INFO:teuthology.orchestra.run.smithi052.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:31.636 INFO:teuthology.orchestra.run.smithi052.stdout:Unable to read consumer identity 2023-05-10T00:54:35.391 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T00:54:35.402 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T00:54:36.436 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:01 2023-05-10T00:54:36.710 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2023-05-10T00:54:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-05-10T00:54:39.584 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-05-10T00:54:40.279 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-05-10T00:54:40.279 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-05-10T00:54:40.279 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-05-10T00:54:40.296 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-05-10T00:54:40.297 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-05-10T00:54:40.297 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-05-10T00:54:40.439 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-05-10T00:54:40.439 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2023-05-10T00:54:40.439 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-05-10T00:54:40.548 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2023-05-10T00:54:40.561 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-05-10T00:54:40.562 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-05-10T00:54:40.562 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-05-10T00:54:40.699 DEBUG:teuthology.orchestra.run.smithi052:> echo no | sudo yum reinstall kernel || true 2023-05-10T00:54:40.892 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:40.892 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-05-10T00:54:41.069 INFO:teuthology.orchestra.run.smithi052.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:41.070 INFO:teuthology.orchestra.run.smithi052.stdout:Unable to read consumer identity 2023-05-10T00:54:41.174 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:02 ago on Wed 10 May 2023 12:54:39 AM UTC. 2023-05-10T00:54:41.296 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-10T00:54:41.296 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:41.297 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:41.326 INFO:teuthology.orchestra.run.smithi172.stderr:Error: No packages marked for reinstall. 2023-05-10T00:54:41.372 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:02 ago on Wed 10 May 2023 12:54:39 AM UTC. 2023-05-10T00:54:41.375 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2023-05-10T00:54:41.592 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-10T00:54:41.593 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:41.593 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:Error: No packages marked for reinstall. 2023-05-10T00:54:41.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum reinstall -y kernel || true 2023-05-10T00:54:41.720 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:41.720 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-05-10T00:54:42.004 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Wed 10 May 2023 12:54:39 AM UTC. 2023-05-10T00:54:42.036 INFO:teuthology.orchestra.run.smithi052.stdout:Updating Subscription Management repositories. 2023-05-10T00:54:42.036 INFO:teuthology.orchestra.run.smithi052.stdout:Unable to read consumer identity 2023-05-10T00:54:42.154 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-10T00:54:42.155 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:42.155 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:42.166 INFO:teuthology.orchestra.run.smithi172.stderr:Error: No packages marked for reinstall. 2023-05-10T00:54:42.217 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel --last | head -n 1 2023-05-10T00:54:42.323 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:03 ago on Wed 10 May 2023 12:54:39 AM UTC. 2023-05-10T00:54:42.343 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-4.18.0-305.25.1.el8_4.x86_64 Wed 21 Dec 2022 01:05:24 PM UTC 2023-05-10T00:54:42.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:42.345 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-10T00:54:42.345 DEBUG:teuthology.parallel:result is None 2023-05-10T00:54:42.482 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-05-10T00:54:42.482 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:42.483 INFO:teuthology.orchestra.run.smithi052.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-05-10T00:54:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:Error: No packages marked for reinstall. 2023-05-10T00:54:42.545 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel --last | head -n 1 2023-05-10T00:54:42.674 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-4.18.0-305.25.1.el8_4.x86_64 Wed 21 Dec 2022 01:05:24 PM UTC 2023-05-10T00:54:42.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.25.1.el8_4.x86_64 2023-05-10T00:54:42.676 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-10T00:54:42.676 DEBUG:teuthology.parallel:result is None 2023-05-10T00:54:42.677 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-10T00:54:42.685 INFO:teuthology.task.internal:Creating test directory... 2023-05-10T00:54:42.686 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-10T00:54:42.688 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-10T00:54:42.703 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-10T00:54:42.710 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-10T00:54:42.721 INFO:teuthology.task.internal:Creating archive directory... 2023-05-10T00:54:42.722 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-10T00:54:42.743 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-10T00:54:42.773 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-10T00:54:42.780 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-10T00:54:42.781 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-10T00:54:42.806 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-10T00:54:42.837 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T00:54:42.840 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T00:54:42.855 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T00:54:42.858 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T00:54:42.860 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-10T00:54:42.869 INFO:teuthology.task.internal:Configuring sudo... 2023-05-10T00:54:42.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-10T00:54:42.901 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-10T00:54:42.925 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-10T00:54:42.938 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-10T00:54:42.939 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-10T00:54:42.967 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-10T00:54:42.985 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T00:54:43.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T00:54:43.108 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T00:54:43.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T00:54:43.229 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T00:54:43.230 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-10T00:54:43.293 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T00:54:43.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T00:54:43.401 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T00:54:43.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T00:54:43.481 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T00:54:43.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-10T00:54:43.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2023-05-10T00:54:43.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-05-10T00:54:43.635 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T00:54:43.692 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T00:54:44.048 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-10T00:54:44.057 INFO:teuthology.task.internal:Starting timer... 2023-05-10T00:54:44.058 INFO:teuthology.run_tasks:Running task pcp... 2023-05-10T00:54:44.098 INFO:teuthology.run_tasks:Running task selinux... 2023-05-10T00:54:44.108 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-05-10T00:54:44.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2023-05-10T00:54:44.163 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: [ OK ] 2023-05-10T00:54:44.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2023-05-10T00:54:44.222 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: [ OK ] 2023-05-10T00:54:44.223 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-10T00:54:44.224 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2023-05-10T00:54:44.245 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2023-05-10T00:54:44.245 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2023-05-10T00:54:44.264 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2023-05-10T00:54:44.264 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2023-05-10T00:54:44.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T00:54:44.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T00:54:44.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T00:54:44.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T00:54:44.337 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-10T00:54:44.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2023-05-10T00:54:44.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2023-05-10T00:54:44.402 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-10T00:54:44.412 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-10T00:54:44.413 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-10T00:54:44.435 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-10T00:54:44.436 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-10T01:06:43.904 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2023-05-10T01:06:43.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-05-10T01:06:43.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T01:06:44.000 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-05-10T01:06:44.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-05-10T01:06:44.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T01:06:44.134 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-05-10T01:06:44.200 INFO:teuthology.run_tasks:Running task clock... 2023-05-10T01:06:44.214 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-10T01:06:44.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-10T01:06:44.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T01:06:44.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-10T01:06:44.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T01:06:44.246 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-10T01:06:44.262 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-10T01:06:44.271 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-10T01:06:44.286 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-10T01:06:44.300 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2023-05-10T01:06:44.310 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2023-05-10T01:06:44.323 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2023-05-10T01:06:44.325 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-10T01:06:44.333 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2023-05-10T01:06:44.339 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-10T01:06:44.347 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-10T01:06:44.361 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-10T01:06:44.402 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2023-05-10T01:06:44.405 INFO:teuthology.orchestra.run.smithi052.stdout:210 Number of sources = 4 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.406 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.425 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:210 Number of sources = 4 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.428 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.429 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:06:44.429 INFO:teuthology.run_tasks:Running task install... 2023-05-10T01:06:44.440 DEBUG:teuthology.task.install:project ceph 2023-05-10T01:06:44.441 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'}} 2023-05-10T01:06:44.441 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'} 2023-05-10T01:06:44.441 INFO:teuthology.task.install:Using flavor: default 2023-05-10T01:06:44.447 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-10T01:06:44.447 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-10T01:06:44.448 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911', 'tag': None, 'wait_for_package': False} 2023-05-10T01:06:44.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c814f3c7f7433199e106dca4409cff1756915911 2023-05-10T01:06:44.450 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911', 'tag': None, 'wait_for_package': False} 2023-05-10T01:06:44.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c814f3c7f7433199e106dca4409cff1756915911 2023-05-10T01:06:44.590 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/ 2023-05-10T01:06:44.590 INFO:teuthology.task.install.rpm:Package version is 16.2.12-163.gc814f3c7 2023-05-10T01:06:44.598 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/ 2023-05-10T01:06:44.598 INFO:teuthology.task.install.rpm:Package version is 16.2.12-163.gc814f3c7 2023-05-10T01:06:44.701 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-10T01:06:44.701 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:06:44.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-10T01:06:44.707 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-08-0846-pacific/c814f3c7f7433199e106dca4409cff1756915911/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-10T01:06:44.707 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:06:44.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-10T01:06:44.728 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-05-10T01:06:44.728 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c814f3c7f7433199e106dca4409cff1756915911/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-10T01:06:44.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-05-10T01:06:44.733 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c814f3c7f7433199e106dca4409cff1756915911/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-10T01:06:44.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-10T01:06:44.797 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-10T01:06:44.869 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-10T01:06:44.871 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-10T01:06:44.933 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2023-05-10T01:06:44.934 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2023-05-10T01:06:44.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2023-05-10T01:06:44.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2023-05-10T01:06:45.323 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-05-10T01:06:45.342 INFO:teuthology.orchestra.run.smithi052.stdout:Updating Subscription Management repositories. 2023-05-10T01:06:45.635 INFO:teuthology.orchestra.run.smithi172.stdout:44 files removed 2023-05-10T01:06:45.644 INFO:teuthology.orchestra.run.smithi052.stdout:44 files removed 2023-05-10T01:06:45.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-05-10T01:06:45.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-05-10T01:06:46.030 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-05-10T01:06:46.061 INFO:teuthology.orchestra.run.smithi052.stdout:Updating Subscription Management repositories. 2023-05-10T01:06:46.685 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 347 kB/s | 76 kB 00:00 2023-05-10T01:06:46.747 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 347 kB/s | 76 kB 00:00 2023-05-10T01:06:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2023-05-10T01:06:46.974 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 83 kB/s | 15 kB 00:00 2023-05-10T01:06:47.126 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.9 kB/s | 1.4 kB 00:00 2023-05-10T01:06:47.195 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 7.7 kB/s | 1.4 kB 00:00 2023-05-10T01:06:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T01:06:49.705 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T01:06:50.693 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-05-10T01:06:53.785 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-05-10T01:06:54.200 INFO:teuthology.orchestra.run.smithi052.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 115 MB/s | 38 MB 00:00 2023-05-10T01:07:00.075 INFO:teuthology.orchestra.run.smithi052.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 111 MB/s | 33 MB 00:00 2023-05-10T01:07:05.570 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 894 kB/s | 14 MB 00:15 2023-05-10T01:07:08.501 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-05-10T01:07:08.518 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T01:07:08.519 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T01:07:08.530 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-05-10T01:07:08.531 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-05-10T01:07:08.532 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-05-10T01:07:08.533 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T01:07:08.535 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T01:07:08.537 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-05-10T01:07:08.538 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-05-10T01:07:08.875 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 129 MB/s | 38 MB 00:00 2023-05-10T01:07:09.056 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================================================== 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================================================== 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-10T01:07:09.069 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 6.4 k 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 6.1 M 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 908 k 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 161 k 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 1.6 M 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 116 k 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 3.1 M 2023-05-10T01:07:09.070 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 8.6 M 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 27 k 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 12 M 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 51 M 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 84 k 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 256 k 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 18 k 2023-05-10T01:07:09.071 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 25 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 822 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 131 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-10T01:07:09.072 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 215 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 389 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 368 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 114 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 88 k 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.7 M 2023-05-10T01:07:09.073 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 173 k 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.7 M 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 4.2 M 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-10T01:07:09.074 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 24 M 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 24 k 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 2.4 M 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 243 k 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 5.0 M 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 18 M 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 15 k 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 26 k 2023-05-10T01:07:09.075 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 174 k 2023-05-10T01:07:09.076 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 493 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.8 M 2023-05-10T01:07:09.077 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-05-10T01:07:09.078 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-10T01:07:09.079 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 45 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 97 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-05-10T01:07:09.080 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-10T01:07:09.081 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-10T01:07:09.082 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-10T01:07:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-10T01:07:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-10T01:07:09.085 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================================================== 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout:Install 118 Packages 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2023-05-10T01:07:09.086 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:07:09.087 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 200 M 2023-05-10T01:07:09.087 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-05-10T01:07:09.234 INFO:teuthology.orchestra.run.smithi052.stdout:(1/120): ceph-16.2.12-163.gc814f3c7.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-05-10T01:07:09.412 INFO:teuthology.orchestra.run.smithi052.stdout:(2/120): ceph-fuse-16.2.12-163.gc814f3c7.el8.x8 5.0 MB/s | 908 kB 00:00 2023-05-10T01:07:09.468 INFO:teuthology.orchestra.run.smithi052.stdout:(3/120): ceph-immutable-object-cache-16.2.12-16 2.8 MB/s | 161 kB 00:00 2023-05-10T01:07:09.791 INFO:teuthology.orchestra.run.smithi052.stdout:(4/120): ceph-mds-16.2.12-163.gc814f3c7.el8.x86 7.6 MB/s | 2.4 MB 00:00 2023-05-10T01:07:09.815 INFO:teuthology.orchestra.run.smithi052.stdout:(5/120): ceph-base-16.2.12-163.gc814f3c7.el8.x8 9.0 MB/s | 6.1 MB 00:00 2023-05-10T01:07:10.053 INFO:teuthology.orchestra.run.smithi052.stdout:(6/120): ceph-mgr-16.2.12-163.gc814f3c7.el8.x86 6.1 MB/s | 1.6 MB 00:00 2023-05-10T01:07:10.243 INFO:teuthology.orchestra.run.smithi052.stdout:(7/120): ceph-mon-16.2.12-163.gc814f3c7.el8.x86 12 MB/s | 5.0 MB 00:00 2023-05-10T01:07:11.269 INFO:teuthology.orchestra.run.smithi052.stdout:(8/120): ceph-radosgw-16.2.12-163.gc814f3c7.el8 11 MB/s | 12 MB 00:01 2023-05-10T01:07:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:(9/120): ceph-selinux-16.2.12-163.gc814f3c7.el8 587 kB/s | 26 kB 00:00 2023-05-10T01:07:11.625 INFO:teuthology.orchestra.run.smithi052.stdout:(10/120): ceph-common-16.2.12-163.gc814f3c7.el8 9.7 MB/s | 24 MB 00:02 2023-05-10T01:07:11.688 INFO:teuthology.orchestra.run.smithi052.stdout:(11/120): cephfs-mirror-16.2.12-163.gc814f3c7.e 4.0 MB/s | 256 kB 00:00 2023-05-10T01:07:11.736 INFO:teuthology.orchestra.run.smithi052.stdout:(12/120): libcephfs-devel-16.2.12-163.gc814f3c7 526 kB/s | 25 kB 00:00 2023-05-10T01:07:11.865 INFO:teuthology.orchestra.run.smithi052.stdout:(13/120): libcephfs2-16.2.12-163.gc814f3c7.el8. 6.2 MB/s | 822 kB 00:00 2023-05-10T01:07:11.925 INFO:teuthology.orchestra.run.smithi052.stdout:(14/120): libcephsqlite-16.2.12-163.gc814f3c7.e 2.9 MB/s | 174 kB 00:00 2023-05-10T01:07:11.982 INFO:teuthology.orchestra.run.smithi052.stdout:(15/120): librados-devel-16.2.12-163.gc814f3c7. 2.3 MB/s | 131 kB 00:00 2023-05-10T01:07:12.054 INFO:teuthology.orchestra.run.smithi052.stdout:(16/120): libradosstriper1-16.2.12-163.gc814f3c 6.7 MB/s | 493 kB 00:00 2023-05-10T01:07:12.514 INFO:teuthology.orchestra.run.smithi052.stdout:(17/120): librgw2-16.2.12-163.gc814f3c7.el8.x86 8.2 MB/s | 3.8 MB 00:00 2023-05-10T01:07:12.663 INFO:teuthology.orchestra.run.smithi052.stdout:(18/120): ceph-osd-16.2.12-163.gc814f3c7.el8.x8 7.0 MB/s | 18 MB 00:02 2023-05-10T01:07:12.664 INFO:teuthology.orchestra.run.smithi052.stdout:(19/120): python3-ceph-argparse-16.2.12-163.gc8 298 kB/s | 45 kB 00:00 2023-05-10T01:07:12.688 INFO:teuthology.orchestra.run.smithi052.stdout:(20/120): python3-ceph-common-16.2.12-163.gc814 3.9 MB/s | 97 kB 00:00 2023-05-10T01:07:12.699 INFO:teuthology.orchestra.run.smithi052.stdout:(21/120): python3-cephfs-16.2.12-163.gc814f3c7. 6.2 MB/s | 215 kB 00:00 2023-05-10T01:07:12.739 INFO:teuthology.orchestra.run.smithi052.stdout:(22/120): python3-rados-16.2.12-163.gc814f3c7.e 7.5 MB/s | 389 kB 00:00 2023-05-10T01:07:12.755 INFO:teuthology.orchestra.run.smithi052.stdout:(23/120): python3-rbd-16.2.12-163.gc814f3c7.el8 6.4 MB/s | 368 kB 00:00 2023-05-10T01:07:12.786 INFO:teuthology.orchestra.run.smithi052.stdout:(24/120): python3-rgw-16.2.12-163.gc814f3c7.el8 2.4 MB/s | 114 kB 00:00 2023-05-10T01:07:12.792 INFO:teuthology.orchestra.run.smithi052.stdout:(25/120): rbd-fuse-16.2.12-163.gc814f3c7.el8.x8 2.3 MB/s | 88 kB 00:00 2023-05-10T01:07:12.843 INFO:teuthology.orchestra.run.smithi052.stdout:(26/120): rbd-nbd-16.2.12-163.gc814f3c7.el8.x86 3.3 MB/s | 173 kB 00:00 2023-05-10T01:07:12.889 INFO:teuthology.orchestra.run.smithi052.stdout:(27/120): ceph-grafana-dashboards-16.2.12-163.g 531 kB/s | 24 kB 00:00 2023-05-10T01:07:12.939 INFO:teuthology.orchestra.run.smithi052.stdout:(28/120): ceph-mgr-cephadm-16.2.12-163.gc814f3c 2.3 MB/s | 116 kB 00:00 2023-05-10T01:07:13.290 INFO:teuthology.orchestra.run.smithi052.stdout:(29/120): ceph-mgr-dashboard-16.2.12-163.gc814f 8.9 MB/s | 3.1 MB 00:00 2023-05-10T01:07:13.393 INFO:teuthology.orchestra.run.smithi052.stdout:(30/120): rbd-mirror-16.2.12-163.gc814f3c7.el8. 6.0 MB/s | 3.7 MB 00:00 2023-05-10T01:07:13.463 INFO:teuthology.orchestra.run.smithi052.stdout:(31/120): ceph-mgr-modules-core-16.2.12-163.gc8 3.4 MB/s | 243 kB 00:00 2023-05-10T01:07:13.526 INFO:teuthology.orchestra.run.smithi052.stdout:(32/120): ceph-mgr-rook-16.2.12-163.gc814f3c7.e 436 kB/s | 27 kB 00:00 2023-05-10T01:07:13.589 INFO:teuthology.orchestra.run.smithi052.stdout:(33/120): ceph-prometheus-alerts-16.2.12-163.gc 236 kB/s | 15 kB 00:00 2023-05-10T01:07:13.656 INFO:teuthology.orchestra.run.smithi052.stdout:(34/120): cephadm-16.2.12-163.gc814f3c7.el8.noa 1.2 MB/s | 84 kB 00:00 2023-05-10T01:07:13.720 INFO:teuthology.orchestra.run.smithi052.stdout:(35/120): cephfs-top-16.2.12-163.gc814f3c7.el8. 287 kB/s | 18 kB 00:00 2023-05-10T01:07:14.006 INFO:teuthology.orchestra.run.smithi052.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-05-10T01:07:14.047 INFO:teuthology.orchestra.run.smithi052.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 4.3 MB/s | 181 kB 00:00 2023-05-10T01:07:14.104 INFO:teuthology.orchestra.run.smithi052.stdout:(38/120): ceph-mgr-diskprediction-local-16.2.12 11 MB/s | 8.6 MB 00:00 2023-05-10T01:07:14.105 INFO:teuthology.orchestra.run.smithi052.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-05-10T01:07:14.146 INFO:teuthology.orchestra.run.smithi052.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 527 kB/s | 21 kB 00:00 2023-05-10T01:07:14.185 INFO:teuthology.orchestra.run.smithi052.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.1 MB/s | 44 kB 00:00 2023-05-10T01:07:14.226 INFO:teuthology.orchestra.run.smithi052.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-05-10T01:07:14.265 INFO:teuthology.orchestra.run.smithi052.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 850 kB/s | 33 kB 00:00 2023-05-10T01:07:14.295 INFO:teuthology.orchestra.run.smithi052.stdout:(44/120): libunwind-1.3.1-3.el8.x86_64.rpm 394 kB/s | 75 kB 00:00 2023-05-10T01:07:14.304 INFO:teuthology.orchestra.run.smithi052.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 417 kB/s | 16 kB 00:00 2023-05-10T01:07:14.398 INFO:teuthology.orchestra.run.smithi052.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-05-10T01:07:14.418 INFO:teuthology.orchestra.run.smithi052.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.3 MB/s | 384 kB 00:00 2023-05-10T01:07:14.456 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-05-10T01:07:14.477 INFO:teuthology.orchestra.run.smithi052.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.3 MB/s | 81 kB 00:00 2023-05-10T01:07:14.519 INFO:teuthology.orchestra.run.smithi052.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 269 kB/s | 11 kB 00:00 2023-05-10T01:07:14.545 INFO:teuthology.orchestra.run.smithi052.stdout:(50/120): python3-execnet-1.7.1-1.el8.noarch.rp 2.4 MB/s | 355 kB 00:00 2023-05-10T01:07:14.558 INFO:teuthology.orchestra.run.smithi052.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 454 kB/s | 18 kB 00:00 2023-05-10T01:07:14.615 INFO:teuthology.orchestra.run.smithi052.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 853 kB/s | 49 kB 00:00 2023-05-10T01:07:14.663 INFO:teuthology.orchestra.run.smithi052.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-05-10T01:07:14.719 INFO:teuthology.orchestra.run.smithi052.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 5.0 MB/s | 283 kB 00:00 2023-05-10T01:07:14.789 INFO:teuthology.orchestra.run.smithi052.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 225 kB/s | 16 kB 00:00 2023-05-10T01:07:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 894 kB/s | 49 kB 00:00 2023-05-10T01:07:14.892 INFO:teuthology.orchestra.run.smithi052.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 707 kB/s | 34 kB 00:00 2023-05-10T01:07:14.918 INFO:teuthology.orchestra.run.smithi052.stdout:(58/120): python3-kubernetes-11.0.0-6.el8.noarc 3.1 MB/s | 1.2 MB 00:00 2023-05-10T01:07:14.947 INFO:teuthology.orchestra.run.smithi052.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 3.5 MB/s | 196 kB 00:00 2023-05-10T01:07:14.958 INFO:teuthology.orchestra.run.smithi052.stdout:(60/120): python3-rsa-4.8-1.el8.noarch.rpm 1.5 MB/s | 61 kB 00:00 2023-05-10T01:07:15.017 INFO:teuthology.orchestra.run.smithi052.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 266 kB/s | 19 kB 00:00 2023-05-10T01:07:15.021 INFO:teuthology.orchestra.run.smithi052.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 383 kB/s | 24 kB 00:00 2023-05-10T01:07:15.065 INFO:teuthology.orchestra.run.smithi052.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 616 kB/s | 29 kB 00:00 2023-05-10T01:07:15.066 INFO:teuthology.orchestra.run.smithi052.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 618 kB/s | 27 kB 00:00 2023-05-10T01:07:15.127 INFO:teuthology.orchestra.run.smithi052.stdout:(65/120): python3-waitress-1.2.1-2.el8.1.noarch 3.8 MB/s | 241 kB 00:00 2023-05-10T01:07:15.172 INFO:teuthology.orchestra.run.smithi052.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-05-10T01:07:15.177 INFO:teuthology.orchestra.run.smithi052.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-05-10T01:07:15.222 INFO:teuthology.orchestra.run.smithi052.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-05-10T01:07:15.223 INFO:teuthology.orchestra.run.smithi052.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 505 kB/s | 23 kB 00:00 2023-05-10T01:07:15.225 INFO:teuthology.orchestra.run.smithi052.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-05-10T01:07:15.254 INFO:teuthology.orchestra.run.smithi052.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 586 kB/s | 19 kB 00:00 2023-05-10T01:07:15.263 INFO:teuthology.orchestra.run.smithi052.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-05-10T01:07:15.269 INFO:teuthology.orchestra.run.smithi052.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-05-10T01:07:15.278 INFO:teuthology.orchestra.run.smithi052.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-05-10T01:07:15.283 INFO:teuthology.orchestra.run.smithi052.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.4 MB/s | 48 kB 00:00 2023-05-10T01:07:15.294 INFO:teuthology.orchestra.run.smithi052.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-05-10T01:07:15.297 INFO:teuthology.orchestra.run.smithi052.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.0 MB/s | 43 kB 00:00 2023-05-10T01:07:15.310 INFO:teuthology.orchestra.run.smithi052.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-05-10T01:07:15.829 INFO:teuthology.orchestra.run.smithi052.stdout:(79/120): ceph-test-16.2.12-163.gc814f3c7.el8.x 11 MB/s | 51 MB 00:04 2023-05-10T01:07:15.850 INFO:teuthology.orchestra.run.smithi052.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 1.1 MB/s | 605 kB 00:00 2023-05-10T01:07:15.863 INFO:teuthology.orchestra.run.smithi052.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 4.1 MB/s | 2.3 MB 00:00 2023-05-10T01:07:15.864 INFO:teuthology.orchestra.run.smithi052.stdout:(82/120): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-05-10T01:07:15.869 INFO:teuthology.orchestra.run.smithi052.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 3.2 MB/s | 59 kB 00:00 2023-05-10T01:07:15.883 INFO:teuthology.orchestra.run.smithi052.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-05-10T01:07:15.883 INFO:teuthology.orchestra.run.smithi052.stdout:(85/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.2 MB/s | 169 kB 00:00 2023-05-10T01:07:15.892 INFO:teuthology.orchestra.run.smithi052.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.6 MB/s | 86 kB 00:00 2023-05-10T01:07:15.900 INFO:teuthology.orchestra.run.smithi052.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.1 MB/s | 58 kB 00:00 2023-05-10T01:07:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.6 MB/s | 47 kB 00:00 2023-05-10T01:07:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-05-10T01:07:15.918 INFO:teuthology.orchestra.run.smithi052.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.0 MB/s | 70 kB 00:00 2023-05-10T01:07:15.926 INFO:teuthology.orchestra.run.smithi052.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2023-05-10T01:07:15.932 INFO:teuthology.orchestra.run.smithi052.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-05-10T01:07:15.934 INFO:teuthology.orchestra.run.smithi052.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.1 MB/s | 97 kB 00:00 2023-05-10T01:07:15.949 INFO:teuthology.orchestra.run.smithi052.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-05-10T01:07:15.956 INFO:teuthology.orchestra.run.smithi052.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2023-05-10T01:07:15.968 INFO:teuthology.orchestra.run.smithi052.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 8.1 MB/s | 161 kB 00:00 2023-05-10T01:07:15.976 INFO:teuthology.orchestra.run.smithi052.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-05-10T01:07:15.991 INFO:teuthology.orchestra.run.smithi052.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-05-10T01:07:16.005 INFO:teuthology.orchestra.run.smithi052.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.6 MB/s | 39 kB 00:00 2023-05-10T01:07:16.032 INFO:teuthology.orchestra.run.smithi052.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 25 MB/s | 688 kB 00:00 2023-05-10T01:07:16.054 INFO:teuthology.orchestra.run.smithi052.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-05-10T01:07:16.074 INFO:teuthology.orchestra.run.smithi052.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2023-05-10T01:07:16.078 INFO:teuthology.orchestra.run.smithi052.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.1 MB/s | 225 kB 00:00 2023-05-10T01:07:16.093 INFO:teuthology.orchestra.run.smithi052.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.9 MB/s | 126 kB 00:00 2023-05-10T01:07:16.114 INFO:teuthology.orchestra.run.smithi052.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 8.8 MB/s | 187 kB 00:00 2023-05-10T01:07:16.137 INFO:teuthology.orchestra.run.smithi052.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-05-10T01:07:16.155 INFO:teuthology.orchestra.run.smithi052.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 49 MB/s | 3.7 MB 00:00 2023-05-10T01:07:16.160 INFO:teuthology.orchestra.run.smithi052.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-05-10T01:07:16.278 INFO:teuthology.orchestra.run.smithi052.stdout:(109/120): python3-scipy-1.0.0-20.module+el8.1. 41 MB/s | 15 MB 00:00 2023-05-10T01:07:16.280 INFO:teuthology.orchestra.run.smithi052.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 919 kB/s | 110 kB 00:00 2023-05-10T01:07:16.281 INFO:teuthology.orchestra.run.smithi052.stdout:(111/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-05-10T01:07:16.295 INFO:teuthology.orchestra.run.smithi052.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.3 MB/s | 20 kB 00:00 2023-05-10T01:07:16.300 INFO:teuthology.orchestra.run.smithi052.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-05-10T01:07:16.308 INFO:teuthology.orchestra.run.smithi052.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2023-05-10T01:07:16.310 INFO:teuthology.orchestra.run.smithi052.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.7 MB/s | 54 kB 00:00 2023-05-10T01:07:16.348 INFO:teuthology.orchestra.run.smithi052.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-05-10T01:07:16.400 INFO:teuthology.orchestra.run.smithi052.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 48 MB/s | 4.7 MB 00:00 2023-05-10T01:07:16.414 INFO:teuthology.orchestra.run.smithi052.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 43 MB/s | 4.6 MB 00:00 2023-05-10T01:07:16.865 INFO:teuthology.orchestra.run.smithi052.stdout:(119/120): librbd1-16.2.12-163.gc814f3c7.el8.x8 9.0 MB/s | 4.2 MB 00:00 2023-05-10T01:07:16.878 INFO:teuthology.orchestra.run.smithi052.stdout:(120/120): librados2-16.2.12-163.gc814f3c7.el8. 7.1 MB/s | 3.7 MB 00:00 2023-05-10T01:07:16.882 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-05-10T01:07:16.883 INFO:teuthology.orchestra.run.smithi052.stdout:Total 26 MB/s | 200 MB 00:07 2023-05-10T01:07:16.934 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-05-10T01:07:17.057 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-05-10T01:07:17.058 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-05-10T01:07:18.883 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-05-10T01:07:18.887 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-05-10T01:07:22.658 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T01:07:22.659 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T01:07:22.669 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-05-10T01:07:22.670 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-05-10T01:07:22.671 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-05-10T01:07:22.672 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T01:07:22.673 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T01:07:22.676 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-05-10T01:07:22.677 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-05-10T01:07:23.148 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-05-10T01:07:23.159 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================================================== 2023-05-10T01:07:23.159 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-05-10T01:07:23.160 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================================================== 2023-05-10T01:07:23.160 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2023-05-10T01:07:23.160 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-10T01:07:23.160 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 6.4 k 2023-05-10T01:07:23.160 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 6.1 M 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 908 k 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 161 k 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 1.6 M 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 116 k 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 3.1 M 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 8.6 M 2023-05-10T01:07:23.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 27 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 12 M 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 51 M 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 84 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 256 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 18 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-10T01:07:23.162 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 25 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 822 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 131 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-10T01:07:23.163 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 215 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 389 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 368 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 114 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 88 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.7 M 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 173 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-05-10T01:07:23.164 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.7 M 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 4.2 M 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 24 M 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 24 k 2023-05-10T01:07:23.165 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 2.4 M 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 243 k 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 5.0 M 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 18 M 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:16.2.12-163.gc814f3c7.el8 ceph-noarch 15 k 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 26 k 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-10T01:07:23.166 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 174 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-05-10T01:07:23.167 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 493 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 3.8 M 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-05-10T01:07:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-10T01:07:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-10T01:07:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 45 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:16.2.12-163.gc814f3c7.el8 ceph 97 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-10T01:07:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-10T01:07:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-10T01:07:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-10T01:07:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-10T01:07:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-10T01:07:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-10T01:07:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-10T01:07:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-10T01:07:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-10T01:07:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================================================== 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout:Install 118 Packages 2023-05-10T01:07:23.177 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2023-05-10T01:07:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:07:23.178 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 200 M 2023-05-10T01:07:23.178 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-05-10T01:07:23.587 INFO:teuthology.orchestra.run.smithi172.stdout:(1/120): ceph-16.2.12-163.gc814f3c7.el8.x86_64. 66 kB/s | 6.4 kB 00:00 2023-05-10T01:07:23.782 INFO:teuthology.orchestra.run.smithi172.stdout:(2/120): ceph-fuse-16.2.12-163.gc814f3c7.el8.x8 4.6 MB/s | 908 kB 00:00 2023-05-10T01:07:23.834 INFO:teuthology.orchestra.run.smithi172.stdout:(3/120): ceph-immutable-object-cache-16.2.12-16 3.0 MB/s | 161 kB 00:00 2023-05-10T01:07:24.110 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-05-10T01:07:24.175 INFO:teuthology.orchestra.run.smithi172.stdout:(4/120): ceph-mds-16.2.12-163.gc814f3c7.el8.x86 7.2 MB/s | 2.4 MB 00:00 2023-05-10T01:07:24.219 INFO:teuthology.orchestra.run.smithi172.stdout:(5/120): ceph-base-16.2.12-163.gc814f3c7.el8.x8 8.4 MB/s | 6.1 MB 00:00 2023-05-10T01:07:24.325 INFO:teuthology.orchestra.run.smithi172.stdout:(6/120): ceph-mgr-16.2.12-163.gc814f3c7.el8.x86 11 MB/s | 1.6 MB 00:00 2023-05-10T01:07:24.365 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-05-10T01:07:24.607 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-05-10T01:07:24.823 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-10T01:07:24.984 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-10T01:07:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-10T01:07:25.409 INFO:teuthology.orchestra.run.smithi172.stdout:(7/120): ceph-common-16.2.12-163.gc814f3c7.el8. 13 MB/s | 24 MB 00:01 2023-05-10T01:07:25.614 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-10T01:07:25.822 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 5/122 2023-05-10T01:07:26.004 INFO:teuthology.orchestra.run.smithi172.stdout:(8/120): ceph-osd-16.2.12-163.gc814f3c7.el8.x86 11 MB/s | 18 MB 00:01 2023-05-10T01:07:26.027 INFO:teuthology.orchestra.run.smithi172.stdout:(9/120): ceph-selinux-16.2.12-163.gc814f3c7.el8 1.1 MB/s | 26 kB 00:00 2023-05-10T01:07:26.091 INFO:teuthology.orchestra.run.smithi172.stdout:(10/120): ceph-radosgw-16.2.12-163.gc814f3c7.el 17 MB/s | 12 MB 00:00 2023-05-10T01:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout:(11/120): cephfs-mirror-16.2.12-163.gc814f3c7.e 4.9 MB/s | 256 kB 00:00 2023-05-10T01:07:26.175 INFO:teuthology.orchestra.run.smithi172.stdout:(12/120): libcephfs-devel-16.2.12-163.gc814f3c7 774 kB/s | 25 kB 00:00 2023-05-10T01:07:26.238 INFO:teuthology.orchestra.run.smithi172.stdout:(13/120): libcephfs2-16.2.12-163.gc814f3c7.el8. 13 MB/s | 822 kB 00:00 2023-05-10T01:07:26.260 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 5/122 2023-05-10T01:07:26.277 INFO:teuthology.orchestra.run.smithi172.stdout:(14/120): libcephsqlite-16.2.12-163.gc814f3c7.e 4.4 MB/s | 174 kB 00:00 2023-05-10T01:07:26.315 INFO:teuthology.orchestra.run.smithi172.stdout:(15/120): librados-devel-16.2.12-163.gc814f3c7. 3.5 MB/s | 131 kB 00:00 2023-05-10T01:07:26.352 INFO:teuthology.orchestra.run.smithi172.stdout:(16/120): ceph-mon-16.2.12-163.gc814f3c7.el8.x8 2.3 MB/s | 5.0 MB 00:02 2023-05-10T01:07:26.366 INFO:teuthology.orchestra.run.smithi172.stdout:(17/120): libradosstriper1-16.2.12-163.gc814f3c 9.6 MB/s | 493 kB 00:00 2023-05-10T01:07:26.400 INFO:teuthology.orchestra.run.smithi172.stdout:(18/120): python3-ceph-argparse-16.2.12-163.gc8 1.3 MB/s | 45 kB 00:00 2023-05-10T01:07:26.436 INFO:teuthology.orchestra.run.smithi172.stdout:(19/120): python3-ceph-common-16.2.12-163.gc814 2.6 MB/s | 97 kB 00:00 2023-05-10T01:07:26.477 INFO:teuthology.orchestra.run.smithi172.stdout:(20/120): python3-cephfs-16.2.12-163.gc814f3c7. 5.2 MB/s | 215 kB 00:00 2023-05-10T01:07:26.480 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:07:26.524 INFO:teuthology.orchestra.run.smithi172.stdout:(21/120): python3-rados-16.2.12-163.gc814f3c7.e 8.1 MB/s | 389 kB 00:00 2023-05-10T01:07:26.572 INFO:teuthology.orchestra.run.smithi172.stdout:(22/120): python3-rbd-16.2.12-163.gc814f3c7.el8 7.6 MB/s | 368 kB 00:00 2023-05-10T01:07:26.610 INFO:teuthology.orchestra.run.smithi172.stdout:(23/120): python3-rgw-16.2.12-163.gc814f3c7.el8 3.0 MB/s | 114 kB 00:00 2023-05-10T01:07:26.617 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:07:26.646 INFO:teuthology.orchestra.run.smithi172.stdout:(24/120): rbd-fuse-16.2.12-163.gc814f3c7.el8.x8 2.4 MB/s | 88 kB 00:00 2023-05-10T01:07:26.872 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:07:26.914 INFO:teuthology.orchestra.run.smithi172.stdout:(25/120): rbd-mirror-16.2.12-163.gc814f3c7.el8. 14 MB/s | 3.7 MB 00:00 2023-05-10T01:07:26.957 INFO:teuthology.orchestra.run.smithi172.stdout:(26/120): rbd-nbd-16.2.12-163.gc814f3c7.el8.x86 3.9 MB/s | 173 kB 00:00 2023-05-10T01:07:26.978 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:07:26.992 INFO:teuthology.orchestra.run.smithi172.stdout:(27/120): ceph-grafana-dashboards-16.2.12-163.g 692 kB/s | 24 kB 00:00 2023-05-10T01:07:27.031 INFO:teuthology.orchestra.run.smithi172.stdout:(28/120): ceph-mgr-cephadm-16.2.12-163.gc814f3c 2.9 MB/s | 116 kB 00:00 2023-05-10T01:07:27.203 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 8/122 2023-05-10T01:07:27.252 INFO:teuthology.orchestra.run.smithi172.stdout:(29/120): ceph-mgr-dashboard-16.2.12-163.gc814f 14 MB/s | 3.1 MB 00:00 2023-05-10T01:07:27.714 INFO:teuthology.orchestra.run.smithi172.stdout:(30/120): librgw2-16.2.12-163.gc814f3c7.el8.x86 2.8 MB/s | 3.8 MB 00:01 2023-05-10T01:07:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-05-10T01:07:27.850 INFO:teuthology.orchestra.run.smithi172.stdout:(31/120): ceph-mgr-diskprediction-local-16.2.12 14 MB/s | 8.6 MB 00:00 2023-05-10T01:07:27.904 INFO:teuthology.orchestra.run.smithi172.stdout:(32/120): ceph-mgr-modules-core-16.2.12-163.gc8 1.3 MB/s | 243 kB 00:00 2023-05-10T01:07:27.905 INFO:teuthology.orchestra.run.smithi172.stdout:(33/120): ceph-mgr-rook-16.2.12-163.gc814f3c7.e 499 kB/s | 27 kB 00:00 2023-05-10T01:07:27.937 INFO:teuthology.orchestra.run.smithi172.stdout:(34/120): ceph-prometheus-alerts-16.2.12-163.gc 454 kB/s | 15 kB 00:00 2023-05-10T01:07:27.940 INFO:teuthology.orchestra.run.smithi172.stdout:(35/120): cephadm-16.2.12-163.gc814f3c7.el8.noa 2.3 MB/s | 84 kB 00:00 2023-05-10T01:07:27.970 INFO:teuthology.orchestra.run.smithi172.stdout:(36/120): cephfs-top-16.2.12-163.gc814f3c7.el8. 568 kB/s | 18 kB 00:00 2023-05-10T01:07:28.201 INFO:teuthology.orchestra.run.smithi172.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 782 kB/s | 181 kB 00:00 2023-05-10T01:07:28.211 INFO:teuthology.orchestra.run.smithi172.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-05-10T01:07:28.240 INFO:teuthology.orchestra.run.smithi172.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2023-05-10T01:07:28.250 INFO:teuthology.orchestra.run.smithi172.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.9 MB/s | 75 kB 00:00 2023-05-10T01:07:28.277 INFO:teuthology.orchestra.run.smithi172.stdout:(41/120): python3-apipkg-1.5-6.el8.noarch.rpm 582 kB/s | 21 kB 00:00 2023-05-10T01:07:28.287 INFO:teuthology.orchestra.run.smithi172.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.1 MB/s | 44 kB 00:00 2023-05-10T01:07:28.318 INFO:teuthology.orchestra.run.smithi172.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-05-10T01:07:28.327 INFO:teuthology.orchestra.run.smithi172.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 844 kB/s | 33 kB 00:00 2023-05-10T01:07:28.355 INFO:teuthology.orchestra.run.smithi172.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 446 kB/s | 16 kB 00:00 2023-05-10T01:07:28.369 INFO:teuthology.orchestra.run.smithi172.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.0 MB/s | 173 kB 00:00 2023-05-10T01:07:28.389 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:07:28.430 INFO:teuthology.orchestra.run.smithi172.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-05-10T01:07:28.444 INFO:teuthology.orchestra.run.smithi172.stdout:(48/120): python3-execnet-1.7.1-1.el8.noarch.rp 4.7 MB/s | 355 kB 00:00 2023-05-10T01:07:28.469 INFO:teuthology.orchestra.run.smithi172.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 2.1 MB/s | 81 kB 00:00 2023-05-10T01:07:28.485 INFO:teuthology.orchestra.run.smithi172.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 269 kB/s | 11 kB 00:00 2023-05-10T01:07:28.504 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:07:28.506 INFO:teuthology.orchestra.run.smithi172.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 482 kB/s | 18 kB 00:00 2023-05-10T01:07:28.546 INFO:teuthology.orchestra.run.smithi172.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2023-05-10T01:07:28.572 INFO:teuthology.orchestra.run.smithi172.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-05-10T01:07:28.586 INFO:teuthology.orchestra.run.smithi172.stdout:(54/120): python3-more-itertools-7.2.0-3.el8.no 1.5 MB/s | 59 kB 00:00 2023-05-10T01:07:28.614 INFO:teuthology.orchestra.run.smithi172.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.6 MB/s | 283 kB 00:00 2023-05-10T01:07:28.623 INFO:teuthology.orchestra.run.smithi172.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 424 kB/s | 16 kB 00:00 2023-05-10T01:07:28.657 INFO:teuthology.orchestra.run.smithi172.stdout:(57/120): python3-remoto-1.2.1-1.el8.noarch.rpm 1.1 MB/s | 49 kB 00:00 2023-05-10T01:07:28.661 INFO:teuthology.orchestra.run.smithi172.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 881 kB/s | 34 kB 00:00 2023-05-10T01:07:28.750 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-05-10T01:07:28.925 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-05-10T01:07:29.083 INFO:teuthology.orchestra.run.smithi172.stdout:(59/120): ceph-test-16.2.12-163.gc814f3c7.el8.x 17 MB/s | 51 MB 00:03 2023-05-10T01:07:29.084 INFO:teuthology.orchestra.run.smithi172.stdout:(60/120): python3-rsa-4.8-1.el8.noarch.rpm 145 kB/s | 61 kB 00:00 2023-05-10T01:07:29.086 INFO:teuthology.orchestra.run.smithi172.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 458 kB/s | 196 kB 00:00 2023-05-10T01:07:29.114 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:07:29.126 INFO:teuthology.orchestra.run.smithi172.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 577 kB/s | 24 kB 00:00 2023-05-10T01:07:29.127 INFO:teuthology.orchestra.run.smithi172.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 734 kB/s | 29 kB 00:00 2023-05-10T01:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 734 kB/s | 27 kB 00:00 2023-05-10T01:07:29.168 INFO:teuthology.orchestra.run.smithi172.stdout:(65/120): python3-waitress-1.2.1-2.el8.1.noarch 5.7 MB/s | 241 kB 00:00 2023-05-10T01:07:29.207 INFO:teuthology.orchestra.run.smithi172.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.8 MB/s | 251 kB 00:00 2023-05-10T01:07:29.209 INFO:teuthology.orchestra.run.smithi172.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2023-05-10T01:07:29.247 INFO:teuthology.orchestra.run.smithi172.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 2.1 MB/s | 85 kB 00:00 2023-05-10T01:07:29.248 INFO:teuthology.orchestra.run.smithi172.stdout:(69/120): python3-simplegeneric-0.8.1-17.el8.no 114 kB/s | 19 kB 00:00 2023-05-10T01:07:29.248 INFO:teuthology.orchestra.run.smithi172.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 598 kB/s | 23 kB 00:00 2023-05-10T01:07:29.251 INFO:teuthology.orchestra.run.smithi172.stdout:(71/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-05-10T01:07:29.257 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:07:29.278 INFO:teuthology.orchestra.run.smithi172.stdout:(72/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 624 kB/s | 19 kB 00:00 2023-05-10T01:07:29.283 INFO:teuthology.orchestra.run.smithi172.stdout:(73/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-05-10T01:07:29.296 INFO:teuthology.orchestra.run.smithi172.stdout:(74/120): python3-oauthlib-2.1.0-1.el8.noarch.r 3.4 MB/s | 155 kB 00:00 2023-05-10T01:07:29.297 INFO:teuthology.orchestra.run.smithi172.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.4 MB/s | 48 kB 00:00 2023-05-10T01:07:29.306 INFO:teuthology.orchestra.run.smithi172.stdout:(76/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.8 MB/s | 220 kB 00:00 2023-05-10T01:07:29.314 INFO:teuthology.orchestra.run.smithi172.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2023-05-10T01:07:29.315 INFO:teuthology.orchestra.run.smithi172.stdout:(78/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-05-10T01:07:29.329 INFO:teuthology.orchestra.run.smithi172.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2023-05-10T01:07:29.343 INFO:teuthology.orchestra.run.smithi172.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 6.0 MB/s | 83 kB 00:00 2023-05-10T01:07:29.345 INFO:teuthology.orchestra.run.smithi172.stdout:(81/120): pcre2-devel-10.32-2.el8.x86_64.rpm 20 MB/s | 605 kB 00:00 2023-05-10T01:07:29.358 INFO:teuthology.orchestra.run.smithi172.stdout:(82/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 44 MB/s | 2.3 MB 00:00 2023-05-10T01:07:29.360 INFO:teuthology.orchestra.run.smithi172.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 3.5 MB/s | 59 kB 00:00 2023-05-10T01:07:29.363 INFO:teuthology.orchestra.run.smithi172.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.1 MB/s | 169 kB 00:00 2023-05-10T01:07:29.374 INFO:teuthology.orchestra.run.smithi172.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.1 MB/s | 86 kB 00:00 2023-05-10T01:07:29.380 INFO:teuthology.orchestra.run.smithi172.stdout:(86/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.8 MB/s | 38 kB 00:00 2023-05-10T01:07:29.387 INFO:teuthology.orchestra.run.smithi172.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-05-10T01:07:29.389 INFO:teuthology.orchestra.run.smithi172.stdout:(88/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2023-05-10T01:07:29.401 INFO:teuthology.orchestra.run.smithi172.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-05-10T01:07:29.407 INFO:teuthology.orchestra.run.smithi172.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.0 MB/s | 70 kB 00:00 2023-05-10T01:07:29.409 INFO:teuthology.orchestra.run.smithi172.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 28 MB/s | 639 kB 00:00 2023-05-10T01:07:29.419 INFO:teuthology.orchestra.run.smithi172.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 11 MB/s | 200 kB 00:00 2023-05-10T01:07:29.423 INFO:teuthology.orchestra.run.smithi172.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.8 MB/s | 97 kB 00:00 2023-05-10T01:07:29.436 INFO:teuthology.orchestra.run.smithi172.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.5 MB/s | 44 kB 00:00 2023-05-10T01:07:29.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 14/122 2023-05-10T01:07:29.442 INFO:teuthology.orchestra.run.smithi172.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2023-05-10T01:07:29.454 INFO:teuthology.orchestra.run.smithi172.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 8.8 MB/s | 161 kB 00:00 2023-05-10T01:07:29.462 INFO:teuthology.orchestra.run.smithi172.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-05-10T01:07:29.474 INFO:teuthology.orchestra.run.smithi172.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-05-10T01:07:29.490 INFO:teuthology.orchestra.run.smithi172.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.5 MB/s | 39 kB 00:00 2023-05-10T01:07:29.515 INFO:teuthology.orchestra.run.smithi172.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 28 MB/s | 688 kB 00:00 2023-05-10T01:07:29.524 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 14/122 2023-05-10T01:07:29.531 INFO:teuthology.orchestra.run.smithi172.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 15 MB/s | 259 kB 00:00 2023-05-10T01:07:29.552 INFO:teuthology.orchestra.run.smithi172.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 53 MB/s | 4.8 MB 00:00 2023-05-10T01:07:29.556 INFO:teuthology.orchestra.run.smithi172.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.1 MB/s | 225 kB 00:00 2023-05-10T01:07:29.569 INFO:teuthology.orchestra.run.smithi172.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.4 MB/s | 126 kB 00:00 2023-05-10T01:07:29.590 INFO:teuthology.orchestra.run.smithi172.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.9 MB/s | 187 kB 00:00 2023-05-10T01:07:29.611 INFO:teuthology.orchestra.run.smithi172.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-05-10T01:07:29.709 INFO:teuthology.orchestra.run.smithi172.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 49 MB/s | 15 MB 00:00 2023-05-10T01:07:29.714 INFO:teuthology.orchestra.run.smithi172.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.9 MB/s | 302 kB 00:00 2023-05-10T01:07:29.730 INFO:teuthology.orchestra.run.smithi172.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-05-10T01:07:29.731 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-05-10T01:07:29.732 INFO:teuthology.orchestra.run.smithi172.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.3 MB/s | 110 kB 00:00 2023-05-10T01:07:29.732 INFO:teuthology.orchestra.run.smithi172.stdout:(111/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.8 MB/s | 157 kB 00:00 2023-05-10T01:07:29.747 INFO:teuthology.orchestra.run.smithi172.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.3 MB/s | 20 kB 00:00 2023-05-10T01:07:29.750 INFO:teuthology.orchestra.run.smithi172.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-05-10T01:07:29.757 INFO:teuthology.orchestra.run.smithi172.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 29 MB/s | 709 kB 00:00 2023-05-10T01:07:29.763 INFO:teuthology.orchestra.run.smithi172.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.3 MB/s | 54 kB 00:00 2023-05-10T01:07:29.791 INFO:teuthology.orchestra.run.smithi172.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2023-05-10T01:07:29.834 INFO:teuthology.orchestra.run.smithi172.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 56 MB/s | 4.7 MB 00:00 2023-05-10T01:07:29.851 INFO:teuthology.orchestra.run.smithi172.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 49 MB/s | 4.6 MB 00:00 2023-05-10T01:07:30.005 INFO:teuthology.orchestra.run.smithi172.stdout:(119/120): librados2-16.2.12-163.gc814f3c7.el8. 18 MB/s | 3.7 MB 00:00 2023-05-10T01:07:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-05-10T01:07:30.288 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-05-10T01:07:30.460 INFO:teuthology.orchestra.run.smithi172.stdout:(120/120): librbd1-16.2.12-163.gc814f3c7.el8.x8 6.7 MB/s | 4.2 MB 00:00 2023-05-10T01:07:30.466 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-05-10T01:07:30.466 INFO:teuthology.orchestra.run.smithi172.stdout:Total 27 MB/s | 200 MB 00:07 2023-05-10T01:07:30.484 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-05-10T01:07:30.513 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-05-10T01:07:30.626 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-05-10T01:07:30.627 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-05-10T01:07:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-10T01:07:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-10T01:07:30.955 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-10T01:07:31.580 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-10T01:07:31.780 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-10T01:07:32.303 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-05-10T01:07:32.308 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-05-10T01:07:32.334 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-10T01:07:32.663 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-05-10T01:07:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-05-10T01:07:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-05-10T01:07:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-05-10T01:07:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-05-10T01:07:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:16.2.12-163.gc814f3c7.el8. 26/122 2023-05-10T01:07:34.946 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el 27/122 2023-05-10T01:07:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_6 28/122 2023-05-10T01:07:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-05-10T01:07:35.845 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-05-10T01:07:36.104 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-10T01:07:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-05-10T01:07:37.234 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-05-10T01:07:37.471 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-05-10T01:07:37.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-10T01:07:37.810 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-05-10T01:07:38.049 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-10T01:07:38.316 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-10T01:07:38.433 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-05-10T01:07:38.674 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 5/122 2023-05-10T01:07:38.825 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-05-10T01:07:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 5/122 2023-05-10T01:07:39.290 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:07:39.420 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:07:39.640 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:07:39.733 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:07:39.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 8/122 2023-05-10T01:07:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-05-10T01:07:40.517 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-05-10T01:07:40.674 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:07:40.765 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:07:40.840 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-05-10T01:07:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-05-10T01:07:41.109 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-05-10T01:07:41.206 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-05-10T01:07:41.387 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/122 2023-05-10T01:07:41.432 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:07:41.536 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:07:41.600 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-05-10T01:07:41.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 14/122 2023-05-10T01:07:41.769 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 14/122 2023-05-10T01:07:41.882 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 38/122 2023-05-10T01:07:41.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-05-10T01:07:42.093 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 39/122 2023-05-10T01:07:42.272 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-05-10T01:07:42.403 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_6 40/122 2023-05-10T01:07:42.505 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-05-10T01:07:42.665 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-05-10T01:07:42.694 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-05-10T01:07:42.848 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-10T01:07:42.885 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-05-10T01:07:42.971 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-05-10T01:07:43.107 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-05-10T01:07:43.156 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-10T01:07:43.299 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-05-10T01:07:43.637 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-10T01:07:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-05-10T01:07:43.719 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-10T01:07:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-10T01:07:43.906 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-05-10T01:07:44.104 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-05-10T01:07:44.319 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-05-10T01:07:44.426 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-05-10T01:07:44.526 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-05-10T01:07:44.631 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-05-10T01:07:44.749 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-05-10T01:07:44.931 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-05-10T01:07:45.076 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-05-10T01:07:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-05-10T01:07:45.357 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-05-10T01:07:45.500 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-05-10T01:07:45.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-05-10T01:07:45.832 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-05-10T01:07:45.958 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-05-10T01:07:46.074 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-05-10T01:07:46.220 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-05-10T01:07:46.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-05-10T01:07:46.420 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:16.2.12-163.gc814f3c7.el8. 26/122 2023-05-10T01:07:46.553 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el 27/122 2023-05-10T01:07:46.691 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-05-10T01:07:46.847 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_6 28/122 2023-05-10T01:07:46.887 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-05-10T01:07:47.120 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-05-10T01:07:47.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-05-10T01:07:47.421 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-05-10T01:07:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-05-10T01:07:47.672 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-10T01:07:47.688 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/122 2023-05-10T01:07:47.918 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-05-10T01:07:48.059 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-05-10T01:07:48.234 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-05-10T01:07:48.462 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-05-10T01:07:48.729 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-05-10T01:07:48.999 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-05-10T01:07:49.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-05-10T01:07:49.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-05-10T01:07:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-05-10T01:07:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-05-10T01:07:50.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-05-10T01:07:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-05-10T01:07:50.464 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-05-10T01:07:50.720 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-05-10T01:07:50.939 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-05-10T01:07:51.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-05-10T01:07:51.211 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-05-10T01:07:51.534 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-05-10T01:07:51.783 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-05-10T01:07:52.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/122 2023-05-10T01:07:52.258 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-05-10T01:07:52.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 38/122 2023-05-10T01:07:52.577 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-05-10T01:07:52.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 39/122 2023-05-10T01:07:52.919 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-05-10T01:07:53.155 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-05-10T01:07:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_6 40/122 2023-05-10T01:07:53.437 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-05-10T01:07:53.494 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-05-10T01:07:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-05-10T01:07:53.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-05-10T01:07:53.930 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-05-10T01:07:54.076 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-05-10T01:07:54.169 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-05-10T01:07:54.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-10T01:07:54.333 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-05-10T01:07:54.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-05-10T01:07:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-05-10T01:07:54.728 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-05-10T01:07:54.741 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-05-10T01:07:54.934 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-05-10T01:07:55.103 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-05-10T01:07:55.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-05-10T01:07:55.294 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-05-10T01:07:55.315 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-05-10T01:07:55.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-05-10T01:07:55.553 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-05-10T01:07:55.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-05-10T01:07:55.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-05-10T01:07:56.050 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-05-10T01:07:56.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-05-10T01:07:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-05-10T01:07:56.940 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-05-10T01:07:57.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-05-10T01:07:57.421 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-05-10T01:07:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-05-10T01:07:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-05-10T01:07:58.163 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/122 2023-05-10T01:07:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-05-10T01:07:58.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-05-10T01:07:58.726 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-05-10T01:07:58.952 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-05-10T01:07:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-05-10T01:07:59.382 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-05-10T01:07:59.607 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-05-10T01:07:59.912 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-05-10T01:08:00.143 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-05-10T01:08:00.361 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-05-10T01:08:00.708 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-05-10T01:08:00.756 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:00.979 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-05-10T01:08:01.002 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:01.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-05-10T01:08:01.485 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-05-10T01:08:01.744 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:02.084 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 89/122 2023-05-10T01:08:02.174 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 89/122 2023-05-10T01:08:02.326 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 90/122 2023-05-10T01:08:02.624 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-05-10T01:08:02.959 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-05-10T01:08:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-05-10T01:08:03.510 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-05-10T01:08:03.848 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-05-10T01:08:04.068 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-05-10T01:08:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-05-10T01:08:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-05-10T01:08:04.879 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-05-10T01:08:05.087 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-05-10T01:08:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-05-10T01:08:10.054 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 88/122 2023-05-10T01:08:11.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 89/122 2023-05-10T01:08:11.429 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 89/122 2023-05-10T01:08:11.568 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 90/122 2023-05-10T01:08:20.462 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 90/122 2023-05-10T01:08:20.462 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /run 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2023-05-10T01:08:20.463 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2023-05-10T01:08:20.464 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-05-10T01:08:20.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:20.875 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 91/122 2023-05-10T01:08:21.335 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 91/122 2023-05-10T01:08:21.532 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 92/122 2023-05-10T01:08:23.111 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 92/122 2023-05-10T01:08:23.307 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 93/122 2023-05-10T01:08:23.329 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 93/122 2023-05-10T01:08:26.185 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 94/122 2023-05-10T01:08:26.348 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 94/122 2023-05-10T01:08:26.547 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.e 95/122 2023-05-10T01:08:26.762 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7. 96/122 2023-05-10T01:08:26.964 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 97/122 2023-05-10T01:08:27.973 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 97/122 2023-05-10T01:08:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 98/122 2023-05-10T01:08:29.111 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 90/122 2023-05-10T01:08:29.111 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2023-05-10T01:08:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2023-05-10T01:08:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-05-10T01:08:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /run 2023-05-10T01:08:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2023-05-10T01:08:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2023-05-10T01:08:29.113 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2023-05-10T01:08:29.113 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2023-05-10T01:08:29.113 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-05-10T01:08:29.113 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:29.397 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 98/122 2023-05-10T01:08:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 91/122 2023-05-10T01:08:29.614 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 99/122 2023-05-10T01:08:29.714 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 99/122 2023-05-10T01:08:29.935 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 91/122 2023-05-10T01:08:30.126 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el 100/122 2023-05-10T01:08:30.132 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 92/122 2023-05-10T01:08:30.355 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 101/122 2023-05-10T01:08:30.383 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 101/122 2023-05-10T01:08:30.533 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 102/122 2023-05-10T01:08:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 102/122 2023-05-10T01:08:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 92/122 2023-05-10T01:08:31.676 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 103/122 2023-05-10T01:08:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 93/122 2023-05-10T01:08:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 93/122 2023-05-10T01:08:31.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 104/122 2023-05-10T01:08:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 104/122 2023-05-10T01:08:32.189 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:16.2.12-163.gc814f 105/122 2023-05-10T01:08:32.232 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.12-163.gc814f 105/122 2023-05-10T01:08:32.398 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 106/122 2023-05-10T01:08:32.764 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 106/122 2023-05-10T01:08:32.898 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 107/122 2023-05-10T01:08:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 94/122 2023-05-10T01:08:34.680 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 94/122 2023-05-10T01:08:34.804 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.e 95/122 2023-05-10T01:08:35.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7. 96/122 2023-05-10T01:08:35.230 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 97/122 2023-05-10T01:08:36.180 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 97/122 2023-05-10T01:08:36.493 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 98/122 2023-05-10T01:08:37.538 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 98/122 2023-05-10T01:08:37.689 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 107/122 2023-05-10T01:08:37.746 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 99/122 2023-05-10T01:08:37.841 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 99/122 2023-05-10T01:08:38.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el 100/122 2023-05-10T01:08:38.394 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 101/122 2023-05-10T01:08:38.420 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 101/122 2023-05-10T01:08:38.605 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 102/122 2023-05-10T01:08:38.616 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 102/122 2023-05-10T01:08:38.646 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 108/122 2023-05-10T01:08:39.075 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-05-10T01:08:39.274 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 110/122 2023-05-10T01:08:39.542 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-05-10T01:08:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 103/122 2023-05-10T01:08:39.688 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-05-10T01:08:39.699 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-05-10T01:08:39.885 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_ 113/122 2023-05-10T01:08:39.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 104/122 2023-05-10T01:08:39.958 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 104/122 2023-05-10T01:08:40.068 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-05-10T01:08:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:16.2.12-163.gc814f 105/122 2023-05-10T01:08:40.181 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.12-163.gc814f 105/122 2023-05-10T01:08:40.247 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 115/122 2023-05-10T01:08:40.322 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 106/122 2023-05-10T01:08:40.446 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 116/122 2023-05-10T01:08:40.666 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 106/122 2023-05-10T01:08:40.710 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 117/122 2023-05-10T01:08:40.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 107/122 2023-05-10T01:08:40.938 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-05-10T01:08:41.003 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-05-10T01:08:41.204 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-05-10T01:08:41.214 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-05-10T01:08:41.365 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-05-10T01:08:41.366 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-10T01:08:41.591 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-10T01:08:41.592 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:42.189 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:42.189 INFO:teuthology.orchestra.run.smithi052.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-10T01:08:42.189 INFO:teuthology.orchestra.run.smithi052.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-10T01:08:42.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:42.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 1/122 2023-05-10T01:08:42.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 2/122 2023-05-10T01:08:42.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 3/122 2023-05-10T01:08:42.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 4/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:16.2.12-163.gc814f 5/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 8/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 9/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:08:42.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 11/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 12/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_ 14/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 15/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 16/122 2023-05-10T01:08:42.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_6 17/122 2023-05-10T01:08:42.542 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 18/122 2023-05-10T01:08:42.542 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 19/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el 20/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:16.2.12-163.gc814f3c7.el8. 21/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_6 22/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 23/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 24/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 25/122 2023-05-10T01:08:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 26/122 2023-05-10T01:08:42.544 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 27/122 2023-05-10T01:08:42.549 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 28/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7. 29/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 30/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 31/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 32/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el 33/122 2023-05-10T01:08:42.550 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 34/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.e 35/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 36/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 37/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-05-10T01:08:42.551 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-05-10T01:08:42.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-05-10T01:08:42.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-05-10T01:08:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-05-10T01:08:42.555 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-05-10T01:08:42.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-05-10T01:08:42.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-05-10T01:08:42.558 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-05-10T01:08:42.559 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-05-10T01:08:42.560 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 119/122 2023-05-10T01:08:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-05-10T01:08:42.562 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 121/122 2023-05-10T01:08:44.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:44.992 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:45 ago on Wed 10 May 2023 01:06:59 AM UTC. 2023-05-10T01:08:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 107/122 2023-05-10T01:08:46.261 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 108/122 2023-05-10T01:08:46.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-05-10T01:08:46.833 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 110/122 2023-05-10T01:08:47.086 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-05-10T01:08:47.251 INFO:teuthology.orchestra.run.smithi052.stdout:Installed products updated. 2023-05-10T01:08:47.287 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-05-10T01:08:47.298 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-05-10T01:08:47.427 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.1-7.el8.noarch 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.0.4-10.el8.x86_64 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.428 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.430 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.1-9.el8.x86_64 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.7-12.el8.x86_64 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-10T01:08:47.431 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.5-12.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: leveldb-1.22-1.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.432 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.433 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-10T01:08:47.434 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.12-1.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-10T01:08:47.435 INFO:teuthology.orchestra.run.smithi052.stdout: python3-apipkg-1.5-6.el8.noarch 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.5.1-5.el8.noarch 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.436 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-10T01:08:47.437 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-10T01:08:47.438 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-2.6-1.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-10T01:08:47.439 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-10T01:08:47.440 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-10T01:08:47.441 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.442 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:47.443 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.3.3-2.el8.x86_64 2023-05-10T01:08:47.443 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-05-10T01:08:47.443 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-10T01:08:47.443 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-05-10T01:08:47.444 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:47.444 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-05-10T01:08:47.467 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_ 113/122 2023-05-10T01:08:47.634 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-05-10T01:08:47.672 DEBUG:teuthology.parallel:result is None 2023-05-10T01:08:47.786 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 115/122 2023-05-10T01:08:48.003 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 116/122 2023-05-10T01:08:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 117/122 2023-05-10T01:08:48.511 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-05-10T01:08:48.572 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-05-10T01:08:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-05-10T01:08:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-05-10T01:08:48.939 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-05-10T01:08:48.939 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-10T01:08:49.173 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-05-10T01:08:49.173 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:49.714 INFO:teuthology.orchestra.run.smithi172.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-10T01:08:49.714 INFO:teuthology.orchestra.run.smithi172.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-10T01:08:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 1/122 2023-05-10T01:08:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 2/122 2023-05-10T01:08:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 3/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 4/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:16.2.12-163.gc814f 5/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 6/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 7/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 8/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 9/122 2023-05-10T01:08:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 10/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 11/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 12/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 13/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_ 14/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 15/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 16/122 2023-05-10T01:08:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_6 17/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86 18/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 19/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el 20/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:16.2.12-163.gc814f3c7.el8. 21/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_6 22/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 23/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 24/122 2023-05-10T01:08:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 25/122 2023-05-10T01:08:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 26/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 27/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 28/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7. 29/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noa 30/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.n 31/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.12-163.gc81 32/122 2023-05-10T01:08:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el 33/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 34/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.e 35/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 36/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 37/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-05-10T01:08:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-05-10T01:08:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-05-10T01:08:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 61/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-05-10T01:08:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-05-10T01:08:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-05-10T01:08:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-05-10T01:08:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-05-10T01:08:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-05-10T01:08:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-05-10T01:08:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-05-10T01:08:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-05-10T01:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 119/122 2023-05-10T01:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-05-10T01:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 121/122 2023-05-10T01:08:52.426 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-05-10T01:08:52.427 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:38 ago on Wed 10 May 2023 01:07:14 AM UTC. 2023-05-10T01:08:54.671 INFO:teuthology.orchestra.run.smithi172.stdout:Installed products updated. 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-05-10T01:08:54.843 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.1-7.el8.noarch 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.0.4-10.el8.x86_64 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.844 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.845 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.846 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:16.2.12-163.gc814f3c7.el8.noarch 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.1-9.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.7-12.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: jq-1.5-12.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-05-10T01:08:54.847 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: leveldb-1.22-1.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-05-10T01:08:54.848 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.849 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-10T01:08:54.850 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.12-1.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: python3-apipkg-1.5-6.el8.noarch 2023-05-10T01:08:54.851 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.5.1-5.el8.noarch 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.852 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-05-10T01:08:54.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-10T01:08:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-2.6-1.el8.noarch 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-10T01:08:54.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-10T01:08:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-10T01:08:54.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.858 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:16.2.12-163.gc814f3c7.el8.x86_64 2023-05-10T01:08:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.3.3-2.el8.x86_64 2023-05-10T01:08:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-05-10T01:08:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-10T01:08:54.859 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-05-10T01:08:54.860 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:54.860 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-05-10T01:08:55.075 DEBUG:teuthology.parallel:result is None 2023-05-10T01:08:55.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c814f3c7f7433199e106dca4409cff1756915911 2023-05-10T01:08:55.218 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-10T01:08:55.239 INFO:teuthology.orchestra.run.smithi052.stdout:16.2.12-163.gc814f3c7.el8 2023-05-10T01:08:55.240 INFO:teuthology.packaging:The installed version of ceph is 16.2.12-163.gc814f3c7.el8 2023-05-10T01:08:55.240 INFO:teuthology.task.install:The correct ceph version 16.2.12-163.gc814f3c7 is installed. 2023-05-10T01:08:55.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c814f3c7f7433199e106dca4409cff1756915911 2023-05-10T01:08:55.374 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-10T01:08:55.395 INFO:teuthology.orchestra.run.smithi172.stdout:16.2.12-163.gc814f3c7.el8 2023-05-10T01:08:55.396 INFO:teuthology.packaging:The installed version of ceph is 16.2.12-163.gc814f3c7.el8 2023-05-10T01:08:55.396 INFO:teuthology.task.install:The correct ceph version 16.2.12-163.gc814f3c7 is installed. 2023-05-10T01:08:55.396 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-10T01:08:55.397 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:55.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-10T01:08:55.436 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:55.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-10T01:08:55.473 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-10T01:08:55.474 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:55.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2023-05-10T01:08:55.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-10T01:08:55.567 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:55.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-05-10T01:08:55.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-10T01:08:55.654 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-10T01:08:55.655 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:55.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-10T01:08:55.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-10T01:08:55.745 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:55.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-10T01:08:55.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-10T01:08:55.832 INFO:teuthology.run_tasks:Running task ceph... 2023-05-10T01:08:55.908 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-10T01:08:55.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2023-05-10T01:08:55.911 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2023-05-10T01:08:55.934 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-10T01:08:55.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-10T01:08:55.976 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-10T01:08:55.999 INFO:tasks.ceph:Creating extra log directories... 2023-05-10T01:08:55.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-10T01:08:56.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-10T01:08:56.070 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-10T01:08:56.071 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-10T01:08:56.071 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-10T01:08:56.071 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:56.072 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-10T01:08:56.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-10T01:08:56.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-10T01:08:56.260 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:56.260 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-10T01:08:56.274 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-10T01:08:56.390 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-10T01:08:56.428 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-10T01:08:56.428 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-10T01:08:56.428 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972', 'branch': 'wip-yuri4-testing-2023-05-08-0846-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7268972', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-05-08-0846-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-05-08-0846-pacific', 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 84, 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-05-08-0846-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_c814f3c7f7433199e106dca4409cff1756915911/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'c814f3c7f7433199e106dca4409cff1756915911', 'targets': {'smithi052.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn8M4DEYMBQSaidVZ9ULUvt4ddwZSTnajhnGeFjLTr3dHVIkJH+6t0Ei/g4hw5sxumtoQ/tCQ0FdY6enwgPfuXdv3Nj9vfIH9iciOOkGyE1CjX3Nw4GWJRu7pZlCMQrA6vbB5+A0GVr183koWPnrOFpEAYbErtOWj8Apb4AMfxKqfZ9rHk5kXD9J63AMUVUuxe/oWR3n6/4NjV/5ii9FaaaJeVCAMqy9sSCLk04+ghJOsn2EbieCohBOzWoAANzyhMO+l+jHnzvsr3BIN+jLnI7w07ULCcowJknhAIHytMBfGSyBhK3iZvvY6xtv7/b1H3A0Tl8sji6RYhFa6xDFD3cg9WUzdZH2L6Xrty3ahBpGwfrAstsAxm6xIEfgNmVv8CBH/xcHAKWAdVvLjCzQVsfXKt2yBm8GPmL3DlYKn5+GOGDjk53hwZ3SURtdlWPBBQntX9IZyZKt/1LL4cvOuO2NLcijDD94mO66A2G8Qs/16/NuZ2DUn+cxAcTssPzQU=', 'smithi172.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHRORxFf3uSeBh7H+Iem6myfyxzSL3Cg3zOXur0Bk+jd3kU0T4nrlGHnFGi7DCFReNvkn/LqSgTT3TP0gr60KTaAPRthH+8H4Fr5XdbBX+ch7gbpSROZcSn7bKcEmxDk6Mz7TX8doSB7wb17Jg1gbEjr6es3+daitdC/H4Jl62jOKCOF64xA+F6oMl4d2bi8QyxFvfefOTwtY5CffgXIZfkEL6HqceVgnONw1xvMH8EC8PUrDr7ZR4SiVtz9cCHvFwODEf0oG6XyoOCT6BFpHwLGtY3Bet6frVguKwaLpSgLN87071SAxpvxTMOMiao3AIAtBIp6NgDy2vhjZpilmtIym3p3uak63cTL5FRN8Hm+snqFna9gqwjeNYBNZ+yCl4hk/zE+5CuzWe8RGhsZZUyPgxBAQnD1/sPvRaTMWKPIRR/e8e+4k/yOqifwrxgjDcofnAQq83IkyAxvh8gkkc5Ws5mS0jxBTmI9BQlzAzPnC39VtDR/HcoXr9MGy8Ga0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c814f3c7f7433199e106dca4409cff1756915911'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-09_19:39:46', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-10T01:08:56.429 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-10T01:08:56.431 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-10T01:08:56.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2023-05-10T01:08:56.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2023-05-10T01:08:56.539 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:56.540 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2023-05-10T01:08:56.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-10T01:08:56.562 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2023-05-10T01:08:56.617 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-10T01:08:56.617 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 210857 Links: 1 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-05-10 01:08:42.102132555 +0000 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-05-10 01:06:11.665699922 +0000 2023-05-10T01:08:56.618 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-05-10 01:06:11.665699922 +0000 2023-05-10T01:08:56.619 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-05-10T01:08:56.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-10T01:08:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-05-10T01:08:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-05-10T01:08:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000116624 s, 4.4 MB/s 2023-05-10T01:08:56.682 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-10T01:08:56.738 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2023-05-10T01:08:56.793 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 210905 Links: 1 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-05-10 01:08:42.102132555 +0000 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-05-10 01:06:12.193692886 +0000 2023-05-10T01:08:56.794 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-05-10 01:06:12.193692886 +0000 2023-05-10T01:08:56.795 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-05-10T01:08:56.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-10T01:08:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-05-10T01:08:56.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-05-10T01:08:56.858 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.3173e-05 s, 5.5 MB/s 2023-05-10T01:08:56.859 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-10T01:08:56.914 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2023-05-10T01:08:56.968 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 211891 Links: 1 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-05-10 01:08:42.102132555 +0000 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-05-10 01:06:12.693686223 +0000 2023-05-10T01:08:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-05-10 01:06:12.693686223 +0000 2023-05-10T01:08:56.970 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-05-10T01:08:56.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-10T01:08:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-05-10T01:08:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-05-10T01:08:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000110673 s, 4.6 MB/s 2023-05-10T01:08:57.034 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-10T01:08:57.089 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2023-05-10T01:08:57.144 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-10T01:08:57.144 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 215237 Links: 1 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-05-10 01:08:42.102132555 +0000 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-05-10 01:06:13.220679200 +0000 2023-05-10T01:08:57.145 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-05-10 01:06:13.220679200 +0000 2023-05-10T01:08:57.146 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-05-10T01:08:57.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-10T01:08:57.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-05-10T01:08:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-05-10T01:08:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.4698e-05 s, 5.4 MB/s 2023-05-10T01:08:57.210 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-10T01:08:57.266 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T01:08:57.266 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:57.267 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-05-10T01:08:57.280 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-10T01:08:57.281 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-05-10T01:08:57.335 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-10T01:08:57.335 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 209222 Links: 1 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-05-10 01:08:49.632628452 +0000 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-05-10 01:01:35.710566198 +0000 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-05-10 01:01:35.710566198 +0000 2023-05-10T01:08:57.336 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-05-10T01:08:57.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-10T01:08:57.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-05-10T01:08:57.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-05-10T01:08:57.398 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000227488 s, 2.3 MB/s 2023-05-10T01:08:57.399 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-10T01:08:57.454 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-05-10T01:08:57.508 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-10T01:08:57.508 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:57.508 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 208518 Links: 1 2023-05-10T01:08:57.508 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:57.508 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-05-10 01:08:49.633628429 +0000 2023-05-10T01:08:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-05-10 01:01:36.205554331 +0000 2023-05-10T01:08:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-05-10 01:01:36.205554331 +0000 2023-05-10T01:08:57.509 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-05-10T01:08:57.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-10T01:08:57.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-05-10T01:08:57.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-05-10T01:08:57.572 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000196571 s, 2.6 MB/s 2023-05-10T01:08:57.574 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-10T01:08:57.629 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-05-10T01:08:57.685 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-10T01:08:57.685 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:57.685 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 213065 Links: 1 2023-05-10T01:08:57.685 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:57.685 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:57.686 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-05-10 01:08:49.633628429 +0000 2023-05-10T01:08:57.686 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-05-10 01:01:36.709542248 +0000 2023-05-10T01:08:57.686 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-05-10 01:01:36.709542248 +0000 2023-05-10T01:08:57.686 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-05-10T01:08:57.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-10T01:08:57.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-05-10T01:08:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-05-10T01:08:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000197589 s, 2.6 MB/s 2023-05-10T01:08:57.748 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-10T01:08:57.803 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-05-10T01:08:57.856 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-10T01:08:57.857 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T01:08:57.857 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 213223 Links: 1 2023-05-10T01:08:57.857 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T01:08:57.857 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T01:08:57.857 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-05-10 01:08:49.633628429 +0000 2023-05-10T01:08:57.858 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-05-10 01:01:37.242529470 +0000 2023-05-10T01:08:57.858 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-05-10 01:01:37.242529470 +0000 2023-05-10T01:08:57.858 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-05-10T01:08:57.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-10T01:08:57.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-05-10T01:08:57.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-05-10T01:08:57.920 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000185727 s, 2.8 MB/s 2023-05-10T01:08:57.922 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-10T01:08:57.976 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T01:08:57.977 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-10T01:08:57.977 INFO:tasks.ceph:Generating config... 2023-05-10T01:08:57.979 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-10T01:08:57.979 INFO:tasks.ceph:[client] debug client = 20 2023-05-10T01:08:57.979 INFO:tasks.ceph:[client] debug ms = 1 2023-05-10T01:08:57.979 INFO:tasks.ceph:[client] pid file = 2023-05-10T01:08:57.979 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-10T01:08:57.980 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-10T01:08:57.980 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-05-10T01:08:57.980 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-10T01:08:57.980 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-10T01:08:57.981 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-10T01:08:57.981 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-10T01:08:57.981 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-10T01:08:57.981 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-10T01:08:57.981 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-10T01:08:57.982 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-10T01:08:57.982 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-10T01:08:57.982 INFO:tasks.ceph:[mgr] debug client = 20 2023-05-10T01:08:57.982 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-05-10T01:08:57.982 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-10T01:08:57.983 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-10T01:08:57.983 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-10T01:08:57.983 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-10T01:08:57.983 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-10T01:08:57.983 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-10T01:08:57.984 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-10T01:08:57.984 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-10T01:08:57.984 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-10T01:08:57.984 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-10T01:08:57.984 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-10T01:08:57.985 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-10T01:08:57.985 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-10T01:08:57.985 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-10T01:08:57.985 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-10T01:08:57.985 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-10T01:08:57.986 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-10T01:08:57.986 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-10T01:08:57.986 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-10T01:08:57.986 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-10T01:08:57.987 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-10T01:08:57.987 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-10T01:08:57.987 INFO:tasks.ceph:Setting up mon.a... 2023-05-10T01:08:57.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-10T01:08:58.105 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2023-05-10T01:08:58.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-10T01:08:58.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T01:08:58.210 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.172'), ('mon.c', '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]')] 2023-05-10T01:08:58.211 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-10T01:08:58.212 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:58.212 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-10T01:08:58.265 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.172 --addv c '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:08:58.345 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:08:58.345 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 81a74aef-38e3-473f-8c9a-a859f40ac8ae 2023-05-10T01:08:58.345 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 81a74aef-38e3-473f-8c9a-a859f40ac8ae 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2023-05-10T01:08:58.343245+0000 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:created 2023-05-10T01:08:58.343245+0000 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 0 (unknown) 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-05-10T01:08:58.346 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2023-05-10T01:08:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] mon.c 2023-05-10T01:08:58.347 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-10T01:08:58.348 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-10T01:08:58.402 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 81a74aef-38e3-473f-8c9a-a859f40ac8ae... 2023-05-10T01:08:58.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-10T01:08:58.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-10T01:08:58.492 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2023-05-10T01:08:58.493 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2023-05-10T01:08:58.493 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-10T01:08:58.493 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2023-05-10T01:08:58.493 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.493 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.494 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.495 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2023-05-10T01:08:58.496 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-10T01:08:58.497 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.498 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 81a74aef-38e3-473f-8c9a-a859f40ac8ae 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.499 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.500 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2023-05-10T01:08:58.501 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2023-05-10T01:08:58.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2023-05-10T01:08:58.503 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-05-10T01:08:58.504 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2023-05-10T01:08:58.505 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-05-10T01:08:58.506 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: debug finisher = 20 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2023-05-10T01:08:58.507 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-05-10T01:08:58.508 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-05-10T01:08:58.508 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2023-05-10T01:08:58.508 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-05-10T01:08:58.508 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-05-10T01:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-10T01:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2023-05-10T01:08:58.511 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-05-10T01:08:58.512 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-05-10T01:08:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2023-05-10T01:08:58.514 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2023-05-10T01:08:58.515 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-05-10T01:08:58.515 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-05-10T01:08:58.515 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-05-10T01:08:58.516 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2023-05-10T01:08:58.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2023-05-10T01:08:58.518 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-10T01:08:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2023-05-10T01:08:58.520 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.521 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2023-05-10T01:08:58.522 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.52,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 81a74aef-38e3-473f-8c9a-a859f40ac8ae 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2023-05-10T01:08:58.523 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2023-05-10T01:08:58.524 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2023-05-10T01:08:58.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2023-05-10T01:08:58.526 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2023-05-10T01:08:58.527 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2023-05-10T01:08:58.528 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.529 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2023-05-10T01:08:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: debug finisher = 20 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2023-05-10T01:08:58.531 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-05-10T01:08:58.532 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-10T01:08:58.533 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2023-05-10T01:08:58.534 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-05-10T01:08:58.535 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2023-05-10T01:08:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2023-05-10T01:08:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2023-05-10T01:08:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-05-10T01:08:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-05-10T01:08:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2023-05-10T01:08:58.537 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2023-05-10T01:08:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-05-10T01:08:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-05-10T01:08:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-05-10T01:08:58.538 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-10T01:08:58.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-10T01:08:58.613 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-10T01:08:58.613 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:58.613 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-10T01:08:58.627 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:58.628 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-10T01:08:58.683 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:08:58.683 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:58.683 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-10T01:08:58.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T01:08:58.758 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:08:58.759 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:08:58.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:08:58.813 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:58.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-10T01:08:58.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T01:08:58.845 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:08:58.846 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:08:58.899 INFO:tasks.ceph:Setting up mon nodes... 2023-05-10T01:08:58.899 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-10T01:08:58.900 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-10T01:08:58.950 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-10T01:08:58.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-10T01:08:59.009 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-10T01:08:59.011 INFO:tasks.ceph:Setting up mds nodes... 2023-05-10T01:08:59.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-10T01:08:59.060 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-10T01:08:59.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-10T01:08:59.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-10T01:08:59.175 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-10T01:08:59.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-10T01:08:59.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-10T01:08:59.250 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-10T01:08:59.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-10T01:08:59.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-10T01:08:59.362 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-10T01:08:59.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-10T01:08:59.387 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-10T01:08:59.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-10T01:08:59.426 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-10T01:08:59.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-10T01:08:59.518 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-10T01:08:59.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-10T01:08:59.569 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-10T01:08:59.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-10T01:08:59.659 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-10T01:08:59.671 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-10T01:08:59.672 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-10T01:08:59.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-10T01:08:59.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T01:08:59.697 INFO:tasks.ceph:role: osd.0 2023-05-10T01:08:59.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:08:59.697 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-10T01:08:59.761 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:08:59.761 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:08:59.761 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:08:59.762 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:08:59.784 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-05-10T01:08:59.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-05-10T01:08:59.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-10T01:08:59.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-10T01:08:59.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-10T01:09:00.000 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:00.000 INFO:tasks.ceph:role: osd.1 2023-05-10T01:09:00.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:09:00.001 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-10T01:09:00.065 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:00.065 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:00.065 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:00.065 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2023-05-10T01:09:00.065 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:00.066 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:00.066 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:00.066 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:00.066 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:00.066 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:00.087 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-05-10T01:09:00.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-05-10T01:09:00.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-10T01:09:00.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-10T01:09:00.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-10T01:09:00.300 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:00.300 INFO:tasks.ceph:role: osd.2 2023-05-10T01:09:00.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:09:00.301 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-10T01:09:00.364 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:00.365 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:00.366 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:00.366 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:00.386 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-05-10T01:09:00.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-05-10T01:09:00.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-10T01:09:00.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-10T01:09:00.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-10T01:09:00.598 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:00.598 INFO:tasks.ceph:role: osd.3 2023-05-10T01:09:00.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:09:00.599 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-10T01:09:00.662 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:00.662 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:00.662 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:00.662 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:00.663 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:00.684 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-05-10T01:09:00.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-05-10T01:09:00.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-10T01:09:00.763 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-10T01:09:00.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:00.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.909+0000 7f08c5c15200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-10T01:09:00.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.909+0000 7f08c5c15200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-10T01:09:00.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.909+0000 7f08c5c15200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T01:09:00.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.909+0000 7f08c5c15200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T01:09:00.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.909+0000 7f08c5c15200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T01:09:00.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:00.910+0000 7f08c5c15200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-10T01:09:03.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-10T01:09:03.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:03.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.959+0000 7f9669918200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-10T01:09:03.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.959+0000 7f9669918200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-10T01:09:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.959+0000 7f9669918200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T01:09:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.959+0000 7f9669918200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T01:09:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.959+0000 7f9669918200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T01:09:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:03.960+0000 7f9669918200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-10T01:09:06.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-10T01:09:06.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.995+0000 7fb9759f2200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-10T01:09:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.995+0000 7fb9759f2200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-10T01:09:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.995+0000 7fb9759f2200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T01:09:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.995+0000 7fb9759f2200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T01:09:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.995+0000 7fb9759f2200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T01:09:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:06.996+0000 7fb9759f2200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-10T01:09:09.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-10T01:09:09.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.007+0000 7fea63ba4200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-10T01:09:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.007+0000 7fea63ba4200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-10T01:09:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.007+0000 7fea63ba4200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T01:09:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.007+0000 7fea63ba4200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T01:09:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.007+0000 7fea63ba4200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T01:09:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:10.008+0000 7fea63ba4200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-10T01:09:12.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-10T01:09:12.969 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-10T01:09:12.992 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:12.993 INFO:tasks.ceph:role: osd.4 2023-05-10T01:09:12.993 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:09:12.993 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-10T01:09:13.064 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:13.064 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:13.064 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:13.064 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:13.065 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:13.426 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-05-10T01:09:13.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-05-10T01:09:13.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-10T01:09:13.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-10T01:09:13.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-10T01:09:13.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:13.653 INFO:tasks.ceph:role: osd.5 2023-05-10T01:09:13.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:09:13.654 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-10T01:09:13.725 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:13.726 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:13.726 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:13.726 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-05-10T01:09:13.726 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:13.726 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:13.727 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:13.727 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:13.727 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:13.727 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-05-10T01:09:14.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-05-10T01:09:14.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-10T01:09:14.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-10T01:09:14.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-10T01:09:14.300 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:14.301 INFO:tasks.ceph:role: osd.6 2023-05-10T01:09:14.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:09:14.302 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-10T01:09:14.371 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:14.371 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:14.371 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:14.372 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:14.734 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-05-10T01:09:14.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-05-10T01:09:14.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-10T01:09:14.833 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-10T01:09:14.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-10T01:09:14.924 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T01:09:14.925 INFO:tasks.ceph:role: osd.7 2023-05-10T01:09:14.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:09:14.925 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-10T01:09:14.997 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T01:09:14.997 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T01:09:14.997 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T01:09:14.997 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-05-10T01:09:14.997 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T01:09:14.998 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-05-10T01:09:14.998 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T01:09:14.998 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T01:09:14.998 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T01:09:14.998 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T01:09:15.368 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-05-10T01:09:15.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-05-10T01:09:15.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-10T01:09:15.477 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-10T01:09:15.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:15.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.581+0000 7f3f12f73200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-10T01:09:15.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.582+0000 7f3f12f73200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-10T01:09:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.582+0000 7f3f12f73200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T01:09:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.582+0000 7f3f12f73200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T01:09:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.582+0000 7f3f12f73200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T01:09:15.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:15.589+0000 7f3f12f73200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-10T01:09:18.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-10T01:09:18.566 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:18.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.645+0000 7fb27e8e0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-10T01:09:18.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.646+0000 7fb27e8e0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-10T01:09:18.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.646+0000 7fb27e8e0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T01:09:18.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.646+0000 7fb27e8e0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T01:09:18.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.646+0000 7fb27e8e0200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T01:09:18.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:18.646+0000 7fb27e8e0200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-10T01:09:21.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-10T01:09:21.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.621+0000 7f46aa0d1200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-10T01:09:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.622+0000 7f46aa0d1200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-10T01:09:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.622+0000 7f46aa0d1200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T01:09:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.622+0000 7f46aa0d1200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T01:09:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.622+0000 7f46aa0d1200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T01:09:21.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:21.622+0000 7f46aa0d1200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-10T01:09:24.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-10T01:09:24.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:24.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-10T01:09:24.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-10T01:09:24.652 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T01:09:24.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T01:09:24.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T01:09:24.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:24.645+0000 7f4822520200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-10T01:09:26.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:09:26.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:09:27.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-10T01:09:27.526 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-10T01:09:27.527 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-10T01:09:27.557 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-10T01:09:27.626 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-10T01:09:27.694 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-10T01:09:27.761 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-10T01:09:27.829 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-10T01:09:27.896 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:27.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-10T01:09:27.961 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:27.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-10T01:09:27.991 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:27.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-10T01:09:28.058 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-10T01:09:28.123 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.124 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-10T01:09:28.188 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-10T01:09:28.253 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-10T01:09:28.318 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-10T01:09:28.381 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:28.381 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-10T01:09:28.399 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:28.399 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-10T01:09:28.455 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.455 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-10T01:09:28.469 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:28.470 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-10T01:09:28.523 INFO:tasks.ceph:Adding keys to all mons... 2023-05-10T01:09:28.524 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-10T01:09:28.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-10T01:09:28.573 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2023-05-10T01:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ== 2023-05-10T01:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-05-10T01:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA== 2023-05-10T01:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-05-10T01:09:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A== 2023-05-10T01:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2023-05-10T01:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw== 2023-05-10T01:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2023-05-10T01:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A== 2023-05-10T01:09:28.575 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2023-05-10T01:09:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ== 2023-05-10T01:09:28.578 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ== 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ== 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA== 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2023-05-10T01:09:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ== 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA== 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w== 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ== 2023-05-10T01:09:28.580 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2023-05-10T01:09:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA== 2023-05-10T01:09:28.581 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-05-10T01:09:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ== 2023-05-10T01:09:28.581 INFO:teuthology.orchestra.run.smithi052.stdout:[client.2] 2023-05-10T01:09:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw== 2023-05-10T01:09:28.582 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2023-05-10T01:09:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg== 2023-05-10T01:09:28.582 INFO:teuthology.orchestra.run.smithi052.stdout:[client.3] 2023-05-10T01:09:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg== 2023-05-10T01:09:28.588 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ== 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA== 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A== 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2023-05-10T01:09:28.589 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw== 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A== 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ== 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ== 2023-05-10T01:09:28.590 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ== 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA== 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ== 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2023-05-10T01:09:28.591 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA== 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w== 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ== 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA== 2023-05-10T01:09:28.592 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ== 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout:[client.2] 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw== 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg== 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout:[client.3] 2023-05-10T01:09:28.593 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg== 2023-05-10T01:09:28.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T01:09:28.632 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T01:09:28.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:28.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:28.781 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:28.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:28.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:28.844 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:28.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:28.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:28.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:28.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T01:09:29.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T01:09:29.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:29.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:29.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:29.258 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T01:09:29.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.363 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.450 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.497 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T01:09:29.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.598 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T01:09:29.745 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-10T01:09:29.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-10T01:09:29.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T01:09:29.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-10T01:09:29.888 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-10T01:09:29.913 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T01:09:30.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-10T01:09:30.026 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-10T01:09:30.089 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T01:09:30.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-10T01:09:30.201 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:30.204 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-10T01:09:30.255 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-10T01:09:30.255 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-10T01:09:30.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-10T01:09:30.259 INFO:tasks.ceph.mon.a:Started 2023-05-10T01:09:30.259 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-10T01:09:30.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-10T01:09:30.296 INFO:tasks.ceph.mon.b:Started 2023-05-10T01:09:30.297 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-10T01:09:30.297 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-10T01:09:30.298 INFO:tasks.ceph.mon.c:Started 2023-05-10T01:09:30.299 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-10T01:09:30.299 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-10T01:09:30.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-10T01:09:30.301 INFO:tasks.ceph.mgr.y:Started 2023-05-10T01:09:30.301 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-10T01:09:30.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-10T01:09:30.303 INFO:tasks.ceph.mgr.x:Started 2023-05-10T01:09:30.304 INFO:tasks.ceph:Setting crush tunables to default 2023-05-10T01:09:30.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2023-05-10T01:09:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.418+0000 7f94754ff700 1 Processor -- start 2023-05-10T01:09:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.418+0000 7f94754ff700 1 -- start start 2023-05-10T01:09:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f94754ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f94754ff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f94754ff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700c94c0 con 0x7f9470154460 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f94754ff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700cb7d0 con 0x7f9470068150 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f94754ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470068a90 con 0x7f9470154080 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946e7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9470154460 0x7f94700a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38530/0 (socket says 172.21.15.52:38530) 2023-05-10T01:09:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946e7fc700 1 -- 172.21.15.52:0/1683905684 learned_addr learned my addr 172.21.15.52:0/1683905684 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.419+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:09:30.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:30.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:30.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:30.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:30.620+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:09:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-10T01:09:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.021+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:09:31.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:31.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:31.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:31.823+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:09:33.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 msgr2=0x7f94700aac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T01:09:33.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.172:3300/0 conn(0x7f9470154080 0x7f94700aac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:33.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 -- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 msgr2=0x7f94700685a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T01:09:33.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 --2- 172.21.15.52:0/1683905684 >> v2:172.21.15.52:3300/0 conn(0x7f9470068150 0x7f94700685a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:33.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 -- 172.21.15.52:0/1683905684 >> v1:172.21.15.52:6789/0 conn(0x7f9470154460 legacy=0x7f94700a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:33.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:33.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 -- 172.21.15.52:0/1683905684 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700c88b0 con 0x7f9454005fd0 2023-05-10T01:09:33.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946cff9700 1 -- 172.21.15.52:0/1683905684 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700cb7d0 con 0x7f9454003560 2023-05-10T01:09:33.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:33.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:33.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:33.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:33.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.420+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:09:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.621+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.621+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.621+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.621+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:33.621+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:09:34.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.022+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:34.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.022+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:34.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.022+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:34.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.022+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:34.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.022+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:09:34.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.824+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:34.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.824+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T01:09:34.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.824+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T01:09:34.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.824+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-05-10T01:09:34.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:34.824+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:09:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.622+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622065231 0 0) 0x7f94700c88b0 con 0x7f9454005fd0 2023-05-10T01:09:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.622+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94500033f0 con 0x7f9454005fd0 2023-05-10T01:09:35.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629947277 0 0) 0x7f94500033f0 con 0x7f9454005fd0 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 msgr2=0x7f9454005990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9454003560 0x7f9454005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945400adb0 con 0x7f9454005fd0 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f94580014f0 con 0x7f9454005fd0 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 >> v1:172.21.15.172:6789/0 conn(0x7f9454005fd0 legacy=0x7f9454008470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946f7fe700 1 -- 172.21.15.52:0/1683905684 reap_dead start 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 0x7f9450003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9450004690 0x7f9450004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f945000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700cb7d0 con 0x7f94500038e0 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945000c060 con 0x7f9450004690 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945000c220 con 0x7f94500050d0 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 0x7f9450003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946f7fe700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f945000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946e7fc700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9450004690 0x7f9450004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 msgr2=0x7f945000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f945000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9450004690 msgr2=0x7f9450004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9450004690 0x7f9450004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.625+0000 7f946effd700 1 -- 172.21.15.52:0/1683905684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500033f0 con 0x7f94500038e0 2023-05-10T01:09:35.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.626+0000 7f946effd700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 0x7f9450003ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9468006db0 tx=0x7f9468008040).ready entity=mon.0 client_cookie=bbaa187649b555a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:35.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.626+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946801e070 con 0x7f94500038e0 2023-05-10T01:09:35.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.626+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468017b90 con 0x7f94500038e0 2023-05-10T01:09:35.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.626+0000 7f946dffb700 1 -- 172.21.15.52:0/1683905684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468017d20 con 0x7f94500038e0 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 -- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 msgr2=0x7f9450003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 0x7f9450003ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9468006db0 tx=0x7f9468008040).stop 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 -- 172.21.15.52:0/1683905684 shutdown_connections 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f945000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9450004690 0x7f9450004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 --2- 172.21.15.52:0/1683905684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94500038e0 0x7f9450003ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 -- 172.21.15.52:0/1683905684 >> 172.21.15.52:0/1683905684 conn(0x7f9470067910 msgr2=0x7f94700cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 -- 172.21.15.52:0/1683905684 shutdown_connections 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.627+0000 7f94754ff700 1 -- 172.21.15.52:0/1683905684 wait complete. 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.628+0000 7f94754ff700 1 Processor -- start 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 -- start start 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94500038e0 0x7f947014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f94700ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700b0c90 con 0x7f9450004690 2023-05-10T01:09:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470156390 con 0x7f94500038e0 2023-05-10T01:09:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f94754ff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9470155a60 con 0x7f94500050d0 2023-05-10T01:09:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.629+0000 7f946e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94500038e0 0x7f947014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57818/0 (socket says 172.21.15.52:57818) 2023-05-10T01:09:35.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 -- 172.21.15.52:0/2848407925 learned_addr learned my addr 172.21.15.52:0/2848407925 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:35.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946f7fe700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f94700ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 -- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 msgr2=0x7f94700ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f94700ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 -- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94500038e0 msgr2=0x7f947014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94500038e0 0x7f947014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 -- 172.21.15.52:0/2848407925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470155d40 con 0x7f9450004690 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f946e7fc700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f945800f950 tx=0x7f9458009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580070d0 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458007230 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580075d0 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470156020 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.630+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470156d10 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.631+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f945801a030 con 0x7f9450004690 2023-05-10T01:09:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.631+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f945801dc90 con 0x7f9450004690 2023-05-10T01:09:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.632+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470066720 con 0x7f9450004690 2023-05-10T01:09:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.634+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9458018070 con 0x7f9450004690 2023-05-10T01:09:35.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.711+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f947006c340 con 0x7f9450004690 2023-05-10T01:09:35.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.714+0000 7f9466ffd700 1 -- 172.21.15.52:0/2848407925 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f945801d440 con 0x7f9450004690 2023-05-10T01:09:35.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 msgr2=0x7f9470156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f945800f950 tx=0x7f9458009040).stop 2023-05-10T01:09:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 shutdown_connections 2023-05-10T01:09:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94500050d0 0x7f94700ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94500038e0 0x7f947014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 --2- 172.21.15.52:0/2848407925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9450004690 0x7f9470156820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 >> 172.21.15.52:0/2848407925 conn(0x7f9470067910 msgr2=0x7f94700ab770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 shutdown_connections 2023-05-10T01:09:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:35.715+0000 7f94754ff700 1 -- 172.21.15.52:0/2848407925 wait complete. 2023-05-10T01:09:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2023-05-10T01:09:35.731 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-10T01:09:35.731 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:35.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-10T01:09:35.757 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:35.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-10T01:09:35.766 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:35.763+0000 7ff09c6d9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:09:35.779 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:35.777+0000 7f4019acb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:09:35.803 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:35.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-10T01:09:35.834 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:35.831+0000 7ff09c6d9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:09:35.853 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:35.849+0000 7f4019acb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:09:35.869 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-05-10T01:09:35.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-10T01:09:35.934 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:35.934 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-10T01:09:35.958 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:35.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-10T01:09:36.022 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:36.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-10T01:09:36.086 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-05-10T01:09:36.087 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-10T01:09:36.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 29044984-cd85-43ea-b2d5-3bc38d56181d 0 2023-05-10T01:09:36.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.300+0000 7f2b19274700 1 Processor -- start 2023-05-10T01:09:36.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.300+0000 7f2b19274700 1 -- start start 2023-05-10T01:09:36.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b19274700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b1406a400 0x7f2b14065670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b19274700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b19274700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b14150880 con 0x7f2b14064b80 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b19274700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140bcd40 con 0x7f2b1406a400 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b19274700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140669b0 con 0x7f2b140bc890 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b127fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b1406a400 0x7f2b14065670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55764/0 (socket says 172.21.15.172:55764) 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 -- 172.21.15.172:0/1336319752 learned_addr learned my addr 172.21.15.172:0/1336319752 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 -- 172.21.15.172:0/1336319752 >> v2:172.21.15.172:3300/0 conn(0x7f2b1406a400 msgr2=0x7f2b14065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 --2- 172.21.15.172:0/1336319752 >> v2:172.21.15.172:3300/0 conn(0x7f2b1406a400 0x7f2b14065670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 -- 172.21.15.172:0/1336319752 >> v1:172.21.15.52:6789/0 conn(0x7f2b14064b80 legacy=0x7f2b14064f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 -- 172.21.15.172:0/1336319752 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140bcf20 con 0x7f2b140bc890 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.301+0000 7f2b137fe700 1 --2- 172.21.15.172:0/1336319752 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b0c009f20 tx=0x7f2b0c009840).ready entity=mon.2 client_cookie=e04b126cc0249111 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b11ffb700 1 -- 172.21.15.172:0/1336319752 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00e070 con 0x7f2b140bc890 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b11ffb700 1 -- 172.21.15.172:0/1336319752 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00b9d0 con 0x7f2b140bc890 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b11ffb700 1 -- 172.21.15.172:0/1336319752 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00bd50 con 0x7f2b140bc890 2023-05-10T01:09:36.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 -- 172.21.15.172:0/1336319752 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 msgr2=0x7f2b140664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 --2- 172.21.15.172:0/1336319752 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b0c009f20 tx=0x7f2b0c009840).stop 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 -- 172.21.15.172:0/1336319752 shutdown_connections 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 --2- 172.21.15.172:0/1336319752 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b140bc890 0x7f2b140664c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 --2- 172.21.15.172:0/1336319752 >> v2:172.21.15.172:3300/0 conn(0x7f2b1406a400 0x7f2b14065670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 -- 172.21.15.172:0/1336319752 >> 172.21.15.172:0/1336319752 conn(0x7f2b140c4440 msgr2=0x7f2b14066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 -- 172.21.15.172:0/1336319752 shutdown_connections 2023-05-10T01:09:36.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.302+0000 7f2b19274700 1 -- 172.21.15.172:0/1336319752 wait complete. 2023-05-10T01:09:36.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.303+0000 7f2b19274700 1 Processor -- start 2023-05-10T01:09:36.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.303+0000 7f2b19274700 1 -- start start 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b1406a400 0x7f2b140aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b140bc890 0x7f2b14145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c0e10 con 0x7f2b1406a400 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c0200 con 0x7f2b140bc890 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b19274700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c04e0 con 0x7f2b14064b80 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b12ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b137fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b140bc890 0x7f2b14145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b12ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55768/0 (socket says 172.21.15.172:55768) 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b12ffd700 1 -- 172.21.15.172:0/498033600 learned_addr learned my addr 172.21.15.172:0/498033600 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b127fc700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b1406a400 0x7f2b140aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.304+0000 7f2b12ffd700 1 -- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b140bc890 msgr2=0x7f2b14145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b12ffd700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b140bc890 0x7f2b14145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b12ffd700 1 -- 172.21.15.172:0/498033600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b1406a400 msgr2=0x7f2b140aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b12ffd700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b1406a400 0x7f2b140aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b12ffd700 1 -- 172.21.15.172:0/498033600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009ae0 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b12ffd700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2b0800c4c0 tx=0x7f2b08007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800ce70 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08001e90 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08007250 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b140c07c0 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.305+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b140ab030 con 0x7f2b14064b80 2023-05-10T01:09:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.306+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f2b08010070 con 0x7f2b14064b80 2023-05-10T01:09:36.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.306+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b14047150 con 0x7f2b14064b80 2023-05-10T01:09:36.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.306+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2b0800f7e0 con 0x7f2b14064b80 2023-05-10T01:09:36.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.308+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2b08006b30 con 0x7f2b14064b80 2023-05-10T01:09:36.352 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:36.349+0000 7ff09c6d9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:09:36.377 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:36.375+0000 7f4019acb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:09:36.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.403+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "29044984-cd85-43ea-b2d5-3bc38d56181d", "id": 0} v 0) v1 -- 0x7f2b14069920 con 0x7f2b14064b80 2023-05-10T01:09:36.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.408+0000 7f2afaffd700 1 -- 172.21.15.172:0/498033600 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29044984-cd85-43ea-b2d5-3bc38d56181d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b0800fa20 con 0x7f2b14064b80 2023-05-10T01:09:36.411 INFO:teuthology.orchestra.run.smithi172.stdout:0 2023-05-10T01:09:36.412 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 msgr2=0x7f2b140bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.412 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2b0800c4c0 tx=0x7f2b08007e00).stop 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 shutdown_connections 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b140bc890 0x7f2b14145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b14064b80 0x7f2b140bfc20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 --2- 172.21.15.172:0/498033600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b1406a400 0x7f2b140aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 >> 172.21.15.172:0/498033600 conn(0x7f2b140c4440 msgr2=0x7f2b140ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 shutdown_connections 2023-05-10T01:09:36.413 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.409+0000 7f2b19274700 1 -- 172.21.15.172:0/498033600 wait complete. 2023-05-10T01:09:36.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new da7e871c-9b19-43d4-803b-7e2b05bbefab 1 2023-05-10T01:09:36.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 Processor -- start 2023-05-10T01:09:36.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 -- start start 2023-05-10T01:09:36.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0c6660 con 0x7fbe1c0c0140 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c069f50 con 0x7fbe1c153f80 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.534+0000 7fbe2097d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c06a9d0 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1ad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55776/0 (socket says 172.21.15.172:55776) 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1ad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44132/0 (socket says 172.21.15.172:44132) 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 -- 172.21.15.172:0/4004813098 learned_addr learned my addr 172.21.15.172:0/4004813098 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 -- 172.21.15.172:0/4004813098 >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 msgr2=0x7fbe1c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 --2- 172.21.15.172:0/4004813098 >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 -- 172.21.15.172:0/4004813098 >> v1:172.21.15.52:6789/0 conn(0x7fbe1c0c0140 legacy=0x7fbe1c0c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 -- 172.21.15.172:0/4004813098 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c06a130 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1ad9d700 1 --2- 172.21.15.172:0/4004813098 >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:36.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe1a59c700 1 --2- 172.21.15.172:0/4004813098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbe10006fd0 tx=0x7fbe100090f0).ready entity=mon.2 client_cookie=46220a79b1348228 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe19d9b700 1 -- 172.21.15.172:0/4004813098 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000b580 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe19d9b700 1 -- 172.21.15.172:0/4004813098 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1000b6e0 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.535+0000 7fbe19d9b700 1 -- 172.21.15.172:0/4004813098 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000ba60 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 -- 172.21.15.172:0/4004813098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 msgr2=0x7fbe1c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 --2- 172.21.15.172:0/4004813098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbe10006fd0 tx=0x7fbe100090f0).stop 2023-05-10T01:09:36.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 -- 172.21.15.172:0/4004813098 shutdown_connections 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 --2- 172.21.15.172:0/4004813098 >> v2:172.21.15.172:3300/0 conn(0x7fbe1c153f80 0x7fbe1c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 --2- 172.21.15.172:0/4004813098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c0c6170 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 -- 172.21.15.172:0/4004813098 >> 172.21.15.172:0/4004813098 conn(0x7fbe1c0cb5f0 msgr2=0x7fbe1c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 -- 172.21.15.172:0/4004813098 shutdown_connections 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.536+0000 7fbe2097d700 1 -- 172.21.15.172:0/4004813098 wait complete. 2023-05-10T01:09:36.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.538+0000 7fbe2097d700 1 Processor -- start 2023-05-10T01:09:36.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.538+0000 7fbe2097d700 1 -- start start 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c163f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c153f80 0x7fbe1c164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0c2b90 con 0x7fbe1c153f80 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0c3710 con 0x7fbe1c0c0140 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe2097d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c14ee60 con 0x7fbe1c0c5cf0 2023-05-10T01:09:36.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44138/0 (socket says 172.21.15.172:44138) 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 -- 172.21.15.172:0/1249883507 learned_addr learned my addr 172.21.15.172:0/1249883507 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1a59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1b59e700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c153f80 0x7fbe1c164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 -- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 msgr2=0x7fbe1c163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c163f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 -- 172.21.15.172:0/1249883507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c153f80 msgr2=0x7fbe1c164470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c153f80 0x7fbe1c164470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 -- 172.21.15.172:0/1249883507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0092a0 con 0x7fbe1c0c0140 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe1ad9d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbe0c00e9b0 tx=0x7fbe0c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.539+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00c670 con 0x7fbe1c0c0140 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00c7d0 con 0x7fbe1c0c0140 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00cb50 con 0x7fbe1c0c0140 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe10009370 con 0x7fbe1c0c0140 2023-05-10T01:09:36.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c0c30c0 con 0x7fbe1c0c0140 2023-05-10T01:09:36.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fbe0c022070 con 0x7fbe1c0c0140 2023-05-10T01:09:36.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.540+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fbe0c0123f0 con 0x7fbe1c0c0140 2023-05-10T01:09:36.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.541+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c0c39f0 con 0x7fbe1c0c0140 2023-05-10T01:09:36.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.543+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fbe0c016020 con 0x7fbe1c0c0140 2023-05-10T01:09:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.623+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da7e871c-9b19-43d4-803b-7e2b05bbefab", "id": 1} v 0) v1 -- 0x7fbe1c083110 con 0x7fbe1c0c0140 2023-05-10T01:09:36.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.630+0000 7fbe02ffd700 1 -- 172.21.15.172:0/1249883507 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da7e871c-9b19-43d4-803b-7e2b05bbefab", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe0c01b840 con 0x7fbe1c0c0140 2023-05-10T01:09:36.634 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-05-10T01:09:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 msgr2=0x7fbe1c14e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbe0c00e9b0 tx=0x7fbe0c009060).stop 2023-05-10T01:09:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 shutdown_connections 2023-05-10T01:09:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c153f80 0x7fbe1c164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe1c0c0140 0x7fbe1c14e970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 --2- 172.21.15.172:0/1249883507 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe1c0c5cf0 0x7fbe1c163f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.631+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 >> 172.21.15.172:0/1249883507 conn(0x7fbe1c0cb5f0 msgr2=0x7fbe1c0c0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.632+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 shutdown_connections 2023-05-10T01:09:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.632+0000 7fbe2097d700 1 -- 172.21.15.172:0/1249883507 wait complete. 2023-05-10T01:09:36.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 82ebe07f-9862-4742-b9e5-df5284613972 2 2023-05-10T01:09:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.755+0000 7f987b7e0700 1 Processor -- start 2023-05-10T01:09:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f987b7e0700 1 -- start start 2023-05-10T01:09:36.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f987b7e0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9874150370 0x7f9874153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f987b7e0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740bdf10 con 0x7f987414ff90 2023-05-10T01:09:36.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f987b7e0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740bc760 con 0x7f98740bc280 2023-05-10T01:09:36.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f987b7e0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987406a500 con 0x7f9874150370 2023-05-10T01:09:36.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f9878d7b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f98740bc280 0x7f98740bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60350/0 (socket says 172.21.15.172:60350) 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.756+0000 7f9878d7b700 1 -- 172.21.15.172:0/3529841865 learned_addr learned my addr 172.21.15.172:0/3529841865 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9879d7d700 1 --2- 172.21.15.172:0/3529841865 >> v2:172.21.15.52:3300/0 conn(0x7f9874150370 0x7f9874153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9863fff700 1 -- 172.21.15.172:0/3529841865 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156822614 0 0) 0x7f98740bc760 con 0x7f98740bc280 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9863fff700 1 -- 172.21.15.172:0/3529841865 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f985c0033f0 con 0x7f98740bc280 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9879d7d700 1 -- 172.21.15.172:0/3529841865 >> v1:172.21.15.172:6789/0 conn(0x7f98740bc280 legacy=0x7f98740bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9879d7d700 1 -- 172.21.15.172:0/3529841865 >> v1:172.21.15.52:6789/0 conn(0x7f987414ff90 legacy=0x7f9874069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9879d7d700 1 -- 172.21.15.172:0/3529841865 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740bca40 con 0x7f9874150370 2023-05-10T01:09:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9879d7d700 1 --2- 172.21.15.172:0/3529841865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9874150370 0x7f9874153ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f986c009e90 tx=0x7f986c009780).ready entity=mon.0 client_cookie=8a80e5267e874a3e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9863fff700 1 -- 172.21.15.172:0/3529841865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00e070 con 0x7f9874150370 2023-05-10T01:09:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9863fff700 1 -- 172.21.15.172:0/3529841865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00bb20 con 0x7f9874150370 2023-05-10T01:09:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.757+0000 7f9863fff700 1 -- 172.21.15.172:0/3529841865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00bea0 con 0x7f9874150370 2023-05-10T01:09:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 -- 172.21.15.172:0/3529841865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9874150370 msgr2=0x7f9874153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3529841865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9874150370 0x7f9874153ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f986c009e90 tx=0x7f986c009780).stop 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 -- 172.21.15.172:0/3529841865 shutdown_connections 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3529841865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9874150370 0x7f9874153ea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 -- 172.21.15.172:0/3529841865 >> 172.21.15.172:0/3529841865 conn(0x7f98740c4610 msgr2=0x7f9874066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 -- 172.21.15.172:0/3529841865 shutdown_connections 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.758+0000 7f987b7e0700 1 -- 172.21.15.172:0/3529841865 wait complete. 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.759+0000 7f987b7e0700 1 Processor -- start 2023-05-10T01:09:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.759+0000 7f987b7e0700 1 -- start start 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98740bc280 0x7f98740a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 0x7f98740bf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9874150800 con 0x7f98740bc280 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98740c0770 con 0x7f9874150370 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987b7e0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98740bfb60 con 0x7f987414ff90 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9878d7b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 0x7f98740bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44154/0 (socket says 172.21.15.172:44154) 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9878d7b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 0x7f98740bf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55794/0 (socket says 172.21.15.172:55794) 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 -- 172.21.15.172:0/3459932943 learned_addr learned my addr 172.21.15.172:0/3459932943 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f987957c700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98740bc280 0x7f98740a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 -- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 msgr2=0x7f98740bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 0x7f98740bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 -- 172.21.15.172:0/3459932943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98740bc280 msgr2=0x7f98740a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98740bc280 0x7f98740a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 -- 172.21.15.172:0/3459932943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009a20 con 0x7f9874150370 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f9879d7d700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f986c00bfc0 tx=0x7f986c009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.760+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c01d630 con 0x7f9874150370 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c01d790 con 0x7f9874150370 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98740bfe40 con 0x7f9874150370 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c01db30 con 0x7f9874150370 2023-05-10T01:09:36.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98740c0400 con 0x7f9874150370 2023-05-10T01:09:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f986c0276c0 con 0x7f9874150370 2023-05-10T01:09:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f986c01c7d0 con 0x7f9874150370 2023-05-10T01:09:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.761+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987406c340 con 0x7f9874150370 2023-05-10T01:09:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.764+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f986c017070 con 0x7f9874150370 2023-05-10T01:09:36.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.843+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82ebe07f-9862-4742-b9e5-df5284613972", "id": 2} v 0) v1 -- 0x7f98740bcd20 con 0x7f9874150370 2023-05-10T01:09:36.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.851+0000 7f98617fa700 1 -- 172.21.15.172:0/3459932943 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82ebe07f-9862-4742-b9e5-df5284613972", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f986c027bd0 con 0x7f9874150370 2023-05-10T01:09:36.854 INFO:teuthology.orchestra.run.smithi172.stdout:2 2023-05-10T01:09:36.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 msgr2=0x7f987413fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f986c00bfc0 tx=0x7f986c009780).stop 2023-05-10T01:09:36.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 shutdown_connections 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9874150370 0x7f987413fb10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98740bc280 0x7f98740a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 --2- 172.21.15.172:0/3459932943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f987414ff90 0x7f98740bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 >> 172.21.15.172:0/3459932943 conn(0x7f98740c4610 msgr2=0x7f987405dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 shutdown_connections 2023-05-10T01:09:36.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.852+0000 7f987b7e0700 1 -- 172.21.15.172:0/3459932943 wait complete. 2023-05-10T01:09:36.866 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new fc11f055-b948-4c26-8de8-cbe0f444b59c 3 2023-05-10T01:09:36.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.978+0000 7ff459e50700 1 Processor -- start 2023-05-10T01:09:36.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.978+0000 7ff459e50700 1 -- start start 2023-05-10T01:09:36.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff459e50700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff459e50700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4540c61e0 0x7ff454154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff459e50700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4540c6650 con 0x7ff454153f80 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff459e50700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff454069f50 con 0x7ff4540c61e0 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff459e50700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45406a9d0 con 0x7ff4540c1150 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55800/0 (socket says 172.21.15.172:55800) 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 -- 172.21.15.172:0/3199750347 learned_addr learned my addr 172.21.15.172:0/3199750347 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff45964f700 1 --2- 172.21.15.172:0/3199750347 >> v2:172.21.15.52:3300/0 conn(0x7ff4540c61e0 0x7ff454154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 -- 172.21.15.172:0/3199750347 >> v2:172.21.15.52:3300/0 conn(0x7ff4540c61e0 msgr2=0x7ff454154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 --2- 172.21.15.172:0/3199750347 >> v2:172.21.15.52:3300/0 conn(0x7ff4540c61e0 0x7ff454154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 -- 172.21.15.172:0/3199750347 >> v1:172.21.15.52:6789/0 conn(0x7ff454153f80 legacy=0x7ff4540a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 -- 172.21.15.172:0/3199750347 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45406a130 con 0x7ff4540c1150 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff453fff700 1 --2- 172.21.15.172:0/3199750347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff440006fd0 tx=0x7ff4400090f0).ready entity=mon.2 client_cookie=587505db73d46548 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff4537fe700 1 -- 172.21.15.172:0/3199750347 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000b580 con 0x7ff4540c1150 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff4537fe700 1 -- 172.21.15.172:0/3199750347 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000b6e0 con 0x7ff4540c1150 2023-05-10T01:09:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.979+0000 7ff4537fe700 1 -- 172.21.15.172:0/3199750347 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000ba60 con 0x7ff4540c1150 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 -- 172.21.15.172:0/3199750347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 msgr2=0x7ff4540c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 --2- 172.21.15.172:0/3199750347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff440006fd0 tx=0x7ff4400090f0).stop 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 -- 172.21.15.172:0/3199750347 shutdown_connections 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 --2- 172.21.15.172:0/3199750347 >> v2:172.21.15.52:3300/0 conn(0x7ff4540c61e0 0x7ff454154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 --2- 172.21.15.172:0/3199750347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c5cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 -- 172.21.15.172:0/3199750347 >> 172.21.15.172:0/3199750347 conn(0x7ff4540cb5f0 msgr2=0x7ff4540c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 -- 172.21.15.172:0/3199750347 shutdown_connections 2023-05-10T01:09:36.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.980+0000 7ff459e50700 1 -- 172.21.15.172:0/3199750347 wait complete. 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.981+0000 7ff459e50700 1 Processor -- start 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.981+0000 7ff459e50700 1 -- start start 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 0x7ff454140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 0x7ff4540c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454140d80 con 0x7ff4540c61e0 2023-05-10T01:09:36.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540c2b40 con 0x7ff454153f80 2023-05-10T01:09:36.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff459e50700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540c2e20 con 0x7ff4540c1150 2023-05-10T01:09:36.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff458e4e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 0x7ff4540c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff458e4e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55804/0 (socket says 172.21.15.172:55804) 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff458e4e700 1 -- 172.21.15.172:0/3386465376 learned_addr learned my addr 172.21.15.172:0/3386465376 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff453fff700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 0x7ff454140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 -- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 msgr2=0x7ff4540c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 -- 172.21.15.172:0/3386465376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 msgr2=0x7ff454140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:36.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 0x7ff454140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff45964f700 1 -- 172.21.15.172:0/3386465376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009370 con 0x7ff454153f80 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.982+0000 7ff453fff700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 0x7ff454140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff45964f700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 0x7ff4540c3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff44c009e50 tx=0x7ff44c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00caa0 con 0x7ff454153f80 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00f040 con 0x7ff454153f80 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4540c3100 con 0x7ff454153f80 2023-05-10T01:09:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00ce10 con 0x7ff454153f80 2023-05-10T01:09:36.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.983+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff454163ff0 con 0x7ff454153f80 2023-05-10T01:09:36.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.984+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7ff44c013870 con 0x7ff454153f80 2023-05-10T01:09:36.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.984+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff44c01d970 con 0x7ff454153f80 2023-05-10T01:09:36.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.984+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff454083110 con 0x7ff454153f80 2023-05-10T01:09:36.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:36.986+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff44c013d50 con 0x7ff454153f80 2023-05-10T01:09:37.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.084+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc11f055-b948-4c26-8de8-cbe0f444b59c", "id": 3} v 0) v1 -- 0x7ff4541641e0 con 0x7ff454153f80 2023-05-10T01:09:37.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.091+0000 7ff450ff9700 1 -- 172.21.15.172:0/3386465376 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc11f055-b948-4c26-8de8-cbe0f444b59c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff44c01dc10 con 0x7ff454153f80 2023-05-10T01:09:37.094 INFO:teuthology.orchestra.run.smithi172.stdout:3 2023-05-10T01:09:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 msgr2=0x7ff4540c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 0x7ff4540c3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff44c009e50 tx=0x7ff44c00b040).stop 2023-05-10T01:09:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 shutdown_connections 2023-05-10T01:09:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff454153f80 0x7ff4540c3b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4540c1150 0x7ff4540c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 --2- 172.21.15.172:0/3386465376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4540c61e0 0x7ff454140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 >> 172.21.15.172:0/3386465376 conn(0x7ff4540cb5f0 msgr2=0x7ff45414f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 shutdown_connections 2023-05-10T01:09:37.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.092+0000 7ff459e50700 1 -- 172.21.15.172:0/3386465376 wait complete. 2023-05-10T01:09:37.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 221cf996-65ca-441f-8c0e-1aaad320a4de 4 2023-05-10T01:09:37.143 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:37.140+0000 7ff09c6d9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:09:37.171 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:37.168+0000 7f4019acb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:09:37.212 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:37.209+0000 7ff09c6d9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:09:37.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.221+0000 7f0e65c5f700 1 Processor -- start 2023-05-10T01:09:37.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e65c5f700 1 -- start start 2023-05-10T01:09:37.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e65c5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e60068860 0x7f0e600aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e65c5f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600c94c0 con 0x7f0e60154460 2023-05-10T01:09:37.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e65c5f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600cb7d0 con 0x7f0e60154080 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e65c5f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600c88b0 con 0x7f0e60068860 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e5f7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0e60154080 0x7f0e600a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60372/0 (socket says 172.21.15.172:60372) 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.222+0000 7f0e5f7fe700 1 -- 172.21.15.172:0/4242647119 learned_addr learned my addr 172.21.15.172:0/4242647119 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5ffff700 1 --2- 172.21.15.172:0/4242647119 >> v2:172.21.15.52:3300/0 conn(0x7f0e60068860 0x7f0e600aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656661936 0 0) 0x7f0e600cb7d0 con 0x7f0e60154080 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e400033f0 con 0x7f0e60154080 2023-05-10T01:09:37.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5ffff700 1 -- 172.21.15.172:0/4242647119 >> v1:172.21.15.172:6789/0 conn(0x7f0e60154080 legacy=0x7f0e600a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660951238 0 0) 0x7f0e600c94c0 con 0x7f0e60154460 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5ffff700 1 -- 172.21.15.172:0/4242647119 >> v1:172.21.15.52:6789/0 conn(0x7f0e60154460 legacy=0x7f0e60068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5ffff700 1 -- 172.21.15.172:0/4242647119 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600c8b90 con 0x7f0e60068860 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5ffff700 1 --2- 172.21.15.172:0/4242647119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60068860 0x7f0e600aac90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0e58009e60 tx=0x7f0e58009780).ready entity=mon.0 client_cookie=1435d33b62a6d815 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800e070 con 0x7f0e60068860 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800bb60 con 0x7f0e60068860 2023-05-10T01:09:37.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.223+0000 7f0e5effd700 1 -- 172.21.15.172:0/4242647119 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800bee0 con 0x7f0e60068860 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 -- 172.21.15.172:0/4242647119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60068860 msgr2=0x7f0e600aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/4242647119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60068860 0x7f0e600aac90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0e58009e60 tx=0x7f0e58009780).stop 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 -- 172.21.15.172:0/4242647119 shutdown_connections 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/4242647119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60068860 0x7f0e600aac90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 -- 172.21.15.172:0/4242647119 >> 172.21.15.172:0/4242647119 conn(0x7f0e60067910 msgr2=0x7f0e600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 -- 172.21.15.172:0/4242647119 shutdown_connections 2023-05-10T01:09:37.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.224+0000 7f0e65c5f700 1 -- 172.21.15.172:0/4242647119 wait complete. 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.225+0000 7f0e65c5f700 1 Processor -- start 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.225+0000 7f0e65c5f700 1 -- start start 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60154080 0x7f0e6014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60150020 con 0x7f0e60154080 2023-05-10T01:09:37.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60154ed0 con 0x7f0e60154460 2023-05-10T01:09:37.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e65c5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c36a0 con 0x7f0e60068860 2023-05-10T01:09:37.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55816/0 (socket says 172.21.15.172:55816) 2023-05-10T01:09:37.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44178/0 (socket says 172.21.15.172:44178) 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5f7fe700 1 -- 172.21.15.172:0/2195989348 learned_addr learned my addr 172.21.15.172:0/2195989348 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e56ffd700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60154080 0x7f0e6014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 -- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 msgr2=0x7f0e60154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 -- 172.21.15.172:0/2195989348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60154080 msgr2=0x7f0e6014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60154080 0x7f0e6014fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 -- 172.21.15.172:0/2195989348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58009a20 con 0x7f0e60154460 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5f7fe700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.226+0000 7f0e5ffff700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0e58014000 tx=0x7f0e58009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5801d630 con 0x7f0e60154460 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5801d790 con 0x7f0e60154460 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600c3980 con 0x7f0e60154460 2023-05-10T01:09:37.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5801db10 con 0x7f0e60154460 2023-05-10T01:09:37.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600c3f40 con 0x7f0e60154460 2023-05-10T01:09:37.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f0e58026670 con 0x7f0e60154460 2023-05-10T01:09:37.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.227+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f0e580088d0 con 0x7f0e60154460 2023-05-10T01:09:37.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.228+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60066720 con 0x7f0e60154460 2023-05-10T01:09:37.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.230+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0e58017070 con 0x7f0e60154460 2023-05-10T01:09:37.240 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:37.237+0000 7f4019acb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:09:37.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.320+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "221cf996-65ca-441f-8c0e-1aaad320a4de", "id": 4} v 0) v1 -- 0x7f0e6006c340 con 0x7f0e60154460 2023-05-10T01:09:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.325+0000 7f0e57fff700 1 -- 172.21.15.172:0/2195989348 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "221cf996-65ca-441f-8c0e-1aaad320a4de", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e580350b0 con 0x7f0e60154460 2023-05-10T01:09:37.329 INFO:teuthology.orchestra.run.smithi172.stdout:4 2023-05-10T01:09:37.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 msgr2=0x7f0e6013eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0e58014000 tx=0x7f0e58009780).stop 2023-05-10T01:09:37.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 shutdown_connections 2023-05-10T01:09:37.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60154460 0x7f0e6013eec0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e60068860 0x7f0e60154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 --2- 172.21.15.172:0/2195989348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e60154080 0x7f0e6014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 >> 172.21.15.172:0/2195989348 conn(0x7f0e60067910 msgr2=0x7f0e600abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 shutdown_connections 2023-05-10T01:09:37.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.326+0000 7f0e65c5f700 1 -- 172.21.15.172:0/2195989348 wait complete. 2023-05-10T01:09:37.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 4228c974-0e49-42f0-82d2-1090c5a3373c 5 2023-05-10T01:09:37.416 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:37.413+0000 7ff09c6d9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:09:37.434 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:37.432+0000 7f4019acb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:09:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.491+0000 7ff8158bd700 1 Processor -- start 2023-05-10T01:09:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.491+0000 7ff8158bd700 1 -- start start 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.491+0000 7ff8158bd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff810154080 0x7ff8100aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.491+0000 7ff8158bd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100c94c0 con 0x7ff810068150 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff8158bd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100cb7d0 con 0x7ff810154460 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff8158bd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100c88b0 con 0x7ff810154080 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80effd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff810154080 0x7ff8100aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80e7fc700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff810154460 0x7ff8100a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60384/0 (socket says 172.21.15.172:60384) 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80e7fc700 1 -- 172.21.15.172:0/4041873992 learned_addr learned my addr 172.21.15.172:0/4041873992 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80effd700 1 -- 172.21.15.172:0/4041873992 >> v1:172.21.15.172:6789/0 conn(0x7ff810154460 legacy=0x7ff8100a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80effd700 1 -- 172.21.15.172:0/4041873992 >> v1:172.21.15.52:6789/0 conn(0x7ff810068150 legacy=0x7ff8100c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80effd700 1 -- 172.21.15.172:0/4041873992 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100c8b90 con 0x7ff810154080 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80effd700 1 --2- 172.21.15.172:0/4041873992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8100aac90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff800009760 tx=0x7ff800009060).ready entity=mon.1 client_cookie=e02516b6455b6aa9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80dffb700 1 -- 172.21.15.172:0/4041873992 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80000b580 con 0x7ff810154080 2023-05-10T01:09:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80dffb700 1 -- 172.21.15.172:0/4041873992 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80000b6e0 con 0x7ff810154080 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.492+0000 7ff80dffb700 1 -- 172.21.15.172:0/4041873992 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80000ba60 con 0x7ff810154080 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 -- 172.21.15.172:0/4041873992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 msgr2=0x7ff8100aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 --2- 172.21.15.172:0/4041873992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8100aac90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff800009760 tx=0x7ff800009060).stop 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 -- 172.21.15.172:0/4041873992 shutdown_connections 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 --2- 172.21.15.172:0/4041873992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8100aac90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 -- 172.21.15.172:0/4041873992 >> 172.21.15.172:0/4041873992 conn(0x7ff810067910 msgr2=0x7ff8100cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 -- 172.21.15.172:0/4041873992 shutdown_connections 2023-05-10T01:09:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.493+0000 7ff8158bd700 1 -- 172.21.15.172:0/4041873992 wait complete. 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.495+0000 7ff8158bd700 1 Processor -- start 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.495+0000 7ff8158bd700 1 -- start start 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 0x7ff810164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810152ec0 con 0x7ff810068150 2023-05-10T01:09:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810165850 con 0x7ff810154080 2023-05-10T01:09:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff8158bd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100af2e0 con 0x7ff810154460 2023-05-10T01:09:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80e7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80e7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44186/0 (socket says 172.21.15.172:44186) 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55830/0 (socket says 172.21.15.172:55830) 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80e7fc700 1 -- 172.21.15.172:0/3618996591 learned_addr learned my addr 172.21.15.172:0/3618996591 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.496+0000 7ff80effd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 0x7ff810164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 -- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 msgr2=0x7ff8101529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 -- 172.21.15.172:0/3618996591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 msgr2=0x7ff810164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 0x7ff810164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 -- 172.21.15.172:0/3618996591 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000092a0 con 0x7ff810154460 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80e7fc700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80effd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 0x7ff810164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff80f7fe700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff80800c790 tx=0x7ff808001530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800e4a0 con 0x7ff810154460 2023-05-10T01:09:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800e600 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800e980 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810164fb0 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff810165570 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7ff808010070 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.497+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7ff80801b3f0 con 0x7ff810154460 2023-05-10T01:09:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.498+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810066720 con 0x7ff810154460 2023-05-10T01:09:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.502+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff808020060 con 0x7ff810154460 2023-05-10T01:09:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.582+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4228c974-0e49-42f0-82d2-1090c5a3373c", "id": 5} v 0) v1 -- 0x7ff81006c340 con 0x7ff810154460 2023-05-10T01:09:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.586+0000 7ff7f6ffd700 1 -- 172.21.15.172:0/3618996591 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4228c974-0e49-42f0-82d2-1090c5a3373c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff80801b990 con 0x7ff810154460 2023-05-10T01:09:37.589 INFO:teuthology.orchestra.run.smithi172.stdout:5 2023-05-10T01:09:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 msgr2=0x7ff81014d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff80800c790 tx=0x7ff808001530).stop 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 shutdown_connections 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff810154460 0x7ff81014d930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff810068150 0x7ff810164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 --2- 172.21.15.172:0/3618996591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff810154080 0x7ff8101529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 >> 172.21.15.172:0/3618996591 conn(0x7ff810067910 msgr2=0x7ff81014e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 shutdown_connections 2023-05-10T01:09:37.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.587+0000 7ff8158bd700 1 -- 172.21.15.172:0/3618996591 wait complete. 2023-05-10T01:09:37.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 22167a6f-e927-4e37-b448-c2a85cbf45cc 6 2023-05-10T01:09:37.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.752+0000 7f8bc2b52700 1 Processor -- start 2023-05-10T01:09:37.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.752+0000 7f8bc2b52700 1 -- start start 2023-05-10T01:09:37.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2b52700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8bbc153ba0 0x7f8bbc0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2b52700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc05e750 con 0x7f8bbc153f80 2023-05-10T01:09:37.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2b52700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc069ee0 con 0x7f8bbc0bdf10 2023-05-10T01:09:37.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2b52700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc0bf530 con 0x7f8bbc153ba0 2023-05-10T01:09:37.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8bbc153ba0 0x7f8bbc0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2351700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8bbc0bdf10 0x7f8bbc0c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60394/0 (socket says 172.21.15.172:60394) 2023-05-10T01:09:37.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8bbc153ba0 0x7f8bbc0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44190/0 (socket says 172.21.15.172:44190) 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc2351700 1 -- 172.21.15.172:0/1859542007 learned_addr learned my addr 172.21.15.172:0/1859542007 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 -- 172.21.15.172:0/1859542007 >> v1:172.21.15.172:6789/0 conn(0x7f8bbc0bdf10 legacy=0x7f8bbc0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 -- 172.21.15.172:0/1859542007 >> v1:172.21.15.52:6789/0 conn(0x7f8bbc153f80 legacy=0x7f8bbc0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 -- 172.21.15.172:0/1859542007 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc158450 con 0x7f8bbc153ba0 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.753+0000 7f8bc1b50700 1 --2- 172.21.15.172:0/1859542007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0698b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8bac009760 tx=0x7f8bac009060).ready entity=mon.1 client_cookie=37a43d8ba0f8e932 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc0b4e700 1 -- 172.21.15.172:0/1859542007 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00b580 con 0x7f8bbc153ba0 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc0b4e700 1 -- 172.21.15.172:0/1859542007 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00b6e0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc0b4e700 1 -- 172.21.15.172:0/1859542007 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00ba60 con 0x7f8bbc153ba0 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 -- 172.21.15.172:0/1859542007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 msgr2=0x7f8bbc0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/1859542007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0698b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8bac009760 tx=0x7f8bac009060).stop 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 -- 172.21.15.172:0/1859542007 shutdown_connections 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/1859542007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0698b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 -- 172.21.15.172:0/1859542007 >> 172.21.15.172:0/1859542007 conn(0x7f8bbc062d70 msgr2=0x7f8bbc05dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 -- 172.21.15.172:0/1859542007 shutdown_connections 2023-05-10T01:09:37.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.754+0000 7f8bc2b52700 1 -- 172.21.15.172:0/1859542007 wait complete. 2023-05-10T01:09:37.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.756+0000 7f8bc2b52700 1 Processor -- start 2023-05-10T01:09:37.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.756+0000 7f8bc2b52700 1 -- start start 2023-05-10T01:09:37.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 0x7f8bbc0aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc164580 con 0x7f8bbc0bdf10 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0c0c30 con 0x7f8bbc153ba0 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.757+0000 7f8bc2b52700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0c0f10 con 0x7f8bbc153f80 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc1b50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc2351700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 0x7f8bbc0aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc1b50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.172:58820/0 (socket says 172.21.15.172:58820) 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc1b50700 1 -- 172.21.15.172:0/3770893726 learned_addr learned my addr 172.21.15.172:0/3770893726 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 -- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 msgr2=0x7f8bbc0aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 0x7f8bbc0aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 -- 172.21.15.172:0/3770893726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 msgr2=0x7f8bbc0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 -- 172.21.15.172:0/3770893726 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0092a0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc1b50700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc2351700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 0x7f8bbc0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc134f700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0c0400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8bb800c410 tx=0x7f8bb8007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800cea0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8007020 con 0x7f8bbc153ba0 2023-05-10T01:09:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80073c0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc0c11f0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f8bb8010070 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.758+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc0c08f0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.759+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f8bb8006d90 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.759+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc164a00 con 0x7f8bbc153ba0 2023-05-10T01:09:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.761+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8bbc164a00 con 0x7f8bbc153ba0 2023-05-10T01:09:37.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.841+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22167a6f-e927-4e37-b448-c2a85cbf45cc", "id": 6} v 0) v1 -- 0x7f8bbc047150 con 0x7f8bbc153ba0 2023-05-10T01:09:37.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.850+0000 7f8ba9ffb700 1 -- 172.21.15.172:0/3770893726 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22167a6f-e927-4e37-b448-c2a85cbf45cc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8bb80124a0 con 0x7f8bbc153ba0 2023-05-10T01:09:37.853 INFO:teuthology.orchestra.run.smithi172.stdout:6 2023-05-10T01:09:37.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 msgr2=0x7f8bbc0c0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0c0400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8bb800c410 tx=0x7f8bb8007d40).stop 2023-05-10T01:09:37.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 shutdown_connections 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bbc153f80 0x7f8bbc0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bbc0bdf10 0x7f8bbc0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 --2- 172.21.15.172:0/3770893726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bbc153ba0 0x7f8bbc0c0400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 >> 172.21.15.172:0/3770893726 conn(0x7f8bbc062d70 msgr2=0x7f8bbc0c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 shutdown_connections 2023-05-10T01:09:37.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.851+0000 7f8bc2b52700 1 -- 172.21.15.172:0/3770893726 wait complete. 2023-05-10T01:09:37.865 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 9d81c33f-18a1-4ed1-8f6b-8c06e06f510c 7 2023-05-10T01:09:37.878 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:37.875+0000 7ff09c6d9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:09:37.889 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:37.886+0000 7f4019acb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:09:37.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.975+0000 7fa806aa8700 1 Processor -- start 2023-05-10T01:09:37.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.975+0000 7fa806aa8700 1 -- start start 2023-05-10T01:09:37.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa806aa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 0x7fa800063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa806aa8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000bf940 con 0x7fa8000622a0 2023-05-10T01:09:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa806aa8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000a7c80 con 0x7fa8001540d0 2023-05-10T01:09:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa806aa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800067f50 con 0x7fa800153cf0 2023-05-10T01:09:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa804844700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 0x7fa800063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa7fffff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa8001540d0 0x7fa8000bf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60404/0 (socket says 172.21.15.172:60404) 2023-05-10T01:09:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa7fffff700 1 -- 172.21.15.172:0/2915756383 learned_addr learned my addr 172.21.15.172:0/2915756383 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-05-10T01:09:37.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa7ff7fe700 1 -- 172.21.15.172:0/2915756383 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073300489 0 0) 0x7fa8000a7c80 con 0x7fa8001540d0 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa804844700 1 -- 172.21.15.172:0/2915756383 >> v1:172.21.15.172:6789/0 conn(0x7fa8001540d0 legacy=0x7fa8000bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa804844700 1 -- 172.21.15.172:0/2915756383 >> v1:172.21.15.52:6789/0 conn(0x7fa8000622a0 legacy=0x7fa8000683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa804844700 1 -- 172.21.15.172:0/2915756383 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000a7ef0 con 0x7fa800153cf0 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.976+0000 7fa804844700 1 --2- 172.21.15.172:0/2915756383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 0x7fa800063fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa7f4009790 tx=0x7fa7f4009060).ready entity=mon.2 client_cookie=fc3f97e87521b796 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa7ff7fe700 1 -- 172.21.15.172:0/2915756383 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b5a0 con 0x7fa800153cf0 2023-05-10T01:09:37.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa7ff7fe700 1 -- 172.21.15.172:0/2915756383 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b700 con 0x7fa800153cf0 2023-05-10T01:09:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa7ff7fe700 1 -- 172.21.15.172:0/2915756383 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400ba80 con 0x7fa800153cf0 2023-05-10T01:09:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 -- 172.21.15.172:0/2915756383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 msgr2=0x7fa800063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 --2- 172.21.15.172:0/2915756383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 0x7fa800063fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa7f4009790 tx=0x7fa7f4009060).stop 2023-05-10T01:09:37.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 -- 172.21.15.172:0/2915756383 shutdown_connections 2023-05-10T01:09:37.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 --2- 172.21.15.172:0/2915756383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa800153cf0 0x7fa800063fa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 -- 172.21.15.172:0/2915756383 >> 172.21.15.172:0/2915756383 conn(0x7fa80005e810 msgr2=0x7fa8000c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:37.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 -- 172.21.15.172:0/2915756383 shutdown_connections 2023-05-10T01:09:37.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.977+0000 7fa806aa8700 1 -- 172.21.15.172:0/2915756383 wait complete. 2023-05-10T01:09:37.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.978+0000 7fa806aa8700 1 Processor -- start 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 -- start start 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 0x7fa8000c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8001540d0 0x7fa8000c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000a94a0 con 0x7fa8001540d0 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000c8180 con 0x7fa800153cf0 2023-05-10T01:09:37.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa806aa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800164790 con 0x7fa8000622a0 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa804844700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa7fffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 0x7fa8000c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa804844700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:55848/0 (socket says 172.21.15.172:55848) 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa7fffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 0x7fa8000c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44208/0 (socket says 172.21.15.172:44208) 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa804844700 1 -- 172.21.15.172:0/3522872188 learned_addr learned my addr 172.21.15.172:0/3522872188 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.979+0000 7fa805045700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8001540d0 0x7fa8000c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 -- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 msgr2=0x7fa8000c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 0x7fa8000c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 -- 172.21.15.172:0/3522872188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8001540d0 msgr2=0x7fa8000c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8001540d0 0x7fa8000c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 -- 172.21.15.172:0/3522872188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40092a0 con 0x7fa8000622a0 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa804844700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa7f4009ee0 tx=0x7fa7f4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b870 con 0x7fa8000622a0 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b9d0 con 0x7fa8000622a0 2023-05-10T01:09:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800165030 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f401b660 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8001649e0 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa7f400f070 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.980+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fa7f4023ae0 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.981+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80014e020 con 0x7fa8000622a0 2023-05-10T01:09:37.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:37.983+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa7f4028020 con 0x7fa8000622a0 2023-05-10T01:09:37.993 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:37.983+0000 7ff09c6d9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:09:37.995 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:37.993+0000 7f4019acb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:09:38.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.063+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d81c33f-18a1-4ed1-8f6b-8c06e06f510c", "id": 7} v 0) v1 -- 0x7fa8000a81d0 con 0x7fa8000622a0 2023-05-10T01:09:38.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.071+0000 7fa7fcff9700 1 -- 172.21.15.172:0/3522872188 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d81c33f-18a1-4ed1-8f6b-8c06e06f510c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7f40340b0 con 0x7fa8000622a0 2023-05-10T01:09:38.074 INFO:teuthology.orchestra.run.smithi172.stdout:7 2023-05-10T01:09:38.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 msgr2=0x7fa8000ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa7f4009ee0 tx=0x7fa7f4015000).stop 2023-05-10T01:09:38.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 shutdown_connections 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8001540d0 0x7fa8000c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8000622a0 0x7fa8000ad130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 --2- 172.21.15.172:0/3522872188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa800153cf0 0x7fa8000c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 >> 172.21.15.172:0/3522872188 conn(0x7fa80005e810 msgr2=0x7fa80014d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 shutdown_connections 2023-05-10T01:09:38.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:09:38.072+0000 7fa806aa8700 1 -- 172.21.15.172:0/3522872188 wait complete. 2023-05-10T01:09:38.088 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-10T01:09:38.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-10T01:09:38.090 INFO:tasks.ceph.osd.0:Started 2023-05-10T01:09:38.090 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-10T01:09:38.091 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-10T01:09:38.093 INFO:tasks.ceph.osd.1:Started 2023-05-10T01:09:38.093 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-10T01:09:38.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-10T01:09:38.095 INFO:tasks.ceph.osd.2:Started 2023-05-10T01:09:38.095 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-10T01:09:38.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-10T01:09:38.097 INFO:tasks.ceph.osd.3:Started 2023-05-10T01:09:38.098 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-10T01:09:38.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-10T01:09:38.129 INFO:tasks.ceph.osd.4:Started 2023-05-10T01:09:38.130 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-10T01:09:38.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-10T01:09:38.132 INFO:tasks.ceph.osd.5:Started 2023-05-10T01:09:38.132 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-10T01:09:38.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-10T01:09:38.134 INFO:tasks.ceph.osd.6:Started 2023-05-10T01:09:38.134 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-10T01:09:38.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-10T01:09:38.136 INFO:tasks.ceph.osd.7:Started 2023-05-10T01:09:38.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:38.150 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:38.147+0000 7ff09c6d9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:09:38.179 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:38.177+0000 7f4019acb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:09:38.239 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:38.236+0000 7ff09c6d9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:09:38.264 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:38.261+0000 7f4019acb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:09:38.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.266+0000 7fee24ca7700 1 Processor -- start 2023-05-10T01:09:38.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.266+0000 7fee24ca7700 1 -- start start 2023-05-10T01:09:38.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee24ca7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fee200c7370 0x7fee20154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:38.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee24ca7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee20158960 con 0x7fee200ad250 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee24ca7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200ad6b0 con 0x7fee200c7750 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee24ca7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee20155330 con 0x7fee200c7370 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fee200ad250 0x7fee2014dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38630/0 (socket says 172.21.15.52:38630) 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1ffff700 1 -- 172.21.15.52:0/4222574384 learned_addr learned my addr 172.21.15.52:0/4222574384 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1f7fe700 1 --2- 172.21.15.52:0/4222574384 >> v2:172.21.15.172:3300/0 conn(0x7fee200c7370 0x7fee20154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324549197 0 0) 0x7fee20158960 con 0x7fee200ad250 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee000033f0 con 0x7fee200ad250 2023-05-10T01:09:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413719764 0 0) 0x7fee200ad6b0 con 0x7fee200c7750 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee20158960 con 0x7fee200c7750 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1f7fe700 1 -- 172.21.15.52:0/4222574384 >> v1:172.21.15.172:6789/0 conn(0x7fee200c7750 legacy=0x7fee200acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658329512 0 0) 0x7fee000033f0 con 0x7fee200ad250 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.267+0000 7fee1f7fe700 1 -- 172.21.15.52:0/4222574384 >> v1:172.21.15.52:6789/0 conn(0x7fee200ad250 legacy=0x7fee2014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee1f7fe700 1 -- 172.21.15.52:0/4222574384 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20157d50 con 0x7fee200c7370 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee1f7fe700 1 --2- 172.21.15.52:0/4222574384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7370 0x7fee20154e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fee08009760 tx=0x7fee08009060).ready entity=mon.1 client_cookie=491ba3f9c6e76435 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180017f0 con 0x7fee200c7370 2023-05-10T01:09:38.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011400 con 0x7fee200c7370 2023-05-10T01:09:38.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee1e7fc700 1 -- 172.21.15.52:0/4222574384 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011780 con 0x7fee200c7370 2023-05-10T01:09:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 -- 172.21.15.52:0/4222574384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7370 msgr2=0x7fee20154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 --2- 172.21.15.52:0/4222574384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7370 0x7fee20154e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fee08009760 tx=0x7fee08009060).stop 2023-05-10T01:09:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 -- 172.21.15.52:0/4222574384 shutdown_connections 2023-05-10T01:09:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 --2- 172.21.15.52:0/4222574384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7370 0x7fee20154e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 -- 172.21.15.52:0/4222574384 >> 172.21.15.52:0/4222574384 conn(0x7fee20068320 msgr2=0x7fee20068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 -- 172.21.15.52:0/4222574384 shutdown_connections 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.268+0000 7fee24ca7700 1 -- 172.21.15.52:0/4222574384 wait complete. 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 Processor -- start 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 -- start start 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee200ad250 0x7fee200c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:38.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7750 0x7fee2014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20146a20 con 0x7fee200c7370 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200c97c0 con 0x7fee200c7750 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.270+0000 7fee24ca7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200c88d0 con 0x7fee200ad250 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57852/0 (socket says 172.21.15.52:57852) 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 -- 172.21.15.52:0/3919434263 learned_addr learned my addr 172.21.15.52:0/3919434263 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1f7fe700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee200ad250 0x7fee200c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1ffff700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7750 0x7fee2014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 -- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee200ad250 msgr2=0x7fee200c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee200ad250 0x7fee200c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 -- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7750 msgr2=0x7fee2014f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7750 0x7fee2014f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 -- 172.21.15.52:0/3919434263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080092a0 con 0x7fee200c7370 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee1effd700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fee1000c440 tx=0x7fee10007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10012400 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee10012560 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200c8bb0 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10012920 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee200c9170 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fee10019030 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.271+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fee1001bab0 con 0x7fee200c7370 2023-05-10T01:09:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.272+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee200c9930 con 0x7fee200c7370 2023-05-10T01:09:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.275+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fee10017070 con 0x7fee200c7370 2023-05-10T01:09:38.310 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:38.307+0000 7ff09c6d9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:09:38.338 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:38.335+0000 7f4019acb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:09:38.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.343+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee20158030 con 0x7fee200c7370 2023-05-10T01:09:38.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.343+0000 7fee177fe700 1 -- 172.21.15.52:0/3919434263 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fee1001bcc0 con 0x7fee200c7370 2023-05-10T01:09:38.346 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:38.347 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:38.064744+0000","last_up_change":"0.000000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:38.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 msgr2=0x7fee2014ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fee1000c440 tx=0x7fee10007c90).stop 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 shutdown_connections 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee200c7750 0x7fee2014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee200ad250 0x7fee200c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 --2- 172.21.15.52:0/3919434263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee200c7370 0x7fee2014ecf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 >> 172.21.15.52:0/3919434263 conn(0x7fee20068320 msgr2=0x7fee201504c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 shutdown_connections 2023-05-10T01:09:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:38.344+0000 7fee24ca7700 1 -- 172.21.15.52:0/3919434263 wait complete. 2023-05-10T01:09:38.359 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-10T01:09:38.359 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-10T01:09:38.572 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:38.569+0000 7ff09c6d9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:09:38.615 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:38.613+0000 7f4019acb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:09:38.710 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-05-10T01:09:38.708+0000 7ff903619200 -1 Falling back to public interface 2023-05-10T01:09:38.718 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-05-10T01:09:38.715+0000 7f4674b65200 -1 Falling back to public interface 2023-05-10T01:09:38.720 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-05-10T01:09:38.717+0000 7ff06f7c8200 -1 Falling back to public interface 2023-05-10T01:09:38.723 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-05-10T01:09:38.721+0000 7f4784235200 -1 Falling back to public interface 2023-05-10T01:09:38.723 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-05-10T01:09:38.721+0000 7f1c409f6200 -1 Falling back to public interface 2023-05-10T01:09:38.735 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-05-10T01:09:38.732+0000 7f9262647200 -1 Falling back to public interface 2023-05-10T01:09:38.747 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-05-10T01:09:38.744+0000 7f9f4126c200 -1 Falling back to public interface 2023-05-10T01:09:38.748 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-05-10T01:09:38.745+0000 7f049fa8b200 -1 Falling back to public interface 2023-05-10T01:09:38.774 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:38.771+0000 7ff09c6d9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:09:38.822 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:38.819+0000 7f4019acb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:09:39.165 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:39.273 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.270+0000 7faa3e887700 1 Processor -- start 2023-05-10T01:09:39.273 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.270+0000 7faa3e887700 1 -- start start 2023-05-10T01:09:39.275 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa3e887700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa380c2380 0x7faa3815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:39.275 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa3e887700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa381507b0 con 0x7faa380bd780 2023-05-10T01:09:39.275 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa3e887700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380c27d0 con 0x7faa38150b20 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa3e887700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380651e0 con 0x7faa380c2380 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa377fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faa380bd780 0x7faa38150f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38640/0 (socket says 172.21.15.52:38640) 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.271+0000 7faa377fe700 1 -- 172.21.15.52:0/1375373011 learned_addr learned my addr 172.21.15.52:0/1375373011 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa3ce24700 1 --2- 172.21.15.52:0/1375373011 >> v2:172.21.15.172:3300/0 conn(0x7faa380c2380 0x7faa3815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691875947 0 0) 0x7faa381507b0 con 0x7faa380bd780 2023-05-10T01:09:39.276 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa240033f0 con 0x7faa380bd780 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722972094 0 0) 0x7faa380c27d0 con 0x7faa38150b20 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa381507b0 con 0x7faa38150b20 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa3ce24700 1 -- 172.21.15.52:0/1375373011 >> v1:172.21.15.172:6789/0 conn(0x7faa38150b20 legacy=0x7faa38064970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa3ce24700 1 -- 172.21.15.52:0/1375373011 >> v1:172.21.15.52:6789/0 conn(0x7faa380bd780 legacy=0x7faa38150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa3ce24700 1 -- 172.21.15.52:0/1375373011 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380654c0 con 0x7faa380c2380 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa3ce24700 1 --2- 172.21.15.52:0/1375373011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa3815af00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7faa3000af70 tx=0x7faa3000a890).ready entity=mon.1 client_cookie=6449c42fbcb8b358 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:39.277 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000f070 con 0x7faa380c2380 2023-05-10T01:09:39.278 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000a2e0 con 0x7faa380c2380 2023-05-10T01:09:39.278 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.272+0000 7faa36ffd700 1 -- 172.21.15.52:0/1375373011 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000cb80 con 0x7faa380c2380 2023-05-10T01:09:39.278 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 -- 172.21.15.52:0/1375373011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 msgr2=0x7faa3815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.278 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 --2- 172.21.15.52:0/1375373011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa3815af00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7faa3000af70 tx=0x7faa3000a890).stop 2023-05-10T01:09:39.278 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 -- 172.21.15.52:0/1375373011 shutdown_connections 2023-05-10T01:09:39.279 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 --2- 172.21.15.52:0/1375373011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa3815af00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.279 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 -- 172.21.15.52:0/1375373011 >> 172.21.15.52:0/1375373011 conn(0x7faa380c7bb0 msgr2=0x7faa380c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:39.279 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 -- 172.21.15.52:0/1375373011 shutdown_connections 2023-05-10T01:09:39.279 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.273+0000 7faa3e887700 1 -- 172.21.15.52:0/1375373011 wait complete. 2023-05-10T01:09:39.281 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.274+0000 7faa3e887700 1 Processor -- start 2023-05-10T01:09:39.282 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.274+0000 7faa3e887700 1 -- start start 2023-05-10T01:09:39.282 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa380bd780 0x7faa380a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:39.282 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa380c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380c6b80 con 0x7faa38150b20 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa381646b0 con 0x7faa380c2380 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3e887700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa381680c0 con 0x7faa380bd780 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57866/0 (socket says 172.21.15.52:57866) 2023-05-10T01:09:39.283 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 -- 172.21.15.52:0/675512641 learned_addr learned my addr 172.21.15.52:0/675512641 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa37fff700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa380bd780 0x7faa380a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa377fe700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa380c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 -- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa380bd780 msgr2=0x7faa380a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa380bd780 0x7faa380a8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 -- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 msgr2=0x7faa380c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa380c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.284 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 -- 172.21.15.52:0/675512641 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3000ab30 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa3ce24700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faa3000c610 tx=0x7faa3000a890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000cb80 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.275+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30014420 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.276+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa38163d80 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.276+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa38164340 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.276+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300147a0 con 0x7faa38150b20 2023-05-10T01:09:39.285 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.276+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7faa30014d70 con 0x7faa38150b20 2023-05-10T01:09:39.286 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.276+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7faa3001d400 con 0x7faa38150b20 2023-05-10T01:09:39.286 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.277+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa14005120 con 0x7faa38150b20 2023-05-10T01:09:39.286 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.279+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7faa300277d0 con 0x7faa38150b20 2023-05-10T01:09:39.350 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.347+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa14005ac0 con 0x7faa38150b20 2023-05-10T01:09:39.351 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.348+0000 7faa1ffff700 1 -- 172.21.15.52:0/675512641 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7faa30035090 con 0x7faa38150b20 2023-05-10T01:09:39.351 INFO:teuthology.misc.health.smithi052.stdout: 2023-05-10T01:09:39.351 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:38.064744+0000","last_up_change":"0.000000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:39.352 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 msgr2=0x7faa380c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:39.352 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faa3000c610 tx=0x7faa3000a890).stop 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 shutdown_connections 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa38150b20 0x7faa380c6690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa380bd780 0x7faa380a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 --2- 172.21.15.52:0/675512641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa380c2380 0x7faa380c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 >> 172.21.15.52:0/675512641 conn(0x7faa380c7bb0 msgr2=0x7faa38065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 shutdown_connections 2023-05-10T01:09:39.353 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:39.349+0000 7faa3e887700 1 -- 172.21.15.52:0/675512641 wait complete. 2023-05-10T01:09:39.363 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-10T01:09:39.442 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.439+0000 7ff09c6d9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:09:39.509 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.506+0000 7ff09c6d9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:09:39.518 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:39.515+0000 7f4019acb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:09:39.588 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.586+0000 7ff09c6d9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:09:39.589 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:39.586+0000 7f4019acb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:09:39.670 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:39.667+0000 7f4019acb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:09:39.735 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.733+0000 7ff09c6d9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:09:39.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.802+0000 7ff09c6d9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:09:39.823 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:39.820+0000 7f4019acb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:09:39.896 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:39.893+0000 7f4019acb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:09:39.922 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:39.919+0000 7ff09c6d9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:09:40.018 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:40.015+0000 7f4019acb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:09:40.026 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:40.023+0000 7ff09c6d9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:09:40.129 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:40.126+0000 7f4019acb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:09:40.347 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:40.344+0000 7ff09c6d9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:09:40.418 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:40.416+0000 7ff09c6d9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:09:40.460 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:40.458+0000 7f4019acb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:09:40.534 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:09:40.532+0000 7f4019acb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:09:41.450 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:41.447+0000 7ff052925700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-10T01:09:41.450 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:09:41.447+0000 7ff052925700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-10T01:09:42.201 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-05-10T01:09:42.199+0000 7ff903619200 -1 osd.2 0 log_to_monitors {default=true} 2023-05-10T01:09:42.212 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-05-10T01:09:42.209+0000 7ff06f7c8200 -1 osd.5 0 log_to_monitors {default=true} 2023-05-10T01:09:42.224 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-05-10T01:09:42.222+0000 7f4674b65200 -1 osd.3 0 log_to_monitors {default=true} 2023-05-10T01:09:42.232 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-05-10T01:09:42.229+0000 7f1c409f6200 -1 osd.1 0 log_to_monitors {default=true} 2023-05-10T01:09:42.242 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-05-10T01:09:42.239+0000 7f9262647200 -1 osd.6 0 log_to_monitors {default=true} 2023-05-10T01:09:42.258 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-05-10T01:09:42.256+0000 7f4784235200 -1 osd.0 0 log_to_monitors {default=true} 2023-05-10T01:09:42.275 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-05-10T01:09:42.272+0000 7f049fa8b200 -1 osd.4 0 log_to_monitors {default=true} 2023-05-10T01:09:42.286 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-05-10T01:09:42.284+0000 7f9f4126c200 -1 osd.7 0 log_to_monitors {default=true} 2023-05-10T01:09:43.453 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-05-10T01:09:43.450+0000 7f1c373b4700 -1 osd.1 0 waiting for initial osdmap 2023-05-10T01:09:43.453 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-05-10T01:09:43.451+0000 7ff8fb7da700 -1 osd.2 0 waiting for initial osdmap 2023-05-10T01:09:43.454 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-05-10T01:09:43.452+0000 7f477abf3700 -1 osd.0 0 waiting for initial osdmap 2023-05-10T01:09:43.454 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-05-10T01:09:43.452+0000 7f466b523700 -1 osd.3 0 waiting for initial osdmap 2023-05-10T01:09:43.455 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-05-10T01:09:43.452+0000 7f9f37c2a700 -1 osd.7 0 waiting for initial osdmap 2023-05-10T01:09:43.455 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-05-10T01:09:43.452+0000 7f0496449700 -1 osd.4 0 waiting for initial osdmap 2023-05-10T01:09:43.456 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-05-10T01:09:43.452+0000 7ff066186700 -1 osd.5 0 waiting for initial osdmap 2023-05-10T01:09:43.456 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-05-10T01:09:43.453+0000 7f9259005700 -1 osd.6 0 waiting for initial osdmap 2023-05-10T01:09:43.461 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-05-10T01:09:43.458+0000 7f0492bc6700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.461 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-05-10T01:09:43.458+0000 7f9255782700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.461 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-05-10T01:09:43.458+0000 7ff062903700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.462 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-05-10T01:09:43.459+0000 7f9f343a7700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.462 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-05-10T01:09:43.459+0000 7f4777370700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.462 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-05-10T01:09:43.459+0000 7f1c33b31700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.463 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-05-10T01:09:43.459+0000 7ff8f6754700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:43.463 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-05-10T01:09:43.459+0000 7f4667ca0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T01:09:46.170 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:46.295 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 Processor -- start 2023-05-10T01:09:46.296 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 -- start start 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febcc154160 0x7febcc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febcc069da0 0x7febcc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc0c0650 con 0x7febcc154540 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0c1af0 con 0x7febcc154160 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.293+0000 7febd14c4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc0bfd20 con 0x7febcc069da0 2023-05-10T01:09:46.298 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febcc154160 0x7febcc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febca7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7febcc154540 0x7febcc069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38870/0 (socket says 172.21.15.52:38870) 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febca7fc700 1 -- 172.21.15.52:0/917173767 learned_addr learned my addr 172.21.15.52:0/917173767 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcb7fe700 1 --2- 172.21.15.52:0/917173767 >> v2:172.21.15.172:3300/0 conn(0x7febcc069da0 0x7febcc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 -- 172.21.15.52:0/917173767 >> v2:172.21.15.172:3300/0 conn(0x7febcc069da0 msgr2=0x7febcc0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 --2- 172.21.15.52:0/917173767 >> v2:172.21.15.172:3300/0 conn(0x7febcc069da0 0x7febcc0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 -- 172.21.15.52:0/917173767 >> v1:172.21.15.52:6789/0 conn(0x7febcc154540 legacy=0x7febcc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febc9ffb700 1 -- 172.21.15.52:0/917173767 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717606363 0 0) 0x7febcc0c0650 con 0x7febcc154540 2023-05-10T01:09:46.299 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 -- 172.21.15.52:0/917173767 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0c0000 con 0x7febcc154160 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febcaffd700 1 --2- 172.21.15.52:0/917173767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc0c5c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7febcc0c5200 tx=0x7febc4009780).ready entity=mon.0 client_cookie=57089f1f11ec3bd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febc9ffb700 1 -- 172.21.15.52:0/917173767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400e070 con 0x7febcc154160 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febc9ffb700 1 -- 172.21.15.52:0/917173767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400bc30 con 0x7febcc154160 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.294+0000 7febc9ffb700 1 -- 172.21.15.52:0/917173767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4012410 con 0x7febcc154160 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 -- 172.21.15.52:0/917173767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 msgr2=0x7febcc0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.300 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 --2- 172.21.15.52:0/917173767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc0c5c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7febcc0c5200 tx=0x7febc4009780).stop 2023-05-10T01:09:46.301 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 -- 172.21.15.52:0/917173767 shutdown_connections 2023-05-10T01:09:46.301 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 --2- 172.21.15.52:0/917173767 >> v2:172.21.15.172:3300/0 conn(0x7febcc069da0 0x7febcc0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.301 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 --2- 172.21.15.52:0/917173767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc0c5c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.301 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 -- 172.21.15.52:0/917173767 >> 172.21.15.52:0/917173767 conn(0x7febcc0cb6f0 msgr2=0x7febcc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:46.301 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 -- 172.21.15.52:0/917173767 shutdown_connections 2023-05-10T01:09:46.302 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.295+0000 7febd14c4700 1 -- 172.21.15.52:0/917173767 wait complete. 2023-05-10T01:09:46.304 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.296+0000 7febd14c4700 1 Processor -- start 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.296+0000 7febd14c4700 1 -- start start 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febcc069da0 0x7febcc14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febcc154540 0x7febcc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc15ad40 con 0x7febcc154160 2023-05-10T01:09:46.305 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0c40a0 con 0x7febcc069da0 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febd14c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc14d210 con 0x7febcc154540 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58094/0 (socket says 172.21.15.52:58094) 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 -- 172.21.15.52:0/2505714232 learned_addr learned my addr 172.21.15.52:0/2505714232 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febcaffd700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febcc069da0 0x7febcc14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febcb7fe700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febcc154540 0x7febcc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 -- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febcc154540 msgr2=0x7febcc15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.306 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febcc154540 0x7febcc15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 -- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febcc069da0 msgr2=0x7febcc14cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febcc069da0 0x7febcc14cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 -- 172.21.15.52:0/2505714232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009a20 con 0x7febcc154160 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febca7fc700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7febb400c490 tx=0x7febb4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.297+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb40072e0 con 0x7febcc154160 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.298+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb4007440 con 0x7febcc154160 2023-05-10T01:09:46.307 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.298+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc0c3490 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.298+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb40057a0 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.298+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc0c3a50 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.298+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc0666b0 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.299+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7febb4010070 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.299+0000 7febc2ffd700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 0x7febb0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.299+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7febb4078c80 con 0x7febcc154160 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.300+0000 7febcaffd700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 0x7febb0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.308 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.300+0000 7febcaffd700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 0x7febb0061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7febc4009f90 tx=0x7febc4009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.309 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.304+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febb404a6f0 con 0x7febcc154160 2023-05-10T01:09:46.480 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.478+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febcc06c340 con 0x7febcc154160 2023-05-10T01:09:46.481 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.479+0000 7febc2ffd700 1 -- 172.21.15.52:0/2505714232 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12298 (secure 0 0 0) 0x7febb404dd10 con 0x7febcc154160 2023-05-10T01:09:46.482 INFO:teuthology.misc.health.smithi052.stdout: 2023-05-10T01:09:46.482 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":15,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:46.463960+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:46.483 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 msgr2=0x7febb0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.483 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 0x7febb0061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7febc4009f90 tx=0x7febc4009780).stop 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 msgr2=0x7febcc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7febb400c490 tx=0x7febb4007e60).stop 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 shutdown_connections 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb005ed90 0x7febb0061250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febcc154540 0x7febcc15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.484 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febcc069da0 0x7febcc14cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.485 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 --2- 172.21.15.52:0/2505714232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febcc154160 0x7febcc15a360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.485 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 >> 172.21.15.52:0/2505714232 conn(0x7febcc0cb6f0 msgr2=0x7febcc0ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:46.485 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 shutdown_connections 2023-05-10T01:09:46.485 INFO:teuthology.misc.health.smithi052.stderr:2023-05-10T01:09:46.481+0000 7febd14c4700 1 -- 172.21.15.52:0/2505714232 wait complete. 2023-05-10T01:09:46.494 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-10T01:09:46.495 INFO:tasks.ceph:Creating RBD pool 2023-05-10T01:09:46.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-10T01:09:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.608+0000 7f7012519700 1 Processor -- start 2023-05-10T01:09:46.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.608+0000 7f7012519700 1 -- start start 2023-05-10T01:09:46.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f7012519700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f700c154080 0x7f700c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f7012519700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c0c94c0 con 0x7f700c154460 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f7012519700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c0cb7d0 con 0x7f700c068150 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f7012519700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c0c88b0 con 0x7f700c154080 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f700b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f700c154460 0x7f700c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38886/0 (socket says 172.21.15.52:38886) 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f700b7fe700 1 -- 172.21.15.52:0/2097596941 learned_addr learned my addr 172.21.15.52:0/2097596941 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:46.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f700bfff700 1 --2- 172.21.15.52:0/2097596941 >> v2:172.21.15.172:3300/0 conn(0x7f700c154080 0x7f700c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457886180 0 0) 0x7f700c0c94c0 con 0x7f700c154460 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.609+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff80033f0 con 0x7f700c154460 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113979772 0 0) 0x7f6ff80033f0 con 0x7f700c154460 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 >> v2:172.21.15.172:3300/0 conn(0x7f700c154080 msgr2=0x7f700c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 --2- 172.21.15.52:0/2097596941 >> v2:172.21.15.172:3300/0 conn(0x7f700c154080 0x7f700c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 >> v1:172.21.15.172:6789/0 conn(0x7f700c068150 legacy=0x7f700c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0c8b90 con 0x7f700c154460 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7000001470 con 0x7f700c154460 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 >> v1:172.21.15.52:6789/0 conn(0x7f700c154460 legacy=0x7f700c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff80038e0 0x7f6ff8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 0x7f6ff8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff8005000 0x7f6ff800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0c88b0 con 0x7f6ff8004690 2023-05-10T01:09:46.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff800bf60 con 0x7f6ff8005000 2023-05-10T01:09:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff800c0f0 con 0x7f6ff80038e0 2023-05-10T01:09:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 0x7f6ff8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700bfff700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff80038e0 0x7f6ff8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f7010ab6700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff8005000 0x7f6ff800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 -- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff80038e0 msgr2=0x7f6ff8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff80038e0 0x7f6ff8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 -- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff8005000 msgr2=0x7f6ff800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff8005000 0x7f6ff800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 -- 172.21.15.52:0/2097596941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80033f0 con 0x7f6ff8004690 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f7010ab6700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff8005000 0x7f6ff800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f7010ab6700 1 -- 172.21.15.52:0/2097596941 reap_dead start 2023-05-10T01:09:46.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 0x7f6ff8004b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f700000c190 tx=0x7f7000001e50).ready entity=mon.0 client_cookie=d378d6cd76dca94f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000007a20 con 0x7f6ff8004690 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000cac0 con 0x7f6ff8004690 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.610+0000 7f700affd700 1 -- 172.21.15.52:0/2097596941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000ce40 con 0x7f6ff8004690 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 -- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 msgr2=0x7f6ff8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 0x7f6ff8004b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f700000c190 tx=0x7f7000001e50).stop 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 -- 172.21.15.52:0/2097596941 shutdown_connections 2023-05-10T01:09:46.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 --2- 172.21.15.52:0/2097596941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ff8004690 0x7f6ff8004b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 -- 172.21.15.52:0/2097596941 >> 172.21.15.52:0/2097596941 conn(0x7f700c067910 msgr2=0x7f700c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 -- 172.21.15.52:0/2097596941 shutdown_connections 2023-05-10T01:09:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.611+0000 7f7012519700 1 -- 172.21.15.52:0/2097596941 wait complete. 2023-05-10T01:09:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.612+0000 7f7012519700 1 Processor -- start 2023-05-10T01:09:46.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.612+0000 7f7012519700 1 -- start start 2023-05-10T01:09:46.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff8004690 0x7f700c164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c142bd0 0x7f700c0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c156720 con 0x7f700c164900 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c155b10 con 0x7f700c142bd0 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7012519700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c155df0 con 0x7f6ff8004690 2023-05-10T01:09:46.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58114/0 (socket says 172.21.15.52:58114) 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 -- 172.21.15.52:0/2470430510 learned_addr learned my addr 172.21.15.52:0/2470430510 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700bfff700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff8004690 0x7f700c164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f7010ab6700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c142bd0 0x7f700c0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 -- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff8004690 msgr2=0x7f700c164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff8004690 0x7f700c164410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 -- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c142bd0 msgr2=0x7f700c0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c142bd0 0x7f700c0c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 -- 172.21.15.52:0/2470430510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c1560d0 con 0x7f700c164900 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f700b7fe700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6ff8005640 tx=0x7f7000015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.613+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000074b0 con 0x7f700c164900 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.614+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7000007610 con 0x7f700c164900 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.614+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c1563b0 con 0x7f700c164900 2023-05-10T01:09:46.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.614+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000048e0 con 0x7f700c164900 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.614+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c0c2c90 con 0x7f700c164900 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.615+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c066720 con 0x7f700c164900 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.615+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7000010070 con 0x7f700c164900 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.615+0000 7f6ff3fff700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 0x7f6fec061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.615+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7f7000079e40 con 0x7f700c164900 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.615+0000 7f700bfff700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 0x7f6fec061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.616+0000 7f700bfff700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 0x7f6fec061280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6ffc006d80 tx=0x7f6ffc009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:46.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.619+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f700004b890 con 0x7f700c164900 2023-05-10T01:09:46.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:46.791+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f700c06c340 con 0x7f700c164900 2023-05-10T01:09:47.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.476+0000 7f6ff3fff700 1 -- 172.21.15.52:0/2470430510 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f700004eeb0 con 0x7f700c164900 2023-05-10T01:09:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 msgr2=0x7f6fec061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 0x7f6fec061280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6ffc006d80 tx=0x7f6ffc009060).stop 2023-05-10T01:09:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 msgr2=0x7f700c1426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6ff8005640 tx=0x7f7000015000).stop 2023-05-10T01:09:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 shutdown_connections 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fec05edc0 0x7f6fec061280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c142bd0 0x7f700c0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ff8004690 0x7f700c164410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 --2- 172.21.15.52:0/2470430510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f700c164900 0x7f700c1426e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 >> 172.21.15.52:0/2470430510 conn(0x7f700c067910 msgr2=0x7f700c0c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 shutdown_connections 2023-05-10T01:09:47.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.479+0000 7f7012519700 1 -- 172.21.15.52:0/2470430510 wait complete. 2023-05-10T01:09:47.484 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2023-05-10T01:09:47.497 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-10T01:09:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.619+0000 7f830efd8700 1 Processor -- start 2023-05-10T01:09:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.619+0000 7f830efd8700 1 -- start start 2023-05-10T01:09:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f830efd8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f83080aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f830efd8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080c94c0 con 0x7f8308154460 2023-05-10T01:09:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f830efd8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080cb7d0 con 0x7f8308068150 2023-05-10T01:09:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f830efd8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080c88b0 con 0x7f8308154080 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f8307fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8308154460 0x7f83080a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38904/0 (socket says 172.21.15.52:38904) 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.620+0000 7f8307fff700 1 -- 172.21.15.52:0/3672349822 learned_addr learned my addr 172.21.15.52:0/3672349822 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830cd74700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f83080aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757521768 0 0) 0x7f83080c94c0 con 0x7f8308154460 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e80033f0 con 0x7f8308154460 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1925114513 0 0) 0x7f82e80033f0 con 0x7f8308154460 2023-05-10T01:09:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 msgr2=0x7f83080aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f83080aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 >> v1:172.21.15.172:6789/0 conn(0x7f8308068150 legacy=0x7f8308068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080c8b90 con 0x7f8308154460 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f82f80017f0 con 0x7f8308154460 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 >> v1:172.21.15.52:6789/0 conn(0x7f8308154460 legacy=0x7f83080a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f82e8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8003e40 0x7f82e8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82e8004b80 0x7f82e8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080c88b0 con 0x7f82e8004b80 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e800b990 con 0x7f82e8003e40 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e800bb50 con 0x7f8308154080 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82e8004b80 0x7f82e8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830cd74700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f82e8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f8307fff700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8003e40 0x7f82e8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 -- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 msgr2=0x7f82e8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308154080 0x7f82e8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 -- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8003e40 msgr2=0x7f82e8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8003e40 0x7f82e8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 -- 172.21.15.52:0/3672349822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80033f0 con 0x7f82e8004b80 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.621+0000 7f830d575700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82e8004b80 0x7f82e8005000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f82f0001730 tx=0x7f82f0007bb0).ready entity=mon.0 client_cookie=1f5a02c49f6ffdc2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:47.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007020 con 0x7f82e8004b80 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0007180 con 0x7f82e8004b80 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f83077fe700 1 -- 172.21.15.52:0/3672349822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007500 con 0x7f82e8004b80 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 -- 172.21.15.52:0/3672349822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82e8004b80 msgr2=0x7f82e8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 --2- 172.21.15.52:0/3672349822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82e8004b80 0x7f82e8005000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f82f0001730 tx=0x7f82f0007bb0).stop 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830d575700 1 -- 172.21.15.52:0/3672349822 reap_dead start 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 -- 172.21.15.52:0/3672349822 shutdown_connections 2023-05-10T01:09:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 -- 172.21.15.52:0/3672349822 >> 172.21.15.52:0/3672349822 conn(0x7f8308067910 msgr2=0x7f83080cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 -- 172.21.15.52:0/3672349822 shutdown_connections 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.622+0000 7f830efd8700 1 -- 172.21.15.52:0/3672349822 wait complete. 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.623+0000 7f830efd8700 1 Processor -- start 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 -- start start 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 0x7f83080abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 0x7f8308140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081411f0 con 0x7f83080ac1f0 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308150dd0 con 0x7f82e8004b80 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f830efd8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830814f3e0 con 0x7f8308167f70 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f8307fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f8307fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58134/0 (socket says 172.21.15.52:58134) 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.624+0000 7f8307fff700 1 -- 172.21.15.52:0/425989801 learned_addr learned my addr 172.21.15.52:0/425989801 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830d575700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 0x7f8308140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 -- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 msgr2=0x7f8308140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830cd74700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 0x7f83080abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 0x7f8308140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 -- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 msgr2=0x7f83080abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 0x7f83080abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 -- 172.21.15.52:0/425989801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83081683f0 con 0x7f83080ac1f0 2023-05-10T01:09:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830d575700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 0x7f8308140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830cd74700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 0x7f83080abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8307fff700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f82f8007430 tx=0x7f82f8001250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800e5c0 con 0x7f83080ac1f0 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8010040 con 0x7f83080ac1f0 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83081507c0 con 0x7f83080ac1f0 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800e950 con 0x7f83080ac1f0 2023-05-10T01:09:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.625+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8308150a60 con 0x7f83080ac1f0 2023-05-10T01:09:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.626+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308066720 con 0x7f83080ac1f0 2023-05-10T01:09:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.626+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f82f801b020 con 0x7f83080ac1f0 2023-05-10T01:09:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.627+0000 7f8304ff9700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 0x7f82ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.627+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f82f80791a0 con 0x7f83080ac1f0 2023-05-10T01:09:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.627+0000 7f830cd74700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 0x7f82ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.627+0000 7f830cd74700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 0x7f82ec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8300009270 tx=0x7f8300008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.631+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82f804aaa0 con 0x7f83080ac1f0 2023-05-10T01:09:47.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:47.804+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f83080c8e70 con 0x7f83080ac1f0 2023-05-10T01:09:48.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.481+0000 7f8304ff9700 1 -- 172.21.15.52:0/425989801 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f82f804e0c0 con 0x7f83080ac1f0 2023-05-10T01:09:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.485+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 msgr2=0x7f82ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.485+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 0x7f82ec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8300009270 tx=0x7f8300008040).stop 2023-05-10T01:09:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.485+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 msgr2=0x7f8308167a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.485+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f82f8007430 tx=0x7f82f8001250).stop 2023-05-10T01:09:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 shutdown_connections 2023-05-10T01:09:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f82ec05ed90 0x7f82ec061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8308167f70 0x7f8308140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e8004b80 0x7f83080abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 --2- 172.21.15.52:0/425989801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83080ac1f0 0x7f8308167a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 >> 172.21.15.52:0/425989801 conn(0x7f8308067910 msgr2=0x7f83080ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 shutdown_connections 2023-05-10T01:09:48.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.486+0000 7f830efd8700 1 -- 172.21.15.52:0/425989801 wait complete. 2023-05-10T01:09:48.491 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-10T01:09:48.505 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-10T01:09:48.505 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:09:48.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:09:48.508 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:09:48.508 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:09:48.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:09:48.511 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:09:48.511 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:09:48.512 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:09:48.515 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:09:48.515 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:09:48.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:09:48.517 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:09:48.517 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-10T01:09:48.518 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:48.586 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:09:48.589 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:09:48.592 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:09:48.592 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:09:48.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.643+0000 7f1f867b8700 1 Processor -- start 2023-05-10T01:09:48.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.643+0000 7f1f867b8700 1 -- start start 2023-05-10T01:09:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f867b8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f8014e1f0 0x7f1f8014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f867b8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f8015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f867b8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800683c0 con 0x7f1f80066e40 2023-05-10T01:09:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f867b8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f80137460 con 0x7f1f8014e1f0 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f867b8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c3510 con 0x7f1f80158150 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f8014e1f0 0x7f1f8014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f8014e1f0 0x7f1f8014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58164/0 (socket says 172.21.15.52:58164) 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 -- 172.21.15.52:0/254342850 learned_addr learned my addr 172.21.15.52:0/254342850 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f84d55700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f8015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 -- 172.21.15.52:0/254342850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 msgr2=0x7f1f8015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f8015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 -- 172.21.15.52:0/254342850 >> v1:172.21.15.172:6789/0 conn(0x7f1f80066e40 legacy=0x7f1f80157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 -- 172.21.15.52:0/254342850 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800be050 con 0x7f1f8014e1f0 2023-05-10T01:09:48.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f84d55700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f8015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:48.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.644+0000 7f1f7ffff700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f8014e5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1f70009830 tx=0x7f1f700090f0).ready entity=mon.0 client_cookie=1af82c0e4a488502 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:48.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f7effd700 1 -- 172.21.15.52:0/254342850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000b600 con 0x7f1f8014e1f0 2023-05-10T01:09:48.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f7effd700 1 -- 172.21.15.52:0/254342850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7000b760 con 0x7f1f8014e1f0 2023-05-10T01:09:48.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f7effd700 1 -- 172.21.15.52:0/254342850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000bae0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 -- 172.21.15.52:0/254342850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 msgr2=0x7f1f8014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f8014e5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1f70009830 tx=0x7f1f700090f0).stop 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 -- 172.21.15.52:0/254342850 shutdown_connections 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f8015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 --2- 172.21.15.52:0/254342850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f8014e5d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 -- 172.21.15.52:0/254342850 >> 172.21.15.52:0/254342850 conn(0x7f1f800c7bb0 msgr2=0x7f1f800c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 -- 172.21.15.52:0/254342850 shutdown_connections 2023-05-10T01:09:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.645+0000 7f1f867b8700 1 -- 172.21.15.52:0/254342850 wait complete. 2023-05-10T01:09:48.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.646+0000 7f1f867b8700 1 Processor -- start 2023-05-10T01:09:48.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.646+0000 7f1f867b8700 1 -- start start 2023-05-10T01:09:48.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f80066e40 0x7f1f80135390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f800aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80135d70 con 0x7f1f8014e1f0 2023-05-10T01:09:48.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800a73c0 con 0x7f1f80066e40 2023-05-10T01:09:48.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f867b8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800ac5a0 con 0x7f1f80158150 2023-05-10T01:09:48.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:48.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58170/0 (socket says 172.21.15.52:58170) 2023-05-10T01:09:48.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.647+0000 7f1f7f7fe700 1 -- 172.21.15.52:0/3363388430 learned_addr learned my addr 172.21.15.52:0/3363388430 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 -- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 msgr2=0x7f1f800aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f800aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 -- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f80066e40 msgr2=0x7f1f80135390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f80066e40 0x7f1f80135390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 -- 172.21.15.52:0/3363388430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70009370 con 0x7f1f8014e1f0 2023-05-10T01:09:48.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f7f7fe700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1f7400c4c0 tx=0x7f1f74007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74007020 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74001e90 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f740073d0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800ab920 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.648+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800abee0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.649+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800a7660 con 0x7f1f8014e1f0 2023-05-10T01:09:48.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.649+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1f74010070 con 0x7f1f8014e1f0 2023-05-10T01:09:48.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.650+0000 7f1f67fff700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 0x7f1f60061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:48.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.650+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1f74078fb0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.650+0000 7f1f7ffff700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 0x7f1f60061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:48.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.650+0000 7f1f7ffff700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 0x7f1f60061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f7000b3c0 tx=0x7f1f70017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:48.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.654+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f7404a8a0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.825+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f8006c340 con 0x7f1f8014e1f0 2023-05-10T01:09:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.826+0000 7f1f67fff700 1 -- 172.21.15.52:0/3363388430 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13818 (secure 0 0 0) 0x7f1f7404dec0 con 0x7f1f8014e1f0 2023-05-10T01:09:48.829 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:48.829 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:48.475401+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 msgr2=0x7f1f60061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 0x7f1f60061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f7000b3c0 tx=0x7f1f70017000).stop 2023-05-10T01:09:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 msgr2=0x7f1f80135880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1f7400c4c0 tx=0x7f1f74007e00).stop 2023-05-10T01:09:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 shutdown_connections 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6005ed90 0x7f1f60061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f80158150 0x7f1f800aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f80066e40 0x7f1f80135390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 --2- 172.21.15.52:0/3363388430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8014e1f0 0x7f1f80135880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 >> 172.21.15.52:0/3363388430 conn(0x7f1f800c7bb0 msgr2=0x7f1f800a54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 shutdown_connections 2023-05-10T01:09:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.828+0000 7f1f867b8700 1 -- 172.21.15.52:0/3363388430 wait complete. 2023-05-10T01:09:48.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:09:48.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:09:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.959+0000 7f4fa0b07700 1 Processor -- start 2023-05-10T01:09:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.959+0000 7f4fa0b07700 1 -- start start 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4fa0b07700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 0x7f4f9c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4fa0b07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4fa0b07700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0c94c0 con 0x7f4f9c154080 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4fa0b07700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0cb7d0 con 0x7f4f9c154460 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4fa0b07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c068a90 con 0x7f4f9c068150 2023-05-10T01:09:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4f9ad9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4f99d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 0x7f4f9c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4f9ad9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:49582/0 (socket says 172.21.15.52:49582) 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/3266894820 learned_addr learned my addr 172.21.15.52:0/3266894820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.960+0000 7f4f9a59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4f9c154080 0x7f4f9c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:41498/0 (socket says 172.21.15.52:41498) 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/3266894820 >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 msgr2=0x7f4f9c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 --2- 172.21.15.52:0/3266894820 >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 0x7f4f9c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/3266894820 >> v1:172.21.15.172:6789/0 conn(0x7f4f9c154080 legacy=0x7f4f9c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9959a700 1 -- 172.21.15.52:0/3266894820 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589527209 0 0) 0x7f4f9c0c94c0 con 0x7f4f9c154080 2023-05-10T01:09:49.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/3266894820 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0c88b0 con 0x7f4f9c068150 2023-05-10T01:09:49.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f99d9b700 1 --2- 172.21.15.52:0/3266894820 >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 0x7f4f9c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:49.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9ad9d700 1 --2- 172.21.15.52:0/3266894820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f8c009f20 tx=0x7f4f8c009840).ready entity=mon.2 client_cookie=ba9459b258cb11ac server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9959a700 1 -- 172.21.15.52:0/3266894820 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00e070 con 0x7f4f9c068150 2023-05-10T01:09:49.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9959a700 1 -- 172.21.15.52:0/3266894820 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00b9d0 con 0x7f4f9c068150 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.961+0000 7f4f9959a700 1 -- 172.21.15.52:0/3266894820 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00bd50 con 0x7f4f9c068150 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 -- 172.21.15.52:0/3266894820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 msgr2=0x7f4f9c0685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/3266894820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f8c009f20 tx=0x7f4f8c009840).stop 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 -- 172.21.15.52:0/3266894820 shutdown_connections 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/3266894820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c068150 0x7f4f9c0685a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/3266894820 >> v2:172.21.15.172:3300/0 conn(0x7f4f9c154460 0x7f4f9c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 -- 172.21.15.52:0/3266894820 >> 172.21.15.52:0/3266894820 conn(0x7f4f9c067910 msgr2=0x7f4f9c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 -- 172.21.15.52:0/3266894820 shutdown_connections 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.962+0000 7f4fa0b07700 1 -- 172.21.15.52:0/3266894820 wait complete. 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 Processor -- start 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 -- start start 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 0x7f4f9c164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c154080 0x7f4f9c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b0730 con 0x7f4f9c154460 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.963+0000 7f4fa0b07700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c168260 con 0x7f4f9c068150 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4fa0b07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1644e0 con 0x7f4f9c154080 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58186/0 (socket says 172.21.15.52:58186) 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/2048055006 learned_addr learned my addr 172.21.15.52:0/2048055006 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9a59c700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 0x7f4f9c164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f99d9b700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c154080 0x7f4f9c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c154080 msgr2=0x7f4f9c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c154080 0x7f4f9c156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 msgr2=0x7f4f9c164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 0x7f4f9c164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 -- 172.21.15.52:0/2048055006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840092a0 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9a59c700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 0x7f4f9c164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f9ad9d700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4f8c00b610 tx=0x7f4f8c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0092e0 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c01e470 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c009ae0 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c01e830 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.964+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c163e90 con 0x7f4f9c154460 2023-05-10T01:09:49.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.965+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c164690 con 0x7f4f9c154460 2023-05-10T01:09:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.966+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4f8c025030 con 0x7f4f9c154460 2023-05-10T01:09:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.966+0000 7f4f927fc700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 0x7f4f80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.966+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4f8c07aec0 con 0x7f4f9c154460 2023-05-10T01:09:49.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.966+0000 7f4f9a59c700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 0x7f4f80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.966+0000 7f4f9a59c700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 0x7f4f80061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4f9c14f4b0 tx=0x7f4f94009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:48.970+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f9c164690 con 0x7f4f9c154460 2023-05-10T01:09:49.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.144+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f9c164650 con 0x7f4f9c154460 2023-05-10T01:09:49.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.144+0000 7f4f927fc700 1 -- 172.21.15.52:0/2048055006 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4f8c023030 con 0x7f4f9c154460 2023-05-10T01:09:49.147 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:09:49.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 msgr2=0x7f4f80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 0x7f4f80061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4f9c14f4b0 tx=0x7f4f94009040).stop 2023-05-10T01:09:49.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 msgr2=0x7f4f9c0ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4f8c00b610 tx=0x7f4f8c009840).stop 2023-05-10T01:09:49.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 shutdown_connections 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f8005ed90 0x7f4f80061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c154460 0x7f4f9c0ca530 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f9c068150 0x7f4f9c164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 --2- 172.21.15.52:0/2048055006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f9c154080 0x7f4f9c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 >> 172.21.15.52:0/2048055006 conn(0x7f4f9c067910 msgr2=0x7f4f9c14fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 shutdown_connections 2023-05-10T01:09:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.146+0000 7f4fa0b07700 1 -- 172.21.15.52:0/2048055006 wait complete. 2023-05-10T01:09:49.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:09:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.277+0000 7f299c213700 1 Processor -- start 2023-05-10T01:09:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.277+0000 7f299c213700 1 -- start start 2023-05-10T01:09:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299c213700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2994154460 0x7f29940aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299c213700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f29940685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299c213700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940c94c0 con 0x7f2994154080 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299c213700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940cb7d0 con 0x7f2994154460 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299c213700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2994068a90 con 0x7f2994068150 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2994154460 0x7f29940aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2994154460 0x7f29940aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58192/0 (socket says 172.21.15.52:58192) 2023-05-10T01:09:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 -- 172.21.15.52:0/661866638 learned_addr learned my addr 172.21.15.52:0/661866638 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f299a7b0700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f29940685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 -- 172.21.15.52:0/661866638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 msgr2=0x7f29940685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f29940685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 -- 172.21.15.52:0/661866638 >> v1:172.21.15.172:6789/0 conn(0x7f2994154080 legacy=0x7f29940a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 -- 172.21.15.52:0/661866638 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940c88b0 con 0x7f2994154460 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f29997ae700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f29940aac90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2988006fd0 tx=0x7f29880090f0).ready entity=mon.0 client_cookie=2f4b8d31d5181a44 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.278+0000 7f2998fad700 1 -- 172.21.15.52:0/661866638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800b600 con 0x7f2994154460 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f2998fad700 1 -- 172.21.15.52:0/661866638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800b760 con 0x7f2994154460 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f2998fad700 1 -- 172.21.15.52:0/661866638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800bae0 con 0x7f2994154460 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 -- 172.21.15.52:0/661866638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 msgr2=0x7f29940aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f29940aac90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2988006fd0 tx=0x7f29880090f0).stop 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 -- 172.21.15.52:0/661866638 shutdown_connections 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f29940685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 --2- 172.21.15.52:0/661866638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f29940aac90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 -- 172.21.15.52:0/661866638 >> 172.21.15.52:0/661866638 conn(0x7f2994067910 msgr2=0x7f29940cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 -- 172.21.15.52:0/661866638 shutdown_connections 2023-05-10T01:09:49.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.279+0000 7f299c213700 1 -- 172.21.15.52:0/661866638 wait complete. 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.280+0000 7f299c213700 1 Processor -- start 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.280+0000 7f299c213700 1 -- start start 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f2994144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994154080 0x7f29940c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994151640 con 0x7f2994154460 2023-05-10T01:09:49.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299414eca0 con 0x7f2994154080 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299c213700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299414ef80 con 0x7f2994068150 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58200/0 (socket says 172.21.15.52:58200) 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 -- 172.21.15.52:0/844425565 learned_addr learned my addr 172.21.15.52:0/844425565 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f29997ae700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994154080 0x7f29940c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f2999faf700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f2994144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 -- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 msgr2=0x7f2994144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f2994144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 -- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994154080 msgr2=0x7f29940c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994154080 0x7f29940c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.281+0000 7f299a7b0700 1 -- 172.21.15.52:0/844425565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009370 con 0x7f2994154460 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f299a7b0700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f298400d890 tx=0x7f2984008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984011590 con 0x7f2994154460 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29840116f0 con 0x7f2994154460 2023-05-10T01:09:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2994152840 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984011a70 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.282+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299414e8f0 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.283+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994152d60 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.283+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2984012420 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.283+0000 7f2991ffb700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 0x7f2974061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.283+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2984079280 con 0x7f2994154460 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.284+0000 7f2999faf700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 0x7f2974061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.284+0000 7f2999faf700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 0x7f2974061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f29941575e0 tx=0x7f298c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.288+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2994152d60 con 0x7f2994154460 2023-05-10T01:09:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.462+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2994152d60 con 0x7f2994154460 2023-05-10T01:09:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.462+0000 7f2991ffb700 1 -- 172.21.15.52:0/844425565 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2994152d60 con 0x7f2994154460 2023-05-10T01:09:49.465 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:09:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 msgr2=0x7f2974061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 0x7f2974061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f29941575e0 tx=0x7f298c009040).stop 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 msgr2=0x7f2994153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f298400d890 tx=0x7f2984008040).stop 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 shutdown_connections 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f297405ed90 0x7f2974061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2994154460 0x7f2994153040 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2994068150 0x7f2994144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 --2- 172.21.15.52:0/844425565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994154080 0x7f29940c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 >> 172.21.15.52:0/844425565 conn(0x7f2994067910 msgr2=0x7f299414f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 shutdown_connections 2023-05-10T01:09:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.464+0000 7f299c213700 1 -- 172.21.15.52:0/844425565 wait complete. 2023-05-10T01:09:49.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:09:49.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.593+0000 7f997badd700 1 Processor -- start 2023-05-10T01:09:49.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.593+0000 7f997badd700 1 -- start start 2023-05-10T01:09:49.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f997badd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f997badd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99740c0650 con 0x7f9974154160 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f997badd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99740c1af0 con 0x7f9974154540 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f997badd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740bfd20 con 0x7f9974069da0 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f9979879700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9974154160 0x7f99740c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38988/0 (socket says 172.21.15.52:38988) 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f9979879700 1 -- 172.21.15.52:0/3918588561 learned_addr learned my addr 172.21.15.52:0/3918588561 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.594+0000 7f997a07a700 1 --2- 172.21.15.52:0/3918588561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.595+0000 7f997a07a700 1 -- 172.21.15.52:0/3918588561 >> v1:172.21.15.172:6789/0 conn(0x7f9974154540 legacy=0x7f9974069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.595+0000 7f997a07a700 1 -- 172.21.15.52:0/3918588561 >> v1:172.21.15.52:6789/0 conn(0x7f9974154160 legacy=0x7f99740c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.595+0000 7f997a07a700 1 -- 172.21.15.52:0/3918588561 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740c0000 con 0x7f9974069da0 2023-05-10T01:09:49.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.595+0000 7f997a07a700 1 --2- 172.21.15.52:0/3918588561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997415f1f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f996c009e90 tx=0x7f996c009780).ready entity=mon.2 client_cookie=122b63fef4b6b900 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.596+0000 7f9978877700 1 -- 172.21.15.52:0/3918588561 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00e070 con 0x7f9974069da0 2023-05-10T01:09:49.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.596+0000 7f9978877700 1 -- 172.21.15.52:0/3918588561 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00bc30 con 0x7f9974069da0 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.596+0000 7f9978877700 1 -- 172.21.15.52:0/3918588561 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c012410 con 0x7f9974069da0 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 -- 172.21.15.52:0/3918588561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 msgr2=0x7f997415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 --2- 172.21.15.52:0/3918588561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997415f1f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f996c009e90 tx=0x7f996c009780).stop 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 -- 172.21.15.52:0/3918588561 shutdown_connections 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 --2- 172.21.15.52:0/3918588561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997415f1f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 -- 172.21.15.52:0/3918588561 >> 172.21.15.52:0/3918588561 conn(0x7f99740cb6f0 msgr2=0x7f99740c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 -- 172.21.15.52:0/3918588561 shutdown_connections 2023-05-10T01:09:49.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.597+0000 7f997badd700 1 -- 172.21.15.52:0/3918588561 wait complete. 2023-05-10T01:09:49.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.598+0000 7f997badd700 1 Processor -- start 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.598+0000 7f997badd700 1 -- start start 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9974154540 0x7f99740ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974157bd0 con 0x7f9974154160 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974157eb0 con 0x7f9974154540 2023-05-10T01:09:49.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997badd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974158190 con 0x7f9974069da0 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58214/0 (socket says 172.21.15.52:58214) 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 -- 172.21.15.52:0/347366927 learned_addr learned my addr 172.21.15.52:0/347366927 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979879700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f997a07a700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9974154540 0x7f99740ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 -- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 msgr2=0x7f997414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997414cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 -- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9974154540 msgr2=0x7f99740ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9974154540 0x7f99740ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.599+0000 7f9979078700 1 -- 172.21.15.52:0/347366927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009a20 con 0x7f9974154160 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f9979078700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f996400c440 tx=0x7f9964007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640123f0 con 0x7f9974154160 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964012550 con 0x7f9974154160 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974158470 con 0x7f9974154160 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640128f0 con 0x7f9974154160 2023-05-10T01:09:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.600+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997414d280 con 0x7f9974154160 2023-05-10T01:09:49.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.601+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740666b0 con 0x7f9974154160 2023-05-10T01:09:49.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.601+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9964010070 con 0x7f9974154160 2023-05-10T01:09:49.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.601+0000 7f9961ffb700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 0x7f9954061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.602+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9964078a20 con 0x7f9974154160 2023-05-10T01:09:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.602+0000 7f9979879700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 0x7f9954061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.602+0000 7f9979879700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 0x7f9954061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9970000c00 tx=0x7f9970009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.606+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99640478f0 con 0x7f9974154160 2023-05-10T01:09:49.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.820+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f997406c340 con 0x7f9974154160 2023-05-10T01:09:49.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.820+0000 7f9961ffb700 1 -- 172.21.15.52:0/347366927 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f996404a310 con 0x7f9974154160 2023-05-10T01:09:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:49.824 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-10T01:09:49.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 msgr2=0x7f9954061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 0x7f9954061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9970000c00 tx=0x7f9970009040).stop 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 msgr2=0x7f99741571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f996400c440 tx=0x7f9964007d80).stop 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 shutdown_connections 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f995405ed60 0x7f9954061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9974154540 0x7f99740ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9974069da0 0x7f997414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 --2- 172.21.15.52:0/347366927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9974154160 0x7f99741571d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 >> 172.21.15.52:0/347366927 conn(0x7f99740cb6f0 msgr2=0x7f99740abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 shutdown_connections 2023-05-10T01:09:49.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.822+0000 7f997badd700 1 -- 172.21.15.52:0/347366927 wait complete. 2023-05-10T01:09:49.828 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2023-05-10T01:09:49.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:49.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.950+0000 7fa98d373700 1 Processor -- start 2023-05-10T01:09:49.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.950+0000 7fa98d373700 1 -- start start 2023-05-10T01:09:49.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa98d373700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9880c12b0 0x7fa9880c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa98d373700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880bfe10 con 0x7fa9880c60c0 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa98d373700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880aa380 con 0x7fa988154020 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa98d373700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880c6510 con 0x7fa9880c12b0 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa9877fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa9880c60c0 0x7fa98815dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39008/0 (socket says 172.21.15.52:39008) 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa9877fe700 1 -- 172.21.15.52:0/3300477066 learned_addr learned my addr 172.21.15.52:0/3300477066 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3300477066 >> v2:172.21.15.172:3300/0 conn(0x7fa9880c12b0 0x7fa9880c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826295953 0 0) 0x7fa9880bfe10 con 0x7fa9880c60c0 2023-05-10T01:09:49.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9680033f0 con 0x7fa9880c60c0 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 372117107 0 0) 0x7fa9680033f0 con 0x7fa9880c60c0 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 >> v2:172.21.15.172:3300/0 conn(0x7fa9880c12b0 msgr2=0x7fa9880c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 --2- 172.21.15.52:0/3300477066 >> v2:172.21.15.172:3300/0 conn(0x7fa9880c12b0 0x7fa9880c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 >> v1:172.21.15.172:6789/0 conn(0x7fa988154020 legacy=0x7fa9880a9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98806a2f0 con 0x7fa9880c60c0 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fa978001470 con 0x7fa9880c60c0 2023-05-10T01:09:49.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 >> v1:172.21.15.52:6789/0 conn(0x7fa9880c60c0 legacy=0x7fa98815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9680038e0 0x7fa968003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 0x7fa968004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa968005000 0x7fa96800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c6510 con 0x7fa968004690 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96800beb0 con 0x7fa968005000 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.951+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96800c070 con 0x7fa9680038e0 2023-05-10T01:09:49.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 0x7fa968004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9877fe700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa968005000 0x7fa96800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa986ffd700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9680038e0 0x7fa968003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 -- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9680038e0 msgr2=0x7fa968003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9680038e0 0x7fa968003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 -- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa968005000 msgr2=0x7fa96800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa968005000 0x7fa96800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 -- 172.21.15.52:0/3300477066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680033f0 con 0x7fa968004690 2023-05-10T01:09:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9877fe700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa968005000 0x7fa96800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9877fe700 1 -- 172.21.15.52:0/3300477066 reap_dead start 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 0x7fa968004b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa970009a80 tx=0x7fa970009060).ready entity=mon.0 client_cookie=f754ae3153a17ea5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970009430 con 0x7fa968004690 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000e640 con 0x7fa968004690 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa985ffb700 1 -- 172.21.15.52:0/3300477066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e9c0 con 0x7fa968004690 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 -- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 msgr2=0x7fa968004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 0x7fa968004b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa970009a80 tx=0x7fa970009060).stop 2023-05-10T01:09:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 -- 172.21.15.52:0/3300477066 shutdown_connections 2023-05-10T01:09:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 --2- 172.21.15.52:0/3300477066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa968004690 0x7fa968004b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 -- 172.21.15.52:0/3300477066 >> 172.21.15.52:0/3300477066 conn(0x7fa9880cb570 msgr2=0x7fa9880c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.952+0000 7fa98d373700 1 -- 172.21.15.52:0/3300477066 shutdown_connections 2023-05-10T01:09:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.953+0000 7fa98d373700 1 -- 172.21.15.52:0/3300477066 wait complete. 2023-05-10T01:09:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 Processor -- start 2023-05-10T01:09:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 -- start start 2023-05-10T01:09:49.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 0x7fa9881564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98814c3f0 0x7fa98814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988168690 con 0x7fa988167710 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9881569a0 con 0x7fa98814c3f0 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.954+0000 7fa98d373700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c1d00 con 0x7fa968004690 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58234/0 (socket says 172.21.15.52:58234) 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 -- 172.21.15.52:0/3404689263 learned_addr learned my addr 172.21.15.52:0/3404689263 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9877fe700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98814c3f0 0x7fa98814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa986ffd700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 0x7fa9881564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 -- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 msgr2=0x7fa9881564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 0x7fa9881564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 -- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98814c3f0 msgr2=0x7fa98814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98814c3f0 0x7fa98814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 -- 172.21.15.52:0/3404689263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988167b90 con 0x7fa988167710 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa986ffd700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 0x7fa9881564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa9867fc700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa970006d50 tx=0x7fa97001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000ed70 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000e7b0 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98814c1f0 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970025440 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.955+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988167df0 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.956+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988083300 con 0x7fa988167710 2023-05-10T01:09:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.956+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa97002b020 con 0x7fa988167710 2023-05-10T01:09:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.957+0000 7fa97effd700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 0x7fa96c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.957+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa97007afa0 con 0x7fa988167710 2023-05-10T01:09:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.957+0000 7fa986ffd700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 0x7fa96c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.957+0000 7fa986ffd700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 0x7fa96c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa980007fd0 tx=0x7fa980009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:49.961+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa97004c890 con 0x7fa988167710 2023-05-10T01:09:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.131+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9881684f0 con 0x7fa988167710 2023-05-10T01:09:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.132+0000 7fa97effd700 1 -- 172.21.15.52:0/3404689263 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13805 (secure 0 0 0) 0x7fa9881684f0 con 0x7fa988167710 2023-05-10T01:09:50.135 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:50.135 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:49.480256+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 msgr2=0x7fa96c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 0x7fa96c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa980007fd0 tx=0x7fa980009040).stop 2023-05-10T01:09:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 msgr2=0x7fa98814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa970006d50 tx=0x7fa97001a000).stop 2023-05-10T01:09:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 shutdown_connections 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96c05ed90 0x7fa96c061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98814c3f0 0x7fa98814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa968004690 0x7fa9881564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 --2- 172.21.15.52:0/3404689263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988167710 0x7fa98814bd00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 >> 172.21.15.52:0/3404689263 conn(0x7fa9880cb570 msgr2=0x7fa98814f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 shutdown_connections 2023-05-10T01:09:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.134+0000 7fa98d373700 1 -- 172.21.15.52:0/3404689263 wait complete. 2023-05-10T01:09:50.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:09:50.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:09:50.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.266+0000 7f286afda700 1 Processor -- start 2023-05-10T01:09:50.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.266+0000 7f286afda700 1 -- start start 2023-05-10T01:09:50.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286afda700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2864153f80 0x7f28640a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286afda700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2864155370 0x7f28640c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286afda700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640c6690 con 0x7f28640c5cf0 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286afda700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2864069f50 con 0x7f2864155370 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286afda700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286406a9d0 con 0x7f2864153f80 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f28697d7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f28640c5cf0 0x7f28640c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39026/0 (socket says 172.21.15.52:39026) 2023-05-10T01:09:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f28697d7700 1 -- 172.21.15.52:0/2190527236 learned_addr learned my addr 172.21.15.52:0/2190527236 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 --2- 172.21.15.52:0/2190527236 >> v2:172.21.15.52:3300/0 conn(0x7f2864155370 0x7f28640c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f2869fd8700 1 --2- 172.21.15.52:0/2190527236 >> v2:172.21.15.172:3300/0 conn(0x7f2864153f80 0x7f28640a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f2868fd6700 1 -- 172.21.15.52:0/2190527236 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742050129 0 0) 0x7f2854001110 con 0x7f28640c5cf0 2023-05-10T01:09:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f2868fd6700 1 -- 172.21.15.52:0/2190527236 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c0033f0 con 0x7f28640c5cf0 2023-05-10T01:09:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 -- 172.21.15.52:0/2190527236 >> v2:172.21.15.172:3300/0 conn(0x7f2864153f80 msgr2=0x7f28640a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 --2- 172.21.15.52:0/2190527236 >> v2:172.21.15.172:3300/0 conn(0x7f2864153f80 0x7f28640a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 -- 172.21.15.52:0/2190527236 >> v1:172.21.15.52:6789/0 conn(0x7f28640c5cf0 legacy=0x7f28640c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 -- 172.21.15.52:0/2190527236 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864155770 con 0x7f2864155370 2023-05-10T01:09:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.267+0000 7f286a7d9700 1 --2- 172.21.15.52:0/2190527236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864155370 0x7f28640c61a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f28640caa30 tx=0x7f285c009780).ready entity=mon.0 client_cookie=815b39aa12e2f95f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f2868fd6700 1 -- 172.21.15.52:0/2190527236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00e070 con 0x7f2864155370 2023-05-10T01:09:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f2868fd6700 1 -- 172.21.15.52:0/2190527236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c00bab0 con 0x7f2864155370 2023-05-10T01:09:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f2868fd6700 1 -- 172.21.15.52:0/2190527236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00be30 con 0x7f2864155370 2023-05-10T01:09:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 -- 172.21.15.52:0/2190527236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864155370 msgr2=0x7f28640c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 --2- 172.21.15.52:0/2190527236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864155370 0x7f28640c61a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f28640caa30 tx=0x7f285c009780).stop 2023-05-10T01:09:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 -- 172.21.15.52:0/2190527236 shutdown_connections 2023-05-10T01:09:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 --2- 172.21.15.52:0/2190527236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864155370 0x7f28640c61a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 --2- 172.21.15.52:0/2190527236 >> v2:172.21.15.172:3300/0 conn(0x7f2864153f80 0x7f28640a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 -- 172.21.15.52:0/2190527236 >> 172.21.15.52:0/2190527236 conn(0x7f28640cb5f0 msgr2=0x7f28640c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 -- 172.21.15.52:0/2190527236 shutdown_connections 2023-05-10T01:09:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.268+0000 7f286afda700 1 -- 172.21.15.52:0/2190527236 wait complete. 2023-05-10T01:09:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.269+0000 7f286afda700 1 Processor -- start 2023-05-10T01:09:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.269+0000 7f286afda700 1 -- start start 2023-05-10T01:09:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 0x7f28640b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2864155370 0x7f2864167400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2864140070 con 0x7f2864153f80 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641405a0 con 0x7f2864155370 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286afda700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640aec10 con 0x7f28640c5cf0 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f28697d7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f28697d7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58246/0 (socket says 172.21.15.52:58246) 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f28697d7700 1 -- 172.21.15.52:0/1386283023 learned_addr learned my addr 172.21.15.52:0/1386283023 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f286a7d9700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2864155370 0x7f2864167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.270+0000 7f2869fd8700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 0x7f28640b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 -- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 msgr2=0x7f28640b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 0x7f28640b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 -- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2864155370 msgr2=0x7f2864167400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2864155370 0x7f2864167400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 -- 172.21.15.52:0/1386283023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009a20 con 0x7f2864153f80 2023-05-10T01:09:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f2869fd8700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 0x7f28640b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f28697d7700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f285400c440 tx=0x7f2854007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540072e0 con 0x7f2864153f80 2023-05-10T01:09:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854007440 con 0x7f2864153f80 2023-05-10T01:09:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640ae000 con 0x7f2864153f80 2023-05-10T01:09:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540057a0 con 0x7f2864153f80 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.271+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28640ae5c0 con 0x7f2864153f80 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.272+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2864083110 con 0x7f2864153f80 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.272+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f285401a060 con 0x7f2864153f80 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.273+0000 7f2851ffb700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 0x7f2844061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.273+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f28540789c0 con 0x7f2864153f80 2023-05-10T01:09:50.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.273+0000 7f2869fd8700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 0x7f2844061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.273+0000 7f2869fd8700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 0x7f2844061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2860006d80 tx=0x7f2860008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.277+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f285404a2b0 con 0x7f2864153f80 2023-05-10T01:09:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.449+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f28640c6690 con 0x7f2864153f80 2023-05-10T01:09:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.450+0000 7f2851ffb700 1 -- 172.21.15.52:0/1386283023 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f28640c6690 con 0x7f2864153f80 2023-05-10T01:09:50.453 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:09:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 msgr2=0x7f2844061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 0x7f2844061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2860006d80 tx=0x7f2860008040).stop 2023-05-10T01:09:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 msgr2=0x7f286415a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f285400c440 tx=0x7f2854007af0).stop 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 shutdown_connections 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f284405ed90 0x7f2844061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2864155370 0x7f2864167400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28640c5cf0 0x7f28640b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 --2- 172.21.15.52:0/1386283023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2864153f80 0x7f286415a680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.451+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 >> 172.21.15.52:0/1386283023 conn(0x7f28640cb5f0 msgr2=0x7f28641518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.452+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 shutdown_connections 2023-05-10T01:09:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.452+0000 7f286afda700 1 -- 172.21.15.52:0/1386283023 wait complete. 2023-05-10T01:09:50.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:09:50.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.583+0000 7f12d400c700 1 Processor -- start 2023-05-10T01:09:50.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.583+0000 7f12d400c700 1 -- start start 2023-05-10T01:09:50.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d400c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f12cc0c5d20 0x7f12cc0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d400c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12cc069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d400c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc154610 con 0x7f12cc153a90 2023-05-10T01:09:50.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d400c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0ca5f0 con 0x7f12cc0c5d20 2023-05-10T01:09:50.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d400c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c8820 con 0x7f12cc0c6100 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d25a9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f12cc153a90 0x7f12cc153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39040/0 (socket says 172.21.15.52:39040) 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d25a9700 1 -- 172.21.15.52:0/1847184098 learned_addr learned my addr 172.21.15.52:0/1847184098 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232412771 0 0) 0x7f12cc154610 con 0x7f12cc153a90 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.584+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b80033f0 con 0x7f12cc153a90 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d15a7700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12cc069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d1da8700 1 --2- 172.21.15.52:0/1847184098 >> v2:172.21.15.172:3300/0 conn(0x7f12cc0c5d20 0x7f12cc0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018287373 0 0) 0x7f12b80033f0 con 0x7f12cc153a90 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 msgr2=0x7f12cc069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12cc069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 >> v2:172.21.15.172:3300/0 conn(0x7f12cc0c5d20 msgr2=0x7f12cc0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 --2- 172.21.15.52:0/1847184098 >> v2:172.21.15.172:3300/0 conn(0x7f12cc0c5d20 0x7f12cc0aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0c8b00 con 0x7f12cc153a90 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f12bc001470 con 0x7f12cc153a90 2023-05-10T01:09:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d1da8700 1 --2- 172.21.15.52:0/1847184098 >> v2:172.21.15.172:3300/0 conn(0x7f12cc0c5d20 0x7f12cc0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 >> v1:172.21.15.52:6789/0 conn(0x7f12cc153a90 legacy=0x7f12cc153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12b8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b8004b80 0x7f12b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0ca5f0 con 0x7f12b8004b80 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c8820 con 0x7f12b80038e0 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b800b8e0 con 0x7f12cc0c6100 2023-05-10T01:09:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b8004b80 0x7f12b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d1da8700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d15a7700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12b8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 -- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 msgr2=0x7f12b8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12cc0c6100 0x7f12b8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 -- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12b80038e0 msgr2=0x7f12b8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 -- 172.21.15.52:0/1847184098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80033f0 con 0x7f12b8004b80 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d25a9700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b8004b80 0x7f12b8005000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f12bc00c210 tx=0x7f12cc0c7050).ready entity=mon.0 client_cookie=12ed0a04c4a5c983 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc007a60 con 0x7f12b8004b80 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.585+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00cae0 con 0x7f12b8004b80 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d0da6700 1 -- 172.21.15.52:0/1847184098 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00ce60 con 0x7f12b8004b80 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 -- 172.21.15.52:0/1847184098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b8004b80 msgr2=0x7f12b8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 --2- 172.21.15.52:0/1847184098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b8004b80 0x7f12b8005000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f12bc00c210 tx=0x7f12cc0c7050).stop 2023-05-10T01:09:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d25a9700 1 -- 172.21.15.52:0/1847184098 reap_dead start 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 -- 172.21.15.52:0/1847184098 shutdown_connections 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 -- 172.21.15.52:0/1847184098 >> 172.21.15.52:0/1847184098 conn(0x7f12cc0cb6f0 msgr2=0x7f12cc0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 -- 172.21.15.52:0/1847184098 shutdown_connections 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.586+0000 7f12d400c700 1 -- 172.21.15.52:0/1847184098 wait complete. 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.587+0000 7f12d400c700 1 Processor -- start 2023-05-10T01:09:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.587+0000 7f12d400c700 1 -- start start 2023-05-10T01:09:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12b8004b80 0x7f12cc148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12cc158290 0x7f12cc158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc149d30 con 0x7f12cc14a9f0 2023-05-10T01:09:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc148f90 con 0x7f12cc158290 2023-05-10T01:09:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d400c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc158ac0 con 0x7f12b8004b80 2023-05-10T01:09:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58268/0 (socket says 172.21.15.52:58268) 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 -- 172.21.15.52:0/2552825488 learned_addr learned my addr 172.21.15.52:0/2552825488 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d15a7700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12cc158290 0x7f12cc158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d1da8700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12b8004b80 0x7f12cc148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 -- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12b8004b80 msgr2=0x7f12cc148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12b8004b80 0x7f12cc148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 -- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12cc158290 msgr2=0x7f12cc158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12cc158290 0x7f12cc158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 -- 172.21.15.52:0/2552825488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc14a560 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.588+0000 7f12d25a9700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f12bc00c800 tx=0x7f12bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.589+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc007a60 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.589+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc001430 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.589+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc1587e0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.589+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc004ad0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.589+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc14a1f0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.590+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc066720 con 0x7f12cc14a9f0 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.590+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f12bc01d070 con 0x7f12cc14a9f0 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.591+0000 7f12c9ffb700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.591+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f12bc07a4d0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.591+0000 7f12d1da8700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.591+0000 7f12d1da8700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 0x7f12ac061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f12c4009fd0 tx=0x7f12c40097d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.595+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12bc04bdc0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.768+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12cc14a6f0 con 0x7f12cc14a9f0 2023-05-10T01:09:50.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.769+0000 7f12c9ffb700 1 -- 172.21.15.52:0/2552825488 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12bc01a030 con 0x7f12cc14a9f0 2023-05-10T01:09:50.772 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:09:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 msgr2=0x7f12ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 0x7f12ac061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f12c4009fd0 tx=0x7f12c40097d0).stop 2023-05-10T01:09:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 msgr2=0x7f12cc0aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f12bc00c800 tx=0x7f12bc015000).stop 2023-05-10T01:09:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 shutdown_connections 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f12ac05ed90 0x7f12ac061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12cc14a9f0 0x7f12cc0aeba0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12b8004b80 0x7f12cc148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 --2- 172.21.15.52:0/2552825488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12cc158290 0x7f12cc158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 >> 172.21.15.52:0/2552825488 conn(0x7f12cc0cb6f0 msgr2=0x7f12cc0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 shutdown_connections 2023-05-10T01:09:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.771+0000 7f12d400c700 1 -- 172.21.15.52:0/2552825488 wait complete. 2023-05-10T01:09:50.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:09:50.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.900+0000 7f460c0cb700 1 Processor -- start 2023-05-10T01:09:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.900+0000 7f460c0cb700 1 -- start start 2023-05-10T01:09:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460c0cb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 0x7f4604069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460c0cb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46040c0650 con 0x7f4604069b80 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460c0cb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460406a010 con 0x7f4604154160 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460c0cb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040bfd20 con 0x7f4604154540 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460a668700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4604069b80 0x7f46040c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39058/0 (socket says 172.21.15.52:39058) 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f460a668700 1 -- 172.21.15.52:0/33597942 learned_addr learned my addr 172.21.15.52:0/33597942 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4609666700 1 --2- 172.21.15.52:0/33597942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 0x7f4604069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088430591 0 0) 0x7f46040c0650 con 0x7f4604069b80 2023-05-10T01:09:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f00033f0 con 0x7f4604069b80 2023-05-10T01:09:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783591726 0 0) 0x7f460406a010 con 0x7f4604154160 2023-05-10T01:09:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46040c0650 con 0x7f4604154160 2023-05-10T01:09:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4609666700 1 -- 172.21.15.52:0/33597942 >> v1:172.21.15.172:6789/0 conn(0x7f4604154160 legacy=0x7f46040c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4609666700 1 -- 172.21.15.52:0/33597942 >> v1:172.21.15.52:6789/0 conn(0x7f4604069b80 legacy=0x7f46040c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.901+0000 7f4609666700 1 -- 172.21.15.52:0/33597942 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040c0000 con 0x7f4604154540 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f4609666700 1 --2- 172.21.15.52:0/33597942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 0x7f4604069690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f45f8009790 tx=0x7f45f8009060).ready entity=mon.2 client_cookie=f703a45bc42c661b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80090d0 con 0x7f4604154540 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f800f510 con 0x7f4604154540 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f4608e65700 1 -- 172.21.15.52:0/33597942 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800f890 con 0x7f4604154540 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 -- 172.21.15.52:0/33597942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 msgr2=0x7f4604069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 --2- 172.21.15.52:0/33597942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 0x7f4604069690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f45f8009790 tx=0x7f45f8009060).stop 2023-05-10T01:09:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 -- 172.21.15.52:0/33597942 shutdown_connections 2023-05-10T01:09:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 --2- 172.21.15.52:0/33597942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604154540 0x7f4604069690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 -- 172.21.15.52:0/33597942 >> 172.21.15.52:0/33597942 conn(0x7f46040cb6f0 msgr2=0x7f46040c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 -- 172.21.15.52:0/33597942 shutdown_connections 2023-05-10T01:09:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.902+0000 7f460c0cb700 1 -- 172.21.15.52:0/33597942 wait complete. 2023-05-10T01:09:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.903+0000 7f460c0cb700 1 Processor -- start 2023-05-10T01:09:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 -- start start 2023-05-10T01:09:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 0x7f460414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 0x7f46041643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040afaf0 con 0x7f4604154160 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040aeee0 con 0x7f4604154540 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f460c0cb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040af1c0 con 0x7f4604069b80 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f4609666700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f4609666700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58280/0 (socket says 172.21.15.52:58280) 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.904+0000 7f4609666700 1 -- 172.21.15.52:0/73862098 learned_addr learned my addr 172.21.15.52:0/73862098 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f460a668700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 0x7f46041643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609e67700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 0x7f460414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 -- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 msgr2=0x7f460414cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 0x7f460414cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 -- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 msgr2=0x7f46041643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 0x7f46041643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 -- 172.21.15.52:0/73862098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80092a0 con 0x7f4604154160 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f460a668700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 0x7f46041643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609e67700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 0x7f460414cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4609666700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f45f8011000 tx=0x7f45f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8006970 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f800fc50 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46040af4a0 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800f890 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.905+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460414d050 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.906+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46040666b0 con 0x7f4604154160 2023-05-10T01:09:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.906+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f45f8022030 con 0x7f4604154160 2023-05-10T01:09:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.907+0000 7f4601ffb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 0x7f45e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.907+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f45f807b5a0 con 0x7f4604154160 2023-05-10T01:09:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.907+0000 7f4609e67700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 0x7f45e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.907+0000 7f4609e67700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 0x7f45e4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45fc007fd0 tx=0x7f45fc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:50.911+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45f804ce30 con 0x7f4604154160 2023-05-10T01:09:51.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.087+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f460406c340 con 0x7f4604154160 2023-05-10T01:09:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.088+0000 7f4601ffb700 1 -- 172.21.15.52:0/73862098 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f45f802a020 con 0x7f4604154160 2023-05-10T01:09:51.091 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:51.091 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:09:51.091 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:09:51.091 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:09:51.092 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:09:51.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 msgr2=0x7f45e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 0x7f45e4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45fc007fd0 tx=0x7f45fc009040).stop 2023-05-10T01:09:51.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 msgr2=0x7f46040ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f45f8011000 tx=0x7f45f8017000).stop 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 shutdown_connections 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45e405ed90 0x7f45e4061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4604154540 0x7f46041643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4604069b80 0x7f460414cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 --2- 172.21.15.52:0/73862098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604154160 0x7f46040ae610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.089+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 >> 172.21.15.52:0/73862098 conn(0x7f46040cb6f0 msgr2=0x7f460414e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.090+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 shutdown_connections 2023-05-10T01:09:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.090+0000 7f460c0cb700 1 -- 172.21.15.52:0/73862098 wait complete. 2023-05-10T01:09:51.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:09:51.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:09:51.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.223+0000 7f8da4d1f700 1 Processor -- start 2023-05-10T01:09:51.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.223+0000 7f8da4d1f700 1 -- start start 2023-05-10T01:09:51.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8da4d1f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8da00c5bd0 0x7f8da00c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da0154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8da4d1f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00c6570 con 0x7f8da0153ff0 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8da4d1f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00c9110 con 0x7f8da00c5bd0 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8da4d1f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00ca5b0 con 0x7f8da01543d0 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8d9dd9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8da00c5bd0 0x7f8da00c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8d9e59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8da0153ff0 0x7f8da0068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:41608/0 (socket says 172.21.15.52:41608) 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8d9e59c700 1 -- 172.21.15.52:0/3082344624 learned_addr learned my addr 172.21.15.52:0/3082344624 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:51.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.224+0000 7f8d9ed9d700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9dd9b700 1 -- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 msgr2=0x7f8da0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9dd9b700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9dd9b700 1 -- 172.21.15.52:0/3082344624 >> v1:172.21.15.172:6789/0 conn(0x7f8da0153ff0 legacy=0x7f8da0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9d59a700 1 -- 172.21.15.52:0/3082344624 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891659758 0 0) 0x7f8d98001160 con 0x7f8da0153ff0 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9dd9b700 1 -- 172.21.15.52:0/3082344624 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00c8820 con 0x7f8da00c5bd0 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9dd9b700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c6080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8d94009760 tx=0x7f8d94009060).ready entity=mon.1 client_cookie=317bed9f386bc304 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9d59a700 1 -- 172.21.15.52:0/3082344624 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400f510 con 0x7f8da00c5bd0 2023-05-10T01:09:51.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9d59a700 1 -- 172.21.15.52:0/3082344624 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400f670 con 0x7f8da00c5bd0 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8d9d59a700 1 -- 172.21.15.52:0/3082344624 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400f9f0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00c5bd0 msgr2=0x7f8da00c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c6080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f8d94009760 tx=0x7f8d94009060).stop 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3082344624 shutdown_connections 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3082344624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c6080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.225+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3082344624 >> 172.21.15.52:0/3082344624 conn(0x7f8da00678d0 msgr2=0x7f8da00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:51.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.226+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3082344624 shutdown_connections 2023-05-10T01:09:51.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.226+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3082344624 wait complete. 2023-05-10T01:09:51.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 Processor -- start 2023-05-10T01:09:51.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 -- start start 2023-05-10T01:09:51.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0153ff0 0x7f8da0164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00c21b0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00c2fd0 con 0x7f8da0153ff0 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8da4d1f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da01654e0 con 0x7f8da01543d0 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8d9e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8d9e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58290/0 (socket says 172.21.15.52:58290) 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.227+0000 7f8d9e59c700 1 -- 172.21.15.52:0/3483197328 learned_addr learned my addr 172.21.15.52:0/3483197328 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9dd9b700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0153ff0 0x7f8da0164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9ed9d700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 -- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 msgr2=0x7f8da014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 -- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0153ff0 msgr2=0x7f8da0164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:51.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0153ff0 0x7f8da0164ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:51.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 -- 172.21.15.52:0/3483197328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940092a0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d9e59c700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8d9800c4f0 tx=0x7f8d98007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:51.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980072e0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98007440 con 0x7f8da00c5bd0 2023-05-10T01:09:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da0150100 con 0x7f8da00c5bd0 2023-05-10T01:09:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980057f0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.228+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da00c26a0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.229+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da0066720 con 0x7f8da00c5bd0 2023-05-10T01:09:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.229+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8d98010070 con 0x7f8da00c5bd0 2023-05-10T01:09:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.230+0000 7f8d8e7fc700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 0x7f8d7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.230+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8d98078cd0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.230+0000 7f8d9dd9b700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 0x7f8d7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.230+0000 7f8d9dd9b700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 0x7f8d7c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8da01506c0 tx=0x7f8d94017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.234+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d9804a5c0 con 0x7f8da00c5bd0 2023-05-10T01:09:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:51.406+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8da00c6570 con 0x7f8da00c5bd0 2023-05-10T01:09:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.350+0000 7f8d8e7fc700 1 -- 172.21.15.52:0/3483197328 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8da00c6570 con 0x7f8da00c5bd0 2023-05-10T01:09:52.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.353+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 msgr2=0x7f8d7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.353+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 0x7f8d7c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8da01506c0 tx=0x7f8d94017000).stop 2023-05-10T01:09:52.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.354+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 msgr2=0x7f8da00c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.354+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8d9800c4f0 tx=0x7f8d98007a80).stop 2023-05-10T01:09:52.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 shutdown_connections 2023-05-10T01:09:52.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8d7c05ed90 0x7f8d7c061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da01543d0 0x7f8da014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da00c5bd0 0x7f8da00c1cc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 --2- 172.21.15.52:0/3483197328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0153ff0 0x7f8da0164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.355+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 >> 172.21.15.52:0/3483197328 conn(0x7f8da00678d0 msgr2=0x7f8da01513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:52.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.356+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 shutdown_connections 2023-05-10T01:09:52.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.356+0000 7f8da4d1f700 1 -- 172.21.15.52:0/3483197328 wait complete. 2023-05-10T01:09:52.362 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:09:52.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:09:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.504+0000 7f2cc3fff700 1 Processor -- start 2023-05-10T01:09:52.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.504+0000 7f2cc3fff700 1 -- start start 2023-05-10T01:09:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 0x7f2cc40698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc3fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc405e750 con 0x7f2cc4153ba0 2023-05-10T01:09:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc3fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc4069ee0 con 0x7f2cc40bdf10 2023-05-10T01:09:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40bf530 con 0x7f2cc4153f80 2023-05-10T01:09:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2cc4153ba0 0x7f2cc40bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39082/0 (socket says 172.21.15.52:39082) 2023-05-10T01:09:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc2ffd700 1 -- 172.21.15.52:0/2954884411 learned_addr learned my addr 172.21.15.52:0/2954884411 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626678557 0 0) 0x7f2cc405e750 con 0x7f2cc4153ba0 2023-05-10T01:09:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca40033f0 con 0x7f2cc4153ba0 2023-05-10T01:09:52.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 0x7f2cc40698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209310328 0 0) 0x7f2ca40033f0 con 0x7f2cc4153ba0 2023-05-10T01:09:52.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 msgr2=0x7f2cc40698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:52.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 0x7f2cc40698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 >> v1:172.21.15.172:6789/0 conn(0x7f2cc40bdf10 legacy=0x7f2cc40c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4158450 con 0x7f2cc4153ba0 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f2cbc0017f0 con 0x7f2cc4153ba0 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 >> v1:172.21.15.52:6789/0 conn(0x7f2cc4153ba0 legacy=0x7f2cc40bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4003910 0x7f2ca4003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 0x7f2ca4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca4004b80 0x7f2ca4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40bf530 con 0x7f2ca4004b80 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400b910 con 0x7f2ca4003910 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400bad0 con 0x7f2cc4153f80 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca4004b80 0x7f2ca4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.505+0000 7f2cc2ffd700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4003910 0x7f2ca4003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 -- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 msgr2=0x7f2ca4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4153f80 0x7f2ca4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 -- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4003910 msgr2=0x7f2ca4003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4003910 0x7f2ca4003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 -- 172.21.15.52:0/2954884411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40033f0 con 0x7f2ca4004b80 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca4004b80 0x7f2ca4005000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2cc4154380 tx=0x7f2cb4009060).ready entity=mon.0 client_cookie=1ab3aedc2a6bbe48 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:52.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4009430 con 0x7f2ca4004b80 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4009e70 con 0x7f2ca4004b80 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc1ffb700 1 -- 172.21.15.52:0/2954884411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400e850 con 0x7f2ca4004b80 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 -- 172.21.15.52:0/2954884411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca4004b80 msgr2=0x7f2ca4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/2954884411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca4004b80 0x7f2ca4005000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2cc4154380 tx=0x7f2cb4009060).stop 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc37fe700 1 -- 172.21.15.52:0/2954884411 reap_dead start 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 -- 172.21.15.52:0/2954884411 shutdown_connections 2023-05-10T01:09:52.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 -- 172.21.15.52:0/2954884411 >> 172.21.15.52:0/2954884411 conn(0x7f2cc4062d70 msgr2=0x7f2cc405dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:52.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 -- 172.21.15.52:0/2954884411 shutdown_connections 2023-05-10T01:09:52.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.506+0000 7f2cc3fff700 1 -- 172.21.15.52:0/2954884411 wait complete. 2023-05-10T01:09:52.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 Processor -- start 2023-05-10T01:09:52.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 -- start start 2023-05-10T01:09:52.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4004b80 0x7f2cc4154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 0x7f2cc4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4155750 con 0x7f2cc4152760 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4154b40 con 0x7f2ca4004b80 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.508+0000 7f2cc3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4154e20 con 0x7f2cc4164570 2023-05-10T01:09:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58314/0 (socket says 172.21.15.52:58314) 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 -- 172.21.15.52:0/4104969413 learned_addr learned my addr 172.21.15.52:0/4104969413 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc2ffd700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4004b80 0x7f2cc4154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc27fc700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 0x7f2cc4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 -- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 msgr2=0x7f2cc4152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 0x7f2cc4152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 -- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4004b80 msgr2=0x7f2cc4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4004b80 0x7f2cc4154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 -- 172.21.15.52:0/4104969413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4155100 con 0x7f2cc4152760 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc27fc700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 0x7f2cc4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc37fe700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2ca400b8e0 tx=0x7f2cb401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb401c640 con 0x7f2cc4152760 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb401c7a0 con 0x7f2cc4152760 2023-05-10T01:09:52.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc41553e0 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb401cb40 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.509+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc4155be0 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.510+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4047150 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.510+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2cb40123f0 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.511+0000 7f2cbaffd700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 0x7f2ca8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.511+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f2cb407a530 con 0x7f2cc4152760 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.511+0000 7f2cc2ffd700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 0x7f2ca8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:52.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.511+0000 7f2cc2ffd700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 0x7f2ca8061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2cbc0013d0 tx=0x7f2cbc001d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:52.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.515+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2cb404bc50 con 0x7f2cc4152760 2023-05-10T01:09:52.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:52.692+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2cc4155890 con 0x7f2cc4152760 2023-05-10T01:09:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.358+0000 7f2cbaffd700 1 -- 172.21.15.52:0/4104969413 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2cb4016020 con 0x7f2cc4152760 2023-05-10T01:09:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.367+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 msgr2=0x7f2ca8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.367+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 0x7f2ca8061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2cbc0013d0 tx=0x7f2cbc001d90).stop 2023-05-10T01:09:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.367+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 msgr2=0x7f2cc4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.367+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2ca400b8e0 tx=0x7f2cb401a000).stop 2023-05-10T01:09:53.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 shutdown_connections 2023-05-10T01:09:53.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ca805ed90 0x7f2ca8061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4152760 0x7f2cc4156780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca4004b80 0x7f2cc4154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 --2- 172.21.15.52:0/4104969413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cc4164570 0x7f2cc4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.368+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 >> 172.21.15.52:0/4104969413 conn(0x7f2cc4062d70 msgr2=0x7f2cc40c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.370+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 shutdown_connections 2023-05-10T01:09:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.371+0000 7f2cc3fff700 1 -- 172.21.15.52:0/4104969413 wait complete. 2023-05-10T01:09:53.388 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:09:53.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:09:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.519+0000 7f3e67397700 1 Processor -- start 2023-05-10T01:09:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.519+0000 7f3e67397700 1 -- start start 2023-05-10T01:09:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e60154460 0x7f3e600a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e600aa140 0x7f3e60068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600aa560 con 0x7f3e600aa140 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600c94c0 con 0x7f3e60154460 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e67397700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600cb7d0 con 0x7f3e60154080 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e65934700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e600aa140 0x7f3e60068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e65934700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e600aa140 0x7f3e60068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58320/0 (socket says 172.21.15.52:58320) 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e65934700 1 -- 172.21.15.52:0/3708421788 learned_addr learned my addr 172.21.15.52:0/3708421788 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e64932700 1 --2- 172.21.15.52:0/3708421788 >> v2:172.21.15.172:3300/0 conn(0x7f3e60154460 0x7f3e600a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.520+0000 7f3e65133700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 -- 172.21.15.52:0/3708421788 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 msgr2=0x7f3e600aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 -- 172.21.15.52:0/3708421788 >> v2:172.21.15.172:3300/0 conn(0x7f3e60154460 msgr2=0x7f3e600a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 --2- 172.21.15.52:0/3708421788 >> v2:172.21.15.172:3300/0 conn(0x7f3e60154460 0x7f3e600a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 -- 172.21.15.52:0/3708421788 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600c88b0 con 0x7f3e600aa140 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e65934700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e60068150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3e60083c40 tx=0x7f3e50009840).ready entity=mon.0 client_cookie=f5787a149b4f955a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e5ffff700 1 -- 172.21.15.52:0/3708421788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000e070 con 0x7f3e600aa140 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e5ffff700 1 -- 172.21.15.52:0/3708421788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000b970 con 0x7f3e600aa140 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e5ffff700 1 -- 172.21.15.52:0/3708421788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000bcf0 con 0x7f3e600aa140 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 -- 172.21.15.52:0/3708421788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 msgr2=0x7f3e60068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e60068150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3e60083c40 tx=0x7f3e50009840).stop 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 -- 172.21.15.52:0/3708421788 shutdown_connections 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e60068150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 --2- 172.21.15.52:0/3708421788 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 --2- 172.21.15.52:0/3708421788 >> v2:172.21.15.172:3300/0 conn(0x7f3e60154460 0x7f3e600a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 -- 172.21.15.52:0/3708421788 >> 172.21.15.52:0/3708421788 conn(0x7f3e60067910 msgr2=0x7f3e600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 -- 172.21.15.52:0/3708421788 shutdown_connections 2023-05-10T01:09:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.521+0000 7f3e67397700 1 -- 172.21.15.52:0/3708421788 wait complete. 2023-05-10T01:09:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 Processor -- start 2023-05-10T01:09:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 -- start start 2023-05-10T01:09:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 0x7f3e60164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600adc60 con 0x7f3e600aa140 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600af520 con 0x7f3e60154460 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.523+0000 7f3e67397700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600af800 con 0x7f3e60154080 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58324/0 (socket says 172.21.15.52:58324) 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 -- 172.21.15.52:0/3056275695 learned_addr learned my addr 172.21.15.52:0/3056275695 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e64932700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65934700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 0x7f3e60164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 -- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 msgr2=0x7f3e600c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 -- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 msgr2=0x7f3e60164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 0x7f3e60164270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 -- 172.21.15.52:0/3056275695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009ae0 con 0x7f3e600aa140 2023-05-10T01:09:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65934700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 0x7f3e60164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e65133700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3e5800e950 tx=0x7f3e58009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800c6a0 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5800c800 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e600afae0 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800cb80 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.524+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e600b00a0 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.525+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e60066720 con 0x7f3e600aa140 2023-05-10T01:09:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.526+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3e58022070 con 0x7f3e600aa140 2023-05-10T01:09:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.526+0000 7f3e5d7fa700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 0x7f3e40061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.526+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f3e58079e80 con 0x7f3e600aa140 2023-05-10T01:09:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.526+0000 7f3e64932700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 0x7f3e40061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.526+0000 7f3e64932700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 0x7f3e40061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3e6006a730 tx=0x7f3e54009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.530+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e5804b480 con 0x7f3e600aa140 2023-05-10T01:09:53.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.749+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e6006c340 con 0x7f3e600aa140 2023-05-10T01:09:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.754+0000 7f3e5d7fa700 1 -- 172.21.15.52:0/3056275695 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3e6006c340 con 0x7f3e600aa140 2023-05-10T01:09:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 msgr2=0x7f3e40061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 0x7f3e40061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3e6006a730 tx=0x7f3e54009060).stop 2023-05-10T01:09:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 msgr2=0x7f3e6014bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3e5800e950 tx=0x7f3e58009060).stop 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 shutdown_connections 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3e4005ed60 0x7f3e40061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e60154460 0x7f3e60164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e600aa140 0x7f3e6014bed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 --2- 172.21.15.52:0/3056275695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e60154080 0x7f3e600c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.758+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 >> 172.21.15.52:0/3056275695 conn(0x7f3e60067910 msgr2=0x7f3e6014d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:53.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.761+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 shutdown_connections 2023-05-10T01:09:53.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.769+0000 7f3e67397700 1 -- 172.21.15.52:0/3056275695 wait complete. 2023-05-10T01:09:53.778 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2023-05-10T01:09:53.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:53.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.904+0000 7f6b5b09b700 1 Processor -- start 2023-05-10T01:09:53.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.904+0000 7f6b5b09b700 1 -- start start 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5b09b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b540c8460 0x7f6b540c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5b09b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b540a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5b09b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b540c6900 con 0x7f6b540aad90 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5b09b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b54155ee0 con 0x7f6b540c8460 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5b09b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b541561c0 con 0x7f6b540c7280 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b540c8460 0x7f6b540c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b540c8460 0x7f6b540c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58334/0 (socket says 172.21.15.52:58334) 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 -- 172.21.15.52:0/4271484495 learned_addr learned my addr 172.21.15.52:0/4271484495 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b5a89a700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b540a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 -- 172.21.15.52:0/4271484495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 msgr2=0x7f6b540a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b540a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 -- 172.21.15.52:0/4271484495 >> v1:172.21.15.172:6789/0 conn(0x7f6b540aad90 legacy=0x7f6b54155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 -- 172.21.15.52:0/4271484495 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540c6590 con 0x7f6b540c8460 2023-05-10T01:09:53.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59898700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c6d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6b44006fd0 tx=0x7f6b440090f0).ready entity=mon.0 client_cookie=9ec6895efdb1c0de server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.905+0000 7f6b59097700 1 -- 172.21.15.52:0/4271484495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400b580 con 0x7f6b540c8460 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b59097700 1 -- 172.21.15.52:0/4271484495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4400b6e0 con 0x7f6b540c8460 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b59097700 1 -- 172.21.15.52:0/4271484495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400ba60 con 0x7f6b540c8460 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4271484495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 msgr2=0x7f6b540c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c6d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6b44006fd0 tx=0x7f6b440090f0).stop 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4271484495 shutdown_connections 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b540a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4271484495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c6d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4271484495 >> 172.21.15.52:0/4271484495 conn(0x7f6b5405e810 msgr2=0x7f6b540622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:53.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4271484495 shutdown_connections 2023-05-10T01:09:53.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.906+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4271484495 wait complete. 2023-05-10T01:09:53.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.907+0000 7f6b5b09b700 1 Processor -- start 2023-05-10T01:09:53.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.907+0000 7f6b5b09b700 1 -- start start 2023-05-10T01:09:53.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b540aad90 0x7f6b541453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b54157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b541543f0 con 0x7f6b540c8460 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54153e30 con 0x7f6b540aad90 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5b09b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54154110 con 0x7f6b540c7280 2023-05-10T01:09:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58342/0 (socket says 172.21.15.52:58342) 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 -- 172.21.15.52:0/4121012116 learned_addr learned my addr 172.21.15.52:0/4121012116 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a099700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b540aad90 0x7f6b541453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b59898700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b54157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 -- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 msgr2=0x7f6b54157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b54157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 -- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b540aad90 msgr2=0x7f6b541453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b540aad90 0x7f6b541453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 -- 172.21.15.52:0/4121012116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009370 con 0x7f6b540c8460 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.908+0000 7f6b5a89a700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6b4c009e90 tx=0x7f6b4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.909+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00caa0 con 0x7f6b540c8460 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.909+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c00f040 con 0x7f6b540c8460 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.909+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b540680f0 con 0x7f6b540c8460 2023-05-10T01:09:53.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.909+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00ce10 con 0x7f6b540c8460 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.909+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b541458a0 con 0x7f6b540c8460 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.910+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b54067f50 con 0x7f6b540c8460 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.910+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6b4c013610 con 0x7f6b540c8460 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.910+0000 7f6b427fc700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 0x7f6b34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.910+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6b4c07a4f0 con 0x7f6b540c8460 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.910+0000 7f6b5a099700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 0x7f6b34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:53.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.911+0000 7f6b5a099700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 0x7f6b34061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6b50003900 tx=0x7f6b50007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:53.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:53.914+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b54067f50 con 0x7f6b540c8460 2023-05-10T01:09:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.087+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b54067f50 con 0x7f6b540c8460 2023-05-10T01:09:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.088+0000 7f6b427fc700 1 -- 172.21.15.52:0/4121012116 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f6b54067f50 con 0x7f6b540c8460 2023-05-10T01:09:54.092 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:54.093 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:53.749869+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:54.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 msgr2=0x7f6b34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 0x7f6b34061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6b50003900 tx=0x7f6b50007d40).stop 2023-05-10T01:09:54.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 msgr2=0x7f6b540c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6b4c009e90 tx=0x7f6b4c00b040).stop 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 shutdown_connections 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6b3405ed90 0x7f6b34061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b540c8460 0x7f6b540c1c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b540aad90 0x7f6b541453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 --2- 172.21.15.52:0/4121012116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6b540c7280 0x7f6b54157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 >> 172.21.15.52:0/4121012116 conn(0x7f6b5405e810 msgr2=0x7f6b5414fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:54.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 shutdown_connections 2023-05-10T01:09:54.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.090+0000 7f6b5b09b700 1 -- 172.21.15.52:0/4121012116 wait complete. 2023-05-10T01:09:54.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:54.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.226+0000 7f1eda04c700 1 Processor -- start 2023-05-10T01:09:54.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.226+0000 7f1eda04c700 1 -- start start 2023-05-10T01:09:54.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1eda04c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ed4154e40 0x7f1ed40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1eda04c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed4158960 con 0x7f1ed40ad030 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1eda04c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed41552f0 con 0x7f1ed40c7370 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1eda04c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed4157d50 con 0x7f1ed4154e40 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed984b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ed40ad030 0x7f1ed414dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39134/0 (socket says 172.21.15.52:39134) 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed984b700 1 -- 172.21.15.52:0/1823501737 learned_addr learned my addr 172.21.15.52:0/1823501737 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed8849700 1 --2- 172.21.15.52:0/1823501737 >> v2:172.21.15.172:3300/0 conn(0x7f1ed4154e40 0x7f1ed40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204557603 0 0) 0x7f1ed4158960 con 0x7f1ed40ad030 2023-05-10T01:09:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ebc0033f0 con 0x7f1ed40ad030 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286301636 0 0) 0x7f1ed41552f0 con 0x7f1ed40c7370 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed4158960 con 0x7f1ed40c7370 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288028684 0 0) 0x7f1ebc0033f0 con 0x7f1ed40ad030 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed8849700 1 -- 172.21.15.52:0/1823501737 >> v1:172.21.15.172:6789/0 conn(0x7f1ed40c7370 legacy=0x7f1ed40c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed8849700 1 -- 172.21.15.52:0/1823501737 >> v1:172.21.15.52:6789/0 conn(0x7f1ed40ad030 legacy=0x7f1ed414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.227+0000 7f1ed8849700 1 -- 172.21.15.52:0/1823501737 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4158030 con 0x7f1ed4154e40 2023-05-10T01:09:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1ed8849700 1 --2- 172.21.15.52:0/1823501737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed4154e40 0x7f1ed40acb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1ec4009760 tx=0x7f1ec4009060).ready entity=mon.1 client_cookie=64daa8120b377ae6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0017f0 con 0x7f1ed4154e40 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4011400 con 0x7f1ed4154e40 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1ec3fff700 1 -- 172.21.15.52:0/1823501737 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4011780 con 0x7f1ed4154e40 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 -- 172.21.15.52:0/1823501737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed4154e40 msgr2=0x7f1ed40acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 --2- 172.21.15.52:0/1823501737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed4154e40 0x7f1ed40acb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1ec4009760 tx=0x7f1ec4009060).stop 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 -- 172.21.15.52:0/1823501737 shutdown_connections 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 --2- 172.21.15.52:0/1823501737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed4154e40 0x7f1ed40acb40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 -- 172.21.15.52:0/1823501737 >> 172.21.15.52:0/1823501737 conn(0x7f1ed4068320 msgr2=0x7f1ed4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:54.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 -- 172.21.15.52:0/1823501737 shutdown_connections 2023-05-10T01:09:54.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.228+0000 7f1eda04c700 1 -- 172.21.15.52:0/1823501737 wait complete. 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.229+0000 7f1eda04c700 1 Processor -- start 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.229+0000 7f1eda04c700 1 -- start start 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 0x7f1ed40b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ed4154e40 0x7f1ed40cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40ae6a0 con 0x7f1ed40c7370 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40ada90 con 0x7f1ed40ad030 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1eda04c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40add70 con 0x7f1ed4154e40 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.230+0000 7f1ed8849700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58354/0 (socket says 172.21.15.52:58354) 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 -- 172.21.15.52:0/2523310278 learned_addr learned my addr 172.21.15.52:0/2523310278 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed904a700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 0x7f1ed40b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed984b700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ed4154e40 0x7f1ed40cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 -- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ed4154e40 msgr2=0x7f1ed40cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ed4154e40 0x7f1ed40cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 -- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 msgr2=0x7f1ed40b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 0x7f1ed40b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 -- 172.21.15.52:0/2523310278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40092a0 con 0x7f1ed40c7370 2023-05-10T01:09:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed904a700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 0x7f1ed40b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ed8849700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1ec4009d50 tx=0x7f1ec4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4010950 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4010ab0 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4010e50 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed40ae050 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.231+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed4143960 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.232+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed4047150 con 0x7f1ed40c7370 2023-05-10T01:09:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.232+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1ec402d070 con 0x7f1ed40c7370 2023-05-10T01:09:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.233+0000 7f1ec17fa700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.233+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ec407b570 con 0x7f1ed40c7370 2023-05-10T01:09:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.233+0000 7f1ed904a700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.233+0000 7f1ed904a700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 0x7f1eb4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1ed0007fd0 tx=0x7f1ed0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.237+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ec404cb10 con 0x7f1ed40c7370 2023-05-10T01:09:54.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.410+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed40bfb80 con 0x7f1ed40c7370 2023-05-10T01:09:54.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.411+0000 7f1ec17fa700 1 -- 172.21.15.52:0/2523310278 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f1ec4021020 con 0x7f1ed40c7370 2023-05-10T01:09:54.414 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:54.415 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:53.749869+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 msgr2=0x7f1eb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 0x7f1eb4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1ed0007fd0 tx=0x7f1ed0009040).stop 2023-05-10T01:09:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 msgr2=0x7f1ed4143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1ec4009d50 tx=0x7f1ec4016000).stop 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 shutdown_connections 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1eb405ed90 0x7f1eb4061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ed4154e40 0x7f1ed40cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ed40ad030 0x7f1ed40b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 --2- 172.21.15.52:0/2523310278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ed40c7370 0x7f1ed4143470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 >> 172.21.15.52:0/2523310278 conn(0x7f1ed4068320 msgr2=0x7f1ed414f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 shutdown_connections 2023-05-10T01:09:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.413+0000 7f1eda04c700 1 -- 172.21.15.52:0/2523310278 wait complete. 2023-05-10T01:09:54.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:09:54.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.544+0000 7ffacec7a700 1 Processor -- start 2023-05-10T01:09:54.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.544+0000 7ffacec7a700 1 -- start start 2023-05-10T01:09:54.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacec7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffac80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacec7a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80c94c0 con 0x7ffac8154080 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacec7a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80cb7d0 con 0x7ffac8068150 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacec7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c88b0 con 0x7ffac8154460 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacca16700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffac8154080 0x7ffac80a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39144/0 (socket says 172.21.15.52:39144) 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffacca16700 1 -- 172.21.15.52:0/2901203387 learned_addr learned my addr 172.21.15.52:0/2901203387 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.545+0000 7ffac7fff700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffac80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767431860 0 0) 0x7ffac80c94c0 con 0x7ffac8154080 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa80033f0 con 0x7ffac8154080 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077403246 0 0) 0x7ffaa80033f0 con 0x7ffac8154080 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 msgr2=0x7ffac80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffac80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 >> v1:172.21.15.172:6789/0 conn(0x7ffac8068150 legacy=0x7ffac80c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80c8b90 con 0x7ffac8154080 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7ffac00017f0 con 0x7ffac8154080 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 >> v1:172.21.15.52:6789/0 conn(0x7ffac8154080 legacy=0x7ffac80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffaa8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8003e00 0x7ffaa8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8004b80 0x7ffaa8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c88b0 con 0x7ffaa8003e00 2023-05-10T01:09:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa800b8e0 con 0x7ffaa8004b80 2023-05-10T01:09:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa800baa0 con 0x7ffac8154460 2023-05-10T01:09:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8003e00 0x7ffaa8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffacca16700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffaa8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffacd217700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8004b80 0x7ffaa8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 -- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 msgr2=0x7ffaa8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac8154460 0x7ffaa8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 -- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8004b80 msgr2=0x7ffaa8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8004b80 0x7ffaa8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 -- 172.21.15.52:0/2901203387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80033f0 con 0x7ffaa8003e00 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffacd217700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8004b80 0x7ffaa8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.546+0000 7ffac7fff700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8003e00 0x7ffaa8004690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ffab8009a60 tx=0x7ffab8009060).ready entity=mon.0 client_cookie=ca637836e74844fd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8009ea0 con 0x7ffaa8003e00 2023-05-10T01:09:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab8009430 con 0x7ffaa8003e00 2023-05-10T01:09:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffac77fe700 1 -- 172.21.15.52:0/2901203387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800e870 con 0x7ffaa8003e00 2023-05-10T01:09:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 -- 172.21.15.52:0/2901203387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8003e00 msgr2=0x7ffaa8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 --2- 172.21.15.52:0/2901203387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8003e00 0x7ffaa8004690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ffab8009a60 tx=0x7ffab8009060).stop 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacd217700 1 -- 172.21.15.52:0/2901203387 reap_dead start 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 -- 172.21.15.52:0/2901203387 shutdown_connections 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 -- 172.21.15.52:0/2901203387 >> 172.21.15.52:0/2901203387 conn(0x7ffac8067910 msgr2=0x7ffac80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 -- 172.21.15.52:0/2901203387 shutdown_connections 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.547+0000 7ffacec7a700 1 -- 172.21.15.52:0/2901203387 wait complete. 2023-05-10T01:09:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.548+0000 7ffacec7a700 1 Processor -- start 2023-05-10T01:09:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.548+0000 7ffacec7a700 1 -- start start 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8003e00 0x7ffac8166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac80c4620 0x7ffac80af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c2660 con 0x7ffac8165180 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81673b0 con 0x7ffaa8003e00 2023-05-10T01:09:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacec7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c4aa0 con 0x7ffac80c4620 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58374/0 (socket says 172.21.15.52:58374) 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 -- 172.21.15.52:0/3170214216 learned_addr learned my addr 172.21.15.52:0/3170214216 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacd217700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac80c4620 0x7ffac80af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffacca16700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8003e00 0x7ffac8166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 -- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac80c4620 msgr2=0x7ffac80af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac80c4620 0x7ffac80af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 -- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8003e00 msgr2=0x7ffac8166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8003e00 0x7ffac8166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.549+0000 7ffac7fff700 1 -- 172.21.15.52:0/3170214216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80b0340 con 0x7ffac8165180 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffac7fff700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ffab800e4b0 tx=0x7ffab801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8020070 con 0x7ffac8165180 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab801b9a0 con 0x7ffac8165180 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80c1cc0 con 0x7ffac8165180 2023-05-10T01:09:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab801bd60 con 0x7ffac8165180 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.550+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac80c2280 con 0x7ffac8165180 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.551+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac80c27a0 con 0x7ffac8165180 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.551+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffab802b030 con 0x7ffac8165180 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.551+0000 7ffac4ff9700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 0x7ffaac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.552+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffab807ade0 con 0x7ffac8165180 2023-05-10T01:09:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.552+0000 7ffacca16700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 0x7ffaac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:54.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.552+0000 7ffacca16700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 0x7ffaac061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffac0007e30 tx=0x7ffac0001d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:54.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.556+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffac80c27a0 con 0x7ffac8165180 2023-05-10T01:09:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:54.774+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffac80c27a0 con 0x7ffac8165180 2023-05-10T01:09:55.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.759+0000 7ffac4ff9700 1 -- 172.21.15.52:0/3170214216 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffac80c27a0 con 0x7ffac8165180 2023-05-10T01:09:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.761+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 msgr2=0x7ffaac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.761+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 0x7ffaac061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffac0007e30 tx=0x7ffac0001d90).stop 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.761+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 msgr2=0x7ffac80c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.761+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ffab800e4b0 tx=0x7ffab801a000).stop 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 shutdown_connections 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffaac05ed90 0x7ffaac061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffac80c4620 0x7ffac80af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaa8003e00 0x7ffac8166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 --2- 172.21.15.52:0/3170214216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffac8165180 0x7ffac80c4130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 >> 172.21.15.52:0/3170214216 conn(0x7ffac8067910 msgr2=0x7ffac80c0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:55.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 shutdown_connections 2023-05-10T01:09:55.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.762+0000 7ffacec7a700 1 -- 172.21.15.52:0/3170214216 wait complete. 2023-05-10T01:09:55.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:09:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.902+0000 7f6d4fc3b700 1 Processor -- start 2023-05-10T01:09:55.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.902+0000 7f6d4fc3b700 1 -- start start 2023-05-10T01:09:55.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4fc3b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d480aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4fc3b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d48154460 0x7f6d480a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4fc3b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480aa560 con 0x7f6d480aa140 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4fc3b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480c94c0 con 0x7f6d48154460 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4fc3b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480cb7d0 con 0x7f6d48154080 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4d1d6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d48154460 0x7f6d480a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4d1d6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d48154460 0x7f6d480a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58384/0 (socket says 172.21.15.52:58384) 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4d1d6700 1 -- 172.21.15.52:0/1084061635 learned_addr learned my addr 172.21.15.52:0/1084061635 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.903+0000 7f6d4d9d7700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d480aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4d1d6700 1 -- 172.21.15.52:0/1084061635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 msgr2=0x7f6d480aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4d1d6700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d480aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4d1d6700 1 -- 172.21.15.52:0/1084061635 >> v1:172.21.15.172:6789/0 conn(0x7f6d480aa140 legacy=0x7f6d48068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4d1d6700 1 -- 172.21.15.52:0/1084061635 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480c88b0 con 0x7f6d48154460 2023-05-10T01:09:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4c9d5700 1 -- 172.21.15.52:0/1084061635 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799726724 0 0) 0x7f6d38001110 con 0x7f6d480aa140 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4d1d6700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480a9c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6d3c006fd0 tx=0x7f6d3c0090f0).ready entity=mon.0 client_cookie=ee51fc87d7f05de8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4c9d5700 1 -- 172.21.15.52:0/1084061635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00b580 con 0x7f6d48154460 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4c9d5700 1 -- 172.21.15.52:0/1084061635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b6e0 con 0x7f6d48154460 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4c9d5700 1 -- 172.21.15.52:0/1084061635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00ba60 con 0x7f6d48154460 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/1084061635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 msgr2=0x7f6d480a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480a9c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6d3c006fd0 tx=0x7f6d3c0090f0).stop 2023-05-10T01:09:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/1084061635 shutdown_connections 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d480aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/1084061635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480a9c50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.904+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/1084061635 >> 172.21.15.52:0/1084061635 conn(0x7f6d48067910 msgr2=0x7f6d480cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.905+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/1084061635 shutdown_connections 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.905+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/1084061635 wait complete. 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.906+0000 7f6d4fc3b700 1 Processor -- start 2023-05-10T01:09:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.906+0000 7f6d4fc3b700 1 -- start start 2023-05-10T01:09:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480aa140 0x7f6d48155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d48155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48157070 con 0x7f6d48154460 2023-05-10T01:09:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d481561f0 con 0x7f6d480aa140 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4814d0e0 con 0x7f6d48154080 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58390/0 (socket says 172.21.15.52:58390) 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 -- 172.21.15.52:0/3134934387 learned_addr learned my addr 172.21.15.52:0/3134934387 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4d1d6700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d48155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4d9d7700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480aa140 0x7f6d48155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 -- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 msgr2=0x7f6d48155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d48155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 -- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480aa140 msgr2=0x7f6d48155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:55.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480aa140 0x7f6d48155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:55.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 -- 172.21.15.52:0/3134934387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009370 con 0x7f6d48154460 2023-05-10T01:09:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4e1d8700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6d3800c440 tx=0x7f6d38007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800f470 con 0x7f6d48154460 2023-05-10T01:09:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3800f5d0 con 0x7f6d48154460 2023-05-10T01:09:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d481563f0 con 0x7f6d48154460 2023-05-10T01:09:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.907+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800f970 con 0x7f6d48154460 2023-05-10T01:09:55.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.908+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d481569b0 con 0x7f6d48154460 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.909+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48066720 con 0x7f6d48154460 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.909+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6d38019030 con 0x7f6d48154460 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.909+0000 7f6d45ffb700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 0x7f6d28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.909+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6d38078d60 con 0x7f6d48154460 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.909+0000 7f6d4d9d7700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 0x7f6d28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:55.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.910+0000 7f6d4d9d7700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 0x7f6d28061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6d400076a0 tx=0x7f6d4000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:55.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:55.913+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d380488f0 con 0x7f6d48154460 2023-05-10T01:09:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.130+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6d480aa540 con 0x7f6d48154460 2023-05-10T01:09:56.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:09:56.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:09:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.763+0000 7f6d45ffb700 1 -- 172.21.15.52:0/3134934387 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d38017030 con 0x7f6d48154460 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 msgr2=0x7f6d28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 0x7f6d28061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6d400076a0 tx=0x7f6d4000b040).stop 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 msgr2=0x7f6d480c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6d3800c440 tx=0x7f6d38007a60).stop 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 shutdown_connections 2023-05-10T01:09:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed90 0x7f6d28061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d48154460 0x7f6d480c3a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480aa140 0x7f6d48155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 --2- 172.21.15.52:0/3134934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d48154080 0x7f6d48155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 >> 172.21.15.52:0/3134934387 conn(0x7f6d48067910 msgr2=0x7f6d4814d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 shutdown_connections 2023-05-10T01:09:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.766+0000 7f6d4fc3b700 1 -- 172.21.15.52:0/3134934387 wait complete. 2023-05-10T01:09:56.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:09:56.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.903+0000 7f78fb161700 1 Processor -- start 2023-05-10T01:09:56.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.903+0000 7f78fb161700 1 -- start start 2023-05-10T01:09:56.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78fb161700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78f40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78fb161700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f78f4069da0 0x7f78f40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78fb161700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f40c0650 con 0x7f78f4154540 2023-05-10T01:09:56.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78fb161700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f40c1af0 con 0x7f78f4069da0 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78fb161700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40bfd20 con 0x7f78f4154160 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78f3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f78f4154540 0x7f78f4069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39180/0 (socket says 172.21.15.52:39180) 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.904+0000 7f78f3fff700 1 -- 172.21.15.52:0/3200351404 learned_addr learned my addr 172.21.15.52:0/3200351404 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 --2- 172.21.15.52:0/3200351404 >> v2:172.21.15.172:3300/0 conn(0x7f78f4069da0 0x7f78f40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f8efd700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78f40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498704212 0 0) 0x7f78f40c0650 con 0x7f78f4154540 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d40033f0 con 0x7f78f4154540 2023-05-10T01:09:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734085405 0 0) 0x7f78d40033f0 con 0x7f78f4154540 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 msgr2=0x7f78f40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78f40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 >> v2:172.21.15.172:3300/0 conn(0x7f78f4069da0 msgr2=0x7f78f40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 --2- 172.21.15.52:0/3200351404 >> v2:172.21.15.172:3300/0 conn(0x7f78f4069da0 0x7f78f40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40c0000 con 0x7f78f4154540 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f78e40017f0 con 0x7f78f4154540 2023-05-10T01:09:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 >> v1:172.21.15.52:6789/0 conn(0x7f78f4154540 legacy=0x7f78f4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78d40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4003e10 0x7f78d4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78d4004b80 0x7f78d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c1af0 con 0x7f78d4004b80 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40bfd20 con 0x7f78d4003e10 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d400b8e0 con 0x7f78f4154160 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78d4004b80 0x7f78d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f3fff700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4003e10 0x7f78d4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f8efd700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78d40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 -- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 msgr2=0x7f78d40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78f4154160 0x7f78d40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 -- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4003e10 msgr2=0x7f78d4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4003e10 0x7f78d4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 -- 172.21.15.52:0/3200351404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40033f0 con 0x7f78d4004b80 2023-05-10T01:09:56.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.905+0000 7f78f96fe700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78d4004b80 0x7f78d4005000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f78dc009a80 tx=0x7f78dc009060).ready entity=mon.0 client_cookie=dded2e1f052ca617 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc009430 con 0x7f78d4004b80 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc00e640 con 0x7f78d4004b80 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78f37fe700 1 -- 172.21.15.52:0/3200351404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00e9c0 con 0x7f78d4004b80 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 -- 172.21.15.52:0/3200351404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78d4004b80 msgr2=0x7f78d4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 --2- 172.21.15.52:0/3200351404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78d4004b80 0x7f78d4005000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f78dc009a80 tx=0x7f78dc009060).stop 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78f96fe700 1 -- 172.21.15.52:0/3200351404 reap_dead start 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 -- 172.21.15.52:0/3200351404 shutdown_connections 2023-05-10T01:09:56.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 -- 172.21.15.52:0/3200351404 >> 172.21.15.52:0/3200351404 conn(0x7f78f40cb6f0 msgr2=0x7f78f40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:56.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 -- 172.21.15.52:0/3200351404 shutdown_connections 2023-05-10T01:09:56.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.906+0000 7f78fb161700 1 -- 172.21.15.52:0/3200351404 wait complete. 2023-05-10T01:09:56.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.907+0000 7f78fb161700 1 Processor -- start 2023-05-10T01:09:56.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.907+0000 7f78fb161700 1 -- start start 2023-05-10T01:09:56.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78d4004b80 0x7f78f40c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 0x7f78f4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c1de0 con 0x7f78f4155820 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4153580 con 0x7f78f4152c10 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78fb161700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c2030 con 0x7f78d4004b80 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58410/0 (socket says 172.21.15.52:58410) 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 -- 172.21.15.52:0/1052118779 learned_addr learned my addr 172.21.15.52:0/1052118779 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:56.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f3fff700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 0x7f78f4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f8efd700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78d4004b80 0x7f78f40c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 -- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78d4004b80 msgr2=0x7f78f40c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78d4004b80 0x7f78f40c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 -- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 msgr2=0x7f78f4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 0x7f78f4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f96fe700 1 -- 172.21.15.52:0/1052118779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40c2310 con 0x7f78f4155820 2023-05-10T01:09:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.908+0000 7f78f3fff700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 0x7f78f4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78f96fe700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f78d4004580 tx=0x7f78dc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00e7b0 con 0x7f78f4155820 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc00e930 con 0x7f78f4155820 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f40c25f0 con 0x7f78f4155820 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc01b6a0 con 0x7f78f4155820 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.909+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f40c2bb0 con 0x7f78f4155820 2023-05-10T01:09:56.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.910+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f40666b0 con 0x7f78f4155820 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.910+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78dc01ba10 con 0x7f78f4155820 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.910+0000 7f78f0ff9700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 0x7f78d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.910+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78dc07b670 con 0x7f78f4155820 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.910+0000 7f78f8efd700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 0x7f78d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.911+0000 7f78f8efd700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 0x7f78d8061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f78ec006d50 tx=0x7f78ec008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:56.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:56.914+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78dc04cc10 con 0x7f78f4155820 2023-05-10T01:09:57.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.127+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78f406c340 con 0x7f78f4155820 2023-05-10T01:09:57.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.128+0000 7f78f0ff9700 1 -- 172.21.15.52:0/1052118779 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f78dc02b020 con 0x7f78f4155820 2023-05-10T01:09:57.131 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:57.132 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:09:57.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 msgr2=0x7f78d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 0x7f78d8061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f78ec006d50 tx=0x7f78ec008040).stop 2023-05-10T01:09:57.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 msgr2=0x7f78f4155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f78d4004580 tx=0x7f78dc01a000).stop 2023-05-10T01:09:57.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 shutdown_connections 2023-05-10T01:09:57.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78d805ed90 0x7f78d8061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4155820 0x7f78f4155c80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78d4004b80 0x7f78f40c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 --2- 172.21.15.52:0/1052118779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4152c10 0x7f78f4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 >> 172.21.15.52:0/1052118779 conn(0x7f78f40cb6f0 msgr2=0x7f78f40c5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 shutdown_connections 2023-05-10T01:09:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.130+0000 7f78fb161700 1 -- 172.21.15.52:0/1052118779 wait complete. 2023-05-10T01:09:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:09:57.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:57.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.258+0000 7f86c75a7700 1 Processor -- start 2023-05-10T01:09:57.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.258+0000 7f86c75a7700 1 -- start start 2023-05-10T01:09:57.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 0x7f86c00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154540 0x7f86c00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f86c0069690 0x7f86c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00c0650 con 0x7f86c0069690 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c006a010 con 0x7f86c0154160 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c75a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00bfd20 con 0x7f86c0154540 2023-05-10T01:09:57.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c5b44700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f86c0069690 0x7f86c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c5b44700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f86c0069690 0x7f86c0069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58418/0 (socket says 172.21.15.52:58418) 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c5b44700 1 -- 172.21.15.52:0/3779713900 learned_addr learned my addr 172.21.15.52:0/3779713900 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c5343700 1 --2- 172.21.15.52:0/3779713900 >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 0x7f86c00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.259+0000 7f86c4b42700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154540 0x7f86c00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 -- 172.21.15.52:0/3779713900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154540 msgr2=0x7f86c00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154540 0x7f86c00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 -- 172.21.15.52:0/3779713900 >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 msgr2=0x7f86c00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 --2- 172.21.15.52:0/3779713900 >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 0x7f86c00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 -- 172.21.15.52:0/3779713900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00c0000 con 0x7f86c0069690 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5343700 1 --2- 172.21.15.52:0/3779713900 >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 0x7f86c00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c5b44700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c0069b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f86c0083020 tx=0x7f86b00090f0).ready entity=mon.0 client_cookie=2460ebe01cb8775d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86bffff700 1 -- 172.21.15.52:0/3779713900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000b600 con 0x7f86c0069690 2023-05-10T01:09:57.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86bffff700 1 -- 172.21.15.52:0/3779713900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000b760 con 0x7f86c0069690 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86bffff700 1 -- 172.21.15.52:0/3779713900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000bb00 con 0x7f86c0069690 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 -- 172.21.15.52:0/3779713900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 msgr2=0x7f86c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c0069b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f86c0083020 tx=0x7f86b00090f0).stop 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 -- 172.21.15.52:0/3779713900 shutdown_connections 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c0069b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 --2- 172.21.15.52:0/3779713900 >> v2:172.21.15.172:3300/0 conn(0x7f86c0154160 0x7f86c00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 --2- 172.21.15.52:0/3779713900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154540 0x7f86c00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 -- 172.21.15.52:0/3779713900 >> 172.21.15.52:0/3779713900 conn(0x7f86c00cb6f0 msgr2=0x7f86c00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 -- 172.21.15.52:0/3779713900 shutdown_connections 2023-05-10T01:09:57.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.260+0000 7f86c75a7700 1 -- 172.21.15.52:0/3779713900 wait complete. 2023-05-10T01:09:57.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 Processor -- start 2023-05-10T01:09:57.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 -- start start 2023-05-10T01:09:57.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 0x7f86c0163610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 0x7f86c01452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c01470b0 con 0x7f86c0069690 2023-05-10T01:09:57.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c01676d0 con 0x7f86c0154540 2023-05-10T01:09:57.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.262+0000 7f86c75a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0145ea0 con 0x7f86c0154160 2023-05-10T01:09:57.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58420/0 (socket says 172.21.15.52:58420) 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 -- 172.21.15.52:0/4038269486 learned_addr learned my addr 172.21.15.52:0/4038269486 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c4b42700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 0x7f86c0163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5b44700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 0x7f86c01452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 -- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 msgr2=0x7f86c0163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 0x7f86c0163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 -- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 msgr2=0x7f86c01452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 0x7f86c01452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 -- 172.21.15.52:0/4038269486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009370 con 0x7f86c0069690 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c4b42700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 0x7f86c0163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5b44700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 0x7f86c01452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c5343700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f86b800d1d0 tx=0x7f86b8009a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800de70 con 0x7f86c0069690 2023-05-10T01:09:57.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800f040 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c0146180 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8013600 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.263+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c0146d40 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.264+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00666b0 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.264+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f86b80139f0 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.265+0000 7f86bd7fa700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 0x7f86a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.265+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f86b807a440 con 0x7f86c0069690 2023-05-10T01:09:57.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.265+0000 7f86c4b42700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 0x7f86a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.265+0000 7f86c4b42700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 0x7f86a0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f86c00c5190 tx=0x7f86b4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.269+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86b804b9e0 con 0x7f86c0069690 2023-05-10T01:09:57.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.442+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c006c340 con 0x7f86c0069690 2023-05-10T01:09:57.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.443+0000 7f86bd7fa700 1 -- 172.21.15.52:0/4038269486 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f86b804f000 con 0x7f86c0069690 2023-05-10T01:09:57.446 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:57.446 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.444+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 msgr2=0x7f86a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.444+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 0x7f86a0061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f86c00c5190 tx=0x7f86b4008040).stop 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 msgr2=0x7f86c00adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f86b800d1d0 tx=0x7f86b8009a90).stop 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 shutdown_connections 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86a005ed90 0x7f86a0061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86c0154540 0x7f86c01452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c0069690 0x7f86c00adc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 --2- 172.21.15.52:0/4038269486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86c0154160 0x7f86c0163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 >> 172.21.15.52:0/4038269486 conn(0x7f86c00cb6f0 msgr2=0x7f86c00ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 shutdown_connections 2023-05-10T01:09:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.445+0000 7f86c75a7700 1 -- 172.21.15.52:0/4038269486 wait complete. 2023-05-10T01:09:57.459 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:09:57.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:09:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.572+0000 7fa69de58700 1 Processor -- start 2023-05-10T01:09:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 -- start start 2023-05-10T01:09:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa698154160 0x7fa6980c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980c0650 con 0x7fa698069690 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980c1af0 con 0x7fa698154160 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa69de58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980bfd20 con 0x7fa698154540 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.573+0000 7fa6977fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa698154160 0x7fa6980c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa698154160 0x7fa6980c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58428/0 (socket says 172.21.15.52:58428) 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 -- 172.21.15.52:0/322704203 learned_addr learned my addr 172.21.15.52:0/322704203 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa696ffd700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 -- 172.21.15.52:0/322704203 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 msgr2=0x7fa6980c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 -- 172.21.15.52:0/322704203 >> v1:172.21.15.172:6789/0 conn(0x7fa698069690 legacy=0x7fa698157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 -- 172.21.15.52:0/322704203 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980c0000 con 0x7fa698154160 2023-05-10T01:09:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6977fe700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa6980c5c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa688006fd0 tx=0x7fa6880090f0).ready entity=mon.0 client_cookie=f05abef4e9f65a80 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6967fc700 1 -- 172.21.15.52:0/322704203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800b600 con 0x7fa698154160 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6967fc700 1 -- 172.21.15.52:0/322704203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800b760 con 0x7fa698154160 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.574+0000 7fa6967fc700 1 -- 172.21.15.52:0/322704203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800bb00 con 0x7fa698154160 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 -- 172.21.15.52:0/322704203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 msgr2=0x7fa6980c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa6980c5c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa688006fd0 tx=0x7fa6880090f0).stop 2023-05-10T01:09:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 -- 172.21.15.52:0/322704203 shutdown_connections 2023-05-10T01:09:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa6980c5c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 --2- 172.21.15.52:0/322704203 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 -- 172.21.15.52:0/322704203 >> 172.21.15.52:0/322704203 conn(0x7fa6980cb6f0 msgr2=0x7fa6980c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 -- 172.21.15.52:0/322704203 shutdown_connections 2023-05-10T01:09:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.575+0000 7fa69de58700 1 -- 172.21.15.52:0/322704203 wait complete. 2023-05-10T01:09:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.576+0000 7fa69de58700 1 Processor -- start 2023-05-10T01:09:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.576+0000 7fa69de58700 1 -- start start 2023-05-10T01:09:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa698069690 0x7fa6980c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698168230 con 0x7fa698154160 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69814de70 con 0x7fa698069690 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa698154b80 con 0x7fa698154540 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58436/0 (socket says 172.21.15.52:58436) 2023-05-10T01:09:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 -- 172.21.15.52:0/1033065286 learned_addr learned my addr 172.21.15.52:0/1033065286 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa6977fe700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa698069690 0x7fa6980c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa697fff700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 -- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 msgr2=0x7fa6980c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 -- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa698069690 msgr2=0x7fa6980c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa698069690 0x7fa6980c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 -- 172.21.15.52:0/1033065286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688009370 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa696ffd700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa68c00d860 tx=0x7fa68c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c011590 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0116f0 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.577+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6980c2220 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.578+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c011a90 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.578+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa698168720 con 0x7fa698154160 2023-05-10T01:09:57.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.578+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa698154950 con 0x7fa698154160 2023-05-10T01:09:57.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.579+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa68c012420 con 0x7fa698154160 2023-05-10T01:09:57.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.579+0000 7fa67f7fe700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 0x7fa678061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.579+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa68c079570 con 0x7fa698154160 2023-05-10T01:09:57.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.579+0000 7fa6977fe700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 0x7fa678061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.580+0000 7fa6977fe700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 0x7fa678061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa68800b3c0 tx=0x7fa688017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.583+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa698154950 con 0x7fa698154160 2023-05-10T01:09:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.751+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6980666b0 con 0x7fa67805ed90 2023-05-10T01:09:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.761+0000 7fa67f7fe700 1 -- 172.21.15.52:0/1033065286 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336378 (secure 0 0 0) 0x7fa6980666b0 con 0x7fa67805ed90 2023-05-10T01:09:57.767 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 msgr2=0x7fa678061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 0x7fa678061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa68800b3c0 tx=0x7fa688017000).stop 2023-05-10T01:09:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 msgr2=0x7fa698167d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa68c00d860 tx=0x7fa68c008040).stop 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 shutdown_connections 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa67805ed90 0x7fa678061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa698154540 0x7fa6980c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa698069690 0x7fa6980c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 --2- 172.21.15.52:0/1033065286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa698154160 0x7fa698167d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 >> 172.21.15.52:0/1033065286 conn(0x7fa6980cb6f0 msgr2=0x7fa6980afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 shutdown_connections 2023-05-10T01:09:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.764+0000 7fa69de58700 1 -- 172.21.15.52:0/1033065286 wait complete. 2023-05-10T01:09:57.771 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:09:57.779 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:09:56.441131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41604,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":39744,"kb_avail":754933116,"statfs":{"total":773094113280,"available":773051510784,"internally_reserved":0,"allocated":1839104,"data_stored":653788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40697856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769639+0000","last_change":"2023-05-10T01:09:53.767516+0000","last_active":"2023-05-10T01:09:53.769639+0000","last_peered":"2023-05-10T01:09:53.769639+0000","last_clean":"2023-05-10T01:09:53.769639+0000","last_became_active":"2023-05-10T01:09:53.767220+0000","last_became_peered":"2023-05-10T01:09:53.767220+0000","last_unstale":"2023-05-10T01:09:53.769639+0000","last_undegraded":"2023-05-10T01:09:53.769639+0000","last_fullsized":"2023-05-10T01:09:53.769639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765712+0000","last_change":"2023-05-10T01:09:53.376660+0000","last_active":"2023-05-10T01:09:53.765712+0000","last_peered":"2023-05-10T01:09:53.765712+0000","last_clean":"2023-05-10T01:09:53.765712+0000","last_became_active":"2023-05-10T01:09:53.372795+0000","last_became_peered":"2023-05-10T01:09:53.372795+0000","last_unstale":"2023-05-10T01:09:53.765712+0000","last_undegraded":"2023-05-10T01:09:53.765712+0000","last_fullsized":"2023-05-10T01:09:53.765712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777846+0000","last_change":"2023-05-10T01:09:53.777846+0000","last_active":"2023-05-10T01:09:53.777846+0000","last_peered":"2023-05-10T01:09:53.777846+0000","last_clean":"2023-05-10T01:09:53.777846+0000","last_became_active":"2023-05-10T01:09:53.777351+0000","last_became_peered":"2023-05-10T01:09:53.777351+0000","last_unstale":"2023-05-10T01:09:53.777846+0000","last_undegraded":"2023-05-10T01:09:53.777846+0000","last_fullsized":"2023-05-10T01:09:53.777846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375957+0000","last_change":"2023-05-10T01:09:53.372546+0000","last_active":"2023-05-10T01:09:53.375957+0000","last_peered":"2023-05-10T01:09:53.375957+0000","last_clean":"2023-05-10T01:09:53.375957+0000","last_became_active":"2023-05-10T01:09:53.371853+0000","last_became_peered":"2023-05-10T01:09:53.371853+0000","last_unstale":"2023-05-10T01:09:53.375957+0000","last_undegraded":"2023-05-10T01:09:53.375957+0000","last_fullsized":"2023-05-10T01:09:53.375957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776453+0000","last_change":"2023-05-10T01:09:53.776453+0000","last_active":"2023-05-10T01:09:53.776453+0000","last_peered":"2023-05-10T01:09:53.776453+0000","last_clean":"2023-05-10T01:09:53.776453+0000","last_became_active":"2023-05-10T01:09:53.776189+0000","last_became_peered":"2023-05-10T01:09:53.776189+0000","last_unstale":"2023-05-10T01:09:53.776453+0000","last_undegraded":"2023-05-10T01:09:53.776453+0000","last_fullsized":"2023-05-10T01:09:53.776453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759545+0000","last_change":"2023-05-10T01:09:53.376261+0000","last_active":"2023-05-10T01:09:53.759545+0000","last_peered":"2023-05-10T01:09:53.759545+0000","last_clean":"2023-05-10T01:09:53.759545+0000","last_became_active":"2023-05-10T01:09:53.375962+0000","last_became_peered":"2023-05-10T01:09:53.375962+0000","last_unstale":"2023-05-10T01:09:53.759545+0000","last_undegraded":"2023-05-10T01:09:53.759545+0000","last_fullsized":"2023-05-10T01:09:53.759545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769197+0000","last_change":"2023-05-10T01:09:53.766314+0000","last_active":"2023-05-10T01:09:53.769197+0000","last_peered":"2023-05-10T01:09:53.769197+0000","last_clean":"2023-05-10T01:09:53.769197+0000","last_became_active":"2023-05-10T01:09:53.766024+0000","last_became_peered":"2023-05-10T01:09:53.766024+0000","last_unstale":"2023-05-10T01:09:53.769197+0000","last_undegraded":"2023-05-10T01:09:53.769197+0000","last_fullsized":"2023-05-10T01:09:53.769197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385510+0000","last_change":"2023-05-10T01:09:53.381301+0000","last_active":"2023-05-10T01:09:53.385510+0000","last_peered":"2023-05-10T01:09:53.385510+0000","last_clean":"2023-05-10T01:09:53.385510+0000","last_became_active":"2023-05-10T01:09:53.379989+0000","last_became_peered":"2023-05-10T01:09:53.379989+0000","last_unstale":"2023-05-10T01:09:53.385510+0000","last_undegraded":"2023-05-10T01:09:53.385510+0000","last_fullsized":"2023-05-10T01:09:53.385510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778357+0000","last_change":"2023-05-10T01:09:53.777145+0000","last_active":"2023-05-10T01:09:53.778357+0000","last_peered":"2023-05-10T01:09:53.778357+0000","last_clean":"2023-05-10T01:09:53.778357+0000","last_became_active":"2023-05-10T01:09:53.776943+0000","last_became_peered":"2023-05-10T01:09:53.776943+0000","last_unstale":"2023-05-10T01:09:53.778357+0000","last_undegraded":"2023-05-10T01:09:53.778357+0000","last_fullsized":"2023-05-10T01:09:53.778357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383894+0000","last_change":"2023-05-10T01:09:53.378829+0000","last_active":"2023-05-10T01:09:53.383894+0000","last_peered":"2023-05-10T01:09:53.383894+0000","last_clean":"2023-05-10T01:09:53.383894+0000","last_became_active":"2023-05-10T01:09:53.378313+0000","last_became_peered":"2023-05-10T01:09:53.378313+0000","last_unstale":"2023-05-10T01:09:53.383894+0000","last_undegraded":"2023-05-10T01:09:53.383894+0000","last_fullsized":"2023-05-10T01:09:53.383894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773149+0000","last_change":"2023-05-10T01:09:53.773149+0000","last_active":"2023-05-10T01:09:53.773149+0000","last_peered":"2023-05-10T01:09:53.773149+0000","last_clean":"2023-05-10T01:09:53.773149+0000","last_became_active":"2023-05-10T01:09:53.772854+0000","last_became_peered":"2023-05-10T01:09:53.772854+0000","last_unstale":"2023-05-10T01:09:53.773149+0000","last_undegraded":"2023-05-10T01:09:53.773149+0000","last_fullsized":"2023-05-10T01:09:53.773149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790150+0000","last_change":"2023-05-10T01:09:53.383052+0000","last_active":"2023-05-10T01:09:53.790150+0000","last_peered":"2023-05-10T01:09:53.790150+0000","last_clean":"2023-05-10T01:09:53.790150+0000","last_became_active":"2023-05-10T01:09:53.382049+0000","last_became_peered":"2023-05-10T01:09:53.382049+0000","last_unstale":"2023-05-10T01:09:53.790150+0000","last_undegraded":"2023-05-10T01:09:53.790150+0000","last_fullsized":"2023-05-10T01:09:53.790150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789769+0000","last_change":"2023-05-10T01:09:53.780945+0000","last_active":"2023-05-10T01:09:53.789769+0000","last_peered":"2023-05-10T01:09:53.789769+0000","last_clean":"2023-05-10T01:09:53.789769+0000","last_became_active":"2023-05-10T01:09:53.780672+0000","last_became_peered":"2023-05-10T01:09:53.780672+0000","last_unstale":"2023-05-10T01:09:53.789769+0000","last_undegraded":"2023-05-10T01:09:53.789769+0000","last_fullsized":"2023-05-10T01:09:53.789769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786797+0000","last_change":"2023-05-10T01:09:53.378586+0000","last_active":"2023-05-10T01:09:53.786797+0000","last_peered":"2023-05-10T01:09:53.786797+0000","last_clean":"2023-05-10T01:09:53.786797+0000","last_became_active":"2023-05-10T01:09:53.378325+0000","last_became_peered":"2023-05-10T01:09:53.378325+0000","last_unstale":"2023-05-10T01:09:53.786797+0000","last_undegraded":"2023-05-10T01:09:53.786797+0000","last_fullsized":"2023-05-10T01:09:53.786797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769057+0000","last_change":"2023-05-10T01:09:53.763888+0000","last_active":"2023-05-10T01:09:53.769057+0000","last_peered":"2023-05-10T01:09:53.769057+0000","last_clean":"2023-05-10T01:09:53.769057+0000","last_became_active":"2023-05-10T01:09:53.763608+0000","last_became_peered":"2023-05-10T01:09:53.763608+0000","last_unstale":"2023-05-10T01:09:53.769057+0000","last_undegraded":"2023-05-10T01:09:53.769057+0000","last_fullsized":"2023-05-10T01:09:53.769057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789861+0000","last_change":"2023-05-10T01:09:53.384560+0000","last_active":"2023-05-10T01:09:53.789861+0000","last_peered":"2023-05-10T01:09:53.789861+0000","last_clean":"2023-05-10T01:09:53.789861+0000","last_became_active":"2023-05-10T01:09:53.384235+0000","last_became_peered":"2023-05-10T01:09:53.384235+0000","last_unstale":"2023-05-10T01:09:53.789861+0000","last_undegraded":"2023-05-10T01:09:53.789861+0000","last_fullsized":"2023-05-10T01:09:53.789861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785094+0000","last_change":"2023-05-10T01:09:53.785094+0000","last_active":"2023-05-10T01:09:53.785094+0000","last_peered":"2023-05-10T01:09:53.785094+0000","last_clean":"2023-05-10T01:09:53.785094+0000","last_became_active":"2023-05-10T01:09:53.784831+0000","last_became_peered":"2023-05-10T01:09:53.784831+0000","last_unstale":"2023-05-10T01:09:53.785094+0000","last_undegraded":"2023-05-10T01:09:53.785094+0000","last_fullsized":"2023-05-10T01:09:53.785094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385767+0000","last_change":"2023-05-10T01:09:53.378680+0000","last_active":"2023-05-10T01:09:53.385767+0000","last_peered":"2023-05-10T01:09:53.385767+0000","last_clean":"2023-05-10T01:09:53.385767+0000","last_became_active":"2023-05-10T01:09:53.378257+0000","last_became_peered":"2023-05-10T01:09:53.378257+0000","last_unstale":"2023-05-10T01:09:53.385767+0000","last_undegraded":"2023-05-10T01:09:53.385767+0000","last_fullsized":"2023-05-10T01:09:53.385767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.766892+0000","last_change":"2023-05-10T01:09:53.766892+0000","last_active":"2023-05-10T01:09:53.766892+0000","last_peered":"2023-05-10T01:09:53.766892+0000","last_clean":"2023-05-10T01:09:53.766892+0000","last_became_active":"2023-05-10T01:09:53.766517+0000","last_became_peered":"2023-05-10T01:09:53.766517+0000","last_unstale":"2023-05-10T01:09:53.766892+0000","last_undegraded":"2023-05-10T01:09:53.766892+0000","last_fullsized":"2023-05-10T01:09:53.766892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769106+0000","last_change":"2023-05-10T01:09:53.384108+0000","last_active":"2023-05-10T01:09:53.769106+0000","last_peered":"2023-05-10T01:09:53.769106+0000","last_clean":"2023-05-10T01:09:53.769106+0000","last_became_active":"2023-05-10T01:09:53.383818+0000","last_became_peered":"2023-05-10T01:09:53.383818+0000","last_unstale":"2023-05-10T01:09:53.769106+0000","last_undegraded":"2023-05-10T01:09:53.769106+0000","last_fullsized":"2023-05-10T01:09:53.769106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783021+0000","last_change":"2023-05-10T01:09:53.782485+0000","last_active":"2023-05-10T01:09:53.783021+0000","last_peered":"2023-05-10T01:09:53.783021+0000","last_clean":"2023-05-10T01:09:53.783021+0000","last_became_active":"2023-05-10T01:09:53.782201+0000","last_became_peered":"2023-05-10T01:09:53.782201+0000","last_unstale":"2023-05-10T01:09:53.783021+0000","last_undegraded":"2023-05-10T01:09:53.783021+0000","last_fullsized":"2023-05-10T01:09:53.783021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778623+0000","last_change":"2023-05-10T01:09:53.387304+0000","last_active":"2023-05-10T01:09:53.778623+0000","last_peered":"2023-05-10T01:09:53.778623+0000","last_clean":"2023-05-10T01:09:53.778623+0000","last_became_active":"2023-05-10T01:09:53.386981+0000","last_became_peered":"2023-05-10T01:09:53.386981+0000","last_unstale":"2023-05-10T01:09:53.778623+0000","last_undegraded":"2023-05-10T01:09:53.778623+0000","last_fullsized":"2023-05-10T01:09:53.778623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775155+0000","last_change":"2023-05-10T01:09:53.775155+0000","last_active":"2023-05-10T01:09:53.775155+0000","last_peered":"2023-05-10T01:09:53.775155+0000","last_clean":"2023-05-10T01:09:53.775155+0000","last_became_active":"2023-05-10T01:09:53.774869+0000","last_became_peered":"2023-05-10T01:09:53.774869+0000","last_unstale":"2023-05-10T01:09:53.775155+0000","last_undegraded":"2023-05-10T01:09:53.775155+0000","last_fullsized":"2023-05-10T01:09:53.775155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789992+0000","last_change":"2023-05-10T01:09:53.383948+0000","last_active":"2023-05-10T01:09:53.789992+0000","last_peered":"2023-05-10T01:09:53.789992+0000","last_clean":"2023-05-10T01:09:53.789992+0000","last_became_active":"2023-05-10T01:09:53.383677+0000","last_became_peered":"2023-05-10T01:09:53.383677+0000","last_unstale":"2023-05-10T01:09:53.789992+0000","last_undegraded":"2023-05-10T01:09:53.789992+0000","last_fullsized":"2023-05-10T01:09:53.789992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789396+0000","last_change":"2023-05-10T01:09:53.779430+0000","last_active":"2023-05-10T01:09:53.789396+0000","last_peered":"2023-05-10T01:09:53.789396+0000","last_clean":"2023-05-10T01:09:53.789396+0000","last_became_active":"2023-05-10T01:09:53.777122+0000","last_became_peered":"2023-05-10T01:09:53.777122+0000","last_unstale":"2023-05-10T01:09:53.789396+0000","last_undegraded":"2023-05-10T01:09:53.789396+0000","last_fullsized":"2023-05-10T01:09:53.789396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789835+0000","last_change":"2023-05-10T01:09:53.384697+0000","last_active":"2023-05-10T01:09:53.789835+0000","last_peered":"2023-05-10T01:09:53.789835+0000","last_clean":"2023-05-10T01:09:53.789835+0000","last_became_active":"2023-05-10T01:09:53.383952+0000","last_became_peered":"2023-05-10T01:09:53.383952+0000","last_unstale":"2023-05-10T01:09:53.789835+0000","last_undegraded":"2023-05-10T01:09:53.789835+0000","last_fullsized":"2023-05-10T01:09:53.789835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770299+0000","last_change":"2023-05-10T01:09:53.770299+0000","last_active":"2023-05-10T01:09:53.770299+0000","last_peered":"2023-05-10T01:09:53.770299+0000","last_clean":"2023-05-10T01:09:53.770299+0000","last_became_active":"2023-05-10T01:09:53.770016+0000","last_became_peered":"2023-05-10T01:09:53.770016+0000","last_unstale":"2023-05-10T01:09:53.770299+0000","last_undegraded":"2023-05-10T01:09:53.770299+0000","last_fullsized":"2023-05-10T01:09:53.770299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774485+0000","last_change":"2023-05-10T01:09:53.383206+0000","last_active":"2023-05-10T01:09:53.774485+0000","last_peered":"2023-05-10T01:09:53.774485+0000","last_clean":"2023-05-10T01:09:53.774485+0000","last_became_active":"2023-05-10T01:09:53.382411+0000","last_became_peered":"2023-05-10T01:09:53.382411+0000","last_unstale":"2023-05-10T01:09:53.774485+0000","last_undegraded":"2023-05-10T01:09:53.774485+0000","last_fullsized":"2023-05-10T01:09:53.774485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763306+0000","last_change":"2023-05-10T01:09:53.763306+0000","last_active":"2023-05-10T01:09:53.763306+0000","last_peered":"2023-05-10T01:09:53.763306+0000","last_clean":"2023-05-10T01:09:53.763306+0000","last_became_active":"2023-05-10T01:09:53.762635+0000","last_became_peered":"2023-05-10T01:09:53.762635+0000","last_unstale":"2023-05-10T01:09:53.763306+0000","last_undegraded":"2023-05-10T01:09:53.763306+0000","last_fullsized":"2023-05-10T01:09:53.763306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384381+0000","last_change":"2023-05-10T01:09:53.377895+0000","last_active":"2023-05-10T01:09:53.384381+0000","last_peered":"2023-05-10T01:09:53.384381+0000","last_clean":"2023-05-10T01:09:53.384381+0000","last_became_active":"2023-05-10T01:09:53.377611+0000","last_became_peered":"2023-05-10T01:09:53.377611+0000","last_unstale":"2023-05-10T01:09:53.384381+0000","last_undegraded":"2023-05-10T01:09:53.384381+0000","last_fullsized":"2023-05-10T01:09:53.384381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777256+0000","last_change":"2023-05-10T01:09:53.770032+0000","last_active":"2023-05-10T01:09:53.777256+0000","last_peered":"2023-05-10T01:09:53.777256+0000","last_clean":"2023-05-10T01:09:53.777256+0000","last_became_active":"2023-05-10T01:09:53.769759+0000","last_became_peered":"2023-05-10T01:09:53.769759+0000","last_unstale":"2023-05-10T01:09:53.777256+0000","last_undegraded":"2023-05-10T01:09:53.777256+0000","last_fullsized":"2023-05-10T01:09:53.777256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775799+0000","last_change":"2023-05-10T01:09:53.384429+0000","last_active":"2023-05-10T01:09:53.775799+0000","last_peered":"2023-05-10T01:09:53.775799+0000","last_clean":"2023-05-10T01:09:53.775799+0000","last_became_active":"2023-05-10T01:09:53.384089+0000","last_became_peered":"2023-05-10T01:09:53.384089+0000","last_unstale":"2023-05-10T01:09:53.775799+0000","last_undegraded":"2023-05-10T01:09:53.775799+0000","last_fullsized":"2023-05-10T01:09:53.775799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786438+0000","last_change":"2023-05-10T01:09:53.775201+0000","last_active":"2023-05-10T01:09:53.786438+0000","last_peered":"2023-05-10T01:09:53.786438+0000","last_clean":"2023-05-10T01:09:53.786438+0000","last_became_active":"2023-05-10T01:09:53.774881+0000","last_became_peered":"2023-05-10T01:09:53.774881+0000","last_unstale":"2023-05-10T01:09:53.786438+0000","last_undegraded":"2023-05-10T01:09:53.786438+0000","last_fullsized":"2023-05-10T01:09:53.786438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.389013+0000","last_change":"2023-05-10T01:09:53.383296+0000","last_active":"2023-05-10T01:09:53.389013+0000","last_peered":"2023-05-10T01:09:53.389013+0000","last_clean":"2023-05-10T01:09:53.389013+0000","last_became_active":"2023-05-10T01:09:53.383024+0000","last_became_peered":"2023-05-10T01:09:53.383024+0000","last_unstale":"2023-05-10T01:09:53.389013+0000","last_undegraded":"2023-05-10T01:09:53.389013+0000","last_fullsized":"2023-05-10T01:09:53.389013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789564+0000","last_change":"2023-05-10T01:09:53.781034+0000","last_active":"2023-05-10T01:09:53.789564+0000","last_peered":"2023-05-10T01:09:53.789564+0000","last_clean":"2023-05-10T01:09:53.789564+0000","last_became_active":"2023-05-10T01:09:53.780772+0000","last_became_peered":"2023-05-10T01:09:53.780772+0000","last_unstale":"2023-05-10T01:09:53.789564+0000","last_undegraded":"2023-05-10T01:09:53.789564+0000","last_fullsized":"2023-05-10T01:09:53.789564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764711+0000","last_change":"2023-05-10T01:09:53.375634+0000","last_active":"2023-05-10T01:09:53.764711+0000","last_peered":"2023-05-10T01:09:53.764711+0000","last_clean":"2023-05-10T01:09:53.764711+0000","last_became_active":"2023-05-10T01:09:53.374842+0000","last_became_peered":"2023-05-10T01:09:53.374842+0000","last_unstale":"2023-05-10T01:09:53.764711+0000","last_undegraded":"2023-05-10T01:09:53.764711+0000","last_fullsized":"2023-05-10T01:09:53.764711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764990+0000","last_change":"2023-05-10T01:09:53.764990+0000","last_active":"2023-05-10T01:09:53.764990+0000","last_peered":"2023-05-10T01:09:53.764990+0000","last_clean":"2023-05-10T01:09:53.764990+0000","last_became_active":"2023-05-10T01:09:53.764708+0000","last_became_peered":"2023-05-10T01:09:53.764708+0000","last_unstale":"2023-05-10T01:09:53.764990+0000","last_undegraded":"2023-05-10T01:09:53.764990+0000","last_fullsized":"2023-05-10T01:09:53.764990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759860+0000","last_change":"2023-05-10T01:09:53.373817+0000","last_active":"2023-05-10T01:09:53.759860+0000","last_peered":"2023-05-10T01:09:53.759860+0000","last_clean":"2023-05-10T01:09:53.759860+0000","last_became_active":"2023-05-10T01:09:53.372121+0000","last_became_peered":"2023-05-10T01:09:53.372121+0000","last_unstale":"2023-05-10T01:09:53.759860+0000","last_undegraded":"2023-05-10T01:09:53.759860+0000","last_fullsized":"2023-05-10T01:09:53.759860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.358197+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:09:53.358197+0000","last_peered":"2023-05-10T01:09:53.358197+0000","last_clean":"2023-05-10T01:09:53.358197+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:09:53.358197+0000","last_undegraded":"2023-05-10T01:09:53.358197+0000","last_fullsized":"2023-05-10T01:09:53.358197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383732+0000","last_change":"2023-05-10T01:09:53.378846+0000","last_active":"2023-05-10T01:09:53.383732+0000","last_peered":"2023-05-10T01:09:53.383732+0000","last_clean":"2023-05-10T01:09:53.383732+0000","last_became_active":"2023-05-10T01:09:53.378439+0000","last_became_peered":"2023-05-10T01:09:53.378439+0000","last_unstale":"2023-05-10T01:09:53.383732+0000","last_undegraded":"2023-05-10T01:09:53.383732+0000","last_fullsized":"2023-05-10T01:09:53.383732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.772154+0000","last_change":"2023-05-10T01:09:53.772154+0000","last_active":"2023-05-10T01:09:53.772154+0000","last_peered":"2023-05-10T01:09:53.772154+0000","last_clean":"2023-05-10T01:09:53.772154+0000","last_became_active":"2023-05-10T01:09:53.771765+0000","last_became_peered":"2023-05-10T01:09:53.771765+0000","last_unstale":"2023-05-10T01:09:53.772154+0000","last_undegraded":"2023-05-10T01:09:53.772154+0000","last_fullsized":"2023-05-10T01:09:53.772154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.369033+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:09:53.369033+0000","last_peered":"2023-05-10T01:09:53.369033+0000","last_clean":"2023-05-10T01:09:53.369033+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:09:53.369033+0000","last_undegraded":"2023-05-10T01:09:53.369033+0000","last_fullsized":"2023-05-10T01:09:53.369033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768154+0000","last_change":"2023-05-10T01:09:53.383796+0000","last_active":"2023-05-10T01:09:53.768154+0000","last_peered":"2023-05-10T01:09:53.768154+0000","last_clean":"2023-05-10T01:09:53.768154+0000","last_became_active":"2023-05-10T01:09:53.383330+0000","last_became_peered":"2023-05-10T01:09:53.383330+0000","last_unstale":"2023-05-10T01:09:53.768154+0000","last_undegraded":"2023-05-10T01:09:53.768154+0000","last_fullsized":"2023-05-10T01:09:53.768154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763322+0000","last_change":"2023-05-10T01:09:53.763322+0000","last_active":"2023-05-10T01:09:53.763322+0000","last_peered":"2023-05-10T01:09:53.763322+0000","last_clean":"2023-05-10T01:09:53.763322+0000","last_became_active":"2023-05-10T01:09:53.762534+0000","last_became_peered":"2023-05-10T01:09:53.762534+0000","last_unstale":"2023-05-10T01:09:53.763322+0000","last_undegraded":"2023-05-10T01:09:53.763322+0000","last_fullsized":"2023-05-10T01:09:53.763322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774245+0000","last_change":"2023-05-10T01:09:53.774245+0000","last_active":"2023-05-10T01:09:53.774245+0000","last_peered":"2023-05-10T01:09:53.774245+0000","last_clean":"2023-05-10T01:09:53.774245+0000","last_became_active":"2023-05-10T01:09:53.773997+0000","last_became_peered":"2023-05-10T01:09:53.773997+0000","last_unstale":"2023-05-10T01:09:53.774245+0000","last_undegraded":"2023-05-10T01:09:53.774245+0000","last_fullsized":"2023-05-10T01:09:53.774245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757100+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:09:53.757100+0000","last_peered":"2023-05-10T01:09:53.757100+0000","last_clean":"2023-05-10T01:09:53.757100+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:09:53.757100+0000","last_undegraded":"2023-05-10T01:09:53.757100+0000","last_fullsized":"2023-05-10T01:09:53.757100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375235+0000","last_change":"2023-05-10T01:09:53.368527+0000","last_active":"2023-05-10T01:09:53.375235+0000","last_peered":"2023-05-10T01:09:53.375235+0000","last_clean":"2023-05-10T01:09:53.375235+0000","last_became_active":"2023-05-10T01:09:53.368195+0000","last_became_peered":"2023-05-10T01:09:53.368195+0000","last_unstale":"2023-05-10T01:09:53.375235+0000","last_undegraded":"2023-05-10T01:09:53.375235+0000","last_fullsized":"2023-05-10T01:09:53.375235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.784150+0000","last_change":"2023-05-10T01:09:53.784150+0000","last_active":"2023-05-10T01:09:53.784150+0000","last_peered":"2023-05-10T01:09:53.784150+0000","last_clean":"2023-05-10T01:09:53.784150+0000","last_became_active":"2023-05-10T01:09:53.783843+0000","last_became_peered":"2023-05-10T01:09:53.783843+0000","last_unstale":"2023-05-10T01:09:53.784150+0000","last_undegraded":"2023-05-10T01:09:53.784150+0000","last_fullsized":"2023-05-10T01:09:53.784150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.365479+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:09:53.365479+0000","last_peered":"2023-05-10T01:09:53.365479+0000","last_clean":"2023-05-10T01:09:53.365479+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:09:53.365479+0000","last_undegraded":"2023-05-10T01:09:53.365479+0000","last_fullsized":"2023-05-10T01:09:53.365479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767625+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:09:53.767625+0000","last_peered":"2023-05-10T01:09:53.767625+0000","last_clean":"2023-05-10T01:09:53.767625+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:09:53.767625+0000","last_undegraded":"2023-05-10T01:09:53.767625+0000","last_fullsized":"2023-05-10T01:09:53.767625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758658+0000","last_change":"2023-05-10T01:09:53.380660+0000","last_active":"2023-05-10T01:09:53.758658+0000","last_peered":"2023-05-10T01:09:53.758658+0000","last_clean":"2023-05-10T01:09:53.758658+0000","last_became_active":"2023-05-10T01:09:53.380145+0000","last_became_peered":"2023-05-10T01:09:53.380145+0000","last_unstale":"2023-05-10T01:09:53.758658+0000","last_undegraded":"2023-05-10T01:09:53.758658+0000","last_fullsized":"2023-05-10T01:09:53.758658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762417+0000","last_change":"2023-05-10T01:09:53.762417+0000","last_active":"2023-05-10T01:09:53.762417+0000","last_peered":"2023-05-10T01:09:53.762417+0000","last_clean":"2023-05-10T01:09:53.762417+0000","last_became_active":"2023-05-10T01:09:53.762170+0000","last_became_peered":"2023-05-10T01:09:53.762170+0000","last_unstale":"2023-05-10T01:09:53.762417+0000","last_undegraded":"2023-05-10T01:09:53.762417+0000","last_fullsized":"2023-05-10T01:09:53.762417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768307+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:09:53.768307+0000","last_peered":"2023-05-10T01:09:53.768307+0000","last_clean":"2023-05-10T01:09:53.768307+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:09:53.768307+0000","last_undegraded":"2023-05-10T01:09:53.768307+0000","last_fullsized":"2023-05-10T01:09:53.768307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385410+0000","last_change":"2023-05-10T01:09:53.379906+0000","last_active":"2023-05-10T01:09:53.385410+0000","last_peered":"2023-05-10T01:09:53.385410+0000","last_clean":"2023-05-10T01:09:53.385410+0000","last_became_active":"2023-05-10T01:09:53.379573+0000","last_became_peered":"2023-05-10T01:09:53.379573+0000","last_unstale":"2023-05-10T01:09:53.385410+0000","last_undegraded":"2023-05-10T01:09:53.385410+0000","last_fullsized":"2023-05-10T01:09:53.385410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774378+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:09:53.774378+0000","last_peered":"2023-05-10T01:09:53.774378+0000","last_clean":"2023-05-10T01:09:53.774378+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:09:53.774378+0000","last_undegraded":"2023-05-10T01:09:53.774378+0000","last_fullsized":"2023-05-10T01:09:53.774378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375319+0000","last_change":"2023-05-10T01:09:53.370231+0000","last_active":"2023-05-10T01:09:53.375319+0000","last_peered":"2023-05-10T01:09:53.375319+0000","last_clean":"2023-05-10T01:09:53.375319+0000","last_became_active":"2023-05-10T01:09:53.369689+0000","last_became_peered":"2023-05-10T01:09:53.369689+0000","last_unstale":"2023-05-10T01:09:53.375319+0000","last_undegraded":"2023-05-10T01:09:53.375319+0000","last_fullsized":"2023-05-10T01:09:53.375319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.761010+0000","last_change":"2023-05-10T01:09:53.761010+0000","last_active":"2023-05-10T01:09:53.761010+0000","last_peered":"2023-05-10T01:09:53.761010+0000","last_clean":"2023-05-10T01:09:53.761010+0000","last_became_active":"2023-05-10T01:09:53.760729+0000","last_became_peered":"2023-05-10T01:09:53.760729+0000","last_unstale":"2023-05-10T01:09:53.761010+0000","last_undegraded":"2023-05-10T01:09:53.761010+0000","last_fullsized":"2023-05-10T01:09:53.761010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789343+0000","last_change":"2023-05-10T01:09:53.378347+0000","last_active":"2023-05-10T01:09:53.789343+0000","last_peered":"2023-05-10T01:09:53.789343+0000","last_clean":"2023-05-10T01:09:53.789343+0000","last_became_active":"2023-05-10T01:09:53.378066+0000","last_became_peered":"2023-05-10T01:09:53.378066+0000","last_unstale":"2023-05-10T01:09:53.789343+0000","last_undegraded":"2023-05-10T01:09:53.789343+0000","last_fullsized":"2023-05-10T01:09:53.789343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.358520+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:09:53.358520+0000","last_peered":"2023-05-10T01:09:53.358520+0000","last_clean":"2023-05-10T01:09:53.358520+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:09:53.358520+0000","last_undegraded":"2023-05-10T01:09:53.358520+0000","last_fullsized":"2023-05-10T01:09:53.358520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778283+0000","last_change":"2023-05-10T01:09:53.777244+0000","last_active":"2023-05-10T01:09:53.778283+0000","last_peered":"2023-05-10T01:09:53.778283+0000","last_clean":"2023-05-10T01:09:53.778283+0000","last_became_active":"2023-05-10T01:09:53.776901+0000","last_became_peered":"2023-05-10T01:09:53.776901+0000","last_unstale":"2023-05-10T01:09:53.778283+0000","last_undegraded":"2023-05-10T01:09:53.778283+0000","last_fullsized":"2023-05-10T01:09:53.778283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375482+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:09:53.375482+0000","last_peered":"2023-05-10T01:09:53.375482+0000","last_clean":"2023-05-10T01:09:53.375482+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:09:53.375482+0000","last_undegraded":"2023-05-10T01:09:53.375482+0000","last_fullsized":"2023-05-10T01:09:53.375482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385420+0000","last_change":"2023-05-10T01:09:53.379978+0000","last_active":"2023-05-10T01:09:53.385420+0000","last_peered":"2023-05-10T01:09:53.385420+0000","last_clean":"2023-05-10T01:09:53.385420+0000","last_became_active":"2023-05-10T01:09:53.378931+0000","last_became_peered":"2023-05-10T01:09:53.378931+0000","last_unstale":"2023-05-10T01:09:53.385420+0000","last_undegraded":"2023-05-10T01:09:53.385420+0000","last_fullsized":"2023-05-10T01:09:53.385420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789667+0000","last_change":"2023-05-10T01:09:53.781546+0000","last_active":"2023-05-10T01:09:53.789667+0000","last_peered":"2023-05-10T01:09:53.789667+0000","last_clean":"2023-05-10T01:09:53.789667+0000","last_became_active":"2023-05-10T01:09:53.781279+0000","last_became_peered":"2023-05-10T01:09:53.781279+0000","last_unstale":"2023-05-10T01:09:53.789667+0000","last_undegraded":"2023-05-10T01:09:53.789667+0000","last_fullsized":"2023-05-10T01:09:53.789667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769108+0000","last_change":"2023-05-10T01:09:53.765537+0000","last_active":"2023-05-10T01:09:53.769108+0000","last_peered":"2023-05-10T01:09:53.769108+0000","last_clean":"2023-05-10T01:09:53.769108+0000","last_became_active":"2023-05-10T01:09:53.765301+0000","last_became_peered":"2023-05-10T01:09:53.765301+0000","last_unstale":"2023-05-10T01:09:53.769108+0000","last_undegraded":"2023-05-10T01:09:53.769108+0000","last_fullsized":"2023-05-10T01:09:53.769108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385567+0000","last_change":"2023-05-10T01:09:53.383241+0000","last_active":"2023-05-10T01:09:53.385567+0000","last_peered":"2023-05-10T01:09:53.385567+0000","last_clean":"2023-05-10T01:09:53.385567+0000","last_became_active":"2023-05-10T01:09:53.382496+0000","last_became_peered":"2023-05-10T01:09:53.382496+0000","last_unstale":"2023-05-10T01:09:53.385567+0000","last_undegraded":"2023-05-10T01:09:53.385567+0000","last_fullsized":"2023-05-10T01:09:53.385567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780316+0000","last_change":"2023-05-10T01:09:53.770592+0000","last_active":"2023-05-10T01:09:53.780316+0000","last_peered":"2023-05-10T01:09:53.780316+0000","last_clean":"2023-05-10T01:09:53.780316+0000","last_became_active":"2023-05-10T01:09:53.770330+0000","last_became_peered":"2023-05-10T01:09:53.770330+0000","last_unstale":"2023-05-10T01:09:53.780316+0000","last_undegraded":"2023-05-10T01:09:53.780316+0000","last_fullsized":"2023-05-10T01:09:53.780316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.392017+0000","last_change":"2023-05-10T01:09:53.383384+0000","last_active":"2023-05-10T01:09:53.392017+0000","last_peered":"2023-05-10T01:09:53.392017+0000","last_clean":"2023-05-10T01:09:53.392017+0000","last_became_active":"2023-05-10T01:09:53.383049+0000","last_became_peered":"2023-05-10T01:09:53.383049+0000","last_unstale":"2023-05-10T01:09:53.392017+0000","last_undegraded":"2023-05-10T01:09:53.392017+0000","last_fullsized":"2023-05-10T01:09:53.392017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789347+0000","last_change":"2023-05-10T01:09:53.778319+0000","last_active":"2023-05-10T01:09:53.789347+0000","last_peered":"2023-05-10T01:09:53.789347+0000","last_clean":"2023-05-10T01:09:53.789347+0000","last_became_active":"2023-05-10T01:09:53.777415+0000","last_became_peered":"2023-05-10T01:09:53.777415+0000","last_unstale":"2023-05-10T01:09:53.789347+0000","last_undegraded":"2023-05-10T01:09:53.789347+0000","last_fullsized":"2023-05-10T01:09:53.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790039+0000","last_change":"2023-05-10T01:09:53.382266+0000","last_active":"2023-05-10T01:09:53.790039+0000","last_peered":"2023-05-10T01:09:53.790039+0000","last_clean":"2023-05-10T01:09:53.790039+0000","last_became_active":"2023-05-10T01:09:53.382000+0000","last_became_peered":"2023-05-10T01:09:53.382000+0000","last_unstale":"2023-05-10T01:09:53.790039+0000","last_undegraded":"2023-05-10T01:09:53.790039+0000","last_fullsized":"2023-05-10T01:09:53.790039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770861+0000","last_change":"2023-05-10T01:09:53.768348+0000","last_active":"2023-05-10T01:09:53.770861+0000","last_peered":"2023-05-10T01:09:53.770861+0000","last_clean":"2023-05-10T01:09:53.770861+0000","last_became_active":"2023-05-10T01:09:53.767452+0000","last_became_peered":"2023-05-10T01:09:53.767452+0000","last_unstale":"2023-05-10T01:09:53.770861+0000","last_undegraded":"2023-05-10T01:09:53.770861+0000","last_fullsized":"2023-05-10T01:09:53.770861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782143+0000","last_change":"2023-05-10T01:09:53.377329+0000","last_active":"2023-05-10T01:09:53.782143+0000","last_peered":"2023-05-10T01:09:53.782143+0000","last_clean":"2023-05-10T01:09:53.782143+0000","last_became_active":"2023-05-10T01:09:53.377037+0000","last_became_peered":"2023-05-10T01:09:53.377037+0000","last_unstale":"2023-05-10T01:09:53.782143+0000","last_undegraded":"2023-05-10T01:09:53.782143+0000","last_fullsized":"2023-05-10T01:09:53.782143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789557+0000","last_change":"2023-05-10T01:09:53.780936+0000","last_active":"2023-05-10T01:09:53.789557+0000","last_peered":"2023-05-10T01:09:53.789557+0000","last_clean":"2023-05-10T01:09:53.789557+0000","last_became_active":"2023-05-10T01:09:53.780642+0000","last_became_peered":"2023-05-10T01:09:53.780642+0000","last_unstale":"2023-05-10T01:09:53.789557+0000","last_undegraded":"2023-05-10T01:09:53.789557+0000","last_fullsized":"2023-05-10T01:09:53.789557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757130+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.757130+0000","last_peered":"2023-05-10T01:09:53.757130+0000","last_clean":"2023-05-10T01:09:53.757130+0000","last_became_active":"2023-05-10T01:09:53.380703+0000","last_became_peered":"2023-05-10T01:09:53.380703+0000","last_unstale":"2023-05-10T01:09:53.757130+0000","last_undegraded":"2023-05-10T01:09:53.757130+0000","last_fullsized":"2023-05-10T01:09:53.757130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773330+0000","last_change":"2023-05-10T01:09:53.773330+0000","last_active":"2023-05-10T01:09:53.773330+0000","last_peered":"2023-05-10T01:09:53.773330+0000","last_clean":"2023-05-10T01:09:53.773330+0000","last_became_active":"2023-05-10T01:09:53.773048+0000","last_became_peered":"2023-05-10T01:09:53.773048+0000","last_unstale":"2023-05-10T01:09:53.773330+0000","last_undegraded":"2023-05-10T01:09:53.773330+0000","last_fullsized":"2023-05-10T01:09:53.773330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.389324+0000","last_change":"2023-05-10T01:09:53.385088+0000","last_active":"2023-05-10T01:09:53.389324+0000","last_peered":"2023-05-10T01:09:53.389324+0000","last_clean":"2023-05-10T01:09:53.389324+0000","last_became_active":"2023-05-10T01:09:53.384812+0000","last_became_peered":"2023-05-10T01:09:53.384812+0000","last_unstale":"2023-05-10T01:09:53.389324+0000","last_undegraded":"2023-05-10T01:09:53.389324+0000","last_fullsized":"2023-05-10T01:09:53.389324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760008+0000","last_change":"2023-05-10T01:09:53.760008+0000","last_active":"2023-05-10T01:09:53.760008+0000","last_peered":"2023-05-10T01:09:53.760008+0000","last_clean":"2023-05-10T01:09:53.760008+0000","last_became_active":"2023-05-10T01:09:53.759723+0000","last_became_peered":"2023-05-10T01:09:53.759723+0000","last_unstale":"2023-05-10T01:09:53.760008+0000","last_undegraded":"2023-05-10T01:09:53.760008+0000","last_fullsized":"2023-05-10T01:09:53.760008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757195+0000","last_change":"2023-05-10T01:09:53.378264+0000","last_active":"2023-05-10T01:09:53.757195+0000","last_peered":"2023-05-10T01:09:53.757195+0000","last_clean":"2023-05-10T01:09:53.757195+0000","last_became_active":"2023-05-10T01:09:53.377943+0000","last_became_peered":"2023-05-10T01:09:53.377943+0000","last_unstale":"2023-05-10T01:09:53.757195+0000","last_undegraded":"2023-05-10T01:09:53.757195+0000","last_fullsized":"2023-05-10T01:09:53.757195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.784908+0000","last_change":"2023-05-10T01:09:53.784908+0000","last_active":"2023-05-10T01:09:53.784908+0000","last_peered":"2023-05-10T01:09:53.784908+0000","last_clean":"2023-05-10T01:09:53.784908+0000","last_became_active":"2023-05-10T01:09:53.784482+0000","last_became_peered":"2023-05-10T01:09:53.784482+0000","last_unstale":"2023-05-10T01:09:53.784908+0000","last_undegraded":"2023-05-10T01:09:53.784908+0000","last_fullsized":"2023-05-10T01:09:53.784908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.380877+0000","last_change":"2023-05-10T01:09:53.377668+0000","last_active":"2023-05-10T01:09:53.380877+0000","last_peered":"2023-05-10T01:09:53.380877+0000","last_clean":"2023-05-10T01:09:53.380877+0000","last_became_active":"2023-05-10T01:09:53.377379+0000","last_became_peered":"2023-05-10T01:09:53.377379+0000","last_unstale":"2023-05-10T01:09:53.380877+0000","last_undegraded":"2023-05-10T01:09:53.380877+0000","last_fullsized":"2023-05-10T01:09:53.380877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775594+0000","last_change":"2023-05-10T01:09:53.775594+0000","last_active":"2023-05-10T01:09:53.775594+0000","last_peered":"2023-05-10T01:09:53.775594+0000","last_clean":"2023-05-10T01:09:53.775594+0000","last_became_active":"2023-05-10T01:09:53.775258+0000","last_became_peered":"2023-05-10T01:09:53.775258+0000","last_unstale":"2023-05-10T01:09:53.775594+0000","last_undegraded":"2023-05-10T01:09:53.775594+0000","last_fullsized":"2023-05-10T01:09:53.775594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385557+0000","last_change":"2023-05-10T01:09:53.383076+0000","last_active":"2023-05-10T01:09:53.385557+0000","last_peered":"2023-05-10T01:09:53.385557+0000","last_clean":"2023-05-10T01:09:53.385557+0000","last_became_active":"2023-05-10T01:09:53.381851+0000","last_became_peered":"2023-05-10T01:09:53.381851+0000","last_unstale":"2023-05-10T01:09:53.385557+0000","last_undegraded":"2023-05-10T01:09:53.385557+0000","last_fullsized":"2023-05-10T01:09:53.385557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783018+0000","last_change":"2023-05-10T01:09:53.782493+0000","last_active":"2023-05-10T01:09:53.783018+0000","last_peered":"2023-05-10T01:09:53.783018+0000","last_clean":"2023-05-10T01:09:53.783018+0000","last_became_active":"2023-05-10T01:09:53.782211+0000","last_became_peered":"2023-05-10T01:09:53.782211+0000","last_unstale":"2023-05-10T01:09:53.783018+0000","last_undegraded":"2023-05-10T01:09:53.783018+0000","last_fullsized":"2023-05-10T01:09:53.783018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760139+0000","last_change":"2023-05-10T01:09:53.384727+0000","last_active":"2023-05-10T01:09:53.760139+0000","last_peered":"2023-05-10T01:09:53.760139+0000","last_clean":"2023-05-10T01:09:53.760139+0000","last_became_active":"2023-05-10T01:09:53.384426+0000","last_became_peered":"2023-05-10T01:09:53.384426+0000","last_unstale":"2023-05-10T01:09:53.760139+0000","last_undegraded":"2023-05-10T01:09:53.760139+0000","last_fullsized":"2023-05-10T01:09:53.760139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789367+0000","last_change":"2023-05-10T01:09:53.778447+0000","last_active":"2023-05-10T01:09:53.789367+0000","last_peered":"2023-05-10T01:09:53.789367+0000","last_clean":"2023-05-10T01:09:53.789367+0000","last_became_active":"2023-05-10T01:09:53.777503+0000","last_became_peered":"2023-05-10T01:09:53.777503+0000","last_unstale":"2023-05-10T01:09:53.789367+0000","last_undegraded":"2023-05-10T01:09:53.789367+0000","last_fullsized":"2023-05-10T01:09:53.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.376021+0000","last_change":"2023-05-10T01:09:53.373308+0000","last_active":"2023-05-10T01:09:53.376021+0000","last_peered":"2023-05-10T01:09:53.376021+0000","last_clean":"2023-05-10T01:09:53.376021+0000","last_became_active":"2023-05-10T01:09:53.372576+0000","last_became_peered":"2023-05-10T01:09:53.372576+0000","last_unstale":"2023-05-10T01:09:53.376021+0000","last_undegraded":"2023-05-10T01:09:53.376021+0000","last_fullsized":"2023-05-10T01:09:53.376021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769654+0000","last_change":"2023-05-10T01:09:53.767497+0000","last_active":"2023-05-10T01:09:53.769654+0000","last_peered":"2023-05-10T01:09:53.769654+0000","last_clean":"2023-05-10T01:09:53.769654+0000","last_became_active":"2023-05-10T01:09:53.764957+0000","last_became_peered":"2023-05-10T01:09:53.764957+0000","last_unstale":"2023-05-10T01:09:53.769654+0000","last_undegraded":"2023-05-10T01:09:53.769654+0000","last_fullsized":"2023-05-10T01:09:53.769654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384210+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.384210+0000","last_peered":"2023-05-10T01:09:53.384210+0000","last_clean":"2023-05-10T01:09:53.384210+0000","last_became_active":"2023-05-10T01:09:53.378549+0000","last_became_peered":"2023-05-10T01:09:53.378549+0000","last_unstale":"2023-05-10T01:09:53.384210+0000","last_undegraded":"2023-05-10T01:09:53.384210+0000","last_fullsized":"2023-05-10T01:09:53.384210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777067+0000","last_change":"2023-05-10T01:09:53.777067+0000","last_active":"2023-05-10T01:09:53.777067+0000","last_peered":"2023-05-10T01:09:53.777067+0000","last_clean":"2023-05-10T01:09:53.777067+0000","last_became_active":"2023-05-10T01:09:53.776765+0000","last_became_peered":"2023-05-10T01:09:53.776765+0000","last_unstale":"2023-05-10T01:09:53.777067+0000","last_undegraded":"2023-05-10T01:09:53.777067+0000","last_fullsized":"2023-05-10T01:09:53.777067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764391+0000","last_change":"2023-05-10T01:09:53.384098+0000","last_active":"2023-05-10T01:09:53.764391+0000","last_peered":"2023-05-10T01:09:53.764391+0000","last_clean":"2023-05-10T01:09:53.764391+0000","last_became_active":"2023-05-10T01:09:53.383801+0000","last_became_peered":"2023-05-10T01:09:53.383801+0000","last_unstale":"2023-05-10T01:09:53.764391+0000","last_undegraded":"2023-05-10T01:09:53.764391+0000","last_fullsized":"2023-05-10T01:09:53.764391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768353+0000","last_change":"2023-05-10T01:09:53.768353+0000","last_active":"2023-05-10T01:09:53.768353+0000","last_peered":"2023-05-10T01:09:53.768353+0000","last_clean":"2023-05-10T01:09:53.768353+0000","last_became_active":"2023-05-10T01:09:53.768082+0000","last_became_peered":"2023-05-10T01:09:53.768082+0000","last_unstale":"2023-05-10T01:09:53.768353+0000","last_undegraded":"2023-05-10T01:09:53.768353+0000","last_fullsized":"2023-05-10T01:09:53.768353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384942+0000","last_change":"2023-05-10T01:09:53.379829+0000","last_active":"2023-05-10T01:09:53.384942+0000","last_peered":"2023-05-10T01:09:53.384942+0000","last_clean":"2023-05-10T01:09:53.384942+0000","last_became_active":"2023-05-10T01:09:53.379516+0000","last_became_peered":"2023-05-10T01:09:53.379516+0000","last_unstale":"2023-05-10T01:09:53.384942+0000","last_undegraded":"2023-05-10T01:09:53.384942+0000","last_fullsized":"2023-05-10T01:09:53.384942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789455+0000","last_change":"2023-05-10T01:09:53.779725+0000","last_active":"2023-05-10T01:09:53.789455+0000","last_peered":"2023-05-10T01:09:53.789455+0000","last_clean":"2023-05-10T01:09:53.789455+0000","last_became_active":"2023-05-10T01:09:53.776948+0000","last_became_peered":"2023-05-10T01:09:53.776948+0000","last_unstale":"2023-05-10T01:09:53.789455+0000","last_undegraded":"2023-05-10T01:09:53.789455+0000","last_fullsized":"2023-05-10T01:09:53.789455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763025+0000","last_change":"2023-05-10T01:09:53.384002+0000","last_active":"2023-05-10T01:09:53.763025+0000","last_peered":"2023-05-10T01:09:53.763025+0000","last_clean":"2023-05-10T01:09:53.763025+0000","last_became_active":"2023-05-10T01:09:53.383716+0000","last_became_peered":"2023-05-10T01:09:53.383716+0000","last_unstale":"2023-05-10T01:09:53.763025+0000","last_undegraded":"2023-05-10T01:09:53.763025+0000","last_fullsized":"2023-05-10T01:09:53.763025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774462+0000","last_change":"2023-05-10T01:09:53.772854+0000","last_active":"2023-05-10T01:09:53.774462+0000","last_peered":"2023-05-10T01:09:53.774462+0000","last_clean":"2023-05-10T01:09:53.774462+0000","last_became_active":"2023-05-10T01:09:53.772540+0000","last_became_peered":"2023-05-10T01:09:53.772540+0000","last_unstale":"2023-05-10T01:09:53.774462+0000","last_undegraded":"2023-05-10T01:09:53.774462+0000","last_fullsized":"2023-05-10T01:09:53.774462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384904+0000","last_change":"2023-05-10T01:09:53.379344+0000","last_active":"2023-05-10T01:09:53.384904+0000","last_peered":"2023-05-10T01:09:53.384904+0000","last_clean":"2023-05-10T01:09:53.384904+0000","last_became_active":"2023-05-10T01:09:53.379093+0000","last_became_peered":"2023-05-10T01:09:53.379093+0000","last_unstale":"2023-05-10T01:09:53.384904+0000","last_undegraded":"2023-05-10T01:09:53.384904+0000","last_fullsized":"2023-05-10T01:09:53.384904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789943+0000","last_change":"2023-05-10T01:09:53.782809+0000","last_active":"2023-05-10T01:09:53.789943+0000","last_peered":"2023-05-10T01:09:53.789943+0000","last_clean":"2023-05-10T01:09:53.789943+0000","last_became_active":"2023-05-10T01:09:53.777458+0000","last_became_peered":"2023-05-10T01:09:53.777458+0000","last_unstale":"2023-05-10T01:09:53.789943+0000","last_undegraded":"2023-05-10T01:09:53.789943+0000","last_fullsized":"2023-05-10T01:09:53.789943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756537+0000","last_change":"2023-05-10T01:09:53.382855+0000","last_active":"2023-05-10T01:09:53.756537+0000","last_peered":"2023-05-10T01:09:53.756537+0000","last_clean":"2023-05-10T01:09:53.756537+0000","last_became_active":"2023-05-10T01:09:53.379670+0000","last_became_peered":"2023-05-10T01:09:53.379670+0000","last_unstale":"2023-05-10T01:09:53.756537+0000","last_undegraded":"2023-05-10T01:09:53.756537+0000","last_fullsized":"2023-05-10T01:09:53.756537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789346+0000","last_change":"2023-05-10T01:09:53.781558+0000","last_active":"2023-05-10T01:09:53.789346+0000","last_peered":"2023-05-10T01:09:53.789346+0000","last_clean":"2023-05-10T01:09:53.789346+0000","last_became_active":"2023-05-10T01:09:53.781283+0000","last_became_peered":"2023-05-10T01:09:53.781283+0000","last_unstale":"2023-05-10T01:09:53.789346+0000","last_undegraded":"2023-05-10T01:09:53.789346+0000","last_fullsized":"2023-05-10T01:09:53.789346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.388977+0000","last_change":"2023-05-10T01:09:53.382597+0000","last_active":"2023-05-10T01:09:53.388977+0000","last_peered":"2023-05-10T01:09:53.388977+0000","last_clean":"2023-05-10T01:09:53.388977+0000","last_became_active":"2023-05-10T01:09:53.382312+0000","last_became_peered":"2023-05-10T01:09:53.382312+0000","last_unstale":"2023-05-10T01:09:53.388977+0000","last_undegraded":"2023-05-10T01:09:53.388977+0000","last_fullsized":"2023-05-10T01:09:53.388977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762455+0000","last_change":"2023-05-10T01:09:53.762455+0000","last_active":"2023-05-10T01:09:53.762455+0000","last_peered":"2023-05-10T01:09:53.762455+0000","last_clean":"2023-05-10T01:09:53.762455+0000","last_became_active":"2023-05-10T01:09:53.762128+0000","last_became_peered":"2023-05-10T01:09:53.762128+0000","last_unstale":"2023-05-10T01:09:53.762455+0000","last_undegraded":"2023-05-10T01:09:53.762455+0000","last_fullsized":"2023-05-10T01:09:53.762455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790088+0000","last_change":"2023-05-10T01:09:53.383349+0000","last_active":"2023-05-10T01:09:53.790088+0000","last_peered":"2023-05-10T01:09:53.790088+0000","last_clean":"2023-05-10T01:09:53.790088+0000","last_became_active":"2023-05-10T01:09:53.381097+0000","last_became_peered":"2023-05-10T01:09:53.381097+0000","last_unstale":"2023-05-10T01:09:53.790088+0000","last_undegraded":"2023-05-10T01:09:53.790088+0000","last_fullsized":"2023-05-10T01:09:53.790088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769665+0000","last_change":"2023-05-10T01:09:53.768045+0000","last_active":"2023-05-10T01:09:53.769665+0000","last_peered":"2023-05-10T01:09:53.769665+0000","last_clean":"2023-05-10T01:09:53.769665+0000","last_became_active":"2023-05-10T01:09:53.767775+0000","last_became_peered":"2023-05-10T01:09:53.767775+0000","last_unstale":"2023-05-10T01:09:53.769665+0000","last_undegraded":"2023-05-10T01:09:53.769665+0000","last_fullsized":"2023-05-10T01:09:53.769665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758314+0000","last_change":"2023-05-10T01:09:53.378075+0000","last_active":"2023-05-10T01:09:53.758314+0000","last_peered":"2023-05-10T01:09:53.758314+0000","last_clean":"2023-05-10T01:09:53.758314+0000","last_became_active":"2023-05-10T01:09:53.377777+0000","last_became_peered":"2023-05-10T01:09:53.377777+0000","last_unstale":"2023-05-10T01:09:53.758314+0000","last_undegraded":"2023-05-10T01:09:53.758314+0000","last_fullsized":"2023-05-10T01:09:53.758314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786432+0000","last_change":"2023-05-10T01:09:53.777094+0000","last_active":"2023-05-10T01:09:53.786432+0000","last_peered":"2023-05-10T01:09:53.786432+0000","last_clean":"2023-05-10T01:09:53.786432+0000","last_became_active":"2023-05-10T01:09:53.776783+0000","last_became_peered":"2023-05-10T01:09:53.776783+0000","last_unstale":"2023-05-10T01:09:53.786432+0000","last_undegraded":"2023-05-10T01:09:53.786432+0000","last_fullsized":"2023-05-10T01:09:53.786432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384980+0000","last_change":"2023-05-10T01:09:53.380032+0000","last_active":"2023-05-10T01:09:53.384980+0000","last_peered":"2023-05-10T01:09:53.384980+0000","last_clean":"2023-05-10T01:09:53.384980+0000","last_became_active":"2023-05-10T01:09:53.379645+0000","last_became_peered":"2023-05-10T01:09:53.379645+0000","last_unstale":"2023-05-10T01:09:53.384980+0000","last_undegraded":"2023-05-10T01:09:53.384980+0000","last_fullsized":"2023-05-10T01:09:53.384980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769678+0000","last_change":"2023-05-10T01:09:53.769678+0000","last_active":"2023-05-10T01:09:53.769678+0000","last_peered":"2023-05-10T01:09:53.769678+0000","last_clean":"2023-05-10T01:09:53.769678+0000","last_became_active":"2023-05-10T01:09:53.768182+0000","last_became_peered":"2023-05-10T01:09:53.768182+0000","last_unstale":"2023-05-10T01:09:53.769678+0000","last_undegraded":"2023-05-10T01:09:53.769678+0000","last_fullsized":"2023-05-10T01:09:53.769678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777513+0000","last_change":"2023-05-10T01:09:53.387228+0000","last_active":"2023-05-10T01:09:53.777513+0000","last_peered":"2023-05-10T01:09:53.777513+0000","last_clean":"2023-05-10T01:09:53.777513+0000","last_became_active":"2023-05-10T01:09:53.386991+0000","last_became_peered":"2023-05-10T01:09:53.386991+0000","last_unstale":"2023-05-10T01:09:53.777513+0000","last_undegraded":"2023-05-10T01:09:53.777513+0000","last_fullsized":"2023-05-10T01:09:53.777513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773869+0000","last_change":"2023-05-10T01:09:53.773869+0000","last_active":"2023-05-10T01:09:53.773869+0000","last_peered":"2023-05-10T01:09:53.773869+0000","last_clean":"2023-05-10T01:09:53.773869+0000","last_became_active":"2023-05-10T01:09:53.773284+0000","last_became_peered":"2023-05-10T01:09:53.773284+0000","last_unstale":"2023-05-10T01:09:53.773869+0000","last_undegraded":"2023-05-10T01:09:53.773869+0000","last_fullsized":"2023-05-10T01:09:53.773869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.376146+0000","last_change":"2023-05-10T01:09:53.374463+0000","last_active":"2023-05-10T01:09:53.376146+0000","last_peered":"2023-05-10T01:09:53.376146+0000","last_clean":"2023-05-10T01:09:53.376146+0000","last_became_active":"2023-05-10T01:09:53.372250+0000","last_became_peered":"2023-05-10T01:09:53.372250+0000","last_unstale":"2023-05-10T01:09:53.376146+0000","last_undegraded":"2023-05-10T01:09:53.376146+0000","last_fullsized":"2023-05-10T01:09:53.376146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789874+0000","last_change":"2023-05-10T01:09:53.780390+0000","last_active":"2023-05-10T01:09:53.789874+0000","last_peered":"2023-05-10T01:09:53.789874+0000","last_clean":"2023-05-10T01:09:53.789874+0000","last_became_active":"2023-05-10T01:09:53.780072+0000","last_became_peered":"2023-05-10T01:09:53.780072+0000","last_unstale":"2023-05-10T01:09:53.789874+0000","last_undegraded":"2023-05-10T01:09:53.789874+0000","last_fullsized":"2023-05-10T01:09:53.789874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385780+0000","last_change":"2023-05-10T01:09:53.379278+0000","last_active":"2023-05-10T01:09:53.385780+0000","last_peered":"2023-05-10T01:09:53.385780+0000","last_clean":"2023-05-10T01:09:53.385780+0000","last_became_active":"2023-05-10T01:09:53.378985+0000","last_became_peered":"2023-05-10T01:09:53.378985+0000","last_unstale":"2023-05-10T01:09:53.385780+0000","last_undegraded":"2023-05-10T01:09:53.385780+0000","last_fullsized":"2023-05-10T01:09:53.385780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778912+0000","last_change":"2023-05-10T01:09:53.778386+0000","last_active":"2023-05-10T01:09:53.778912+0000","last_peered":"2023-05-10T01:09:53.778912+0000","last_clean":"2023-05-10T01:09:53.778912+0000","last_became_active":"2023-05-10T01:09:53.778121+0000","last_became_peered":"2023-05-10T01:09:53.778121+0000","last_unstale":"2023-05-10T01:09:53.778912+0000","last_undegraded":"2023-05-10T01:09:53.778912+0000","last_fullsized":"2023-05-10T01:09:53.778912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782640+0000","last_change":"2023-05-10T01:09:53.377455+0000","last_active":"2023-05-10T01:09:53.782640+0000","last_peered":"2023-05-10T01:09:53.782640+0000","last_clean":"2023-05-10T01:09:53.782640+0000","last_became_active":"2023-05-10T01:09:53.377216+0000","last_became_peered":"2023-05-10T01:09:53.377216+0000","last_unstale":"2023-05-10T01:09:53.782640+0000","last_undegraded":"2023-05-10T01:09:53.782640+0000","last_fullsized":"2023-05-10T01:09:53.782640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768114+0000","last_change":"2023-05-10T01:09:53.766371+0000","last_active":"2023-05-10T01:09:53.768114+0000","last_peered":"2023-05-10T01:09:53.768114+0000","last_clean":"2023-05-10T01:09:53.768114+0000","last_became_active":"2023-05-10T01:09:53.766077+0000","last_became_peered":"2023-05-10T01:09:53.766077+0000","last_unstale":"2023-05-10T01:09:53.768114+0000","last_undegraded":"2023-05-10T01:09:53.768114+0000","last_fullsized":"2023-05-10T01:09:53.768114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790195+0000","last_change":"2023-05-10T01:09:53.381183+0000","last_active":"2023-05-10T01:09:53.790195+0000","last_peered":"2023-05-10T01:09:53.790195+0000","last_clean":"2023-05-10T01:09:53.790195+0000","last_became_active":"2023-05-10T01:09:53.380930+0000","last_became_peered":"2023-05-10T01:09:53.380930+0000","last_unstale":"2023-05-10T01:09:53.790195+0000","last_undegraded":"2023-05-10T01:09:53.790195+0000","last_fullsized":"2023-05-10T01:09:53.790195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762054+0000","last_change":"2023-05-10T01:09:53.762054+0000","last_active":"2023-05-10T01:09:53.762054+0000","last_peered":"2023-05-10T01:09:53.762054+0000","last_clean":"2023-05-10T01:09:53.762054+0000","last_became_active":"2023-05-10T01:09:53.761780+0000","last_became_peered":"2023-05-10T01:09:53.761780+0000","last_unstale":"2023-05-10T01:09:53.762054+0000","last_undegraded":"2023-05-10T01:09:53.762054+0000","last_fullsized":"2023-05-10T01:09:53.762054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.380841+0000","last_change":"2023-05-10T01:09:53.376957+0000","last_active":"2023-05-10T01:09:53.380841+0000","last_peered":"2023-05-10T01:09:53.380841+0000","last_clean":"2023-05-10T01:09:53.380841+0000","last_became_active":"2023-05-10T01:09:53.376671+0000","last_became_peered":"2023-05-10T01:09:53.376671+0000","last_unstale":"2023-05-10T01:09:53.380841+0000","last_undegraded":"2023-05-10T01:09:53.380841+0000","last_fullsized":"2023-05-10T01:09:53.380841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786478+0000","last_change":"2023-05-10T01:09:53.778775+0000","last_active":"2023-05-10T01:09:53.786478+0000","last_peered":"2023-05-10T01:09:53.786478+0000","last_clean":"2023-05-10T01:09:53.786478+0000","last_became_active":"2023-05-10T01:09:53.778466+0000","last_became_peered":"2023-05-10T01:09:53.778466+0000","last_unstale":"2023-05-10T01:09:53.786478+0000","last_undegraded":"2023-05-10T01:09:53.786478+0000","last_fullsized":"2023-05-10T01:09:53.786478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383108+0000","last_change":"2023-05-10T01:09:53.377703+0000","last_active":"2023-05-10T01:09:53.383108+0000","last_peered":"2023-05-10T01:09:53.383108+0000","last_clean":"2023-05-10T01:09:53.383108+0000","last_became_active":"2023-05-10T01:09:53.377326+0000","last_became_peered":"2023-05-10T01:09:53.377326+0000","last_unstale":"2023-05-10T01:09:53.383108+0000","last_undegraded":"2023-05-10T01:09:53.383108+0000","last_fullsized":"2023-05-10T01:09:53.383108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780343+0000","last_change":"2023-05-10T01:09:53.771235+0000","last_active":"2023-05-10T01:09:53.780343+0000","last_peered":"2023-05-10T01:09:53.780343+0000","last_clean":"2023-05-10T01:09:53.780343+0000","last_became_active":"2023-05-10T01:09:53.770851+0000","last_became_peered":"2023-05-10T01:09:53.770851+0000","last_unstale":"2023-05-10T01:09:53.780343+0000","last_undegraded":"2023-05-10T01:09:53.780343+0000","last_fullsized":"2023-05-10T01:09:53.780343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773545+0000","last_change":"2023-05-10T01:09:53.381560+0000","last_active":"2023-05-10T01:09:53.773545+0000","last_peered":"2023-05-10T01:09:53.773545+0000","last_clean":"2023-05-10T01:09:53.773545+0000","last_became_active":"2023-05-10T01:09:53.381233+0000","last_became_peered":"2023-05-10T01:09:53.381233+0000","last_unstale":"2023-05-10T01:09:53.773545+0000","last_undegraded":"2023-05-10T01:09:53.773545+0000","last_fullsized":"2023-05-10T01:09:53.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770806+0000","last_change":"2023-05-10T01:09:53.768979+0000","last_active":"2023-05-10T01:09:53.770806+0000","last_peered":"2023-05-10T01:09:53.770806+0000","last_clean":"2023-05-10T01:09:53.770806+0000","last_became_active":"2023-05-10T01:09:53.768736+0000","last_became_peered":"2023-05-10T01:09:53.768736+0000","last_unstale":"2023-05-10T01:09:53.770806+0000","last_undegraded":"2023-05-10T01:09:53.770806+0000","last_fullsized":"2023-05-10T01:09:53.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759905+0000","last_change":"2023-05-10T01:09:53.380523+0000","last_active":"2023-05-10T01:09:53.759905+0000","last_peered":"2023-05-10T01:09:53.759905+0000","last_clean":"2023-05-10T01:09:53.759905+0000","last_became_active":"2023-05-10T01:09:53.380220+0000","last_became_peered":"2023-05-10T01:09:53.380220+0000","last_unstale":"2023-05-10T01:09:53.759905+0000","last_undegraded":"2023-05-10T01:09:53.759905+0000","last_fullsized":"2023-05-10T01:09:53.759905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774054+0000","last_change":"2023-05-10T01:09:53.774054+0000","last_active":"2023-05-10T01:09:53.774054+0000","last_peered":"2023-05-10T01:09:53.774054+0000","last_clean":"2023-05-10T01:09:53.774054+0000","last_became_active":"2023-05-10T01:09:53.773600+0000","last_became_peered":"2023-05-10T01:09:53.773600+0000","last_unstale":"2023-05-10T01:09:53.774054+0000","last_undegraded":"2023-05-10T01:09:53.774054+0000","last_fullsized":"2023-05-10T01:09:53.774054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769207+0000","last_change":"2023-05-10T01:09:53.387215+0000","last_active":"2023-05-10T01:09:53.769207+0000","last_peered":"2023-05-10T01:09:53.769207+0000","last_clean":"2023-05-10T01:09:53.769207+0000","last_became_active":"2023-05-10T01:09:53.386942+0000","last_became_peered":"2023-05-10T01:09:53.386942+0000","last_unstale":"2023-05-10T01:09:53.769207+0000","last_undegraded":"2023-05-10T01:09:53.769207+0000","last_fullsized":"2023-05-10T01:09:53.769207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789796+0000","last_change":"2023-05-10T01:09:53.775699+0000","last_active":"2023-05-10T01:09:53.789796+0000","last_peered":"2023-05-10T01:09:53.789796+0000","last_clean":"2023-05-10T01:09:53.789796+0000","last_became_active":"2023-05-10T01:09:53.775407+0000","last_became_peered":"2023-05-10T01:09:53.775407+0000","last_unstale":"2023-05-10T01:09:53.789796+0000","last_undegraded":"2023-05-10T01:09:53.789796+0000","last_fullsized":"2023-05-10T01:09:53.789796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759464+0000","last_change":"2023-05-10T01:09:53.387442+0000","last_active":"2023-05-10T01:09:53.759464+0000","last_peered":"2023-05-10T01:09:53.759464+0000","last_clean":"2023-05-10T01:09:53.759464+0000","last_became_active":"2023-05-10T01:09:53.387192+0000","last_became_peered":"2023-05-10T01:09:53.387192+0000","last_unstale":"2023-05-10T01:09:53.759464+0000","last_undegraded":"2023-05-10T01:09:53.759464+0000","last_fullsized":"2023-05-10T01:09:53.759464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776255+0000","last_change":"2023-05-10T01:09:53.776255+0000","last_active":"2023-05-10T01:09:53.776255+0000","last_peered":"2023-05-10T01:09:53.776255+0000","last_clean":"2023-05-10T01:09:53.776255+0000","last_became_active":"2023-05-10T01:09:53.775994+0000","last_became_peered":"2023-05-10T01:09:53.775994+0000","last_unstale":"2023-05-10T01:09:53.776255+0000","last_undegraded":"2023-05-10T01:09:53.776255+0000","last_fullsized":"2023-05-10T01:09:53.776255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786324+0000","last_change":"2023-05-10T01:09:53.381425+0000","last_active":"2023-05-10T01:09:53.786324+0000","last_peered":"2023-05-10T01:09:53.786324+0000","last_clean":"2023-05-10T01:09:53.786324+0000","last_became_active":"2023-05-10T01:09:53.381139+0000","last_became_peered":"2023-05-10T01:09:53.381139+0000","last_unstale":"2023-05-10T01:09:53.786324+0000","last_undegraded":"2023-05-10T01:09:53.786324+0000","last_fullsized":"2023-05-10T01:09:53.786324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763499+0000","last_change":"2023-05-10T01:09:53.763499+0000","last_active":"2023-05-10T01:09:53.763499+0000","last_peered":"2023-05-10T01:09:53.763499+0000","last_clean":"2023-05-10T01:09:53.763499+0000","last_became_active":"2023-05-10T01:09:53.763025+0000","last_became_peered":"2023-05-10T01:09:53.763025+0000","last_unstale":"2023-05-10T01:09:53.763499+0000","last_undegraded":"2023-05-10T01:09:53.763499+0000","last_fullsized":"2023-05-10T01:09:53.763499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775734+0000","last_change":"2023-05-10T01:09:53.379747+0000","last_active":"2023-05-10T01:09:53.775734+0000","last_peered":"2023-05-10T01:09:53.775734+0000","last_clean":"2023-05-10T01:09:53.775734+0000","last_became_active":"2023-05-10T01:09:53.379410+0000","last_became_peered":"2023-05-10T01:09:53.379410+0000","last_unstale":"2023-05-10T01:09:53.775734+0000","last_undegraded":"2023-05-10T01:09:53.775734+0000","last_fullsized":"2023-05-10T01:09:53.775734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789720+0000","last_change":"2023-05-10T01:09:53.782423+0000","last_active":"2023-05-10T01:09:53.789720+0000","last_peered":"2023-05-10T01:09:53.789720+0000","last_clean":"2023-05-10T01:09:53.789720+0000","last_became_active":"2023-05-10T01:09:53.782122+0000","last_became_peered":"2023-05-10T01:09:53.782122+0000","last_unstale":"2023-05-10T01:09:53.789720+0000","last_undegraded":"2023-05-10T01:09:53.789720+0000","last_fullsized":"2023-05-10T01:09:53.789720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385506+0000","last_change":"2023-05-10T01:09:53.377917+0000","last_active":"2023-05-10T01:09:53.385506+0000","last_peered":"2023-05-10T01:09:53.385506+0000","last_clean":"2023-05-10T01:09:53.385506+0000","last_became_active":"2023-05-10T01:09:53.377603+0000","last_became_peered":"2023-05-10T01:09:53.377603+0000","last_unstale":"2023-05-10T01:09:53.385506+0000","last_undegraded":"2023-05-10T01:09:53.385506+0000","last_fullsized":"2023-05-10T01:09:53.385506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786549+0000","last_change":"2023-05-10T01:09:53.779988+0000","last_active":"2023-05-10T01:09:53.786549+0000","last_peered":"2023-05-10T01:09:53.786549+0000","last_clean":"2023-05-10T01:09:53.786549+0000","last_became_active":"2023-05-10T01:09:53.774488+0000","last_became_peered":"2023-05-10T01:09:53.774488+0000","last_unstale":"2023-05-10T01:09:53.786549+0000","last_undegraded":"2023-05-10T01:09:53.786549+0000","last_fullsized":"2023-05-10T01:09:53.786549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375348+0000","last_change":"2023-05-10T01:09:53.370862+0000","last_active":"2023-05-10T01:09:53.375348+0000","last_peered":"2023-05-10T01:09:53.375348+0000","last_clean":"2023-05-10T01:09:53.375348+0000","last_became_active":"2023-05-10T01:09:53.370581+0000","last_became_peered":"2023-05-10T01:09:53.370581+0000","last_unstale":"2023-05-10T01:09:53.375348+0000","last_undegraded":"2023-05-10T01:09:53.375348+0000","last_fullsized":"2023-05-10T01:09:53.375348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775797+0000","last_change":"2023-05-10T01:09:53.775797+0000","last_active":"2023-05-10T01:09:53.775797+0000","last_peered":"2023-05-10T01:09:53.775797+0000","last_clean":"2023-05-10T01:09:53.775797+0000","last_became_active":"2023-05-10T01:09:53.775494+0000","last_became_peered":"2023-05-10T01:09:53.775494+0000","last_unstale":"2023-05-10T01:09:53.775797+0000","last_undegraded":"2023-05-10T01:09:53.775797+0000","last_fullsized":"2023-05-10T01:09:53.775797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789403+0000","last_change":"2023-05-10T01:09:53.382141+0000","last_active":"2023-05-10T01:09:53.789403+0000","last_peered":"2023-05-10T01:09:53.789403+0000","last_clean":"2023-05-10T01:09:53.789403+0000","last_became_active":"2023-05-10T01:09:53.381836+0000","last_became_peered":"2023-05-10T01:09:53.381836+0000","last_unstale":"2023-05-10T01:09:53.789403+0000","last_undegraded":"2023-05-10T01:09:53.789403+0000","last_fullsized":"2023-05-10T01:09:53.789403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":225280,"data_stored":80079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":221184,"data_stored":78723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:09:57.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:09:57.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.933+0000 7f234d116700 1 Processor -- start 2023-05-10T01:09:57.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.933+0000 7f234d116700 1 -- start start 2023-05-10T01:09:57.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f234d116700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f23480c7370 0x7f2348154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f234d116700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2348158960 con 0x7f23480c7750 2023-05-10T01:09:57.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f234d116700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480ad6b0 con 0x7f23480ad250 2023-05-10T01:09:57.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f234d116700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2348155330 con 0x7f23480c7370 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f23477fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f23480c7750 0x7f23480acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39228/0 (socket says 172.21.15.52:39228) 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f23477fe700 1 -- 172.21.15.52:0/3907919050 learned_addr learned my addr 172.21.15.52:0/3907919050 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598184667 0 0) 0x7f2348158960 con 0x7f23480c7750 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2347fff700 1 --2- 172.21.15.52:0/3907919050 >> v2:172.21.15.172:3300/0 conn(0x7f23480c7370 0x7f2348154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23340033f0 con 0x7f23480c7750 2023-05-10T01:09:57.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011154250 0 0) 0x7f23340033f0 con 0x7f23480c7750 2023-05-10T01:09:57.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 >> v2:172.21.15.172:3300/0 conn(0x7f23480c7370 msgr2=0x7f2348154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 --2- 172.21.15.52:0/3907919050 >> v2:172.21.15.172:3300/0 conn(0x7f23480c7370 0x7f2348154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 >> v1:172.21.15.172:6789/0 conn(0x7f23480ad250 legacy=0x7f234814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348157d50 con 0x7f23480c7750 2023-05-10T01:09:57.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f233c001470 con 0x7f23480c7750 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 >> v1:172.21.15.52:6789/0 conn(0x7f23480c7750 legacy=0x7f23480acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.934+0000 7f2346ffd700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23340038e0 0x7f2334003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f2334004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2334005000 0x7f233400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2348155330 con 0x7f2334004690 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233400beb0 con 0x7f2334005000 2023-05-10T01:09:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233400c070 con 0x7f23340038e0 2023-05-10T01:09:57.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f2334004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f234c915700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2334005000 0x7f233400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2347fff700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23340038e0 0x7f2334003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 -- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23340038e0 msgr2=0x7f2334003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23340038e0 0x7f2334003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 -- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2334005000 msgr2=0x7f233400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2334005000 0x7f233400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 -- 172.21.15.52:0/3907919050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340033f0 con 0x7f2334004690 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f234c915700 1 -- 172.21.15.52:0/3907919050 reap_dead start 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f23477fe700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f2334004b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f233c00c190 tx=0x7f233c001e50).ready entity=mon.0 client_cookie=71778334f4b1c8f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c007a20 con 0x7f2334004690 2023-05-10T01:09:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00cac0 con 0x7f2334004690 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.935+0000 7f2346ffd700 1 -- 172.21.15.52:0/3907919050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00ce40 con 0x7f2334004690 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 -- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 msgr2=0x7f2334004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f2334004b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f233c00c190 tx=0x7f233c001e50).stop 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 -- 172.21.15.52:0/3907919050 shutdown_connections 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 --2- 172.21.15.52:0/3907919050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f2334004b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 -- 172.21.15.52:0/3907919050 >> 172.21.15.52:0/3907919050 conn(0x7f2348068320 msgr2=0x7f2348068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 -- 172.21.15.52:0/3907919050 shutdown_connections 2023-05-10T01:09:57.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.936+0000 7f234d116700 1 -- 172.21.15.52:0/3907919050 wait complete. 2023-05-10T01:09:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.937+0000 7f234d116700 1 Processor -- start 2023-05-10T01:09:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.937+0000 7f234d116700 1 -- start start 2023-05-10T01:09:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23480add70 0x7f23480c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 0x7f2348156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c8a70 con 0x7f2334004690 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c8d50 con 0x7f23480c4540 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c9030 con 0x7f23480add70 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58454/0 (socket says 172.21.15.52:58454) 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 -- 172.21.15.52:0/3431938519 learned_addr learned my addr 172.21.15.52:0/3431938519 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:57.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f23477fe700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23480add70 0x7f23480c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234c915700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 0x7f2348156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 -- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23480add70 msgr2=0x7f23480c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23480add70 0x7f23480c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 -- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 msgr2=0x7f2348156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 0x7f2348156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 -- 172.21.15.52:0/3431938519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480c9310 con 0x7f2334004690 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234c915700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 0x7f2348156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:57.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f2347fff700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f23380119f0 tx=0x7f2338009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800f940 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800faa0 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480c1e00 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800fe20 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.938+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23481570f0 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.939+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23480c4920 con 0x7f2334004690 2023-05-10T01:09:57.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.940+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2338024070 con 0x7f2334004690 2023-05-10T01:09:57.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.940+0000 7f232ffff700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 0x7f2328061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:57.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.941+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f233807ac90 con 0x7f2334004690 2023-05-10T01:09:57.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.941+0000 7f23477fe700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 0x7f2328061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:57.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.941+0000 7f23477fe700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 0x7f2328061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f23480b0cb0 tx=0x7f233c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:57.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:57.944+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f233804c2b0 con 0x7f2334004690 2023-05-10T01:09:58.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.113+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23480c8bb0 con 0x7f232805ed90 2023-05-10T01:09:58.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.123+0000 7f232ffff700 1 -- 172.21.15.52:0/3431938519 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336378 (secure 0 0 0) 0x7f23480c8bb0 con 0x7f232805ed90 2023-05-10T01:09:58.132 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 msgr2=0x7f2328061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 0x7f2328061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f23480b0cb0 tx=0x7f233c015000).stop 2023-05-10T01:09:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 msgr2=0x7f23480c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f23380119f0 tx=0x7f2338009060).stop 2023-05-10T01:09:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 shutdown_connections 2023-05-10T01:09:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f232805ed90 0x7f2328061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23480c4540 0x7f2348156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334004690 0x7f23480c2710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 --2- 172.21.15.52:0/3431938519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23480add70 0x7f23480c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 >> 172.21.15.52:0/3431938519 conn(0x7f2348068320 msgr2=0x7f2348152010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 shutdown_connections 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.126+0000 7f234d116700 1 -- 172.21.15.52:0/3431938519 wait complete. 2023-05-10T01:09:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:09:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:09:56.441131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41604,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":39744,"kb_avail":754933116,"statfs":{"total":773094113280,"available":773051510784,"internally_reserved":0,"allocated":1839104,"data_stored":653788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40697856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769639+0000","last_change":"2023-05-10T01:09:53.767516+0000","last_active":"2023-05-10T01:09:53.769639+0000","last_peered":"2023-05-10T01:09:53.769639+0000","last_clean":"2023-05-10T01:09:53.769639+0000","last_became_active":"2023-05-10T01:09:53.767220+0000","last_became_peered":"2023-05-10T01:09:53.767220+0000","last_unstale":"2023-05-10T01:09:53.769639+0000","last_undegraded":"2023-05-10T01:09:53.769639+0000","last_fullsized":"2023-05-10T01:09:53.769639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765712+0000","last_change":"2023-05-10T01:09:53.376660+0000","last_active":"2023-05-10T01:09:53.765712+0000","last_peered":"2023-05-10T01:09:53.765712+0000","last_clean":"2023-05-10T01:09:53.765712+0000","last_became_active":"2023-05-10T01:09:53.372795+0000","last_became_peered":"2023-05-10T01:09:53.372795+0000","last_unstale":"2023-05-10T01:09:53.765712+0000","last_undegraded":"2023-05-10T01:09:53.765712+0000","last_fullsized":"2023-05-10T01:09:53.765712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777846+0000","last_change":"2023-05-10T01:09:53.777846+0000","last_active":"2023-05-10T01:09:53.777846+0000","last_peered":"2023-05-10T01:09:53.777846+0000","last_clean":"2023-05-10T01:09:53.777846+0000","last_became_active":"2023-05-10T01:09:53.777351+0000","last_became_peered":"2023-05-10T01:09:53.777351+0000","last_unstale":"2023-05-10T01:09:53.777846+0000","last_undegraded":"2023-05-10T01:09:53.777846+0000","last_fullsized":"2023-05-10T01:09:53.777846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375957+0000","last_change":"2023-05-10T01:09:53.372546+0000","last_active":"2023-05-10T01:09:53.375957+0000","last_peered":"2023-05-10T01:09:53.375957+0000","last_clean":"2023-05-10T01:09:53.375957+0000","last_became_active":"2023-05-10T01:09:53.371853+0000","last_became_peered":"2023-05-10T01:09:53.371853+0000","last_unstale":"2023-05-10T01:09:53.375957+0000","last_undegraded":"2023-05-10T01:09:53.375957+0000","last_fullsized":"2023-05-10T01:09:53.375957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776453+0000","last_change":"2023-05-10T01:09:53.776453+0000","last_active":"2023-05-10T01:09:53.776453+0000","last_peered":"2023-05-10T01:09:53.776453+0000","last_clean":"2023-05-10T01:09:53.776453+0000","last_became_active":"2023-05-10T01:09:53.776189+0000","last_became_peered":"2023-05-10T01:09:53.776189+0000","last_unstale":"2023-05-10T01:09:53.776453+0000","last_undegraded":"2023-05-10T01:09:53.776453+0000","last_fullsized":"2023-05-10T01:09:53.776453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759545+0000","last_change":"2023-05-10T01:09:53.376261+0000","last_active":"2023-05-10T01:09:53.759545+0000","last_peered":"2023-05-10T01:09:53.759545+0000","last_clean":"2023-05-10T01:09:53.759545+0000","last_became_active":"2023-05-10T01:09:53.375962+0000","last_became_peered":"2023-05-10T01:09:53.375962+0000","last_unstale":"2023-05-10T01:09:53.759545+0000","last_undegraded":"2023-05-10T01:09:53.759545+0000","last_fullsized":"2023-05-10T01:09:53.759545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769197+0000","last_change":"2023-05-10T01:09:53.766314+0000","last_active":"2023-05-10T01:09:53.769197+0000","last_peered":"2023-05-10T01:09:53.769197+0000","last_clean":"2023-05-10T01:09:53.769197+0000","last_became_active":"2023-05-10T01:09:53.766024+0000","last_became_peered":"2023-05-10T01:09:53.766024+0000","last_unstale":"2023-05-10T01:09:53.769197+0000","last_undegraded":"2023-05-10T01:09:53.769197+0000","last_fullsized":"2023-05-10T01:09:53.769197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385510+0000","last_change":"2023-05-10T01:09:53.381301+0000","last_active":"2023-05-10T01:09:53.385510+0000","last_peered":"2023-05-10T01:09:53.385510+0000","last_clean":"2023-05-10T01:09:53.385510+0000","last_became_active":"2023-05-10T01:09:53.379989+0000","last_became_peered":"2023-05-10T01:09:53.379989+0000","last_unstale":"2023-05-10T01:09:53.385510+0000","last_undegraded":"2023-05-10T01:09:53.385510+0000","last_fullsized":"2023-05-10T01:09:53.385510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778357+0000","last_change":"2023-05-10T01:09:53.777145+0000","last_active":"2023-05-10T01:09:53.778357+0000","last_peered":"2023-05-10T01:09:53.778357+0000","last_clean":"2023-05-10T01:09:53.778357+0000","last_became_active":"2023-05-10T01:09:53.776943+0000","last_became_peered":"2023-05-10T01:09:53.776943+0000","last_unstale":"2023-05-10T01:09:53.778357+0000","last_undegraded":"2023-05-10T01:09:53.778357+0000","last_fullsized":"2023-05-10T01:09:53.778357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383894+0000","last_change":"2023-05-10T01:09:53.378829+0000","last_active":"2023-05-10T01:09:53.383894+0000","last_peered":"2023-05-10T01:09:53.383894+0000","last_clean":"2023-05-10T01:09:53.383894+0000","last_became_active":"2023-05-10T01:09:53.378313+0000","last_became_peered":"2023-05-10T01:09:53.378313+0000","last_unstale":"2023-05-10T01:09:53.383894+0000","last_undegraded":"2023-05-10T01:09:53.383894+0000","last_fullsized":"2023-05-10T01:09:53.383894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773149+0000","last_change":"2023-05-10T01:09:53.773149+0000","last_active":"2023-05-10T01:09:53.773149+0000","last_peered":"2023-05-10T01:09:53.773149+0000","last_clean":"2023-05-10T01:09:53.773149+0000","last_became_active":"2023-05-10T01:09:53.772854+0000","last_became_peered":"2023-05-10T01:09:53.772854+0000","last_unstale":"2023-05-10T01:09:53.773149+0000","last_undegraded":"2023-05-10T01:09:53.773149+0000","last_fullsized":"2023-05-10T01:09:53.773149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790150+0000","last_change":"2023-05-10T01:09:53.383052+0000","last_active":"2023-05-10T01:09:53.790150+0000","last_peered":"2023-05-10T01:09:53.790150+0000","last_clean":"2023-05-10T01:09:53.790150+0000","last_became_active":"2023-05-10T01:09:53.382049+0000","last_became_peered":"2023-05-10T01:09:53.382049+0000","last_unstale":"2023-05-10T01:09:53.790150+0000","last_undegraded":"2023-05-10T01:09:53.790150+0000","last_fullsized":"2023-05-10T01:09:53.790150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789769+0000","last_change":"2023-05-10T01:09:53.780945+0000","last_active":"2023-05-10T01:09:53.789769+0000","last_peered":"2023-05-10T01:09:53.789769+0000","last_clean":"2023-05-10T01:09:53.789769+0000","last_became_active":"2023-05-10T01:09:53.780672+0000","last_became_peered":"2023-05-10T01:09:53.780672+0000","last_unstale":"2023-05-10T01:09:53.789769+0000","last_undegraded":"2023-05-10T01:09:53.789769+0000","last_fullsized":"2023-05-10T01:09:53.789769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786797+0000","last_change":"2023-05-10T01:09:53.378586+0000","last_active":"2023-05-10T01:09:53.786797+0000","last_peered":"2023-05-10T01:09:53.786797+0000","last_clean":"2023-05-10T01:09:53.786797+0000","last_became_active":"2023-05-10T01:09:53.378325+0000","last_became_peered":"2023-05-10T01:09:53.378325+0000","last_unstale":"2023-05-10T01:09:53.786797+0000","last_undegraded":"2023-05-10T01:09:53.786797+0000","last_fullsized":"2023-05-10T01:09:53.786797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769057+0000","last_change":"2023-05-10T01:09:53.763888+0000","last_active":"2023-05-10T01:09:53.769057+0000","last_peered":"2023-05-10T01:09:53.769057+0000","last_clean":"2023-05-10T01:09:53.769057+0000","last_became_active":"2023-05-10T01:09:53.763608+0000","last_became_peered":"2023-05-10T01:09:53.763608+0000","last_unstale":"2023-05-10T01:09:53.769057+0000","last_undegraded":"2023-05-10T01:09:53.769057+0000","last_fullsized":"2023-05-10T01:09:53.769057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789861+0000","last_change":"2023-05-10T01:09:53.384560+0000","last_active":"2023-05-10T01:09:53.789861+0000","last_peered":"2023-05-10T01:09:53.789861+0000","last_clean":"2023-05-10T01:09:53.789861+0000","last_became_active":"2023-05-10T01:09:53.384235+0000","last_became_peered":"2023-05-10T01:09:53.384235+0000","last_unstale":"2023-05-10T01:09:53.789861+0000","last_undegraded":"2023-05-10T01:09:53.789861+0000","last_fullsized":"2023-05-10T01:09:53.789861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785094+0000","last_change":"2023-05-10T01:09:53.785094+0000","last_active":"2023-05-10T01:09:53.785094+0000","last_peered":"2023-05-10T01:09:53.785094+0000","last_clean":"2023-05-10T01:09:53.785094+0000","last_became_active":"2023-05-10T01:09:53.784831+0000","last_became_peered":"2023-05-10T01:09:53.784831+0000","last_unstale":"2023-05-10T01:09:53.785094+0000","last_undegraded":"2023-05-10T01:09:53.785094+0000","last_fullsized":"2023-05-10T01:09:53.785094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385767+0000","last_change":"2023-05-10T01:09:53.378680+0000","last_active":"2023-05-10T01:09:53.385767+0000","last_peered":"2023-05-10T01:09:53.385767+0000","last_clean":"2023-05-10T01:09:53.385767+0000","last_became_active":"2023-05-10T01:09:53.378257+0000","last_became_peered":"2023-05-10T01:09:53.378257+0000","last_unstale":"2023-05-10T01:09:53.385767+0000","last_undegraded":"2023-05-10T01:09:53.385767+0000","last_fullsized":"2023-05-10T01:09:53.385767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.766892+0000","last_change":"2023-05-10T01:09:53.766892+0000","last_active":"2023-05-10T01:09:53.766892+0000","last_peered":"2023-05-10T01:09:53.766892+0000","last_clean":"2023-05-10T01:09:53.766892+0000","last_became_active":"2023-05-10T01:09:53.766517+0000","last_became_peered":"2023-05-10T01:09:53.766517+0000","last_unstale":"2023-05-10T01:09:53.766892+0000","last_undegraded":"2023-05-10T01:09:53.766892+0000","last_fullsized":"2023-05-10T01:09:53.766892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769106+0000","last_change":"2023-05-10T01:09:53.384108+0000","last_active":"2023-05-10T01:09:53.769106+0000","last_peered":"2023-05-10T01:09:53.769106+0000","last_clean":"2023-05-10T01:09:53.769106+0000","last_became_active":"2023-05-10T01:09:53.383818+0000","last_became_peered":"2023-05-10T01:09:53.383818+0000","last_unstale":"2023-05-10T01:09:53.769106+0000","last_undegraded":"2023-05-10T01:09:53.769106+0000","last_fullsized":"2023-05-10T01:09:53.769106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783021+0000","last_change":"2023-05-10T01:09:53.782485+0000","last_active":"2023-05-10T01:09:53.783021+0000","last_peered":"2023-05-10T01:09:53.783021+0000","last_clean":"2023-05-10T01:09:53.783021+0000","last_became_active":"2023-05-10T01:09:53.782201+0000","last_became_peered":"2023-05-10T01:09:53.782201+0000","last_unstale":"2023-05-10T01:09:53.783021+0000","last_undegraded":"2023-05-10T01:09:53.783021+0000","last_fullsized":"2023-05-10T01:09:53.783021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778623+0000","last_change":"2023-05-10T01:09:53.387304+0000","last_active":"2023-05-10T01:09:53.778623+0000","last_peered":"2023-05-10T01:09:53.778623+0000","last_clean":"2023-05-10T01:09:53.778623+0000","last_became_active":"2023-05-10T01:09:53.386981+0000","last_became_peered":"2023-05-10T01:09:53.386981+0000","last_unstale":"2023-05-10T01:09:53.778623+0000","last_undegraded":"2023-05-10T01:09:53.778623+0000","last_fullsized":"2023-05-10T01:09:53.778623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775155+0000","last_change":"2023-05-10T01:09:53.775155+0000","last_active":"2023-05-10T01:09:53.775155+0000","last_peered":"2023-05-10T01:09:53.775155+0000","last_clean":"2023-05-10T01:09:53.775155+0000","last_became_active":"2023-05-10T01:09:53.774869+0000","last_became_peered":"2023-05-10T01:09:53.774869+0000","last_unstale":"2023-05-10T01:09:53.775155+0000","last_undegraded":"2023-05-10T01:09:53.775155+0000","last_fullsized":"2023-05-10T01:09:53.775155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789992+0000","last_change":"2023-05-10T01:09:53.383948+0000","last_active":"2023-05-10T01:09:53.789992+0000","last_peered":"2023-05-10T01:09:53.789992+0000","last_clean":"2023-05-10T01:09:53.789992+0000","last_became_active":"2023-05-10T01:09:53.383677+0000","last_became_peered":"2023-05-10T01:09:53.383677+0000","last_unstale":"2023-05-10T01:09:53.789992+0000","last_undegraded":"2023-05-10T01:09:53.789992+0000","last_fullsized":"2023-05-10T01:09:53.789992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789396+0000","last_change":"2023-05-10T01:09:53.779430+0000","last_active":"2023-05-10T01:09:53.789396+0000","last_peered":"2023-05-10T01:09:53.789396+0000","last_clean":"2023-05-10T01:09:53.789396+0000","last_became_active":"2023-05-10T01:09:53.777122+0000","last_became_peered":"2023-05-10T01:09:53.777122+0000","last_unstale":"2023-05-10T01:09:53.789396+0000","last_undegraded":"2023-05-10T01:09:53.789396+0000","last_fullsized":"2023-05-10T01:09:53.789396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789835+0000","last_change":"2023-05-10T01:09:53.384697+0000","last_active":"2023-05-10T01:09:53.789835+0000","last_peered":"2023-05-10T01:09:53.789835+0000","last_clean":"2023-05-10T01:09:53.789835+0000","last_became_active":"2023-05-10T01:09:53.383952+0000","last_became_peered":"2023-05-10T01:09:53.383952+0000","last_unstale":"2023-05-10T01:09:53.789835+0000","last_undegraded":"2023-05-10T01:09:53.789835+0000","last_fullsized":"2023-05-10T01:09:53.789835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770299+0000","last_change":"2023-05-10T01:09:53.770299+0000","last_active":"2023-05-10T01:09:53.770299+0000","last_peered":"2023-05-10T01:09:53.770299+0000","last_clean":"2023-05-10T01:09:53.770299+0000","last_became_active":"2023-05-10T01:09:53.770016+0000","last_became_peered":"2023-05-10T01:09:53.770016+0000","last_unstale":"2023-05-10T01:09:53.770299+0000","last_undegraded":"2023-05-10T01:09:53.770299+0000","last_fullsized":"2023-05-10T01:09:53.770299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774485+0000","last_change":"2023-05-10T01:09:53.383206+0000","last_active":"2023-05-10T01:09:53.774485+0000","last_peered":"2023-05-10T01:09:53.774485+0000","last_clean":"2023-05-10T01:09:53.774485+0000","last_became_active":"2023-05-10T01:09:53.382411+0000","last_became_peered":"2023-05-10T01:09:53.382411+0000","last_unstale":"2023-05-10T01:09:53.774485+0000","last_undegraded":"2023-05-10T01:09:53.774485+0000","last_fullsized":"2023-05-10T01:09:53.774485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763306+0000","last_change":"2023-05-10T01:09:53.763306+0000","last_active":"2023-05-10T01:09:53.763306+0000","last_peered":"2023-05-10T01:09:53.763306+0000","last_clean":"2023-05-10T01:09:53.763306+0000","last_became_active":"2023-05-10T01:09:53.762635+0000","last_became_peered":"2023-05-10T01:09:53.762635+0000","last_unstale":"2023-05-10T01:09:53.763306+0000","last_undegraded":"2023-05-10T01:09:53.763306+0000","last_fullsized":"2023-05-10T01:09:53.763306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384381+0000","last_change":"2023-05-10T01:09:53.377895+0000","last_active":"2023-05-10T01:09:53.384381+0000","last_peered":"2023-05-10T01:09:53.384381+0000","last_clean":"2023-05-10T01:09:53.384381+0000","last_became_active":"2023-05-10T01:09:53.377611+0000","last_became_peered":"2023-05-10T01:09:53.377611+0000","last_unstale":"2023-05-10T01:09:53.384381+0000","last_undegraded":"2023-05-10T01:09:53.384381+0000","last_fullsized":"2023-05-10T01:09:53.384381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777256+0000","last_change":"2023-05-10T01:09:53.770032+0000","last_active":"2023-05-10T01:09:53.777256+0000","last_peered":"2023-05-10T01:09:53.777256+0000","last_clean":"2023-05-10T01:09:53.777256+0000","last_became_active":"2023-05-10T01:09:53.769759+0000","last_became_peered":"2023-05-10T01:09:53.769759+0000","last_unstale":"2023-05-10T01:09:53.777256+0000","last_undegraded":"2023-05-10T01:09:53.777256+0000","last_fullsized":"2023-05-10T01:09:53.777256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775799+0000","last_change":"2023-05-10T01:09:53.384429+0000","last_active":"2023-05-10T01:09:53.775799+0000","last_peered":"2023-05-10T01:09:53.775799+0000","last_clean":"2023-05-10T01:09:53.775799+0000","last_became_active":"2023-05-10T01:09:53.384089+0000","last_became_peered":"2023-05-10T01:09:53.384089+0000","last_unstale":"2023-05-10T01:09:53.775799+0000","last_undegraded":"2023-05-10T01:09:53.775799+0000","last_fullsized":"2023-05-10T01:09:53.775799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786438+0000","last_change":"2023-05-10T01:09:53.775201+0000","last_active":"2023-05-10T01:09:53.786438+0000","last_peered":"2023-05-10T01:09:53.786438+0000","last_clean":"2023-05-10T01:09:53.786438+0000","last_became_active":"2023-05-10T01:09:53.774881+0000","last_became_peered":"2023-05-10T01:09:53.774881+0000","last_unstale":"2023-05-10T01:09:53.786438+0000","last_undegraded":"2023-05-10T01:09:53.786438+0000","last_fullsized":"2023-05-10T01:09:53.786438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.389013+0000","last_change":"2023-05-10T01:09:53.383296+0000","last_active":"2023-05-10T01:09:53.389013+0000","last_peered":"2023-05-10T01:09:53.389013+0000","last_clean":"2023-05-10T01:09:53.389013+0000","last_became_active":"2023-05-10T01:09:53.383024+0000","last_became_peered":"2023-05-10T01:09:53.383024+0000","last_unstale":"2023-05-10T01:09:53.389013+0000","last_undegraded":"2023-05-10T01:09:53.389013+0000","last_fullsized":"2023-05-10T01:09:53.389013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789564+0000","last_change":"2023-05-10T01:09:53.781034+0000","last_active":"2023-05-10T01:09:53.789564+0000","last_peered":"2023-05-10T01:09:53.789564+0000","last_clean":"2023-05-10T01:09:53.789564+0000","last_became_active":"2023-05-10T01:09:53.780772+0000","last_became_peered":"2023-05-10T01:09:53.780772+0000","last_unstale":"2023-05-10T01:09:53.789564+0000","last_undegraded":"2023-05-10T01:09:53.789564+0000","last_fullsized":"2023-05-10T01:09:53.789564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764711+0000","last_change":"2023-05-10T01:09:53.375634+0000","last_active":"2023-05-10T01:09:53.764711+0000","last_peered":"2023-05-10T01:09:53.764711+0000","last_clean":"2023-05-10T01:09:53.764711+0000","last_became_active":"2023-05-10T01:09:53.374842+0000","last_became_peered":"2023-05-10T01:09:53.374842+0000","last_unstale":"2023-05-10T01:09:53.764711+0000","last_undegraded":"2023-05-10T01:09:53.764711+0000","last_fullsized":"2023-05-10T01:09:53.764711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764990+0000","last_change":"2023-05-10T01:09:53.764990+0000","last_active":"2023-05-10T01:09:53.764990+0000","last_peered":"2023-05-10T01:09:53.764990+0000","last_clean":"2023-05-10T01:09:53.764990+0000","last_became_active":"2023-05-10T01:09:53.764708+0000","last_became_peered":"2023-05-10T01:09:53.764708+0000","last_unstale":"2023-05-10T01:09:53.764990+0000","last_undegraded":"2023-05-10T01:09:53.764990+0000","last_fullsized":"2023-05-10T01:09:53.764990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759860+0000","last_change":"2023-05-10T01:09:53.373817+0000","last_active":"2023-05-10T01:09:53.759860+0000","last_peered":"2023-05-10T01:09:53.759860+0000","last_clean":"2023-05-10T01:09:53.759860+0000","last_became_active":"2023-05-10T01:09:53.372121+0000","last_became_peered":"2023-05-10T01:09:53.372121+0000","last_unstale":"2023-05-10T01:09:53.759860+0000","last_undegraded":"2023-05-10T01:09:53.759860+0000","last_fullsized":"2023-05-10T01:09:53.759860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.358197+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:09:53.358197+0000","last_peered":"2023-05-10T01:09:53.358197+0000","last_clean":"2023-05-10T01:09:53.358197+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:09:53.358197+0000","last_undegraded":"2023-05-10T01:09:53.358197+0000","last_fullsized":"2023-05-10T01:09:53.358197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383732+0000","last_change":"2023-05-10T01:09:53.378846+0000","last_active":"2023-05-10T01:09:53.383732+0000","last_peered":"2023-05-10T01:09:53.383732+0000","last_clean":"2023-05-10T01:09:53.383732+0000","last_became_active":"2023-05-10T01:09:53.378439+0000","last_became_peered":"2023-05-10T01:09:53.378439+0000","last_unstale":"2023-05-10T01:09:53.383732+0000","last_undegraded":"2023-05-10T01:09:53.383732+0000","last_fullsized":"2023-05-10T01:09:53.383732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.772154+0000","last_change":"2023-05-10T01:09:53.772154+0000","last_active":"2023-05-10T01:09:53.772154+0000","last_peered":"2023-05-10T01:09:53.772154+0000","last_clean":"2023-05-10T01:09:53.772154+0000","last_became_active":"2023-05-10T01:09:53.771765+0000","last_became_peered":"2023-05-10T01:09:53.771765+0000","last_unstale":"2023-05-10T01:09:53.772154+0000","last_undegraded":"2023-05-10T01:09:53.772154+0000","last_fullsized":"2023-05-10T01:09:53.772154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.369033+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:09:53.369033+0000","last_peered":"2023-05-10T01:09:53.369033+0000","last_clean":"2023-05-10T01:09:53.369033+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:09:53.369033+0000","last_undegraded":"2023-05-10T01:09:53.369033+0000","last_fullsized":"2023-05-10T01:09:53.369033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768154+0000","last_change":"2023-05-10T01:09:53.383796+0000","last_active":"2023-05-10T01:09:53.768154+0000","last_peered":"2023-05-10T01:09:53.768154+0000","last_clean":"2023-05-10T01:09:53.768154+0000","last_became_active":"2023-05-10T01:09:53.383330+0000","last_became_peered":"2023-05-10T01:09:53.383330+0000","last_unstale":"2023-05-10T01:09:53.768154+0000","last_undegraded":"2023-05-10T01:09:53.768154+0000","last_fullsized":"2023-05-10T01:09:53.768154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763322+0000","last_change":"2023-05-10T01:09:53.763322+0000","last_active":"2023-05-10T01:09:53.763322+0000","last_peered":"2023-05-10T01:09:53.763322+0000","last_clean":"2023-05-10T01:09:53.763322+0000","last_became_active":"2023-05-10T01:09:53.762534+0000","last_became_peered":"2023-05-10T01:09:53.762534+0000","last_unstale":"2023-05-10T01:09:53.763322+0000","last_undegraded":"2023-05-10T01:09:53.763322+0000","last_fullsized":"2023-05-10T01:09:53.763322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774245+0000","last_change":"2023-05-10T01:09:53.774245+0000","last_active":"2023-05-10T01:09:53.774245+0000","last_peered":"2023-05-10T01:09:53.774245+0000","last_clean":"2023-05-10T01:09:53.774245+0000","last_became_active":"2023-05-10T01:09:53.773997+0000","last_became_peered":"2023-05-10T01:09:53.773997+0000","last_unstale":"2023-05-10T01:09:53.774245+0000","last_undegraded":"2023-05-10T01:09:53.774245+0000","last_fullsized":"2023-05-10T01:09:53.774245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757100+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:09:53.757100+0000","last_peered":"2023-05-10T01:09:53.757100+0000","last_clean":"2023-05-10T01:09:53.757100+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:09:53.757100+0000","last_undegraded":"2023-05-10T01:09:53.757100+0000","last_fullsized":"2023-05-10T01:09:53.757100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375235+0000","last_change":"2023-05-10T01:09:53.368527+0000","last_active":"2023-05-10T01:09:53.375235+0000","last_peered":"2023-05-10T01:09:53.375235+0000","last_clean":"2023-05-10T01:09:53.375235+0000","last_became_active":"2023-05-10T01:09:53.368195+0000","last_became_peered":"2023-05-10T01:09:53.368195+0000","last_unstale":"2023-05-10T01:09:53.375235+0000","last_undegraded":"2023-05-10T01:09:53.375235+0000","last_fullsized":"2023-05-10T01:09:53.375235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.784150+0000","last_change":"2023-05-10T01:09:53.784150+0000","last_active":"2023-05-10T01:09:53.784150+0000","last_peered":"2023-05-10T01:09:53.784150+0000","last_clean":"2023-05-10T01:09:53.784150+0000","last_became_active":"2023-05-10T01:09:53.783843+0000","last_became_peered":"2023-05-10T01:09:53.783843+0000","last_unstale":"2023-05-10T01:09:53.784150+0000","last_undegraded":"2023-05-10T01:09:53.784150+0000","last_fullsized":"2023-05-10T01:09:53.784150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.365479+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:09:53.365479+0000","last_peered":"2023-05-10T01:09:53.365479+0000","last_clean":"2023-05-10T01:09:53.365479+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:09:53.365479+0000","last_undegraded":"2023-05-10T01:09:53.365479+0000","last_fullsized":"2023-05-10T01:09:53.365479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767625+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:09:53.767625+0000","last_peered":"2023-05-10T01:09:53.767625+0000","last_clean":"2023-05-10T01:09:53.767625+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:09:53.767625+0000","last_undegraded":"2023-05-10T01:09:53.767625+0000","last_fullsized":"2023-05-10T01:09:53.767625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758658+0000","last_change":"2023-05-10T01:09:53.380660+0000","last_active":"2023-05-10T01:09:53.758658+0000","last_peered":"2023-05-10T01:09:53.758658+0000","last_clean":"2023-05-10T01:09:53.758658+0000","last_became_active":"2023-05-10T01:09:53.380145+0000","last_became_peered":"2023-05-10T01:09:53.380145+0000","last_unstale":"2023-05-10T01:09:53.758658+0000","last_undegraded":"2023-05-10T01:09:53.758658+0000","last_fullsized":"2023-05-10T01:09:53.758658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762417+0000","last_change":"2023-05-10T01:09:53.762417+0000","last_active":"2023-05-10T01:09:53.762417+0000","last_peered":"2023-05-10T01:09:53.762417+0000","last_clean":"2023-05-10T01:09:53.762417+0000","last_became_active":"2023-05-10T01:09:53.762170+0000","last_became_peered":"2023-05-10T01:09:53.762170+0000","last_unstale":"2023-05-10T01:09:53.762417+0000","last_undegraded":"2023-05-10T01:09:53.762417+0000","last_fullsized":"2023-05-10T01:09:53.762417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768307+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:09:53.768307+0000","last_peered":"2023-05-10T01:09:53.768307+0000","last_clean":"2023-05-10T01:09:53.768307+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:09:53.768307+0000","last_undegraded":"2023-05-10T01:09:53.768307+0000","last_fullsized":"2023-05-10T01:09:53.768307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385410+0000","last_change":"2023-05-10T01:09:53.379906+0000","last_active":"2023-05-10T01:09:53.385410+0000","last_peered":"2023-05-10T01:09:53.385410+0000","last_clean":"2023-05-10T01:09:53.385410+0000","last_became_active":"2023-05-10T01:09:53.379573+0000","last_became_peered":"2023-05-10T01:09:53.379573+0000","last_unstale":"2023-05-10T01:09:53.385410+0000","last_undegraded":"2023-05-10T01:09:53.385410+0000","last_fullsized":"2023-05-10T01:09:53.385410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774378+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:09:53.774378+0000","last_peered":"2023-05-10T01:09:53.774378+0000","last_clean":"2023-05-10T01:09:53.774378+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:09:53.774378+0000","last_undegraded":"2023-05-10T01:09:53.774378+0000","last_fullsized":"2023-05-10T01:09:53.774378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375319+0000","last_change":"2023-05-10T01:09:53.370231+0000","last_active":"2023-05-10T01:09:53.375319+0000","last_peered":"2023-05-10T01:09:53.375319+0000","last_clean":"2023-05-10T01:09:53.375319+0000","last_became_active":"2023-05-10T01:09:53.369689+0000","last_became_peered":"2023-05-10T01:09:53.369689+0000","last_unstale":"2023-05-10T01:09:53.375319+0000","last_undegraded":"2023-05-10T01:09:53.375319+0000","last_fullsized":"2023-05-10T01:09:53.375319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.761010+0000","last_change":"2023-05-10T01:09:53.761010+0000","last_active":"2023-05-10T01:09:53.761010+0000","last_peered":"2023-05-10T01:09:53.761010+0000","last_clean":"2023-05-10T01:09:53.761010+0000","last_became_active":"2023-05-10T01:09:53.760729+0000","last_became_peered":"2023-05-10T01:09:53.760729+0000","last_unstale":"2023-05-10T01:09:53.761010+0000","last_undegraded":"2023-05-10T01:09:53.761010+0000","last_fullsized":"2023-05-10T01:09:53.761010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789343+0000","last_change":"2023-05-10T01:09:53.378347+0000","last_active":"2023-05-10T01:09:53.789343+0000","last_peered":"2023-05-10T01:09:53.789343+0000","last_clean":"2023-05-10T01:09:53.789343+0000","last_became_active":"2023-05-10T01:09:53.378066+0000","last_became_peered":"2023-05-10T01:09:53.378066+0000","last_unstale":"2023-05-10T01:09:53.789343+0000","last_undegraded":"2023-05-10T01:09:53.789343+0000","last_fullsized":"2023-05-10T01:09:53.789343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.358520+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:09:53.358520+0000","last_peered":"2023-05-10T01:09:53.358520+0000","last_clean":"2023-05-10T01:09:53.358520+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:09:53.358520+0000","last_undegraded":"2023-05-10T01:09:53.358520+0000","last_fullsized":"2023-05-10T01:09:53.358520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778283+0000","last_change":"2023-05-10T01:09:53.777244+0000","last_active":"2023-05-10T01:09:53.778283+0000","last_peered":"2023-05-10T01:09:53.778283+0000","last_clean":"2023-05-10T01:09:53.778283+0000","last_became_active":"2023-05-10T01:09:53.776901+0000","last_became_peered":"2023-05-10T01:09:53.776901+0000","last_unstale":"2023-05-10T01:09:53.778283+0000","last_undegraded":"2023-05-10T01:09:53.778283+0000","last_fullsized":"2023-05-10T01:09:53.778283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375482+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:09:53.375482+0000","last_peered":"2023-05-10T01:09:53.375482+0000","last_clean":"2023-05-10T01:09:53.375482+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:09:53.375482+0000","last_undegraded":"2023-05-10T01:09:53.375482+0000","last_fullsized":"2023-05-10T01:09:53.375482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385420+0000","last_change":"2023-05-10T01:09:53.379978+0000","last_active":"2023-05-10T01:09:53.385420+0000","last_peered":"2023-05-10T01:09:53.385420+0000","last_clean":"2023-05-10T01:09:53.385420+0000","last_became_active":"2023-05-10T01:09:53.378931+0000","last_became_peered":"2023-05-10T01:09:53.378931+0000","last_unstale":"2023-05-10T01:09:53.385420+0000","last_undegraded":"2023-05-10T01:09:53.385420+0000","last_fullsized":"2023-05-10T01:09:53.385420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789667+0000","last_change":"2023-05-10T01:09:53.781546+0000","last_active":"2023-05-10T01:09:53.789667+0000","last_peered":"2023-05-10T01:09:53.789667+0000","last_clean":"2023-05-10T01:09:53.789667+0000","last_became_active":"2023-05-10T01:09:53.781279+0000","last_became_peered":"2023-05-10T01:09:53.781279+0000","last_unstale":"2023-05-10T01:09:53.789667+0000","last_undegraded":"2023-05-10T01:09:53.789667+0000","last_fullsized":"2023-05-10T01:09:53.789667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769108+0000","last_change":"2023-05-10T01:09:53.765537+0000","last_active":"2023-05-10T01:09:53.769108+0000","last_peered":"2023-05-10T01:09:53.769108+0000","last_clean":"2023-05-10T01:09:53.769108+0000","last_became_active":"2023-05-10T01:09:53.765301+0000","last_became_peered":"2023-05-10T01:09:53.765301+0000","last_unstale":"2023-05-10T01:09:53.769108+0000","last_undegraded":"2023-05-10T01:09:53.769108+0000","last_fullsized":"2023-05-10T01:09:53.769108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385567+0000","last_change":"2023-05-10T01:09:53.383241+0000","last_active":"2023-05-10T01:09:53.385567+0000","last_peered":"2023-05-10T01:09:53.385567+0000","last_clean":"2023-05-10T01:09:53.385567+0000","last_became_active":"2023-05-10T01:09:53.382496+0000","last_became_peered":"2023-05-10T01:09:53.382496+0000","last_unstale":"2023-05-10T01:09:53.385567+0000","last_undegraded":"2023-05-10T01:09:53.385567+0000","last_fullsized":"2023-05-10T01:09:53.385567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780316+0000","last_change":"2023-05-10T01:09:53.770592+0000","last_active":"2023-05-10T01:09:53.780316+0000","last_peered":"2023-05-10T01:09:53.780316+0000","last_clean":"2023-05-10T01:09:53.780316+0000","last_became_active":"2023-05-10T01:09:53.770330+0000","last_became_peered":"2023-05-10T01:09:53.770330+0000","last_unstale":"2023-05-10T01:09:53.780316+0000","last_undegraded":"2023-05-10T01:09:53.780316+0000","last_fullsized":"2023-05-10T01:09:53.780316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.392017+0000","last_change":"2023-05-10T01:09:53.383384+0000","last_active":"2023-05-10T01:09:53.392017+0000","last_peered":"2023-05-10T01:09:53.392017+0000","last_clean":"2023-05-10T01:09:53.392017+0000","last_became_active":"2023-05-10T01:09:53.383049+0000","last_became_peered":"2023-05-10T01:09:53.383049+0000","last_unstale":"2023-05-10T01:09:53.392017+0000","last_undegraded":"2023-05-10T01:09:53.392017+0000","last_fullsized":"2023-05-10T01:09:53.392017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789347+0000","last_change":"2023-05-10T01:09:53.778319+0000","last_active":"2023-05-10T01:09:53.789347+0000","last_peered":"2023-05-10T01:09:53.789347+0000","last_clean":"2023-05-10T01:09:53.789347+0000","last_became_active":"2023-05-10T01:09:53.777415+0000","last_became_peered":"2023-05-10T01:09:53.777415+0000","last_unstale":"2023-05-10T01:09:53.789347+0000","last_undegraded":"2023-05-10T01:09:53.789347+0000","last_fullsized":"2023-05-10T01:09:53.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790039+0000","last_change":"2023-05-10T01:09:53.382266+0000","last_active":"2023-05-10T01:09:53.790039+0000","last_peered":"2023-05-10T01:09:53.790039+0000","last_clean":"2023-05-10T01:09:53.790039+0000","last_became_active":"2023-05-10T01:09:53.382000+0000","last_became_peered":"2023-05-10T01:09:53.382000+0000","last_unstale":"2023-05-10T01:09:53.790039+0000","last_undegraded":"2023-05-10T01:09:53.790039+0000","last_fullsized":"2023-05-10T01:09:53.790039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770861+0000","last_change":"2023-05-10T01:09:53.768348+0000","last_active":"2023-05-10T01:09:53.770861+0000","last_peered":"2023-05-10T01:09:53.770861+0000","last_clean":"2023-05-10T01:09:53.770861+0000","last_became_active":"2023-05-10T01:09:53.767452+0000","last_became_peered":"2023-05-10T01:09:53.767452+0000","last_unstale":"2023-05-10T01:09:53.770861+0000","last_undegraded":"2023-05-10T01:09:53.770861+0000","last_fullsized":"2023-05-10T01:09:53.770861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782143+0000","last_change":"2023-05-10T01:09:53.377329+0000","last_active":"2023-05-10T01:09:53.782143+0000","last_peered":"2023-05-10T01:09:53.782143+0000","last_clean":"2023-05-10T01:09:53.782143+0000","last_became_active":"2023-05-10T01:09:53.377037+0000","last_became_peered":"2023-05-10T01:09:53.377037+0000","last_unstale":"2023-05-10T01:09:53.782143+0000","last_undegraded":"2023-05-10T01:09:53.782143+0000","last_fullsized":"2023-05-10T01:09:53.782143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789557+0000","last_change":"2023-05-10T01:09:53.780936+0000","last_active":"2023-05-10T01:09:53.789557+0000","last_peered":"2023-05-10T01:09:53.789557+0000","last_clean":"2023-05-10T01:09:53.789557+0000","last_became_active":"2023-05-10T01:09:53.780642+0000","last_became_peered":"2023-05-10T01:09:53.780642+0000","last_unstale":"2023-05-10T01:09:53.789557+0000","last_undegraded":"2023-05-10T01:09:53.789557+0000","last_fullsized":"2023-05-10T01:09:53.789557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757130+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.757130+0000","last_peered":"2023-05-10T01:09:53.757130+0000","last_clean":"2023-05-10T01:09:53.757130+0000","last_became_active":"2023-05-10T01:09:53.380703+0000","last_became_peered":"2023-05-10T01:09:53.380703+0000","last_unstale":"2023-05-10T01:09:53.757130+0000","last_undegraded":"2023-05-10T01:09:53.757130+0000","last_fullsized":"2023-05-10T01:09:53.757130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773330+0000","last_change":"2023-05-10T01:09:53.773330+0000","last_active":"2023-05-10T01:09:53.773330+0000","last_peered":"2023-05-10T01:09:53.773330+0000","last_clean":"2023-05-10T01:09:53.773330+0000","last_became_active":"2023-05-10T01:09:53.773048+0000","last_became_peered":"2023-05-10T01:09:53.773048+0000","last_unstale":"2023-05-10T01:09:53.773330+0000","last_undegraded":"2023-05-10T01:09:53.773330+0000","last_fullsized":"2023-05-10T01:09:53.773330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.389324+0000","last_change":"2023-05-10T01:09:53.385088+0000","last_active":"2023-05-10T01:09:53.389324+0000","last_peered":"2023-05-10T01:09:53.389324+0000","last_clean":"2023-05-10T01:09:53.389324+0000","last_became_active":"2023-05-10T01:09:53.384812+0000","last_became_peered":"2023-05-10T01:09:53.384812+0000","last_unstale":"2023-05-10T01:09:53.389324+0000","last_undegraded":"2023-05-10T01:09:53.389324+0000","last_fullsized":"2023-05-10T01:09:53.389324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760008+0000","last_change":"2023-05-10T01:09:53.760008+0000","last_active":"2023-05-10T01:09:53.760008+0000","last_peered":"2023-05-10T01:09:53.760008+0000","last_clean":"2023-05-10T01:09:53.760008+0000","last_became_active":"2023-05-10T01:09:53.759723+0000","last_became_peered":"2023-05-10T01:09:53.759723+0000","last_unstale":"2023-05-10T01:09:53.760008+0000","last_undegraded":"2023-05-10T01:09:53.760008+0000","last_fullsized":"2023-05-10T01:09:53.760008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757195+0000","last_change":"2023-05-10T01:09:53.378264+0000","last_active":"2023-05-10T01:09:53.757195+0000","last_peered":"2023-05-10T01:09:53.757195+0000","last_clean":"2023-05-10T01:09:53.757195+0000","last_became_active":"2023-05-10T01:09:53.377943+0000","last_became_peered":"2023-05-10T01:09:53.377943+0000","last_unstale":"2023-05-10T01:09:53.757195+0000","last_undegraded":"2023-05-10T01:09:53.757195+0000","last_fullsized":"2023-05-10T01:09:53.757195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.784908+0000","last_change":"2023-05-10T01:09:53.784908+0000","last_active":"2023-05-10T01:09:53.784908+0000","last_peered":"2023-05-10T01:09:53.784908+0000","last_clean":"2023-05-10T01:09:53.784908+0000","last_became_active":"2023-05-10T01:09:53.784482+0000","last_became_peered":"2023-05-10T01:09:53.784482+0000","last_unstale":"2023-05-10T01:09:53.784908+0000","last_undegraded":"2023-05-10T01:09:53.784908+0000","last_fullsized":"2023-05-10T01:09:53.784908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.380877+0000","last_change":"2023-05-10T01:09:53.377668+0000","last_active":"2023-05-10T01:09:53.380877+0000","last_peered":"2023-05-10T01:09:53.380877+0000","last_clean":"2023-05-10T01:09:53.380877+0000","last_became_active":"2023-05-10T01:09:53.377379+0000","last_became_peered":"2023-05-10T01:09:53.377379+0000","last_unstale":"2023-05-10T01:09:53.380877+0000","last_undegraded":"2023-05-10T01:09:53.380877+0000","last_fullsized":"2023-05-10T01:09:53.380877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775594+0000","last_change":"2023-05-10T01:09:53.775594+0000","last_active":"2023-05-10T01:09:53.775594+0000","last_peered":"2023-05-10T01:09:53.775594+0000","last_clean":"2023-05-10T01:09:53.775594+0000","last_became_active":"2023-05-10T01:09:53.775258+0000","last_became_peered":"2023-05-10T01:09:53.775258+0000","last_unstale":"2023-05-10T01:09:53.775594+0000","last_undegraded":"2023-05-10T01:09:53.775594+0000","last_fullsized":"2023-05-10T01:09:53.775594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385557+0000","last_change":"2023-05-10T01:09:53.383076+0000","last_active":"2023-05-10T01:09:53.385557+0000","last_peered":"2023-05-10T01:09:53.385557+0000","last_clean":"2023-05-10T01:09:53.385557+0000","last_became_active":"2023-05-10T01:09:53.381851+0000","last_became_peered":"2023-05-10T01:09:53.381851+0000","last_unstale":"2023-05-10T01:09:53.385557+0000","last_undegraded":"2023-05-10T01:09:53.385557+0000","last_fullsized":"2023-05-10T01:09:53.385557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783018+0000","last_change":"2023-05-10T01:09:53.782493+0000","last_active":"2023-05-10T01:09:53.783018+0000","last_peered":"2023-05-10T01:09:53.783018+0000","last_clean":"2023-05-10T01:09:53.783018+0000","last_became_active":"2023-05-10T01:09:53.782211+0000","last_became_peered":"2023-05-10T01:09:53.782211+0000","last_unstale":"2023-05-10T01:09:53.783018+0000","last_undegraded":"2023-05-10T01:09:53.783018+0000","last_fullsized":"2023-05-10T01:09:53.783018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760139+0000","last_change":"2023-05-10T01:09:53.384727+0000","last_active":"2023-05-10T01:09:53.760139+0000","last_peered":"2023-05-10T01:09:53.760139+0000","last_clean":"2023-05-10T01:09:53.760139+0000","last_became_active":"2023-05-10T01:09:53.384426+0000","last_became_peered":"2023-05-10T01:09:53.384426+0000","last_unstale":"2023-05-10T01:09:53.760139+0000","last_undegraded":"2023-05-10T01:09:53.760139+0000","last_fullsized":"2023-05-10T01:09:53.760139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789367+0000","last_change":"2023-05-10T01:09:53.778447+0000","last_active":"2023-05-10T01:09:53.789367+0000","last_peered":"2023-05-10T01:09:53.789367+0000","last_clean":"2023-05-10T01:09:53.789367+0000","last_became_active":"2023-05-10T01:09:53.777503+0000","last_became_peered":"2023-05-10T01:09:53.777503+0000","last_unstale":"2023-05-10T01:09:53.789367+0000","last_undegraded":"2023-05-10T01:09:53.789367+0000","last_fullsized":"2023-05-10T01:09:53.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.376021+0000","last_change":"2023-05-10T01:09:53.373308+0000","last_active":"2023-05-10T01:09:53.376021+0000","last_peered":"2023-05-10T01:09:53.376021+0000","last_clean":"2023-05-10T01:09:53.376021+0000","last_became_active":"2023-05-10T01:09:53.372576+0000","last_became_peered":"2023-05-10T01:09:53.372576+0000","last_unstale":"2023-05-10T01:09:53.376021+0000","last_undegraded":"2023-05-10T01:09:53.376021+0000","last_fullsized":"2023-05-10T01:09:53.376021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769654+0000","last_change":"2023-05-10T01:09:53.767497+0000","last_active":"2023-05-10T01:09:53.769654+0000","last_peered":"2023-05-10T01:09:53.769654+0000","last_clean":"2023-05-10T01:09:53.769654+0000","last_became_active":"2023-05-10T01:09:53.764957+0000","last_became_peered":"2023-05-10T01:09:53.764957+0000","last_unstale":"2023-05-10T01:09:53.769654+0000","last_undegraded":"2023-05-10T01:09:53.769654+0000","last_fullsized":"2023-05-10T01:09:53.769654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384210+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.384210+0000","last_peered":"2023-05-10T01:09:53.384210+0000","last_clean":"2023-05-10T01:09:53.384210+0000","last_became_active":"2023-05-10T01:09:53.378549+0000","last_became_peered":"2023-05-10T01:09:53.378549+0000","last_unstale":"2023-05-10T01:09:53.384210+0000","last_undegraded":"2023-05-10T01:09:53.384210+0000","last_fullsized":"2023-05-10T01:09:53.384210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777067+0000","last_change":"2023-05-10T01:09:53.777067+0000","last_active":"2023-05-10T01:09:53.777067+0000","last_peered":"2023-05-10T01:09:53.777067+0000","last_clean":"2023-05-10T01:09:53.777067+0000","last_became_active":"2023-05-10T01:09:53.776765+0000","last_became_peered":"2023-05-10T01:09:53.776765+0000","last_unstale":"2023-05-10T01:09:53.777067+0000","last_undegraded":"2023-05-10T01:09:53.777067+0000","last_fullsized":"2023-05-10T01:09:53.777067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764391+0000","last_change":"2023-05-10T01:09:53.384098+0000","last_active":"2023-05-10T01:09:53.764391+0000","last_peered":"2023-05-10T01:09:53.764391+0000","last_clean":"2023-05-10T01:09:53.764391+0000","last_became_active":"2023-05-10T01:09:53.383801+0000","last_became_peered":"2023-05-10T01:09:53.383801+0000","last_unstale":"2023-05-10T01:09:53.764391+0000","last_undegraded":"2023-05-10T01:09:53.764391+0000","last_fullsized":"2023-05-10T01:09:53.764391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768353+0000","last_change":"2023-05-10T01:09:53.768353+0000","last_active":"2023-05-10T01:09:53.768353+0000","last_peered":"2023-05-10T01:09:53.768353+0000","last_clean":"2023-05-10T01:09:53.768353+0000","last_became_active":"2023-05-10T01:09:53.768082+0000","last_became_peered":"2023-05-10T01:09:53.768082+0000","last_unstale":"2023-05-10T01:09:53.768353+0000","last_undegraded":"2023-05-10T01:09:53.768353+0000","last_fullsized":"2023-05-10T01:09:53.768353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384942+0000","last_change":"2023-05-10T01:09:53.379829+0000","last_active":"2023-05-10T01:09:53.384942+0000","last_peered":"2023-05-10T01:09:53.384942+0000","last_clean":"2023-05-10T01:09:53.384942+0000","last_became_active":"2023-05-10T01:09:53.379516+0000","last_became_peered":"2023-05-10T01:09:53.379516+0000","last_unstale":"2023-05-10T01:09:53.384942+0000","last_undegraded":"2023-05-10T01:09:53.384942+0000","last_fullsized":"2023-05-10T01:09:53.384942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789455+0000","last_change":"2023-05-10T01:09:53.779725+0000","last_active":"2023-05-10T01:09:53.789455+0000","last_peered":"2023-05-10T01:09:53.789455+0000","last_clean":"2023-05-10T01:09:53.789455+0000","last_became_active":"2023-05-10T01:09:53.776948+0000","last_became_peered":"2023-05-10T01:09:53.776948+0000","last_unstale":"2023-05-10T01:09:53.789455+0000","last_undegraded":"2023-05-10T01:09:53.789455+0000","last_fullsized":"2023-05-10T01:09:53.789455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763025+0000","last_change":"2023-05-10T01:09:53.384002+0000","last_active":"2023-05-10T01:09:53.763025+0000","last_peered":"2023-05-10T01:09:53.763025+0000","last_clean":"2023-05-10T01:09:53.763025+0000","last_became_active":"2023-05-10T01:09:53.383716+0000","last_became_peered":"2023-05-10T01:09:53.383716+0000","last_unstale":"2023-05-10T01:09:53.763025+0000","last_undegraded":"2023-05-10T01:09:53.763025+0000","last_fullsized":"2023-05-10T01:09:53.763025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774462+0000","last_change":"2023-05-10T01:09:53.772854+0000","last_active":"2023-05-10T01:09:53.774462+0000","last_peered":"2023-05-10T01:09:53.774462+0000","last_clean":"2023-05-10T01:09:53.774462+0000","last_became_active":"2023-05-10T01:09:53.772540+0000","last_became_peered":"2023-05-10T01:09:53.772540+0000","last_unstale":"2023-05-10T01:09:53.774462+0000","last_undegraded":"2023-05-10T01:09:53.774462+0000","last_fullsized":"2023-05-10T01:09:53.774462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384904+0000","last_change":"2023-05-10T01:09:53.379344+0000","last_active":"2023-05-10T01:09:53.384904+0000","last_peered":"2023-05-10T01:09:53.384904+0000","last_clean":"2023-05-10T01:09:53.384904+0000","last_became_active":"2023-05-10T01:09:53.379093+0000","last_became_peered":"2023-05-10T01:09:53.379093+0000","last_unstale":"2023-05-10T01:09:53.384904+0000","last_undegraded":"2023-05-10T01:09:53.384904+0000","last_fullsized":"2023-05-10T01:09:53.384904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789943+0000","last_change":"2023-05-10T01:09:53.782809+0000","last_active":"2023-05-10T01:09:53.789943+0000","last_peered":"2023-05-10T01:09:53.789943+0000","last_clean":"2023-05-10T01:09:53.789943+0000","last_became_active":"2023-05-10T01:09:53.777458+0000","last_became_peered":"2023-05-10T01:09:53.777458+0000","last_unstale":"2023-05-10T01:09:53.789943+0000","last_undegraded":"2023-05-10T01:09:53.789943+0000","last_fullsized":"2023-05-10T01:09:53.789943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756537+0000","last_change":"2023-05-10T01:09:53.382855+0000","last_active":"2023-05-10T01:09:53.756537+0000","last_peered":"2023-05-10T01:09:53.756537+0000","last_clean":"2023-05-10T01:09:53.756537+0000","last_became_active":"2023-05-10T01:09:53.379670+0000","last_became_peered":"2023-05-10T01:09:53.379670+0000","last_unstale":"2023-05-10T01:09:53.756537+0000","last_undegraded":"2023-05-10T01:09:53.756537+0000","last_fullsized":"2023-05-10T01:09:53.756537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789346+0000","last_change":"2023-05-10T01:09:53.781558+0000","last_active":"2023-05-10T01:09:53.789346+0000","last_peered":"2023-05-10T01:09:53.789346+0000","last_clean":"2023-05-10T01:09:53.789346+0000","last_became_active":"2023-05-10T01:09:53.781283+0000","last_became_peered":"2023-05-10T01:09:53.781283+0000","last_unstale":"2023-05-10T01:09:53.789346+0000","last_undegraded":"2023-05-10T01:09:53.789346+0000","last_fullsized":"2023-05-10T01:09:53.789346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.388977+0000","last_change":"2023-05-10T01:09:53.382597+0000","last_active":"2023-05-10T01:09:53.388977+0000","last_peered":"2023-05-10T01:09:53.388977+0000","last_clean":"2023-05-10T01:09:53.388977+0000","last_became_active":"2023-05-10T01:09:53.382312+0000","last_became_peered":"2023-05-10T01:09:53.382312+0000","last_unstale":"2023-05-10T01:09:53.388977+0000","last_undegraded":"2023-05-10T01:09:53.388977+0000","last_fullsized":"2023-05-10T01:09:53.388977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762455+0000","last_change":"2023-05-10T01:09:53.762455+0000","last_active":"2023-05-10T01:09:53.762455+0000","last_peered":"2023-05-10T01:09:53.762455+0000","last_clean":"2023-05-10T01:09:53.762455+0000","last_became_active":"2023-05-10T01:09:53.762128+0000","last_became_peered":"2023-05-10T01:09:53.762128+0000","last_unstale":"2023-05-10T01:09:53.762455+0000","last_undegraded":"2023-05-10T01:09:53.762455+0000","last_fullsized":"2023-05-10T01:09:53.762455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790088+0000","last_change":"2023-05-10T01:09:53.383349+0000","last_active":"2023-05-10T01:09:53.790088+0000","last_peered":"2023-05-10T01:09:53.790088+0000","last_clean":"2023-05-10T01:09:53.790088+0000","last_became_active":"2023-05-10T01:09:53.381097+0000","last_became_peered":"2023-05-10T01:09:53.381097+0000","last_unstale":"2023-05-10T01:09:53.790088+0000","last_undegraded":"2023-05-10T01:09:53.790088+0000","last_fullsized":"2023-05-10T01:09:53.790088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769665+0000","last_change":"2023-05-10T01:09:53.768045+0000","last_active":"2023-05-10T01:09:53.769665+0000","last_peered":"2023-05-10T01:09:53.769665+0000","last_clean":"2023-05-10T01:09:53.769665+0000","last_became_active":"2023-05-10T01:09:53.767775+0000","last_became_peered":"2023-05-10T01:09:53.767775+0000","last_unstale":"2023-05-10T01:09:53.769665+0000","last_undegraded":"2023-05-10T01:09:53.769665+0000","last_fullsized":"2023-05-10T01:09:53.769665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758314+0000","last_change":"2023-05-10T01:09:53.378075+0000","last_active":"2023-05-10T01:09:53.758314+0000","last_peered":"2023-05-10T01:09:53.758314+0000","last_clean":"2023-05-10T01:09:53.758314+0000","last_became_active":"2023-05-10T01:09:53.377777+0000","last_became_peered":"2023-05-10T01:09:53.377777+0000","last_unstale":"2023-05-10T01:09:53.758314+0000","last_undegraded":"2023-05-10T01:09:53.758314+0000","last_fullsized":"2023-05-10T01:09:53.758314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786432+0000","last_change":"2023-05-10T01:09:53.777094+0000","last_active":"2023-05-10T01:09:53.786432+0000","last_peered":"2023-05-10T01:09:53.786432+0000","last_clean":"2023-05-10T01:09:53.786432+0000","last_became_active":"2023-05-10T01:09:53.776783+0000","last_became_peered":"2023-05-10T01:09:53.776783+0000","last_unstale":"2023-05-10T01:09:53.786432+0000","last_undegraded":"2023-05-10T01:09:53.786432+0000","last_fullsized":"2023-05-10T01:09:53.786432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.384980+0000","last_change":"2023-05-10T01:09:53.380032+0000","last_active":"2023-05-10T01:09:53.384980+0000","last_peered":"2023-05-10T01:09:53.384980+0000","last_clean":"2023-05-10T01:09:53.384980+0000","last_became_active":"2023-05-10T01:09:53.379645+0000","last_became_peered":"2023-05-10T01:09:53.379645+0000","last_unstale":"2023-05-10T01:09:53.384980+0000","last_undegraded":"2023-05-10T01:09:53.384980+0000","last_fullsized":"2023-05-10T01:09:53.384980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769678+0000","last_change":"2023-05-10T01:09:53.769678+0000","last_active":"2023-05-10T01:09:53.769678+0000","last_peered":"2023-05-10T01:09:53.769678+0000","last_clean":"2023-05-10T01:09:53.769678+0000","last_became_active":"2023-05-10T01:09:53.768182+0000","last_became_peered":"2023-05-10T01:09:53.768182+0000","last_unstale":"2023-05-10T01:09:53.769678+0000","last_undegraded":"2023-05-10T01:09:53.769678+0000","last_fullsized":"2023-05-10T01:09:53.769678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777513+0000","last_change":"2023-05-10T01:09:53.387228+0000","last_active":"2023-05-10T01:09:53.777513+0000","last_peered":"2023-05-10T01:09:53.777513+0000","last_clean":"2023-05-10T01:09:53.777513+0000","last_became_active":"2023-05-10T01:09:53.386991+0000","last_became_peered":"2023-05-10T01:09:53.386991+0000","last_unstale":"2023-05-10T01:09:53.777513+0000","last_undegraded":"2023-05-10T01:09:53.777513+0000","last_fullsized":"2023-05-10T01:09:53.777513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773869+0000","last_change":"2023-05-10T01:09:53.773869+0000","last_active":"2023-05-10T01:09:53.773869+0000","last_peered":"2023-05-10T01:09:53.773869+0000","last_clean":"2023-05-10T01:09:53.773869+0000","last_became_active":"2023-05-10T01:09:53.773284+0000","last_became_peered":"2023-05-10T01:09:53.773284+0000","last_unstale":"2023-05-10T01:09:53.773869+0000","last_undegraded":"2023-05-10T01:09:53.773869+0000","last_fullsized":"2023-05-10T01:09:53.773869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.376146+0000","last_change":"2023-05-10T01:09:53.374463+0000","last_active":"2023-05-10T01:09:53.376146+0000","last_peered":"2023-05-10T01:09:53.376146+0000","last_clean":"2023-05-10T01:09:53.376146+0000","last_became_active":"2023-05-10T01:09:53.372250+0000","last_became_peered":"2023-05-10T01:09:53.372250+0000","last_unstale":"2023-05-10T01:09:53.376146+0000","last_undegraded":"2023-05-10T01:09:53.376146+0000","last_fullsized":"2023-05-10T01:09:53.376146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789874+0000","last_change":"2023-05-10T01:09:53.780390+0000","last_active":"2023-05-10T01:09:53.789874+0000","last_peered":"2023-05-10T01:09:53.789874+0000","last_clean":"2023-05-10T01:09:53.789874+0000","last_became_active":"2023-05-10T01:09:53.780072+0000","last_became_peered":"2023-05-10T01:09:53.780072+0000","last_unstale":"2023-05-10T01:09:53.789874+0000","last_undegraded":"2023-05-10T01:09:53.789874+0000","last_fullsized":"2023-05-10T01:09:53.789874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385780+0000","last_change":"2023-05-10T01:09:53.379278+0000","last_active":"2023-05-10T01:09:53.385780+0000","last_peered":"2023-05-10T01:09:53.385780+0000","last_clean":"2023-05-10T01:09:53.385780+0000","last_became_active":"2023-05-10T01:09:53.378985+0000","last_became_peered":"2023-05-10T01:09:53.378985+0000","last_unstale":"2023-05-10T01:09:53.385780+0000","last_undegraded":"2023-05-10T01:09:53.385780+0000","last_fullsized":"2023-05-10T01:09:53.385780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778912+0000","last_change":"2023-05-10T01:09:53.778386+0000","last_active":"2023-05-10T01:09:53.778912+0000","last_peered":"2023-05-10T01:09:53.778912+0000","last_clean":"2023-05-10T01:09:53.778912+0000","last_became_active":"2023-05-10T01:09:53.778121+0000","last_became_peered":"2023-05-10T01:09:53.778121+0000","last_unstale":"2023-05-10T01:09:53.778912+0000","last_undegraded":"2023-05-10T01:09:53.778912+0000","last_fullsized":"2023-05-10T01:09:53.778912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782640+0000","last_change":"2023-05-10T01:09:53.377455+0000","last_active":"2023-05-10T01:09:53.782640+0000","last_peered":"2023-05-10T01:09:53.782640+0000","last_clean":"2023-05-10T01:09:53.782640+0000","last_became_active":"2023-05-10T01:09:53.377216+0000","last_became_peered":"2023-05-10T01:09:53.377216+0000","last_unstale":"2023-05-10T01:09:53.782640+0000","last_undegraded":"2023-05-10T01:09:53.782640+0000","last_fullsized":"2023-05-10T01:09:53.782640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768114+0000","last_change":"2023-05-10T01:09:53.766371+0000","last_active":"2023-05-10T01:09:53.768114+0000","last_peered":"2023-05-10T01:09:53.768114+0000","last_clean":"2023-05-10T01:09:53.768114+0000","last_became_active":"2023-05-10T01:09:53.766077+0000","last_became_peered":"2023-05-10T01:09:53.766077+0000","last_unstale":"2023-05-10T01:09:53.768114+0000","last_undegraded":"2023-05-10T01:09:53.768114+0000","last_fullsized":"2023-05-10T01:09:53.768114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790195+0000","last_change":"2023-05-10T01:09:53.381183+0000","last_active":"2023-05-10T01:09:53.790195+0000","last_peered":"2023-05-10T01:09:53.790195+0000","last_clean":"2023-05-10T01:09:53.790195+0000","last_became_active":"2023-05-10T01:09:53.380930+0000","last_became_peered":"2023-05-10T01:09:53.380930+0000","last_unstale":"2023-05-10T01:09:53.790195+0000","last_undegraded":"2023-05-10T01:09:53.790195+0000","last_fullsized":"2023-05-10T01:09:53.790195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762054+0000","last_change":"2023-05-10T01:09:53.762054+0000","last_active":"2023-05-10T01:09:53.762054+0000","last_peered":"2023-05-10T01:09:53.762054+0000","last_clean":"2023-05-10T01:09:53.762054+0000","last_became_active":"2023-05-10T01:09:53.761780+0000","last_became_peered":"2023-05-10T01:09:53.761780+0000","last_unstale":"2023-05-10T01:09:53.762054+0000","last_undegraded":"2023-05-10T01:09:53.762054+0000","last_fullsized":"2023-05-10T01:09:53.762054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.380841+0000","last_change":"2023-05-10T01:09:53.376957+0000","last_active":"2023-05-10T01:09:53.380841+0000","last_peered":"2023-05-10T01:09:53.380841+0000","last_clean":"2023-05-10T01:09:53.380841+0000","last_became_active":"2023-05-10T01:09:53.376671+0000","last_became_peered":"2023-05-10T01:09:53.376671+0000","last_unstale":"2023-05-10T01:09:53.380841+0000","last_undegraded":"2023-05-10T01:09:53.380841+0000","last_fullsized":"2023-05-10T01:09:53.380841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786478+0000","last_change":"2023-05-10T01:09:53.778775+0000","last_active":"2023-05-10T01:09:53.786478+0000","last_peered":"2023-05-10T01:09:53.786478+0000","last_clean":"2023-05-10T01:09:53.786478+0000","last_became_active":"2023-05-10T01:09:53.778466+0000","last_became_peered":"2023-05-10T01:09:53.778466+0000","last_unstale":"2023-05-10T01:09:53.786478+0000","last_undegraded":"2023-05-10T01:09:53.786478+0000","last_fullsized":"2023-05-10T01:09:53.786478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.383108+0000","last_change":"2023-05-10T01:09:53.377703+0000","last_active":"2023-05-10T01:09:53.383108+0000","last_peered":"2023-05-10T01:09:53.383108+0000","last_clean":"2023-05-10T01:09:53.383108+0000","last_became_active":"2023-05-10T01:09:53.377326+0000","last_became_peered":"2023-05-10T01:09:53.377326+0000","last_unstale":"2023-05-10T01:09:53.383108+0000","last_undegraded":"2023-05-10T01:09:53.383108+0000","last_fullsized":"2023-05-10T01:09:53.383108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780343+0000","last_change":"2023-05-10T01:09:53.771235+0000","last_active":"2023-05-10T01:09:53.780343+0000","last_peered":"2023-05-10T01:09:53.780343+0000","last_clean":"2023-05-10T01:09:53.780343+0000","last_became_active":"2023-05-10T01:09:53.770851+0000","last_became_peered":"2023-05-10T01:09:53.770851+0000","last_unstale":"2023-05-10T01:09:53.780343+0000","last_undegraded":"2023-05-10T01:09:53.780343+0000","last_fullsized":"2023-05-10T01:09:53.780343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773545+0000","last_change":"2023-05-10T01:09:53.381560+0000","last_active":"2023-05-10T01:09:53.773545+0000","last_peered":"2023-05-10T01:09:53.773545+0000","last_clean":"2023-05-10T01:09:53.773545+0000","last_became_active":"2023-05-10T01:09:53.381233+0000","last_became_peered":"2023-05-10T01:09:53.381233+0000","last_unstale":"2023-05-10T01:09:53.773545+0000","last_undegraded":"2023-05-10T01:09:53.773545+0000","last_fullsized":"2023-05-10T01:09:53.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770806+0000","last_change":"2023-05-10T01:09:53.768979+0000","last_active":"2023-05-10T01:09:53.770806+0000","last_peered":"2023-05-10T01:09:53.770806+0000","last_clean":"2023-05-10T01:09:53.770806+0000","last_became_active":"2023-05-10T01:09:53.768736+0000","last_became_peered":"2023-05-10T01:09:53.768736+0000","last_unstale":"2023-05-10T01:09:53.770806+0000","last_undegraded":"2023-05-10T01:09:53.770806+0000","last_fullsized":"2023-05-10T01:09:53.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759905+0000","last_change":"2023-05-10T01:09:53.380523+0000","last_active":"2023-05-10T01:09:53.759905+0000","last_peered":"2023-05-10T01:09:53.759905+0000","last_clean":"2023-05-10T01:09:53.759905+0000","last_became_active":"2023-05-10T01:09:53.380220+0000","last_became_peered":"2023-05-10T01:09:53.380220+0000","last_unstale":"2023-05-10T01:09:53.759905+0000","last_undegraded":"2023-05-10T01:09:53.759905+0000","last_fullsized":"2023-05-10T01:09:53.759905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774054+0000","last_change":"2023-05-10T01:09:53.774054+0000","last_active":"2023-05-10T01:09:53.774054+0000","last_peered":"2023-05-10T01:09:53.774054+0000","last_clean":"2023-05-10T01:09:53.774054+0000","last_became_active":"2023-05-10T01:09:53.773600+0000","last_became_peered":"2023-05-10T01:09:53.773600+0000","last_unstale":"2023-05-10T01:09:53.774054+0000","last_undegraded":"2023-05-10T01:09:53.774054+0000","last_fullsized":"2023-05-10T01:09:53.774054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769207+0000","last_change":"2023-05-10T01:09:53.387215+0000","last_active":"2023-05-10T01:09:53.769207+0000","last_peered":"2023-05-10T01:09:53.769207+0000","last_clean":"2023-05-10T01:09:53.769207+0000","last_became_active":"2023-05-10T01:09:53.386942+0000","last_became_peered":"2023-05-10T01:09:53.386942+0000","last_unstale":"2023-05-10T01:09:53.769207+0000","last_undegraded":"2023-05-10T01:09:53.769207+0000","last_fullsized":"2023-05-10T01:09:53.769207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789796+0000","last_change":"2023-05-10T01:09:53.775699+0000","last_active":"2023-05-10T01:09:53.789796+0000","last_peered":"2023-05-10T01:09:53.789796+0000","last_clean":"2023-05-10T01:09:53.789796+0000","last_became_active":"2023-05-10T01:09:53.775407+0000","last_became_peered":"2023-05-10T01:09:53.775407+0000","last_unstale":"2023-05-10T01:09:53.789796+0000","last_undegraded":"2023-05-10T01:09:53.789796+0000","last_fullsized":"2023-05-10T01:09:53.789796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759464+0000","last_change":"2023-05-10T01:09:53.387442+0000","last_active":"2023-05-10T01:09:53.759464+0000","last_peered":"2023-05-10T01:09:53.759464+0000","last_clean":"2023-05-10T01:09:53.759464+0000","last_became_active":"2023-05-10T01:09:53.387192+0000","last_became_peered":"2023-05-10T01:09:53.387192+0000","last_unstale":"2023-05-10T01:09:53.759464+0000","last_undegraded":"2023-05-10T01:09:53.759464+0000","last_fullsized":"2023-05-10T01:09:53.759464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776255+0000","last_change":"2023-05-10T01:09:53.776255+0000","last_active":"2023-05-10T01:09:53.776255+0000","last_peered":"2023-05-10T01:09:53.776255+0000","last_clean":"2023-05-10T01:09:53.776255+0000","last_became_active":"2023-05-10T01:09:53.775994+0000","last_became_peered":"2023-05-10T01:09:53.775994+0000","last_unstale":"2023-05-10T01:09:53.776255+0000","last_undegraded":"2023-05-10T01:09:53.776255+0000","last_fullsized":"2023-05-10T01:09:53.776255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786324+0000","last_change":"2023-05-10T01:09:53.381425+0000","last_active":"2023-05-10T01:09:53.786324+0000","last_peered":"2023-05-10T01:09:53.786324+0000","last_clean":"2023-05-10T01:09:53.786324+0000","last_became_active":"2023-05-10T01:09:53.381139+0000","last_became_peered":"2023-05-10T01:09:53.381139+0000","last_unstale":"2023-05-10T01:09:53.786324+0000","last_undegraded":"2023-05-10T01:09:53.786324+0000","last_fullsized":"2023-05-10T01:09:53.786324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763499+0000","last_change":"2023-05-10T01:09:53.763499+0000","last_active":"2023-05-10T01:09:53.763499+0000","last_peered":"2023-05-10T01:09:53.763499+0000","last_clean":"2023-05-10T01:09:53.763499+0000","last_became_active":"2023-05-10T01:09:53.763025+0000","last_became_peered":"2023-05-10T01:09:53.763025+0000","last_unstale":"2023-05-10T01:09:53.763499+0000","last_undegraded":"2023-05-10T01:09:53.763499+0000","last_fullsized":"2023-05-10T01:09:53.763499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775734+0000","last_change":"2023-05-10T01:09:53.379747+0000","last_active":"2023-05-10T01:09:53.775734+0000","last_peered":"2023-05-10T01:09:53.775734+0000","last_clean":"2023-05-10T01:09:53.775734+0000","last_became_active":"2023-05-10T01:09:53.379410+0000","last_became_peered":"2023-05-10T01:09:53.379410+0000","last_unstale":"2023-05-10T01:09:53.775734+0000","last_undegraded":"2023-05-10T01:09:53.775734+0000","last_fullsized":"2023-05-10T01:09:53.775734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789720+0000","last_change":"2023-05-10T01:09:53.782423+0000","last_active":"2023-05-10T01:09:53.789720+0000","last_peered":"2023-05-10T01:09:53.789720+0000","last_clean":"2023-05-10T01:09:53.789720+0000","last_became_active":"2023-05-10T01:09:53.782122+0000","last_became_peered":"2023-05-10T01:09:53.782122+0000","last_unstale":"2023-05-10T01:09:53.789720+0000","last_undegraded":"2023-05-10T01:09:53.789720+0000","last_fullsized":"2023-05-10T01:09:53.789720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.385506+0000","last_change":"2023-05-10T01:09:53.377917+0000","last_active":"2023-05-10T01:09:53.385506+0000","last_peered":"2023-05-10T01:09:53.385506+0000","last_clean":"2023-05-10T01:09:53.385506+0000","last_became_active":"2023-05-10T01:09:53.377603+0000","last_became_peered":"2023-05-10T01:09:53.377603+0000","last_unstale":"2023-05-10T01:09:53.385506+0000","last_undegraded":"2023-05-10T01:09:53.385506+0000","last_fullsized":"2023-05-10T01:09:53.385506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786549+0000","last_change":"2023-05-10T01:09:53.779988+0000","last_active":"2023-05-10T01:09:53.786549+0000","last_peered":"2023-05-10T01:09:53.786549+0000","last_clean":"2023-05-10T01:09:53.786549+0000","last_became_active":"2023-05-10T01:09:53.774488+0000","last_became_peered":"2023-05-10T01:09:53.774488+0000","last_unstale":"2023-05-10T01:09:53.786549+0000","last_undegraded":"2023-05-10T01:09:53.786549+0000","last_fullsized":"2023-05-10T01:09:53.786549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.375348+0000","last_change":"2023-05-10T01:09:53.370862+0000","last_active":"2023-05-10T01:09:53.375348+0000","last_peered":"2023-05-10T01:09:53.375348+0000","last_clean":"2023-05-10T01:09:53.375348+0000","last_became_active":"2023-05-10T01:09:53.370581+0000","last_became_peered":"2023-05-10T01:09:53.370581+0000","last_unstale":"2023-05-10T01:09:53.375348+0000","last_undegraded":"2023-05-10T01:09:53.375348+0000","last_fullsized":"2023-05-10T01:09:53.375348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775797+0000","last_change":"2023-05-10T01:09:53.775797+0000","last_active":"2023-05-10T01:09:53.775797+0000","last_peered":"2023-05-10T01:09:53.775797+0000","last_clean":"2023-05-10T01:09:53.775797+0000","last_became_active":"2023-05-10T01:09:53.775494+0000","last_became_peered":"2023-05-10T01:09:53.775494+0000","last_unstale":"2023-05-10T01:09:53.775797+0000","last_undegraded":"2023-05-10T01:09:53.775797+0000","last_fullsized":"2023-05-10T01:09:53.775797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789403+0000","last_change":"2023-05-10T01:09:53.382141+0000","last_active":"2023-05-10T01:09:53.789403+0000","last_peered":"2023-05-10T01:09:53.789403+0000","last_clean":"2023-05-10T01:09:53.789403+0000","last_became_active":"2023-05-10T01:09:53.381836+0000","last_became_peered":"2023-05-10T01:09:53.381836+0000","last_unstale":"2023-05-10T01:09:53.789403+0000","last_undegraded":"2023-05-10T01:09:53.789403+0000","last_fullsized":"2023-05-10T01:09:53.789403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":225280,"data_stored":80079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":221184,"data_stored":78723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":217088,"data_stored":78633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:09:58.150 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:09:58.150 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-10T01:09:58.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-10T01:09:58.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-10T01:09:58.151 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-10T01:09:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 Processor -- start 2023-05-10T01:09:58.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 -- start start 2023-05-10T01:09:58.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c0bd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0bdba0 con 0x7fad5c0bd770 2023-05-10T01:09:58.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c154b70 con 0x7fad5c13a590 2023-05-10T01:09:58.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.294+0000 7fad6239c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c154e50 con 0x7fad5c068050 2023-05-10T01:09:58.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad60939700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad5c0bd770 0x7fad5c0c2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39250/0 (socket says 172.21.15.52:39250) 2023-05-10T01:09:58.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad60939700 1 -- 172.21.15.52:0/1230268686 learned_addr learned my addr 172.21.15.52:0/1230268686 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:58.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad53fff700 1 --2- 172.21.15.52:0/1230268686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c0bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529158320 0 0) 0x7fad5c0bdba0 con 0x7fad5c0bd770 2023-05-10T01:09:58.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c0033f0 con 0x7fad5c0bd770 2023-05-10T01:09:58.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140313595 0 0) 0x7fad5c154b70 con 0x7fad5c13a590 2023-05-10T01:09:58.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c0bdba0 con 0x7fad5c13a590 2023-05-10T01:09:58.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad53fff700 1 -- 172.21.15.52:0/1230268686 >> v1:172.21.15.172:6789/0 conn(0x7fad5c13a590 legacy=0x7fad5c0685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad53fff700 1 -- 172.21.15.52:0/1230268686 >> v1:172.21.15.52:6789/0 conn(0x7fad5c0bd770 legacy=0x7fad5c0c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad53fff700 1 -- 172.21.15.52:0/1230268686 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c155130 con 0x7fad5c068050 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad53fff700 1 --2- 172.21.15.52:0/1230268686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c0bd280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad44009790 tx=0x7fad44009060).ready entity=mon.2 client_cookie=aedb63de4f887a5e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400f510 con 0x7fad5c068050 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400f670 con 0x7fad5c068050 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.295+0000 7fad5b7fe700 1 -- 172.21.15.52:0/1230268686 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400f9f0 con 0x7fad5c068050 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 -- 172.21.15.52:0/1230268686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 msgr2=0x7fad5c0bd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 --2- 172.21.15.52:0/1230268686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c0bd280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad44009790 tx=0x7fad44009060).stop 2023-05-10T01:09:58.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 -- 172.21.15.52:0/1230268686 shutdown_connections 2023-05-10T01:09:58.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 --2- 172.21.15.52:0/1230268686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c0bd280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 -- 172.21.15.52:0/1230268686 >> 172.21.15.52:0/1230268686 conn(0x7fad5c0c4420 msgr2=0x7fad5c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 -- 172.21.15.52:0/1230268686 shutdown_connections 2023-05-10T01:09:58.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.296+0000 7fad6239c700 1 -- 172.21.15.52:0/1230268686 wait complete. 2023-05-10T01:09:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.297+0000 7fad6239c700 1 Processor -- start 2023-05-10T01:09:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.297+0000 7fad6239c700 1 -- start start 2023-05-10T01:09:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 0x7fad5c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1393a0 con 0x7fad5c13a590 2023-05-10T01:09:58.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14ece0 con 0x7fad5c0bd770 2023-05-10T01:09:58.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad6239c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1521b0 con 0x7fad5c068050 2023-05-10T01:09:58.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58472/0 (socket says 172.21.15.52:58472) 2023-05-10T01:09:58.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 -- 172.21.15.52:0/248860808 learned_addr learned my addr 172.21.15.52:0/248860808 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad5bfff700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad53fff700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 0x7fad5c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 -- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 msgr2=0x7fad5c138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 -- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 msgr2=0x7fad5c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 0x7fad5c0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 -- 172.21.15.52:0/248860808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440092a0 con 0x7fad5c13a590 2023-05-10T01:09:58.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad53fff700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 0x7fad5c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad60939700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fad54001560 tx=0x7fad54001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54005d30 con 0x7fad5c13a590 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.298+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54005e90 con 0x7fad5c13a590 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.299+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c1515a0 con 0x7fad5c13a590 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.299+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54007360 con 0x7fad5c13a590 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.299+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c151b60 con 0x7fad5c13a590 2023-05-10T01:09:58.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.299+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c06c340 con 0x7fad5c13a590 2023-05-10T01:09:58.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.300+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fad54010030 con 0x7fad5c13a590 2023-05-10T01:09:58.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.300+0000 7fad58ff9700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 0x7fad40061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.300+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad540799f0 con 0x7fad5c13a590 2023-05-10T01:09:58.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.300+0000 7fad5bfff700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 0x7fad40061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.301+0000 7fad5bfff700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 0x7fad40061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fad4c003890 tx=0x7fad4c007bd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.304+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad5404ae80 con 0x7fad5c13a590 2023-05-10T01:09:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.521+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fad5c0691a0 con 0x7fad5c13a590 2023-05-10T01:09:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.524+0000 7fad58ff9700 1 -- 172.21.15.52:0/248860808 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148526 (secure 0 0 0) 0x7fad540016c0 con 0x7fad5c13a590 2023-05-10T01:09:58.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 msgr2=0x7fad40061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 0x7fad40061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fad4c003890 tx=0x7fad4c007bd0).stop 2023-05-10T01:09:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 msgr2=0x7fad5c14c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fad54001560 tx=0x7fad54001650).stop 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 shutdown_connections 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad4005ed90 0x7fad40061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c13a590 0x7fad5c14c870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c068050 0x7fad5c138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 --2- 172.21.15.52:0/248860808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c0bd770 0x7fad5c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 >> 172.21.15.52:0/248860808 conn(0x7fad5c0c4420 msgr2=0x7fad5c0c2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 shutdown_connections 2023-05-10T01:09:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.526+0000 7fad6239c700 1 -- 172.21.15.52:0/248860808 wait complete. 2023-05-10T01:09:58.541 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":116173},{"type":"v1","addr":"172.21.15.172:6833","nonce":116173}]},"active_addr":"172.21.15.172:6833/116173","active_change":"2023-05-10T01:09:40.430657+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3349551008}]},{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3297537909}]}]} 2023-05-10T01:09:58.546 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-10T01:09:58.546 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-10T01:09:58.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.660+0000 7f0cea583700 1 Processor -- start 2023-05-10T01:09:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.660+0000 7f0cea583700 1 -- start start 2023-05-10T01:09:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0cea583700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ce4154e40 0x7f0ce40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0cea583700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce4158960 con 0x7f0ce40ad030 2023-05-10T01:09:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0cea583700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce41552f0 con 0x7f0ce40c7370 2023-05-10T01:09:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0cea583700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce4157d50 con 0x7f0ce4154e40 2023-05-10T01:09:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce8d80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ce4154e40 0x7f0ce40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce9d82700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ce40ad030 0x7f0ce414dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39264/0 (socket says 172.21.15.52:39264) 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce9d82700 1 -- 172.21.15.52:0/1022360425 learned_addr learned my addr 172.21.15.52:0/1022360425 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce8d80700 1 -- 172.21.15.52:0/1022360425 >> v1:172.21.15.172:6789/0 conn(0x7f0ce40c7370 legacy=0x7f0ce40c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce8d80700 1 -- 172.21.15.52:0/1022360425 >> v1:172.21.15.52:6789/0 conn(0x7f0ce40ad030 legacy=0x7f0ce414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce3fff700 1 -- 172.21.15.52:0/1022360425 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695825037 0 0) 0x7f0ce4158960 con 0x7f0ce40ad030 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce8d80700 1 -- 172.21.15.52:0/1022360425 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4158030 con 0x7f0ce4154e40 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce8d80700 1 --2- 172.21.15.52:0/1022360425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce4154e40 0x7f0ce40acb40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0cd8009760 tx=0x7f0cd8009060).ready entity=mon.0 client_cookie=5b98352f5d3812c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce3fff700 1 -- 172.21.15.52:0/1022360425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800b580 con 0x7f0ce4154e40 2023-05-10T01:09:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce3fff700 1 -- 172.21.15.52:0/1022360425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800b6e0 con 0x7f0ce4154e40 2023-05-10T01:09:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.661+0000 7f0ce3fff700 1 -- 172.21.15.52:0/1022360425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ba60 con 0x7f0ce4154e40 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 -- 172.21.15.52:0/1022360425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce4154e40 msgr2=0x7f0ce40acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 --2- 172.21.15.52:0/1022360425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce4154e40 0x7f0ce40acb40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0cd8009760 tx=0x7f0cd8009060).stop 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 -- 172.21.15.52:0/1022360425 shutdown_connections 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 --2- 172.21.15.52:0/1022360425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce4154e40 0x7f0ce40acb40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 -- 172.21.15.52:0/1022360425 >> 172.21.15.52:0/1022360425 conn(0x7f0ce4068320 msgr2=0x7f0ce4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 -- 172.21.15.52:0/1022360425 shutdown_connections 2023-05-10T01:09:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.662+0000 7f0cea583700 1 -- 172.21.15.52:0/1022360425 wait complete. 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.663+0000 7f0cea583700 1 Processor -- start 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.663+0000 7f0cea583700 1 -- start start 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ce40c7370 0x7f0ce40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 0x7f0ce4152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce414e480 con 0x7f0ce40ad030 2023-05-10T01:09:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40c8e20 con 0x7f0ce4154e40 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0cea583700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40c9100 con 0x7f0ce40c7370 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58482/0 (socket says 172.21.15.52:58482) 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 -- 172.21.15.52:0/1735252483 learned_addr learned my addr 172.21.15.52:0/1735252483 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce8d80700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ce40c7370 0x7f0ce40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9d82700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 0x7f0ce4152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 -- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ce40c7370 msgr2=0x7f0ce40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ce40c7370 0x7f0ce40cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 -- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 msgr2=0x7f0ce4152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 0x7f0ce4152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 -- 172.21.15.52:0/1735252483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80092a0 con 0x7f0ce40ad030 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9d82700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 0x7f0ce4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.664+0000 7f0ce9581700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0cdc00c4c0 tx=0x7f0cdc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.665+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc007020 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.665+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc001e90 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.665+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0073b0 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.665+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce40c93e0 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.665+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce40cb5e0 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.666+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce4047150 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.666+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0cdc010070 con 0x7f0ce40ad030 2023-05-10T01:09:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.666+0000 7f0ce17fa700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 0x7f0cc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.666+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0cdc079350 con 0x7f0ce40ad030 2023-05-10T01:09:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.667+0000 7f0ce8d80700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 0x7f0cc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.667+0000 7f0ce8d80700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 0x7f0cc4061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0cd800b340 tx=0x7f0cd8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.671+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0cdc04a8f0 con 0x7f0ce40ad030 2023-05-10T01:09:58.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.846+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ce40bfb80 con 0x7f0ce40ad030 2023-05-10T01:09:58.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.847+0000 7f0ce17fa700 1 -- 172.21.15.52:0/1735252483 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f0cdc04df10 con 0x7f0ce40ad030 2023-05-10T01:09:58.849 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:58.850 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:58.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 msgr2=0x7f0cc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 0x7f0cc4061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0cd800b340 tx=0x7f0cd8017000).stop 2023-05-10T01:09:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 msgr2=0x7f0ce414df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0cdc00c4c0 tx=0x7f0cdc007e00).stop 2023-05-10T01:09:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 shutdown_connections 2023-05-10T01:09:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0cc405ed90 0x7f0cc4061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ce4154e40 0x7f0ce4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ce40ad030 0x7f0ce414df90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 --2- 172.21.15.52:0/1735252483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ce40c7370 0x7f0ce40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 >> 172.21.15.52:0/1735252483 conn(0x7f0ce4068320 msgr2=0x7f0ce414f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 shutdown_connections 2023-05-10T01:09:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.849+0000 7f0cea583700 1 -- 172.21.15.52:0/1735252483 wait complete. 2023-05-10T01:09:58.863 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-10T01:09:58.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:09:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.977+0000 7fda7ce16700 1 Processor -- start 2023-05-10T01:09:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.977+0000 7fda7ce16700 1 -- start start 2023-05-10T01:09:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda7ce16700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fda780c1090 0x7fda780ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda7ce16700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda78158960 con 0x7fda78154e40 2023-05-10T01:09:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda7ce16700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda781552f0 con 0x7fda780c7370 2023-05-10T01:09:58.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda7ce16700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda78157d50 con 0x7fda780c1090 2023-05-10T01:09:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda76ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fda78154e40 0x7fda780acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39276/0 (socket says 172.21.15.52:39276) 2023-05-10T01:09:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda76ffd700 1 -- 172.21.15.52:0/2814507521 learned_addr learned my addr 172.21.15.52:0/2814507521 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda77fff700 1 --2- 172.21.15.52:0/2814507521 >> v2:172.21.15.172:3300/0 conn(0x7fda780c1090 0x7fda780ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995766895 0 0) 0x7fda78158960 con 0x7fda78154e40 2023-05-10T01:09:58.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda640033f0 con 0x7fda78154e40 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863896005 0 0) 0x7fda640033f0 con 0x7fda78154e40 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda77fff700 1 -- 172.21.15.52:0/2814507521 >> v1:172.21.15.172:6789/0 conn(0x7fda780c7370 legacy=0x7fda780c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda77fff700 1 -- 172.21.15.52:0/2814507521 >> v1:172.21.15.52:6789/0 conn(0x7fda78154e40 legacy=0x7fda780acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.978+0000 7fda77fff700 1 -- 172.21.15.52:0/2814507521 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78158030 con 0x7fda780c1090 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda77fff700 1 --2- 172.21.15.52:0/2814507521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c1090 0x7fda780ad250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fda78158910 tx=0x7fda70009780).ready entity=mon.1 client_cookie=ca2aee83e879de05 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000e070 con 0x7fda780c1090 2023-05-10T01:09:58.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000b850 con 0x7fda780c1090 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda767fc700 1 -- 172.21.15.52:0/2814507521 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c001470 con 0x7fda780c1090 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 -- 172.21.15.52:0/2814507521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c1090 msgr2=0x7fda780ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 --2- 172.21.15.52:0/2814507521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c1090 0x7fda780ad250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fda78158910 tx=0x7fda70009780).stop 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 -- 172.21.15.52:0/2814507521 shutdown_connections 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 --2- 172.21.15.52:0/2814507521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c1090 0x7fda780ad250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 -- 172.21.15.52:0/2814507521 >> 172.21.15.52:0/2814507521 conn(0x7fda78068320 msgr2=0x7fda78068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 -- 172.21.15.52:0/2814507521 shutdown_connections 2023-05-10T01:09:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.979+0000 7fda7ce16700 1 -- 172.21.15.52:0/2814507521 wait complete. 2023-05-10T01:09:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.980+0000 7fda7ce16700 1 Processor -- start 2023-05-10T01:09:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 -- start start 2023-05-10T01:09:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda780c1090 0x7fda7813c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c7370 0x7fda780abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780ac9b0 con 0x7fda78154e40 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c1f50 con 0x7fda780c7370 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda7ce16700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780ad0c0 con 0x7fda780c1090 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda77fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda77fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58500/0 (socket says 172.21.15.52:58500) 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.981+0000 7fda77fff700 1 -- 172.21.15.52:0/1780086651 learned_addr learned my addr 172.21.15.52:0/1780086651 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda777fe700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda780c1090 0x7fda7813c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 -- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda780c1090 msgr2=0x7fda7813c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda780c1090 0x7fda7813c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 -- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c7370 msgr2=0x7fda780abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda76ffd700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c7370 0x7fda780abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c7370 0x7fda780abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 -- 172.21.15.52:0/1780086651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70009a20 con 0x7fda78154e40 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda77fff700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fda70012ba0 tx=0x7fda70009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7001e440 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7001e5a0 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780cb2b0 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7001e940 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.982+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda780cb870 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.983+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780c20e0 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.983+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda70025030 con 0x7fda78154e40 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.984+0000 7fda5f7fe700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 0x7fda58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.984+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda7007b480 con 0x7fda78154e40 2023-05-10T01:09:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.984+0000 7fda777fe700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 0x7fda58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.984+0000 7fda777fe700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 0x7fda58061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fda68001680 tx=0x7fda68009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:58.988+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda7004cad0 con 0x7fda78154e40 2023-05-10T01:09:59.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.161+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda780bfb80 con 0x7fda78154e40 2023-05-10T01:09:59.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.162+0000 7fda5f7fe700 1 -- 172.21.15.52:0/1780086651 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fda70023020 con 0x7fda78154e40 2023-05-10T01:09:59.165 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:09:59.165 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:09:59.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 msgr2=0x7fda58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 0x7fda58061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fda68001680 tx=0x7fda68009040).stop 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 msgr2=0x7fda780ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fda70012ba0 tx=0x7fda70009780).stop 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 shutdown_connections 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fda5805ed90 0x7fda58061250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda78154e40 0x7fda780ac4c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda780c1090 0x7fda7813c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 --2- 172.21.15.52:0/1780086651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda780c7370 0x7fda780abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 >> 172.21.15.52:0/1780086651 conn(0x7fda78068320 msgr2=0x7fda781509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 shutdown_connections 2023-05-10T01:09:59.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.164+0000 7fda7ce16700 1 -- 172.21.15.52:0/1780086651 wait complete. 2023-05-10T01:09:59.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-10T01:09:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.292+0000 7f1b8cbbe700 1 Processor -- start 2023-05-10T01:09:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.292+0000 7f1b8cbbe700 1 -- start start 2023-05-10T01:09:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b8cbbe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b88154540 0x7f1b88069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b8cbbe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b880c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b8cbbe700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880c0650 con 0x7f1b88154160 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b8cbbe700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88069ff0 con 0x7f1b88154540 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b8cbbe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880bfd20 con 0x7f1b88069b80 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b85d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b88154540 0x7f1b88069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b85d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b88154540 0x7f1b88069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58508/0 (socket says 172.21.15.52:58508) 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b85d9b700 1 -- 172.21.15.52:0/2886419794 learned_addr learned my addr 172.21.15.52:0/2886419794 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.293+0000 7f1b86d9d700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b880c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b85d9b700 1 -- 172.21.15.52:0/2886419794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 msgr2=0x7f1b880c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b85d9b700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b880c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8559a700 1 -- 172.21.15.52:0/2886419794 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710985430 0 0) 0x7f1b880c0650 con 0x7f1b88154160 2023-05-10T01:09:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b85d9b700 1 -- 172.21.15.52:0/2886419794 >> v1:172.21.15.172:6789/0 conn(0x7f1b88154160 legacy=0x7f1b880c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b85d9b700 1 -- 172.21.15.52:0/2886419794 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880c0000 con 0x7f1b88154540 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b85d9b700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88069690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1b70006fd0 tx=0x7f1b700090f0).ready entity=mon.0 client_cookie=31eaeb5f245a5cf6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8559a700 1 -- 172.21.15.52:0/2886419794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000b580 con 0x7f1b88154540 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8559a700 1 -- 172.21.15.52:0/2886419794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000b6e0 con 0x7f1b88154540 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8559a700 1 -- 172.21.15.52:0/2886419794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000ba80 con 0x7f1b88154540 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2886419794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 msgr2=0x7f1b88069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88069690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1b70006fd0 tx=0x7f1b700090f0).stop 2023-05-10T01:09:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2886419794 shutdown_connections 2023-05-10T01:09:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b880c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2886419794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88069690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.294+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2886419794 >> 172.21.15.52:0/2886419794 conn(0x7f1b880cb6f0 msgr2=0x7f1b880c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.295+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2886419794 shutdown_connections 2023-05-10T01:09:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.295+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2886419794 wait complete. 2023-05-10T01:09:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 Processor -- start 2023-05-10T01:09:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 -- start start 2023-05-10T01:09:59.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b8814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b88154160 0x7f1b88155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880c1d30 con 0x7f1b88154540 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880c22f0 con 0x7f1b88154160 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b8cbbe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88156a00 con 0x7f1b88069b80 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b86d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b86d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58514/0 (socket says 172.21.15.52:58514) 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.296+0000 7f1b86d9d700 1 -- 172.21.15.52:0/2365263420 learned_addr learned my addr 172.21.15.52:0/2365263420 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b8659c700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b8814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b85d9b700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b88154160 0x7f1b88155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 -- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 msgr2=0x7f1b8814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b88069b80 0x7f1b8814cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 -- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b88154160 msgr2=0x7f1b88155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b88154160 0x7f1b88155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009370 con 0x7f1b88154540 2023-05-10T01:09:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b86d9d700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88156430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1b7800e900 tx=0x7f1b78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800eea0 con 0x7f1b88154540 2023-05-10T01:09:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800c850 con 0x7f1b88154540 2023-05-10T01:09:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b88156ce0 con 0x7f1b88154540 2023-05-10T01:09:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800cbd0 con 0x7f1b88154540 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.297+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88168090 con 0x7f1b88154540 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.298+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b880666b0 con 0x7f1b88154540 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.298+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1b78022070 con 0x7f1b88154540 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.298+0000 7f1b7e7fc700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1b6c05ed90 0x7f1b6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b78079f50 con 0x7f1b88154540 2023-05-10T01:09:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b7e7fc700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f1b6c068130 0x7f1b6c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b8659c700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1b6c05ed90 0x7f1b6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b6c06ac10 con 0x7f1b6c068130 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b7807c560 con 0x7f1b88154540 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b85d9b700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f1b6c068130 0x7f1b6c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b85d9b700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f1b6c068130 0x7f1b6c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.299+0000 7f1b8659c700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1b6c05ed90 0x7f1b6c061250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1b80001560 tx=0x7f1b80009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.300+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== osd.0 v2:172.21.15.52:6816/116680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1b6c06ac10 con 0x7f1b6c068130 2023-05-10T01:09:59.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.314+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 --> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b880c2480 con 0x7f1b6c068130 2023-05-10T01:09:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.314+0000 7f1b7e7fc700 1 -- 172.21.15.52:0/2365263420 <== osd.0 v2:172.21.15.52:6816/116680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b880c2480 con 0x7f1b6c068130 2023-05-10T01:09:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f1b6c068130 msgr2=0x7f1b6c06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f1b6c068130 0x7f1b6c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1b6c05ed90 msgr2=0x7f1b6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1b6c05ed90 0x7f1b6c061250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1b80001560 tx=0x7f1b80009040).stop 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 msgr2=0x7f1b88156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 --2- 172.21.15.52:0/2365263420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b88154540 0x7f1b88156430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1b7800e900 tx=0x7f1b78009060).stop 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b86d9d700 1 -- 172.21.15.52:0/2365263420 reap_dead start 2023-05-10T01:09:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 shutdown_connections 2023-05-10T01:09:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 >> 172.21.15.52:0/2365263420 conn(0x7f1b880cb6f0 msgr2=0x7f1b880ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 shutdown_connections 2023-05-10T01:09:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.315+0000 7f1b8cbbe700 1 -- 172.21.15.52:0/2365263420 wait complete. 2023-05-10T01:09:59.329 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:09:59.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-10T01:09:59.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.444+0000 7fdb3512b700 1 Processor -- start 2023-05-10T01:09:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.444+0000 7fdb3512b700 1 -- start start 2023-05-10T01:09:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3512b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 0x7fdb30069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3512b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 0x7fdb30153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3512b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3006a910 con 0x7fdb300aab30 2023-05-10T01:09:59.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3512b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300c65e0 con 0x7fdb30153af0 2023-05-10T01:09:59.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3512b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300bfa20 con 0x7fdb30069740 2023-05-10T01:09:59.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdb300aab30 0x7fdb300c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39304/0 (socket says 172.21.15.52:39304) 2023-05-10T01:09:59.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2f7fe700 1 -- 172.21.15.52:0/3379815004 learned_addr learned my addr 172.21.15.52:0/3379815004 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:59.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3379815004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 0x7fdb30069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3492a700 1 --2- 172.21.15.52:0/3379815004 >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 0x7fdb30153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12167847 0 0) 0x7fdb3006a910 con 0x7fdb300aab30 2023-05-10T01:09:59.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb100033f0 con 0x7fdb300aab30 2023-05-10T01:09:59.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2ffff700 1 -- 172.21.15.52:0/3379815004 >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 msgr2=0x7fdb30153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:59.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3379815004 >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 0x7fdb30153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1904154069 0 0) 0x7fdb100033f0 con 0x7fdb300aab30 2023-05-10T01:09:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2ffff700 1 -- 172.21.15.52:0/3379815004 >> v1:172.21.15.52:6789/0 conn(0x7fdb300aab30 legacy=0x7fdb300c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb2ffff700 1 -- 172.21.15.52:0/3379815004 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300bfc70 con 0x7fdb30069740 2023-05-10T01:09:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.445+0000 7fdb3492a700 1 --2- 172.21.15.52:0/3379815004 >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 0x7fdb30153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3379815004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 0x7fdb30069b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdb18009760 tx=0x7fdb18009060).ready entity=mon.2 client_cookie=59edae169ecb7a7e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20001470 con 0x7fdb30069740 2023-05-10T01:09:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18011400 con 0x7fdb30069740 2023-05-10T01:09:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb2effd700 1 -- 172.21.15.52:0/3379815004 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18011780 con 0x7fdb30069740 2023-05-10T01:09:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 -- 172.21.15.52:0/3379815004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 msgr2=0x7fdb30069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3379815004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 0x7fdb30069b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdb18009760 tx=0x7fdb18009060).stop 2023-05-10T01:09:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 -- 172.21.15.52:0/3379815004 shutdown_connections 2023-05-10T01:09:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3379815004 >> v2:172.21.15.172:3300/0 conn(0x7fdb30153af0 0x7fdb30153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3379815004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30069740 0x7fdb30069b20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 -- 172.21.15.52:0/3379815004 >> 172.21.15.52:0/3379815004 conn(0x7fdb300cb540 msgr2=0x7fdb300c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 -- 172.21.15.52:0/3379815004 shutdown_connections 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.446+0000 7fdb3512b700 1 -- 172.21.15.52:0/3379815004 wait complete. 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.447+0000 7fdb3512b700 1 Processor -- start 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 -- start start 2023-05-10T01:09:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30069740 0x7fdb3014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 0x7fdb3014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30153af0 0x7fdb301529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300af5c0 con 0x7fdb300aab30 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3014ee20 con 0x7fdb30069740 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb3512b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3014f100 con 0x7fdb30153af0 2023-05-10T01:09:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 0x7fdb3014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 0x7fdb3014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58526/0 (socket says 172.21.15.52:58526) 2023-05-10T01:09:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.448+0000 7fdb2f7fe700 1 -- 172.21.15.52:0/3748151340 learned_addr learned my addr 172.21.15.52:0/3748151340 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30069740 0x7fdb3014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb3492a700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30153af0 0x7fdb301529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 -- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30153af0 msgr2=0x7fdb301529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb30153af0 0x7fdb301529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 -- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30069740 msgr2=0x7fdb3014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30069740 0x7fdb3014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009a20 con 0x7fdb300aab30 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb2f7fe700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 0x7fdb3014bf80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fdb2000c760 tx=0x7fdb20001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007320 con 0x7fdb300aab30 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200074a0 con 0x7fdb300aab30 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180092a0 con 0x7fdb300aab30 2023-05-10T01:09:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20005990 con 0x7fdb300aab30 2023-05-10T01:09:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.449+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb300af250 con 0x7fdb300aab30 2023-05-10T01:09:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.450+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb30083030 con 0x7fdb300aab30 2023-05-10T01:09:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.450+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb20010030 con 0x7fdb300aab30 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb27fff700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdb1405ed90 0x7fdb14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb20079b50 con 0x7fdb300aab30 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdb1405ed90 0x7fdb14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb27fff700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fdb14068130 0x7fdb1406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb1406ac10 con 0x7fdb14068130 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2007e220 con 0x7fdb300aab30 2023-05-10T01:09:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb3492a700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fdb14068130 0x7fdb1406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb2ffff700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdb1405ed90 0x7fdb14061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdb18009760 tx=0x7fdb18016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.451+0000 7fdb3492a700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fdb14068130 0x7fdb1406a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.452+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== osd.1 v2:172.21.15.52:6817/116664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fdb1406ac10 con 0x7fdb14068130 2023-05-10T01:09:59.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.466+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 --> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb30047150 con 0x7fdb14068130 2023-05-10T01:09:59.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb27fff700 1 -- 172.21.15.52:0/3748151340 <== osd.1 v2:172.21.15.52:6817/116664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb30047150 con 0x7fdb14068130 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fdb14068130 msgr2=0x7fdb1406a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fdb14068130 0x7fdb1406a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdb1405ed90 msgr2=0x7fdb14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdb1405ed90 0x7fdb14061250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdb18009760 tx=0x7fdb18016000).stop 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 msgr2=0x7fdb3014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 --2- 172.21.15.52:0/3748151340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb300aab30 0x7fdb3014bf80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fdb2000c760 tx=0x7fdb20001aa0).stop 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3492a700 1 -- 172.21.15.52:0/3748151340 reap_dead start 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 shutdown_connections 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 >> 172.21.15.52:0/3748151340 conn(0x7fdb300cb540 msgr2=0x7fdb300c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 shutdown_connections 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.467+0000 7fdb3512b700 1 -- 172.21.15.52:0/3748151340 wait complete. 2023-05-10T01:09:59.558 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:09:59.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-10T01:09:59.603 INFO:tasks.ceph.mds.b.smithi172.stderr:2023-05-10T01:09:59.599+0000 7f1d3c937700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:09:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.673+0000 7f453b229700 1 Processor -- start 2023-05-10T01:09:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.673+0000 7f453b229700 1 -- start start 2023-05-10T01:09:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f453b229700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4534154160 0x7f45340c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f453b229700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340c0650 con 0x7f4534154540 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f453b229700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340bfd20 con 0x7f4534069da0 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f453b229700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340c0000 con 0x7f4534154160 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4538fc5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4534154160 0x7f45340c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4533fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4534154540 0x7f4534069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39322/0 (socket says 172.21.15.52:39322) 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4533fff700 1 -- 172.21.15.52:0/3903747674 learned_addr learned my addr 172.21.15.52:0/3903747674 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4538fc5700 1 -- 172.21.15.52:0/3903747674 >> v1:172.21.15.172:6789/0 conn(0x7f4534069da0 legacy=0x7f45340c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4538fc5700 1 -- 172.21.15.52:0/3903747674 >> v1:172.21.15.52:6789/0 conn(0x7f4534154540 legacy=0x7f4534069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f4538fc5700 1 -- 172.21.15.52:0/3903747674 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340c02e0 con 0x7f4534154160 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.674+0000 7f45337fe700 1 -- 172.21.15.52:0/3903747674 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241045906 0 0) 0x7f45340c0650 con 0x7f4534154540 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f4538fc5700 1 --2- 172.21.15.52:0/3903747674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154160 0x7f45340c5c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f452c009760 tx=0x7f452c009060).ready entity=mon.0 client_cookie=74c36ef342466ce7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f45337fe700 1 -- 172.21.15.52:0/3903747674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c009120 con 0x7f4534154160 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f45337fe700 1 -- 172.21.15.52:0/3903747674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00b580 con 0x7f4534154160 2023-05-10T01:09:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f45337fe700 1 -- 172.21.15.52:0/3903747674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00b900 con 0x7f4534154160 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 -- 172.21.15.52:0/3903747674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154160 msgr2=0x7f45340c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 --2- 172.21.15.52:0/3903747674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154160 0x7f45340c5c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f452c009760 tx=0x7f452c009060).stop 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 -- 172.21.15.52:0/3903747674 shutdown_connections 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 --2- 172.21.15.52:0/3903747674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154160 0x7f45340c5c60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 -- 172.21.15.52:0/3903747674 >> 172.21.15.52:0/3903747674 conn(0x7f45340cb6f0 msgr2=0x7f45340c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 -- 172.21.15.52:0/3903747674 shutdown_connections 2023-05-10T01:09:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.675+0000 7f453b229700 1 -- 172.21.15.52:0/3903747674 wait complete. 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 Processor -- start 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 -- start start 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4534069da0 0x7f45340af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4534154160 0x7f453414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 0x7f45340c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534158a30 con 0x7f4534154540 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534167cc0 con 0x7f4534069da0 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.677+0000 7f453b229700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4534168b20 con 0x7f4534154160 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 0x7f45340c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 0x7f45340c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58546/0 (socket says 172.21.15.52:58546) 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 -- 172.21.15.52:0/1388996084 learned_addr learned my addr 172.21.15.52:0/1388996084 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f4538fc5700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4534069da0 0x7f45340af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f4533fff700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4534154160 0x7f453414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 -- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4534154160 msgr2=0x7f453414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4534154160 0x7f453414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 -- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4534069da0 msgr2=0x7f45340af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4534069da0 0x7f45340af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0092a0 con 0x7f4534154540 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f45397c6700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 0x7f45340c3d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f452400c790 tx=0x7f45240015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400e4a0 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452400e600 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534167f10 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400e980 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.678+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45341684d0 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.679+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45340666b0 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4524019030 con 0x7f4534154540 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f451805ed60 0x7f4518061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4524078fc0 con 0x7f4534154540 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4538fc5700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f451805ed60 0x7f4518061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7f4518068100 0x7f451806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f451806abe0 con 0x7f4518068100 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f452407b630 con 0x7f4534154540 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4533fff700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7f4518068100 0x7f451806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4538fc5700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f451805ed60 0x7f4518061220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f452c006e00 tx=0x7f452c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.680+0000 7f4533fff700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7f4518068100 0x7f451806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.681+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== osd.2 v2:172.21.15.52:6800/116667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f451806abe0 con 0x7f4518068100 2023-05-10T01:09:59.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.695+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 --> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4534066870 con 0x7f4518068100 2023-05-10T01:09:59.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f4530ff9700 1 -- 172.21.15.52:0/1388996084 <== osd.2 v2:172.21.15.52:6800/116667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4534066870 con 0x7f4518068100 2023-05-10T01:09:59.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7f4518068100 msgr2=0x7f451806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7f4518068100 0x7f451806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f451805ed60 msgr2=0x7f4518061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f451805ed60 0x7f4518061220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f452c006e00 tx=0x7f452c017000).stop 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 msgr2=0x7f45340c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 --2- 172.21.15.52:0/1388996084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4534154540 0x7f45340c3d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f452400c790 tx=0x7f45240015e0).stop 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f45397c6700 1 -- 172.21.15.52:0/1388996084 reap_dead start 2023-05-10T01:09:59.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 shutdown_connections 2023-05-10T01:09:59.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 >> 172.21.15.52:0/1388996084 conn(0x7f45340cb6f0 msgr2=0x7f45340ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 shutdown_connections 2023-05-10T01:09:59.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.696+0000 7f453b229700 1 -- 172.21.15.52:0/1388996084 wait complete. 2023-05-10T01:09:59.710 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:09:59.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-10T01:09:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.825+0000 7f0af9a4c700 1 Processor -- start 2023-05-10T01:09:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.825+0000 7f0af9a4c700 1 -- start start 2023-05-10T01:09:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af9a4c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0af40629b0 0x7f0af40c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af9a4c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af40c37e0 con 0x7f0af40c3090 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af9a4c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af40bef80 con 0x7f0af4138690 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af9a4c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af4138a70 con 0x7f0af40629b0 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0af40629b0 0x7f0af40c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0af40c3090 0x7f0af4138f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39340/0 (socket says 172.21.15.52:39340) 2023-05-10T01:09:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.826+0000 7f0af37fe700 1 -- 172.21.15.52:0/1349624470 learned_addr learned my addr 172.21.15.52:0/1349624470 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af27fc700 1 -- 172.21.15.52:0/1349624470 >> v1:172.21.15.172:6789/0 conn(0x7f0af4138690 legacy=0x7f0af40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af27fc700 1 -- 172.21.15.52:0/1349624470 >> v1:172.21.15.52:6789/0 conn(0x7f0af40c3090 legacy=0x7f0af4138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af27fc700 1 -- 172.21.15.52:0/1349624470 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40be3c0 con 0x7f0af40629b0 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af1ffb700 1 -- 172.21.15.52:0/1349624470 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568045184 0 0) 0x7f0af40c37e0 con 0x7f0af40c3090 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af27fc700 1 --2- 172.21.15.52:0/1349624470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af40c4eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0adc009760 tx=0x7f0adc009060).ready entity=mon.0 client_cookie=5ee8eb9c9fe75db server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af1ffb700 1 -- 172.21.15.52:0/1349624470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00b580 con 0x7f0af40629b0 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af1ffb700 1 -- 172.21.15.52:0/1349624470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00b6e0 con 0x7f0af40629b0 2023-05-10T01:09:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af1ffb700 1 -- 172.21.15.52:0/1349624470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00ba60 con 0x7f0af40629b0 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1349624470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 msgr2=0x7f0af40c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af9a4c700 1 --2- 172.21.15.52:0/1349624470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af40c4eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0adc009760 tx=0x7f0adc009060).stop 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1349624470 shutdown_connections 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af9a4c700 1 --2- 172.21.15.52:0/1349624470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af40c4eb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.827+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1349624470 >> 172.21.15.52:0/1349624470 conn(0x7f0af40c8a90 msgr2=0x7f0af40c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.828+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1349624470 shutdown_connections 2023-05-10T01:09:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.828+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1349624470 wait complete. 2023-05-10T01:09:59.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.829+0000 7f0af9a4c700 1 Processor -- start 2023-05-10T01:09:59.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.829+0000 7f0af9a4c700 1 -- start start 2023-05-10T01:09:59.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.829+0000 7f0af9a4c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.829+0000 7f0af9a4c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0af40c3090 0x7f0af40bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0af4138690 0x7f0af40c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af4156030 con 0x7f0af40629b0 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c0020 con 0x7f0af4138690 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af4155700 con 0x7f0af40c3090 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af41564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58558/0 (socket says 172.21.15.52:58558) 2023-05-10T01:09:59.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 -- 172.21.15.52:0/1591383382 learned_addr learned my addr 172.21.15.52:0/1591383382 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af37fe700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0af4138690 0x7f0af40c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af27fc700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0af40c3090 0x7f0af40bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 -- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0af40c3090 msgr2=0x7f0af40bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0af40c3090 0x7f0af40bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 -- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0af4138690 msgr2=0x7f0af40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0af4138690 0x7f0af40c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0092a0 con 0x7f0af40629b0 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af2ffd700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af41564c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0aec00c4c0 tx=0x7f0aec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00ce70 con 0x7f0af40629b0 2023-05-10T01:09:59.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec001e90 con 0x7f0af40629b0 2023-05-10T01:09:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af41559e0 con 0x7f0af40629b0 2023-05-10T01:09:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec007250 con 0x7f0af40629b0 2023-05-10T01:09:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.830+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af40c02f0 con 0x7f0af40629b0 2023-05-10T01:09:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.831+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0af406c340 con 0x7f0af40629b0 2023-05-10T01:09:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0aec010070 con 0x7f0af40629b0 2023-05-10T01:09:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0ad805ed60 0x7f0ad8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0aec079250 con 0x7f0af40629b0 2023-05-10T01:09:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7f0ad8068100 0x7f0ad806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ad806abe0 con 0x7f0ad8068100 2023-05-10T01:09:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aec07b8c0 con 0x7f0af40629b0 2023-05-10T01:09:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0af27fc700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0ad805ed60 0x7f0ad8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.832+0000 7f0af37fe700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7f0ad8068100 0x7f0ad806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.833+0000 7f0af37fe700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7f0ad8068100 0x7f0ad806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.833+0000 7f0af27fc700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0ad805ed60 0x7f0ad8061220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0adc00b340 tx=0x7f0adc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.833+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== osd.3 v2:172.21.15.52:6808/116668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0ad806abe0 con 0x7f0ad8068100 2023-05-10T01:09:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 --> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0af4156170 con 0x7f0ad8068100 2023-05-10T01:09:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0aeaffd700 1 -- 172.21.15.52:0/1591383382 <== osd.3 v2:172.21.15.52:6808/116668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ae4001fb0 con 0x7f0ad8068100 2023-05-10T01:09:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7f0ad8068100 msgr2=0x7f0ad806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7f0ad8068100 0x7f0ad806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0ad805ed60 msgr2=0x7f0ad8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0ad805ed60 0x7f0ad8061220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0adc00b340 tx=0x7f0adc017000).stop 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 msgr2=0x7f0af41564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 --2- 172.21.15.52:0/1591383382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af40629b0 0x7f0af41564c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0aec00c4c0 tx=0x7f0aec007e00).stop 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af37fe700 1 -- 172.21.15.52:0/1591383382 reap_dead start 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 shutdown_connections 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 >> 172.21.15.52:0/1591383382 conn(0x7f0af40c8a90 msgr2=0x7f0af41379c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 shutdown_connections 2023-05-10T01:09:59.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.848+0000 7f0af9a4c700 1 -- 172.21.15.52:0/1591383382 wait complete. 2023-05-10T01:09:59.862 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:09:59.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-10T01:09:59.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.977+0000 7f44acd97700 1 Processor -- start 2023-05-10T01:09:59.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.977+0000 7f44acd97700 1 -- start start 2023-05-10T01:09:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44acd97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44acd97700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44a8153af0 0x7f44a8153f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44acd97700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a806a910 con 0x7f44a8069740 2023-05-10T01:09:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44acd97700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a80c65e0 con 0x7f44a8153af0 2023-05-10T01:09:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44acd97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80bfa20 con 0x7f44a80aab30 2023-05-10T01:09:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a6ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44a8153af0 0x7f44a8153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a6ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:49974/0 (socket says 172.21.15.52:49974) 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44a8153af0 0x7f44a8153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:56896/0 (socket says 172.21.15.52:56896) 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a6ffd700 1 -- 172.21.15.52:0/3829697439 learned_addr learned my addr 172.21.15.52:0/3829697439 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a67fc700 1 -- 172.21.15.52:0/3829697439 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870307188 0 0) 0x7f44a806a910 con 0x7f44a8069740 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a67fc700 1 -- 172.21.15.52:0/3829697439 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44880033f0 con 0x7f44a8069740 2023-05-10T01:09:59.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 -- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 msgr2=0x7f44a8069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 -- 172.21.15.52:0/3829697439 >> v1:172.21.15.172:6789/0 conn(0x7f44a8069740 legacy=0x7f44a80c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a7fff700 1 -- 172.21.15.52:0/3829697439 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80bfc70 con 0x7f44a8153af0 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.978+0000 7f44a6ffd700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44a7fff700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8153af0 0x7f44a8153f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f44a0009e60 tx=0x7f44a0009780).ready entity=mon.1 client_cookie=63b3ccb9d3bdc8a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44a67fc700 1 -- 172.21.15.52:0/3829697439 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000e070 con 0x7f44a8153af0 2023-05-10T01:09:59.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44a67fc700 1 -- 172.21.15.52:0/3829697439 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000bab0 con 0x7f44a8153af0 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44a67fc700 1 -- 172.21.15.52:0/3829697439 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000be30 con 0x7f44a8153af0 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 -- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8153af0 msgr2=0x7f44a8153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8153af0 0x7f44a8153f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f44a0009e60 tx=0x7f44a0009780).stop 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 -- 172.21.15.52:0/3829697439 shutdown_connections 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8153af0 0x7f44a8153f60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 --2- 172.21.15.52:0/3829697439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a8069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 -- 172.21.15.52:0/3829697439 >> 172.21.15.52:0/3829697439 conn(0x7f44a80cb540 msgr2=0x7f44a80c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:09:59.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 -- 172.21.15.52:0/3829697439 shutdown_connections 2023-05-10T01:09:59.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.979+0000 7f44acd97700 1 -- 172.21.15.52:0/3829697439 wait complete. 2023-05-10T01:09:59.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.980+0000 7f44acd97700 1 Processor -- start 2023-05-10T01:09:59.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 -- start start 2023-05-10T01:09:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8069740 0x7f44a80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a80c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 0x7f44a8148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8165710 con 0x7f44a8153af0 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80c2a20 con 0x7f44a8069740 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44acd97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80c2c70 con 0x7f44a80aab30 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 0x7f44a8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 0x7f44a8148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58578/0 (socket says 172.21.15.52:58578) 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.981+0000 7f44a7fff700 1 -- 172.21.15.52:0/1522524882 learned_addr learned my addr 172.21.15.52:0/1522524882 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:09:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a6ffd700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a80c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a77fe700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8069740 0x7f44a80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 -- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 msgr2=0x7f44a80c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44a80aab30 0x7f44a80c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 -- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8069740 msgr2=0x7f44a80c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a8069740 0x7f44a80c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009370 con 0x7f44a8153af0 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44a7fff700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 0x7f44a8148420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f44a0013cc0 tx=0x7f44a0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0013ea0 con 0x7f44a8153af0 2023-05-10T01:09:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a001d630 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0009a20 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a001d9f0 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.982+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a80c3230 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.983+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44a8083030 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.983+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f44a0026410 con 0x7f44a8153af0 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f449f7fe700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f448c05ed90 0x7f448c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44a007bbf0 con 0x7f44a8153af0 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f449f7fe700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7f448c068130 0x7f448c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f448c06ac10 con 0x7f448c068130 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a007e260 con 0x7f44a8153af0 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f44a77fe700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f448c05ed90 0x7f448c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f44a6ffd700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7f448c068130 0x7f448c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.984+0000 7f44a77fe700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f448c05ed90 0x7f448c061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4490007fd0 tx=0x7f4490007bd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.985+0000 7f44a6ffd700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7f448c068130 0x7f448c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:09:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:09:59.986+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== osd.4 v2:172.21.15.172:6818/116794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f448c06ac10 con 0x7f448c068130 2023-05-10T01:10:00.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.000+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 --> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44a81659f0 con 0x7f448c068130 2023-05-10T01:10:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.000+0000 7f449f7fe700 1 -- 172.21.15.52:0/1522524882 <== osd.4 v2:172.21.15.172:6818/116794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f44a81659f0 con 0x7f448c068130 2023-05-10T01:10:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7f448c068130 msgr2=0x7f448c06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7f448c068130 0x7f448c06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f448c05ed90 msgr2=0x7f448c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f448c05ed90 0x7f448c061250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4490007fd0 tx=0x7f4490007bd0).stop 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 msgr2=0x7f44a8148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 --2- 172.21.15.52:0/1522524882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44a8153af0 0x7f44a8148420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f44a0013cc0 tx=0x7f44a0009780).stop 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44a7fff700 1 -- 172.21.15.52:0/1522524882 reap_dead start 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 shutdown_connections 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 >> 172.21.15.52:0/1522524882 conn(0x7f44a80cb540 msgr2=0x7f44a80aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 shutdown_connections 2023-05-10T01:10:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.001+0000 7f44acd97700 1 -- 172.21.15.52:0/1522524882 wait complete. 2023-05-10T01:10:00.016 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:10:00.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-10T01:10:00.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.133+0000 7fd799539700 1 Processor -- start 2023-05-10T01:10:00.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.133+0000 7fd799539700 1 -- start start 2023-05-10T01:10:00.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.133+0000 7fd799539700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 0x7fd794150f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd799539700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7940a61c0 con 0x7fd794150b40 2023-05-10T01:10:00.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd799539700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794066320 con 0x7fd794068f00 2023-05-10T01:10:00.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd799539700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd794069400 con 0x7fd7940bcff0 2023-05-10T01:10:00.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd792ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd794150b40 0x7fd7940a5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39368/0 (socket says 172.21.15.52:39368) 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd792ffd700 1 -- 172.21.15.52:0/3019390288 learned_addr learned my addr 172.21.15.52:0/3019390288 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677709725 0 0) 0x7fd7940a61c0 con 0x7fd794150b40 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7740033f0 con 0x7fd794150b40 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213380435 0 0) 0x7fd7740033f0 con 0x7fd794150b40 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 msgr2=0x7fd794150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 0x7fd794150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 >> v1:172.21.15.172:6789/0 conn(0x7fd794068f00 legacy=0x7fd7940bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7940696e0 con 0x7fd794150b40 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd78c001470 con 0x7fd794150b40 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 >> v1:172.21.15.52:6789/0 conn(0x7fd794150b40 legacy=0x7fd7940a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774003910 0x7fd774003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd774004690 0x7fd774004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 0x7fd774005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794069400 con 0x7fd774004690 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400bac0 con 0x7fd774003910 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400bc80 con 0x7fd7940bcff0 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd7927fc700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd774004690 0x7fd774004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd792ffd700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774003910 0x7fd774003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.134+0000 7fd7937fe700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 0x7fd774005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 -- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 msgr2=0x7fd774005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bcff0 0x7fd774005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 -- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774003910 msgr2=0x7fd774003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774003910 0x7fd774003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 -- 172.21.15.52:0/3019390288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740033f0 con 0x7fd774004690 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd792ffd700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774003910 0x7fd774003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7927fc700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd774004690 0x7fd774004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd77c001e00 tx=0x7fd77c007f30).ready entity=mon.0 client_cookie=8bd0b386b6341356 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c006a20 con 0x7fd774004690 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c006b80 con 0x7fd774004690 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd791ffb700 1 -- 172.21.15.52:0/3019390288 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00c5d0 con 0x7fd774004690 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 -- 172.21.15.52:0/3019390288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd774004690 msgr2=0x7fd774004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 --2- 172.21.15.52:0/3019390288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd774004690 0x7fd774004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd77c001e00 tx=0x7fd77c007f30).stop 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd7937fe700 1 -- 172.21.15.52:0/3019390288 reap_dead start 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 -- 172.21.15.52:0/3019390288 shutdown_connections 2023-05-10T01:10:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 -- 172.21.15.52:0/3019390288 >> 172.21.15.52:0/3019390288 conn(0x7fd7940c7340 msgr2=0x7fd7940c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 -- 172.21.15.52:0/3019390288 shutdown_connections 2023-05-10T01:10:00.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.135+0000 7fd799539700 1 -- 172.21.15.52:0/3019390288 wait complete. 2023-05-10T01:10:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 Processor -- start 2023-05-10T01:10:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 -- start start 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774004690 0x7fd794149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bd910 0x7fd7940a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 0x7fd7941499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940beb00 con 0x7fd7940bef90 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940a93c0 con 0x7fd774004690 2023-05-10T01:10:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.137+0000 7fd799539700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940bdef0 con 0x7fd7940bd910 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 0x7fd7941499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 0x7fd7941499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58600/0 (socket says 172.21.15.52:58600) 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 -- 172.21.15.52:0/2330311023 learned_addr learned my addr 172.21.15.52:0/2330311023 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd792ffd700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774004690 0x7fd794149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7927fc700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bd910 0x7fd7940a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 -- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bd910 msgr2=0x7fd7940a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7940bd910 0x7fd7940a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 -- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774004690 msgr2=0x7fd794149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd774004690 0x7fd794149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7940be1d0 con 0x7fd7940bef90 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd7937fe700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 0x7fd7941499f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd774005670 tx=0x7fd784006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784013450 con 0x7fd7940bef90 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7840135b0 con 0x7fd7940bef90 2023-05-10T01:10:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7940be4b0 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784013930 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.138+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940ac8b0 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.139+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd79406c340 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.139+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd78401a030 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd78affd700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd77805ed90 0x7fd778061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd7840798b0 con 0x7fd7940bef90 2023-05-10T01:10:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd792ffd700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd77805ed90 0x7fd778061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd78affd700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7fd778068130 0x7fd77806a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd77806ac10 con 0x7fd778068130 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd784079cb0 con 0x7fd7940bef90 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd7927fc700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7fd778068130 0x7fd77806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.140+0000 7fd792ffd700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd77805ed90 0x7fd778061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd78c001ce0 tx=0x7fd78c001e50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.141+0000 7fd7927fc700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7fd778068130 0x7fd77806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.141+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== osd.5 v2:172.21.15.172:6800/116763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd77806ac10 con 0x7fd778068130 2023-05-10T01:10:00.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.156+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 --> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7940699c0 con 0x7fd778068130 2023-05-10T01:10:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.156+0000 7fd78affd700 1 -- 172.21.15.52:0/2330311023 <== osd.5 v2:172.21.15.172:6800/116763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7940699c0 con 0x7fd778068130 2023-05-10T01:10:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7fd778068130 msgr2=0x7fd77806a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7fd778068130 0x7fd77806a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd77805ed90 msgr2=0x7fd778061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd77805ed90 0x7fd778061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd78c001ce0 tx=0x7fd78c001e50).stop 2023-05-10T01:10:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 msgr2=0x7fd7941499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 --2- 172.21.15.52:0/2330311023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7940bef90 0x7fd7941499f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd774005670 tx=0x7fd784006e50).stop 2023-05-10T01:10:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd7937fe700 1 -- 172.21.15.52:0/2330311023 reap_dead start 2023-05-10T01:10:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 shutdown_connections 2023-05-10T01:10:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 >> 172.21.15.52:0/2330311023 conn(0x7fd7940c7340 msgr2=0x7fd794158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 shutdown_connections 2023-05-10T01:10:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.157+0000 7fd799539700 1 -- 172.21.15.52:0/2330311023 wait complete. 2023-05-10T01:10:00.171 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2023-05-10T01:10:00.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-10T01:10:00.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.286+0000 7f3922537700 1 Processor -- start 2023-05-10T01:10:00.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.286+0000 7f3922537700 1 -- start start 2023-05-10T01:10:00.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3922537700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f391c0bd840 0x7f391c0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3922537700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f391c0a5ff0 0x7f391c0c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3922537700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c065fd0 con 0x7f391c1501d0 2023-05-10T01:10:00.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3922537700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0667e0 con 0x7f391c0a5ff0 2023-05-10T01:10:00.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3922537700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c066220 con 0x7f391c0bd840 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f391c0a5ff0 0x7f391c0c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921535700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f391c1501d0 0x7f391c0a53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39390/0 (socket says 172.21.15.52:39390) 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921535700 1 -- 172.21.15.52:0/3982434673 learned_addr learned my addr 172.21.15.52:0/3982434673 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3920d34700 1 --2- 172.21.15.52:0/3982434673 >> v2:172.21.15.172:3300/0 conn(0x7f391c0bd840 0x7f391c0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 -- 172.21.15.52:0/3982434673 >> v2:172.21.15.172:3300/0 conn(0x7f391c0bd840 msgr2=0x7f391c0a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 --2- 172.21.15.52:0/3982434673 >> v2:172.21.15.172:3300/0 conn(0x7f391c0bd840 0x7f391c0a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 -- 172.21.15.52:0/3982434673 >> v1:172.21.15.52:6789/0 conn(0x7f391c1501d0 legacy=0x7f391c0a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 -- 172.21.15.52:0/3982434673 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c066500 con 0x7f391c0a5ff0 2023-05-10T01:10:00.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f390bfff700 1 -- 172.21.15.52:0/3982434673 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486205044 0 0) 0x7f391c065fd0 con 0x7f391c1501d0 2023-05-10T01:10:00.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f3921d36700 1 --2- 172.21.15.52:0/3982434673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c0c1b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f391c0a69d0 tx=0x7f391400b990).ready entity=mon.0 client_cookie=e5eb0179b7b35798 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f390bfff700 1 -- 172.21.15.52:0/3982434673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914010070 con 0x7f391c0a5ff0 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f390bfff700 1 -- 172.21.15.52:0/3982434673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400b2e0 con 0x7f391c0a5ff0 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.287+0000 7f390bfff700 1 -- 172.21.15.52:0/3982434673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400dd10 con 0x7f391c0a5ff0 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 -- 172.21.15.52:0/3982434673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 msgr2=0x7f391c0c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 --2- 172.21.15.52:0/3982434673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c0c1b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f391c0a69d0 tx=0x7f391400b990).stop 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 -- 172.21.15.52:0/3982434673 shutdown_connections 2023-05-10T01:10:00.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 --2- 172.21.15.52:0/3982434673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c0c1b70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 --2- 172.21.15.52:0/3982434673 >> v2:172.21.15.172:3300/0 conn(0x7f391c0bd840 0x7f391c0a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 -- 172.21.15.52:0/3982434673 >> 172.21.15.52:0/3982434673 conn(0x7f391c0c4460 msgr2=0x7f391c0bbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 -- 172.21.15.52:0/3982434673 shutdown_connections 2023-05-10T01:10:00.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.288+0000 7f3922537700 1 -- 172.21.15.52:0/3982434673 wait complete. 2023-05-10T01:10:00.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.289+0000 7f3922537700 1 Processor -- start 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.289+0000 7f3922537700 1 -- start start 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f391c0bd840 0x7f391c1631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f391c1501d0 0x7f391c163690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c163b80 con 0x7f391c0a5ff0 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0a8820 con 0x7f391c0bd840 2023-05-10T01:10:00.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3922537700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0a8b00 con 0x7f391c1501d0 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c15f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58614/0 (socket says 172.21.15.52:58614) 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 -- 172.21.15.52:0/4130898565 learned_addr learned my addr 172.21.15.52:0/4130898565 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3920d34700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f391c0bd840 0x7f391c1631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921d36700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f391c1501d0 0x7f391c163690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 -- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f391c1501d0 msgr2=0x7f391c163690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f391c1501d0 0x7f391c163690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 -- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f391c0bd840 msgr2=0x7f391c1631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f391c0bd840 0x7f391c1631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.290+0000 7f3921535700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391400bc30 con 0x7f391c0a5ff0 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f3921535700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c15f420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f391800c490 tx=0x7f3918007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180072e0 con 0x7f391c0a5ff0 2023-05-10T01:10:00.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918007440 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180057a0 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0a8de0 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c15f910 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.291+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f391c0aa650 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.292+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3918010070 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.292+0000 7f39097fa700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f38fc05ed90 0x7f38fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3918079a10 con 0x7f391c0a5ff0 2023-05-10T01:10:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f39097fa700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f38fc068130 0x7f38fc06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38fc06ac10 con 0x7f38fc068130 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3918079e10 con 0x7f391c0a5ff0 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f3920d34700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f38fc05ed90 0x7f38fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f3921d36700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f38fc068130 0x7f38fc06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f3920d34700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f38fc05ed90 0x7f38fc061250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f391c0aa3c0 tx=0x7f390c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.293+0000 7f3921d36700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f38fc068130 0x7f38fc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.294+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== osd.6 v2:172.21.15.172:6808/116764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f38fc06ac10 con 0x7f38fc068130 2023-05-10T01:10:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.308+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 --> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f391c047150 con 0x7f38fc068130 2023-05-10T01:10:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.309+0000 7f39097fa700 1 -- 172.21.15.52:0/4130898565 <== osd.6 v2:172.21.15.172:6808/116764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f391c047150 con 0x7f38fc068130 2023-05-10T01:10:00.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.309+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f38fc068130 msgr2=0x7f38fc06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.309+0000 7f3922537700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f38fc068130 0x7f38fc06a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f38fc05ed90 msgr2=0x7f38fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f38fc05ed90 0x7f38fc061250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f391c0aa3c0 tx=0x7f390c008040).stop 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 msgr2=0x7f391c15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 --2- 172.21.15.52:0/4130898565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f391c0a5ff0 0x7f391c15f420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f391800c490 tx=0x7f3918007e40).stop 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3921d36700 1 -- 172.21.15.52:0/4130898565 reap_dead start 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 shutdown_connections 2023-05-10T01:10:00.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 >> 172.21.15.52:0/4130898565 conn(0x7f391c0c4460 msgr2=0x7f391c0a53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 shutdown_connections 2023-05-10T01:10:00.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.310+0000 7f3922537700 1 -- 172.21.15.52:0/4130898565 wait complete. 2023-05-10T01:10:00.323 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:10:00.324 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-10T01:10:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.438+0000 7f998ab39700 1 Processor -- start 2023-05-10T01:10:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.438+0000 7f998ab39700 1 -- start start 2023-05-10T01:10:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f998ab39700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99841519f0 0x7f9984066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f998ab39700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9984151dd0 0x7f99840bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f998ab39700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99840a6cd0 con 0x7f99840bc530 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f998ab39700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9984152250 con 0x7f99841519f0 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f998ab39700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99840c4b10 con 0x7f9984151dd0 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f99888d5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99841519f0 0x7f9984066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f9983fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9984151dd0 0x7f99840bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f99888d5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99841519f0 0x7f9984066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:56946/0 (socket says 172.21.15.52:56946) 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.439+0000 7f99890d6700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f99840bc530 0x7f9984067850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:41944/0 (socket says 172.21.15.52:41944) 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 -- 172.21.15.52:0/4247027685 learned_addr learned my addr 172.21.15.52:0/4247027685 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 -- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9984151dd0 msgr2=0x7f99840bc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 --2- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9984151dd0 0x7f99840bc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 -- 172.21.15.52:0/4247027685 >> v1:172.21.15.172:6789/0 conn(0x7f99840bc530 legacy=0x7f9984067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99837fe700 1 -- 172.21.15.52:0/4247027685 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142820217 0 0) 0x7f99840a6cd0 con 0x7f99840bc530 2023-05-10T01:10:00.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 -- 172.21.15.52:0/4247027685 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984066a00 con 0x7f99841519f0 2023-05-10T01:10:00.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99888d5700 1 --2- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984066390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f997c009f20 tx=0x7f997c009840).ready entity=mon.1 client_cookie=c9caa9c109763444 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99837fe700 1 -- 172.21.15.52:0/4247027685 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00e070 con 0x7f99841519f0 2023-05-10T01:10:00.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99837fe700 1 -- 172.21.15.52:0/4247027685 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c00b9d0 con 0x7f99841519f0 2023-05-10T01:10:00.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.440+0000 7f99837fe700 1 -- 172.21.15.52:0/4247027685 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00bd50 con 0x7f99841519f0 2023-05-10T01:10:00.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 -- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 msgr2=0x7f9984066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 --2- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984066390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f997c009f20 tx=0x7f997c009840).stop 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 -- 172.21.15.52:0/4247027685 shutdown_connections 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 --2- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984066390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 --2- 172.21.15.52:0/4247027685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9984151dd0 0x7f99840bc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 -- 172.21.15.52:0/4247027685 >> 172.21.15.52:0/4247027685 conn(0x7f99840c7bb0 msgr2=0x7f99840c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 -- 172.21.15.52:0/4247027685 shutdown_connections 2023-05-10T01:10:00.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.441+0000 7f998ab39700 1 -- 172.21.15.52:0/4247027685 wait complete. 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.442+0000 7f998ab39700 1 Processor -- start 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.442+0000 7f998ab39700 1 -- start start 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99840bc530 0x7f99840c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 0x7f9984152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840bf5f0 con 0x7f9984151dd0 2023-05-10T01:10:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840c1ed0 con 0x7f99841519f0 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f998ab39700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99840bfe50 con 0x7f99840bc530 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 0x7f9984152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 0x7f9984152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58632/0 (socket says 172.21.15.52:58632) 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 -- 172.21.15.52:0/2734240182 learned_addr learned my addr 172.21.15.52:0/2734240182 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99888d5700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99840bc530 0x7f99840c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f9983fff700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 -- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99840bc530 msgr2=0x7f99840c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99840bc530 0x7f99840c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 -- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 msgr2=0x7f9984155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99841519f0 0x7f9984155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c009ae0 con 0x7f9984151dd0 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f99890d6700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 0x7f9984152ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f997400c490 tx=0x7f9974007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.443+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740070d0 con 0x7f9984151dd0 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.444+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974007230 con 0x7f9984151dd0 2023-05-10T01:10:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.444+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99841561b0 con 0x7f9984151dd0 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.444+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740056e0 con 0x7f9984151dd0 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.444+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99840bfae0 con 0x7f9984151dd0 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.444+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99841567b0 con 0x7f9984151dd0 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f997401a060 con 0x7f9984151dd0 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f996405ed90 0x7f9964061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99740790e0 con 0x7f9984151dd0 2023-05-10T01:10:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f9964068130 0x7f996406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f996406ac10 con 0x7f9964068130 2023-05-10T01:10:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f997407b750 con 0x7f9984151dd0 2023-05-10T01:10:00.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.445+0000 7f99888d5700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f996405ed90 0x7f9964061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.446+0000 7f9983fff700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f9964068130 0x7f996406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.446+0000 7f99888d5700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f996405ed90 0x7f9964061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f997c00b9a0 tx=0x7f997c009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.446+0000 7f9983fff700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f9964068130 0x7f996406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.447+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== osd.7 v2:172.21.15.172:6816/116795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f996406ac10 con 0x7f9964068130 2023-05-10T01:10:00.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.461+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 --> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f998406c340 con 0x7f9964068130 2023-05-10T01:10:00.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f9980ff9700 1 -- 172.21.15.52:0/2734240182 <== osd.7 v2:172.21.15.172:6816/116795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f998406c340 con 0x7f9964068130 2023-05-10T01:10:00.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f9964068130 msgr2=0x7f996406a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f9964068130 0x7f996406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f996405ed90 msgr2=0x7f9964061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f996405ed90 0x7f9964061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f997c00b9a0 tx=0x7f997c009840).stop 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 msgr2=0x7f9984152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 --2- 172.21.15.52:0/2734240182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9984151dd0 0x7f9984152ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f997400c490 tx=0x7f9974007dc0).stop 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f99890d6700 1 -- 172.21.15.52:0/2734240182 reap_dead start 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 shutdown_connections 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 >> 172.21.15.52:0/2734240182 conn(0x7f99840c7bb0 msgr2=0x7f998414f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 shutdown_connections 2023-05-10T01:10:00.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.462+0000 7f998ab39700 1 -- 172.21.15.52:0/2734240182 wait complete. 2023-05-10T01:10:00.477 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2023-05-10T01:10:00.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-10T01:10:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.592+0000 7f0a8a6ab700 1 Processor -- start 2023-05-10T01:10:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.592+0000 7f0a8a6ab700 1 -- start start 2023-05-10T01:10:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a8a6ab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a84069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a8a6ab700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8406a910 con 0x7f0a84153af0 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a8a6ab700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840bfa20 con 0x7f0a84069740 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a8a6ab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c65e0 con 0x7f0a840aab30 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a89eaa700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0a84153af0 0x7f0a84153f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39426/0 (socket says 172.21.15.52:39426) 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a89eaa700 1 -- 172.21.15.52:0/3248204255 learned_addr learned my addr 172.21.15.52:0/3248204255 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a88ea8700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a84069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685471384 0 0) 0x7f0a8406a910 con 0x7f0a84153af0 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a6c0033f0 con 0x7f0a84153af0 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172436994 0 0) 0x7f0a6c0033f0 con 0x7f0a84153af0 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 msgr2=0x7f0a84069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a84069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.593+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 >> v1:172.21.15.172:6789/0 conn(0x7f0a84069740 legacy=0x7f0a840c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840bfc70 con 0x7f0a84153af0 2023-05-10T01:10:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0a7c0017f0 con 0x7f0a84153af0 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 >> v1:172.21.15.52:6789/0 conn(0x7f0a84153af0 legacy=0x7f0a84153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6c003910 0x7f0a6c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a6c004690 0x7f0a6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a6c005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c65e0 con 0x7f0a6c003910 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c00b990 con 0x7f0a6c004690 2023-05-10T01:10:00.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c00bb20 con 0x7f0a840aab30 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6c003910 0x7f0a6c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a88ea8700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a6c004690 0x7f0a6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a89eaa700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a6c005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 -- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 msgr2=0x7f0a6c005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a840aab30 0x7f0a6c005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 -- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a6c004690 msgr2=0x7f0a6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a6c004690 0x7f0a6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 -- 172.21.15.52:0/3248204255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0033f0 con 0x7f0a6c003910 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a896a9700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6c003910 0x7f0a6c003d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0a80001760 tx=0x7f0a80007bb0).ready entity=mon.0 client_cookie=9dbb9b081892974c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80007020 con 0x7f0a6c003910 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80007180 con 0x7f0a6c003910 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.594+0000 7f0a73fff700 1 -- 172.21.15.52:0/3248204255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80007500 con 0x7f0a6c003910 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/3248204255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6c003910 msgr2=0x7f0a6c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/3248204255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6c003910 0x7f0a6c003d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0a80001760 tx=0x7f0a80007bb0).stop 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a89eaa700 1 -- 172.21.15.52:0/3248204255 reap_dead start 2023-05-10T01:10:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/3248204255 shutdown_connections 2023-05-10T01:10:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/3248204255 >> 172.21.15.52:0/3248204255 conn(0x7f0a840cb540 msgr2=0x7f0a840c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/3248204255 shutdown_connections 2023-05-10T01:10:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.595+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/3248204255 wait complete. 2023-05-10T01:10:00.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.596+0000 7f0a8a6ab700 1 Processor -- start 2023-05-10T01:10:00.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.596+0000 7f0a8a6ab700 1 -- start start 2023-05-10T01:10:00.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 0x7f0a840af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 0x7f0a840acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c47a0 con 0x7f0a840b0750 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840af6b0 con 0x7f0a840ac7f0 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a8a6ab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840af990 con 0x7f0a6c003910 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58652/0 (socket says 172.21.15.52:58652) 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 -- 172.21.15.52:0/688210610 learned_addr learned my addr 172.21.15.52:0/688210610 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a896a9700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 0x7f0a840af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a89eaa700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 0x7f0a840acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 -- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 msgr2=0x7f0a840af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 0x7f0a840af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 -- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 msgr2=0x7f0a840acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 0x7f0a840acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 -- 172.21.15.52:0/688210610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840afc70 con 0x7f0a840b0750 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a89eaa700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 0x7f0a840acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a896a9700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 0x7f0a840af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.597+0000 7f0a88ea8700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a740119f0 tx=0x7f0a74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.598+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400f940 con 0x7f0a840b0750 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.598+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7400faa0 con 0x7f0a840b0750 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.598+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a840aff50 con 0x7f0a840b0750 2023-05-10T01:10:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.598+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400fe20 con 0x7f0a840b0750 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.598+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84146330 con 0x7f0a840b0750 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.599+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a840b03f0 con 0x7f0a840b0750 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.599+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0a74024070 con 0x7f0a840b0750 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.599+0000 7f0a717fa700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 0x7f0a64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.599+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a7407a590 con 0x7f0a840b0750 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.600+0000 7f0a896a9700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 0x7f0a64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.600+0000 7f0a896a9700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 0x7f0a64061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0a80001700 tx=0x7f0a80015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.604+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a7404bb30 con 0x7f0a840b0750 2023-05-10T01:10:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.780+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a84083030 con 0x7f0a840b0750 2023-05-10T01:10:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.780+0000 7f0a717fa700 1 -- 172.21.15.52:0/688210610 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a7404f150 con 0x7f0a840b0750 2023-05-10T01:10:00.783 INFO:teuthology.orchestra.run.smithi052.stdout:55834574851 2023-05-10T01:10:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 msgr2=0x7f0a64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 0x7f0a64061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0a80001700 tx=0x7f0a80015000).stop 2023-05-10T01:10:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 msgr2=0x7f0a840c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a740119f0 tx=0x7f0a74009060).stop 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 shutdown_connections 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a6405ed90 0x7f0a64061250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a840ac7f0 0x7f0a840acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a6c003910 0x7f0a840af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 --2- 172.21.15.52:0/688210610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a840b0750 0x7f0a840c42b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 >> 172.21.15.52:0/688210610 conn(0x7f0a840cb540 msgr2=0x7f0a840aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:00.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 shutdown_connections 2023-05-10T01:10:00.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:00.782+0000 7f0a8a6ab700 1 -- 172.21.15.52:0/688210610 wait complete. 2023-05-10T01:10:00.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-05-10T01:10:01.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-10T01:10:01.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.928+0000 7f0adcac8700 1 Processor -- start 2023-05-10T01:10:01.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.928+0000 7f0adcac8700 1 -- start start 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0adcac8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ad8154160 0x7f0ad80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0adcac8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ad8069da0 0x7f0ad80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0adcac8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80c0650 con 0x7f0ad8154540 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0adcac8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80c1af0 con 0x7f0ad8069da0 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0adcac8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80bfd20 con 0x7f0ad8154160 2023-05-10T01:10:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0ad6d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ad8069da0 0x7f0ad80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0ad5d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ad8154540 0x7f0ad8069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39444/0 (socket says 172.21.15.52:39444) 2023-05-10T01:10:01.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0ad5d9b700 1 -- 172.21.15.52:0/3174769842 learned_addr learned my addr 172.21.15.52:0/3174769842 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:01.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.929+0000 7f0ad659c700 1 --2- 172.21.15.52:0/3174769842 >> v2:172.21.15.172:3300/0 conn(0x7f0ad8154160 0x7f0ad80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad6d9d700 1 -- 172.21.15.52:0/3174769842 >> v2:172.21.15.172:3300/0 conn(0x7f0ad8154160 msgr2=0x7f0ad80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad6d9d700 1 --2- 172.21.15.52:0/3174769842 >> v2:172.21.15.172:3300/0 conn(0x7f0ad8154160 0x7f0ad80c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad6d9d700 1 -- 172.21.15.52:0/3174769842 >> v1:172.21.15.52:6789/0 conn(0x7f0ad8154540 legacy=0x7f0ad8069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad6d9d700 1 -- 172.21.15.52:0/3174769842 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80c0000 con 0x7f0ad8069da0 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad559a700 1 -- 172.21.15.52:0/3174769842 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209306597 0 0) 0x7f0ad80c0650 con 0x7f0ad8154540 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad6d9d700 1 --2- 172.21.15.52:0/3174769842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8069da0 0x7f0ad80c6150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0ad8083020 tx=0x7f0ac8009060).ready entity=mon.0 client_cookie=b061f9449ee2dd6a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad559a700 1 -- 172.21.15.52:0/3174769842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80090d0 con 0x7f0ad8069da0 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad559a700 1 -- 172.21.15.52:0/3174769842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800f510 con 0x7f0ad8069da0 2023-05-10T01:10:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0ad559a700 1 -- 172.21.15.52:0/3174769842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800f890 con 0x7f0ad8069da0 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0adcac8700 1 -- 172.21.15.52:0/3174769842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8069da0 msgr2=0x7f0ad80c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.930+0000 7f0adcac8700 1 --2- 172.21.15.52:0/3174769842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8069da0 0x7f0ad80c6150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0ad8083020 tx=0x7f0ac8009060).stop 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 -- 172.21.15.52:0/3174769842 shutdown_connections 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 --2- 172.21.15.52:0/3174769842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8069da0 0x7f0ad80c6150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 --2- 172.21.15.52:0/3174769842 >> v2:172.21.15.172:3300/0 conn(0x7f0ad8154160 0x7f0ad80c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 -- 172.21.15.52:0/3174769842 >> 172.21.15.52:0/3174769842 conn(0x7f0ad80cb6f0 msgr2=0x7f0ad80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 -- 172.21.15.52:0/3174769842 shutdown_connections 2023-05-10T01:10:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.931+0000 7f0adcac8700 1 -- 172.21.15.52:0/3174769842 wait complete. 2023-05-10T01:10:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 Processor -- start 2023-05-10T01:10:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 -- start start 2023-05-10T01:10:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ad8069da0 0x7f0ad81460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 0x7f0ad81445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.932+0000 7f0adcac8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8148a20 con 0x7f0ad8154160 2023-05-10T01:10:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0adcac8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8146890 con 0x7f0ad8154540 2023-05-10T01:10:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0adcac8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8146b70 con 0x7f0ad8069da0 2023-05-10T01:10:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58666/0 (socket says 172.21.15.52:58666) 2023-05-10T01:10:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 -- 172.21.15.52:0/54556618 learned_addr learned my addr 172.21.15.52:0/54556618 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad6d9d700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 0x7f0ad81445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad659c700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ad8069da0 0x7f0ad81460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 -- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ad8069da0 msgr2=0x7f0ad81460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ad8069da0 0x7f0ad81460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 -- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 msgr2=0x7f0ad81445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 0x7f0ad81445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 -- 172.21.15.52:0/54556618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80092a0 con 0x7f0ad8154160 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad6d9d700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 0x7f0ad81445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ad5d9b700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0ac000c490 tx=0x7f0ac0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00072e0 con 0x7f0ad8154160 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac0007440 con 0x7f0ad8154160 2023-05-10T01:10:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad8146e50 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00057a0 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.933+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad8147410 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.934+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad80666b0 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.935+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ac0010070 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.935+0000 7f0ace7fc700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 0x7f0abc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.935+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ac0079190 con 0x7f0ad8154160 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.935+0000 7f0ad659c700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 0x7f0abc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.936+0000 7f0ad659c700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 0x7f0abc061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0ad0007680 tx=0x7f0ad000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:01.939+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ac004a730 con 0x7f0ad8154160 2023-05-10T01:10:02.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.113+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ad8147600 con 0x7f0ad8154160 2023-05-10T01:10:02.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.113+0000 7f0ace7fc700 1 -- 172.21.15.52:0/54556618 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ac004dd50 con 0x7f0ad8154160 2023-05-10T01:10:02.116 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:10:02.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 msgr2=0x7f0abc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 0x7f0abc061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0ad0007680 tx=0x7f0ad000b040).stop 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 msgr2=0x7f0ad8148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0ac000c490 tx=0x7f0ac0007e60).stop 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 shutdown_connections 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0abc05ed90 0x7f0abc061250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ad8154540 0x7f0ad81445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ad8069da0 0x7f0ad81460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 --2- 172.21.15.52:0/54556618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ad8154160 0x7f0ad8148bd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 >> 172.21.15.52:0/54556618 conn(0x7f0ad80cb6f0 msgr2=0x7f0ad80ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 shutdown_connections 2023-05-10T01:10:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.115+0000 7f0adcac8700 1 -- 172.21.15.52:0/54556618 wait complete. 2023-05-10T01:10:02.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-05-10T01:10:02.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-10T01:10:02.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.243+0000 7fbad2abe700 1 Processor -- start 2023-05-10T01:10:02.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.243+0000 7fbad2abe700 1 -- start start 2023-05-10T01:10:02.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad2abe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbacc150cd0 0x7fbacc064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad2abe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbacc155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad2abe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0653e0 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad2abe700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0bda40 con 0x7fbacc150cd0 2023-05-10T01:10:02.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad2abe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0bdd20 con 0x7fbacc1510b0 2023-05-10T01:10:02.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad105b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbacc0bd4d0 0x7fbacc0696e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39456/0 (socket says 172.21.15.52:39456) 2023-05-10T01:10:02.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.244+0000 7fbad105b700 1 -- 172.21.15.52:0/2816775678 learned_addr learned my addr 172.21.15.52:0/2816775678 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:02.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacbfff700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbacc155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 --2- 172.21.15.52:0/2816775678 >> v2:172.21.15.172:3300/0 conn(0x7fbacc150cd0 0x7fbacc064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405948045 0 0) 0x7fbacc0653e0 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab80033f0 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 9267339 0 0) 0x7fbab80033f0 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 msgr2=0x7fbacc155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbacc155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 >> v2:172.21.15.172:3300/0 conn(0x7fbacc150cd0 msgr2=0x7fbacc064ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 --2- 172.21.15.52:0/2816775678 >> v2:172.21.15.172:3300/0 conn(0x7fbacc150cd0 0x7fbacc064ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0be000 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fbabc001470 con 0x7fbacc0bd4d0 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 >> v1:172.21.15.52:6789/0 conn(0x7fbacc0bd4d0 legacy=0x7fbacc0696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80038e0 0x7fbab8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbab8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab8004b80 0x7fbab8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0bda40 con 0x7fbab80038e0 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0bdd20 con 0x7fbab8004b80 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800b8e0 con 0x7fbacc1510b0 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80038e0 0x7fbab8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbacbfff700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbab8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad105b700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab8004b80 0x7fbab8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 -- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 msgr2=0x7fbab8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc1510b0 0x7fbab8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 -- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab8004b80 msgr2=0x7fbab8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab8004b80 0x7fbab8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad085a700 1 -- 172.21.15.52:0/2816775678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80033f0 con 0x7fbab80038e0 2023-05-10T01:10:02.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.245+0000 7fbad105b700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab8004b80 0x7fbab8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad085a700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80038e0 0x7fbab8003d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbac400e210 tx=0x7fbac400b040).ready entity=mon.0 client_cookie=40843faad2cfef8f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4009ac0 con 0x7fbab80038e0 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400f040 con 0x7fbab80038e0 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbacb7fe700 1 -- 172.21.15.52:0/2816775678 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400ecd0 con 0x7fbab80038e0 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 -- 172.21.15.52:0/2816775678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80038e0 msgr2=0x7fbab8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2816775678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbab80038e0 0x7fbab8003d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbac400e210 tx=0x7fbac400b040).stop 2023-05-10T01:10:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad105b700 1 -- 172.21.15.52:0/2816775678 reap_dead start 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 -- 172.21.15.52:0/2816775678 shutdown_connections 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 -- 172.21.15.52:0/2816775678 >> 172.21.15.52:0/2816775678 conn(0x7fbacc063620 msgr2=0x7fbacc0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 -- 172.21.15.52:0/2816775678 shutdown_connections 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.246+0000 7fbad2abe700 1 -- 172.21.15.52:0/2816775678 wait complete. 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.247+0000 7fbad2abe700 1 Processor -- start 2023-05-10T01:10:02.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 -- start start 2023-05-10T01:10:02.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 0x7fbacc165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 0x7fbacc0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc165e30 con 0x7fbacc14ff70 2023-05-10T01:10:02.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc166110 con 0x7fbab80038e0 2023-05-10T01:10:02.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbad2abe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1663f0 con 0x7fbacc141480 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbacbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbacbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58682/0 (socket says 172.21.15.52:58682) 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.248+0000 7fbacbfff700 1 -- 172.21.15.52:0/2989819802 learned_addr learned my addr 172.21.15.52:0/2989819802 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad105b700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 0x7fbacc0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad085a700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 0x7fbacc165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 -- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 msgr2=0x7fbacc0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 0x7fbacc0acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 -- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 msgr2=0x7fbacc165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 0x7fbacc165890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 -- 172.21.15.52:0/2989819802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc1666d0 con 0x7fbacc14ff70 2023-05-10T01:10:02.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad105b700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 0x7fbacc0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad085a700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 0x7fbacc165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbacbfff700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fbac00119f0 tx=0x7fbac0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000f940 con 0x7fbacc14ff70 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000faa0 con 0x7fbacc14ff70 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc1622c0 con 0x7fbacc14ff70 2023-05-10T01:10:02.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000fe20 con 0x7fbacc14ff70 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.249+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc152e80 con 0x7fbacc14ff70 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.250+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc06c340 con 0x7fbacc14ff70 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.250+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbac0024070 con 0x7fbacc14ff70 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.250+0000 7fbac8ff9700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 0x7fbaac061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.251+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbac007a610 con 0x7fbacc14ff70 2023-05-10T01:10:02.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.251+0000 7fbad085a700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 0x7fbaac061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.251+0000 7fbad085a700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 0x7fbaac061280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fbac400afd0 tx=0x7fbac401a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.255+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbac004bbb0 con 0x7fbacc14ff70 2023-05-10T01:10:02.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.428+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbacc0c82f0 con 0x7fbacc14ff70 2023-05-10T01:10:02.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.429+0000 7fbac8ff9700 1 -- 172.21.15.52:0/2989819802 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbac004f1d0 con 0x7fbacc14ff70 2023-05-10T01:10:02.432 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:10:02.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 msgr2=0x7fbaac061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 0x7fbaac061280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fbac400afd0 tx=0x7fbac401a000).stop 2023-05-10T01:10:02.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 msgr2=0x7fbacc152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fbac00119f0 tx=0x7fbac0009060).stop 2023-05-10T01:10:02.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 shutdown_connections 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbaac05edc0 0x7fbaac061280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbacc141480 0x7fbacc0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbab80038e0 0x7fbacc165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 --2- 172.21.15.52:0/2989819802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbacc14ff70 0x7fbacc152990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 >> 172.21.15.52:0/2989819802 conn(0x7fbacc063620 msgr2=0x7fbacc065600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 shutdown_connections 2023-05-10T01:10:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.430+0000 7fbad2abe700 1 -- 172.21.15.52:0/2989819802 wait complete. 2023-05-10T01:10:02.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2023-05-10T01:10:02.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-10T01:10:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.559+0000 7fd15febf700 1 Processor -- start 2023-05-10T01:10:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 -- start start 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd158154160 0x7fd1580c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1580c0650 con 0x7fd158154540 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580c1af0 con 0x7fd158154160 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.560+0000 7fd15febf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580bfd20 con 0x7fd158069da0 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd158154160 0x7fd1580c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15e45c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd158154160 0x7fd1580c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:57014/0 (socket says 172.21.15.52:57014) 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 -- 172.21.15.52:0/3208741544 learned_addr learned my addr 172.21.15.52:0/3208741544 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15d45a700 1 --1- 172.21.15.52:0/3208741544 >> v1:172.21.15.172:6789/0 conn(0x7fd158154540 0x7fd158069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42014/0 (socket says 172.21.15.52:42014) 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 -- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 msgr2=0x7fd1580c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 --2- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 -- 172.21.15.52:0/3208741544 >> v1:172.21.15.172:6789/0 conn(0x7fd158154540 legacy=0x7fd158069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 -- 172.21.15.52:0/3208741544 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580c0000 con 0x7fd158154160 2023-05-10T01:10:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15dc5b700 1 --2- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd1580c5c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd150006fd0 tx=0x7fd1500090f0).ready entity=mon.1 client_cookie=fd70b832f0db2dd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15cc59700 1 -- 172.21.15.52:0/3208741544 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000b580 con 0x7fd158154160 2023-05-10T01:10:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15cc59700 1 -- 172.21.15.52:0/3208741544 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000b6e0 con 0x7fd158154160 2023-05-10T01:10:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.561+0000 7fd15cc59700 1 -- 172.21.15.52:0/3208741544 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15000ba60 con 0x7fd158154160 2023-05-10T01:10:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 -- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 msgr2=0x7fd1580c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 --2- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd1580c5c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd150006fd0 tx=0x7fd1500090f0).stop 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 -- 172.21.15.52:0/3208741544 shutdown_connections 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 --2- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 --2- 172.21.15.52:0/3208741544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd1580c5c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 -- 172.21.15.52:0/3208741544 >> 172.21.15.52:0/3208741544 conn(0x7fd1580cb740 msgr2=0x7fd1580c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 -- 172.21.15.52:0/3208741544 shutdown_connections 2023-05-10T01:10:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.562+0000 7fd15febf700 1 -- 172.21.15.52:0/3208741544 wait complete. 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.563+0000 7fd15febf700 1 Processor -- start 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.563+0000 7fd15febf700 1 -- start start 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd158152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158153110 con 0x7fd158154540 2023-05-10T01:10:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c4850 con 0x7fd158154160 2023-05-10T01:10:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd158165c60 con 0x7fd158069da0 2023-05-10T01:10:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58700/0 (socket says 172.21.15.52:58700) 2023-05-10T01:10:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 -- 172.21.15.52:0/273685033 learned_addr learned my addr 172.21.15.52:0/273685033 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15dc5b700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15d45a700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd158152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 -- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 msgr2=0x7fd1580c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 -- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 msgr2=0x7fd158152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd158152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 -- 172.21.15.52:0/273685033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009370 con 0x7fd158154540 2023-05-10T01:10:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15e45c700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd148009ef0 tx=0x7fd14800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800cb70 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800f040 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1580c3c40 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.564+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148013400 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.565+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1580c4200 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.565+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1580666b0 con 0x7fd158154540 2023-05-10T01:10:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.566+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd1480137b0 con 0x7fd158154540 2023-05-10T01:10:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.566+0000 7fd155ffb700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 0x7fd138061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.566+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd14807a5e0 con 0x7fd158154540 2023-05-10T01:10:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.567+0000 7fd15dc5b700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 0x7fd138061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.567+0000 7fd15dc5b700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 0x7fd138061220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd150009130 tx=0x7fd150017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.571+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd14804ba70 con 0x7fd158154540 2023-05-10T01:10:02.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.745+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd15806c340 con 0x7fd158154540 2023-05-10T01:10:02.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.746+0000 7fd155ffb700 1 -- 172.21.15.52:0/273685033 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd14804f090 con 0x7fd158154540 2023-05-10T01:10:02.749 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-05-10T01:10:02.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 msgr2=0x7fd138061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 0x7fd138061220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd150009130 tx=0x7fd150017000).stop 2023-05-10T01:10:02.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 msgr2=0x7fd158165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd148009ef0 tx=0x7fd14800b040).stop 2023-05-10T01:10:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 shutdown_connections 2023-05-10T01:10:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd13805ed60 0x7fd138061220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd158154540 0x7fd158165770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd158069da0 0x7fd1580c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 --2- 172.21.15.52:0/273685033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158154160 0x7fd158152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 >> 172.21.15.52:0/273685033 conn(0x7fd1580cb740 msgr2=0x7fd1581532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 shutdown_connections 2023-05-10T01:10:02.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.747+0000 7fd15febf700 1 -- 172.21.15.52:0/273685033 wait complete. 2023-05-10T01:10:02.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-05-10T01:10:02.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-10T01:10:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.887+0000 7f8f160d6700 1 Processor -- start 2023-05-10T01:10:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.887+0000 7f8f160d6700 1 -- start start 2023-05-10T01:10:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f160d6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8f10154540 0x7f8f10069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f160d6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100c0650 con 0x7f8f10069b80 2023-05-10T01:10:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f160d6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f10069fb0 con 0x7f8f10154160 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f160d6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100bfd20 con 0x7f8f10154540 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f10069b80 0x7f8f100c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39492/0 (socket says 172.21.15.52:39492) 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0ffff700 1 -- 172.21.15.52:0/1143128357 learned_addr learned my addr 172.21.15.52:0/1143128357 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0effd700 1 --2- 172.21.15.52:0/1143128357 >> v2:172.21.15.172:3300/0 conn(0x7f8f10154540 0x7f8f10069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184823649 0 0) 0x7f8f100c0650 con 0x7f8f10069b80 2023-05-10T01:10:02.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef00033f0 con 0x7f8f10069b80 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855144913 0 0) 0x7f8ef00033f0 con 0x7f8f10069b80 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 >> v2:172.21.15.172:3300/0 conn(0x7f8f10154540 msgr2=0x7f8f10069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 --2- 172.21.15.52:0/1143128357 >> v2:172.21.15.172:3300/0 conn(0x7f8f10154540 0x7f8f10069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 >> v1:172.21.15.172:6789/0 conn(0x7f8f10154160 legacy=0x7f8f100c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100c0000 con 0x7f8f10069b80 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f8f000017f0 con 0x7f8f10069b80 2023-05-10T01:10:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 >> v1:172.21.15.52:6789/0 conn(0x7f8f10069b80 legacy=0x7f8f100c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 0x7f8ef0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef0004690 0x7f8ef0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ef0005050 0x7f8ef000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100bfd20 con 0x7f8ef00038e0 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.888+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef000bfe0 con 0x7f8ef0004690 2023-05-10T01:10:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef000c1a0 con 0x7f8ef0005050 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 0x7f8ef0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0effd700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef0004690 0x7f8ef0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0ffff700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ef0005050 0x7f8ef000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 -- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ef0005050 msgr2=0x7f8ef000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ef0005050 0x7f8ef000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 -- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef0004690 msgr2=0x7f8ef0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef0004690 0x7f8ef0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 -- 172.21.15.52:0/1143128357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00033f0 con 0x7f8ef00038e0 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0ffff700 1 -- 172.21.15.52:0/1143128357 reap_dead start 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 0x7f8ef0003d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8f08001700 tx=0x7f8f08007bb0).ready entity=mon.0 client_cookie=93cfff08a9a3751e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08007020 con 0x7f8ef00038e0 2023-05-10T01:10:02.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08007180 con 0x7f8ef00038e0 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f0e7fc700 1 -- 172.21.15.52:0/1143128357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08007520 con 0x7f8ef00038e0 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f160d6700 1 -- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 msgr2=0x7f8ef0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.889+0000 7f8f160d6700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 0x7f8ef0003d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8f08001700 tx=0x7f8f08007bb0).stop 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.890+0000 7f8f160d6700 1 -- 172.21.15.52:0/1143128357 shutdown_connections 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.890+0000 7f8f160d6700 1 --2- 172.21.15.52:0/1143128357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef00038e0 0x7f8ef0003d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.890+0000 7f8f160d6700 1 -- 172.21.15.52:0/1143128357 >> 172.21.15.52:0/1143128357 conn(0x7f8f100cb6f0 msgr2=0x7f8f100c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.890+0000 7f8f160d6700 1 -- 172.21.15.52:0/1143128357 shutdown_connections 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.890+0000 7f8f160d6700 1 -- 172.21.15.52:0/1143128357 wait complete. 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.891+0000 7f8f160d6700 1 Processor -- start 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.891+0000 7f8f160d6700 1 -- start start 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef00038e0 0x7f8f1014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f10152010 0x7f8f10152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10164510 con 0x7f8f100af0b0 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101647b0 con 0x7f8ef00038e0 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100c2e20 con 0x7f8f10152010 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58718/0 (socket says 172.21.15.52:58718) 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 -- 172.21.15.52:0/3604325354 learned_addr learned my addr 172.21.15.52:0/3604325354 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef00038e0 0x7f8f1014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0ffff700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f10152010 0x7f8f10152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 -- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f10152010 msgr2=0x7f8f10152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f10152010 0x7f8f10152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 -- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef00038e0 msgr2=0x7f8f1014d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef00038e0 0x7f8f1014d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 -- 172.21.15.52:0/3604325354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10152960 con 0x7f8f100af0b0 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f0effd700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8ef80119f0 tx=0x7f8ef8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800f730 con 0x7f8f100af0b0 2023-05-10T01:10:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef800f890 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1014dcf0 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800fc50 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.892+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f100c2860 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.893+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f10164920 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.894+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ef8024070 con 0x7f8f100af0b0 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.894+0000 7f8f077fe700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 0x7f8ef4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.894+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ef807a400 con 0x7f8f100af0b0 2023-05-10T01:10:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.894+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 0x7f8ef4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.895+0000 7f8f0f7fe700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 0x7f8ef4061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8f08001010 tx=0x7f8f08016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:02.898+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f10164920 con 0x7f8f100af0b0 2023-05-10T01:10:03.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.071+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f100666b0 con 0x7f8f100af0b0 2023-05-10T01:10:03.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.071+0000 7f8f077fe700 1 -- 172.21.15.52:0/3604325354 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ef8018020 con 0x7f8f100af0b0 2023-05-10T01:10:03.075 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-05-10T01:10:03.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 msgr2=0x7f8ef4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 0x7f8ef4061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8f08001010 tx=0x7f8f08016000).stop 2023-05-10T01:10:03.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 msgr2=0x7f8f100c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8ef80119f0 tx=0x7f8ef8009060).stop 2023-05-10T01:10:03.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 shutdown_connections 2023-05-10T01:10:03.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8ef405ed90 0x7f8ef4061250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f10152010 0x7f8f10152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef00038e0 0x7f8f1014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 --2- 172.21.15.52:0/3604325354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f100af0b0 0x7f8f100c1d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 >> 172.21.15.52:0/3604325354 conn(0x7f8f100cb6f0 msgr2=0x7f8f100ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 shutdown_connections 2023-05-10T01:10:03.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.073+0000 7f8f160d6700 1 -- 172.21.15.52:0/3604325354 wait complete. 2023-05-10T01:10:03.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-05-10T01:10:03.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-10T01:10:03.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.207+0000 7f4d1991b700 1 Processor -- start 2023-05-10T01:10:03.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.207+0000 7f4d1991b700 1 -- start start 2023-05-10T01:10:03.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d1991b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d14154030 0x7f4d14069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d1991b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d140bf4e0 0x7f4d14062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d1991b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d14062950 con 0x7f4d14063710 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d1991b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d14154410 con 0x7f4d140bf4e0 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d1991b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14069fa0 con 0x7f4d14154030 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d12ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d14154030 0x7f4d14069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d127fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d140bf4e0 0x7f4d14062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d127fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d140bf4e0 0x7f4d14062de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:57048/0 (socket says 172.21.15.52:57048) 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.208+0000 7f4d127fc700 1 -- 172.21.15.52:0/3947405859 learned_addr learned my addr 172.21.15.52:0/3947405859 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d127fc700 1 -- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d14154030 msgr2=0x7f4d14069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d127fc700 1 --2- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d14154030 0x7f4d14069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d127fc700 1 -- 172.21.15.52:0/3947405859 >> v1:172.21.15.172:6789/0 conn(0x7f4d14063710 legacy=0x7f4d140bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d11ffb700 1 -- 172.21.15.52:0/3947405859 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560459043 0 0) 0x7f4d14062950 con 0x7f4d14063710 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d127fc700 1 -- 172.21.15.52:0/3947405859 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14062340 con 0x7f4d140bf4e0 2023-05-10T01:10:03.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d127fc700 1 --2- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d140bf4e0 0x7f4d14062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4cfc006fd0 tx=0x7f4cfc0090f0).ready entity=mon.1 client_cookie=c83c65a1c97a6310 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d11ffb700 1 -- 172.21.15.52:0/3947405859 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00b580 con 0x7f4d140bf4e0 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d11ffb700 1 -- 172.21.15.52:0/3947405859 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00b6e0 con 0x7f4d140bf4e0 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.209+0000 7f4d11ffb700 1 -- 172.21.15.52:0/3947405859 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00ba60 con 0x7f4d140bf4e0 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 -- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d140bf4e0 msgr2=0x7f4d14062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d140bf4e0 0x7f4d14062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4cfc006fd0 tx=0x7f4cfc0090f0).stop 2023-05-10T01:10:03.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 -- 172.21.15.52:0/3947405859 shutdown_connections 2023-05-10T01:10:03.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d14154030 0x7f4d14069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3947405859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d140bf4e0 0x7f4d14062de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 -- 172.21.15.52:0/3947405859 >> 172.21.15.52:0/3947405859 conn(0x7f4d140c8a90 msgr2=0x7f4d140c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 -- 172.21.15.52:0/3947405859 shutdown_connections 2023-05-10T01:10:03.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.210+0000 7f4d1991b700 1 -- 172.21.15.52:0/3947405859 wait complete. 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.211+0000 7f4d1991b700 1 Processor -- start 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.211+0000 7f4d1991b700 1 -- start start 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d140bf4e0 0x7f4d1414de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14154030 0x7f4d140a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140a9510 con 0x7f4d14063710 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140a8f50 con 0x7f4d14154030 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d1991b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140a9230 con 0x7f4d140bf4e0 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58728/0 (socket says 172.21.15.52:58728) 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 -- 172.21.15.52:0/3414879257 learned_addr learned my addr 172.21.15.52:0/3414879257 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d127fc700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d140bf4e0 0x7f4d1414de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d137fe700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14154030 0x7f4d140a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 -- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d140bf4e0 msgr2=0x7f4d1414de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d140bf4e0 0x7f4d1414de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 -- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14154030 msgr2=0x7f4d140a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14154030 0x7f4d140a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 -- 172.21.15.52:0/3414879257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009370 con 0x7f4d14063710 2023-05-10T01:10:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d12ffd700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4d0c00e930 tx=0x7f4d0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.212+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c012600 con 0x7f4d14063710 2023-05-10T01:10:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.213+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c012760 con 0x7f4d14063710 2023-05-10T01:10:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.213+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d140aa080 con 0x7f4d14063710 2023-05-10T01:10:03.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.213+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c012ae0 con 0x7f4d14063710 2023-05-10T01:10:03.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.213+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d140a4d60 con 0x7f4d14063710 2023-05-10T01:10:03.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.214+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d140a9ee0 con 0x7f4d14063710 2023-05-10T01:10:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.214+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4d0c022070 con 0x7f4d14063710 2023-05-10T01:10:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.214+0000 7f4d0affd700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 0x7f4cf8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.214+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4d0c079e10 con 0x7f4d14063710 2023-05-10T01:10:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.214+0000 7f4d127fc700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 0x7f4cf8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.215+0000 7f4d127fc700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 0x7f4cf8061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4cfc006fd0 tx=0x7f4cfc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.218+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d140a9ee0 con 0x7f4d14063710 2023-05-10T01:10:03.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.393+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4d140a9ee0 con 0x7f4d14063710 2023-05-10T01:10:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.393+0000 7f4d0affd700 1 -- 172.21.15.52:0/3414879257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d140a9ee0 con 0x7f4d14063710 2023-05-10T01:10:03.396 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-05-10T01:10:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 msgr2=0x7f4cf8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 0x7f4cf8061250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4cfc006fd0 tx=0x7f4cfc017000).stop 2023-05-10T01:10:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 msgr2=0x7f4d140a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4d0c00e930 tx=0x7f4d0c009060).stop 2023-05-10T01:10:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 shutdown_connections 2023-05-10T01:10:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4cf805ed90 0x7f4cf8061250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14154030 0x7f4d140a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d14063710 0x7f4d140a4870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 --2- 172.21.15.52:0/3414879257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d140bf4e0 0x7f4d1414de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 >> 172.21.15.52:0/3414879257 conn(0x7f4d140c8a90 msgr2=0x7f4d14068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 shutdown_connections 2023-05-10T01:10:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.395+0000 7f4d1991b700 1 -- 172.21.15.52:0/3414879257 wait complete. 2023-05-10T01:10:03.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2023-05-10T01:10:03.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-10T01:10:03.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.528+0000 7f9f8ad9b700 1 Processor -- start 2023-05-10T01:10:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.528+0000 7f9f8ad9b700 1 -- start start 2023-05-10T01:10:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f8ad9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f84154160 0x7f9f840c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f8ad9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f840c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f8ad9b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840c0650 con 0x7f9f84154540 2023-05-10T01:10:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f8ad9b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840c1af0 con 0x7f9f84154160 2023-05-10T01:10:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f8ad9b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840bfd20 con 0x7f9f84069da0 2023-05-10T01:10:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f83fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9f84154540 0x7f9f84069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39520/0 (socket says 172.21.15.52:39520) 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f88b37700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f84154160 0x7f9f840c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f83fff700 1 -- 172.21.15.52:0/375805472 learned_addr learned my addr 172.21.15.52:0/375805472 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f89338700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f840c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f837fe700 1 -- 172.21.15.52:0/375805472 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777928571 0 0) 0x7f9f840c0650 con 0x7f9f84154540 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f88b37700 1 -- 172.21.15.52:0/375805472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 msgr2=0x7f9f840c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f88b37700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f840c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f88b37700 1 -- 172.21.15.52:0/375805472 >> v1:172.21.15.52:6789/0 conn(0x7f9f84154540 legacy=0x7f9f84069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.529+0000 7f9f88b37700 1 -- 172.21.15.52:0/375805472 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840c0000 con 0x7f9f84154160 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f88b37700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154160 0x7f9f840c5c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9f7c009e60 tx=0x7f9f7c009780).ready entity=mon.0 client_cookie=5f07fac90da502d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f837fe700 1 -- 172.21.15.52:0/375805472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f84154160 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f837fe700 1 -- 172.21.15.52:0/375805472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00bb60 con 0x7f9f84154160 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f837fe700 1 -- 172.21.15.52:0/375805472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c012410 con 0x7f9f84154160 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/375805472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154160 msgr2=0x7f9f840c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154160 0x7f9f840c5c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9f7c009e60 tx=0x7f9f7c009780).stop 2023-05-10T01:10:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/375805472 shutdown_connections 2023-05-10T01:10:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f840c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/375805472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154160 0x7f9f840c5c60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/375805472 >> 172.21.15.52:0/375805472 conn(0x7f9f840cb740 msgr2=0x7f9f840c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/375805472 shutdown_connections 2023-05-10T01:10:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.530+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/375805472 wait complete. 2023-05-10T01:10:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.531+0000 7f9f8ad9b700 1 Processor -- start 2023-05-10T01:10:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 -- start start 2023-05-10T01:10:03.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f84168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f84154160 0x7f9f84157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840c2f40 con 0x7f9f84154540 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841688d0 con 0x7f9f84154160 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f8ad9b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84168bb0 con 0x7f9f84069da0 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f89338700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f89338700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58744/0 (socket says 172.21.15.52:58744) 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.532+0000 7f9f89338700 1 -- 172.21.15.52:0/2046055085 learned_addr learned my addr 172.21.15.52:0/2046055085 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f88b37700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f84168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f83fff700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f84154160 0x7f9f84157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 -- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 msgr2=0x7f9f84168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f84168330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 -- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f84154160 msgr2=0x7f9f84157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f84154160 0x7f9f84157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 -- 172.21.15.52:0/2046055085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009a20 con 0x7f9f84154540 2023-05-10T01:10:03.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f89338700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9f6c00e900 tx=0x7f9f6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00ee40 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c00c850 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84168e90 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00cbd0 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.533+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f841598d0 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.534+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f840c3080 con 0x7f9f84154540 2023-05-10T01:10:03.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.534+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9f6c022070 con 0x7f9f84154540 2023-05-10T01:10:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.535+0000 7f9f80ff9700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 0x7f9f68061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.535+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9f6c079f00 con 0x7f9f84154540 2023-05-10T01:10:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.535+0000 7f9f88b37700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 0x7f9f68061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.535+0000 7f9f88b37700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 0x7f9f68061220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9f7c009f90 tx=0x7f9f7c009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.539+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f840c3080 con 0x7f9f84154540 2023-05-10T01:10:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.712+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9f840c3080 con 0x7f9f84154540 2023-05-10T01:10:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.712+0000 7f9f80ff9700 1 -- 172.21.15.52:0/2046055085 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f840c3080 con 0x7f9f84154540 2023-05-10T01:10:03.715 INFO:teuthology.orchestra.run.smithi052.stdout:55834574855 2023-05-10T01:10:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 msgr2=0x7f9f68061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 0x7f9f68061220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9f7c009f90 tx=0x7f9f7c009780).stop 2023-05-10T01:10:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 msgr2=0x7f9f841467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9f6c00e900 tx=0x7f9f6c009060).stop 2023-05-10T01:10:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 shutdown_connections 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9f6805ed60 0x7f9f68061220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f84154540 0x7f9f841467f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f84069da0 0x7f9f84168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 --2- 172.21.15.52:0/2046055085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f84154160 0x7f9f84157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 >> 172.21.15.52:0/2046055085 conn(0x7f9f840cb740 msgr2=0x7f9f840ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 shutdown_connections 2023-05-10T01:10:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.714+0000 7f9f8ad9b700 1 -- 172.21.15.52:0/2046055085 wait complete. 2023-05-10T01:10:03.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-05-10T01:10:03.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-10T01:10:03.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.845+0000 7f2c013a8700 1 Processor -- start 2023-05-10T01:10:03.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.845+0000 7f2c013a8700 1 -- start start 2023-05-10T01:10:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2c013a8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2bfc069da0 0x7f2bfc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2c013a8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0c0650 con 0x7f2bfc154540 2023-05-10T01:10:03.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2c013a8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0c1af0 con 0x7f2bfc154160 2023-05-10T01:10:03.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2c013a8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0bfd20 con 0x7f2bfc069da0 2023-05-10T01:10:03.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2bfa7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2bfc154540 0x7f2bfc069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39534/0 (socket says 172.21.15.52:39534) 2023-05-10T01:10:03.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.846+0000 7f2bfa7fc700 1 -- 172.21.15.52:0/39627916 learned_addr learned my addr 172.21.15.52:0/39627916 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:03.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfb7fe700 1 --2- 172.21.15.52:0/39627916 >> v2:172.21.15.172:3300/0 conn(0x7f2bfc069da0 0x7f2bfc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492772500 0 0) 0x7f2bfc0c0650 con 0x7f2bfc154540 2023-05-10T01:10:03.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bdc0033f0 con 0x7f2bfc154540 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2738269620 0 0) 0x7f2bdc0033f0 con 0x7f2bfc154540 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 >> v2:172.21.15.172:3300/0 conn(0x7f2bfc069da0 msgr2=0x7f2bfc15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 --2- 172.21.15.52:0/39627916 >> v2:172.21.15.172:3300/0 conn(0x7f2bfc069da0 0x7f2bfc15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 >> v1:172.21.15.172:6789/0 conn(0x7f2bfc154160 legacy=0x7f2bfc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0c0000 con 0x7f2bfc154540 2023-05-10T01:10:03.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f2be40017f0 con 0x7f2bfc154540 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 >> v1:172.21.15.52:6789/0 conn(0x7f2bfc154540 legacy=0x7f2bfc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 0x7f2bdc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bdc004690 0x7f2bdc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc005050 0x7f2bdc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0bfd20 con 0x7f2bdc0038e0 2023-05-10T01:10:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc00bfe0 con 0x7f2bdc004690 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc00c1a0 con 0x7f2bdc005050 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 0x7f2bdc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfa7fc700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bdc004690 0x7f2bdc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfb7fe700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc005050 0x7f2bdc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 -- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc005050 msgr2=0x7f2bdc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc005050 0x7f2bdc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 -- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bdc004690 msgr2=0x7f2bdc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:03.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bdc004690 0x7f2bdc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 -- 172.21.15.52:0/39627916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0033f0 con 0x7f2bdc0038e0 2023-05-10T01:10:03.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfb7fe700 1 -- 172.21.15.52:0/39627916 reap_dead start 2023-05-10T01:10:03.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.847+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 0x7f2bdc003d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2bf4001700 tx=0x7f2bf4007bb0).ready entity=mon.0 client_cookie=b72b0f24fb3518c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4007020 con 0x7f2bdc0038e0 2023-05-10T01:10:03.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf4007180 con 0x7f2bdc0038e0 2023-05-10T01:10:03.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2bf9ffb700 1 -- 172.21.15.52:0/39627916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4007520 con 0x7f2bdc0038e0 2023-05-10T01:10:03.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 -- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 msgr2=0x7f2bdc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 0x7f2bdc003d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2bf4001700 tx=0x7f2bf4007bb0).stop 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 -- 172.21.15.52:0/39627916 shutdown_connections 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 --2- 172.21.15.52:0/39627916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bdc0038e0 0x7f2bdc003d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 -- 172.21.15.52:0/39627916 >> 172.21.15.52:0/39627916 conn(0x7f2bfc0cb6f0 msgr2=0x7f2bfc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 -- 172.21.15.52:0/39627916 shutdown_connections 2023-05-10T01:10:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.848+0000 7f2c013a8700 1 -- 172.21.15.52:0/39627916 wait complete. 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.849+0000 7f2c013a8700 1 Processor -- start 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.849+0000 7f2c013a8700 1 -- start start 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc0038e0 0x7f2bfc156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bfc14cf50 0x7f2bfc0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc168e80 con 0x7f2bfc14cad0 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0aba60 con 0x7f2bfc14cf50 2023-05-10T01:10:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2c013a8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc156510 con 0x7f2bdc0038e0 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58762/0 (socket says 172.21.15.52:58762) 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 -- 172.21.15.52:0/3300288018 learned_addr learned my addr 172.21.15.52:0/3300288018 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc0038e0 0x7f2bfc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfb7fe700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bfc14cf50 0x7f2bfc0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 -- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc0038e0 msgr2=0x7f2bfc156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc0038e0 0x7f2bfc156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 -- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bfc14cf50 msgr2=0x7f2bfc0ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bfc14cf50 0x7f2bfc0ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.850+0000 7f2bfa7fc700 1 -- 172.21.15.52:0/3300288018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc155260 con 0x7f2bfc14cad0 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2bfa7fc700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2be40076f0 tx=0x7f2be4001060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400f8d0 con 0x7f2bfc14cad0 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be400fa30 con 0x7f2bfc14cad0 2023-05-10T01:10:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc155540 con 0x7f2bfc14cad0 2023-05-10T01:10:03.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400fdb0 con 0x7f2bfc14cad0 2023-05-10T01:10:03.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.851+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc155b00 con 0x7f2bfc14cad0 2023-05-10T01:10:03.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.852+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0666b0 con 0x7f2bfc14cad0 2023-05-10T01:10:03.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.852+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2be401b030 con 0x7f2bfc14cad0 2023-05-10T01:10:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.852+0000 7f2bf2ffd700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 0x7f2be0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.852+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2be4079650 con 0x7f2bfc14cad0 2023-05-10T01:10:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.853+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 0x7f2be0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.853+0000 7f2bfaffd700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 0x7f2be0061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2bf4001010 tx=0x7f2bf4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:03.856+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2be404ac40 con 0x7f2bfc14cad0 2023-05-10T01:10:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.028+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2bfc06c340 con 0x7f2bfc14cad0 2023-05-10T01:10:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.028+0000 7f2bf2ffd700 1 -- 172.21.15.52:0/3300288018 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2be4019030 con 0x7f2bfc14cad0 2023-05-10T01:10:04.031 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-05-10T01:10:04.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 msgr2=0x7f2be0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 0x7f2be0061250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2bf4001010 tx=0x7f2bf4016000).stop 2023-05-10T01:10:04.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 msgr2=0x7f2bfc0ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2be40076f0 tx=0x7f2be4001060).stop 2023-05-10T01:10:04.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 shutdown_connections 2023-05-10T01:10:04.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2be005ed90 0x7f2be0061250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bfc14cf50 0x7f2bfc0ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2bdc0038e0 0x7f2bfc156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 --2- 172.21.15.52:0/3300288018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bfc14cad0 0x7f2bfc0ab080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 >> 172.21.15.52:0/3300288018 conn(0x7f2bfc0cb6f0 msgr2=0x7f2bfc0ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 shutdown_connections 2023-05-10T01:10:04.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.030+0000 7f2c013a8700 1 -- 172.21.15.52:0/3300288018 wait complete. 2023-05-10T01:10:04.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2023-05-10T01:10:04.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-10T01:10:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.161+0000 7f814e830700 1 Processor -- start 2023-05-10T01:10:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.161+0000 7f814e830700 1 -- start start 2023-05-10T01:10:04.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814e830700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8148154160 0x7f81480c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814e830700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8148154540 0x7f81480c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814e830700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480c0650 con 0x7f8148069690 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814e830700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480c1af0 con 0x7f8148154540 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814e830700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480bfd20 con 0x7f8148154160 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8148154540 0x7f81480c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814cdcd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8148069690 0x7f8148157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39556/0 (socket says 172.21.15.52:39556) 2023-05-10T01:10:04.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f814cdcd700 1 -- 172.21.15.52:0/3747808447 learned_addr learned my addr 172.21.15.52:0/3747808447 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f8147fff700 1 --2- 172.21.15.52:0/3747808447 >> v2:172.21.15.172:3300/0 conn(0x7f8148154160 0x7f81480c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 -- 172.21.15.52:0/3747808447 >> v2:172.21.15.172:3300/0 conn(0x7f8148154160 msgr2=0x7f81480c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 --2- 172.21.15.52:0/3747808447 >> v2:172.21.15.172:3300/0 conn(0x7f8148154160 0x7f81480c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 -- 172.21.15.52:0/3747808447 >> v1:172.21.15.52:6789/0 conn(0x7f8148069690 legacy=0x7f8148157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f81477fe700 1 -- 172.21.15.52:0/3747808447 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172644880 0 0) 0x7f81480c0650 con 0x7f8148069690 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 -- 172.21.15.52:0/3747808447 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480c0000 con 0x7f8148154540 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f813ffff700 1 --2- 172.21.15.52:0/3747808447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154540 0x7f81480c6150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8148083020 tx=0x7f8130009060).ready entity=mon.0 client_cookie=d51f30ea910f8e62 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.162+0000 7f81477fe700 1 -- 172.21.15.52:0/3747808447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300090d0 con 0x7f8148154540 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f81477fe700 1 -- 172.21.15.52:0/3747808447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000b580 con 0x7f8148154540 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f81477fe700 1 -- 172.21.15.52:0/3747808447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000b900 con 0x7f8148154540 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 -- 172.21.15.52:0/3747808447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154540 msgr2=0x7f81480c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 --2- 172.21.15.52:0/3747808447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154540 0x7f81480c6150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8148083020 tx=0x7f8130009060).stop 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 -- 172.21.15.52:0/3747808447 shutdown_connections 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 --2- 172.21.15.52:0/3747808447 >> v2:172.21.15.172:3300/0 conn(0x7f8148154160 0x7f81480c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 --2- 172.21.15.52:0/3747808447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154540 0x7f81480c6150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 -- 172.21.15.52:0/3747808447 >> 172.21.15.52:0/3747808447 conn(0x7f81480cb6f0 msgr2=0x7f81480c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 -- 172.21.15.52:0/3747808447 shutdown_connections 2023-05-10T01:10:04.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.163+0000 7f814e830700 1 -- 172.21.15.52:0/3747808447 wait complete. 2023-05-10T01:10:04.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.164+0000 7f814e830700 1 Processor -- start 2023-05-10T01:10:04.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.164+0000 7f814e830700 1 -- start start 2023-05-10T01:10:04.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8148069690 0x7f814814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 0x7f81480c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481586e0 con 0x7f8148154160 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814cf70 con 0x7f8148154540 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814e830700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148157ad0 con 0x7f8148069690 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f813ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f813ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58776/0 (socket says 172.21.15.52:58776) 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f813ffff700 1 -- 172.21.15.52:0/3933040833 learned_addr learned my addr 172.21.15.52:0/3933040833 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:04.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f8147fff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8148069690 0x7f814814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.165+0000 7f814cdcd700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 0x7f81480c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 -- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8148069690 msgr2=0x7f814814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8148069690 0x7f814814ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 -- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 msgr2=0x7f81480c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 0x7f81480c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 -- 172.21.15.52:0/3933040833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300092a0 con 0x7f8148154160 2023-05-10T01:10:04.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f814cdcd700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 0x7f81480c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:04.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f813ffff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8148083050 tx=0x7f8130017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130006970 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130011ac0 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148157db0 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130011e60 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.166+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8148158370 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.167+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8148158890 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.167+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f813000f070 con 0x7f8148154160 2023-05-10T01:10:04.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.168+0000 7f8144ff9700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 0x7f812c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.168+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f813007b0b0 con 0x7f8148154160 2023-05-10T01:10:04.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.168+0000 7f8147fff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 0x7f812c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.168+0000 7f8147fff700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 0x7f812c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f813800bb20 tx=0x7f8138008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.172+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8148158890 con 0x7f8148154160 2023-05-10T01:10:04.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.347+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8148158890 con 0x7f8148154160 2023-05-10T01:10:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.347+0000 7f8144ff9700 1 -- 172.21.15.52:0/3933040833 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8148158890 con 0x7f8148154160 2023-05-10T01:10:04.350 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 msgr2=0x7f812c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 0x7f812c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f813800bb20 tx=0x7f8138008040).stop 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 msgr2=0x7f814814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8148083050 tx=0x7f8130017000).stop 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 shutdown_connections 2023-05-10T01:10:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f812c05ed90 0x7f812c061250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8148154540 0x7f81480c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8148069690 0x7f814814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 --2- 172.21.15.52:0/3933040833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8148154160 0x7f814814c240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 >> 172.21.15.52:0/3933040833 conn(0x7f81480cb6f0 msgr2=0x7f814814d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 shutdown_connections 2023-05-10T01:10:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.349+0000 7f814e830700 1 -- 172.21.15.52:0/3933040833 wait complete. 2023-05-10T01:10:04.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-05-10T01:10:04.364 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-10T01:10:04.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:10:04.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.477+0000 7fa1a10d2700 1 Processor -- start 2023-05-10T01:10:04.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.477+0000 7fa1a10d2700 1 -- start start 2023-05-10T01:10:04.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa1a10d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154160 0x7fa19c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa1a10d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa19c154540 0x7fa19c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa1a10d2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0c0650 con 0x7fa19c069690 2023-05-10T01:10:04.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa1a10d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0c1af0 con 0x7fa19c154540 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa1a10d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0bfd20 con 0x7fa19c154160 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa19c154540 0x7fa19c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19b59e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa19c069690 0x7fa19c157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39566/0 (socket says 172.21.15.52:39566) 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19b59e700 1 -- 172.21.15.52:0/1779221676 learned_addr learned my addr 172.21.15.52:0/1779221676 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 --2- 172.21.15.52:0/1779221676 >> v2:172.21.15.52:3300/0 conn(0x7fa19c154540 0x7fa19c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58782/0 (socket says 172.21.15.52:58782) 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19ad9d700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154160 0x7fa19c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 -- 172.21.15.52:0/1779221676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154160 msgr2=0x7fa19c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:04.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154160 0x7fa19c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 -- 172.21.15.52:0/1779221676 >> v1:172.21.15.52:6789/0 conn(0x7fa19c069690 legacy=0x7fa19c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 -- 172.21.15.52:0/1779221676 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0c0000 con 0x7fa19c154540 2023-05-10T01:10:04.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa199d9b700 1 -- 172.21.15.52:0/1779221676 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736428988 0 0) 0x7fa19c0c0650 con 0x7fa19c069690 2023-05-10T01:10:04.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa19a59c700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154540 0x7fa19c0c6150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa184009760 tx=0x7fa184009060).ready entity=mon.0 client_cookie=8f40a8ab7f02e28f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa199d9b700 1 -- 172.21.15.52:0/1779221676 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840090d0 con 0x7fa19c154540 2023-05-10T01:10:04.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa199d9b700 1 -- 172.21.15.52:0/1779221676 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18400b580 con 0x7fa19c154540 2023-05-10T01:10:04.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.478+0000 7fa199d9b700 1 -- 172.21.15.52:0/1779221676 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400b900 con 0x7fa19c154540 2023-05-10T01:10:04.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 -- 172.21.15.52:0/1779221676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154540 msgr2=0x7fa19c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154540 0x7fa19c0c6150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa184009760 tx=0x7fa184009060).stop 2023-05-10T01:10:04.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 -- 172.21.15.52:0/1779221676 shutdown_connections 2023-05-10T01:10:04.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154160 0x7fa19c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/1779221676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154540 0x7fa19c0c6150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 -- 172.21.15.52:0/1779221676 >> 172.21.15.52:0/1779221676 conn(0x7fa19c0cb6f0 msgr2=0x7fa19c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 -- 172.21.15.52:0/1779221676 shutdown_connections 2023-05-10T01:10:04.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.479+0000 7fa1a10d2700 1 -- 172.21.15.52:0/1779221676 wait complete. 2023-05-10T01:10:04.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.480+0000 7fa1a10d2700 1 Processor -- start 2023-05-10T01:10:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.480+0000 7fa1a10d2700 1 -- start start 2023-05-10T01:10:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 0x7fa19c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 0x7fa19c14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c157b90 con 0x7fa19c154160 2023-05-10T01:10:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0c2ed0 con 0x7fa19c069690 2023-05-10T01:10:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa1a10d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0c2630 con 0x7fa19c154540 2023-05-10T01:10:04.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58788/0 (socket says 172.21.15.52:58788) 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 -- 172.21.15.52:0/3089602925 learned_addr learned my addr 172.21.15.52:0/3089602925 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19b59e700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 0x7fa19c14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19ad9d700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 0x7fa19c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 -- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 msgr2=0x7fa19c14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 0x7fa19c14f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 -- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 msgr2=0x7fa19c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 0x7fa19c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19a59c700 1 -- 172.21.15.52:0/3089602925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840092a0 con 0x7fa19c154160 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19b59e700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 0x7fa19c14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.481+0000 7fa19ad9d700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 0x7fa19c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa19a59c700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa19c083050 tx=0x7fa184017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400b900 con 0x7fa19c154160 2023-05-10T01:10:04.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184006910 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c0c2910 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400bed0 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.482+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c14f1a0 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.483+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c157960 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.483+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa18402b070 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.483+0000 7fa192ffd700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 0x7fa180061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.483+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa18407b330 con 0x7fa19c154160 2023-05-10T01:10:04.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.484+0000 7fa19ad9d700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 0x7fa180061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.484+0000 7fa19ad9d700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 0x7fa180061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa1940075e0 tx=0x7fa1940097e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.488+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa19c157960 con 0x7fa19c154160 2023-05-10T01:10:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.657+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa19c157960 con 0x7fa18005ed90 2023-05-10T01:10:04.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.666+0000 7fa192ffd700 1 -- 172.21.15.52:0/3089602925 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336229 (secure 0 0 0) 0x7fa19c157960 con 0x7fa18005ed90 2023-05-10T01:10:04.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 msgr2=0x7fa180061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 0x7fa180061250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa1940075e0 tx=0x7fa1940097e0).stop 2023-05-10T01:10:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 msgr2=0x7fa19c0c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fa19c083050 tx=0x7fa184017000).stop 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 shutdown_connections 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa18005ed90 0x7fa180061250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa19c154540 0x7fa19c14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa19c069690 0x7fa19c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 --2- 172.21.15.52:0/3089602925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c154160 0x7fa19c0c1d30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 >> 172.21.15.52:0/3089602925 conn(0x7fa19c0cb6f0 msgr2=0x7fa19c0abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 shutdown_connections 2023-05-10T01:10:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.670+0000 7fa1a10d2700 1 -- 172.21.15.52:0/3089602925 wait complete. 2023-05-10T01:10:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:10:04.685 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-10T01:10:04.443444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41728,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39808,"kb_avail":754932992,"statfs":{"total":773094113280,"available":773051383808,"internally_reserved":0,"allocated":1900544,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40763392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002313"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769639+0000","last_change":"2023-05-10T01:09:53.767516+0000","last_active":"2023-05-10T01:09:53.769639+0000","last_peered":"2023-05-10T01:09:53.769639+0000","last_clean":"2023-05-10T01:09:53.769639+0000","last_became_active":"2023-05-10T01:09:53.767220+0000","last_became_peered":"2023-05-10T01:09:53.767220+0000","last_unstale":"2023-05-10T01:09:53.769639+0000","last_undegraded":"2023-05-10T01:09:53.769639+0000","last_fullsized":"2023-05-10T01:09:53.769639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765712+0000","last_change":"2023-05-10T01:09:53.376660+0000","last_active":"2023-05-10T01:09:53.765712+0000","last_peered":"2023-05-10T01:09:53.765712+0000","last_clean":"2023-05-10T01:09:53.765712+0000","last_became_active":"2023-05-10T01:09:53.372795+0000","last_became_peered":"2023-05-10T01:09:53.372795+0000","last_unstale":"2023-05-10T01:09:53.765712+0000","last_undegraded":"2023-05-10T01:09:53.765712+0000","last_fullsized":"2023-05-10T01:09:53.765712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778404+0000","last_change":"2023-05-10T01:09:53.777846+0000","last_active":"2023-05-10T01:09:53.778404+0000","last_peered":"2023-05-10T01:09:53.778404+0000","last_clean":"2023-05-10T01:09:53.778404+0000","last_became_active":"2023-05-10T01:09:53.777351+0000","last_became_peered":"2023-05-10T01:09:53.777351+0000","last_unstale":"2023-05-10T01:09:53.778404+0000","last_undegraded":"2023-05-10T01:09:53.778404+0000","last_fullsized":"2023-05-10T01:09:53.778404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753389+0000","last_change":"2023-05-10T01:09:53.372546+0000","last_active":"2023-05-10T01:09:53.753389+0000","last_peered":"2023-05-10T01:09:53.753389+0000","last_clean":"2023-05-10T01:09:53.753389+0000","last_became_active":"2023-05-10T01:09:53.371853+0000","last_became_peered":"2023-05-10T01:09:53.371853+0000","last_unstale":"2023-05-10T01:09:53.753389+0000","last_undegraded":"2023-05-10T01:09:53.753389+0000","last_fullsized":"2023-05-10T01:09:53.753389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780965+0000","last_change":"2023-05-10T01:09:53.776453+0000","last_active":"2023-05-10T01:09:53.780965+0000","last_peered":"2023-05-10T01:09:53.780965+0000","last_clean":"2023-05-10T01:09:53.780965+0000","last_became_active":"2023-05-10T01:09:53.776189+0000","last_became_peered":"2023-05-10T01:09:53.776189+0000","last_unstale":"2023-05-10T01:09:53.780965+0000","last_undegraded":"2023-05-10T01:09:53.780965+0000","last_fullsized":"2023-05-10T01:09:53.780965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759545+0000","last_change":"2023-05-10T01:09:53.376261+0000","last_active":"2023-05-10T01:09:53.759545+0000","last_peered":"2023-05-10T01:09:53.759545+0000","last_clean":"2023-05-10T01:09:53.759545+0000","last_became_active":"2023-05-10T01:09:53.375962+0000","last_became_peered":"2023-05-10T01:09:53.375962+0000","last_unstale":"2023-05-10T01:09:53.759545+0000","last_undegraded":"2023-05-10T01:09:53.759545+0000","last_fullsized":"2023-05-10T01:09:53.759545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769197+0000","last_change":"2023-05-10T01:09:53.766314+0000","last_active":"2023-05-10T01:09:53.769197+0000","last_peered":"2023-05-10T01:09:53.769197+0000","last_clean":"2023-05-10T01:09:53.769197+0000","last_became_active":"2023-05-10T01:09:53.766024+0000","last_became_peered":"2023-05-10T01:09:53.766024+0000","last_unstale":"2023-05-10T01:09:53.769197+0000","last_undegraded":"2023-05-10T01:09:53.769197+0000","last_fullsized":"2023-05-10T01:09:53.769197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757040+0000","last_change":"2023-05-10T01:09:53.381301+0000","last_active":"2023-05-10T01:09:53.757040+0000","last_peered":"2023-05-10T01:09:53.757040+0000","last_clean":"2023-05-10T01:09:53.757040+0000","last_became_active":"2023-05-10T01:09:53.379989+0000","last_became_peered":"2023-05-10T01:09:53.379989+0000","last_unstale":"2023-05-10T01:09:53.757040+0000","last_undegraded":"2023-05-10T01:09:53.757040+0000","last_fullsized":"2023-05-10T01:09:53.757040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778357+0000","last_change":"2023-05-10T01:09:53.777145+0000","last_active":"2023-05-10T01:09:53.778357+0000","last_peered":"2023-05-10T01:09:53.778357+0000","last_clean":"2023-05-10T01:09:53.778357+0000","last_became_active":"2023-05-10T01:09:53.776943+0000","last_became_peered":"2023-05-10T01:09:53.776943+0000","last_unstale":"2023-05-10T01:09:53.778357+0000","last_undegraded":"2023-05-10T01:09:53.778357+0000","last_fullsized":"2023-05-10T01:09:53.778357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759348+0000","last_change":"2023-05-10T01:09:53.378829+0000","last_active":"2023-05-10T01:09:53.759348+0000","last_peered":"2023-05-10T01:09:53.759348+0000","last_clean":"2023-05-10T01:09:53.759348+0000","last_became_active":"2023-05-10T01:09:53.378313+0000","last_became_peered":"2023-05-10T01:09:53.378313+0000","last_unstale":"2023-05-10T01:09:53.759348+0000","last_undegraded":"2023-05-10T01:09:53.759348+0000","last_fullsized":"2023-05-10T01:09:53.759348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774228+0000","last_change":"2023-05-10T01:09:53.773149+0000","last_active":"2023-05-10T01:09:53.774228+0000","last_peered":"2023-05-10T01:09:53.774228+0000","last_clean":"2023-05-10T01:09:53.774228+0000","last_became_active":"2023-05-10T01:09:53.772854+0000","last_became_peered":"2023-05-10T01:09:53.772854+0000","last_unstale":"2023-05-10T01:09:53.774228+0000","last_undegraded":"2023-05-10T01:09:53.774228+0000","last_fullsized":"2023-05-10T01:09:53.774228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790150+0000","last_change":"2023-05-10T01:09:53.383052+0000","last_active":"2023-05-10T01:09:53.790150+0000","last_peered":"2023-05-10T01:09:53.790150+0000","last_clean":"2023-05-10T01:09:53.790150+0000","last_became_active":"2023-05-10T01:09:53.382049+0000","last_became_peered":"2023-05-10T01:09:53.382049+0000","last_unstale":"2023-05-10T01:09:53.790150+0000","last_undegraded":"2023-05-10T01:09:53.790150+0000","last_fullsized":"2023-05-10T01:09:53.790150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789769+0000","last_change":"2023-05-10T01:09:53.780945+0000","last_active":"2023-05-10T01:09:53.789769+0000","last_peered":"2023-05-10T01:09:53.789769+0000","last_clean":"2023-05-10T01:09:53.789769+0000","last_became_active":"2023-05-10T01:09:53.780672+0000","last_became_peered":"2023-05-10T01:09:53.780672+0000","last_unstale":"2023-05-10T01:09:53.789769+0000","last_undegraded":"2023-05-10T01:09:53.789769+0000","last_fullsized":"2023-05-10T01:09:53.789769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786797+0000","last_change":"2023-05-10T01:09:53.378586+0000","last_active":"2023-05-10T01:09:53.786797+0000","last_peered":"2023-05-10T01:09:53.786797+0000","last_clean":"2023-05-10T01:09:53.786797+0000","last_became_active":"2023-05-10T01:09:53.378325+0000","last_became_peered":"2023-05-10T01:09:53.378325+0000","last_unstale":"2023-05-10T01:09:53.786797+0000","last_undegraded":"2023-05-10T01:09:53.786797+0000","last_fullsized":"2023-05-10T01:09:53.786797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769057+0000","last_change":"2023-05-10T01:09:53.763888+0000","last_active":"2023-05-10T01:09:53.769057+0000","last_peered":"2023-05-10T01:09:53.769057+0000","last_clean":"2023-05-10T01:09:53.769057+0000","last_became_active":"2023-05-10T01:09:53.763608+0000","last_became_peered":"2023-05-10T01:09:53.763608+0000","last_unstale":"2023-05-10T01:09:53.769057+0000","last_undegraded":"2023-05-10T01:09:53.769057+0000","last_fullsized":"2023-05-10T01:09:53.769057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789861+0000","last_change":"2023-05-10T01:09:53.384560+0000","last_active":"2023-05-10T01:09:53.789861+0000","last_peered":"2023-05-10T01:09:53.789861+0000","last_clean":"2023-05-10T01:09:53.789861+0000","last_became_active":"2023-05-10T01:09:53.384235+0000","last_became_peered":"2023-05-10T01:09:53.384235+0000","last_unstale":"2023-05-10T01:09:53.789861+0000","last_undegraded":"2023-05-10T01:09:53.789861+0000","last_fullsized":"2023-05-10T01:09:53.789861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.788352+0000","last_change":"2023-05-10T01:09:53.785094+0000","last_active":"2023-05-10T01:09:53.788352+0000","last_peered":"2023-05-10T01:09:53.788352+0000","last_clean":"2023-05-10T01:09:53.788352+0000","last_became_active":"2023-05-10T01:09:53.784831+0000","last_became_peered":"2023-05-10T01:09:53.784831+0000","last_unstale":"2023-05-10T01:09:53.788352+0000","last_undegraded":"2023-05-10T01:09:53.788352+0000","last_fullsized":"2023-05-10T01:09:53.788352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755715+0000","last_change":"2023-05-10T01:09:53.378680+0000","last_active":"2023-05-10T01:09:53.755715+0000","last_peered":"2023-05-10T01:09:53.755715+0000","last_clean":"2023-05-10T01:09:53.755715+0000","last_became_active":"2023-05-10T01:09:53.378257+0000","last_became_peered":"2023-05-10T01:09:53.378257+0000","last_unstale":"2023-05-10T01:09:53.755715+0000","last_undegraded":"2023-05-10T01:09:53.755715+0000","last_fullsized":"2023-05-10T01:09:53.755715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768757+0000","last_change":"2023-05-10T01:09:53.766892+0000","last_active":"2023-05-10T01:09:53.768757+0000","last_peered":"2023-05-10T01:09:53.768757+0000","last_clean":"2023-05-10T01:09:53.768757+0000","last_became_active":"2023-05-10T01:09:53.766517+0000","last_became_peered":"2023-05-10T01:09:53.766517+0000","last_unstale":"2023-05-10T01:09:53.768757+0000","last_undegraded":"2023-05-10T01:09:53.768757+0000","last_fullsized":"2023-05-10T01:09:53.768757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769106+0000","last_change":"2023-05-10T01:09:53.384108+0000","last_active":"2023-05-10T01:09:53.769106+0000","last_peered":"2023-05-10T01:09:53.769106+0000","last_clean":"2023-05-10T01:09:53.769106+0000","last_became_active":"2023-05-10T01:09:53.383818+0000","last_became_peered":"2023-05-10T01:09:53.383818+0000","last_unstale":"2023-05-10T01:09:53.769106+0000","last_undegraded":"2023-05-10T01:09:53.769106+0000","last_fullsized":"2023-05-10T01:09:53.769106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783021+0000","last_change":"2023-05-10T01:09:53.782485+0000","last_active":"2023-05-10T01:09:53.783021+0000","last_peered":"2023-05-10T01:09:53.783021+0000","last_clean":"2023-05-10T01:09:53.783021+0000","last_became_active":"2023-05-10T01:09:53.782201+0000","last_became_peered":"2023-05-10T01:09:53.782201+0000","last_unstale":"2023-05-10T01:09:53.783021+0000","last_undegraded":"2023-05-10T01:09:53.783021+0000","last_fullsized":"2023-05-10T01:09:53.783021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778719+0000","last_change":"2023-05-10T01:09:53.387304+0000","last_active":"2023-05-10T01:09:53.778719+0000","last_peered":"2023-05-10T01:09:53.778719+0000","last_clean":"2023-05-10T01:09:53.778719+0000","last_became_active":"2023-05-10T01:09:53.386981+0000","last_became_peered":"2023-05-10T01:09:53.386981+0000","last_unstale":"2023-05-10T01:09:53.778719+0000","last_undegraded":"2023-05-10T01:09:53.778719+0000","last_fullsized":"2023-05-10T01:09:53.778719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785942+0000","last_change":"2023-05-10T01:09:53.775155+0000","last_active":"2023-05-10T01:09:53.785942+0000","last_peered":"2023-05-10T01:09:53.785942+0000","last_clean":"2023-05-10T01:09:53.785942+0000","last_became_active":"2023-05-10T01:09:53.774869+0000","last_became_peered":"2023-05-10T01:09:53.774869+0000","last_unstale":"2023-05-10T01:09:53.785942+0000","last_undegraded":"2023-05-10T01:09:53.785942+0000","last_fullsized":"2023-05-10T01:09:53.785942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789992+0000","last_change":"2023-05-10T01:09:53.383948+0000","last_active":"2023-05-10T01:09:53.789992+0000","last_peered":"2023-05-10T01:09:53.789992+0000","last_clean":"2023-05-10T01:09:53.789992+0000","last_became_active":"2023-05-10T01:09:53.383677+0000","last_became_peered":"2023-05-10T01:09:53.383677+0000","last_unstale":"2023-05-10T01:09:53.789992+0000","last_undegraded":"2023-05-10T01:09:53.789992+0000","last_fullsized":"2023-05-10T01:09:53.789992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789396+0000","last_change":"2023-05-10T01:09:53.779430+0000","last_active":"2023-05-10T01:09:53.789396+0000","last_peered":"2023-05-10T01:09:53.789396+0000","last_clean":"2023-05-10T01:09:53.789396+0000","last_became_active":"2023-05-10T01:09:53.777122+0000","last_became_peered":"2023-05-10T01:09:53.777122+0000","last_unstale":"2023-05-10T01:09:53.789396+0000","last_undegraded":"2023-05-10T01:09:53.789396+0000","last_fullsized":"2023-05-10T01:09:53.789396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789835+0000","last_change":"2023-05-10T01:09:53.384697+0000","last_active":"2023-05-10T01:09:53.789835+0000","last_peered":"2023-05-10T01:09:53.789835+0000","last_clean":"2023-05-10T01:09:53.789835+0000","last_became_active":"2023-05-10T01:09:53.383952+0000","last_became_peered":"2023-05-10T01:09:53.383952+0000","last_unstale":"2023-05-10T01:09:53.789835+0000","last_undegraded":"2023-05-10T01:09:53.789835+0000","last_fullsized":"2023-05-10T01:09:53.789835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775587+0000","last_change":"2023-05-10T01:09:53.770299+0000","last_active":"2023-05-10T01:09:53.775587+0000","last_peered":"2023-05-10T01:09:53.775587+0000","last_clean":"2023-05-10T01:09:53.775587+0000","last_became_active":"2023-05-10T01:09:53.770016+0000","last_became_peered":"2023-05-10T01:09:53.770016+0000","last_unstale":"2023-05-10T01:09:53.775587+0000","last_undegraded":"2023-05-10T01:09:53.775587+0000","last_fullsized":"2023-05-10T01:09:53.775587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774485+0000","last_change":"2023-05-10T01:09:53.383206+0000","last_active":"2023-05-10T01:09:53.774485+0000","last_peered":"2023-05-10T01:09:53.774485+0000","last_clean":"2023-05-10T01:09:53.774485+0000","last_became_active":"2023-05-10T01:09:53.382411+0000","last_became_peered":"2023-05-10T01:09:53.382411+0000","last_unstale":"2023-05-10T01:09:53.774485+0000","last_undegraded":"2023-05-10T01:09:53.774485+0000","last_fullsized":"2023-05-10T01:09:53.774485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764874+0000","last_change":"2023-05-10T01:09:53.763306+0000","last_active":"2023-05-10T01:09:53.764874+0000","last_peered":"2023-05-10T01:09:53.764874+0000","last_clean":"2023-05-10T01:09:53.764874+0000","last_became_active":"2023-05-10T01:09:53.762635+0000","last_became_peered":"2023-05-10T01:09:53.762635+0000","last_unstale":"2023-05-10T01:09:53.764874+0000","last_undegraded":"2023-05-10T01:09:53.764874+0000","last_fullsized":"2023-05-10T01:09:53.764874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759060+0000","last_change":"2023-05-10T01:09:53.377895+0000","last_active":"2023-05-10T01:09:53.759060+0000","last_peered":"2023-05-10T01:09:53.759060+0000","last_clean":"2023-05-10T01:09:53.759060+0000","last_became_active":"2023-05-10T01:09:53.377611+0000","last_became_peered":"2023-05-10T01:09:53.377611+0000","last_unstale":"2023-05-10T01:09:53.759060+0000","last_undegraded":"2023-05-10T01:09:53.759060+0000","last_fullsized":"2023-05-10T01:09:53.759060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777256+0000","last_change":"2023-05-10T01:09:53.770032+0000","last_active":"2023-05-10T01:09:53.777256+0000","last_peered":"2023-05-10T01:09:53.777256+0000","last_clean":"2023-05-10T01:09:53.777256+0000","last_became_active":"2023-05-10T01:09:53.769759+0000","last_became_peered":"2023-05-10T01:09:53.769759+0000","last_unstale":"2023-05-10T01:09:53.777256+0000","last_undegraded":"2023-05-10T01:09:53.777256+0000","last_fullsized":"2023-05-10T01:09:53.777256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775799+0000","last_change":"2023-05-10T01:09:53.384429+0000","last_active":"2023-05-10T01:09:53.775799+0000","last_peered":"2023-05-10T01:09:53.775799+0000","last_clean":"2023-05-10T01:09:53.775799+0000","last_became_active":"2023-05-10T01:09:53.384089+0000","last_became_peered":"2023-05-10T01:09:53.384089+0000","last_unstale":"2023-05-10T01:09:53.775799+0000","last_undegraded":"2023-05-10T01:09:53.775799+0000","last_fullsized":"2023-05-10T01:09:53.775799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786438+0000","last_change":"2023-05-10T01:09:53.775201+0000","last_active":"2023-05-10T01:09:53.786438+0000","last_peered":"2023-05-10T01:09:53.786438+0000","last_clean":"2023-05-10T01:09:53.786438+0000","last_became_active":"2023-05-10T01:09:53.774881+0000","last_became_peered":"2023-05-10T01:09:53.774881+0000","last_unstale":"2023-05-10T01:09:53.786438+0000","last_undegraded":"2023-05-10T01:09:53.786438+0000","last_fullsized":"2023-05-10T01:09:53.786438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765837+0000","last_change":"2023-05-10T01:09:53.383296+0000","last_active":"2023-05-10T01:09:53.765837+0000","last_peered":"2023-05-10T01:09:53.765837+0000","last_clean":"2023-05-10T01:09:53.765837+0000","last_became_active":"2023-05-10T01:09:53.383024+0000","last_became_peered":"2023-05-10T01:09:53.383024+0000","last_unstale":"2023-05-10T01:09:53.765837+0000","last_undegraded":"2023-05-10T01:09:53.765837+0000","last_fullsized":"2023-05-10T01:09:53.765837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789564+0000","last_change":"2023-05-10T01:09:53.781034+0000","last_active":"2023-05-10T01:09:53.789564+0000","last_peered":"2023-05-10T01:09:53.789564+0000","last_clean":"2023-05-10T01:09:53.789564+0000","last_became_active":"2023-05-10T01:09:53.780772+0000","last_became_peered":"2023-05-10T01:09:53.780772+0000","last_unstale":"2023-05-10T01:09:53.789564+0000","last_undegraded":"2023-05-10T01:09:53.789564+0000","last_fullsized":"2023-05-10T01:09:53.789564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764711+0000","last_change":"2023-05-10T01:09:53.375634+0000","last_active":"2023-05-10T01:09:53.764711+0000","last_peered":"2023-05-10T01:09:53.764711+0000","last_clean":"2023-05-10T01:09:53.764711+0000","last_became_active":"2023-05-10T01:09:53.374842+0000","last_became_peered":"2023-05-10T01:09:53.374842+0000","last_unstale":"2023-05-10T01:09:53.764711+0000","last_undegraded":"2023-05-10T01:09:53.764711+0000","last_fullsized":"2023-05-10T01:09:53.764711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768935+0000","last_change":"2023-05-10T01:09:53.764990+0000","last_active":"2023-05-10T01:09:53.768935+0000","last_peered":"2023-05-10T01:09:53.768935+0000","last_clean":"2023-05-10T01:09:53.768935+0000","last_became_active":"2023-05-10T01:09:53.764708+0000","last_became_peered":"2023-05-10T01:09:53.764708+0000","last_unstale":"2023-05-10T01:09:53.768935+0000","last_undegraded":"2023-05-10T01:09:53.768935+0000","last_fullsized":"2023-05-10T01:09:53.768935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759860+0000","last_change":"2023-05-10T01:09:53.373817+0000","last_active":"2023-05-10T01:09:53.759860+0000","last_peered":"2023-05-10T01:09:53.759860+0000","last_clean":"2023-05-10T01:09:53.759860+0000","last_became_active":"2023-05-10T01:09:53.372121+0000","last_became_peered":"2023-05-10T01:09:53.372121+0000","last_unstale":"2023-05-10T01:09:53.759860+0000","last_undegraded":"2023-05-10T01:09:53.759860+0000","last_fullsized":"2023-05-10T01:09:53.759860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.754503+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:09:53.754503+0000","last_peered":"2023-05-10T01:09:53.754503+0000","last_clean":"2023-05-10T01:09:53.754503+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:09:53.754503+0000","last_undegraded":"2023-05-10T01:09:53.754503+0000","last_fullsized":"2023-05-10T01:09:53.754503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759995+0000","last_change":"2023-05-10T01:09:53.378846+0000","last_active":"2023-05-10T01:09:53.759995+0000","last_peered":"2023-05-10T01:09:53.759995+0000","last_clean":"2023-05-10T01:09:53.759995+0000","last_became_active":"2023-05-10T01:09:53.378439+0000","last_became_peered":"2023-05-10T01:09:53.378439+0000","last_unstale":"2023-05-10T01:09:53.759995+0000","last_undegraded":"2023-05-10T01:09:53.759995+0000","last_fullsized":"2023-05-10T01:09:53.759995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773287+0000","last_change":"2023-05-10T01:09:53.772154+0000","last_active":"2023-05-10T01:09:53.773287+0000","last_peered":"2023-05-10T01:09:53.773287+0000","last_clean":"2023-05-10T01:09:53.773287+0000","last_became_active":"2023-05-10T01:09:53.771765+0000","last_became_peered":"2023-05-10T01:09:53.771765+0000","last_unstale":"2023-05-10T01:09:53.773287+0000","last_undegraded":"2023-05-10T01:09:53.773287+0000","last_fullsized":"2023-05-10T01:09:53.773287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759060+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:09:53.759060+0000","last_peered":"2023-05-10T01:09:53.759060+0000","last_clean":"2023-05-10T01:09:53.759060+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:09:53.759060+0000","last_undegraded":"2023-05-10T01:09:53.759060+0000","last_fullsized":"2023-05-10T01:09:53.759060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768154+0000","last_change":"2023-05-10T01:09:53.383796+0000","last_active":"2023-05-10T01:09:53.768154+0000","last_peered":"2023-05-10T01:09:53.768154+0000","last_clean":"2023-05-10T01:09:53.768154+0000","last_became_active":"2023-05-10T01:09:53.383330+0000","last_became_peered":"2023-05-10T01:09:53.383330+0000","last_unstale":"2023-05-10T01:09:53.768154+0000","last_undegraded":"2023-05-10T01:09:53.768154+0000","last_fullsized":"2023-05-10T01:09:53.768154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765130+0000","last_change":"2023-05-10T01:09:53.763322+0000","last_active":"2023-05-10T01:09:53.765130+0000","last_peered":"2023-05-10T01:09:53.765130+0000","last_clean":"2023-05-10T01:09:53.765130+0000","last_became_active":"2023-05-10T01:09:53.762534+0000","last_became_peered":"2023-05-10T01:09:53.762534+0000","last_unstale":"2023-05-10T01:09:53.765130+0000","last_undegraded":"2023-05-10T01:09:53.765130+0000","last_fullsized":"2023-05-10T01:09:53.765130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775591+0000","last_change":"2023-05-10T01:09:53.774245+0000","last_active":"2023-05-10T01:09:53.775591+0000","last_peered":"2023-05-10T01:09:53.775591+0000","last_clean":"2023-05-10T01:09:53.775591+0000","last_became_active":"2023-05-10T01:09:53.773997+0000","last_became_peered":"2023-05-10T01:09:53.773997+0000","last_unstale":"2023-05-10T01:09:53.775591+0000","last_undegraded":"2023-05-10T01:09:53.775591+0000","last_fullsized":"2023-05-10T01:09:53.775591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757100+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:09:53.757100+0000","last_peered":"2023-05-10T01:09:53.757100+0000","last_clean":"2023-05-10T01:09:53.757100+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:09:53.757100+0000","last_undegraded":"2023-05-10T01:09:53.757100+0000","last_fullsized":"2023-05-10T01:09:53.757100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753403+0000","last_change":"2023-05-10T01:09:53.368527+0000","last_active":"2023-05-10T01:09:53.753403+0000","last_peered":"2023-05-10T01:09:53.753403+0000","last_clean":"2023-05-10T01:09:53.753403+0000","last_became_active":"2023-05-10T01:09:53.368195+0000","last_became_peered":"2023-05-10T01:09:53.368195+0000","last_unstale":"2023-05-10T01:09:53.753403+0000","last_undegraded":"2023-05-10T01:09:53.753403+0000","last_fullsized":"2023-05-10T01:09:53.753403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789709+0000","last_change":"2023-05-10T01:09:53.784150+0000","last_active":"2023-05-10T01:09:53.789709+0000","last_peered":"2023-05-10T01:09:53.789709+0000","last_clean":"2023-05-10T01:09:53.789709+0000","last_became_active":"2023-05-10T01:09:53.783843+0000","last_became_peered":"2023-05-10T01:09:53.783843+0000","last_unstale":"2023-05-10T01:09:53.789709+0000","last_undegraded":"2023-05-10T01:09:53.789709+0000","last_fullsized":"2023-05-10T01:09:53.789709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758906+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:09:53.758906+0000","last_peered":"2023-05-10T01:09:53.758906+0000","last_clean":"2023-05-10T01:09:53.758906+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:09:53.758906+0000","last_undegraded":"2023-05-10T01:09:53.758906+0000","last_fullsized":"2023-05-10T01:09:53.758906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767625+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:09:53.767625+0000","last_peered":"2023-05-10T01:09:53.767625+0000","last_clean":"2023-05-10T01:09:53.767625+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:09:53.767625+0000","last_undegraded":"2023-05-10T01:09:53.767625+0000","last_fullsized":"2023-05-10T01:09:53.767625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758658+0000","last_change":"2023-05-10T01:09:53.380660+0000","last_active":"2023-05-10T01:09:53.758658+0000","last_peered":"2023-05-10T01:09:53.758658+0000","last_clean":"2023-05-10T01:09:53.758658+0000","last_became_active":"2023-05-10T01:09:53.380145+0000","last_became_peered":"2023-05-10T01:09:53.380145+0000","last_unstale":"2023-05-10T01:09:53.758658+0000","last_undegraded":"2023-05-10T01:09:53.758658+0000","last_fullsized":"2023-05-10T01:09:53.758658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765077+0000","last_change":"2023-05-10T01:09:53.762417+0000","last_active":"2023-05-10T01:09:53.765077+0000","last_peered":"2023-05-10T01:09:53.765077+0000","last_clean":"2023-05-10T01:09:53.765077+0000","last_became_active":"2023-05-10T01:09:53.762170+0000","last_became_peered":"2023-05-10T01:09:53.762170+0000","last_unstale":"2023-05-10T01:09:53.765077+0000","last_undegraded":"2023-05-10T01:09:53.765077+0000","last_fullsized":"2023-05-10T01:09:53.765077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768307+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:09:53.768307+0000","last_peered":"2023-05-10T01:09:53.768307+0000","last_clean":"2023-05-10T01:09:53.768307+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:09:53.768307+0000","last_undegraded":"2023-05-10T01:09:53.768307+0000","last_fullsized":"2023-05-10T01:09:53.768307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755602+0000","last_change":"2023-05-10T01:09:53.379906+0000","last_active":"2023-05-10T01:09:53.755602+0000","last_peered":"2023-05-10T01:09:53.755602+0000","last_clean":"2023-05-10T01:09:53.755602+0000","last_became_active":"2023-05-10T01:09:53.379573+0000","last_became_peered":"2023-05-10T01:09:53.379573+0000","last_unstale":"2023-05-10T01:09:53.755602+0000","last_undegraded":"2023-05-10T01:09:53.755602+0000","last_fullsized":"2023-05-10T01:09:53.755602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774378+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:09:53.774378+0000","last_peered":"2023-05-10T01:09:53.774378+0000","last_clean":"2023-05-10T01:09:53.774378+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:09:53.774378+0000","last_undegraded":"2023-05-10T01:09:53.774378+0000","last_fullsized":"2023-05-10T01:09:53.774378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.754926+0000","last_change":"2023-05-10T01:09:53.370231+0000","last_active":"2023-05-10T01:09:53.754926+0000","last_peered":"2023-05-10T01:09:53.754926+0000","last_clean":"2023-05-10T01:09:53.754926+0000","last_became_active":"2023-05-10T01:09:53.369689+0000","last_became_peered":"2023-05-10T01:09:53.369689+0000","last_unstale":"2023-05-10T01:09:53.754926+0000","last_undegraded":"2023-05-10T01:09:53.754926+0000","last_fullsized":"2023-05-10T01:09:53.754926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763598+0000","last_change":"2023-05-10T01:09:53.761010+0000","last_active":"2023-05-10T01:09:53.763598+0000","last_peered":"2023-05-10T01:09:53.763598+0000","last_clean":"2023-05-10T01:09:53.763598+0000","last_became_active":"2023-05-10T01:09:53.760729+0000","last_became_peered":"2023-05-10T01:09:53.760729+0000","last_unstale":"2023-05-10T01:09:53.763598+0000","last_undegraded":"2023-05-10T01:09:53.763598+0000","last_fullsized":"2023-05-10T01:09:53.763598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789343+0000","last_change":"2023-05-10T01:09:53.378347+0000","last_active":"2023-05-10T01:09:53.789343+0000","last_peered":"2023-05-10T01:09:53.789343+0000","last_clean":"2023-05-10T01:09:53.789343+0000","last_became_active":"2023-05-10T01:09:53.378066+0000","last_became_peered":"2023-05-10T01:09:53.378066+0000","last_unstale":"2023-05-10T01:09:53.789343+0000","last_undegraded":"2023-05-10T01:09:53.789343+0000","last_fullsized":"2023-05-10T01:09:53.789343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753859+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:09:53.753859+0000","last_peered":"2023-05-10T01:09:53.753859+0000","last_clean":"2023-05-10T01:09:53.753859+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:09:53.753859+0000","last_undegraded":"2023-05-10T01:09:53.753859+0000","last_fullsized":"2023-05-10T01:09:53.753859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778283+0000","last_change":"2023-05-10T01:09:53.777244+0000","last_active":"2023-05-10T01:09:53.778283+0000","last_peered":"2023-05-10T01:09:53.778283+0000","last_clean":"2023-05-10T01:09:53.778283+0000","last_became_active":"2023-05-10T01:09:53.776901+0000","last_became_peered":"2023-05-10T01:09:53.776901+0000","last_unstale":"2023-05-10T01:09:53.778283+0000","last_undegraded":"2023-05-10T01:09:53.778283+0000","last_fullsized":"2023-05-10T01:09:53.778283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767587+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:09:53.767587+0000","last_peered":"2023-05-10T01:09:53.767587+0000","last_clean":"2023-05-10T01:09:53.767587+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:09:53.767587+0000","last_undegraded":"2023-05-10T01:09:53.767587+0000","last_fullsized":"2023-05-10T01:09:53.767587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756449+0000","last_change":"2023-05-10T01:09:53.379978+0000","last_active":"2023-05-10T01:09:53.756449+0000","last_peered":"2023-05-10T01:09:53.756449+0000","last_clean":"2023-05-10T01:09:53.756449+0000","last_became_active":"2023-05-10T01:09:53.378931+0000","last_became_peered":"2023-05-10T01:09:53.378931+0000","last_unstale":"2023-05-10T01:09:53.756449+0000","last_undegraded":"2023-05-10T01:09:53.756449+0000","last_fullsized":"2023-05-10T01:09:53.756449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789667+0000","last_change":"2023-05-10T01:09:53.781546+0000","last_active":"2023-05-10T01:09:53.789667+0000","last_peered":"2023-05-10T01:09:53.789667+0000","last_clean":"2023-05-10T01:09:53.789667+0000","last_became_active":"2023-05-10T01:09:53.781279+0000","last_became_peered":"2023-05-10T01:09:53.781279+0000","last_unstale":"2023-05-10T01:09:53.789667+0000","last_undegraded":"2023-05-10T01:09:53.789667+0000","last_fullsized":"2023-05-10T01:09:53.789667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769108+0000","last_change":"2023-05-10T01:09:53.765537+0000","last_active":"2023-05-10T01:09:53.769108+0000","last_peered":"2023-05-10T01:09:53.769108+0000","last_clean":"2023-05-10T01:09:53.769108+0000","last_became_active":"2023-05-10T01:09:53.765301+0000","last_became_peered":"2023-05-10T01:09:53.765301+0000","last_unstale":"2023-05-10T01:09:53.769108+0000","last_undegraded":"2023-05-10T01:09:53.769108+0000","last_fullsized":"2023-05-10T01:09:53.769108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756704+0000","last_change":"2023-05-10T01:09:53.383241+0000","last_active":"2023-05-10T01:09:53.756704+0000","last_peered":"2023-05-10T01:09:53.756704+0000","last_clean":"2023-05-10T01:09:53.756704+0000","last_became_active":"2023-05-10T01:09:53.382496+0000","last_became_peered":"2023-05-10T01:09:53.382496+0000","last_unstale":"2023-05-10T01:09:53.756704+0000","last_undegraded":"2023-05-10T01:09:53.756704+0000","last_fullsized":"2023-05-10T01:09:53.756704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780316+0000","last_change":"2023-05-10T01:09:53.770592+0000","last_active":"2023-05-10T01:09:53.780316+0000","last_peered":"2023-05-10T01:09:53.780316+0000","last_clean":"2023-05-10T01:09:53.780316+0000","last_became_active":"2023-05-10T01:09:53.770330+0000","last_became_peered":"2023-05-10T01:09:53.770330+0000","last_unstale":"2023-05-10T01:09:53.780316+0000","last_undegraded":"2023-05-10T01:09:53.780316+0000","last_fullsized":"2023-05-10T01:09:53.780316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759133+0000","last_change":"2023-05-10T01:09:53.383384+0000","last_active":"2023-05-10T01:09:53.759133+0000","last_peered":"2023-05-10T01:09:53.759133+0000","last_clean":"2023-05-10T01:09:53.759133+0000","last_became_active":"2023-05-10T01:09:53.383049+0000","last_became_peered":"2023-05-10T01:09:53.383049+0000","last_unstale":"2023-05-10T01:09:53.759133+0000","last_undegraded":"2023-05-10T01:09:53.759133+0000","last_fullsized":"2023-05-10T01:09:53.759133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789347+0000","last_change":"2023-05-10T01:09:53.778319+0000","last_active":"2023-05-10T01:09:53.789347+0000","last_peered":"2023-05-10T01:09:53.789347+0000","last_clean":"2023-05-10T01:09:53.789347+0000","last_became_active":"2023-05-10T01:09:53.777415+0000","last_became_peered":"2023-05-10T01:09:53.777415+0000","last_unstale":"2023-05-10T01:09:53.789347+0000","last_undegraded":"2023-05-10T01:09:53.789347+0000","last_fullsized":"2023-05-10T01:09:53.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790172+0000","last_change":"2023-05-10T01:09:53.382266+0000","last_active":"2023-05-10T01:09:53.790172+0000","last_peered":"2023-05-10T01:09:53.790172+0000","last_clean":"2023-05-10T01:09:53.790172+0000","last_became_active":"2023-05-10T01:09:53.382000+0000","last_became_peered":"2023-05-10T01:09:53.382000+0000","last_unstale":"2023-05-10T01:09:53.790172+0000","last_undegraded":"2023-05-10T01:09:53.790172+0000","last_fullsized":"2023-05-10T01:09:53.790172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770861+0000","last_change":"2023-05-10T01:09:53.768348+0000","last_active":"2023-05-10T01:09:53.770861+0000","last_peered":"2023-05-10T01:09:53.770861+0000","last_clean":"2023-05-10T01:09:53.770861+0000","last_became_active":"2023-05-10T01:09:53.767452+0000","last_became_peered":"2023-05-10T01:09:53.767452+0000","last_unstale":"2023-05-10T01:09:53.770861+0000","last_undegraded":"2023-05-10T01:09:53.770861+0000","last_fullsized":"2023-05-10T01:09:53.770861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782143+0000","last_change":"2023-05-10T01:09:53.377329+0000","last_active":"2023-05-10T01:09:53.782143+0000","last_peered":"2023-05-10T01:09:53.782143+0000","last_clean":"2023-05-10T01:09:53.782143+0000","last_became_active":"2023-05-10T01:09:53.377037+0000","last_became_peered":"2023-05-10T01:09:53.377037+0000","last_unstale":"2023-05-10T01:09:53.782143+0000","last_undegraded":"2023-05-10T01:09:53.782143+0000","last_fullsized":"2023-05-10T01:09:53.782143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789557+0000","last_change":"2023-05-10T01:09:53.780936+0000","last_active":"2023-05-10T01:09:53.789557+0000","last_peered":"2023-05-10T01:09:53.789557+0000","last_clean":"2023-05-10T01:09:53.789557+0000","last_became_active":"2023-05-10T01:09:53.780642+0000","last_became_peered":"2023-05-10T01:09:53.780642+0000","last_unstale":"2023-05-10T01:09:53.789557+0000","last_undegraded":"2023-05-10T01:09:53.789557+0000","last_fullsized":"2023-05-10T01:09:53.789557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777392+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.777392+0000","last_peered":"2023-05-10T01:09:53.777392+0000","last_clean":"2023-05-10T01:09:53.777392+0000","last_became_active":"2023-05-10T01:09:53.380703+0000","last_became_peered":"2023-05-10T01:09:53.380703+0000","last_unstale":"2023-05-10T01:09:53.777392+0000","last_undegraded":"2023-05-10T01:09:53.777392+0000","last_fullsized":"2023-05-10T01:09:53.777392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774988+0000","last_change":"2023-05-10T01:09:53.773330+0000","last_active":"2023-05-10T01:09:53.774988+0000","last_peered":"2023-05-10T01:09:53.774988+0000","last_clean":"2023-05-10T01:09:53.774988+0000","last_became_active":"2023-05-10T01:09:53.773048+0000","last_became_peered":"2023-05-10T01:09:53.773048+0000","last_unstale":"2023-05-10T01:09:53.774988+0000","last_undegraded":"2023-05-10T01:09:53.774988+0000","last_fullsized":"2023-05-10T01:09:53.774988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769213+0000","last_change":"2023-05-10T01:09:53.385088+0000","last_active":"2023-05-10T01:09:53.769213+0000","last_peered":"2023-05-10T01:09:53.769213+0000","last_clean":"2023-05-10T01:09:53.769213+0000","last_became_active":"2023-05-10T01:09:53.384812+0000","last_became_peered":"2023-05-10T01:09:53.384812+0000","last_unstale":"2023-05-10T01:09:53.769213+0000","last_undegraded":"2023-05-10T01:09:53.769213+0000","last_fullsized":"2023-05-10T01:09:53.769213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762107+0000","last_change":"2023-05-10T01:09:53.760008+0000","last_active":"2023-05-10T01:09:53.762107+0000","last_peered":"2023-05-10T01:09:53.762107+0000","last_clean":"2023-05-10T01:09:53.762107+0000","last_became_active":"2023-05-10T01:09:53.759723+0000","last_became_peered":"2023-05-10T01:09:53.759723+0000","last_unstale":"2023-05-10T01:09:53.762107+0000","last_undegraded":"2023-05-10T01:09:53.762107+0000","last_fullsized":"2023-05-10T01:09:53.762107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757195+0000","last_change":"2023-05-10T01:09:53.378264+0000","last_active":"2023-05-10T01:09:53.757195+0000","last_peered":"2023-05-10T01:09:53.757195+0000","last_clean":"2023-05-10T01:09:53.757195+0000","last_became_active":"2023-05-10T01:09:53.377943+0000","last_became_peered":"2023-05-10T01:09:53.377943+0000","last_unstale":"2023-05-10T01:09:53.757195+0000","last_undegraded":"2023-05-10T01:09:53.757195+0000","last_fullsized":"2023-05-10T01:09:53.757195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.788314+0000","last_change":"2023-05-10T01:09:53.784908+0000","last_active":"2023-05-10T01:09:53.788314+0000","last_peered":"2023-05-10T01:09:53.788314+0000","last_clean":"2023-05-10T01:09:53.788314+0000","last_became_active":"2023-05-10T01:09:53.784482+0000","last_became_peered":"2023-05-10T01:09:53.784482+0000","last_unstale":"2023-05-10T01:09:53.788314+0000","last_undegraded":"2023-05-10T01:09:53.788314+0000","last_fullsized":"2023-05-10T01:09:53.788314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759253+0000","last_change":"2023-05-10T01:09:53.377668+0000","last_active":"2023-05-10T01:09:53.759253+0000","last_peered":"2023-05-10T01:09:53.759253+0000","last_clean":"2023-05-10T01:09:53.759253+0000","last_became_active":"2023-05-10T01:09:53.377379+0000","last_became_peered":"2023-05-10T01:09:53.377379+0000","last_unstale":"2023-05-10T01:09:53.759253+0000","last_undegraded":"2023-05-10T01:09:53.759253+0000","last_fullsized":"2023-05-10T01:09:53.759253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776080+0000","last_change":"2023-05-10T01:09:53.775594+0000","last_active":"2023-05-10T01:09:53.776080+0000","last_peered":"2023-05-10T01:09:53.776080+0000","last_clean":"2023-05-10T01:09:53.776080+0000","last_became_active":"2023-05-10T01:09:53.775258+0000","last_became_peered":"2023-05-10T01:09:53.775258+0000","last_unstale":"2023-05-10T01:09:53.776080+0000","last_undegraded":"2023-05-10T01:09:53.776080+0000","last_fullsized":"2023-05-10T01:09:53.776080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756438+0000","last_change":"2023-05-10T01:09:53.383076+0000","last_active":"2023-05-10T01:09:53.756438+0000","last_peered":"2023-05-10T01:09:53.756438+0000","last_clean":"2023-05-10T01:09:53.756438+0000","last_became_active":"2023-05-10T01:09:53.381851+0000","last_became_peered":"2023-05-10T01:09:53.381851+0000","last_unstale":"2023-05-10T01:09:53.756438+0000","last_undegraded":"2023-05-10T01:09:53.756438+0000","last_fullsized":"2023-05-10T01:09:53.756438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783018+0000","last_change":"2023-05-10T01:09:53.782493+0000","last_active":"2023-05-10T01:09:53.783018+0000","last_peered":"2023-05-10T01:09:53.783018+0000","last_clean":"2023-05-10T01:09:53.783018+0000","last_became_active":"2023-05-10T01:09:53.782211+0000","last_became_peered":"2023-05-10T01:09:53.782211+0000","last_unstale":"2023-05-10T01:09:53.783018+0000","last_undegraded":"2023-05-10T01:09:53.783018+0000","last_fullsized":"2023-05-10T01:09:53.783018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760139+0000","last_change":"2023-05-10T01:09:53.384727+0000","last_active":"2023-05-10T01:09:53.760139+0000","last_peered":"2023-05-10T01:09:53.760139+0000","last_clean":"2023-05-10T01:09:53.760139+0000","last_became_active":"2023-05-10T01:09:53.384426+0000","last_became_peered":"2023-05-10T01:09:53.384426+0000","last_unstale":"2023-05-10T01:09:53.760139+0000","last_undegraded":"2023-05-10T01:09:53.760139+0000","last_fullsized":"2023-05-10T01:09:53.760139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789367+0000","last_change":"2023-05-10T01:09:53.778447+0000","last_active":"2023-05-10T01:09:53.789367+0000","last_peered":"2023-05-10T01:09:53.789367+0000","last_clean":"2023-05-10T01:09:53.789367+0000","last_became_active":"2023-05-10T01:09:53.777503+0000","last_became_peered":"2023-05-10T01:09:53.777503+0000","last_unstale":"2023-05-10T01:09:53.789367+0000","last_undegraded":"2023-05-10T01:09:53.789367+0000","last_fullsized":"2023-05-10T01:09:53.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753478+0000","last_change":"2023-05-10T01:09:53.373308+0000","last_active":"2023-05-10T01:09:53.753478+0000","last_peered":"2023-05-10T01:09:53.753478+0000","last_clean":"2023-05-10T01:09:53.753478+0000","last_became_active":"2023-05-10T01:09:53.372576+0000","last_became_peered":"2023-05-10T01:09:53.372576+0000","last_unstale":"2023-05-10T01:09:53.753478+0000","last_undegraded":"2023-05-10T01:09:53.753478+0000","last_fullsized":"2023-05-10T01:09:53.753478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769654+0000","last_change":"2023-05-10T01:09:53.767497+0000","last_active":"2023-05-10T01:09:53.769654+0000","last_peered":"2023-05-10T01:09:53.769654+0000","last_clean":"2023-05-10T01:09:53.769654+0000","last_became_active":"2023-05-10T01:09:53.764957+0000","last_became_peered":"2023-05-10T01:09:53.764957+0000","last_unstale":"2023-05-10T01:09:53.769654+0000","last_undegraded":"2023-05-10T01:09:53.769654+0000","last_fullsized":"2023-05-10T01:09:53.769654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-10T01:09:57.283120+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:57.283120+0000","last_peered":"2023-05-10T01:09:57.283120+0000","last_clean":"2023-05-10T01:09:57.283120+0000","last_became_active":"2023-05-10T01:09:53.378549+0000","last_became_peered":"2023-05-10T01:09:53.378549+0000","last_unstale":"2023-05-10T01:09:57.283120+0000","last_undegraded":"2023-05-10T01:09:57.283120+0000","last_fullsized":"2023-05-10T01:09:57.283120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780991+0000","last_change":"2023-05-10T01:09:53.777067+0000","last_active":"2023-05-10T01:09:53.780991+0000","last_peered":"2023-05-10T01:09:53.780991+0000","last_clean":"2023-05-10T01:09:53.780991+0000","last_became_active":"2023-05-10T01:09:53.776765+0000","last_became_peered":"2023-05-10T01:09:53.776765+0000","last_unstale":"2023-05-10T01:09:53.780991+0000","last_undegraded":"2023-05-10T01:09:53.780991+0000","last_fullsized":"2023-05-10T01:09:53.780991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764391+0000","last_change":"2023-05-10T01:09:53.384098+0000","last_active":"2023-05-10T01:09:53.764391+0000","last_peered":"2023-05-10T01:09:53.764391+0000","last_clean":"2023-05-10T01:09:53.764391+0000","last_became_active":"2023-05-10T01:09:53.383801+0000","last_became_peered":"2023-05-10T01:09:53.383801+0000","last_unstale":"2023-05-10T01:09:53.764391+0000","last_undegraded":"2023-05-10T01:09:53.764391+0000","last_fullsized":"2023-05-10T01:09:53.764391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770439+0000","last_change":"2023-05-10T01:09:53.768353+0000","last_active":"2023-05-10T01:09:53.770439+0000","last_peered":"2023-05-10T01:09:53.770439+0000","last_clean":"2023-05-10T01:09:53.770439+0000","last_became_active":"2023-05-10T01:09:53.768082+0000","last_became_peered":"2023-05-10T01:09:53.768082+0000","last_unstale":"2023-05-10T01:09:53.770439+0000","last_undegraded":"2023-05-10T01:09:53.770439+0000","last_fullsized":"2023-05-10T01:09:53.770439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759098+0000","last_change":"2023-05-10T01:09:53.379829+0000","last_active":"2023-05-10T01:09:53.759098+0000","last_peered":"2023-05-10T01:09:53.759098+0000","last_clean":"2023-05-10T01:09:53.759098+0000","last_became_active":"2023-05-10T01:09:53.379516+0000","last_became_peered":"2023-05-10T01:09:53.379516+0000","last_unstale":"2023-05-10T01:09:53.759098+0000","last_undegraded":"2023-05-10T01:09:53.759098+0000","last_fullsized":"2023-05-10T01:09:53.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789455+0000","last_change":"2023-05-10T01:09:53.779725+0000","last_active":"2023-05-10T01:09:53.789455+0000","last_peered":"2023-05-10T01:09:53.789455+0000","last_clean":"2023-05-10T01:09:53.789455+0000","last_became_active":"2023-05-10T01:09:53.776948+0000","last_became_peered":"2023-05-10T01:09:53.776948+0000","last_unstale":"2023-05-10T01:09:53.789455+0000","last_undegraded":"2023-05-10T01:09:53.789455+0000","last_fullsized":"2023-05-10T01:09:53.789455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763025+0000","last_change":"2023-05-10T01:09:53.384002+0000","last_active":"2023-05-10T01:09:53.763025+0000","last_peered":"2023-05-10T01:09:53.763025+0000","last_clean":"2023-05-10T01:09:53.763025+0000","last_became_active":"2023-05-10T01:09:53.383716+0000","last_became_peered":"2023-05-10T01:09:53.383716+0000","last_unstale":"2023-05-10T01:09:53.763025+0000","last_undegraded":"2023-05-10T01:09:53.763025+0000","last_fullsized":"2023-05-10T01:09:53.763025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774462+0000","last_change":"2023-05-10T01:09:53.772854+0000","last_active":"2023-05-10T01:09:53.774462+0000","last_peered":"2023-05-10T01:09:53.774462+0000","last_clean":"2023-05-10T01:09:53.774462+0000","last_became_active":"2023-05-10T01:09:53.772540+0000","last_became_peered":"2023-05-10T01:09:53.772540+0000","last_unstale":"2023-05-10T01:09:53.774462+0000","last_undegraded":"2023-05-10T01:09:53.774462+0000","last_fullsized":"2023-05-10T01:09:53.774462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759354+0000","last_change":"2023-05-10T01:09:53.379344+0000","last_active":"2023-05-10T01:09:53.759354+0000","last_peered":"2023-05-10T01:09:53.759354+0000","last_clean":"2023-05-10T01:09:53.759354+0000","last_became_active":"2023-05-10T01:09:53.379093+0000","last_became_peered":"2023-05-10T01:09:53.379093+0000","last_unstale":"2023-05-10T01:09:53.759354+0000","last_undegraded":"2023-05-10T01:09:53.759354+0000","last_fullsized":"2023-05-10T01:09:53.759354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789943+0000","last_change":"2023-05-10T01:09:53.782809+0000","last_active":"2023-05-10T01:09:53.789943+0000","last_peered":"2023-05-10T01:09:53.789943+0000","last_clean":"2023-05-10T01:09:53.789943+0000","last_became_active":"2023-05-10T01:09:53.777458+0000","last_became_peered":"2023-05-10T01:09:53.777458+0000","last_unstale":"2023-05-10T01:09:53.789943+0000","last_undegraded":"2023-05-10T01:09:53.789943+0000","last_fullsized":"2023-05-10T01:09:53.789943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782052+0000","last_change":"2023-05-10T01:09:53.382855+0000","last_active":"2023-05-10T01:09:53.782052+0000","last_peered":"2023-05-10T01:09:53.782052+0000","last_clean":"2023-05-10T01:09:53.782052+0000","last_became_active":"2023-05-10T01:09:53.379670+0000","last_became_peered":"2023-05-10T01:09:53.379670+0000","last_unstale":"2023-05-10T01:09:53.782052+0000","last_undegraded":"2023-05-10T01:09:53.782052+0000","last_fullsized":"2023-05-10T01:09:53.782052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789346+0000","last_change":"2023-05-10T01:09:53.781558+0000","last_active":"2023-05-10T01:09:53.789346+0000","last_peered":"2023-05-10T01:09:53.789346+0000","last_clean":"2023-05-10T01:09:53.789346+0000","last_became_active":"2023-05-10T01:09:53.781283+0000","last_became_peered":"2023-05-10T01:09:53.781283+0000","last_unstale":"2023-05-10T01:09:53.789346+0000","last_undegraded":"2023-05-10T01:09:53.789346+0000","last_fullsized":"2023-05-10T01:09:53.789346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.766776+0000","last_change":"2023-05-10T01:09:53.382597+0000","last_active":"2023-05-10T01:09:53.766776+0000","last_peered":"2023-05-10T01:09:53.766776+0000","last_clean":"2023-05-10T01:09:53.766776+0000","last_became_active":"2023-05-10T01:09:53.382312+0000","last_became_peered":"2023-05-10T01:09:53.382312+0000","last_unstale":"2023-05-10T01:09:53.766776+0000","last_undegraded":"2023-05-10T01:09:53.766776+0000","last_fullsized":"2023-05-10T01:09:53.766776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765131+0000","last_change":"2023-05-10T01:09:53.762455+0000","last_active":"2023-05-10T01:09:53.765131+0000","last_peered":"2023-05-10T01:09:53.765131+0000","last_clean":"2023-05-10T01:09:53.765131+0000","last_became_active":"2023-05-10T01:09:53.762128+0000","last_became_peered":"2023-05-10T01:09:53.762128+0000","last_unstale":"2023-05-10T01:09:53.765131+0000","last_undegraded":"2023-05-10T01:09:53.765131+0000","last_fullsized":"2023-05-10T01:09:53.765131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790088+0000","last_change":"2023-05-10T01:09:53.383349+0000","last_active":"2023-05-10T01:09:53.790088+0000","last_peered":"2023-05-10T01:09:53.790088+0000","last_clean":"2023-05-10T01:09:53.790088+0000","last_became_active":"2023-05-10T01:09:53.381097+0000","last_became_peered":"2023-05-10T01:09:53.381097+0000","last_unstale":"2023-05-10T01:09:53.790088+0000","last_undegraded":"2023-05-10T01:09:53.790088+0000","last_fullsized":"2023-05-10T01:09:53.790088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769665+0000","last_change":"2023-05-10T01:09:53.768045+0000","last_active":"2023-05-10T01:09:53.769665+0000","last_peered":"2023-05-10T01:09:53.769665+0000","last_clean":"2023-05-10T01:09:53.769665+0000","last_became_active":"2023-05-10T01:09:53.767775+0000","last_became_peered":"2023-05-10T01:09:53.767775+0000","last_unstale":"2023-05-10T01:09:53.769665+0000","last_undegraded":"2023-05-10T01:09:53.769665+0000","last_fullsized":"2023-05-10T01:09:53.769665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758314+0000","last_change":"2023-05-10T01:09:53.378075+0000","last_active":"2023-05-10T01:09:53.758314+0000","last_peered":"2023-05-10T01:09:53.758314+0000","last_clean":"2023-05-10T01:09:53.758314+0000","last_became_active":"2023-05-10T01:09:53.377777+0000","last_became_peered":"2023-05-10T01:09:53.377777+0000","last_unstale":"2023-05-10T01:09:53.758314+0000","last_undegraded":"2023-05-10T01:09:53.758314+0000","last_fullsized":"2023-05-10T01:09:53.758314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786432+0000","last_change":"2023-05-10T01:09:53.777094+0000","last_active":"2023-05-10T01:09:53.786432+0000","last_peered":"2023-05-10T01:09:53.786432+0000","last_clean":"2023-05-10T01:09:53.786432+0000","last_became_active":"2023-05-10T01:09:53.776783+0000","last_became_peered":"2023-05-10T01:09:53.776783+0000","last_unstale":"2023-05-10T01:09:53.786432+0000","last_undegraded":"2023-05-10T01:09:53.786432+0000","last_fullsized":"2023-05-10T01:09:53.786432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759876+0000","last_change":"2023-05-10T01:09:53.380032+0000","last_active":"2023-05-10T01:09:53.759876+0000","last_peered":"2023-05-10T01:09:53.759876+0000","last_clean":"2023-05-10T01:09:53.759876+0000","last_became_active":"2023-05-10T01:09:53.379645+0000","last_became_peered":"2023-05-10T01:09:53.379645+0000","last_unstale":"2023-05-10T01:09:53.759876+0000","last_undegraded":"2023-05-10T01:09:53.759876+0000","last_fullsized":"2023-05-10T01:09:53.759876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770896+0000","last_change":"2023-05-10T01:09:53.769678+0000","last_active":"2023-05-10T01:09:53.770896+0000","last_peered":"2023-05-10T01:09:53.770896+0000","last_clean":"2023-05-10T01:09:53.770896+0000","last_became_active":"2023-05-10T01:09:53.768182+0000","last_became_peered":"2023-05-10T01:09:53.768182+0000","last_unstale":"2023-05-10T01:09:53.770896+0000","last_undegraded":"2023-05-10T01:09:53.770896+0000","last_fullsized":"2023-05-10T01:09:53.770896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777638+0000","last_change":"2023-05-10T01:09:53.387228+0000","last_active":"2023-05-10T01:09:53.777638+0000","last_peered":"2023-05-10T01:09:53.777638+0000","last_clean":"2023-05-10T01:09:53.777638+0000","last_became_active":"2023-05-10T01:09:53.386991+0000","last_became_peered":"2023-05-10T01:09:53.386991+0000","last_unstale":"2023-05-10T01:09:53.777638+0000","last_undegraded":"2023-05-10T01:09:53.777638+0000","last_fullsized":"2023-05-10T01:09:53.777638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785856+0000","last_change":"2023-05-10T01:09:53.773869+0000","last_active":"2023-05-10T01:09:53.785856+0000","last_peered":"2023-05-10T01:09:53.785856+0000","last_clean":"2023-05-10T01:09:53.785856+0000","last_became_active":"2023-05-10T01:09:53.773284+0000","last_became_peered":"2023-05-10T01:09:53.773284+0000","last_unstale":"2023-05-10T01:09:53.785856+0000","last_undegraded":"2023-05-10T01:09:53.785856+0000","last_fullsized":"2023-05-10T01:09:53.785856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753391+0000","last_change":"2023-05-10T01:09:53.374463+0000","last_active":"2023-05-10T01:09:53.753391+0000","last_peered":"2023-05-10T01:09:53.753391+0000","last_clean":"2023-05-10T01:09:53.753391+0000","last_became_active":"2023-05-10T01:09:53.372250+0000","last_became_peered":"2023-05-10T01:09:53.372250+0000","last_unstale":"2023-05-10T01:09:53.753391+0000","last_undegraded":"2023-05-10T01:09:53.753391+0000","last_fullsized":"2023-05-10T01:09:53.753391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789874+0000","last_change":"2023-05-10T01:09:53.780390+0000","last_active":"2023-05-10T01:09:53.789874+0000","last_peered":"2023-05-10T01:09:53.789874+0000","last_clean":"2023-05-10T01:09:53.789874+0000","last_became_active":"2023-05-10T01:09:53.780072+0000","last_became_peered":"2023-05-10T01:09:53.780072+0000","last_unstale":"2023-05-10T01:09:53.789874+0000","last_undegraded":"2023-05-10T01:09:53.789874+0000","last_fullsized":"2023-05-10T01:09:53.789874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755808+0000","last_change":"2023-05-10T01:09:53.379278+0000","last_active":"2023-05-10T01:09:53.755808+0000","last_peered":"2023-05-10T01:09:53.755808+0000","last_clean":"2023-05-10T01:09:53.755808+0000","last_became_active":"2023-05-10T01:09:53.378985+0000","last_became_peered":"2023-05-10T01:09:53.378985+0000","last_unstale":"2023-05-10T01:09:53.755808+0000","last_undegraded":"2023-05-10T01:09:53.755808+0000","last_fullsized":"2023-05-10T01:09:53.755808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778912+0000","last_change":"2023-05-10T01:09:53.778386+0000","last_active":"2023-05-10T01:09:53.778912+0000","last_peered":"2023-05-10T01:09:53.778912+0000","last_clean":"2023-05-10T01:09:53.778912+0000","last_became_active":"2023-05-10T01:09:53.778121+0000","last_became_peered":"2023-05-10T01:09:53.778121+0000","last_unstale":"2023-05-10T01:09:53.778912+0000","last_undegraded":"2023-05-10T01:09:53.778912+0000","last_fullsized":"2023-05-10T01:09:53.778912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782640+0000","last_change":"2023-05-10T01:09:53.377455+0000","last_active":"2023-05-10T01:09:53.782640+0000","last_peered":"2023-05-10T01:09:53.782640+0000","last_clean":"2023-05-10T01:09:53.782640+0000","last_became_active":"2023-05-10T01:09:53.377216+0000","last_became_peered":"2023-05-10T01:09:53.377216+0000","last_unstale":"2023-05-10T01:09:53.782640+0000","last_undegraded":"2023-05-10T01:09:53.782640+0000","last_fullsized":"2023-05-10T01:09:53.782640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768114+0000","last_change":"2023-05-10T01:09:53.766371+0000","last_active":"2023-05-10T01:09:53.768114+0000","last_peered":"2023-05-10T01:09:53.768114+0000","last_clean":"2023-05-10T01:09:53.768114+0000","last_became_active":"2023-05-10T01:09:53.766077+0000","last_became_peered":"2023-05-10T01:09:53.766077+0000","last_unstale":"2023-05-10T01:09:53.768114+0000","last_undegraded":"2023-05-10T01:09:53.768114+0000","last_fullsized":"2023-05-10T01:09:53.768114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790195+0000","last_change":"2023-05-10T01:09:53.381183+0000","last_active":"2023-05-10T01:09:53.790195+0000","last_peered":"2023-05-10T01:09:53.790195+0000","last_clean":"2023-05-10T01:09:53.790195+0000","last_became_active":"2023-05-10T01:09:53.380930+0000","last_became_peered":"2023-05-10T01:09:53.380930+0000","last_unstale":"2023-05-10T01:09:53.790195+0000","last_undegraded":"2023-05-10T01:09:53.790195+0000","last_fullsized":"2023-05-10T01:09:53.790195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775783+0000","last_change":"2023-05-10T01:09:53.762054+0000","last_active":"2023-05-10T01:09:53.775783+0000","last_peered":"2023-05-10T01:09:53.775783+0000","last_clean":"2023-05-10T01:09:53.775783+0000","last_became_active":"2023-05-10T01:09:53.761780+0000","last_became_peered":"2023-05-10T01:09:53.761780+0000","last_unstale":"2023-05-10T01:09:53.775783+0000","last_undegraded":"2023-05-10T01:09:53.775783+0000","last_fullsized":"2023-05-10T01:09:53.775783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765676+0000","last_change":"2023-05-10T01:09:53.376957+0000","last_active":"2023-05-10T01:09:53.765676+0000","last_peered":"2023-05-10T01:09:53.765676+0000","last_clean":"2023-05-10T01:09:53.765676+0000","last_became_active":"2023-05-10T01:09:53.376671+0000","last_became_peered":"2023-05-10T01:09:53.376671+0000","last_unstale":"2023-05-10T01:09:53.765676+0000","last_undegraded":"2023-05-10T01:09:53.765676+0000","last_fullsized":"2023-05-10T01:09:53.765676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786478+0000","last_change":"2023-05-10T01:09:53.778775+0000","last_active":"2023-05-10T01:09:53.786478+0000","last_peered":"2023-05-10T01:09:53.786478+0000","last_clean":"2023-05-10T01:09:53.786478+0000","last_became_active":"2023-05-10T01:09:53.778466+0000","last_became_peered":"2023-05-10T01:09:53.778466+0000","last_unstale":"2023-05-10T01:09:53.786478+0000","last_undegraded":"2023-05-10T01:09:53.786478+0000","last_fullsized":"2023-05-10T01:09:53.786478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767867+0000","last_change":"2023-05-10T01:09:53.377703+0000","last_active":"2023-05-10T01:09:53.767867+0000","last_peered":"2023-05-10T01:09:53.767867+0000","last_clean":"2023-05-10T01:09:53.767867+0000","last_became_active":"2023-05-10T01:09:53.377326+0000","last_became_peered":"2023-05-10T01:09:53.377326+0000","last_unstale":"2023-05-10T01:09:53.767867+0000","last_undegraded":"2023-05-10T01:09:53.767867+0000","last_fullsized":"2023-05-10T01:09:53.767867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780343+0000","last_change":"2023-05-10T01:09:53.771235+0000","last_active":"2023-05-10T01:09:53.780343+0000","last_peered":"2023-05-10T01:09:53.780343+0000","last_clean":"2023-05-10T01:09:53.780343+0000","last_became_active":"2023-05-10T01:09:53.770851+0000","last_became_peered":"2023-05-10T01:09:53.770851+0000","last_unstale":"2023-05-10T01:09:53.780343+0000","last_undegraded":"2023-05-10T01:09:53.780343+0000","last_fullsized":"2023-05-10T01:09:53.780343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773545+0000","last_change":"2023-05-10T01:09:53.381560+0000","last_active":"2023-05-10T01:09:53.773545+0000","last_peered":"2023-05-10T01:09:53.773545+0000","last_clean":"2023-05-10T01:09:53.773545+0000","last_became_active":"2023-05-10T01:09:53.381233+0000","last_became_peered":"2023-05-10T01:09:53.381233+0000","last_unstale":"2023-05-10T01:09:53.773545+0000","last_undegraded":"2023-05-10T01:09:53.773545+0000","last_fullsized":"2023-05-10T01:09:53.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770806+0000","last_change":"2023-05-10T01:09:53.768979+0000","last_active":"2023-05-10T01:09:53.770806+0000","last_peered":"2023-05-10T01:09:53.770806+0000","last_clean":"2023-05-10T01:09:53.770806+0000","last_became_active":"2023-05-10T01:09:53.768736+0000","last_became_peered":"2023-05-10T01:09:53.768736+0000","last_unstale":"2023-05-10T01:09:53.770806+0000","last_undegraded":"2023-05-10T01:09:53.770806+0000","last_fullsized":"2023-05-10T01:09:53.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759905+0000","last_change":"2023-05-10T01:09:53.380523+0000","last_active":"2023-05-10T01:09:53.759905+0000","last_peered":"2023-05-10T01:09:53.759905+0000","last_clean":"2023-05-10T01:09:53.759905+0000","last_became_active":"2023-05-10T01:09:53.380220+0000","last_became_peered":"2023-05-10T01:09:53.380220+0000","last_unstale":"2023-05-10T01:09:53.759905+0000","last_undegraded":"2023-05-10T01:09:53.759905+0000","last_fullsized":"2023-05-10T01:09:53.759905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785890+0000","last_change":"2023-05-10T01:09:53.774054+0000","last_active":"2023-05-10T01:09:53.785890+0000","last_peered":"2023-05-10T01:09:53.785890+0000","last_clean":"2023-05-10T01:09:53.785890+0000","last_became_active":"2023-05-10T01:09:53.773600+0000","last_became_peered":"2023-05-10T01:09:53.773600+0000","last_unstale":"2023-05-10T01:09:53.785890+0000","last_undegraded":"2023-05-10T01:09:53.785890+0000","last_fullsized":"2023-05-10T01:09:53.785890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769207+0000","last_change":"2023-05-10T01:09:53.387215+0000","last_active":"2023-05-10T01:09:53.769207+0000","last_peered":"2023-05-10T01:09:53.769207+0000","last_clean":"2023-05-10T01:09:53.769207+0000","last_became_active":"2023-05-10T01:09:53.386942+0000","last_became_peered":"2023-05-10T01:09:53.386942+0000","last_unstale":"2023-05-10T01:09:53.769207+0000","last_undegraded":"2023-05-10T01:09:53.769207+0000","last_fullsized":"2023-05-10T01:09:53.769207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789796+0000","last_change":"2023-05-10T01:09:53.775699+0000","last_active":"2023-05-10T01:09:53.789796+0000","last_peered":"2023-05-10T01:09:53.789796+0000","last_clean":"2023-05-10T01:09:53.789796+0000","last_became_active":"2023-05-10T01:09:53.775407+0000","last_became_peered":"2023-05-10T01:09:53.775407+0000","last_unstale":"2023-05-10T01:09:53.789796+0000","last_undegraded":"2023-05-10T01:09:53.789796+0000","last_fullsized":"2023-05-10T01:09:53.789796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775817+0000","last_change":"2023-05-10T01:09:53.387442+0000","last_active":"2023-05-10T01:09:53.775817+0000","last_peered":"2023-05-10T01:09:53.775817+0000","last_clean":"2023-05-10T01:09:53.775817+0000","last_became_active":"2023-05-10T01:09:53.387192+0000","last_became_peered":"2023-05-10T01:09:53.387192+0000","last_unstale":"2023-05-10T01:09:53.775817+0000","last_undegraded":"2023-05-10T01:09:53.775817+0000","last_fullsized":"2023-05-10T01:09:53.775817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.781258+0000","last_change":"2023-05-10T01:09:53.776255+0000","last_active":"2023-05-10T01:09:53.781258+0000","last_peered":"2023-05-10T01:09:53.781258+0000","last_clean":"2023-05-10T01:09:53.781258+0000","last_became_active":"2023-05-10T01:09:53.775994+0000","last_became_peered":"2023-05-10T01:09:53.775994+0000","last_unstale":"2023-05-10T01:09:53.781258+0000","last_undegraded":"2023-05-10T01:09:53.781258+0000","last_fullsized":"2023-05-10T01:09:53.781258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786324+0000","last_change":"2023-05-10T01:09:53.381425+0000","last_active":"2023-05-10T01:09:53.786324+0000","last_peered":"2023-05-10T01:09:53.786324+0000","last_clean":"2023-05-10T01:09:53.786324+0000","last_became_active":"2023-05-10T01:09:53.381139+0000","last_became_peered":"2023-05-10T01:09:53.381139+0000","last_unstale":"2023-05-10T01:09:53.786324+0000","last_undegraded":"2023-05-10T01:09:53.786324+0000","last_fullsized":"2023-05-10T01:09:53.786324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764895+0000","last_change":"2023-05-10T01:09:53.763499+0000","last_active":"2023-05-10T01:09:53.764895+0000","last_peered":"2023-05-10T01:09:53.764895+0000","last_clean":"2023-05-10T01:09:53.764895+0000","last_became_active":"2023-05-10T01:09:53.763025+0000","last_became_peered":"2023-05-10T01:09:53.763025+0000","last_unstale":"2023-05-10T01:09:53.764895+0000","last_undegraded":"2023-05-10T01:09:53.764895+0000","last_fullsized":"2023-05-10T01:09:53.764895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780774+0000","last_change":"2023-05-10T01:09:53.379747+0000","last_active":"2023-05-10T01:09:53.780774+0000","last_peered":"2023-05-10T01:09:53.780774+0000","last_clean":"2023-05-10T01:09:53.780774+0000","last_became_active":"2023-05-10T01:09:53.379410+0000","last_became_peered":"2023-05-10T01:09:53.379410+0000","last_unstale":"2023-05-10T01:09:53.780774+0000","last_undegraded":"2023-05-10T01:09:53.780774+0000","last_fullsized":"2023-05-10T01:09:53.780774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789720+0000","last_change":"2023-05-10T01:09:53.782423+0000","last_active":"2023-05-10T01:09:53.789720+0000","last_peered":"2023-05-10T01:09:53.789720+0000","last_clean":"2023-05-10T01:09:53.789720+0000","last_became_active":"2023-05-10T01:09:53.782122+0000","last_became_peered":"2023-05-10T01:09:53.782122+0000","last_unstale":"2023-05-10T01:09:53.789720+0000","last_undegraded":"2023-05-10T01:09:53.789720+0000","last_fullsized":"2023-05-10T01:09:53.789720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756687+0000","last_change":"2023-05-10T01:09:53.377917+0000","last_active":"2023-05-10T01:09:53.756687+0000","last_peered":"2023-05-10T01:09:53.756687+0000","last_clean":"2023-05-10T01:09:53.756687+0000","last_became_active":"2023-05-10T01:09:53.377603+0000","last_became_peered":"2023-05-10T01:09:53.377603+0000","last_unstale":"2023-05-10T01:09:53.756687+0000","last_undegraded":"2023-05-10T01:09:53.756687+0000","last_fullsized":"2023-05-10T01:09:53.756687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786549+0000","last_change":"2023-05-10T01:09:53.779988+0000","last_active":"2023-05-10T01:09:53.786549+0000","last_peered":"2023-05-10T01:09:53.786549+0000","last_clean":"2023-05-10T01:09:53.786549+0000","last_became_active":"2023-05-10T01:09:53.774488+0000","last_became_peered":"2023-05-10T01:09:53.774488+0000","last_unstale":"2023-05-10T01:09:53.786549+0000","last_undegraded":"2023-05-10T01:09:53.786549+0000","last_fullsized":"2023-05-10T01:09:53.786549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753958+0000","last_change":"2023-05-10T01:09:53.370862+0000","last_active":"2023-05-10T01:09:53.753958+0000","last_peered":"2023-05-10T01:09:53.753958+0000","last_clean":"2023-05-10T01:09:53.753958+0000","last_became_active":"2023-05-10T01:09:53.370581+0000","last_became_peered":"2023-05-10T01:09:53.370581+0000","last_unstale":"2023-05-10T01:09:53.753958+0000","last_undegraded":"2023-05-10T01:09:53.753958+0000","last_fullsized":"2023-05-10T01:09:53.753958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785974+0000","last_change":"2023-05-10T01:09:53.775797+0000","last_active":"2023-05-10T01:09:53.785974+0000","last_peered":"2023-05-10T01:09:53.785974+0000","last_clean":"2023-05-10T01:09:53.785974+0000","last_became_active":"2023-05-10T01:09:53.775494+0000","last_became_peered":"2023-05-10T01:09:53.775494+0000","last_unstale":"2023-05-10T01:09:53.785974+0000","last_undegraded":"2023-05-10T01:09:53.785974+0000","last_fullsized":"2023-05-10T01:09:53.785974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789403+0000","last_change":"2023-05-10T01:09:53.382141+0000","last_active":"2023-05-10T01:09:53.789403+0000","last_peered":"2023-05-10T01:09:53.789403+0000","last_clean":"2023-05-10T01:09:53.789403+0000","last_became_active":"2023-05-10T01:09:53.381836+0000","last_became_peered":"2023-05-10T01:09:53.381836+0000","last_unstale":"2023-05-10T01:09:53.789403+0000","last_undegraded":"2023-05-10T01:09:53.789403+0000","last_fullsized":"2023-05-10T01:09:53.789403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:10:04.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:10:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.840+0000 7f77343bf700 1 Processor -- start 2023-05-10T01:10:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.840+0000 7f77343bf700 1 -- start start 2023-05-10T01:10:04.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f77343bf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f772c154540 0x7f772c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f77343bf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0c0650 con 0x7f772c154160 2023-05-10T01:10:04.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f77343bf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c069fb0 con 0x7f772c069b80 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f77343bf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0bfd20 con 0x7f772c154540 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f773215b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f772c154160 0x7f772c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39578/0 (socket says 172.21.15.52:39578) 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f773215b700 1 -- 172.21.15.52:0/2494477429 learned_addr learned my addr 172.21.15.52:0/2494477429 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f773195a700 1 --2- 172.21.15.52:0/2494477429 >> v2:172.21.15.172:3300/0 conn(0x7f772c154540 0x7f772c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f7731159700 1 -- 172.21.15.52:0/2494477429 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515071659 0 0) 0x7f772c0c0650 con 0x7f772c154160 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.841+0000 7f7731159700 1 -- 172.21.15.52:0/2494477429 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77180033f0 con 0x7f772c154160 2023-05-10T01:10:04.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f773195a700 1 -- 172.21.15.52:0/2494477429 >> v1:172.21.15.172:6789/0 conn(0x7f772c069b80 legacy=0x7f772c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f773195a700 1 -- 172.21.15.52:0/2494477429 >> v1:172.21.15.52:6789/0 conn(0x7f772c154160 legacy=0x7f772c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f773195a700 1 -- 172.21.15.52:0/2494477429 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0c0000 con 0x7f772c154540 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f773195a700 1 --2- 172.21.15.52:0/2494477429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c069690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7720009760 tx=0x7f7720009060).ready entity=mon.1 client_cookie=4f0ec0a766dabe9c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f7731159700 1 -- 172.21.15.52:0/2494477429 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000f510 con 0x7f772c154540 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f7731159700 1 -- 172.21.15.52:0/2494477429 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000f670 con 0x7f772c154540 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f7731159700 1 -- 172.21.15.52:0/2494477429 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000f9f0 con 0x7f772c154540 2023-05-10T01:10:04.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f77343bf700 1 -- 172.21.15.52:0/2494477429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 msgr2=0x7f772c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.842+0000 7f77343bf700 1 --2- 172.21.15.52:0/2494477429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c069690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7720009760 tx=0x7f7720009060).stop 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.843+0000 7f77343bf700 1 -- 172.21.15.52:0/2494477429 shutdown_connections 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.843+0000 7f77343bf700 1 --2- 172.21.15.52:0/2494477429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c069690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.843+0000 7f77343bf700 1 -- 172.21.15.52:0/2494477429 >> 172.21.15.52:0/2494477429 conn(0x7f772c0cb740 msgr2=0x7f772c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.843+0000 7f77343bf700 1 -- 172.21.15.52:0/2494477429 shutdown_connections 2023-05-10T01:10:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.843+0000 7f77343bf700 1 -- 172.21.15.52:0/2494477429 wait complete. 2023-05-10T01:10:04.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 Processor -- start 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 -- start start 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f772c154160 0x7f772c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c14f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0b04b0 con 0x7f772c069b80 2023-05-10T01:10:04.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c2a50 con 0x7f772c154540 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.844+0000 7f77343bf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c2d30 con 0x7f772c154160 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58800/0 (socket says 172.21.15.52:58800) 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 -- 172.21.15.52:0/4158757736 learned_addr learned my addr 172.21.15.52:0/4158757736 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773195a700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f772c154160 0x7f772c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773295c700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 -- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f772c154160 msgr2=0x7f772c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f772c154160 0x7f772c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 -- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 msgr2=0x7f772c14f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c14f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 -- 172.21.15.52:0/4158757736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200092a0 con 0x7f772c069b80 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773295c700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c14f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f773215b700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f772400c590 tx=0x7f7724007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724007e40 con 0x7f772c069b80 2023-05-10T01:10:04.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77240072e0 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c0b0140 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77240057a0 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.845+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c0c2720 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.846+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c0666b0 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.846+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f772401a060 con 0x7f772c069b80 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.847+0000 7f772a7fc700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 0x7f770c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:04.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.847+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7724079070 con 0x7f772c069b80 2023-05-10T01:10:04.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.847+0000 7f773195a700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 0x7f770c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:04.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.847+0000 7f773195a700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 0x7f770c061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f772c154920 tx=0x7f7720017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:04.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:04.851+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f772404a500 con 0x7f772c069b80 2023-05-10T01:10:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.019+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f772c0b05f0 con 0x7f770c05ed90 2023-05-10T01:10:05.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.029+0000 7f772a7fc700 1 -- 172.21.15.52:0/4158757736 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336229 (secure 0 0 0) 0x7f772001f070 con 0x7f770c05ed90 2023-05-10T01:10:05.037 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:05.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 msgr2=0x7f770c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 0x7f770c061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f772c154920 tx=0x7f7720017000).stop 2023-05-10T01:10:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 msgr2=0x7f772c0b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f772400c590 tx=0x7f7724007c80).stop 2023-05-10T01:10:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 shutdown_connections 2023-05-10T01:10:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f770c05ed90 0x7f770c061250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f772c154540 0x7f772c14f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f772c069b80 0x7f772c0b0940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 --2- 172.21.15.52:0/4158757736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f772c154160 0x7f772c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.032+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 >> 172.21.15.52:0/4158757736 conn(0x7f772c0cb740 msgr2=0x7f772c0ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.033+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 shutdown_connections 2023-05-10T01:10:05.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.033+0000 7f77343bf700 1 -- 172.21.15.52:0/4158757736 wait complete. 2023-05-10T01:10:05.042 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:10:05.048 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-10T01:10:04.443444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41728,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39808,"kb_avail":754932992,"statfs":{"total":773094113280,"available":773051383808,"internally_reserved":0,"allocated":1900544,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40763392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002313"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769639+0000","last_change":"2023-05-10T01:09:53.767516+0000","last_active":"2023-05-10T01:09:53.769639+0000","last_peered":"2023-05-10T01:09:53.769639+0000","last_clean":"2023-05-10T01:09:53.769639+0000","last_became_active":"2023-05-10T01:09:53.767220+0000","last_became_peered":"2023-05-10T01:09:53.767220+0000","last_unstale":"2023-05-10T01:09:53.769639+0000","last_undegraded":"2023-05-10T01:09:53.769639+0000","last_fullsized":"2023-05-10T01:09:53.769639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765712+0000","last_change":"2023-05-10T01:09:53.376660+0000","last_active":"2023-05-10T01:09:53.765712+0000","last_peered":"2023-05-10T01:09:53.765712+0000","last_clean":"2023-05-10T01:09:53.765712+0000","last_became_active":"2023-05-10T01:09:53.372795+0000","last_became_peered":"2023-05-10T01:09:53.372795+0000","last_unstale":"2023-05-10T01:09:53.765712+0000","last_undegraded":"2023-05-10T01:09:53.765712+0000","last_fullsized":"2023-05-10T01:09:53.765712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778404+0000","last_change":"2023-05-10T01:09:53.777846+0000","last_active":"2023-05-10T01:09:53.778404+0000","last_peered":"2023-05-10T01:09:53.778404+0000","last_clean":"2023-05-10T01:09:53.778404+0000","last_became_active":"2023-05-10T01:09:53.777351+0000","last_became_peered":"2023-05-10T01:09:53.777351+0000","last_unstale":"2023-05-10T01:09:53.778404+0000","last_undegraded":"2023-05-10T01:09:53.778404+0000","last_fullsized":"2023-05-10T01:09:53.778404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753389+0000","last_change":"2023-05-10T01:09:53.372546+0000","last_active":"2023-05-10T01:09:53.753389+0000","last_peered":"2023-05-10T01:09:53.753389+0000","last_clean":"2023-05-10T01:09:53.753389+0000","last_became_active":"2023-05-10T01:09:53.371853+0000","last_became_peered":"2023-05-10T01:09:53.371853+0000","last_unstale":"2023-05-10T01:09:53.753389+0000","last_undegraded":"2023-05-10T01:09:53.753389+0000","last_fullsized":"2023-05-10T01:09:53.753389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780965+0000","last_change":"2023-05-10T01:09:53.776453+0000","last_active":"2023-05-10T01:09:53.780965+0000","last_peered":"2023-05-10T01:09:53.780965+0000","last_clean":"2023-05-10T01:09:53.780965+0000","last_became_active":"2023-05-10T01:09:53.776189+0000","last_became_peered":"2023-05-10T01:09:53.776189+0000","last_unstale":"2023-05-10T01:09:53.780965+0000","last_undegraded":"2023-05-10T01:09:53.780965+0000","last_fullsized":"2023-05-10T01:09:53.780965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759545+0000","last_change":"2023-05-10T01:09:53.376261+0000","last_active":"2023-05-10T01:09:53.759545+0000","last_peered":"2023-05-10T01:09:53.759545+0000","last_clean":"2023-05-10T01:09:53.759545+0000","last_became_active":"2023-05-10T01:09:53.375962+0000","last_became_peered":"2023-05-10T01:09:53.375962+0000","last_unstale":"2023-05-10T01:09:53.759545+0000","last_undegraded":"2023-05-10T01:09:53.759545+0000","last_fullsized":"2023-05-10T01:09:53.759545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769197+0000","last_change":"2023-05-10T01:09:53.766314+0000","last_active":"2023-05-10T01:09:53.769197+0000","last_peered":"2023-05-10T01:09:53.769197+0000","last_clean":"2023-05-10T01:09:53.769197+0000","last_became_active":"2023-05-10T01:09:53.766024+0000","last_became_peered":"2023-05-10T01:09:53.766024+0000","last_unstale":"2023-05-10T01:09:53.769197+0000","last_undegraded":"2023-05-10T01:09:53.769197+0000","last_fullsized":"2023-05-10T01:09:53.769197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757040+0000","last_change":"2023-05-10T01:09:53.381301+0000","last_active":"2023-05-10T01:09:53.757040+0000","last_peered":"2023-05-10T01:09:53.757040+0000","last_clean":"2023-05-10T01:09:53.757040+0000","last_became_active":"2023-05-10T01:09:53.379989+0000","last_became_peered":"2023-05-10T01:09:53.379989+0000","last_unstale":"2023-05-10T01:09:53.757040+0000","last_undegraded":"2023-05-10T01:09:53.757040+0000","last_fullsized":"2023-05-10T01:09:53.757040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778357+0000","last_change":"2023-05-10T01:09:53.777145+0000","last_active":"2023-05-10T01:09:53.778357+0000","last_peered":"2023-05-10T01:09:53.778357+0000","last_clean":"2023-05-10T01:09:53.778357+0000","last_became_active":"2023-05-10T01:09:53.776943+0000","last_became_peered":"2023-05-10T01:09:53.776943+0000","last_unstale":"2023-05-10T01:09:53.778357+0000","last_undegraded":"2023-05-10T01:09:53.778357+0000","last_fullsized":"2023-05-10T01:09:53.778357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759348+0000","last_change":"2023-05-10T01:09:53.378829+0000","last_active":"2023-05-10T01:09:53.759348+0000","last_peered":"2023-05-10T01:09:53.759348+0000","last_clean":"2023-05-10T01:09:53.759348+0000","last_became_active":"2023-05-10T01:09:53.378313+0000","last_became_peered":"2023-05-10T01:09:53.378313+0000","last_unstale":"2023-05-10T01:09:53.759348+0000","last_undegraded":"2023-05-10T01:09:53.759348+0000","last_fullsized":"2023-05-10T01:09:53.759348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774228+0000","last_change":"2023-05-10T01:09:53.773149+0000","last_active":"2023-05-10T01:09:53.774228+0000","last_peered":"2023-05-10T01:09:53.774228+0000","last_clean":"2023-05-10T01:09:53.774228+0000","last_became_active":"2023-05-10T01:09:53.772854+0000","last_became_peered":"2023-05-10T01:09:53.772854+0000","last_unstale":"2023-05-10T01:09:53.774228+0000","last_undegraded":"2023-05-10T01:09:53.774228+0000","last_fullsized":"2023-05-10T01:09:53.774228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790150+0000","last_change":"2023-05-10T01:09:53.383052+0000","last_active":"2023-05-10T01:09:53.790150+0000","last_peered":"2023-05-10T01:09:53.790150+0000","last_clean":"2023-05-10T01:09:53.790150+0000","last_became_active":"2023-05-10T01:09:53.382049+0000","last_became_peered":"2023-05-10T01:09:53.382049+0000","last_unstale":"2023-05-10T01:09:53.790150+0000","last_undegraded":"2023-05-10T01:09:53.790150+0000","last_fullsized":"2023-05-10T01:09:53.790150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789769+0000","last_change":"2023-05-10T01:09:53.780945+0000","last_active":"2023-05-10T01:09:53.789769+0000","last_peered":"2023-05-10T01:09:53.789769+0000","last_clean":"2023-05-10T01:09:53.789769+0000","last_became_active":"2023-05-10T01:09:53.780672+0000","last_became_peered":"2023-05-10T01:09:53.780672+0000","last_unstale":"2023-05-10T01:09:53.789769+0000","last_undegraded":"2023-05-10T01:09:53.789769+0000","last_fullsized":"2023-05-10T01:09:53.789769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786797+0000","last_change":"2023-05-10T01:09:53.378586+0000","last_active":"2023-05-10T01:09:53.786797+0000","last_peered":"2023-05-10T01:09:53.786797+0000","last_clean":"2023-05-10T01:09:53.786797+0000","last_became_active":"2023-05-10T01:09:53.378325+0000","last_became_peered":"2023-05-10T01:09:53.378325+0000","last_unstale":"2023-05-10T01:09:53.786797+0000","last_undegraded":"2023-05-10T01:09:53.786797+0000","last_fullsized":"2023-05-10T01:09:53.786797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769057+0000","last_change":"2023-05-10T01:09:53.763888+0000","last_active":"2023-05-10T01:09:53.769057+0000","last_peered":"2023-05-10T01:09:53.769057+0000","last_clean":"2023-05-10T01:09:53.769057+0000","last_became_active":"2023-05-10T01:09:53.763608+0000","last_became_peered":"2023-05-10T01:09:53.763608+0000","last_unstale":"2023-05-10T01:09:53.769057+0000","last_undegraded":"2023-05-10T01:09:53.769057+0000","last_fullsized":"2023-05-10T01:09:53.769057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789861+0000","last_change":"2023-05-10T01:09:53.384560+0000","last_active":"2023-05-10T01:09:53.789861+0000","last_peered":"2023-05-10T01:09:53.789861+0000","last_clean":"2023-05-10T01:09:53.789861+0000","last_became_active":"2023-05-10T01:09:53.384235+0000","last_became_peered":"2023-05-10T01:09:53.384235+0000","last_unstale":"2023-05-10T01:09:53.789861+0000","last_undegraded":"2023-05-10T01:09:53.789861+0000","last_fullsized":"2023-05-10T01:09:53.789861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.788352+0000","last_change":"2023-05-10T01:09:53.785094+0000","last_active":"2023-05-10T01:09:53.788352+0000","last_peered":"2023-05-10T01:09:53.788352+0000","last_clean":"2023-05-10T01:09:53.788352+0000","last_became_active":"2023-05-10T01:09:53.784831+0000","last_became_peered":"2023-05-10T01:09:53.784831+0000","last_unstale":"2023-05-10T01:09:53.788352+0000","last_undegraded":"2023-05-10T01:09:53.788352+0000","last_fullsized":"2023-05-10T01:09:53.788352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755715+0000","last_change":"2023-05-10T01:09:53.378680+0000","last_active":"2023-05-10T01:09:53.755715+0000","last_peered":"2023-05-10T01:09:53.755715+0000","last_clean":"2023-05-10T01:09:53.755715+0000","last_became_active":"2023-05-10T01:09:53.378257+0000","last_became_peered":"2023-05-10T01:09:53.378257+0000","last_unstale":"2023-05-10T01:09:53.755715+0000","last_undegraded":"2023-05-10T01:09:53.755715+0000","last_fullsized":"2023-05-10T01:09:53.755715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768757+0000","last_change":"2023-05-10T01:09:53.766892+0000","last_active":"2023-05-10T01:09:53.768757+0000","last_peered":"2023-05-10T01:09:53.768757+0000","last_clean":"2023-05-10T01:09:53.768757+0000","last_became_active":"2023-05-10T01:09:53.766517+0000","last_became_peered":"2023-05-10T01:09:53.766517+0000","last_unstale":"2023-05-10T01:09:53.768757+0000","last_undegraded":"2023-05-10T01:09:53.768757+0000","last_fullsized":"2023-05-10T01:09:53.768757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769106+0000","last_change":"2023-05-10T01:09:53.384108+0000","last_active":"2023-05-10T01:09:53.769106+0000","last_peered":"2023-05-10T01:09:53.769106+0000","last_clean":"2023-05-10T01:09:53.769106+0000","last_became_active":"2023-05-10T01:09:53.383818+0000","last_became_peered":"2023-05-10T01:09:53.383818+0000","last_unstale":"2023-05-10T01:09:53.769106+0000","last_undegraded":"2023-05-10T01:09:53.769106+0000","last_fullsized":"2023-05-10T01:09:53.769106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783021+0000","last_change":"2023-05-10T01:09:53.782485+0000","last_active":"2023-05-10T01:09:53.783021+0000","last_peered":"2023-05-10T01:09:53.783021+0000","last_clean":"2023-05-10T01:09:53.783021+0000","last_became_active":"2023-05-10T01:09:53.782201+0000","last_became_peered":"2023-05-10T01:09:53.782201+0000","last_unstale":"2023-05-10T01:09:53.783021+0000","last_undegraded":"2023-05-10T01:09:53.783021+0000","last_fullsized":"2023-05-10T01:09:53.783021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778719+0000","last_change":"2023-05-10T01:09:53.387304+0000","last_active":"2023-05-10T01:09:53.778719+0000","last_peered":"2023-05-10T01:09:53.778719+0000","last_clean":"2023-05-10T01:09:53.778719+0000","last_became_active":"2023-05-10T01:09:53.386981+0000","last_became_peered":"2023-05-10T01:09:53.386981+0000","last_unstale":"2023-05-10T01:09:53.778719+0000","last_undegraded":"2023-05-10T01:09:53.778719+0000","last_fullsized":"2023-05-10T01:09:53.778719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785942+0000","last_change":"2023-05-10T01:09:53.775155+0000","last_active":"2023-05-10T01:09:53.785942+0000","last_peered":"2023-05-10T01:09:53.785942+0000","last_clean":"2023-05-10T01:09:53.785942+0000","last_became_active":"2023-05-10T01:09:53.774869+0000","last_became_peered":"2023-05-10T01:09:53.774869+0000","last_unstale":"2023-05-10T01:09:53.785942+0000","last_undegraded":"2023-05-10T01:09:53.785942+0000","last_fullsized":"2023-05-10T01:09:53.785942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789992+0000","last_change":"2023-05-10T01:09:53.383948+0000","last_active":"2023-05-10T01:09:53.789992+0000","last_peered":"2023-05-10T01:09:53.789992+0000","last_clean":"2023-05-10T01:09:53.789992+0000","last_became_active":"2023-05-10T01:09:53.383677+0000","last_became_peered":"2023-05-10T01:09:53.383677+0000","last_unstale":"2023-05-10T01:09:53.789992+0000","last_undegraded":"2023-05-10T01:09:53.789992+0000","last_fullsized":"2023-05-10T01:09:53.789992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789396+0000","last_change":"2023-05-10T01:09:53.779430+0000","last_active":"2023-05-10T01:09:53.789396+0000","last_peered":"2023-05-10T01:09:53.789396+0000","last_clean":"2023-05-10T01:09:53.789396+0000","last_became_active":"2023-05-10T01:09:53.777122+0000","last_became_peered":"2023-05-10T01:09:53.777122+0000","last_unstale":"2023-05-10T01:09:53.789396+0000","last_undegraded":"2023-05-10T01:09:53.789396+0000","last_fullsized":"2023-05-10T01:09:53.789396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789835+0000","last_change":"2023-05-10T01:09:53.384697+0000","last_active":"2023-05-10T01:09:53.789835+0000","last_peered":"2023-05-10T01:09:53.789835+0000","last_clean":"2023-05-10T01:09:53.789835+0000","last_became_active":"2023-05-10T01:09:53.383952+0000","last_became_peered":"2023-05-10T01:09:53.383952+0000","last_unstale":"2023-05-10T01:09:53.789835+0000","last_undegraded":"2023-05-10T01:09:53.789835+0000","last_fullsized":"2023-05-10T01:09:53.789835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775587+0000","last_change":"2023-05-10T01:09:53.770299+0000","last_active":"2023-05-10T01:09:53.775587+0000","last_peered":"2023-05-10T01:09:53.775587+0000","last_clean":"2023-05-10T01:09:53.775587+0000","last_became_active":"2023-05-10T01:09:53.770016+0000","last_became_peered":"2023-05-10T01:09:53.770016+0000","last_unstale":"2023-05-10T01:09:53.775587+0000","last_undegraded":"2023-05-10T01:09:53.775587+0000","last_fullsized":"2023-05-10T01:09:53.775587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774485+0000","last_change":"2023-05-10T01:09:53.383206+0000","last_active":"2023-05-10T01:09:53.774485+0000","last_peered":"2023-05-10T01:09:53.774485+0000","last_clean":"2023-05-10T01:09:53.774485+0000","last_became_active":"2023-05-10T01:09:53.382411+0000","last_became_peered":"2023-05-10T01:09:53.382411+0000","last_unstale":"2023-05-10T01:09:53.774485+0000","last_undegraded":"2023-05-10T01:09:53.774485+0000","last_fullsized":"2023-05-10T01:09:53.774485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764874+0000","last_change":"2023-05-10T01:09:53.763306+0000","last_active":"2023-05-10T01:09:53.764874+0000","last_peered":"2023-05-10T01:09:53.764874+0000","last_clean":"2023-05-10T01:09:53.764874+0000","last_became_active":"2023-05-10T01:09:53.762635+0000","last_became_peered":"2023-05-10T01:09:53.762635+0000","last_unstale":"2023-05-10T01:09:53.764874+0000","last_undegraded":"2023-05-10T01:09:53.764874+0000","last_fullsized":"2023-05-10T01:09:53.764874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759060+0000","last_change":"2023-05-10T01:09:53.377895+0000","last_active":"2023-05-10T01:09:53.759060+0000","last_peered":"2023-05-10T01:09:53.759060+0000","last_clean":"2023-05-10T01:09:53.759060+0000","last_became_active":"2023-05-10T01:09:53.377611+0000","last_became_peered":"2023-05-10T01:09:53.377611+0000","last_unstale":"2023-05-10T01:09:53.759060+0000","last_undegraded":"2023-05-10T01:09:53.759060+0000","last_fullsized":"2023-05-10T01:09:53.759060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777256+0000","last_change":"2023-05-10T01:09:53.770032+0000","last_active":"2023-05-10T01:09:53.777256+0000","last_peered":"2023-05-10T01:09:53.777256+0000","last_clean":"2023-05-10T01:09:53.777256+0000","last_became_active":"2023-05-10T01:09:53.769759+0000","last_became_peered":"2023-05-10T01:09:53.769759+0000","last_unstale":"2023-05-10T01:09:53.777256+0000","last_undegraded":"2023-05-10T01:09:53.777256+0000","last_fullsized":"2023-05-10T01:09:53.777256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775799+0000","last_change":"2023-05-10T01:09:53.384429+0000","last_active":"2023-05-10T01:09:53.775799+0000","last_peered":"2023-05-10T01:09:53.775799+0000","last_clean":"2023-05-10T01:09:53.775799+0000","last_became_active":"2023-05-10T01:09:53.384089+0000","last_became_peered":"2023-05-10T01:09:53.384089+0000","last_unstale":"2023-05-10T01:09:53.775799+0000","last_undegraded":"2023-05-10T01:09:53.775799+0000","last_fullsized":"2023-05-10T01:09:53.775799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786438+0000","last_change":"2023-05-10T01:09:53.775201+0000","last_active":"2023-05-10T01:09:53.786438+0000","last_peered":"2023-05-10T01:09:53.786438+0000","last_clean":"2023-05-10T01:09:53.786438+0000","last_became_active":"2023-05-10T01:09:53.774881+0000","last_became_peered":"2023-05-10T01:09:53.774881+0000","last_unstale":"2023-05-10T01:09:53.786438+0000","last_undegraded":"2023-05-10T01:09:53.786438+0000","last_fullsized":"2023-05-10T01:09:53.786438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765837+0000","last_change":"2023-05-10T01:09:53.383296+0000","last_active":"2023-05-10T01:09:53.765837+0000","last_peered":"2023-05-10T01:09:53.765837+0000","last_clean":"2023-05-10T01:09:53.765837+0000","last_became_active":"2023-05-10T01:09:53.383024+0000","last_became_peered":"2023-05-10T01:09:53.383024+0000","last_unstale":"2023-05-10T01:09:53.765837+0000","last_undegraded":"2023-05-10T01:09:53.765837+0000","last_fullsized":"2023-05-10T01:09:53.765837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789564+0000","last_change":"2023-05-10T01:09:53.781034+0000","last_active":"2023-05-10T01:09:53.789564+0000","last_peered":"2023-05-10T01:09:53.789564+0000","last_clean":"2023-05-10T01:09:53.789564+0000","last_became_active":"2023-05-10T01:09:53.780772+0000","last_became_peered":"2023-05-10T01:09:53.780772+0000","last_unstale":"2023-05-10T01:09:53.789564+0000","last_undegraded":"2023-05-10T01:09:53.789564+0000","last_fullsized":"2023-05-10T01:09:53.789564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764711+0000","last_change":"2023-05-10T01:09:53.375634+0000","last_active":"2023-05-10T01:09:53.764711+0000","last_peered":"2023-05-10T01:09:53.764711+0000","last_clean":"2023-05-10T01:09:53.764711+0000","last_became_active":"2023-05-10T01:09:53.374842+0000","last_became_peered":"2023-05-10T01:09:53.374842+0000","last_unstale":"2023-05-10T01:09:53.764711+0000","last_undegraded":"2023-05-10T01:09:53.764711+0000","last_fullsized":"2023-05-10T01:09:53.764711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768935+0000","last_change":"2023-05-10T01:09:53.764990+0000","last_active":"2023-05-10T01:09:53.768935+0000","last_peered":"2023-05-10T01:09:53.768935+0000","last_clean":"2023-05-10T01:09:53.768935+0000","last_became_active":"2023-05-10T01:09:53.764708+0000","last_became_peered":"2023-05-10T01:09:53.764708+0000","last_unstale":"2023-05-10T01:09:53.768935+0000","last_undegraded":"2023-05-10T01:09:53.768935+0000","last_fullsized":"2023-05-10T01:09:53.768935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759860+0000","last_change":"2023-05-10T01:09:53.373817+0000","last_active":"2023-05-10T01:09:53.759860+0000","last_peered":"2023-05-10T01:09:53.759860+0000","last_clean":"2023-05-10T01:09:53.759860+0000","last_became_active":"2023-05-10T01:09:53.372121+0000","last_became_peered":"2023-05-10T01:09:53.372121+0000","last_unstale":"2023-05-10T01:09:53.759860+0000","last_undegraded":"2023-05-10T01:09:53.759860+0000","last_fullsized":"2023-05-10T01:09:53.759860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.754503+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:09:53.754503+0000","last_peered":"2023-05-10T01:09:53.754503+0000","last_clean":"2023-05-10T01:09:53.754503+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:09:53.754503+0000","last_undegraded":"2023-05-10T01:09:53.754503+0000","last_fullsized":"2023-05-10T01:09:53.754503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759995+0000","last_change":"2023-05-10T01:09:53.378846+0000","last_active":"2023-05-10T01:09:53.759995+0000","last_peered":"2023-05-10T01:09:53.759995+0000","last_clean":"2023-05-10T01:09:53.759995+0000","last_became_active":"2023-05-10T01:09:53.378439+0000","last_became_peered":"2023-05-10T01:09:53.378439+0000","last_unstale":"2023-05-10T01:09:53.759995+0000","last_undegraded":"2023-05-10T01:09:53.759995+0000","last_fullsized":"2023-05-10T01:09:53.759995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773287+0000","last_change":"2023-05-10T01:09:53.772154+0000","last_active":"2023-05-10T01:09:53.773287+0000","last_peered":"2023-05-10T01:09:53.773287+0000","last_clean":"2023-05-10T01:09:53.773287+0000","last_became_active":"2023-05-10T01:09:53.771765+0000","last_became_peered":"2023-05-10T01:09:53.771765+0000","last_unstale":"2023-05-10T01:09:53.773287+0000","last_undegraded":"2023-05-10T01:09:53.773287+0000","last_fullsized":"2023-05-10T01:09:53.773287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759060+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:09:53.759060+0000","last_peered":"2023-05-10T01:09:53.759060+0000","last_clean":"2023-05-10T01:09:53.759060+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:09:53.759060+0000","last_undegraded":"2023-05-10T01:09:53.759060+0000","last_fullsized":"2023-05-10T01:09:53.759060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768154+0000","last_change":"2023-05-10T01:09:53.383796+0000","last_active":"2023-05-10T01:09:53.768154+0000","last_peered":"2023-05-10T01:09:53.768154+0000","last_clean":"2023-05-10T01:09:53.768154+0000","last_became_active":"2023-05-10T01:09:53.383330+0000","last_became_peered":"2023-05-10T01:09:53.383330+0000","last_unstale":"2023-05-10T01:09:53.768154+0000","last_undegraded":"2023-05-10T01:09:53.768154+0000","last_fullsized":"2023-05-10T01:09:53.768154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765130+0000","last_change":"2023-05-10T01:09:53.763322+0000","last_active":"2023-05-10T01:09:53.765130+0000","last_peered":"2023-05-10T01:09:53.765130+0000","last_clean":"2023-05-10T01:09:53.765130+0000","last_became_active":"2023-05-10T01:09:53.762534+0000","last_became_peered":"2023-05-10T01:09:53.762534+0000","last_unstale":"2023-05-10T01:09:53.765130+0000","last_undegraded":"2023-05-10T01:09:53.765130+0000","last_fullsized":"2023-05-10T01:09:53.765130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775591+0000","last_change":"2023-05-10T01:09:53.774245+0000","last_active":"2023-05-10T01:09:53.775591+0000","last_peered":"2023-05-10T01:09:53.775591+0000","last_clean":"2023-05-10T01:09:53.775591+0000","last_became_active":"2023-05-10T01:09:53.773997+0000","last_became_peered":"2023-05-10T01:09:53.773997+0000","last_unstale":"2023-05-10T01:09:53.775591+0000","last_undegraded":"2023-05-10T01:09:53.775591+0000","last_fullsized":"2023-05-10T01:09:53.775591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757100+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:09:53.757100+0000","last_peered":"2023-05-10T01:09:53.757100+0000","last_clean":"2023-05-10T01:09:53.757100+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:09:53.757100+0000","last_undegraded":"2023-05-10T01:09:53.757100+0000","last_fullsized":"2023-05-10T01:09:53.757100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753403+0000","last_change":"2023-05-10T01:09:53.368527+0000","last_active":"2023-05-10T01:09:53.753403+0000","last_peered":"2023-05-10T01:09:53.753403+0000","last_clean":"2023-05-10T01:09:53.753403+0000","last_became_active":"2023-05-10T01:09:53.368195+0000","last_became_peered":"2023-05-10T01:09:53.368195+0000","last_unstale":"2023-05-10T01:09:53.753403+0000","last_undegraded":"2023-05-10T01:09:53.753403+0000","last_fullsized":"2023-05-10T01:09:53.753403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789709+0000","last_change":"2023-05-10T01:09:53.784150+0000","last_active":"2023-05-10T01:09:53.789709+0000","last_peered":"2023-05-10T01:09:53.789709+0000","last_clean":"2023-05-10T01:09:53.789709+0000","last_became_active":"2023-05-10T01:09:53.783843+0000","last_became_peered":"2023-05-10T01:09:53.783843+0000","last_unstale":"2023-05-10T01:09:53.789709+0000","last_undegraded":"2023-05-10T01:09:53.789709+0000","last_fullsized":"2023-05-10T01:09:53.789709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758906+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:09:53.758906+0000","last_peered":"2023-05-10T01:09:53.758906+0000","last_clean":"2023-05-10T01:09:53.758906+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:09:53.758906+0000","last_undegraded":"2023-05-10T01:09:53.758906+0000","last_fullsized":"2023-05-10T01:09:53.758906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767625+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:09:53.767625+0000","last_peered":"2023-05-10T01:09:53.767625+0000","last_clean":"2023-05-10T01:09:53.767625+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:09:53.767625+0000","last_undegraded":"2023-05-10T01:09:53.767625+0000","last_fullsized":"2023-05-10T01:09:53.767625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758658+0000","last_change":"2023-05-10T01:09:53.380660+0000","last_active":"2023-05-10T01:09:53.758658+0000","last_peered":"2023-05-10T01:09:53.758658+0000","last_clean":"2023-05-10T01:09:53.758658+0000","last_became_active":"2023-05-10T01:09:53.380145+0000","last_became_peered":"2023-05-10T01:09:53.380145+0000","last_unstale":"2023-05-10T01:09:53.758658+0000","last_undegraded":"2023-05-10T01:09:53.758658+0000","last_fullsized":"2023-05-10T01:09:53.758658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765077+0000","last_change":"2023-05-10T01:09:53.762417+0000","last_active":"2023-05-10T01:09:53.765077+0000","last_peered":"2023-05-10T01:09:53.765077+0000","last_clean":"2023-05-10T01:09:53.765077+0000","last_became_active":"2023-05-10T01:09:53.762170+0000","last_became_peered":"2023-05-10T01:09:53.762170+0000","last_unstale":"2023-05-10T01:09:53.765077+0000","last_undegraded":"2023-05-10T01:09:53.765077+0000","last_fullsized":"2023-05-10T01:09:53.765077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768307+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:09:53.768307+0000","last_peered":"2023-05-10T01:09:53.768307+0000","last_clean":"2023-05-10T01:09:53.768307+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:09:53.768307+0000","last_undegraded":"2023-05-10T01:09:53.768307+0000","last_fullsized":"2023-05-10T01:09:53.768307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755602+0000","last_change":"2023-05-10T01:09:53.379906+0000","last_active":"2023-05-10T01:09:53.755602+0000","last_peered":"2023-05-10T01:09:53.755602+0000","last_clean":"2023-05-10T01:09:53.755602+0000","last_became_active":"2023-05-10T01:09:53.379573+0000","last_became_peered":"2023-05-10T01:09:53.379573+0000","last_unstale":"2023-05-10T01:09:53.755602+0000","last_undegraded":"2023-05-10T01:09:53.755602+0000","last_fullsized":"2023-05-10T01:09:53.755602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774378+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:09:53.774378+0000","last_peered":"2023-05-10T01:09:53.774378+0000","last_clean":"2023-05-10T01:09:53.774378+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:09:53.774378+0000","last_undegraded":"2023-05-10T01:09:53.774378+0000","last_fullsized":"2023-05-10T01:09:53.774378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.754926+0000","last_change":"2023-05-10T01:09:53.370231+0000","last_active":"2023-05-10T01:09:53.754926+0000","last_peered":"2023-05-10T01:09:53.754926+0000","last_clean":"2023-05-10T01:09:53.754926+0000","last_became_active":"2023-05-10T01:09:53.369689+0000","last_became_peered":"2023-05-10T01:09:53.369689+0000","last_unstale":"2023-05-10T01:09:53.754926+0000","last_undegraded":"2023-05-10T01:09:53.754926+0000","last_fullsized":"2023-05-10T01:09:53.754926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763598+0000","last_change":"2023-05-10T01:09:53.761010+0000","last_active":"2023-05-10T01:09:53.763598+0000","last_peered":"2023-05-10T01:09:53.763598+0000","last_clean":"2023-05-10T01:09:53.763598+0000","last_became_active":"2023-05-10T01:09:53.760729+0000","last_became_peered":"2023-05-10T01:09:53.760729+0000","last_unstale":"2023-05-10T01:09:53.763598+0000","last_undegraded":"2023-05-10T01:09:53.763598+0000","last_fullsized":"2023-05-10T01:09:53.763598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789343+0000","last_change":"2023-05-10T01:09:53.378347+0000","last_active":"2023-05-10T01:09:53.789343+0000","last_peered":"2023-05-10T01:09:53.789343+0000","last_clean":"2023-05-10T01:09:53.789343+0000","last_became_active":"2023-05-10T01:09:53.378066+0000","last_became_peered":"2023-05-10T01:09:53.378066+0000","last_unstale":"2023-05-10T01:09:53.789343+0000","last_undegraded":"2023-05-10T01:09:53.789343+0000","last_fullsized":"2023-05-10T01:09:53.789343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753859+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:09:53.753859+0000","last_peered":"2023-05-10T01:09:53.753859+0000","last_clean":"2023-05-10T01:09:53.753859+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:09:53.753859+0000","last_undegraded":"2023-05-10T01:09:53.753859+0000","last_fullsized":"2023-05-10T01:09:53.753859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778283+0000","last_change":"2023-05-10T01:09:53.777244+0000","last_active":"2023-05-10T01:09:53.778283+0000","last_peered":"2023-05-10T01:09:53.778283+0000","last_clean":"2023-05-10T01:09:53.778283+0000","last_became_active":"2023-05-10T01:09:53.776901+0000","last_became_peered":"2023-05-10T01:09:53.776901+0000","last_unstale":"2023-05-10T01:09:53.778283+0000","last_undegraded":"2023-05-10T01:09:53.778283+0000","last_fullsized":"2023-05-10T01:09:53.778283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767587+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:09:53.767587+0000","last_peered":"2023-05-10T01:09:53.767587+0000","last_clean":"2023-05-10T01:09:53.767587+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:09:53.767587+0000","last_undegraded":"2023-05-10T01:09:53.767587+0000","last_fullsized":"2023-05-10T01:09:53.767587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756449+0000","last_change":"2023-05-10T01:09:53.379978+0000","last_active":"2023-05-10T01:09:53.756449+0000","last_peered":"2023-05-10T01:09:53.756449+0000","last_clean":"2023-05-10T01:09:53.756449+0000","last_became_active":"2023-05-10T01:09:53.378931+0000","last_became_peered":"2023-05-10T01:09:53.378931+0000","last_unstale":"2023-05-10T01:09:53.756449+0000","last_undegraded":"2023-05-10T01:09:53.756449+0000","last_fullsized":"2023-05-10T01:09:53.756449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789667+0000","last_change":"2023-05-10T01:09:53.781546+0000","last_active":"2023-05-10T01:09:53.789667+0000","last_peered":"2023-05-10T01:09:53.789667+0000","last_clean":"2023-05-10T01:09:53.789667+0000","last_became_active":"2023-05-10T01:09:53.781279+0000","last_became_peered":"2023-05-10T01:09:53.781279+0000","last_unstale":"2023-05-10T01:09:53.789667+0000","last_undegraded":"2023-05-10T01:09:53.789667+0000","last_fullsized":"2023-05-10T01:09:53.789667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769108+0000","last_change":"2023-05-10T01:09:53.765537+0000","last_active":"2023-05-10T01:09:53.769108+0000","last_peered":"2023-05-10T01:09:53.769108+0000","last_clean":"2023-05-10T01:09:53.769108+0000","last_became_active":"2023-05-10T01:09:53.765301+0000","last_became_peered":"2023-05-10T01:09:53.765301+0000","last_unstale":"2023-05-10T01:09:53.769108+0000","last_undegraded":"2023-05-10T01:09:53.769108+0000","last_fullsized":"2023-05-10T01:09:53.769108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756704+0000","last_change":"2023-05-10T01:09:53.383241+0000","last_active":"2023-05-10T01:09:53.756704+0000","last_peered":"2023-05-10T01:09:53.756704+0000","last_clean":"2023-05-10T01:09:53.756704+0000","last_became_active":"2023-05-10T01:09:53.382496+0000","last_became_peered":"2023-05-10T01:09:53.382496+0000","last_unstale":"2023-05-10T01:09:53.756704+0000","last_undegraded":"2023-05-10T01:09:53.756704+0000","last_fullsized":"2023-05-10T01:09:53.756704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780316+0000","last_change":"2023-05-10T01:09:53.770592+0000","last_active":"2023-05-10T01:09:53.780316+0000","last_peered":"2023-05-10T01:09:53.780316+0000","last_clean":"2023-05-10T01:09:53.780316+0000","last_became_active":"2023-05-10T01:09:53.770330+0000","last_became_peered":"2023-05-10T01:09:53.770330+0000","last_unstale":"2023-05-10T01:09:53.780316+0000","last_undegraded":"2023-05-10T01:09:53.780316+0000","last_fullsized":"2023-05-10T01:09:53.780316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759133+0000","last_change":"2023-05-10T01:09:53.383384+0000","last_active":"2023-05-10T01:09:53.759133+0000","last_peered":"2023-05-10T01:09:53.759133+0000","last_clean":"2023-05-10T01:09:53.759133+0000","last_became_active":"2023-05-10T01:09:53.383049+0000","last_became_peered":"2023-05-10T01:09:53.383049+0000","last_unstale":"2023-05-10T01:09:53.759133+0000","last_undegraded":"2023-05-10T01:09:53.759133+0000","last_fullsized":"2023-05-10T01:09:53.759133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789347+0000","last_change":"2023-05-10T01:09:53.778319+0000","last_active":"2023-05-10T01:09:53.789347+0000","last_peered":"2023-05-10T01:09:53.789347+0000","last_clean":"2023-05-10T01:09:53.789347+0000","last_became_active":"2023-05-10T01:09:53.777415+0000","last_became_peered":"2023-05-10T01:09:53.777415+0000","last_unstale":"2023-05-10T01:09:53.789347+0000","last_undegraded":"2023-05-10T01:09:53.789347+0000","last_fullsized":"2023-05-10T01:09:53.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790172+0000","last_change":"2023-05-10T01:09:53.382266+0000","last_active":"2023-05-10T01:09:53.790172+0000","last_peered":"2023-05-10T01:09:53.790172+0000","last_clean":"2023-05-10T01:09:53.790172+0000","last_became_active":"2023-05-10T01:09:53.382000+0000","last_became_peered":"2023-05-10T01:09:53.382000+0000","last_unstale":"2023-05-10T01:09:53.790172+0000","last_undegraded":"2023-05-10T01:09:53.790172+0000","last_fullsized":"2023-05-10T01:09:53.790172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770861+0000","last_change":"2023-05-10T01:09:53.768348+0000","last_active":"2023-05-10T01:09:53.770861+0000","last_peered":"2023-05-10T01:09:53.770861+0000","last_clean":"2023-05-10T01:09:53.770861+0000","last_became_active":"2023-05-10T01:09:53.767452+0000","last_became_peered":"2023-05-10T01:09:53.767452+0000","last_unstale":"2023-05-10T01:09:53.770861+0000","last_undegraded":"2023-05-10T01:09:53.770861+0000","last_fullsized":"2023-05-10T01:09:53.770861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782143+0000","last_change":"2023-05-10T01:09:53.377329+0000","last_active":"2023-05-10T01:09:53.782143+0000","last_peered":"2023-05-10T01:09:53.782143+0000","last_clean":"2023-05-10T01:09:53.782143+0000","last_became_active":"2023-05-10T01:09:53.377037+0000","last_became_peered":"2023-05-10T01:09:53.377037+0000","last_unstale":"2023-05-10T01:09:53.782143+0000","last_undegraded":"2023-05-10T01:09:53.782143+0000","last_fullsized":"2023-05-10T01:09:53.782143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789557+0000","last_change":"2023-05-10T01:09:53.780936+0000","last_active":"2023-05-10T01:09:53.789557+0000","last_peered":"2023-05-10T01:09:53.789557+0000","last_clean":"2023-05-10T01:09:53.789557+0000","last_became_active":"2023-05-10T01:09:53.780642+0000","last_became_peered":"2023-05-10T01:09:53.780642+0000","last_unstale":"2023-05-10T01:09:53.789557+0000","last_undegraded":"2023-05-10T01:09:53.789557+0000","last_fullsized":"2023-05-10T01:09:53.789557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777392+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:53.777392+0000","last_peered":"2023-05-10T01:09:53.777392+0000","last_clean":"2023-05-10T01:09:53.777392+0000","last_became_active":"2023-05-10T01:09:53.380703+0000","last_became_peered":"2023-05-10T01:09:53.380703+0000","last_unstale":"2023-05-10T01:09:53.777392+0000","last_undegraded":"2023-05-10T01:09:53.777392+0000","last_fullsized":"2023-05-10T01:09:53.777392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774988+0000","last_change":"2023-05-10T01:09:53.773330+0000","last_active":"2023-05-10T01:09:53.774988+0000","last_peered":"2023-05-10T01:09:53.774988+0000","last_clean":"2023-05-10T01:09:53.774988+0000","last_became_active":"2023-05-10T01:09:53.773048+0000","last_became_peered":"2023-05-10T01:09:53.773048+0000","last_unstale":"2023-05-10T01:09:53.774988+0000","last_undegraded":"2023-05-10T01:09:53.774988+0000","last_fullsized":"2023-05-10T01:09:53.774988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769213+0000","last_change":"2023-05-10T01:09:53.385088+0000","last_active":"2023-05-10T01:09:53.769213+0000","last_peered":"2023-05-10T01:09:53.769213+0000","last_clean":"2023-05-10T01:09:53.769213+0000","last_became_active":"2023-05-10T01:09:53.384812+0000","last_became_peered":"2023-05-10T01:09:53.384812+0000","last_unstale":"2023-05-10T01:09:53.769213+0000","last_undegraded":"2023-05-10T01:09:53.769213+0000","last_fullsized":"2023-05-10T01:09:53.769213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.762107+0000","last_change":"2023-05-10T01:09:53.760008+0000","last_active":"2023-05-10T01:09:53.762107+0000","last_peered":"2023-05-10T01:09:53.762107+0000","last_clean":"2023-05-10T01:09:53.762107+0000","last_became_active":"2023-05-10T01:09:53.759723+0000","last_became_peered":"2023-05-10T01:09:53.759723+0000","last_unstale":"2023-05-10T01:09:53.762107+0000","last_undegraded":"2023-05-10T01:09:53.762107+0000","last_fullsized":"2023-05-10T01:09:53.762107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.757195+0000","last_change":"2023-05-10T01:09:53.378264+0000","last_active":"2023-05-10T01:09:53.757195+0000","last_peered":"2023-05-10T01:09:53.757195+0000","last_clean":"2023-05-10T01:09:53.757195+0000","last_became_active":"2023-05-10T01:09:53.377943+0000","last_became_peered":"2023-05-10T01:09:53.377943+0000","last_unstale":"2023-05-10T01:09:53.757195+0000","last_undegraded":"2023-05-10T01:09:53.757195+0000","last_fullsized":"2023-05-10T01:09:53.757195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.788314+0000","last_change":"2023-05-10T01:09:53.784908+0000","last_active":"2023-05-10T01:09:53.788314+0000","last_peered":"2023-05-10T01:09:53.788314+0000","last_clean":"2023-05-10T01:09:53.788314+0000","last_became_active":"2023-05-10T01:09:53.784482+0000","last_became_peered":"2023-05-10T01:09:53.784482+0000","last_unstale":"2023-05-10T01:09:53.788314+0000","last_undegraded":"2023-05-10T01:09:53.788314+0000","last_fullsized":"2023-05-10T01:09:53.788314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759253+0000","last_change":"2023-05-10T01:09:53.377668+0000","last_active":"2023-05-10T01:09:53.759253+0000","last_peered":"2023-05-10T01:09:53.759253+0000","last_clean":"2023-05-10T01:09:53.759253+0000","last_became_active":"2023-05-10T01:09:53.377379+0000","last_became_peered":"2023-05-10T01:09:53.377379+0000","last_unstale":"2023-05-10T01:09:53.759253+0000","last_undegraded":"2023-05-10T01:09:53.759253+0000","last_fullsized":"2023-05-10T01:09:53.759253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.776080+0000","last_change":"2023-05-10T01:09:53.775594+0000","last_active":"2023-05-10T01:09:53.776080+0000","last_peered":"2023-05-10T01:09:53.776080+0000","last_clean":"2023-05-10T01:09:53.776080+0000","last_became_active":"2023-05-10T01:09:53.775258+0000","last_became_peered":"2023-05-10T01:09:53.775258+0000","last_unstale":"2023-05-10T01:09:53.776080+0000","last_undegraded":"2023-05-10T01:09:53.776080+0000","last_fullsized":"2023-05-10T01:09:53.776080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756438+0000","last_change":"2023-05-10T01:09:53.383076+0000","last_active":"2023-05-10T01:09:53.756438+0000","last_peered":"2023-05-10T01:09:53.756438+0000","last_clean":"2023-05-10T01:09:53.756438+0000","last_became_active":"2023-05-10T01:09:53.381851+0000","last_became_peered":"2023-05-10T01:09:53.381851+0000","last_unstale":"2023-05-10T01:09:53.756438+0000","last_undegraded":"2023-05-10T01:09:53.756438+0000","last_fullsized":"2023-05-10T01:09:53.756438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.783018+0000","last_change":"2023-05-10T01:09:53.782493+0000","last_active":"2023-05-10T01:09:53.783018+0000","last_peered":"2023-05-10T01:09:53.783018+0000","last_clean":"2023-05-10T01:09:53.783018+0000","last_became_active":"2023-05-10T01:09:53.782211+0000","last_became_peered":"2023-05-10T01:09:53.782211+0000","last_unstale":"2023-05-10T01:09:53.783018+0000","last_undegraded":"2023-05-10T01:09:53.783018+0000","last_fullsized":"2023-05-10T01:09:53.783018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.760139+0000","last_change":"2023-05-10T01:09:53.384727+0000","last_active":"2023-05-10T01:09:53.760139+0000","last_peered":"2023-05-10T01:09:53.760139+0000","last_clean":"2023-05-10T01:09:53.760139+0000","last_became_active":"2023-05-10T01:09:53.384426+0000","last_became_peered":"2023-05-10T01:09:53.384426+0000","last_unstale":"2023-05-10T01:09:53.760139+0000","last_undegraded":"2023-05-10T01:09:53.760139+0000","last_fullsized":"2023-05-10T01:09:53.760139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789367+0000","last_change":"2023-05-10T01:09:53.778447+0000","last_active":"2023-05-10T01:09:53.789367+0000","last_peered":"2023-05-10T01:09:53.789367+0000","last_clean":"2023-05-10T01:09:53.789367+0000","last_became_active":"2023-05-10T01:09:53.777503+0000","last_became_peered":"2023-05-10T01:09:53.777503+0000","last_unstale":"2023-05-10T01:09:53.789367+0000","last_undegraded":"2023-05-10T01:09:53.789367+0000","last_fullsized":"2023-05-10T01:09:53.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753478+0000","last_change":"2023-05-10T01:09:53.373308+0000","last_active":"2023-05-10T01:09:53.753478+0000","last_peered":"2023-05-10T01:09:53.753478+0000","last_clean":"2023-05-10T01:09:53.753478+0000","last_became_active":"2023-05-10T01:09:53.372576+0000","last_became_peered":"2023-05-10T01:09:53.372576+0000","last_unstale":"2023-05-10T01:09:53.753478+0000","last_undegraded":"2023-05-10T01:09:53.753478+0000","last_fullsized":"2023-05-10T01:09:53.753478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769654+0000","last_change":"2023-05-10T01:09:53.767497+0000","last_active":"2023-05-10T01:09:53.769654+0000","last_peered":"2023-05-10T01:09:53.769654+0000","last_clean":"2023-05-10T01:09:53.769654+0000","last_became_active":"2023-05-10T01:09:53.764957+0000","last_became_peered":"2023-05-10T01:09:53.764957+0000","last_unstale":"2023-05-10T01:09:53.769654+0000","last_undegraded":"2023-05-10T01:09:53.769654+0000","last_fullsized":"2023-05-10T01:09:53.769654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-10T01:09:57.283120+0000","last_change":"2023-05-10T01:09:53.380990+0000","last_active":"2023-05-10T01:09:57.283120+0000","last_peered":"2023-05-10T01:09:57.283120+0000","last_clean":"2023-05-10T01:09:57.283120+0000","last_became_active":"2023-05-10T01:09:53.378549+0000","last_became_peered":"2023-05-10T01:09:53.378549+0000","last_unstale":"2023-05-10T01:09:57.283120+0000","last_undegraded":"2023-05-10T01:09:57.283120+0000","last_fullsized":"2023-05-10T01:09:57.283120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780991+0000","last_change":"2023-05-10T01:09:53.777067+0000","last_active":"2023-05-10T01:09:53.780991+0000","last_peered":"2023-05-10T01:09:53.780991+0000","last_clean":"2023-05-10T01:09:53.780991+0000","last_became_active":"2023-05-10T01:09:53.776765+0000","last_became_peered":"2023-05-10T01:09:53.776765+0000","last_unstale":"2023-05-10T01:09:53.780991+0000","last_undegraded":"2023-05-10T01:09:53.780991+0000","last_fullsized":"2023-05-10T01:09:53.780991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764391+0000","last_change":"2023-05-10T01:09:53.384098+0000","last_active":"2023-05-10T01:09:53.764391+0000","last_peered":"2023-05-10T01:09:53.764391+0000","last_clean":"2023-05-10T01:09:53.764391+0000","last_became_active":"2023-05-10T01:09:53.383801+0000","last_became_peered":"2023-05-10T01:09:53.383801+0000","last_unstale":"2023-05-10T01:09:53.764391+0000","last_undegraded":"2023-05-10T01:09:53.764391+0000","last_fullsized":"2023-05-10T01:09:53.764391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770439+0000","last_change":"2023-05-10T01:09:53.768353+0000","last_active":"2023-05-10T01:09:53.770439+0000","last_peered":"2023-05-10T01:09:53.770439+0000","last_clean":"2023-05-10T01:09:53.770439+0000","last_became_active":"2023-05-10T01:09:53.768082+0000","last_became_peered":"2023-05-10T01:09:53.768082+0000","last_unstale":"2023-05-10T01:09:53.770439+0000","last_undegraded":"2023-05-10T01:09:53.770439+0000","last_fullsized":"2023-05-10T01:09:53.770439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759098+0000","last_change":"2023-05-10T01:09:53.379829+0000","last_active":"2023-05-10T01:09:53.759098+0000","last_peered":"2023-05-10T01:09:53.759098+0000","last_clean":"2023-05-10T01:09:53.759098+0000","last_became_active":"2023-05-10T01:09:53.379516+0000","last_became_peered":"2023-05-10T01:09:53.379516+0000","last_unstale":"2023-05-10T01:09:53.759098+0000","last_undegraded":"2023-05-10T01:09:53.759098+0000","last_fullsized":"2023-05-10T01:09:53.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789455+0000","last_change":"2023-05-10T01:09:53.779725+0000","last_active":"2023-05-10T01:09:53.789455+0000","last_peered":"2023-05-10T01:09:53.789455+0000","last_clean":"2023-05-10T01:09:53.789455+0000","last_became_active":"2023-05-10T01:09:53.776948+0000","last_became_peered":"2023-05-10T01:09:53.776948+0000","last_unstale":"2023-05-10T01:09:53.789455+0000","last_undegraded":"2023-05-10T01:09:53.789455+0000","last_fullsized":"2023-05-10T01:09:53.789455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.763025+0000","last_change":"2023-05-10T01:09:53.384002+0000","last_active":"2023-05-10T01:09:53.763025+0000","last_peered":"2023-05-10T01:09:53.763025+0000","last_clean":"2023-05-10T01:09:53.763025+0000","last_became_active":"2023-05-10T01:09:53.383716+0000","last_became_peered":"2023-05-10T01:09:53.383716+0000","last_unstale":"2023-05-10T01:09:53.763025+0000","last_undegraded":"2023-05-10T01:09:53.763025+0000","last_fullsized":"2023-05-10T01:09:53.763025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.774462+0000","last_change":"2023-05-10T01:09:53.772854+0000","last_active":"2023-05-10T01:09:53.774462+0000","last_peered":"2023-05-10T01:09:53.774462+0000","last_clean":"2023-05-10T01:09:53.774462+0000","last_became_active":"2023-05-10T01:09:53.772540+0000","last_became_peered":"2023-05-10T01:09:53.772540+0000","last_unstale":"2023-05-10T01:09:53.774462+0000","last_undegraded":"2023-05-10T01:09:53.774462+0000","last_fullsized":"2023-05-10T01:09:53.774462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759354+0000","last_change":"2023-05-10T01:09:53.379344+0000","last_active":"2023-05-10T01:09:53.759354+0000","last_peered":"2023-05-10T01:09:53.759354+0000","last_clean":"2023-05-10T01:09:53.759354+0000","last_became_active":"2023-05-10T01:09:53.379093+0000","last_became_peered":"2023-05-10T01:09:53.379093+0000","last_unstale":"2023-05-10T01:09:53.759354+0000","last_undegraded":"2023-05-10T01:09:53.759354+0000","last_fullsized":"2023-05-10T01:09:53.759354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789943+0000","last_change":"2023-05-10T01:09:53.782809+0000","last_active":"2023-05-10T01:09:53.789943+0000","last_peered":"2023-05-10T01:09:53.789943+0000","last_clean":"2023-05-10T01:09:53.789943+0000","last_became_active":"2023-05-10T01:09:53.777458+0000","last_became_peered":"2023-05-10T01:09:53.777458+0000","last_unstale":"2023-05-10T01:09:53.789943+0000","last_undegraded":"2023-05-10T01:09:53.789943+0000","last_fullsized":"2023-05-10T01:09:53.789943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782052+0000","last_change":"2023-05-10T01:09:53.382855+0000","last_active":"2023-05-10T01:09:53.782052+0000","last_peered":"2023-05-10T01:09:53.782052+0000","last_clean":"2023-05-10T01:09:53.782052+0000","last_became_active":"2023-05-10T01:09:53.379670+0000","last_became_peered":"2023-05-10T01:09:53.379670+0000","last_unstale":"2023-05-10T01:09:53.782052+0000","last_undegraded":"2023-05-10T01:09:53.782052+0000","last_fullsized":"2023-05-10T01:09:53.782052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789346+0000","last_change":"2023-05-10T01:09:53.781558+0000","last_active":"2023-05-10T01:09:53.789346+0000","last_peered":"2023-05-10T01:09:53.789346+0000","last_clean":"2023-05-10T01:09:53.789346+0000","last_became_active":"2023-05-10T01:09:53.781283+0000","last_became_peered":"2023-05-10T01:09:53.781283+0000","last_unstale":"2023-05-10T01:09:53.789346+0000","last_undegraded":"2023-05-10T01:09:53.789346+0000","last_fullsized":"2023-05-10T01:09:53.789346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.766776+0000","last_change":"2023-05-10T01:09:53.382597+0000","last_active":"2023-05-10T01:09:53.766776+0000","last_peered":"2023-05-10T01:09:53.766776+0000","last_clean":"2023-05-10T01:09:53.766776+0000","last_became_active":"2023-05-10T01:09:53.382312+0000","last_became_peered":"2023-05-10T01:09:53.382312+0000","last_unstale":"2023-05-10T01:09:53.766776+0000","last_undegraded":"2023-05-10T01:09:53.766776+0000","last_fullsized":"2023-05-10T01:09:53.766776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765131+0000","last_change":"2023-05-10T01:09:53.762455+0000","last_active":"2023-05-10T01:09:53.765131+0000","last_peered":"2023-05-10T01:09:53.765131+0000","last_clean":"2023-05-10T01:09:53.765131+0000","last_became_active":"2023-05-10T01:09:53.762128+0000","last_became_peered":"2023-05-10T01:09:53.762128+0000","last_unstale":"2023-05-10T01:09:53.765131+0000","last_undegraded":"2023-05-10T01:09:53.765131+0000","last_fullsized":"2023-05-10T01:09:53.765131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790088+0000","last_change":"2023-05-10T01:09:53.383349+0000","last_active":"2023-05-10T01:09:53.790088+0000","last_peered":"2023-05-10T01:09:53.790088+0000","last_clean":"2023-05-10T01:09:53.790088+0000","last_became_active":"2023-05-10T01:09:53.381097+0000","last_became_peered":"2023-05-10T01:09:53.381097+0000","last_unstale":"2023-05-10T01:09:53.790088+0000","last_undegraded":"2023-05-10T01:09:53.790088+0000","last_fullsized":"2023-05-10T01:09:53.790088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769665+0000","last_change":"2023-05-10T01:09:53.768045+0000","last_active":"2023-05-10T01:09:53.769665+0000","last_peered":"2023-05-10T01:09:53.769665+0000","last_clean":"2023-05-10T01:09:53.769665+0000","last_became_active":"2023-05-10T01:09:53.767775+0000","last_became_peered":"2023-05-10T01:09:53.767775+0000","last_unstale":"2023-05-10T01:09:53.769665+0000","last_undegraded":"2023-05-10T01:09:53.769665+0000","last_fullsized":"2023-05-10T01:09:53.769665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.758314+0000","last_change":"2023-05-10T01:09:53.378075+0000","last_active":"2023-05-10T01:09:53.758314+0000","last_peered":"2023-05-10T01:09:53.758314+0000","last_clean":"2023-05-10T01:09:53.758314+0000","last_became_active":"2023-05-10T01:09:53.377777+0000","last_became_peered":"2023-05-10T01:09:53.377777+0000","last_unstale":"2023-05-10T01:09:53.758314+0000","last_undegraded":"2023-05-10T01:09:53.758314+0000","last_fullsized":"2023-05-10T01:09:53.758314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786432+0000","last_change":"2023-05-10T01:09:53.777094+0000","last_active":"2023-05-10T01:09:53.786432+0000","last_peered":"2023-05-10T01:09:53.786432+0000","last_clean":"2023-05-10T01:09:53.786432+0000","last_became_active":"2023-05-10T01:09:53.776783+0000","last_became_peered":"2023-05-10T01:09:53.776783+0000","last_unstale":"2023-05-10T01:09:53.786432+0000","last_undegraded":"2023-05-10T01:09:53.786432+0000","last_fullsized":"2023-05-10T01:09:53.786432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759876+0000","last_change":"2023-05-10T01:09:53.380032+0000","last_active":"2023-05-10T01:09:53.759876+0000","last_peered":"2023-05-10T01:09:53.759876+0000","last_clean":"2023-05-10T01:09:53.759876+0000","last_became_active":"2023-05-10T01:09:53.379645+0000","last_became_peered":"2023-05-10T01:09:53.379645+0000","last_unstale":"2023-05-10T01:09:53.759876+0000","last_undegraded":"2023-05-10T01:09:53.759876+0000","last_fullsized":"2023-05-10T01:09:53.759876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770896+0000","last_change":"2023-05-10T01:09:53.769678+0000","last_active":"2023-05-10T01:09:53.770896+0000","last_peered":"2023-05-10T01:09:53.770896+0000","last_clean":"2023-05-10T01:09:53.770896+0000","last_became_active":"2023-05-10T01:09:53.768182+0000","last_became_peered":"2023-05-10T01:09:53.768182+0000","last_unstale":"2023-05-10T01:09:53.770896+0000","last_undegraded":"2023-05-10T01:09:53.770896+0000","last_fullsized":"2023-05-10T01:09:53.770896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.777638+0000","last_change":"2023-05-10T01:09:53.387228+0000","last_active":"2023-05-10T01:09:53.777638+0000","last_peered":"2023-05-10T01:09:53.777638+0000","last_clean":"2023-05-10T01:09:53.777638+0000","last_became_active":"2023-05-10T01:09:53.386991+0000","last_became_peered":"2023-05-10T01:09:53.386991+0000","last_unstale":"2023-05-10T01:09:53.777638+0000","last_undegraded":"2023-05-10T01:09:53.777638+0000","last_fullsized":"2023-05-10T01:09:53.777638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785856+0000","last_change":"2023-05-10T01:09:53.773869+0000","last_active":"2023-05-10T01:09:53.785856+0000","last_peered":"2023-05-10T01:09:53.785856+0000","last_clean":"2023-05-10T01:09:53.785856+0000","last_became_active":"2023-05-10T01:09:53.773284+0000","last_became_peered":"2023-05-10T01:09:53.773284+0000","last_unstale":"2023-05-10T01:09:53.785856+0000","last_undegraded":"2023-05-10T01:09:53.785856+0000","last_fullsized":"2023-05-10T01:09:53.785856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753391+0000","last_change":"2023-05-10T01:09:53.374463+0000","last_active":"2023-05-10T01:09:53.753391+0000","last_peered":"2023-05-10T01:09:53.753391+0000","last_clean":"2023-05-10T01:09:53.753391+0000","last_became_active":"2023-05-10T01:09:53.372250+0000","last_became_peered":"2023-05-10T01:09:53.372250+0000","last_unstale":"2023-05-10T01:09:53.753391+0000","last_undegraded":"2023-05-10T01:09:53.753391+0000","last_fullsized":"2023-05-10T01:09:53.753391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789874+0000","last_change":"2023-05-10T01:09:53.780390+0000","last_active":"2023-05-10T01:09:53.789874+0000","last_peered":"2023-05-10T01:09:53.789874+0000","last_clean":"2023-05-10T01:09:53.789874+0000","last_became_active":"2023-05-10T01:09:53.780072+0000","last_became_peered":"2023-05-10T01:09:53.780072+0000","last_unstale":"2023-05-10T01:09:53.789874+0000","last_undegraded":"2023-05-10T01:09:53.789874+0000","last_fullsized":"2023-05-10T01:09:53.789874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.755808+0000","last_change":"2023-05-10T01:09:53.379278+0000","last_active":"2023-05-10T01:09:53.755808+0000","last_peered":"2023-05-10T01:09:53.755808+0000","last_clean":"2023-05-10T01:09:53.755808+0000","last_became_active":"2023-05-10T01:09:53.378985+0000","last_became_peered":"2023-05-10T01:09:53.378985+0000","last_unstale":"2023-05-10T01:09:53.755808+0000","last_undegraded":"2023-05-10T01:09:53.755808+0000","last_fullsized":"2023-05-10T01:09:53.755808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.778912+0000","last_change":"2023-05-10T01:09:53.778386+0000","last_active":"2023-05-10T01:09:53.778912+0000","last_peered":"2023-05-10T01:09:53.778912+0000","last_clean":"2023-05-10T01:09:53.778912+0000","last_became_active":"2023-05-10T01:09:53.778121+0000","last_became_peered":"2023-05-10T01:09:53.778121+0000","last_unstale":"2023-05-10T01:09:53.778912+0000","last_undegraded":"2023-05-10T01:09:53.778912+0000","last_fullsized":"2023-05-10T01:09:53.778912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.782640+0000","last_change":"2023-05-10T01:09:53.377455+0000","last_active":"2023-05-10T01:09:53.782640+0000","last_peered":"2023-05-10T01:09:53.782640+0000","last_clean":"2023-05-10T01:09:53.782640+0000","last_became_active":"2023-05-10T01:09:53.377216+0000","last_became_peered":"2023-05-10T01:09:53.377216+0000","last_unstale":"2023-05-10T01:09:53.782640+0000","last_undegraded":"2023-05-10T01:09:53.782640+0000","last_fullsized":"2023-05-10T01:09:53.782640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.768114+0000","last_change":"2023-05-10T01:09:53.766371+0000","last_active":"2023-05-10T01:09:53.768114+0000","last_peered":"2023-05-10T01:09:53.768114+0000","last_clean":"2023-05-10T01:09:53.768114+0000","last_became_active":"2023-05-10T01:09:53.766077+0000","last_became_peered":"2023-05-10T01:09:53.766077+0000","last_unstale":"2023-05-10T01:09:53.768114+0000","last_undegraded":"2023-05-10T01:09:53.768114+0000","last_fullsized":"2023-05-10T01:09:53.768114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.790195+0000","last_change":"2023-05-10T01:09:53.381183+0000","last_active":"2023-05-10T01:09:53.790195+0000","last_peered":"2023-05-10T01:09:53.790195+0000","last_clean":"2023-05-10T01:09:53.790195+0000","last_became_active":"2023-05-10T01:09:53.380930+0000","last_became_peered":"2023-05-10T01:09:53.380930+0000","last_unstale":"2023-05-10T01:09:53.790195+0000","last_undegraded":"2023-05-10T01:09:53.790195+0000","last_fullsized":"2023-05-10T01:09:53.790195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775783+0000","last_change":"2023-05-10T01:09:53.762054+0000","last_active":"2023-05-10T01:09:53.775783+0000","last_peered":"2023-05-10T01:09:53.775783+0000","last_clean":"2023-05-10T01:09:53.775783+0000","last_became_active":"2023-05-10T01:09:53.761780+0000","last_became_peered":"2023-05-10T01:09:53.761780+0000","last_unstale":"2023-05-10T01:09:53.775783+0000","last_undegraded":"2023-05-10T01:09:53.775783+0000","last_fullsized":"2023-05-10T01:09:53.775783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.765676+0000","last_change":"2023-05-10T01:09:53.376957+0000","last_active":"2023-05-10T01:09:53.765676+0000","last_peered":"2023-05-10T01:09:53.765676+0000","last_clean":"2023-05-10T01:09:53.765676+0000","last_became_active":"2023-05-10T01:09:53.376671+0000","last_became_peered":"2023-05-10T01:09:53.376671+0000","last_unstale":"2023-05-10T01:09:53.765676+0000","last_undegraded":"2023-05-10T01:09:53.765676+0000","last_fullsized":"2023-05-10T01:09:53.765676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786478+0000","last_change":"2023-05-10T01:09:53.778775+0000","last_active":"2023-05-10T01:09:53.786478+0000","last_peered":"2023-05-10T01:09:53.786478+0000","last_clean":"2023-05-10T01:09:53.786478+0000","last_became_active":"2023-05-10T01:09:53.778466+0000","last_became_peered":"2023-05-10T01:09:53.778466+0000","last_unstale":"2023-05-10T01:09:53.786478+0000","last_undegraded":"2023-05-10T01:09:53.786478+0000","last_fullsized":"2023-05-10T01:09:53.786478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.767867+0000","last_change":"2023-05-10T01:09:53.377703+0000","last_active":"2023-05-10T01:09:53.767867+0000","last_peered":"2023-05-10T01:09:53.767867+0000","last_clean":"2023-05-10T01:09:53.767867+0000","last_became_active":"2023-05-10T01:09:53.377326+0000","last_became_peered":"2023-05-10T01:09:53.377326+0000","last_unstale":"2023-05-10T01:09:53.767867+0000","last_undegraded":"2023-05-10T01:09:53.767867+0000","last_fullsized":"2023-05-10T01:09:53.767867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780343+0000","last_change":"2023-05-10T01:09:53.771235+0000","last_active":"2023-05-10T01:09:53.780343+0000","last_peered":"2023-05-10T01:09:53.780343+0000","last_clean":"2023-05-10T01:09:53.780343+0000","last_became_active":"2023-05-10T01:09:53.770851+0000","last_became_peered":"2023-05-10T01:09:53.770851+0000","last_unstale":"2023-05-10T01:09:53.780343+0000","last_undegraded":"2023-05-10T01:09:53.780343+0000","last_fullsized":"2023-05-10T01:09:53.780343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.773545+0000","last_change":"2023-05-10T01:09:53.381560+0000","last_active":"2023-05-10T01:09:53.773545+0000","last_peered":"2023-05-10T01:09:53.773545+0000","last_clean":"2023-05-10T01:09:53.773545+0000","last_became_active":"2023-05-10T01:09:53.381233+0000","last_became_peered":"2023-05-10T01:09:53.381233+0000","last_unstale":"2023-05-10T01:09:53.773545+0000","last_undegraded":"2023-05-10T01:09:53.773545+0000","last_fullsized":"2023-05-10T01:09:53.773545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.770806+0000","last_change":"2023-05-10T01:09:53.768979+0000","last_active":"2023-05-10T01:09:53.770806+0000","last_peered":"2023-05-10T01:09:53.770806+0000","last_clean":"2023-05-10T01:09:53.770806+0000","last_became_active":"2023-05-10T01:09:53.768736+0000","last_became_peered":"2023-05-10T01:09:53.768736+0000","last_unstale":"2023-05-10T01:09:53.770806+0000","last_undegraded":"2023-05-10T01:09:53.770806+0000","last_fullsized":"2023-05-10T01:09:53.770806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.759905+0000","last_change":"2023-05-10T01:09:53.380523+0000","last_active":"2023-05-10T01:09:53.759905+0000","last_peered":"2023-05-10T01:09:53.759905+0000","last_clean":"2023-05-10T01:09:53.759905+0000","last_became_active":"2023-05-10T01:09:53.380220+0000","last_became_peered":"2023-05-10T01:09:53.380220+0000","last_unstale":"2023-05-10T01:09:53.759905+0000","last_undegraded":"2023-05-10T01:09:53.759905+0000","last_fullsized":"2023-05-10T01:09:53.759905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785890+0000","last_change":"2023-05-10T01:09:53.774054+0000","last_active":"2023-05-10T01:09:53.785890+0000","last_peered":"2023-05-10T01:09:53.785890+0000","last_clean":"2023-05-10T01:09:53.785890+0000","last_became_active":"2023-05-10T01:09:53.773600+0000","last_became_peered":"2023-05-10T01:09:53.773600+0000","last_unstale":"2023-05-10T01:09:53.785890+0000","last_undegraded":"2023-05-10T01:09:53.785890+0000","last_fullsized":"2023-05-10T01:09:53.785890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.769207+0000","last_change":"2023-05-10T01:09:53.387215+0000","last_active":"2023-05-10T01:09:53.769207+0000","last_peered":"2023-05-10T01:09:53.769207+0000","last_clean":"2023-05-10T01:09:53.769207+0000","last_became_active":"2023-05-10T01:09:53.386942+0000","last_became_peered":"2023-05-10T01:09:53.386942+0000","last_unstale":"2023-05-10T01:09:53.769207+0000","last_undegraded":"2023-05-10T01:09:53.769207+0000","last_fullsized":"2023-05-10T01:09:53.769207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789796+0000","last_change":"2023-05-10T01:09:53.775699+0000","last_active":"2023-05-10T01:09:53.789796+0000","last_peered":"2023-05-10T01:09:53.789796+0000","last_clean":"2023-05-10T01:09:53.789796+0000","last_became_active":"2023-05-10T01:09:53.775407+0000","last_became_peered":"2023-05-10T01:09:53.775407+0000","last_unstale":"2023-05-10T01:09:53.789796+0000","last_undegraded":"2023-05-10T01:09:53.789796+0000","last_fullsized":"2023-05-10T01:09:53.789796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.775817+0000","last_change":"2023-05-10T01:09:53.387442+0000","last_active":"2023-05-10T01:09:53.775817+0000","last_peered":"2023-05-10T01:09:53.775817+0000","last_clean":"2023-05-10T01:09:53.775817+0000","last_became_active":"2023-05-10T01:09:53.387192+0000","last_became_peered":"2023-05-10T01:09:53.387192+0000","last_unstale":"2023-05-10T01:09:53.775817+0000","last_undegraded":"2023-05-10T01:09:53.775817+0000","last_fullsized":"2023-05-10T01:09:53.775817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.781258+0000","last_change":"2023-05-10T01:09:53.776255+0000","last_active":"2023-05-10T01:09:53.781258+0000","last_peered":"2023-05-10T01:09:53.781258+0000","last_clean":"2023-05-10T01:09:53.781258+0000","last_became_active":"2023-05-10T01:09:53.775994+0000","last_became_peered":"2023-05-10T01:09:53.775994+0000","last_unstale":"2023-05-10T01:09:53.781258+0000","last_undegraded":"2023-05-10T01:09:53.781258+0000","last_fullsized":"2023-05-10T01:09:53.781258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786324+0000","last_change":"2023-05-10T01:09:53.381425+0000","last_active":"2023-05-10T01:09:53.786324+0000","last_peered":"2023-05-10T01:09:53.786324+0000","last_clean":"2023-05-10T01:09:53.786324+0000","last_became_active":"2023-05-10T01:09:53.381139+0000","last_became_peered":"2023-05-10T01:09:53.381139+0000","last_unstale":"2023-05-10T01:09:53.786324+0000","last_undegraded":"2023-05-10T01:09:53.786324+0000","last_fullsized":"2023-05-10T01:09:53.786324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.764895+0000","last_change":"2023-05-10T01:09:53.763499+0000","last_active":"2023-05-10T01:09:53.764895+0000","last_peered":"2023-05-10T01:09:53.764895+0000","last_clean":"2023-05-10T01:09:53.764895+0000","last_became_active":"2023-05-10T01:09:53.763025+0000","last_became_peered":"2023-05-10T01:09:53.763025+0000","last_unstale":"2023-05-10T01:09:53.764895+0000","last_undegraded":"2023-05-10T01:09:53.764895+0000","last_fullsized":"2023-05-10T01:09:53.764895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.780774+0000","last_change":"2023-05-10T01:09:53.379747+0000","last_active":"2023-05-10T01:09:53.780774+0000","last_peered":"2023-05-10T01:09:53.780774+0000","last_clean":"2023-05-10T01:09:53.780774+0000","last_became_active":"2023-05-10T01:09:53.379410+0000","last_became_peered":"2023-05-10T01:09:53.379410+0000","last_unstale":"2023-05-10T01:09:53.780774+0000","last_undegraded":"2023-05-10T01:09:53.780774+0000","last_fullsized":"2023-05-10T01:09:53.780774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789720+0000","last_change":"2023-05-10T01:09:53.782423+0000","last_active":"2023-05-10T01:09:53.789720+0000","last_peered":"2023-05-10T01:09:53.789720+0000","last_clean":"2023-05-10T01:09:53.789720+0000","last_became_active":"2023-05-10T01:09:53.782122+0000","last_became_peered":"2023-05-10T01:09:53.782122+0000","last_unstale":"2023-05-10T01:09:53.789720+0000","last_undegraded":"2023-05-10T01:09:53.789720+0000","last_fullsized":"2023-05-10T01:09:53.789720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.756687+0000","last_change":"2023-05-10T01:09:53.377917+0000","last_active":"2023-05-10T01:09:53.756687+0000","last_peered":"2023-05-10T01:09:53.756687+0000","last_clean":"2023-05-10T01:09:53.756687+0000","last_became_active":"2023-05-10T01:09:53.377603+0000","last_became_peered":"2023-05-10T01:09:53.377603+0000","last_unstale":"2023-05-10T01:09:53.756687+0000","last_undegraded":"2023-05-10T01:09:53.756687+0000","last_fullsized":"2023-05-10T01:09:53.756687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.786549+0000","last_change":"2023-05-10T01:09:53.779988+0000","last_active":"2023-05-10T01:09:53.786549+0000","last_peered":"2023-05-10T01:09:53.786549+0000","last_clean":"2023-05-10T01:09:53.786549+0000","last_became_active":"2023-05-10T01:09:53.774488+0000","last_became_peered":"2023-05-10T01:09:53.774488+0000","last_unstale":"2023-05-10T01:09:53.786549+0000","last_undegraded":"2023-05-10T01:09:53.786549+0000","last_fullsized":"2023-05-10T01:09:53.786549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.753958+0000","last_change":"2023-05-10T01:09:53.370862+0000","last_active":"2023-05-10T01:09:53.753958+0000","last_peered":"2023-05-10T01:09:53.753958+0000","last_clean":"2023-05-10T01:09:53.753958+0000","last_became_active":"2023-05-10T01:09:53.370581+0000","last_became_peered":"2023-05-10T01:09:53.370581+0000","last_unstale":"2023-05-10T01:09:53.753958+0000","last_undegraded":"2023-05-10T01:09:53.753958+0000","last_fullsized":"2023-05-10T01:09:53.753958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.785974+0000","last_change":"2023-05-10T01:09:53.775797+0000","last_active":"2023-05-10T01:09:53.785974+0000","last_peered":"2023-05-10T01:09:53.785974+0000","last_clean":"2023-05-10T01:09:53.785974+0000","last_became_active":"2023-05-10T01:09:53.775494+0000","last_became_peered":"2023-05-10T01:09:53.775494+0000","last_unstale":"2023-05-10T01:09:53.785974+0000","last_undegraded":"2023-05-10T01:09:53.785974+0000","last_fullsized":"2023-05-10T01:09:53.785974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:53.348548+0000","last_clean_scrub_stamp":"2023-05-10T01:09:53.348548+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-05-10T01:09:53.789403+0000","last_change":"2023-05-10T01:09:53.382141+0000","last_active":"2023-05-10T01:09:53.789403+0000","last_peered":"2023-05-10T01:09:53.789403+0000","last_clean":"2023-05-10T01:09:53.789403+0000","last_became_active":"2023-05-10T01:09:53.381836+0000","last_became_peered":"2023-05-10T01:09:53.381836+0000","last_unstale":"2023-05-10T01:09:53.789403+0000","last_undegraded":"2023-05-10T01:09:53.789403+0000","last_fullsized":"2023-05-10T01:09:53.789403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:52.346165+0000","last_clean_scrub_stamp":"2023-05-10T01:09:52.346165+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":86751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":86783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":86929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:10:05.056 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-10T01:10:05.056 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-10T01:10:05.057 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-10T01:10:05.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-10T01:10:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.201+0000 7f601714c700 1 Processor -- start 2023-05-10T01:10:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.201+0000 7f601714c700 1 -- start start 2023-05-10T01:10:05.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f601714c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f601014ea20 0x7f60101556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f601714c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6010155250 con 0x7f6010069760 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f601714c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60100c6600 con 0x7f60100a9ea0 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f601714c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100c68e0 con 0x7f601014ea20 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f6014ee8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f601014ea20 0x7f60101556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f60156e9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6010069760 0x7f60100bfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39596/0 (socket says 172.21.15.52:39596) 2023-05-10T01:10:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f60156e9700 1 -- 172.21.15.52:0/76363329 learned_addr learned my addr 172.21.15.52:0/76363329 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f6014ee8700 1 -- 172.21.15.52:0/76363329 >> v1:172.21.15.172:6789/0 conn(0x7f60100a9ea0 legacy=0x7f60100c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f6014ee8700 1 -- 172.21.15.52:0/76363329 >> v1:172.21.15.52:6789/0 conn(0x7f6010069760 legacy=0x7f60100bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f6014ee8700 1 -- 172.21.15.52:0/76363329 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010154c00 con 0x7f601014ea20 2023-05-10T01:10:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f600f7fe700 1 -- 172.21.15.52:0/76363329 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014202205 0 0) 0x7f6010155250 con 0x7f6010069760 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f6014ee8700 1 --2- 172.21.15.52:0/76363329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f601014ea20 0x7f60101556e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f6008009760 tx=0x7f6008009060).ready entity=mon.0 client_cookie=8a85d0d2848d74a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f600f7fe700 1 -- 172.21.15.52:0/76363329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800b580 con 0x7f601014ea20 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f600f7fe700 1 -- 172.21.15.52:0/76363329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800b6e0 con 0x7f601014ea20 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.202+0000 7f600f7fe700 1 -- 172.21.15.52:0/76363329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800ba60 con 0x7f601014ea20 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 -- 172.21.15.52:0/76363329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f601014ea20 msgr2=0x7f60101556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 --2- 172.21.15.52:0/76363329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f601014ea20 0x7f60101556e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f6008009760 tx=0x7f6008009060).stop 2023-05-10T01:10:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 -- 172.21.15.52:0/76363329 shutdown_connections 2023-05-10T01:10:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 --2- 172.21.15.52:0/76363329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f601014ea20 0x7f60101556e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 -- 172.21.15.52:0/76363329 >> 172.21.15.52:0/76363329 conn(0x7f60100cb710 msgr2=0x7f60100c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 -- 172.21.15.52:0/76363329 shutdown_connections 2023-05-10T01:10:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.203+0000 7f601714c700 1 -- 172.21.15.52:0/76363329 wait complete. 2023-05-10T01:10:05.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.204+0000 7f601714c700 1 Processor -- start 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.204+0000 7f601714c700 1 -- start start 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6010069760 0x7f6010164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 0x7f60100c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6010164b10 con 0x7f60100a9ea0 2023-05-10T01:10:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100c0370 con 0x7f601014ea20 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f601714c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6010167930 con 0x7f6010069760 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58816/0 (socket says 172.21.15.52:58816) 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 -- 172.21.15.52:0/2126140102 learned_addr learned my addr 172.21.15.52:0/2126140102 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f6014ee8700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6010069760 0x7f6010164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f60156e9700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 0x7f60100c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 -- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6010069760 msgr2=0x7f6010164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6010069760 0x7f6010164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 -- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 msgr2=0x7f60100c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 0x7f60100c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 -- 172.21.15.52:0/2126140102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080092a0 con 0x7f60100a9ea0 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f60156e9700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 0x7f60100c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.205+0000 7f600ffff700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f600000c810 tx=0x7f60000025b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000010510 con 0x7f60100a9ea0 2023-05-10T01:10:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000010670 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60100c2730 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000010a30 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60100c0000 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.206+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60100666b0 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.207+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6000010070 con 0x7f60100a9ea0 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.207+0000 7f600cff9700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 0x7f5ff4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.207+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6000079830 con 0x7f60100a9ea0 2023-05-10T01:10:05.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.208+0000 7f6014ee8700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 0x7f5ff4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.208+0000 7f6014ee8700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 0x7f5ff4061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6008006d30 tx=0x7f6008017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.211+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f600004add0 con 0x7f60100a9ea0 2023-05-10T01:10:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.424+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f601006c340 con 0x7f60100a9ea0 2023-05-10T01:10:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.425+0000 7f600cff9700 1 -- 172.21.15.52:0/2126140102 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f600004e3f0 con 0x7f60100a9ea0 2023-05-10T01:10:05.428 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 msgr2=0x7f5ff4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 0x7f5ff4061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6008006d30 tx=0x7f6008017000).stop 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 msgr2=0x7f6010167440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f600000c810 tx=0x7f60000025b0).stop 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 shutdown_connections 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff405ed90 0x7f5ff4061250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601014ea20 0x7f60100c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6010069760 0x7f6010164620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 --2- 172.21.15.52:0/2126140102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60100a9ea0 0x7f6010167440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.426+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 >> 172.21.15.52:0/2126140102 conn(0x7f60100cb710 msgr2=0x7f60101572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.427+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 shutdown_connections 2023-05-10T01:10:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.427+0000 7f601714c700 1 -- 172.21.15.52:0/2126140102 wait complete. 2023-05-10T01:10:05.441 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-10T01:10:05.441 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-10T01:10:05.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.555+0000 7f5deef6f700 1 Processor -- start 2023-05-10T01:10:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.555+0000 7f5deef6f700 1 -- start start 2023-05-10T01:10:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5deef6f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8154540 0x7f5de8069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5deef6f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5de8069b80 0x7f5de80c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5deef6f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de80c0650 con 0x7f5de8154160 2023-05-10T01:10:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5deef6f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de806a010 con 0x7f5de8069b80 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5deef6f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80bfd20 con 0x7f5de8154540 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5ded50c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5de8069b80 0x7f5de80c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5decd0b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5de8154160 0x7f5de80c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39606/0 (socket says 172.21.15.52:39606) 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5decd0b700 1 -- 172.21.15.52:0/4176519053 learned_addr learned my addr 172.21.15.52:0/4176519053 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5de7fff700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8154540 0x7f5de8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5ded50c700 1 -- 172.21.15.52:0/4176519053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8154540 msgr2=0x7f5de8069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5ded50c700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8154540 0x7f5de8069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5ded50c700 1 -- 172.21.15.52:0/4176519053 >> v1:172.21.15.52:6789/0 conn(0x7f5de8154160 legacy=0x7f5de80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5de77fe700 1 -- 172.21.15.52:0/4176519053 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173305875 0 0) 0x7f5de80c0650 con 0x7f5de8154160 2023-05-10T01:10:05.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.556+0000 7f5ded50c700 1 -- 172.21.15.52:0/4176519053 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80c0000 con 0x7f5de8069b80 2023-05-10T01:10:05.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5ded50c700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8069b80 0x7f5de80c0ae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5dd8009760 tx=0x7f5dd8009060).ready entity=mon.0 client_cookie=f60e5ea07a98511 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5de77fe700 1 -- 172.21.15.52:0/4176519053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80090d0 con 0x7f5de8069b80 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5de77fe700 1 -- 172.21.15.52:0/4176519053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800b580 con 0x7f5de8069b80 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5de77fe700 1 -- 172.21.15.52:0/4176519053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800b900 con 0x7f5de8069b80 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 -- 172.21.15.52:0/4176519053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8069b80 msgr2=0x7f5de80c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8069b80 0x7f5de80c0ae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5dd8009760 tx=0x7f5dd8009060).stop 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 -- 172.21.15.52:0/4176519053 shutdown_connections 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8069b80 0x7f5de80c0ae0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 --2- 172.21.15.52:0/4176519053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8154540 0x7f5de8069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 -- 172.21.15.52:0/4176519053 >> 172.21.15.52:0/4176519053 conn(0x7f5de80cb6f0 msgr2=0x7f5de80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 -- 172.21.15.52:0/4176519053 shutdown_connections 2023-05-10T01:10:05.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.557+0000 7f5deef6f700 1 -- 172.21.15.52:0/4176519053 wait complete. 2023-05-10T01:10:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.558+0000 7f5deef6f700 1 Processor -- start 2023-05-10T01:10:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 -- start start 2023-05-10T01:10:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8069b80 0x7f5de81676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 0x7f5de8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80c3c70 con 0x7f5de8154160 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8168610 con 0x7f5de8154540 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5deef6f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de814e400 con 0x7f5de8069b80 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5de7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5de7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58830/0 (socket says 172.21.15.52:58830) 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.559+0000 7f5de7fff700 1 -- 172.21.15.52:0/3068634075 learned_addr learned my addr 172.21.15.52:0/3068634075 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5decd0b700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8069b80 0x7f5de81676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5ded50c700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 0x7f5de8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 -- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8069b80 msgr2=0x7f5de81676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8069b80 0x7f5de81676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 -- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 msgr2=0x7f5de8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 0x7f5de8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 -- 172.21.15.52:0/3068634075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80092a0 con 0x7f5de8154160 2023-05-10T01:10:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5ded50c700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 0x7f5de8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de7fff700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f5ddc00d860 tx=0x7f5ddc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0125f0 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc012750 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de8167d70 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc012ad0 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.560+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de8168330 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.561+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de814e5b0 con 0x7f5de8154160 2023-05-10T01:10:05.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.561+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5ddc013480 con 0x7f5de8154160 2023-05-10T01:10:05.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.562+0000 7f5de4ff9700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 0x7f5dc8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.562+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ddc079950 con 0x7f5de8154160 2023-05-10T01:10:05.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.562+0000 7f5decd0b700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 0x7f5dc8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.562+0000 7f5decd0b700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 0x7f5dc8061220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5de0001560 tx=0x7f5de0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.566+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5de814e5b0 con 0x7f5de8154160 2023-05-10T01:10:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.739+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de80666b0 con 0x7f5de8154160 2023-05-10T01:10:05.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.740+0000 7f5de4ff9700 1 -- 172.21.15.52:0/3068634075 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f5ddc04ae90 con 0x7f5de8154160 2023-05-10T01:10:05.744 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:05.745 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 msgr2=0x7f5dc8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 0x7f5dc8061220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5de0001560 tx=0x7f5de0009040).stop 2023-05-10T01:10:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 msgr2=0x7f5de80c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f5ddc00d860 tx=0x7f5ddc008040).stop 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 shutdown_connections 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5dc805ed60 0x7f5dc8061220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de8154540 0x7f5de8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de8069b80 0x7f5de81676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 --2- 172.21.15.52:0/3068634075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8154160 0x7f5de80c3780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 >> 172.21.15.52:0/3068634075 conn(0x7f5de80cb6f0 msgr2=0x7f5de80c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 shutdown_connections 2023-05-10T01:10:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.742+0000 7f5deef6f700 1 -- 172.21.15.52:0/3068634075 wait complete. 2023-05-10T01:10:05.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:05.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:05.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.874+0000 7ff34230e700 1 Processor -- start 2023-05-10T01:10:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.874+0000 7ff34230e700 1 -- start start 2023-05-10T01:10:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff34230e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff33c0c6400 0x7ff33c155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff34230e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c06a130 con 0x7ff33c0c1150 2023-05-10T01:10:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff34230e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c06a410 con 0x7ff33c153f80 2023-05-10T01:10:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff34230e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c069f50 con 0x7ff33c0c6400 2023-05-10T01:10:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff340b0b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff33c0c1150 0x7ff33c0c5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39622/0 (socket says 172.21.15.52:39622) 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff340b0b700 1 -- 172.21.15.52:0/483202046 learned_addr learned my addr 172.21.15.52:0/483202046 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff341b0d700 1 --2- 172.21.15.52:0/483202046 >> v2:172.21.15.172:3300/0 conn(0x7ff33c0c6400 0x7ff33c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439661665 0 0) 0x7ff33c06a130 con 0x7ff33c0c1150 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3280033f0 con 0x7ff33c0c1150 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837905058 0 0) 0x7ff3280033f0 con 0x7ff33c0c1150 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 >> v2:172.21.15.172:3300/0 conn(0x7ff33c0c6400 msgr2=0x7ff33c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 --2- 172.21.15.52:0/483202046 >> v2:172.21.15.172:3300/0 conn(0x7ff33c0c6400 0x7ff33c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 >> v1:172.21.15.172:6789/0 conn(0x7ff33c153f80 legacy=0x7ff33c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c06a6f0 con 0x7ff33c0c1150 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7ff330001470 con 0x7ff33c0c1150 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 >> v1:172.21.15.52:6789/0 conn(0x7ff33c0c1150 legacy=0x7ff33c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.875+0000 7ff33bfff700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3280038e0 0x7ff328003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff328004690 0x7ff328004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 0x7ff32800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c069f50 con 0x7ff328005000 2023-05-10T01:10:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32800beb0 con 0x7ff3280038e0 2023-05-10T01:10:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32800c070 con 0x7ff328004690 2023-05-10T01:10:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 0x7ff32800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff34130c700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3280038e0 0x7ff328003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff340b0b700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff328004690 0x7ff328004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 -- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff328004690 msgr2=0x7ff328004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff328004690 0x7ff328004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 -- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3280038e0 msgr2=0x7ff328003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3280038e0 0x7ff328003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 -- 172.21.15.52:0/483202046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280033f0 con 0x7ff328005000 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff340b0b700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff328004690 0x7ff328004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 -- 172.21.15.52:0/483202046 reap_dead start 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff341b0d700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 0x7ff32800b8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff33c0c6800 tx=0x7ff32c009060).ready entity=mon.0 client_cookie=9938d181dda47e4a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c009e90 con 0x7ff328005000 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c009430 con 0x7ff328005000 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.876+0000 7ff33bfff700 1 -- 172.21.15.52:0/483202046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00e870 con 0x7ff328005000 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 -- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 msgr2=0x7ff32800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 0x7ff32800b8e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff33c0c6800 tx=0x7ff32c009060).stop 2023-05-10T01:10:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 -- 172.21.15.52:0/483202046 shutdown_connections 2023-05-10T01:10:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 --2- 172.21.15.52:0/483202046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff328005000 0x7ff32800b8e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 -- 172.21.15.52:0/483202046 >> 172.21.15.52:0/483202046 conn(0x7ff33c0cb5f0 msgr2=0x7ff33c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 -- 172.21.15.52:0/483202046 shutdown_connections 2023-05-10T01:10:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.877+0000 7ff34230e700 1 -- 172.21.15.52:0/483202046 wait complete. 2023-05-10T01:10:05.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.878+0000 7ff34230e700 1 Processor -- start 2023-05-10T01:10:05.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.878+0000 7ff34230e700 1 -- start start 2023-05-10T01:10:05.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff328005000 0x7ff33c0a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff33c167910 0x7ff33c167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0a96e0 con 0x7ff33c0a9260 2023-05-10T01:10:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c165750 con 0x7ff328005000 2023-05-10T01:10:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34230e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c165450 con 0x7ff33c167910 2023-05-10T01:10:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58850/0 (socket says 172.21.15.52:58850) 2023-05-10T01:10:05.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 -- 172.21.15.52:0/1879268656 learned_addr learned my addr 172.21.15.52:0/1879268656 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:05.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff34130c700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff328005000 0x7ff33c0a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff341b0d700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff33c167910 0x7ff33c167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 -- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff33c167910 msgr2=0x7ff33c167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff33c167910 0x7ff33c167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 -- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff328005000 msgr2=0x7ff33c0a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff328005000 0x7ff33c0a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 -- 172.21.15.52:0/1879268656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c168280 con 0x7ff33c0a9260 2023-05-10T01:10:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff340b0b700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff33000e780 tx=0x7ff330000d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330010490 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.879+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330010040 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.880+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c0c3df0 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.880+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330010800 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.880+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0c43b0 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.880+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c165590 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.881+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff330010bb0 con 0x7ff33c0a9260 2023-05-10T01:10:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.881+0000 7ff3397fa700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 0x7ff31c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.881+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff3300792f0 con 0x7ff33c0a9260 2023-05-10T01:10:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.881+0000 7ff34130c700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 0x7ff31c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.882+0000 7ff34130c700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 0x7ff31c061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff33c151210 tx=0x7ff334007f30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:05.885+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff33c165590 con 0x7ff33c0a9260 2023-05-10T01:10:06.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.056+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff33c165590 con 0x7ff33c0a9260 2023-05-10T01:10:06.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.056+0000 7ff3397fa700 1 -- 172.21.15.52:0/1879268656 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff33c165590 con 0x7ff33c0a9260 2023-05-10T01:10:06.059 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:06.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 msgr2=0x7ff31c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 0x7ff31c061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff33c151210 tx=0x7ff334007f30).stop 2023-05-10T01:10:06.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 msgr2=0x7ff33c0c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff33000e780 tx=0x7ff330000d20).stop 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 shutdown_connections 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff31c05ed90 0x7ff31c061250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff33c167910 0x7ff33c167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff328005000 0x7ff33c0a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 --2- 172.21.15.52:0/1879268656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff33c0a9260 0x7ff33c0c3550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 >> 172.21.15.52:0/1879268656 conn(0x7ff33c0cb5f0 msgr2=0x7ff33c1515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 shutdown_connections 2023-05-10T01:10:06.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.058+0000 7ff34230e700 1 -- 172.21.15.52:0/1879268656 wait complete. 2023-05-10T01:10:06.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.188+0000 7f449208b700 1 Processor -- start 2023-05-10T01:10:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.188+0000 7f449208b700 1 -- start start 2023-05-10T01:10:06.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f449208b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f448c0a4a30 0x7f448c0a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f449208b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f448c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f449208b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c14e930 con 0x7f448c068a60 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f449208b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c137420 con 0x7f448c0a4a30 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f449208b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c06a380 con 0x7f448c1549d0 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f448bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f448c068a60 0x7f448c068ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39644/0 (socket says 172.21.15.52:39644) 2023-05-10T01:10:06.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f448bfff700 1 -- 172.21.15.52:0/2089084898 learned_addr learned my addr 172.21.15.52:0/2089084898 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2089084898 >> v2:172.21.15.172:3300/0 conn(0x7f448c0a4a30 0x7f448c0a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.189+0000 7f448affd700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f448c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321760894 0 0) 0x7f448c14e930 con 0x7f448c068a60 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44780033f0 con 0x7f448c068a60 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137458865 0 0) 0x7f44780033f0 con 0x7f448c068a60 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 msgr2=0x7f448c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f448c154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 >> v2:172.21.15.172:3300/0 conn(0x7f448c0a4a30 msgr2=0x7f448c0a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 --2- 172.21.15.52:0/2089084898 >> v2:172.21.15.172:3300/0 conn(0x7f448c0a4a30 0x7f448c0a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c069770 con 0x7f448c068a60 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f44840017f0 con 0x7f448c068a60 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 >> v1:172.21.15.52:6789/0 conn(0x7f448c068a60 legacy=0x7f448c068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44780038e0 0x7f4478003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f4478004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478004b80 0x7f4478005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c137420 con 0x7f4478004b80 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c06a380 con 0x7f44780038e0 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447800b8e0 con 0x7f448c1549d0 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2089084898 >> v2:172.21.15.172:3300/0 conn(0x7f448c0a4a30 0x7f448c0a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:06.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478004b80 0x7f4478005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448affd700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f4478004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44780038e0 0x7f4478003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 -- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 msgr2=0x7f4478004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f448c1549d0 0x7f4478004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 -- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44780038e0 msgr2=0x7f4478003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44780038e0 0x7f4478003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 -- 172.21.15.52:0/2089084898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780033f0 con 0x7f4478004b80 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44780038e0 0x7f4478003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448bfff700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478004b80 0x7f4478005000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f448400c530 tx=0x7f4484002210).ready entity=mon.0 client_cookie=92565efcff954dc8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484007de0 con 0x7f4478004b80 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448400ce60 con 0x7f4478004b80 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.190+0000 7f448a7fc700 1 -- 172.21.15.52:0/2089084898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484005d30 con 0x7f4478004b80 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 -- 172.21.15.52:0/2089084898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478004b80 msgr2=0x7f4478005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 --2- 172.21.15.52:0/2089084898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478004b80 0x7f4478005000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f448400c530 tx=0x7f4484002210).stop 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f448bfff700 1 -- 172.21.15.52:0/2089084898 reap_dead start 2023-05-10T01:10:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 -- 172.21.15.52:0/2089084898 shutdown_connections 2023-05-10T01:10:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 -- 172.21.15.52:0/2089084898 >> 172.21.15.52:0/2089084898 conn(0x7f448c0c4610 msgr2=0x7f448c066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 -- 172.21.15.52:0/2089084898 shutdown_connections 2023-05-10T01:10:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.191+0000 7f449208b700 1 -- 172.21.15.52:0/2089084898 wait complete. 2023-05-10T01:10:06.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.192+0000 7f449208b700 1 Processor -- start 2023-05-10T01:10:06.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.192+0000 7f449208b700 1 -- start start 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4478004b80 0x7f448c14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f448c0aac60 0x7f448c0a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c164eb0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0aa7d0 con 0x7f448c0aac60 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f449208b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0a8f50 con 0x7f4478004b80 2023-05-10T01:10:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58872/0 (socket says 172.21.15.52:58872) 2023-05-10T01:10:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 -- 172.21.15.52:0/2387976676 learned_addr learned my addr 172.21.15.52:0/2387976676 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4478004b80 0x7f448c14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448affd700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f448c0aac60 0x7f448c0a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 -- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4478004b80 msgr2=0x7f448c14d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4478004b80 0x7f448c14d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 -- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f448c0aac60 msgr2=0x7f448c0a85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f448c0aac60 0x7f448c0a85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 -- 172.21.15.52:0/2387976676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c14dac0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.193+0000 7f448bfff700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4484000f80 tx=0x7f4484015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.194+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484007de0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.194+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484005e80 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.194+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c164bd0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.194+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840017b0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.194+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0aa460 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.195+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c06c340 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.195+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f448401d070 con 0x7f448c0a8ad0 2023-05-10T01:10:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.195+0000 7f44737fe700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 0x7f446c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.195+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f448407a8b0 con 0x7f448c0a8ad0 2023-05-10T01:10:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.196+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 0x7f446c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.196+0000 7f448b7fe700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 0x7f446c061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f447c009270 tx=0x7f447c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.199+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f448404be50 con 0x7f448c0a8ad0 2023-05-10T01:10:06.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.373+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f448c0aa910 con 0x7f448c0a8ad0 2023-05-10T01:10:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.373+0000 7f44737fe700 1 -- 172.21.15.52:0/2387976676 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f448401a030 con 0x7f448c0a8ad0 2023-05-10T01:10:06.376 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 msgr2=0x7f446c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 0x7f446c061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f447c009270 tx=0x7f447c008040).stop 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 msgr2=0x7f448c163f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4484000f80 tx=0x7f4484015000).stop 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 shutdown_connections 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f446c05ed90 0x7f446c061250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f448c0a8ad0 0x7f448c163f30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4478004b80 0x7f448c14d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 --2- 172.21.15.52:0/2387976676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f448c0aac60 0x7f448c0a85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 >> 172.21.15.52:0/2387976676 conn(0x7f448c0c4610 msgr2=0x7f448c0c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 shutdown_connections 2023-05-10T01:10:06.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.375+0000 7f449208b700 1 -- 172.21.15.52:0/2387976676 wait complete. 2023-05-10T01:10:06.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.507+0000 7f84fa75c700 1 Processor -- start 2023-05-10T01:10:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.507+0000 7f84fa75c700 1 -- start start 2023-05-10T01:10:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84fa75c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84fa75c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84fa75c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40bfcb0 con 0x7f84f4157700 2023-05-10T01:10:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84fa75c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f406a990 con 0x7f84f40c6090 2023-05-10T01:10:06.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84fa75c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40aa400 con 0x7f84f40c1150 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f9f5b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50282/0 (socket says 172.21.15.52:50282) 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f9f5b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:57204/0 (socket says 172.21.15.52:57204) 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f975a700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f84f4157700 0x7f84f40a9cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42198/0 (socket says 172.21.15.52:42198) 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 -- 172.21.15.52:0/1748464072 learned_addr learned my addr 172.21.15.52:0/1748464072 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84e3fff700 1 -- 172.21.15.52:0/1748464072 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067597662 0 0) 0x7f84f40bfcb0 con 0x7f84f4157700 2023-05-10T01:10:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84e3fff700 1 -- 172.21.15.52:0/1748464072 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84dc0033f0 con 0x7f84f4157700 2023-05-10T01:10:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 -- 172.21.15.52:0/1748464072 >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 msgr2=0x7f84f415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 --2- 172.21.15.52:0/1748464072 >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 -- 172.21.15.52:0/1748464072 >> v1:172.21.15.172:6789/0 conn(0x7f84f4157700 legacy=0x7f84f40a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f8f59700 1 -- 172.21.15.52:0/1748464072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f406a130 con 0x7f84f40c1150 2023-05-10T01:10:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.508+0000 7f84f9f5b700 1 --2- 172.21.15.52:0/1748464072 >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84f8f59700 1 --2- 172.21.15.52:0/1748464072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f84e4006fd0 tx=0x7f84e40090f0).ready entity=mon.2 client_cookie=d352a345df736d7d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84e3fff700 1 -- 172.21.15.52:0/1748464072 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400f510 con 0x7f84f40c1150 2023-05-10T01:10:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84e3fff700 1 -- 172.21.15.52:0/1748464072 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400f670 con 0x7f84f40c1150 2023-05-10T01:10:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84e3fff700 1 -- 172.21.15.52:0/1748464072 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400f9f0 con 0x7f84f40c1150 2023-05-10T01:10:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 -- 172.21.15.52:0/1748464072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 msgr2=0x7f84f40c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 --2- 172.21.15.52:0/1748464072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f84e4006fd0 tx=0x7f84e40090f0).stop 2023-05-10T01:10:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 -- 172.21.15.52:0/1748464072 shutdown_connections 2023-05-10T01:10:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 --2- 172.21.15.52:0/1748464072 >> v2:172.21.15.172:3300/0 conn(0x7f84f40c6090 0x7f84f415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 --2- 172.21.15.52:0/1748464072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c1150 0x7f84f40c5ba0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 -- 172.21.15.52:0/1748464072 >> 172.21.15.52:0/1748464072 conn(0x7f84f40cb5f0 msgr2=0x7f84f40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 -- 172.21.15.52:0/1748464072 shutdown_connections 2023-05-10T01:10:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.509+0000 7f84fa75c700 1 -- 172.21.15.52:0/1748464072 wait complete. 2023-05-10T01:10:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.510+0000 7f84fa75c700 1 Processor -- start 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.510+0000 7f84fa75c700 1 -- start start 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 0x7f84f41551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 0x7f84f4140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41556e0 con 0x7f84f4157700 2023-05-10T01:10:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4154150 con 0x7f84f40c1150 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84fa75c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4154430 con 0x7f84f40c6090 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84f9f5b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84f9f5b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58886/0 (socket says 172.21.15.52:58886) 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.511+0000 7f84f9f5b700 1 -- 172.21.15.52:0/2583817562 learned_addr learned my addr 172.21.15.52:0/2583817562 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f8f59700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 0x7f84f4140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f975a700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 0x7f84f41551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 -- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 msgr2=0x7f84f4140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 0x7f84f4140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 -- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 msgr2=0x7f84f41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 0x7f84f41551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 -- 172.21.15.52:0/2583817562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00092a0 con 0x7f84f4157700 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f8f59700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 0x7f84f4140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f975a700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 0x7f84f41551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84f9f5b700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f84f000e980 tx=0x7f84f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000c850 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000c9b0 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e4009370 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000cd50 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.512+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f41549f0 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.513+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4083110 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.514+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f84f0022070 con 0x7f84f4157700 2023-05-10T01:10:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.514+0000 7f84e17fa700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 0x7f84d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.514+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84f007a550 con 0x7f84f4157700 2023-05-10T01:10:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.514+0000 7f84f975a700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 0x7f84d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.515+0000 7f84f975a700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 0x7f84d4061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f84ec005fd0 tx=0x7f84ec007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.518+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84f004bb70 con 0x7f84f4157700 2023-05-10T01:10:06.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.690+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84f4047150 con 0x7f84f4157700 2023-05-10T01:10:06.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.691+0000 7f84e17fa700 1 -- 172.21.15.52:0/2583817562 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84f004f190 con 0x7f84f4157700 2023-05-10T01:10:06.694 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 msgr2=0x7f84d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 0x7f84d4061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f84ec005fd0 tx=0x7f84ec007e60).stop 2023-05-10T01:10:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 msgr2=0x7f84f4068230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f84f000e980 tx=0x7f84f0009060).stop 2023-05-10T01:10:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 shutdown_connections 2023-05-10T01:10:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84d405ed90 0x7f84d4061250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f4157700 0x7f84f4068230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f40c1150 0x7f84f41551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 --2- 172.21.15.52:0/2583817562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84f40c6090 0x7f84f4140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 >> 172.21.15.52:0/2583817562 conn(0x7f84f40cb5f0 msgr2=0x7f84f40c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 shutdown_connections 2023-05-10T01:10:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.693+0000 7f84fa75c700 1 -- 172.21.15.52:0/2583817562 wait complete. 2023-05-10T01:10:06.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:06.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.824+0000 7fb356814700 1 Processor -- start 2023-05-10T01:10:06.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 -- start start 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb350068150 0x7fb350068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500c94c0 con 0x7fb350154460 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500cb7d0 con 0x7fb350068150 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.825+0000 7fb356814700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb350068a60 con 0x7fb350154080 2023-05-10T01:10:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb350068150 0x7fb350068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50294/0 (socket says 172.21.15.52:50294) 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34ffff700 1 -- 172.21.15.52:0/741448630 learned_addr learned my addr 172.21.15.52:0/741448630 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34f7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb350154460 0x7fb3500a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42214/0 (socket says 172.21.15.52:42214) 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 -- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 msgr2=0x7fb3500aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 -- 172.21.15.52:0/741448630 >> v1:172.21.15.172:6789/0 conn(0x7fb350154460 legacy=0x7fb3500a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34effd700 1 -- 172.21.15.52:0/741448630 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210361556 0 0) 0x7fb3500c94c0 con 0x7fb350154460 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 -- 172.21.15.52:0/741448630 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500c88b0 con 0x7fb350068150 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34ffff700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb354db1700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb350068570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb348009e60 tx=0x7fb348009780).ready entity=mon.1 client_cookie=dc9c77635655e00b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34effd700 1 -- 172.21.15.52:0/741448630 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800e070 con 0x7fb350068150 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34effd700 1 -- 172.21.15.52:0/741448630 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800bb60 con 0x7fb350068150 2023-05-10T01:10:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.826+0000 7fb34effd700 1 -- 172.21.15.52:0/741448630 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348012410 con 0x7fb350068150 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 -- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 msgr2=0x7fb350068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb350068570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb348009e60 tx=0x7fb348009780).stop 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 -- 172.21.15.52:0/741448630 shutdown_connections 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb350068570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 --2- 172.21.15.52:0/741448630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb3500aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 -- 172.21.15.52:0/741448630 >> 172.21.15.52:0/741448630 conn(0x7fb350067910 msgr2=0x7fb3500cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 -- 172.21.15.52:0/741448630 shutdown_connections 2023-05-10T01:10:06.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.827+0000 7fb356814700 1 -- 172.21.15.52:0/741448630 wait complete. 2023-05-10T01:10:06.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.828+0000 7fb356814700 1 Processor -- start 2023-05-10T01:10:06.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.828+0000 7fb356814700 1 -- start start 2023-05-10T01:10:06.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb35014f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb350150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c3320 con 0x7fb350154460 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350151420 con 0x7fb350068150 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb356814700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb350151700 con 0x7fb350154080 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58900/0 (socket says 172.21.15.52:58900) 2023-05-10T01:10:06.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 -- 172.21.15.52:0/777740255 learned_addr learned my addr 172.21.15.52:0/777740255 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb34ffff700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb35014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb34f7fe700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb350150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 -- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 msgr2=0x7fb350150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb350150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 -- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 msgr2=0x7fb35014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb35014f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 -- 172.21.15.52:0/777740255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009370 con 0x7fb350154460 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.829+0000 7fb354db1700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb348009480 tx=0x7fb348009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.830+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34801d630 con 0x7fb350154460 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.830+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34801d790 con 0x7fb350154460 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.830+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb348009a20 con 0x7fb350154460 2023-05-10T01:10:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.830+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34801db50 con 0x7fb350154460 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.830+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb350150500 con 0x7fb350154460 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.831+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb350066720 con 0x7fb350154460 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.831+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb348026410 con 0x7fb350154460 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.831+0000 7fb337fff700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 0x7fb330061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.831+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb34807bda0 con 0x7fb350154460 2023-05-10T01:10:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.832+0000 7fb34ffff700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 0x7fb330061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.832+0000 7fb34ffff700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 0x7fb330061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb340006fd0 tx=0x7fb3400090f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:06.836+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb34804d390 con 0x7fb350154460 2023-05-10T01:10:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.005+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3500c8b90 con 0x7fb350154460 2023-05-10T01:10:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.005+0000 7fb337fff700 1 -- 172.21.15.52:0/777740255 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3480509b0 con 0x7fb350154460 2023-05-10T01:10:07.009 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 msgr2=0x7fb330061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 0x7fb330061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb340006fd0 tx=0x7fb3400090f0).stop 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 msgr2=0x7fb350150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb348009480 tx=0x7fb348009780).stop 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 shutdown_connections 2023-05-10T01:10:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb33005ed90 0x7fb330061250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb350154460 0x7fb350150e50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb350068150 0x7fb35014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 --2- 172.21.15.52:0/777740255 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb350154080 0x7fb350150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 >> 172.21.15.52:0/777740255 conn(0x7fb350067910 msgr2=0x7fb3500abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 shutdown_connections 2023-05-10T01:10:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.007+0000 7fb356814700 1 -- 172.21.15.52:0/777740255 wait complete. 2023-05-10T01:10:07.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:07.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.135+0000 7f5280fe2700 1 Processor -- start 2023-05-10T01:10:07.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.135+0000 7f5280fe2700 1 -- start start 2023-05-10T01:10:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f5280fe2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f527c154540 0x7f527c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f5280fe2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c0c0650 con 0x7f527c069b80 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f5280fe2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c069fb0 con 0x7f527c154160 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f5280fe2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0bfd20 con 0x7f527c154540 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f5279d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f527c154540 0x7f527c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f527ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f527c069b80 0x7f527c0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39690/0 (socket says 172.21.15.52:39690) 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.136+0000 7f527ad9d700 1 -- 172.21.15.52:0/3360471720 learned_addr learned my addr 172.21.15.52:0/3360471720 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5279d9b700 1 -- 172.21.15.52:0/3360471720 >> v1:172.21.15.172:6789/0 conn(0x7f527c154160 legacy=0x7f527c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5279d9b700 1 -- 172.21.15.52:0/3360471720 >> v1:172.21.15.52:6789/0 conn(0x7f527c069b80 legacy=0x7f527c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5279d9b700 1 -- 172.21.15.52:0/3360471720 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0c0000 con 0x7f527c154540 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f527959a700 1 -- 172.21.15.52:0/3360471720 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344765011 0 0) 0x7f527c0c0650 con 0x7f527c069b80 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5279d9b700 1 --2- 172.21.15.52:0/3360471720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154540 0x7f527c069690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5270009760 tx=0x7f5270009060).ready entity=mon.0 client_cookie=4132f8eeee1f49ea server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f527959a700 1 -- 172.21.15.52:0/3360471720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700090d0 con 0x7f527c154540 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f527959a700 1 -- 172.21.15.52:0/3360471720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527000b520 con 0x7f527c154540 2023-05-10T01:10:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f527959a700 1 -- 172.21.15.52:0/3360471720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000b8a0 con 0x7f527c154540 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 -- 172.21.15.52:0/3360471720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154540 msgr2=0x7f527c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 --2- 172.21.15.52:0/3360471720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154540 0x7f527c069690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5270009760 tx=0x7f5270009060).stop 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 -- 172.21.15.52:0/3360471720 shutdown_connections 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 --2- 172.21.15.52:0/3360471720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154540 0x7f527c069690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 -- 172.21.15.52:0/3360471720 >> 172.21.15.52:0/3360471720 conn(0x7f527c0cb6f0 msgr2=0x7f527c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 -- 172.21.15.52:0/3360471720 shutdown_connections 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.137+0000 7f5280fe2700 1 -- 172.21.15.52:0/3360471720 wait complete. 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 Processor -- start 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 -- start start 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 0x7f527c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 0x7f527c068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1575f0 con 0x7f527c154160 2023-05-10T01:10:07.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1569e0 con 0x7f527c069b80 2023-05-10T01:10:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5280fe2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c156cc0 con 0x7f527c154540 2023-05-10T01:10:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5279d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5279d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58912/0 (socket says 172.21.15.52:58912) 2023-05-10T01:10:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.139+0000 7f5279d9b700 1 -- 172.21.15.52:0/824242139 learned_addr learned my addr 172.21.15.52:0/824242139 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f527ad9d700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 0x7f527c068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f527a59c700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 0x7f527c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 -- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 msgr2=0x7f527c068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 0x7f527c068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 -- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 msgr2=0x7f527c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 0x7f527c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 -- 172.21.15.52:0/824242139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700092a0 con 0x7f527c154160 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f527a59c700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 0x7f527c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f527ad9d700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 0x7f527c068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5279d9b700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f527c083050 tx=0x7f5270017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270011c20 con 0x7f527c154160 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5270011d80 con 0x7f527c154160 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c156fa0 con 0x7f527c154160 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527001b650 con 0x7f527c154160 2023-05-10T01:10:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.140+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c155d10 con 0x7f527c154160 2023-05-10T01:10:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.141+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0666b0 con 0x7f527c154160 2023-05-10T01:10:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.141+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f527000f070 con 0x7f527c154160 2023-05-10T01:10:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.142+0000 7f526a7fc700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 0x7f5258061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.142+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f527007b2c0 con 0x7f527c154160 2023-05-10T01:10:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.142+0000 7f527a59c700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 0x7f5258061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.142+0000 7f527a59c700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 0x7f5258061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f527c0cab70 tx=0x7f5274009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.146+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f527004c860 con 0x7f527c154160 2023-05-10T01:10:07.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.365+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f527c06c340 con 0x7f527c154160 2023-05-10T01:10:07.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.366+0000 7f526a7fc700 1 -- 172.21.15.52:0/824242139 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f527004fe80 con 0x7f527c154160 2023-05-10T01:10:07.370 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:07.370 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:07.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 msgr2=0x7f5258061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 0x7f5258061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f527c0cab70 tx=0x7f5274009040).stop 2023-05-10T01:10:07.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 msgr2=0x7f527c14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f527c083050 tx=0x7f5270017000).stop 2023-05-10T01:10:07.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 shutdown_connections 2023-05-10T01:10:07.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f525805ed90 0x7f5258061250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c154540 0x7f527c068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c069b80 0x7f527c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 --2- 172.21.15.52:0/824242139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f527c154160 0x7f527c14ca40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 >> 172.21.15.52:0/824242139 conn(0x7f527c0cb6f0 msgr2=0x7f527c14db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 shutdown_connections 2023-05-10T01:10:07.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.367+0000 7f5280fe2700 1 -- 172.21.15.52:0/824242139 wait complete. 2023-05-10T01:10:07.375 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:07.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:07.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.495+0000 7ff94f5d0700 1 Processor -- start 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.495+0000 7ff94f5d0700 1 -- start start 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948154160 0x7ff9480c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff948154540 0x7ff9480c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff948069690 0x7ff948069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480c0650 con 0x7ff948069690 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94806a010 con 0x7ff948154540 2023-05-10T01:10:07.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94f5d0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480bfd20 con 0x7ff948154160 2023-05-10T01:10:07.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94db6d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff948069690 0x7ff948069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94db6d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff948069690 0x7ff948069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58920/0 (socket says 172.21.15.52:58920) 2023-05-10T01:10:07.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94db6d700 1 -- 172.21.15.52:0/2894413939 learned_addr learned my addr 172.21.15.52:0/2894413939 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:07.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94cb6b700 1 --2- 172.21.15.52:0/2894413939 >> v2:172.21.15.172:3300/0 conn(0x7ff948154540 0x7ff9480c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.496+0000 7ff94d36c700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948154160 0x7ff9480c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 -- 172.21.15.52:0/2894413939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948154160 msgr2=0x7ff9480c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:07.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948154160 0x7ff9480c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 -- 172.21.15.52:0/2894413939 >> v2:172.21.15.172:3300/0 conn(0x7ff948154540 msgr2=0x7ff9480c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:07.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 --2- 172.21.15.52:0/2894413939 >> v2:172.21.15.172:3300/0 conn(0x7ff948154540 0x7ff9480c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 -- 172.21.15.52:0/2894413939 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480c0000 con 0x7ff948069690 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94db6d700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948069690 0x7ff948069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff948083fd0 tx=0x7ff9380090f0).ready entity=mon.0 client_cookie=524b8389ee24fee7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff947fff700 1 -- 172.21.15.52:0/2894413939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800b600 con 0x7ff948069690 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff947fff700 1 -- 172.21.15.52:0/2894413939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800b760 con 0x7ff948069690 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff947fff700 1 -- 172.21.15.52:0/2894413939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800bb00 con 0x7ff948069690 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 -- 172.21.15.52:0/2894413939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948069690 msgr2=0x7ff948069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948069690 0x7ff948069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff948083fd0 tx=0x7ff9380090f0).stop 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 -- 172.21.15.52:0/2894413939 shutdown_connections 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948069690 0x7ff948069b20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/2894413939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948154160 0x7ff9480c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/2894413939 >> v2:172.21.15.172:3300/0 conn(0x7ff948154540 0x7ff9480c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.497+0000 7ff94f5d0700 1 -- 172.21.15.52:0/2894413939 >> 172.21.15.52:0/2894413939 conn(0x7ff9480cb6f0 msgr2=0x7ff9480c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.498+0000 7ff94f5d0700 1 -- 172.21.15.52:0/2894413939 shutdown_connections 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.498+0000 7ff94f5d0700 1 -- 172.21.15.52:0/2894413939 wait complete. 2023-05-10T01:10:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.499+0000 7ff94f5d0700 1 Processor -- start 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.499+0000 7ff94f5d0700 1 -- start start 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.499+0000 7ff94f5d0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 0x7ff948153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.499+0000 7ff94f5d0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 0x7ff94813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814fe60 con 0x7ff948154160 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480aea90 con 0x7ff948154540 2023-05-10T01:10:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814f5c0 con 0x7ff948069690 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58926/0 (socket says 172.21.15.52:58926) 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 -- 172.21.15.52:0/3076656038 learned_addr learned my addr 172.21.15.52:0/3076656038 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94db6d700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 0x7ff94813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94d36c700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 0x7ff948153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 -- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 msgr2=0x7ff948153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 0x7ff948153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 -- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 msgr2=0x7ff94813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 0x7ff94813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 -- 172.21.15.52:0/3076656038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009370 con 0x7ff948154160 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94d36c700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 0x7ff948153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94db6d700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 0x7ff94813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94cb6b700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff948154920 tx=0x7ff93c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00f520 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00f680 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94814f8a0 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00fa00 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.500+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94814f220 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.501+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480666b0 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.501+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff93c01a030 con 0x7ff948154160 2023-05-10T01:10:07.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.502+0000 7ff9457fa700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 0x7ff928061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.502+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff93c079490 con 0x7ff948154160 2023-05-10T01:10:07.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.502+0000 7ff94d36c700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 0x7ff928061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.502+0000 7ff94d36c700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 0x7ff928061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff940007540 tx=0x7ff94000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.506+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff93c04aa30 con 0x7ff948154160 2023-05-10T01:10:07.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.679+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9480ae860 con 0x7ff948154160 2023-05-10T01:10:07.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.680+0000 7ff9457fa700 1 -- 172.21.15.52:0/3076656038 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7ff93c04e050 con 0x7ff948154160 2023-05-10T01:10:07.684 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:07.685 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:07.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 msgr2=0x7ff928061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 0x7ff928061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff940007540 tx=0x7ff94000b040).stop 2023-05-10T01:10:07.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 msgr2=0x7ff94814ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff948154920 tx=0x7ff93c008040).stop 2023-05-10T01:10:07.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 shutdown_connections 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff92805ed90 0x7ff928061250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff948154540 0x7ff94813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff948069690 0x7ff948153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 --2- 172.21.15.52:0/3076656038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff948154160 0x7ff94814ed30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 >> 172.21.15.52:0/3076656038 conn(0x7ff9480cb6f0 msgr2=0x7ff948068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 shutdown_connections 2023-05-10T01:10:07.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.682+0000 7ff94f5d0700 1 -- 172.21.15.52:0/3076656038 wait complete. 2023-05-10T01:10:07.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:07.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.816+0000 7f27ded22700 1 Processor -- start 2023-05-10T01:10:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.816+0000 7f27ded22700 1 -- start start 2023-05-10T01:10:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27ded22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27d8154460 0x7f27d80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27ded22700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 0x7f27d80685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27ded22700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80c94c0 con 0x7f27d8154080 2023-05-10T01:10:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27ded22700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d80cb7d0 con 0x7f27d8154460 2023-05-10T01:10:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27ded22700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8068a90 con 0x7f27d8068150 2023-05-10T01:10:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27d7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27d8154460 0x7f27d80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27dcabe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f27d8154080 0x7f27d80a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39716/0 (socket says 172.21.15.52:39716) 2023-05-10T01:10:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27dcabe700 1 -- 172.21.15.52:0/3196032319 learned_addr learned my addr 172.21.15.52:0/3196032319 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:07.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27dd2bf700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 0x7f27d80685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27d7fff700 1 -- 172.21.15.52:0/3196032319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 msgr2=0x7f27d80685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:07.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27d7fff700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 0x7f27d80685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.817+0000 7f27d77fe700 1 -- 172.21.15.52:0/3196032319 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926743294 0 0) 0x7f27d80c94c0 con 0x7f27d8154080 2023-05-10T01:10:07.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d7fff700 1 -- 172.21.15.52:0/3196032319 >> v1:172.21.15.52:6789/0 conn(0x7f27d8154080 legacy=0x7f27d80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d7fff700 1 -- 172.21.15.52:0/3196032319 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80c88b0 con 0x7f27d8154460 2023-05-10T01:10:07.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27dd2bf700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 0x7f27d80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:07.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d7fff700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8154460 0x7f27d80aac90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27cc009760 tx=0x7f27cc009060).ready entity=mon.0 client_cookie=ad98d9cfe5a72562 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d77fe700 1 -- 172.21.15.52:0/3196032319 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00b580 con 0x7f27d8154460 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d77fe700 1 -- 172.21.15.52:0/3196032319 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc00b6e0 con 0x7f27d8154460 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27d77fe700 1 -- 172.21.15.52:0/3196032319 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00ba60 con 0x7f27d8154460 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 -- 172.21.15.52:0/3196032319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8154460 msgr2=0x7f27d80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8154460 0x7f27d80aac90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f27cc009760 tx=0x7f27cc009060).stop 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 -- 172.21.15.52:0/3196032319 shutdown_connections 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8068150 0x7f27d80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 --2- 172.21.15.52:0/3196032319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8154460 0x7f27d80aac90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 -- 172.21.15.52:0/3196032319 >> 172.21.15.52:0/3196032319 conn(0x7f27d8067910 msgr2=0x7f27d80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 -- 172.21.15.52:0/3196032319 shutdown_connections 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.818+0000 7f27ded22700 1 -- 172.21.15.52:0/3196032319 wait complete. 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.819+0000 7f27ded22700 1 Processor -- start 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 -- start start 2023-05-10T01:10:07.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8154080 0x7f27d814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8167bc0 0x7f27d80c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d814d630 con 0x7f27d8068150 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8168b90 con 0x7f27d8154080 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27ded22700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8156740 con 0x7f27d8167bc0 2023-05-10T01:10:07.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27dcabe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27dcabe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58938/0 (socket says 172.21.15.52:58938) 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.820+0000 7f27dcabe700 1 -- 172.21.15.52:0/3886203208 learned_addr learned my addr 172.21.15.52:0/3886203208 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 -- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8167bc0 msgr2=0x7f27d80c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8167bc0 0x7f27d80c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 -- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8154080 msgr2=0x7f27d814d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8154080 0x7f27d814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 -- 172.21.15.52:0/3886203208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0092a0 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27dcabe700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27d000c810 tx=0x7f27d0001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005d30 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0005e90 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d8151e40 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0007320 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.821+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d81682f0 con 0x7f27d8068150 2023-05-10T01:10:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.822+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d8151c10 con 0x7f27d8068150 2023-05-10T01:10:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.822+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f27d0010030 con 0x7f27d8068150 2023-05-10T01:10:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.823+0000 7f27d4ff9700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.823+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f27d0079aa0 con 0x7f27d8068150 2023-05-10T01:10:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.823+0000 7f27d7fff700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.823+0000 7f27d7fff700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 0x7f27b8061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f27d8067e20 tx=0x7f27cc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:07.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:07.827+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27d8151c10 con 0x7f27d8068150 2023-05-10T01:10:08.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.000+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f27d8151c10 con 0x7f27d8068150 2023-05-10T01:10:08.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.001+0000 7f27d4ff9700 1 -- 172.21.15.52:0/3886203208 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f27d8151c10 con 0x7f27d8068150 2023-05-10T01:10:08.006 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:08.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 msgr2=0x7f27b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 0x7f27b8061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f27d8067e20 tx=0x7f27cc017000).stop 2023-05-10T01:10:08.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 msgr2=0x7f27d8156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f27d000c810 tx=0x7f27d0001570).stop 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 shutdown_connections 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f27b805ed90 0x7f27b8061250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d8167bc0 0x7f27d80c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27d8068150 0x7f27d8156250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 --2- 172.21.15.52:0/3886203208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8154080 0x7f27d814d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 >> 172.21.15.52:0/3886203208 conn(0x7f27d8067910 msgr2=0x7f27d80afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 shutdown_connections 2023-05-10T01:10:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.003+0000 7f27ded22700 1 -- 172.21.15.52:0/3886203208 wait complete. 2023-05-10T01:10:08.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.134+0000 7f5917564700 1 Processor -- start 2023-05-10T01:10:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.134+0000 7f5917564700 1 -- start start 2023-05-10T01:10:08.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5917564700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5917564700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5910068150 0x7f59100685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5917564700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59100c94c0 con 0x7f5910154080 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5917564700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100cb7d0 con 0x7f5910068150 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5917564700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5910068ab0 con 0x7f5910154460 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5914aff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5915b01700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5910068150 0x7f59100685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5914aff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50352/0 (socket says 172.21.15.52:50352) 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.135+0000 7f5914aff700 1 -- 172.21.15.52:0/757673760 learned_addr learned my addr 172.21.15.52:0/757673760 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5915b01700 1 -- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 msgr2=0x7f59100aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5915b01700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5915b01700 1 -- 172.21.15.52:0/757673760 >> v1:172.21.15.172:6789/0 conn(0x7f5910154080 legacy=0x7f59100a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f58fffff700 1 -- 172.21.15.52:0/757673760 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896867217 0 0) 0x7f59100c94c0 con 0x7f5910154080 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5915b01700 1 -- 172.21.15.52:0/757673760 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100c88b0 con 0x7f5910068150 2023-05-10T01:10:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5914aff700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f5915b01700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910068150 0x7f59100685c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f590c009e60 tx=0x7f590c009780).ready entity=mon.1 client_cookie=3346fb6b252d25d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f58fffff700 1 -- 172.21.15.52:0/757673760 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c00e070 con 0x7f5910068150 2023-05-10T01:10:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f58fffff700 1 -- 172.21.15.52:0/757673760 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c00bb60 con 0x7f5910068150 2023-05-10T01:10:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.136+0000 7f58fffff700 1 -- 172.21.15.52:0/757673760 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c012410 con 0x7f5910068150 2023-05-10T01:10:08.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 -- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910068150 msgr2=0x7f59100685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910068150 0x7f59100685c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f590c009e60 tx=0x7f590c009780).stop 2023-05-10T01:10:08.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 -- 172.21.15.52:0/757673760 shutdown_connections 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910068150 0x7f59100685c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 --2- 172.21.15.52:0/757673760 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154460 0x7f59100aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 -- 172.21.15.52:0/757673760 >> 172.21.15.52:0/757673760 conn(0x7f5910067910 msgr2=0x7f59100cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 -- 172.21.15.52:0/757673760 shutdown_connections 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.137+0000 7f5917564700 1 -- 172.21.15.52:0/757673760 wait complete. 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.138+0000 7f5917564700 1 Processor -- start 2023-05-10T01:10:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.138+0000 7f5917564700 1 -- start start 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 0x7f5910154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910154460 0x7f5910154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5910152cb0 con 0x7f5910068150 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100aebb0 con 0x7f5910154460 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100ae530 con 0x7f5910154080 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58950/0 (socket says 172.21.15.52:58950) 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 -- 172.21.15.52:0/3537374900 learned_addr learned my addr 172.21.15.52:0/3537374900 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5914aff700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 0x7f5910154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915b01700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910154460 0x7f5910154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 -- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 msgr2=0x7f5910154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 0x7f5910154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 -- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910154460 msgr2=0x7f5910154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910154460 0x7f5910154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 -- 172.21.15.52:0/3537374900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009370 con 0x7f5910068150 2023-05-10T01:10:08.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5914aff700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 0x7f5910154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:08.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5915300700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5908001eb0 tx=0x7f5908007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800f470 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590800f5f0 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c009a20 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.139+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590800f9b0 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.140+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59101526f0 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.140+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59100aee90 con 0x7f5910068150 2023-05-10T01:10:08.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.141+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5908019030 con 0x7f5910068150 2023-05-10T01:10:08.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.141+0000 7f58fd7fa700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 0x7f58f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.141+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5908079070 con 0x7f5910068150 2023-05-10T01:10:08.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.141+0000 7f5914aff700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 0x7f58f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.142+0000 7f5914aff700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 0x7f58f0061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5900006fd0 tx=0x7f5900008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.145+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f590804a610 con 0x7f5910068150 2023-05-10T01:10:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.316+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f591006c340 con 0x7f5910068150 2023-05-10T01:10:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.316+0000 7f58fd7fa700 1 -- 172.21.15.52:0/3537374900 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f590804dc30 con 0x7f5910068150 2023-05-10T01:10:08.320 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 msgr2=0x7f58f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 0x7f58f0061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5900006fd0 tx=0x7f5900008040).stop 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 msgr2=0x7f591014faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5908001eb0 tx=0x7f5908007c70).stop 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 shutdown_connections 2023-05-10T01:10:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f58f005ed90 0x7f58f0061250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5910154460 0x7f5910154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5910068150 0x7f591014faf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 --2- 172.21.15.52:0/3537374900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5910154080 0x7f5910154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 >> 172.21.15.52:0/3537374900 conn(0x7f5910067910 msgr2=0x7f59100c1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 shutdown_connections 2023-05-10T01:10:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.318+0000 7f5917564700 1 -- 172.21.15.52:0/3537374900 wait complete. 2023-05-10T01:10:08.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:08.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.449+0000 7f57f83c8700 1 Processor -- start 2023-05-10T01:10:08.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.449+0000 7f57f83c8700 1 -- start start 2023-05-10T01:10:08.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.450+0000 7f57f83c8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.450+0000 7f57f83c8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57f00622a0 0x7f57f0062730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.450+0000 7f57f83c8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00642a0 con 0x7f57f01383a0 2023-05-10T01:10:08.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.450+0000 7f57f83c8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f00bf940 con 0x7f57f00622a0 2023-05-10T01:10:08.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.450+0000 7f57f83c8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0062c20 con 0x7f57f0138780 2023-05-10T01:10:08.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5963700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57f00622a0 0x7f57f0062730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5963700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50364/0 (socket says 172.21.15.52:50364) 2023-05-10T01:10:08.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5963700 1 -- 172.21.15.52:0/2444870275 learned_addr learned my addr 172.21.15.52:0/2444870275 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:08.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 -- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 msgr2=0x7f57f0156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:08.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 -- 172.21.15.52:0/2444870275 >> v1:172.21.15.172:6789/0 conn(0x7f57f01383a0 legacy=0x7f57f00bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 -- 172.21.15.52:0/2444870275 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f0063690 con 0x7f57f00622a0 2023-05-10T01:10:08.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5162700 1 -- 172.21.15.52:0/2444870275 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240460325 0 0) 0x7f57f00642a0 con 0x7f57f01383a0 2023-05-10T01:10:08.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5963700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:08.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f6965700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f0062730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f57e8009e60 tx=0x7f57e8009780).ready entity=mon.1 client_cookie=bd725b8847e81e79 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.451+0000 7f57f5162700 1 -- 172.21.15.52:0/2444870275 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800e070 con 0x7f57f00622a0 2023-05-10T01:10:08.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f5162700 1 -- 172.21.15.52:0/2444870275 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e800bb60 con 0x7f57f00622a0 2023-05-10T01:10:08.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f5162700 1 -- 172.21.15.52:0/2444870275 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8012410 con 0x7f57f00622a0 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 -- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 msgr2=0x7f57f0062730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f0062730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f57e8009e60 tx=0x7f57e8009780).stop 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 -- 172.21.15.52:0/2444870275 shutdown_connections 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f0062730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 --2- 172.21.15.52:0/2444870275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f0138780 0x7f57f0156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 -- 172.21.15.52:0/2444870275 >> 172.21.15.52:0/2444870275 conn(0x7f57f005e810 msgr2=0x7f57f00c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 -- 172.21.15.52:0/2444870275 shutdown_connections 2023-05-10T01:10:08.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.452+0000 7f57f83c8700 1 -- 172.21.15.52:0/2444870275 wait complete. 2023-05-10T01:10:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.453+0000 7f57f83c8700 1 Processor -- start 2023-05-10T01:10:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.453+0000 7f57f83c8700 1 -- start start 2023-05-10T01:10:08.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f00aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f01383a0 0x7f57f014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00ac400 con 0x7f57f0138780 2023-05-10T01:10:08.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0069700 con 0x7f57f00622a0 2023-05-10T01:10:08.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f83c8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00ab440 con 0x7f57f01383a0 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58968/0 (socket says 172.21.15.52:58968) 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 -- 172.21.15.52:0/1191372272 learned_addr learned my addr 172.21.15.52:0/1191372272 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f5963700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f01383a0 0x7f57f014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6164700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f00aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 -- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f01383a0 msgr2=0x7f57f014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f01383a0 0x7f57f014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 -- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 msgr2=0x7f57f00aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f00aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6965700 1 -- 172.21.15.52:0/1191372272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0009370 con 0x7f57f0138780 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.454+0000 7f57f6164700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f00aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57f6965700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f57f0065e10 tx=0x7f57e8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8021070 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e801d630 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e8009a20 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8012410 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.455+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f00ac5e0 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.456+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f00bdfb0 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.456+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f57e801dc80 con 0x7f57f0138780 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.456+0000 7f57de7fc700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 0x7f57d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.457+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57e807bd10 con 0x7f57f0138780 2023-05-10T01:10:08.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.457+0000 7f57f6164700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 0x7f57d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.457+0000 7f57f6164700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 0x7f57d0061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f57ec007fd0 tx=0x7f57ec009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.461+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57e8050ce0 con 0x7f57f0138780 2023-05-10T01:10:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.635+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57f006c340 con 0x7f57f0138780 2023-05-10T01:10:08.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.635+0000 7f57de7fc700 1 -- 172.21.15.52:0/1191372272 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57e80508d0 con 0x7f57f0138780 2023-05-10T01:10:08.639 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:08.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 msgr2=0x7f57d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 0x7f57d0061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f57ec007fd0 tx=0x7f57ec009040).stop 2023-05-10T01:10:08.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 msgr2=0x7f57f00bff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f57f0065e10 tx=0x7f57e8009780).stop 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 shutdown_connections 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f57d005ed90 0x7f57d0061250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0138780 0x7f57f00bff40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f00622a0 0x7f57f00aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 --2- 172.21.15.52:0/1191372272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57f01383a0 0x7f57f014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 >> 172.21.15.52:0/1191372272 conn(0x7f57f005e810 msgr2=0x7f57f00c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 shutdown_connections 2023-05-10T01:10:08.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.637+0000 7f57f83c8700 1 -- 172.21.15.52:0/1191372272 wait complete. 2023-05-10T01:10:08.652 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.768+0000 7fac33b6b700 1 Processor -- start 2023-05-10T01:10:08.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 -- start start 2023-05-10T01:10:08.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac2c154080 0x7fac2c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 0x7fac2c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0c94c0 con 0x7fac2c154460 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0cb7d0 con 0x7fac2c154080 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.769+0000 7fac33b6b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c068a90 con 0x7fac2c068150 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac2c154080 0x7fac2c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31106700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fac2c154460 0x7fac2c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39758/0 (socket says 172.21.15.52:39758) 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31106700 1 -- 172.21.15.52:0/2649193411 learned_addr learned my addr 172.21.15.52:0/2649193411 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:08.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac32108700 1 --2- 172.21.15.52:0/2649193411 >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 0x7fac2c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 -- 172.21.15.52:0/2649193411 >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 msgr2=0x7fac2c0685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:08.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 --2- 172.21.15.52:0/2649193411 >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 0x7fac2c0685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 -- 172.21.15.52:0/2649193411 >> v1:172.21.15.52:6789/0 conn(0x7fac2c154460 legacy=0x7fac2c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac30905700 1 -- 172.21.15.52:0/2649193411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126142142 0 0) 0x7fac2c0c94c0 con 0x7fac2c154460 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 -- 172.21.15.52:0/2649193411 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0c88b0 con 0x7fac2c154080 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac32108700 1 --2- 172.21.15.52:0/2649193411 >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 0x7fac2c0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac31907700 1 --2- 172.21.15.52:0/2649193411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154080 0x7fac2c0aac90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fac2c05f9d0 tx=0x7fac24009060).ready entity=mon.0 client_cookie=31017c22ecf480af server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac30905700 1 -- 172.21.15.52:0/2649193411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400b580 con 0x7fac2c154080 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac30905700 1 -- 172.21.15.52:0/2649193411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400b6e0 con 0x7fac2c154080 2023-05-10T01:10:08.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.770+0000 7fac30905700 1 -- 172.21.15.52:0/2649193411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400ba60 con 0x7fac2c154080 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 -- 172.21.15.52:0/2649193411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154080 msgr2=0x7fac2c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 --2- 172.21.15.52:0/2649193411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154080 0x7fac2c0aac90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fac2c05f9d0 tx=0x7fac24009060).stop 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 -- 172.21.15.52:0/2649193411 shutdown_connections 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 --2- 172.21.15.52:0/2649193411 >> v2:172.21.15.172:3300/0 conn(0x7fac2c068150 0x7fac2c0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 --2- 172.21.15.52:0/2649193411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154080 0x7fac2c0aac90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 -- 172.21.15.52:0/2649193411 >> 172.21.15.52:0/2649193411 conn(0x7fac2c067910 msgr2=0x7fac2c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 -- 172.21.15.52:0/2649193411 shutdown_connections 2023-05-10T01:10:08.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.771+0000 7fac33b6b700 1 -- 172.21.15.52:0/2649193411 wait complete. 2023-05-10T01:10:08.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.772+0000 7fac33b6b700 1 Processor -- start 2023-05-10T01:10:08.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.772+0000 7fac33b6b700 1 -- start start 2023-05-10T01:10:08.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac2c068150 0x7fac2c164250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac2c154080 0x7fac2c0bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c0560 con 0x7fac2c154460 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c164740 con 0x7fac2c068150 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1651f0 con 0x7fac2c154080 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58982/0 (socket says 172.21.15.52:58982) 2023-05-10T01:10:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 -- 172.21.15.52:0/782550429 learned_addr learned my addr 172.21.15.52:0/782550429 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac31907700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac2c068150 0x7fac2c164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac31106700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac2c154080 0x7fac2c0bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 -- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac2c154080 msgr2=0x7fac2c0bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac2c154080 0x7fac2c0bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 -- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac2c068150 msgr2=0x7fac2c164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac2c068150 0x7fac2c164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 -- 172.21.15.52:0/782550429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240092a0 con 0x7fac2c154460 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac32108700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac1c00a380 tx=0x7fac1c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c016470 con 0x7fac2c154460 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0165d0 con 0x7fac2c154460 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c1655e0 con 0x7fac2c154460 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.773+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c016950 con 0x7fac2c154460 2023-05-10T01:10:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.774+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c164950 con 0x7fac2c154460 2023-05-10T01:10:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.774+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c066720 con 0x7fac2c154460 2023-05-10T01:10:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.775+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fac1c00d440 con 0x7fac2c154460 2023-05-10T01:10:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.775+0000 7fac29ffb700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 0x7fac0c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.775+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fac1c07ad70 con 0x7fac2c154460 2023-05-10T01:10:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.775+0000 7fac31907700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 0x7fac0c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.776+0000 7fac31907700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 0x7fac0c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fac24009fd0 tx=0x7fac24017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.779+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac1c04c2b0 con 0x7fac2c154460 2023-05-10T01:10:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.955+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac2c165770 con 0x7fac2c154460 2023-05-10T01:10:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.955+0000 7fac29ffb700 1 -- 172.21.15.52:0/782550429 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac1c04f8d0 con 0x7fac2c154460 2023-05-10T01:10:08.959 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 msgr2=0x7fac0c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 0x7fac0c061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fac24009fd0 tx=0x7fac24017000).stop 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 msgr2=0x7fac2c0c0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac1c00a380 tx=0x7fac1c007900).stop 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 shutdown_connections 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fac0c05ed90 0x7fac0c061250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac2c154460 0x7fac2c0c0070 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac2c068150 0x7fac2c164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 --2- 172.21.15.52:0/782550429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac2c154080 0x7fac2c0bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 >> 172.21.15.52:0/782550429 conn(0x7fac2c067910 msgr2=0x7fac2c0ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 shutdown_connections 2023-05-10T01:10:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:08.957+0000 7fac33b6b700 1 -- 172.21.15.52:0/782550429 wait complete. 2023-05-10T01:10:08.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:09.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.085+0000 7f9695ea4700 1 Processor -- start 2023-05-10T01:10:09.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.085+0000 7f9695ea4700 1 -- start start 2023-05-10T01:10:09.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f9695ea4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9690153d90 0x7f9690069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f9695ea4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9690154170 0x7f9690063710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f9695ea4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9690062b00 con 0x7f9690062f90 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f9695ea4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9690068610 con 0x7f9690154170 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f9695ea4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900622a0 con 0x7f9690153d90 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f968effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9690154170 0x7f9690063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f968effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9690154170 0x7f9690063710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58988/0 (socket says 172.21.15.52:58988) 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f968effd700 1 -- 172.21.15.52:0/2770721321 learned_addr learned my addr 172.21.15.52:0/2770721321 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:09.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.086+0000 7f968f7fe700 1 --2- 172.21.15.52:0/2770721321 >> v2:172.21.15.172:3300/0 conn(0x7f9690153d90 0x7f9690069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968effd700 1 -- 172.21.15.52:0/2770721321 >> v2:172.21.15.172:3300/0 conn(0x7f9690153d90 msgr2=0x7f9690069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968effd700 1 --2- 172.21.15.52:0/2770721321 >> v2:172.21.15.172:3300/0 conn(0x7f9690153d90 0x7f9690069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968effd700 1 -- 172.21.15.52:0/2770721321 >> v1:172.21.15.172:6789/0 conn(0x7f9690062f90 legacy=0x7f96900bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968effd700 1 -- 172.21.15.52:0/2770721321 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690068330 con 0x7f9690154170 2023-05-10T01:10:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968effd700 1 --2- 172.21.15.52:0/2770721321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f9690063710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9690067ad0 tx=0x7f96840090f0).ready entity=mon.0 client_cookie=7f69c944f69447e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968e7fc700 1 -- 172.21.15.52:0/2770721321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400b520 con 0x7f9690154170 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968e7fc700 1 -- 172.21.15.52:0/2770721321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400b680 con 0x7f9690154170 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f968e7fc700 1 -- 172.21.15.52:0/2770721321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400ba00 con 0x7f9690154170 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 -- 172.21.15.52:0/2770721321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 msgr2=0x7f9690063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 --2- 172.21.15.52:0/2770721321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f9690063710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9690067ad0 tx=0x7f96840090f0).stop 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 -- 172.21.15.52:0/2770721321 shutdown_connections 2023-05-10T01:10:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 --2- 172.21.15.52:0/2770721321 >> v2:172.21.15.172:3300/0 conn(0x7f9690153d90 0x7f9690069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 --2- 172.21.15.52:0/2770721321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f9690063710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 -- 172.21.15.52:0/2770721321 >> 172.21.15.52:0/2770721321 conn(0x7f96900c8a90 msgr2=0x7f96900c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 -- 172.21.15.52:0/2770721321 shutdown_connections 2023-05-10T01:10:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.087+0000 7f9695ea4700 1 -- 172.21.15.52:0/2770721321 wait complete. 2023-05-10T01:10:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 Processor -- start 2023-05-10T01:10:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 -- start start 2023-05-10T01:10:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690062f90 0x7f96900aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690153d90 0x7f9690153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c6c10 con 0x7f9690154170 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c7790 con 0x7f9690062f90 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.089+0000 7f9695ea4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c6860 con 0x7f9690153d90 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58992/0 (socket says 172.21.15.52:58992) 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 -- 172.21.15.52:0/1430757206 learned_addr learned my addr 172.21.15.52:0/1430757206 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968f7fe700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690062f90 0x7f96900aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968effd700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690153d90 0x7f9690153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 -- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690153d90 msgr2=0x7f9690153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690153d90 0x7f9690153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 -- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690062f90 msgr2=0x7f96900aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690062f90 0x7f96900aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 -- 172.21.15.52:0/1430757206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009370 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f968ffff700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f9688002230 tx=0x7f96880015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800e4a0 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800e600 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900c6e60 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800e980 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.090+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96900c7420 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.091+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96900c7900 con 0x7f9690154170 2023-05-10T01:10:09.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.091+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9688019030 con 0x7f9690154170 2023-05-10T01:10:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.092+0000 7f96777fe700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 0x7f9670061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.092+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f96880790b0 con 0x7f9690154170 2023-05-10T01:10:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.092+0000 7f968f7fe700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 0x7f9670061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.092+0000 7f968f7fe700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 0x7f9670061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9680009c30 tx=0x7f9680009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.096+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96880488f0 con 0x7f9690154170 2023-05-10T01:10:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.313+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f969006c340 con 0x7f9690154170 2023-05-10T01:10:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.313+0000 7f96777fe700 1 -- 172.21.15.52:0/1430757206 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f968804a700 con 0x7f9690154170 2023-05-10T01:10:09.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:09.317 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 msgr2=0x7f9670061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 0x7f9670061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9680009c30 tx=0x7f9680009060).stop 2023-05-10T01:10:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 msgr2=0x7f96900c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f9688002230 tx=0x7f96880015e0).stop 2023-05-10T01:10:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 shutdown_connections 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f967005ed90 0x7f9670061250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9690154170 0x7f96900c6370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690062f90 0x7f96900aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 --2- 172.21.15.52:0/1430757206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690153d90 0x7f9690153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 >> 172.21.15.52:0/1430757206 conn(0x7f96900c8a90 msgr2=0x7f96900c3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 shutdown_connections 2023-05-10T01:10:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.315+0000 7f9695ea4700 1 -- 172.21.15.52:0/1430757206 wait complete. 2023-05-10T01:10:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:09.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:09.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.445+0000 7fc6edfdc700 1 Processor -- start 2023-05-10T01:10:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.445+0000 7fc6edfdc700 1 -- start start 2023-05-10T01:10:09.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6edfdc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6e8069da0 0x7fc6e815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6edfdc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80c0650 con 0x7fc6e8154540 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6edfdc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80c1af0 con 0x7fc6e8154160 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6edfdc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80bfd20 con 0x7fc6e8069da0 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6dffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc6e8154540 0x7fc6e8069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39784/0 (socket says 172.21.15.52:39784) 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6dffff700 1 -- 172.21.15.52:0/131941922 learned_addr learned my addr 172.21.15.52:0/131941922 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e7fff700 1 --2- 172.21.15.52:0/131941922 >> v2:172.21.15.172:3300/0 conn(0x7fc6e8069da0 0x7fc6e815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663253818 0 0) 0x7fc6e80c0650 con 0x7fc6e8154540 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c80033f0 con 0x7fc6e8154540 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068054960 0 0) 0x7fc6c80033f0 con 0x7fc6e8154540 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 >> v2:172.21.15.172:3300/0 conn(0x7fc6e8069da0 msgr2=0x7fc6e815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 --2- 172.21.15.52:0/131941922 >> v2:172.21.15.172:3300/0 conn(0x7fc6e8069da0 0x7fc6e815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 >> v1:172.21.15.172:6789/0 conn(0x7fc6e8154160 legacy=0x7fc6e80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.446+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80c0000 con 0x7fc6e8154540 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fc6d0001470 con 0x7fc6e8154540 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 >> v1:172.21.15.52:6789/0 conn(0x7fc6e8154540 legacy=0x7fc6e8069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 0x7fc6c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c8004690 0x7fc6c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6c8005050 0x7fc6c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80bfd20 con 0x7fc6c80038e0 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c800bfe0 con 0x7fc6c8004690 2023-05-10T01:10:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c800c1a0 con 0x7fc6c8005050 2023-05-10T01:10:09.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 0x7fc6c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6dffff700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c8004690 0x7fc6c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e7fff700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6c8005050 0x7fc6c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 -- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6c8005050 msgr2=0x7fc6c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6c8005050 0x7fc6c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 -- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c8004690 msgr2=0x7fc6c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c8004690 0x7fc6c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e7fff700 1 -- 172.21.15.52:0/131941922 reap_dead start 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 -- 172.21.15.52:0/131941922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80033f0 con 0x7fc6c80038e0 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6dffff700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c8004690 0x7fc6c8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 0x7fc6c8003d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc6d8001700 tx=0x7fc6d8007bb0).ready entity=mon.0 client_cookie=63e3a5c7dda4b0df server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007020 con 0x7fc6c80038e0 2023-05-10T01:10:09.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8007180 con 0x7fc6c80038e0 2023-05-10T01:10:09.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.447+0000 7fc6e6ffd700 1 -- 172.21.15.52:0/131941922 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007520 con 0x7fc6c80038e0 2023-05-10T01:10:09.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 -- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 msgr2=0x7fc6c8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 0x7fc6c8003d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc6d8001700 tx=0x7fc6d8007bb0).stop 2023-05-10T01:10:09.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 -- 172.21.15.52:0/131941922 shutdown_connections 2023-05-10T01:10:09.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/131941922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c80038e0 0x7fc6c8003d00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 -- 172.21.15.52:0/131941922 >> 172.21.15.52:0/131941922 conn(0x7fc6e80cb6f0 msgr2=0x7fc6e80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 -- 172.21.15.52:0/131941922 shutdown_connections 2023-05-10T01:10:09.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.448+0000 7fc6edfdc700 1 -- 172.21.15.52:0/131941922 wait complete. 2023-05-10T01:10:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.449+0000 7fc6edfdc700 1 Processor -- start 2023-05-10T01:10:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.449+0000 7fc6edfdc700 1 -- start start 2023-05-10T01:10:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 0x7fc6e8141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6e8164860 0x7fc6e8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81537b0 con 0x7fc6e81531e0 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80c3b90 con 0x7fc6c80038e0 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80c3260 con 0x7fc6e8164860 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59014/0 (socket says 172.21.15.52:59014) 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 -- 172.21.15.52:0/3615061187 learned_addr learned my addr 172.21.15.52:0/3615061187 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 0x7fc6e8141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 -- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6e8164860 msgr2=0x7fc6e8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6e8164860 0x7fc6e8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 -- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 msgr2=0x7fc6e8141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 0x7fc6e8141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 -- 172.21.15.52:0/3615061187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80c3540 con 0x7fc6e81531e0 2023-05-10T01:10:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 0x7fc6e8141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6e7fff700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc6e8083a90 tx=0x7fc6e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000e070 con 0x7fc6e81531e0 2023-05-10T01:10:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0011bd0 con 0x7fc6e81531e0 2023-05-10T01:10:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0016450 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e80c3820 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.450+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e8141d70 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.451+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e80666b0 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.452+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc6e001d030 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.452+0000 7fc6df7fe700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 0x7fc6cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.452+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc6e0079e20 con 0x7fc6e81531e0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.452+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 0x7fc6cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.453+0000 7fc6e77fe700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 0x7fc6cc061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc6d8000fd0 tx=0x7fc6d8016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.456+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6e004b470 con 0x7fc6e81531e0 2023-05-10T01:10:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.627+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6e80c3d20 con 0x7fc6e81531e0 2023-05-10T01:10:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.628+0000 7fc6df7fe700 1 -- 172.21.15.52:0/3615061187 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fc6e004ea90 con 0x7fc6e81531e0 2023-05-10T01:10:09.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:09.632 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 msgr2=0x7fc6cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 0x7fc6cc061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc6d8000fd0 tx=0x7fc6d8016000).stop 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 msgr2=0x7fc6e8150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc6e8083a90 tx=0x7fc6e000b040).stop 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 shutdown_connections 2023-05-10T01:10:09.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc6cc05ed90 0x7fc6cc061250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6e81531e0 0x7fc6e8150300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80038e0 0x7fc6e8141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 --2- 172.21.15.52:0/3615061187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6e8164860 0x7fc6e8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 >> 172.21.15.52:0/3615061187 conn(0x7fc6e80cb6f0 msgr2=0x7fc6e80ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 shutdown_connections 2023-05-10T01:10:09.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.630+0000 7fc6edfdc700 1 -- 172.21.15.52:0/3615061187 wait complete. 2023-05-10T01:10:09.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.758+0000 7f8461ad5700 1 Processor -- start 2023-05-10T01:10:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.758+0000 7f8461ad5700 1 -- start start 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f8461ad5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f845c069da0 0x7f845c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f8461ad5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0c0650 con 0x7f845c154160 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f8461ad5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0c1af0 con 0x7f845c154540 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f8461ad5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0bfd20 con 0x7f845c069da0 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f845b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f845c154160 0x7f845c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39802/0 (socket says 172.21.15.52:39802) 2023-05-10T01:10:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f845b7fe700 1 -- 172.21.15.52:0/3196440754 learned_addr learned my addr 172.21.15.52:0/3196440754 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f845bfff700 1 --2- 172.21.15.52:0/3196440754 >> v2:172.21.15.172:3300/0 conn(0x7f845c069da0 0x7f845c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480033372 0 0) 0x7f845c0c0650 con 0x7f845c154160 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.759+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84480033f0 con 0x7f845c154160 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379100949 0 0) 0x7f845c0c1af0 con 0x7f845c154540 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845c0c0650 con 0x7f845c154540 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140247161 0 0) 0x7f84480033f0 con 0x7f845c154160 2023-05-10T01:10:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 >> v2:172.21.15.172:3300/0 conn(0x7f845c069da0 msgr2=0x7f845c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 --2- 172.21.15.52:0/3196440754 >> v2:172.21.15.172:3300/0 conn(0x7f845c069da0 0x7f845c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 >> v1:172.21.15.172:6789/0 conn(0x7f845c154540 legacy=0x7f845c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0c0000 con 0x7f845c154160 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f844c001470 con 0x7f845c154160 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 >> v1:172.21.15.52:6789/0 conn(0x7f845c154160 legacy=0x7f845c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 0x7f8448003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448004690 0x7f8448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8448005050 0x7f844800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0bfd20 con 0x7f8448003a70 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844800bfc0 con 0x7f8448004690 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844800c180 con 0x7f8448005050 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 0x7f8448003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845affd700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448004690 0x7f8448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845bfff700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8448005050 0x7f844800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 -- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8448005050 msgr2=0x7f844800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8448005050 0x7f844800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 -- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448004690 msgr2=0x7f8448004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448004690 0x7f8448004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 -- 172.21.15.52:0/3196440754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480033f0 con 0x7f8448003a70 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845bfff700 1 -- 172.21.15.52:0/3196440754 reap_dead start 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845b7fe700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 0x7f8448003e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f844c00c110 tx=0x7f844c001e10).ready entity=mon.0 client_cookie=87ac959488709123 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.760+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00ca40 con 0x7f8448003a70 2023-05-10T01:10:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00cba0 con 0x7f8448003a70 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f845a7fc700 1 -- 172.21.15.52:0/3196440754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0070d0 con 0x7f8448003a70 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 -- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 msgr2=0x7f8448003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 0x7f8448003e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f844c00c110 tx=0x7f844c001e10).stop 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 -- 172.21.15.52:0/3196440754 shutdown_connections 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 --2- 172.21.15.52:0/3196440754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8448003a70 0x7f8448003e70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 -- 172.21.15.52:0/3196440754 >> 172.21.15.52:0/3196440754 conn(0x7f845c0cb6f0 msgr2=0x7f845c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 -- 172.21.15.52:0/3196440754 shutdown_connections 2023-05-10T01:10:09.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.761+0000 7f8461ad5700 1 -- 172.21.15.52:0/3196440754 wait complete. 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 Processor -- start 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 -- start start 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448003a70 0x7f845c1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f845c0c3f20 0x7f845c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c168bb0 con 0x7f845c167bc0 2023-05-10T01:10:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c14fdf0 con 0x7f8448003a70 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.763+0000 7f8461ad5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0c4890 con 0x7f845c0c3f20 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59032/0 (socket says 172.21.15.52:59032) 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 -- 172.21.15.52:0/627697233 learned_addr learned my addr 172.21.15.52:0/627697233 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845bfff700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f845c0c3f20 0x7f845c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845b7fe700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448003a70 0x7f845c1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 -- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f845c0c3f20 msgr2=0x7f845c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f845c0c3f20 0x7f845c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 -- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448003a70 msgr2=0x7f845c1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448003a70 0x7f845c1580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 -- 172.21.15.52:0/627697233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c1685f0 con 0x7f845c167bc0 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f845affd700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f84500029d0 tx=0x7f8450007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450007240 con 0x7f845c167bc0 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84500073a0 con 0x7f845c167bc0 2023-05-10T01:10:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c1688d0 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500066a0 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.764+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c153270 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.765+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c14f8e0 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.766+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f845001a030 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.766+0000 7f84437fe700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 0x7f843c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.766+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8450079450 con 0x7f845c167bc0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.766+0000 7f845b7fe700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 0x7f843c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.767+0000 7f845b7fe700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 0x7f843c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f844c00c110 tx=0x7f844c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.770+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f845c14f8e0 con 0x7f845c167bc0 2023-05-10T01:10:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.986+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f845c14f8e0 con 0x7f845c167bc0 2023-05-10T01:10:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.987+0000 7f84437fe700 1 -- 172.21.15.52:0/627697233 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f845c14f8e0 con 0x7f845c167bc0 2023-05-10T01:10:09.990 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:09.991 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 msgr2=0x7f843c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 0x7f843c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f844c00c110 tx=0x7f844c015000).stop 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 msgr2=0x7f845c168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f84500029d0 tx=0x7f8450007bb0).stop 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 shutdown_connections 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.988+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f843c05ed90 0x7f843c061250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f845c0c3f20 0x7f845c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8448003a70 0x7f845c1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 --2- 172.21.15.52:0/627697233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f845c167bc0 0x7f845c168040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 >> 172.21.15.52:0/627697233 conn(0x7f845c0cb6f0 msgr2=0x7f845c0afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 shutdown_connections 2023-05-10T01:10:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:09.989+0000 7f8461ad5700 1 -- 172.21.15.52:0/627697233 wait complete. 2023-05-10T01:10:09.995 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:10.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:09:53.750190+0000', 'modified': '2023-05-10T01:09:56.757913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6836/2330058526', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2330058526}, {'type': 'v1', 'addr': '172.21.15.172:6836', 'nonce': 2330058526}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:10:10.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:10:10.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-10T01:10:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.526+0000 7f56a6f8e700 1 Processor -- start 2023-05-10T01:10:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.526+0000 7f56a6f8e700 1 -- start start 2023-05-10T01:10:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a6f8e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56a014e1f0 0x7f56a014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a6f8e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00683c0 con 0x7f56a0158150 2023-05-10T01:10:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a6f8e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00be050 con 0x7f56a0066e40 2023-05-10T01:10:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a6f8e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a0137460 con 0x7f56a014e1f0 2023-05-10T01:10:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a552b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f56a0158150 0x7f56a015dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39824/0 (socket says 172.21.15.52:39824) 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a552b700 1 -- 172.21.15.52:0/656001125 learned_addr learned my addr 172.21.15.52:0/656001125 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/656001125 >> v2:172.21.15.172:3300/0 conn(0x7f56a014e1f0 0x7f56a014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201229922 0 0) 0x7f56a00683c0 con 0x7f56a0158150 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.527+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56800033f0 con 0x7f56a0158150 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515300541 0 0) 0x7f56800033f0 con 0x7f56a0158150 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 >> v2:172.21.15.172:3300/0 conn(0x7f56a014e1f0 msgr2=0x7f56a014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 --2- 172.21.15.52:0/656001125 >> v2:172.21.15.172:3300/0 conn(0x7f56a014e1f0 0x7f56a014e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 >> v1:172.21.15.172:6789/0 conn(0x7f56a0066e40 legacy=0x7f56a0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00677b0 con 0x7f56a0158150 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5688001470 con 0x7f56a0158150 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 >> v1:172.21.15.52:6789/0 conn(0x7f56a0158150 legacy=0x7f56a015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 0x7f5680003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5680004690 0x7f5680004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5680005000 0x7f568000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0137460 con 0x7f56800038e0 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568000beb0 con 0x7f5680005000 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568000c070 con 0x7f5680004690 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 0x7f5680003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 -- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5680004690 msgr2=0x7f5680004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5680004690 0x7f5680004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 -- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5680005000 msgr2=0x7f568000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5680005000 0x7f568000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a552b700 1 -- 172.21.15.52:0/656001125 reap_dead start 2023-05-10T01:10:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 -- 172.21.15.52:0/656001125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800033f0 con 0x7f56800038e0 2023-05-10T01:10:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 0x7f5680003d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5698009a80 tx=0x7f5698009060).ready entity=mon.0 client_cookie=c086f4e4b6570d86 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698009430 con 0x7f56800038e0 2023-05-10T01:10:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800e640 con 0x7f56800038e0 2023-05-10T01:10:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.528+0000 7f569f7fe700 1 -- 172.21.15.52:0/656001125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800e9c0 con 0x7f56800038e0 2023-05-10T01:10:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 -- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 msgr2=0x7f5680003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 0x7f5680003d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5698009a80 tx=0x7f5698009060).stop 2023-05-10T01:10:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 -- 172.21.15.52:0/656001125 shutdown_connections 2023-05-10T01:10:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/656001125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56800038e0 0x7f5680003d00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 -- 172.21.15.52:0/656001125 >> 172.21.15.52:0/656001125 conn(0x7f56a00c7bb0 msgr2=0x7f56a00c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 -- 172.21.15.52:0/656001125 shutdown_connections 2023-05-10T01:10:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.529+0000 7f56a6f8e700 1 -- 172.21.15.52:0/656001125 wait complete. 2023-05-10T01:10:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.530+0000 7f56a6f8e700 1 Processor -- start 2023-05-10T01:10:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.530+0000 7f56a6f8e700 1 -- start start 2023-05-10T01:10:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 0x7f56a0136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00a7080 0x7f56a0065760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00be570 con 0x7f56a00a6c00 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c0fd0 con 0x7f56800038e0 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a6f8e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a01365f0 con 0x7f56a00a7080 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59052/0 (socket says 172.21.15.52:59052) 2023-05-10T01:10:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 -- 172.21.15.52:0/2323253974 learned_addr learned my addr 172.21.15.52:0/2323253974 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 0x7f56a0136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a552b700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00a7080 0x7f56a0065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 -- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00a7080 msgr2=0x7f56a0065760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00a7080 0x7f56a0065760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 -- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 msgr2=0x7f56a0136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 0x7f56a0136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 -- 172.21.15.52:0/2323253974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00ac910 con 0x7f56a00a6c00 2023-05-10T01:10:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 0x7f56a0136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.531+0000 7f569ffff700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f569000c7f0 tx=0x7f56900015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.532+0000 7f569cff9700 1 -- 172.21.15.52:0/2323253974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000a580 con 0x7f56a00a6c00 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.532+0000 7f569cff9700 1 -- 172.21.15.52:0/2323253974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000a6e0 con 0x7f56a00a6c00 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.532+0000 7f569cff9700 1 -- 172.21.15.52:0/2323253974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000aa60 con 0x7f56a00a6c00 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.532+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00acbf0 con 0x7f56a00a6c00 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.532+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00be200 con 0x7f56a00a6c00 2023-05-10T01:10:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.533+0000 7f569cff9700 1 -- 172.21.15.52:0/2323253974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5690019030 con 0x7f56a00a6c00 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.533+0000 7f569cff9700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 0x7f5684061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.533+0000 7f569cff9700 1 -- 172.21.15.52:0/2323253974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f56900793a0 con 0x7f56a00a6c00 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.534+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 0x7f5684061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.534+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 0x7f5684061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5698006d50 tx=0x7f569801a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.535+0000 7f56b8920b80 1 Processor -- start 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.535+0000 7f56b8920b80 1 -- start start 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb695c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 0x55afdb668710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb6335e0 con 0x55afdb6b7480 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb5aa8a0 con 0x55afdb6b2560 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdb5bf900 con 0x55afdb66e300 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59060/0 (socket says 172.21.15.52:59060) 2023-05-10T01:10:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f569ffff700 1 -- 172.21.15.52:0/3822370124 learned_addr learned my addr 172.21.15.52:0/3822370124 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb695c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.536+0000 7f56a552b700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 0x55afdb668710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 -- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 msgr2=0x55afdb668710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 0x55afdb668710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 -- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 msgr2=0x55afdb695c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb695c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 -- 172.21.15.52:0/3822370124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afdb462310 con 0x55afdb6b7480 2023-05-10T01:10:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56a552b700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 0x55afdb668710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f569ffff700 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5690077a10 tx=0x7f569000f000).ready entity=mon.0 client_cookie=cff8c6feebc16887 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f5695ffb700 1 -- 172.21.15.52:0/3822370124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900790a0 con 0x55afdb6b7480 2023-05-10T01:10:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f5695ffb700 1 -- 172.21.15.52:0/3822370124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690079200 con 0x55afdb6b7480 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f5695ffb700 1 -- 172.21.15.52:0/3822370124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569004dba0 con 0x55afdb6b7480 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 -- 172.21.15.52:0/3822370124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 msgr2=0x55afdb6b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f5690077a10 tx=0x7f569000f000).stop 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 -- 172.21.15.52:0/3822370124 shutdown_connections 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb66e300 0x55afdb668710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb695c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 --2- 172.21.15.52:0/3822370124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b2940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 -- 172.21.15.52:0/3822370124 >> 172.21.15.52:0/3822370124 conn(0x55afdb42ae40 msgr2=0x55afdb6b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 -- 172.21.15.52:0/3822370124 shutdown_connections 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.537+0000 7f56b8920b80 1 -- 172.21.15.52:0/3822370124 wait complete. 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.538+0000 7f56b8920b80 1 -- start start 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.538+0000 7f56b8920b80 1 Processor -- start 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb698d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb6935a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb586ed0 con 0x55afdb66e300 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb693a90 con 0x55afdb6b2560 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdb697a90 con 0x55afdb6b7480 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56b8920b80 10 client.0 ll_register_callbacks cb 0x55afdb62d200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59064/0 (socket says 172.21.15.52:59064) 2023-05-10T01:10:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 -- 172.21.15.52:0/2875012770 learned_addr learned my addr 172.21.15.52:0/2875012770 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f569ffff700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb698d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a552b700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb6935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 -- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 msgr2=0x55afdb6935a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb6935a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 -- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 msgr2=0x55afdb698d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb698d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.539+0000 7f56a4d2a700 1 -- 172.21.15.52:0/2875012770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00be200 con 0x55afdb66e300 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f569800e4b0 tx=0x7f5698020000).ready entity=mon.0 client_cookie=4d15e231fb144e1f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698020070 con 0x55afdb66e300 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5698031ca0 con 0x55afdb66e300 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afdb661460 con 0x55afdb66e300 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5698031ea0 con 0x55afdb66e300 2023-05-10T01:10:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 10 client.4638 fetch_fsmap learned FSMap version 8 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55afdb5b8880 con 0x55afdb66e300 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55afdb661460 con 0x55afdb66e300 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5698025d00 con 0x55afdb66e300 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 20 client.4638 populate_metadata read hostname 'smithi052' 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb6c6080 0x55afdb699fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 4 client.4638 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 --> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afdb426ca0 con 0x55afdb6c6080 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.540+0000 7f569ffff700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb6c6080 0x55afdb699fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.541+0000 7f5676ffd700 10 client.4638 ms_handle_connect on v2:172.21.15.172:6834/2330058526 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.541+0000 7f569ffff700 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb6c6080 0x55afdb699fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1b7671ca8c77e1db server_cookie=98abfdaf248a8b61 in_seq=0 out_seq=0 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.541+0000 7f5676ffd700 1 -- 172.21.15.52:0/2875012770 <== mds.0 v2:172.21.15.172:6834/2330058526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55afdb426ca0 con 0x55afdb6c6080 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f5676ffd700 10 client.4638 handle_command_reply: tid=0 2023-05-10T01:10:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 client.4638 shutdown 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 msgr2=0x55afdb6c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f569800e4b0 tx=0x7f5698020000).stop 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 shutdown_connections 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb6935a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb66e300 0x55afdb6c67b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb6c6080 0x55afdb699fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 --2- 172.21.15.52:0/2875012770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb6b2560 0x55afdb698d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f5676ffd700 0 client.4638 ms_handle_reset on v2:172.21.15.172:6834/2330058526 2023-05-10T01:10:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 >> 172.21.15.52:0/2875012770 conn(0x55afdb42ae40 msgr2=0x55afdb6b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 shutdown_connections 2023-05-10T01:10:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 1 -- 172.21.15.52:0/2875012770 wait complete. 2023-05-10T01:10:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.542+0000 7f56b8920b80 20 client.4638 trim_cache size 0 max 16384 2023-05-10T01:10:10.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.558+0000 7f56b8920b80 1 Processor -- start 2023-05-10T01:10:10.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.558+0000 7f56b8920b80 1 -- start start 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb6b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b2560 0x55afdb6b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb66e160 con 0x55afdb6b7480 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb6b6ff0 con 0x55afdb66e300 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdb6982d0 con 0x55afdb6b2560 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59076/0 (socket says 172.21.15.52:59076) 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 -- 172.21.15.52:0/1744208666 learned_addr learned my addr 172.21.15.52:0/1744208666 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 -- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b2560 msgr2=0x55afdb6b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f569ffff700 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b2560 0x55afdb6b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb6b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b2560 0x55afdb6b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 -- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 msgr2=0x55afdb6b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb6b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.559+0000 7f56a552b700 1 -- 172.21.15.52:0/1744208666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afdb5b4070 con 0x55afdb6b7480 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56a552b700 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f56880059a0 tx=0x7f5688009040).ready entity=mon.0 client_cookie=1f375e385b388781 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56967fc700 1 -- 172.21.15.52:0/1744208666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688013670 con 0x55afdb6b7480 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56967fc700 1 -- 172.21.15.52:0/1744208666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800d040 con 0x55afdb6b7480 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56967fc700 1 -- 172.21.15.52:0/1744208666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880139e0 con 0x55afdb6b7480 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 -- 172.21.15.52:0/1744208666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 msgr2=0x55afdb6b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f56880059a0 tx=0x7f5688009040).stop 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 -- 172.21.15.52:0/1744208666 shutdown_connections 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b7480 0x55afdb6b3970 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb6b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1744208666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b2560 0x55afdb6b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 -- 172.21.15.52:0/1744208666 >> 172.21.15.52:0/1744208666 conn(0x55afdb42ae40 msgr2=0x55afdb698bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 -- 172.21.15.52:0/1744208666 shutdown_connections 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.560+0000 7f56b8920b80 1 -- 172.21.15.52:0/1744208666 wait complete. 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.561+0000 7f56b8920b80 1 -- start start 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.561+0000 7f56b8920b80 1 Processor -- start 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb717ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb7188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb6b4060 con 0x55afdb6b2560 2023-05-10T01:10:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afdb718d90 con 0x55afdb66e300 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afdb6c79f0 con 0x55afdb6b7480 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 10 client.0 ll_register_callbacks cb 0x55afdb62d200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59080/0 (socket says 172.21.15.52:59080) 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 -- 172.21.15.52:0/1277205938 learned_addr learned my addr 172.21.15.52:0/1277205938 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb717ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56a552b700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb7188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 -- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 msgr2=0x55afdb7188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb7188a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 -- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 msgr2=0x55afdb717ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb717ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 -- 172.21.15.52:0/1277205938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00677b0 con 0x55afdb6b2560 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f569ffff700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5690079370 tx=0x7f569001e070).ready entity=mon.0 client_cookie=b63525f4ddcc1fe9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f5676ffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:10:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569004dba0 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f569000abc0 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.562+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5690079200 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5690077b40 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 10 client.4644 fetch_fsmap learned FSMap version 8 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55afdb5b3dc0 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690079200 con 0x55afdb6b2560 2023-05-10T01:10:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5690077ca0 con 0x55afdb6b2560 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 10 client.4644 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 20 client.4644 populate_metadata read hostname 'smithi052' 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb69a6d0 0x55afdb69aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 4 client.4644 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 --> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55afdb45dca0 con 0x55afdb69a6d0 2023-05-10T01:10:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb69a6d0 0x55afdb69aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f5676ffd700 10 client.4644 ms_handle_connect on v2:172.21.15.172:6834/2330058526 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.563+0000 7f56a4d2a700 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb69a6d0 0x55afdb69aab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=69d1eae081e07b2f server_cookie=268f630f85243bd5 in_seq=0 out_seq=0 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f5676ffd700 1 -- 172.21.15.52:0/1277205938 <== mds.0 v2:172.21.15.172:6834/2330058526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55afdb45dca0 con 0x55afdb69a6d0 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f5676ffd700 10 client.4644 handle_command_reply: tid=0 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 client.4644 shutdown 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 msgr2=0x55afdb7183b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5690079370 tx=0x7f569001e070).stop 2023-05-10T01:10:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 shutdown_connections 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55afdb6b7480 0x55afdb7188a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:6834/2330058526,v1:172.21.15.172:6836/2330058526] conn(0x55afdb69a6d0 0x55afdb69aab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afdb66e300 0x55afdb717ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 --2- 172.21.15.52:0/1277205938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55afdb6b2560 0x55afdb7183b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f5676ffd700 0 client.4644 ms_handle_reset on v2:172.21.15.172:6834/2330058526 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 >> 172.21.15.52:0/1277205938 conn(0x55afdb42ae40 msgr2=0x55afdb66c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 shutdown_connections 2023-05-10T01:10:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 1 -- 172.21.15.52:0/1277205938 wait complete. 2023-05-10T01:10:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56b8920b80 20 client.4644 trim_cache size 0 max 16384 2023-05-10T01:10:10.580 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4273, 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:10:10.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 16.810181059000001, 2023-05-10T01:10:10.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 8, 2023-05-10T01:10:10.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 22, 2023-05-10T01:10:10.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 22, 2023-05-10T01:10:10.582 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 21.97511299 2023-05-10T01:10:10.582 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:10:10.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 msgr2=0x7f5684061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 0x7f5684061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5698006d50 tx=0x7f569801a000).stop 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 msgr2=0x7f56a00c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f569000c7f0 tx=0x7f56900015e0).stop 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 shutdown_connections 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568405ed90 0x7f5684061250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00a7080 0x7f56a0065760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56800038e0 0x7f56a0136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 --2- 172.21.15.52:0/2323253974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00a6c00 0x7f56a00c00c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.564+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 >> 172.21.15.52:0/2323253974 conn(0x7f56a00c7bb0 msgr2=0x7f56a00a4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.565+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 shutdown_connections 2023-05-10T01:10:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:10.565+0000 7f56a6f8e700 1 -- 172.21.15.52:0/2323253974 wait complete. 2023-05-10T01:10:10.586 INFO:teuthology.run_tasks:Running task kclient... 2023-05-10T01:10:10.609 INFO:tasks.kclient:Mounting kernel clients... 2023-05-10T01:10:10.609 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-10T01:10:10.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.610 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:10:10.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-05-10T01:10:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2023-05-10T01:10:10.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:10:10.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.694 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:10:10.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-05-10T01:10:10.814 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2023-05-10T01:10:10.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:10:10.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.817 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:10:10.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.836 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-05-10T01:10:10.907 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-05-10T01:10:10.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:10:10.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.910 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:10:10.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:10.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-05-10T01:10:11.035 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-05-10T01:10:11.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:10:11.077 INFO:tasks.kclient:client.0 config is {} 2023-05-10T01:10:11.077 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:10:11.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.181+0000 7f6ded444700 1 Processor -- start 2023-05-10T01:10:11.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.181+0000 7f6ded444700 1 -- start start 2023-05-10T01:10:11.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6ded444700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6de8066920 0x7f6de8068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6ded444700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6de81561a0 0x7f6de8152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6ded444700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80c4470 con 0x7f6de80c4900 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6ded444700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80c3860 con 0x7f6de81561a0 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6ded444700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80c3b40 con 0x7f6de8066920 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6de77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6de81561a0 0x7f6de8152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6de77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6de81561a0 0x7f6de8152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59088/0 (socket says 172.21.15.52:59088) 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6de77fe700 1 -- 172.21.15.52:0/2140954690 learned_addr learned my addr 172.21.15.52:0/2140954690 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.182+0000 7f6de6ffd700 1 --2- 172.21.15.52:0/2140954690 >> v2:172.21.15.172:3300/0 conn(0x7f6de8066920 0x7f6de8068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de77fe700 1 -- 172.21.15.52:0/2140954690 >> v2:172.21.15.172:3300/0 conn(0x7f6de8066920 msgr2=0x7f6de8068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de77fe700 1 --2- 172.21.15.52:0/2140954690 >> v2:172.21.15.172:3300/0 conn(0x7f6de8066920 0x7f6de8068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de77fe700 1 -- 172.21.15.52:0/2140954690 >> v1:172.21.15.172:6789/0 conn(0x7f6de80c4900 legacy=0x7f6de8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de5ffb700 1 -- 172.21.15.52:0/2140954690 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57700037 0 0) 0x7f6de80c4470 con 0x7f6de80c4900 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de77fe700 1 -- 172.21.15.52:0/2140954690 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80c3e20 con 0x7f6de81561a0 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de77fe700 1 --2- 172.21.15.52:0/2140954690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8152460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6de8061b90 tx=0x7f6dd8009840).ready entity=mon.0 client_cookie=29f6274b9743acaa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de5ffb700 1 -- 172.21.15.52:0/2140954690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800e070 con 0x7f6de81561a0 2023-05-10T01:10:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de5ffb700 1 -- 172.21.15.52:0/2140954690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800ba50 con 0x7f6de81561a0 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.183+0000 7f6de5ffb700 1 -- 172.21.15.52:0/2140954690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800bdd0 con 0x7f6de81561a0 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 -- 172.21.15.52:0/2140954690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 msgr2=0x7f6de8152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 --2- 172.21.15.52:0/2140954690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8152460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6de8061b90 tx=0x7f6dd8009840).stop 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 -- 172.21.15.52:0/2140954690 shutdown_connections 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 --2- 172.21.15.52:0/2140954690 >> v2:172.21.15.172:3300/0 conn(0x7f6de8066920 0x7f6de8068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 --2- 172.21.15.52:0/2140954690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8152460 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 -- 172.21.15.52:0/2140954690 >> 172.21.15.52:0/2140954690 conn(0x7f6de8062da0 msgr2=0x7f6de80c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 -- 172.21.15.52:0/2140954690 shutdown_connections 2023-05-10T01:10:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.184+0000 7f6ded444700 1 -- 172.21.15.52:0/2140954690 wait complete. 2023-05-10T01:10:11.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.185+0000 7f6ded444700 1 Processor -- start 2023-05-10T01:10:11.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.185+0000 7f6ded444700 1 -- start start 2023-05-10T01:10:11.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6de8066920 0x7f6de81464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 0x7f6de80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80ac010 con 0x7f6de81561a0 2023-05-10T01:10:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80ac5d0 con 0x7f6de80c4900 2023-05-10T01:10:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80aea40 con 0x7f6de8066920 2023-05-10T01:10:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59096/0 (socket says 172.21.15.52:59096) 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 -- 172.21.15.52:0/3788038690 learned_addr learned my addr 172.21.15.52:0/3788038690 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de6ffd700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6de8066920 0x7f6de81464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de67fc700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 0x7f6de80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 -- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6de8066920 msgr2=0x7f6de81464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6de8066920 0x7f6de81464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 -- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 msgr2=0x7f6de80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 0x7f6de80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 -- 172.21.15.52:0/3788038690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8009ae0 con 0x7f6de81561a0 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de67fc700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 0x7f6de80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6de77fe700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6dd8009fd0 tx=0x7f6de80c43e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800bdd0 con 0x7f6de81561a0 2023-05-10T01:10:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80092e0 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de814ad30 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd801c610 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.186+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80ac260 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.187+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de80ac760 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.188+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6dd801ca40 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.188+0000 7f6ddeffd700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 0x7f6dcc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.188+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6dd807b530 con 0x7f6de81561a0 2023-05-10T01:10:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.188+0000 7f6de6ffd700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 0x7f6dcc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.189+0000 7f6de6ffd700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 0x7f6dcc061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6de000bbc0 tx=0x7f6de0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.192+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dd804cad0 con 0x7f6de81561a0 2023-05-10T01:10:11.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.410+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6de805ef90 con 0x7f6de81561a0 2023-05-10T01:10:11.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.410+0000 7f6ddeffd700 1 -- 172.21.15.52:0/3788038690 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6dd80500f0 con 0x7f6de81561a0 2023-05-10T01:10:11.415 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:10:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 msgr2=0x7f6dcc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 0x7f6dcc061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6de000bbc0 tx=0x7f6de0008040).stop 2023-05-10T01:10:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 msgr2=0x7f6de8147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6dd8009fd0 tx=0x7f6de80c43e0).stop 2023-05-10T01:10:11.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 shutdown_connections 2023-05-10T01:10:11.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6dcc05ed90 0x7f6dcc061250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6de81561a0 0x7f6de8147d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6de8066920 0x7f6de81464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 --2- 172.21.15.52:0/3788038690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de80c4900 0x7f6de80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 >> 172.21.15.52:0/3788038690 conn(0x7f6de8062da0 msgr2=0x7f6de8154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:11.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 shutdown_connections 2023-05-10T01:10:11.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:11.412+0000 7f6ded444700 1 -- 172.21.15.52:0/3788038690 wait complete. 2023-05-10T01:10:11.427 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:10:11.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:10:11.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:10:11.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:10:11.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:11.430 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:10:11.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T01:10:11.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:10:11.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:10:11.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.433 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:10:11.450 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:11.450 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:11.450 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:11.451 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42224sec preferred_lft 42224sec 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:11.452 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:11.453 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-10T01:10:11.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.454 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:11.454 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:11.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2023-05-10T01:10:11.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2023-05-10T01:10:11.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2023-05-10T01:10:11.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-10T01:10:11.455 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:11.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.606 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:10:11.644 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:10:11.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.646 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:10:11.713 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:10:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:10:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:10:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:10:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:10:11.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.715 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:11.715 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:11.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:10:11.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:10:11.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:10:11.717 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:11.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.952 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:10:11.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:11.968 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2023-05-10T01:10:12.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:12.023 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:12.023 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:12.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:10:12.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-10T01:10:12.024 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:12.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-10T01:10:12.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:12.114 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:12.114 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:12.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-10T01:10:12.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-10T01:10:12.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-10T01:10:12.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-10T01:10:12.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-10T01:10:12.118 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:12.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:12.311 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:12.311 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:12.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:10:12.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2023-05-10T01:10:12.312 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:12.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:12.405 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:12.419 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:10:12.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:12.509 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:12.509 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:10:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:10:12.630 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:10:12.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:12.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:12.656 INFO:tasks.kclient:client.2 config is {} 2023-05-10T01:10:12.656 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:10:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.796+0000 7f50f0d57700 1 Processor -- start 2023-05-10T01:10:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.796+0000 7f50f0d57700 1 -- start start 2023-05-10T01:10:12.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50f0d57700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50ec0a48d0 0x7f50ec0a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50f0d57700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec158150 0x7f50ec062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50f0d57700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec062e00 con 0x7f50ec0622d0 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50f0d57700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec063a80 con 0x7f50ec0a48d0 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50f0d57700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0630e0 con 0x7f50ec158150 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50ea59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50ec0a48d0 0x7f50ec0a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50e9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50ec0622d0 0x7f50ec157a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39890/0 (socket says 172.21.15.52:39890) 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.797+0000 7f50e9d9b700 1 -- 172.21.15.52:0/3964309033 learned_addr learned my addr 172.21.15.52:0/3964309033 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ead9d700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec158150 0x7f50ec062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ea59c700 1 -- 172.21.15.52:0/3964309033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec158150 msgr2=0x7f50ec062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ea59c700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec158150 0x7f50ec062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ea59c700 1 -- 172.21.15.52:0/3964309033 >> v1:172.21.15.52:6789/0 conn(0x7f50ec0622d0 legacy=0x7f50ec157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50e959a700 1 -- 172.21.15.52:0/3964309033 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017151455 0 0) 0x7f50ec062e00 con 0x7f50ec0622d0 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ea59c700 1 -- 172.21.15.52:0/3964309033 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0633c0 con 0x7f50ec0a48d0 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50ea59c700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0a48d0 0x7f50ec0a4cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50e4009760 tx=0x7f50e4009060).ready entity=mon.0 client_cookie=bd71ea658de2c300 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50e959a700 1 -- 172.21.15.52:0/3964309033 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b580 con 0x7f50ec0a48d0 2023-05-10T01:10:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50e959a700 1 -- 172.21.15.52:0/3964309033 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400b6e0 con 0x7f50ec0a48d0 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50e959a700 1 -- 172.21.15.52:0/3964309033 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400ba60 con 0x7f50ec0a48d0 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50f0d57700 1 -- 172.21.15.52:0/3964309033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0a48d0 msgr2=0x7f50ec0a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.798+0000 7f50f0d57700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0a48d0 0x7f50ec0a4cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f50e4009760 tx=0x7f50e4009060).stop 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 -- 172.21.15.52:0/3964309033 shutdown_connections 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec158150 0x7f50ec062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 --2- 172.21.15.52:0/3964309033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0a48d0 0x7f50ec0a4cb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 -- 172.21.15.52:0/3964309033 >> 172.21.15.52:0/3964309033 conn(0x7f50ec066060 msgr2=0x7f50ec066470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 -- 172.21.15.52:0/3964309033 shutdown_connections 2023-05-10T01:10:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.799+0000 7f50f0d57700 1 -- 172.21.15.52:0/3964309033 wait complete. 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.800+0000 7f50f0d57700 1 Processor -- start 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.800+0000 7f50f0d57700 1 -- start start 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec0a48d0 0x7f50ec136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50ec158150 0x7f50ec069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0aa0d0 con 0x7f50ec0622d0 2023-05-10T01:10:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec136eb0 con 0x7f50ec158150 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec138ae0 con 0x7f50ec0a48d0 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59110/0 (socket says 172.21.15.52:59110) 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 -- 172.21.15.52:0/4078239767 learned_addr learned my addr 172.21.15.52:0/4078239767 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 -- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec0a48d0 msgr2=0x7f50ec136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec0a48d0 0x7f50ec136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 -- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50ec158150 msgr2=0x7f50ec069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50ec158150 0x7f50ec069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 -- 172.21.15.52:0/4078239767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40092a0 con 0x7f50ec0622d0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50ea59c700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f50ec068040 tx=0x7f50e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b850 con 0x7f50ec0622d0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400b9b0 con 0x7f50ec0622d0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec138dc0 con 0x7f50ec0622d0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e401b660 con 0x7f50ec0622d0 2023-05-10T01:10:12.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.801+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec139380 con 0x7f50ec0622d0 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.802+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec0aa240 con 0x7f50ec0622d0 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.803+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f50e402b070 con 0x7f50ec0622d0 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.803+0000 7f50da7fc700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 0x7f50c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.803+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f50e407b550 con 0x7f50ec0622d0 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.803+0000 7f50e9d9b700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 0x7f50c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.804+0000 7f50e9d9b700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 0x7f50c8061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f50e00011e0 tx=0x7f50e0007850).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:12.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:12.807+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50ec0aa240 con 0x7f50ec0622d0 2023-05-10T01:10:13.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.022+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50ec0aa210 con 0x7f50ec0622d0 2023-05-10T01:10:13.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.023+0000 7f50da7fc700 1 -- 172.21.15.52:0/4078239767 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50e401f070 con 0x7f50ec0622d0 2023-05-10T01:10:13.026 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:10:13.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 msgr2=0x7f50c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:13.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 0x7f50c8061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f50e00011e0 tx=0x7f50e0007850).stop 2023-05-10T01:10:13.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 msgr2=0x7f50ec0a7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:13.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f50ec068040 tx=0x7f50e4017000).stop 2023-05-10T01:10:13.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 shutdown_connections 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f50c805ed90 0x7f50c8061250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50ec158150 0x7f50ec069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50ec0622d0 0x7f50ec0a7a90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 --2- 172.21.15.52:0/4078239767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50ec0a48d0 0x7f50ec136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 >> 172.21.15.52:0/4078239767 conn(0x7f50ec066060 msgr2=0x7f50ec0c3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 shutdown_connections 2023-05-10T01:10:13.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:13.024+0000 7f50f0d57700 1 -- 172.21.15.52:0/4078239767 wait complete. 2023-05-10T01:10:13.038 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:10:13.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:10:13.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:10:13.039 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-10T01:10:13.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-10T01:10:13.039 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:10:13.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T01:10:13.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:10:13.040 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-10T01:10:13.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.040 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:10:13.055 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:13.055 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:13.056 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42223sec preferred_lft 42223sec 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:13.057 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:10:13.058 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.059 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:10:13.059 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:10:13.059 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link tentative 2023-05-10T01:10:13.059 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.060 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:10:13.118 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:10:13.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.120 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:10:13.177 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:10:13.177 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:10:13.178 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:10:13.178 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:10:13.178 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:10:13.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.179 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:13.179 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:13.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:10:13.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:10:13.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:10:13.180 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:13.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.278 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:10:13.294 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:10:13.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.296 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2023-05-10T01:10:13.364 INFO:teuthology.orchestra.run.smithi052.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-10T01:10:13.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.365 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:13.365 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:13.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:10:13.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-10T01:10:13.366 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:13.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-10T01:10:13.485 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0a:bf:d6:b4:57:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T01:10:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T01:10:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8bf:d6ff:feb4:5722/64 scope link tentative 2023-05-10T01:10:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-10T01:10:13.578 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.579 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:10:13.580 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0a:bf:d6:b4:57:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T01:10:13.580 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T01:10:13.580 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.580 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8bf:d6ff:feb4:5722/64 scope link tentative 2023-05-10T01:10:13.580 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:13.589 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-10T01:10:13.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.590 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:13.590 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:13.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-10T01:10:13.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-10T01:10:13.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-10T01:10:13.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-10T01:10:13.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-10T01:10:13.591 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.818 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:13.818 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:13.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.1 up 2023-05-10T01:10:13.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.1 master ceph-brx 2023-05-10T01:10:13.819 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:13.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:13.899 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-05-10T01:10:13.918 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:10:13.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:14.002 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:14.003 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=2,norbytes" will pass to kernel. 2023-05-10T01:10:14.044 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:14.044 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=2,norbytes" will pass to kernel. 2023-05-10T01:10:14.047 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:10:14.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-10T01:10:14.115 INFO:tasks.kclient:client.1 config is {} 2023-05-10T01:10:14.115 DEBUG:teuthology.orchestra.run.smithi172:> ceph fs ls 2023-05-10T01:10:14.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 Processor -- start 2023-05-10T01:10:14.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 -- start start 2023-05-10T01:10:14.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1254154030 0x7f12540c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 0x7f12540bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1254065160 con 0x7f1254069a80 2023-05-10T01:10:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540c41a0 con 0x7f1254067370 2023-05-10T01:10:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.225+0000 7f1259ec4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540a7290 con 0x7f1254154030 2023-05-10T01:10:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1254154030 0x7f12540c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1254154030 0x7f12540c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44530/0 (socket says 172.21.15.172:44530) 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 -- 172.21.15.172:0/3908715209 learned_addr learned my addr 172.21.15.172:0/3908715209 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f1252ffd700 1 --2- 172.21.15.172:0/3908715209 >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 0x7f12540bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 -- 172.21.15.172:0/3908715209 >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 msgr2=0x7f12540bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 --2- 172.21.15.172:0/3908715209 >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 0x7f12540bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 -- 172.21.15.172:0/3908715209 >> v1:172.21.15.52:6789/0 conn(0x7f1254069a80 legacy=0x7f12540622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 -- 172.21.15.172:0/3908715209 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254154410 con 0x7f1254154030 2023-05-10T01:10:14.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f1252ffd700 1 --2- 172.21.15.172:0/3908715209 >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 0x7f12540bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:14.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12537fe700 1 --2- 172.21.15.172:0/3908715209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540c3ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f12540c7910 tx=0x7f1244009060).ready entity=mon.1 client_cookie=161b5c98e44b678e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:14.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12527fc700 1 -- 172.21.15.172:0/3908715209 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244005880 con 0x7f1254154030 2023-05-10T01:10:14.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12527fc700 1 -- 172.21.15.172:0/3908715209 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12440059e0 con 0x7f1254154030 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.226+0000 7f12527fc700 1 -- 172.21.15.172:0/3908715209 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244005d60 con 0x7f1254154030 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 -- 172.21.15.172:0/3908715209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 msgr2=0x7f12540c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 --2- 172.21.15.172:0/3908715209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540c3ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f12540c7910 tx=0x7f1244009060).stop 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 -- 172.21.15.172:0/3908715209 shutdown_connections 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 --2- 172.21.15.172:0/3908715209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540c3ac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 --2- 172.21.15.172:0/3908715209 >> v2:172.21.15.52:3300/0 conn(0x7f1254067370 0x7f12540bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 -- 172.21.15.172:0/3908715209 >> 172.21.15.172:0/3908715209 conn(0x7f1254063e60 msgr2=0x7f1254064890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 -- 172.21.15.172:0/3908715209 shutdown_connections 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.227+0000 7f1259ec4700 1 -- 172.21.15.172:0/3908715209 wait complete. 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.228+0000 7f1259ec4700 1 Processor -- start 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.228+0000 7f1259ec4700 1 -- start start 2023-05-10T01:10:14.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1254067370 0x7f12540bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540a9700 con 0x7f1254067370 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540a8570 con 0x7f1254154030 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1259ec4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540aaad0 con 0x7f1254069a80 2023-05-10T01:10:14.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:56178/0 (socket says 172.21.15.172:56178) 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1252ffd700 1 -- 172.21.15.172:0/1140296232 learned_addr learned my addr 172.21.15.172:0/1140296232 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44538/0 (socket says 172.21.15.172:44538) 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f12537fe700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1254067370 0x7f12540bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 -- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 msgr2=0x7f12540a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 -- 172.21.15.172:0/1140296232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1254067370 msgr2=0x7f12540bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1254067370 0x7f12540bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1253fff700 1 -- 172.21.15.172:0/1140296232 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009300 con 0x7f1254154030 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.229+0000 7f1252ffd700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f1253fff700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f124c00c810 tx=0x7f124c0024b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00e4a0 con 0x7f1254154030 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00e600 con 0x7f1254154030 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540aadb0 con 0x7f1254154030 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00e9c0 con 0x7f1254154030 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.230+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540ab370 con 0x7f1254154030 2023-05-10T01:10:14.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.231+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540ab590 con 0x7f1254154030 2023-05-10T01:10:14.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.231+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f124c010070 con 0x7f1254154030 2023-05-10T01:10:14.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.231+0000 7f123b7fe700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 0x7f1234061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:14.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.231+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f124c079340 con 0x7f1254154030 2023-05-10T01:10:14.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.231+0000 7f12537fe700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 0x7f1234061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:14.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.232+0000 7f12537fe700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 0x7f1234061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1244009150 tx=0x7f1244016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:14.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.236+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f124c0478f0 con 0x7f1254154030 2023-05-10T01:10:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.442+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f125405ef90 con 0x7f1254154030 2023-05-10T01:10:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.442+0000 7f123b7fe700 1 -- 172.21.15.172:0/1140296232 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f124c04a7d0 con 0x7f1254154030 2023-05-10T01:10:14.446 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:10:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 msgr2=0x7f1234061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 0x7f1234061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1244009150 tx=0x7f1244016000).stop 2023-05-10T01:10:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 msgr2=0x7f12540a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f124c00c810 tx=0x7f124c0024b0).stop 2023-05-10T01:10:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 shutdown_connections 2023-05-10T01:10:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f123405ed90 0x7f1234061250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1254154030 0x7f12540a9210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1254067370 0x7f12540bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 --2- 172.21.15.172:0/1140296232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1254069a80 0x7f12540a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:14.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 >> 172.21.15.172:0/1140296232 conn(0x7f1254063e60 msgr2=0x7f1254153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:14.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 shutdown_connections 2023-05-10T01:10:14.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:14.444+0000 7f1259ec4700 1 -- 172.21.15.172:0/1140296232 wait complete. 2023-05-10T01:10:14.457 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:10:14.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:10:14.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-05-10T01:10:14.458 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-10T01:10:14.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-10T01:10:14.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:10:14.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T01:10:14.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:10:14.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-10T01:10:14.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.460 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-05-10T01:10:14.474 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:14.475 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:14.476 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T01:10:14.477 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42242sec preferred_lft 42242sec 2023-05-10T01:10:14.477 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-05-10T01:10:14.477 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:14.477 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-10T01:10:14.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.478 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:14.478 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:14.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2023-05-10T01:10:14.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2023-05-10T01:10:14.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2023-05-10T01:10:14.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-10T01:10:14.479 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:14.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.632 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:10:14.667 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-05-10T01:10:14.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.669 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-05-10T01:10:14.739 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-05-10T01:10:14.740 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:10:14.740 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T01:10:14.740 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T01:10:14.740 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:10:14.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.741 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:14.742 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:14.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T01:10:14.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T01:10:14.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T01:10:14.743 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:14.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.950 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:10:14.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:14.965 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-05-10T01:10:15.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:15.019 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:15.020 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:15.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-10T01:10:15.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-10T01:10:15.020 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:15.107 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-10T01:10:15.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:15.108 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:15.108 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:15.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-10T01:10:15.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-10T01:10:15.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-10T01:10:15.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-10T01:10:15.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-10T01:10:15.110 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:15.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:15.297 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:15.297 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:15.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-05-10T01:10:15.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2023-05-10T01:10:15.298 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:15.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:15.389 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-05-10T01:10:15.404 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:10:15.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:15.497 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:15.498 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-05-10T01:10:15.610 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:15.610 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-05-10T01:10:15.613 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:10:15.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:15.614 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-10T01:10:15.637 INFO:tasks.kclient:client.3 config is {} 2023-05-10T01:10:15.638 DEBUG:teuthology.orchestra.run.smithi172:> ceph fs ls 2023-05-10T01:10:15.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.774+0000 7f3ad4ede700 1 Processor -- start 2023-05-10T01:10:15.778 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.774+0000 7f3ad4ede700 1 -- start start 2023-05-10T01:10:15.779 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ad4ede700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ad4ede700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ad4ede700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad0062e00 con 0x7f3ad0157a40 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ad4ede700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad0063a80 con 0x7f3ad00a48d0 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ad4ede700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00630e0 con 0x7f3ad00622d0 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3ace59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.775+0000 7f3acdd9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acdd9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:56192/0 (socket says 172.21.15.172:56192) 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44548/0 (socket says 172.21.15.172:44548) 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acdd9b700 1 -- 172.21.15.172:0/3715209378 learned_addr learned my addr 172.21.15.172:0/3715209378 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 -- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 msgr2=0x7f3ad0062750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 -- 172.21.15.172:0/3715209378 >> v1:172.21.15.52:6789/0 conn(0x7f3ad0157a40 legacy=0x7f3ad0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 -- 172.21.15.172:0/3715209378 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00633c0 con 0x7f3ad00a48d0 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acdd9b700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ace59c700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3ac0009e60 tx=0x7f3ac0009780).ready entity=mon.1 client_cookie=e577e6c22fc1b797 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acd59a700 1 -- 172.21.15.172:0/3715209378 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000e070 con 0x7f3ad00a48d0 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acd59a700 1 -- 172.21.15.172:0/3715209378 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000bb20 con 0x7f3ad00a48d0 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3acd59a700 1 -- 172.21.15.172:0/3715209378 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000bea0 con 0x7f3ad00a48d0 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ad4ede700 1 -- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00a48d0 msgr2=0x7f3ad00a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:15.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.776+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3ac0009e60 tx=0x7f3ac0009780).stop 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 -- 172.21.15.172:0/3715209378 shutdown_connections 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00a48d0 0x7f3ad00a4cb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/3715209378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad00622d0 0x7f3ad0062750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 -- 172.21.15.172:0/3715209378 >> 172.21.15.172:0/3715209378 conn(0x7f3ad0066060 msgr2=0x7f3ad0066470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 -- 172.21.15.172:0/3715209378 shutdown_connections 2023-05-10T01:10:15.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.777+0000 7f3ad4ede700 1 -- 172.21.15.172:0/3715209378 wait complete. 2023-05-10T01:10:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 Processor -- start 2023-05-10T01:10:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 -- start start 2023-05-10T01:10:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 0x7f3ad0069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 0x7f3ad00aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad006a1a0 con 0x7f3ad00a48d0 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0137ca0 con 0x7f3ad00622d0 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.778+0000 7f3ad4ede700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00ac990 con 0x7f3ad0157a40 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3aced9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 0x7f3ad00aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44554/0 (socket says 172.21.15.172:44554) 2023-05-10T01:10:15.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 -- 172.21.15.172:0/135887840 learned_addr learned my addr 172.21.15.172:0/135887840 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-05-10T01:10:15.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3acdd9b700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 0x7f3ad0069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 -- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 msgr2=0x7f3ad00aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:15.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 0x7f3ad00aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 -- 172.21.15.172:0/135887840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 msgr2=0x7f3ad0069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:15.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 0x7f3ad0069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 -- 172.21.15.172:0/135887840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8009370 con 0x7f3ad00622d0 2023-05-10T01:10:15.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3aced9d700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 0x7f3ad00aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:15.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3acdd9b700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 0x7f3ad0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:15.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ace59c700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3ac000b6c0 tx=0x7f3ac0009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:15.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac001d420 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac001d580 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac0009a20 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac001d940 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.779+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad0137650 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.780+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad005ef90 con 0x7f3ad00622d0 2023-05-10T01:10:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.780+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ac001dcf0 con 0x7f3ad00622d0 2023-05-10T01:10:15.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.781+0000 7f3ac67fc700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 0x7f3ab4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:15.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.781+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ac007bb80 con 0x7f3ad00622d0 2023-05-10T01:10:15.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.781+0000 7f3acdd9b700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 0x7f3ab4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:15.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.781+0000 7f3acdd9b700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 0x7f3ab4061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3ad00a9a80 tx=0x7f3ab8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:15.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.785+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ac004d120 con 0x7f3ad00622d0 2023-05-10T01:10:15.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.993+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ad00a9ca0 con 0x7f3ad00622d0 2023-05-10T01:10:15.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.993+0000 7f3ac67fc700 1 -- 172.21.15.172:0/135887840 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ac0050740 con 0x7f3ad00622d0 2023-05-10T01:10:15.998 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 msgr2=0x7f3ab4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 0x7f3ab4061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3ad00a9a80 tx=0x7f3ab8008040).stop 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 msgr2=0x7f3ad00697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3ac000b6c0 tx=0x7f3ac0009780).stop 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 shutdown_connections 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ab405ed90 0x7f3ab4061250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:15.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ad0157a40 0x7f3ad00aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:16.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00622d0 0x7f3ad00697c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:16.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 --2- 172.21.15.172:0/135887840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ad00a48d0 0x7f3ad0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:16.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 >> 172.21.15.172:0/135887840 conn(0x7f3ad0066060 msgr2=0x7f3ad0155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:16.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 shutdown_connections 2023-05-10T01:10:16.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-05-10T01:10:15.995+0000 7f3ad4ede700 1 -- 172.21.15.172:0/135887840 wait complete. 2023-05-10T01:10:16.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:10:16.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:10:16.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-05-10T01:10:16.010 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-10T01:10:16.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-10T01:10:16.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:10:16.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T01:10:16.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:10:16.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-10T01:10:16.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.011 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-05-10T01:10:16.026 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:16.026 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:16.026 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:16.026 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:16.027 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42240sec preferred_lft 42240sec 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.028 INFO:teuthology.orchestra.run.smithi172.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether e2:fa:ff:0c:27:e3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::488a:22ff:fe7d:f27d/64 scope link 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:10:16.029 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether e2:fa:ff:0c:27:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-10T01:10:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::e0fa:ffff:fe0c:27e3/64 scope link tentative 2023-05-10T01:10:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.031 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:10:16.089 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-05-10T01:10:16.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.091 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-05-10T01:10:16.146 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-05-10T01:10:16.147 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:10:16.147 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T01:10:16.147 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T01:10:16.147 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:10:16.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.148 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:16.149 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:16.149 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T01:10:16.149 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T01:10:16.149 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T01:10:16.150 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:16.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.246 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:10:16.260 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-10T01:10:16.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.262 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-05-10T01:10:16.316 INFO:teuthology.orchestra.run.smithi172.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-10T01:10:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.317 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:16.317 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:16.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-10T01:10:16.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-10T01:10:16.318 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:16.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-10T01:10:16.436 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether c6:4f:5c:12:78:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c44f:5cff:fe12:7891/64 scope link tentative 2023-05-10T01:10:16.438 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-10T01:10:16.522 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:16.522 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:16.522 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:16.523 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.523 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:16.523 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.523 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:10:16.523 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether c6:4f:5c:12:78:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T01:10:16.524 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T01:10:16.524 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.524 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c44f:5cff:fe12:7891/64 scope link tentative 2023-05-10T01:10:16.524 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:16.531 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-10T01:10:16.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.532 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:16.534 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:16.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-10T01:10:16.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-10T01:10:16.535 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-10T01:10:16.535 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-10T01:10:16.535 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-10T01:10:16.535 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:16.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.737 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-05-10T01:10:16.737 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-05-10T01:10:16.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.1 up 2023-05-10T01:10:16.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.1 master ceph-brx 2023-05-10T01:10:16.738 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-05-10T01:10:16.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.816 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-05-10T01:10:16.830 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:10:16.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,name=3,norbytes" will pass to kernel. 2023-05-10T01:10:16.948 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:16.949 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,name=3,norbytes" will pass to kernel. 2023-05-10T01:10:16.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:10:16.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:16.951 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-10T01:10:17.014 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-10T01:10:17.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.165+0000 7f5220359700 1 Processor -- start 2023-05-10T01:10:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.165+0000 7f5220359700 1 -- start start 2023-05-10T01:10:17.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f5220359700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 0x7f52180c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f5220359700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5218069da0 0x7f52180c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f5220359700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180c0650 con 0x7f5218154540 2023-05-10T01:10:17.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f5220359700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180c1af0 con 0x7f5218069da0 2023-05-10T01:10:17.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f5220359700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180bfd20 con 0x7f5218154160 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f521e8f6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5218069da0 0x7f52180c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f521e8f6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5218069da0 0x7f52180c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59128/0 (socket says 172.21.15.52:59128) 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.166+0000 7f521e8f6700 1 -- 172.21.15.52:0/2650420745 learned_addr learned my addr 172.21.15.52:0/2650420745 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e0f5700 1 --2- 172.21.15.52:0/2650420745 >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 0x7f52180c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e8f6700 1 -- 172.21.15.52:0/2650420745 >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 msgr2=0x7f52180c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e8f6700 1 --2- 172.21.15.52:0/2650420745 >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 0x7f52180c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e8f6700 1 -- 172.21.15.52:0/2650420745 >> v1:172.21.15.172:6789/0 conn(0x7f5218154540 legacy=0x7f5218069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e8f6700 1 -- 172.21.15.52:0/2650420745 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180c0000 con 0x7f5218069da0 2023-05-10T01:10:17.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e0f5700 1 --2- 172.21.15.52:0/2650420745 >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 0x7f52180c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:17.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521e8f6700 1 --2- 172.21.15.52:0/2650420745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218069da0 0x7f52180c6150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5218083020 tx=0x7f52080090f0).ready entity=mon.0 client_cookie=57d7526213675707 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521d0f3700 1 -- 172.21.15.52:0/2650420745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800b600 con 0x7f5218069da0 2023-05-10T01:10:17.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521d0f3700 1 -- 172.21.15.52:0/2650420745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800b760 con 0x7f5218069da0 2023-05-10T01:10:17.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.167+0000 7f521d0f3700 1 -- 172.21.15.52:0/2650420745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800bb00 con 0x7f5218069da0 2023-05-10T01:10:17.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 -- 172.21.15.52:0/2650420745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218069da0 msgr2=0x7f52180c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 --2- 172.21.15.52:0/2650420745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218069da0 0x7f52180c6150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5218083020 tx=0x7f52080090f0).stop 2023-05-10T01:10:17.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 -- 172.21.15.52:0/2650420745 shutdown_connections 2023-05-10T01:10:17.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 --2- 172.21.15.52:0/2650420745 >> v2:172.21.15.172:3300/0 conn(0x7f5218154160 0x7f52180c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 --2- 172.21.15.52:0/2650420745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218069da0 0x7f52180c6150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 -- 172.21.15.52:0/2650420745 >> 172.21.15.52:0/2650420745 conn(0x7f52180cb6f0 msgr2=0x7f52180c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 -- 172.21.15.52:0/2650420745 shutdown_connections 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.168+0000 7f5220359700 1 -- 172.21.15.52:0/2650420745 wait complete. 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.169+0000 7f5220359700 1 Processor -- start 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.169+0000 7f5220359700 1 -- start start 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 0x7f52181641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5218154160 0x7f52181505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218151aa0 con 0x7f5218154540 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218150e90 con 0x7f5218069da0 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5218151170 con 0x7f5218154160 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59134/0 (socket says 172.21.15.52:59134) 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 -- 172.21.15.52:0/3578709475 learned_addr learned my addr 172.21.15.52:0/3578709475 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:17.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e0f5700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 0x7f52181641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521d8f4700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5218154160 0x7f52181505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 -- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5218154160 msgr2=0x7f52181505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5218154160 0x7f52181505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 -- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 msgr2=0x7f52181641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 0x7f52181641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 -- 172.21.15.52:0/3578709475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009370 con 0x7f5218154540 2023-05-10T01:10:17.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e0f5700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 0x7f52181641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f521e8f6700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f5208006fd0 tx=0x7f5208017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800bec0 con 0x7f5218154540 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800bae0 con 0x7f5218154540 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5218151450 con 0x7f5218154540 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080246c0 con 0x7f5218154540 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.170+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218164690 con 0x7f5218154540 2023-05-10T01:10:17.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.171+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5218153a10 con 0x7f5218154540 2023-05-10T01:10:17.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.172+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f520800f070 con 0x7f5218154540 2023-05-10T01:10:17.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.172+0000 7f52167fc700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 0x7f51f8061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.172+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f520807b830 con 0x7f5218154540 2023-05-10T01:10:17.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.172+0000 7f521e0f5700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 0x7f51f8061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.172+0000 7f521e0f5700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 0x7f51f8061280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f52100076e0 tx=0x7f52100098f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.176+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f520804cdd0 con 0x7f5218154540 2023-05-10T01:10:17.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.350+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52180666b0 con 0x7f5218154540 2023-05-10T01:10:17.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.351+0000 7f52167fc700 1 -- 172.21.15.52:0/3578709475 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f52080503f0 con 0x7f5218154540 2023-05-10T01:10:17.354 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:17.355 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 msgr2=0x7f51f8061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 0x7f51f8061280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f52100076e0 tx=0x7f52100098f0).stop 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 msgr2=0x7f521814ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f5208006fd0 tx=0x7f5208017000).stop 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 shutdown_connections 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51f805edc0 0x7f51f8061280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5218154540 0x7f521814ca20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5218069da0 0x7f52181641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 --2- 172.21.15.52:0/3578709475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5218154160 0x7f52181505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 >> 172.21.15.52:0/3578709475 conn(0x7f52180cb6f0 msgr2=0x7f52180c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:17.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.352+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 shutdown_connections 2023-05-10T01:10:17.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.353+0000 7f5220359700 1 -- 172.21.15.52:0/3578709475 wait complete. 2023-05-10T01:10:17.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:17.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:17.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.486+0000 7f519b8c8700 1 Processor -- start 2023-05-10T01:10:17.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.486+0000 7f519b8c8700 1 -- start start 2023-05-10T01:10:17.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f519b8c8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51940692a0 0x7f5194158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f519b8c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5194158540 con 0x7f519414e200 2023-05-10T01:10:17.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f519b8c8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51940697e0 con 0x7f5194157bd0 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f519b8c8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519406a460 con 0x7f51940692a0 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f5199e65700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51940692a0 0x7f5194158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f5199664700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f519414e200 0x7f519414e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39922/0 (socket says 172.21.15.52:39922) 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.487+0000 7f5199664700 1 -- 172.21.15.52:0/3025715919 learned_addr learned my addr 172.21.15.52:0/3025715919 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5199e65700 1 -- 172.21.15.52:0/3025715919 >> v1:172.21.15.172:6789/0 conn(0x7f5194157bd0 legacy=0x7f5194068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5199e65700 1 -- 172.21.15.52:0/3025715919 >> v1:172.21.15.52:6789/0 conn(0x7f519414e200 legacy=0x7f519414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5199e65700 1 -- 172.21.15.52:0/3025715919 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194069ac0 con 0x7f51940692a0 2023-05-10T01:10:17.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5199e65700 1 --2- 172.21.15.52:0/3025715919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f5194158050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5184009e60 tx=0x7f5184009780).ready entity=mon.0 client_cookie=4d45e25319053ada server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5193fff700 1 -- 172.21.15.52:0/3025715919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400e070 con 0x7f51940692a0 2023-05-10T01:10:17.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5193fff700 1 -- 172.21.15.52:0/3025715919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518400bc30 con 0x7f51940692a0 2023-05-10T01:10:17.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f5193fff700 1 -- 172.21.15.52:0/3025715919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184012410 con 0x7f51940692a0 2023-05-10T01:10:17.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 -- 172.21.15.52:0/3025715919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 msgr2=0x7f5194158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3025715919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f5194158050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5184009e60 tx=0x7f5184009780).stop 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 -- 172.21.15.52:0/3025715919 shutdown_connections 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3025715919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f5194158050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 -- 172.21.15.52:0/3025715919 >> 172.21.15.52:0/3025715919 conn(0x7f51940c45f0 msgr2=0x7f5194066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 -- 172.21.15.52:0/3025715919 shutdown_connections 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.488+0000 7f519b8c8700 1 -- 172.21.15.52:0/3025715919 wait complete. 2023-05-10T01:10:17.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.490+0000 7f519b8c8700 1 Processor -- start 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.490+0000 7f519b8c8700 1 -- start start 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.490+0000 7f519b8c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.490+0000 7f519b8c8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 0x7f5194163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.490+0000 7f519b8c8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 0x7f5194167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f519b8c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940abcf0 con 0x7f51940692a0 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f519b8c8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940ab0e0 con 0x7f519414e200 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f519b8c8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940ab3c0 con 0x7f5194157bd0 2023-05-10T01:10:17.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59144/0 (socket says 172.21.15.52:59144) 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 -- 172.21.15.52:0/3392637815 learned_addr learned my addr 172.21.15.52:0/3392637815 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5198e63700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 0x7f5194163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199e65700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 0x7f5194167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 -- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 msgr2=0x7f5194167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 0x7f5194167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 -- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 msgr2=0x7f5194163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 0x7f5194163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 -- 172.21.15.52:0/3392637815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184009a20 con 0x7f51940692a0 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5198e63700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 0x7f5194163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199e65700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 0x7f5194167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f5199664700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f518c001eb0 tx=0x7f518c007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0072e0 con 0x7f51940692a0 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c007440 con 0x7f51940692a0 2023-05-10T01:10:17.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0057a0 con 0x7f51940692a0 2023-05-10T01:10:17.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51940ab6a0 con 0x7f51940692a0 2023-05-10T01:10:17.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.491+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519414dd60 con 0x7f51940692a0 2023-05-10T01:10:17.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.492+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519406c340 con 0x7f51940692a0 2023-05-10T01:10:17.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.493+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f518c010070 con 0x7f51940692a0 2023-05-10T01:10:17.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.493+0000 7f51917fa700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 0x7f5174061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.493+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f518c079150 con 0x7f51940692a0 2023-05-10T01:10:17.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.493+0000 7f5198e63700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 0x7f5174061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.494+0000 7f5198e63700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 0x7f5174061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5194167c40 tx=0x7f5188009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.497+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f518c04a6f0 con 0x7f51940692a0 2023-05-10T01:10:17.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.671+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f519414dfe0 con 0x7f51940692a0 2023-05-10T01:10:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.671+0000 7f51917fa700 1 -- 172.21.15.52:0/3392637815 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f518c04dd10 con 0x7f51940692a0 2023-05-10T01:10:17.676 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:17.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 msgr2=0x7f5174061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 0x7f5174061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5194167c40 tx=0x7f5188009040).stop 2023-05-10T01:10:17.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 msgr2=0x7f51940c0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f518c001eb0 tx=0x7f518c007e50).stop 2023-05-10T01:10:17.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 shutdown_connections 2023-05-10T01:10:17.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517405ed90 0x7f5174061250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5194157bd0 0x7f5194167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51940692a0 0x7f51940c0400 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 --2- 172.21.15.52:0/3392637815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519414e200 0x7f5194163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 >> 172.21.15.52:0/3392637815 conn(0x7f51940c45f0 msgr2=0x7f5194068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:17.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 shutdown_connections 2023-05-10T01:10:17.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.673+0000 7f519b8c8700 1 -- 172.21.15.52:0/3392637815 wait complete. 2023-05-10T01:10:17.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:17.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.807+0000 7fc0bf59e700 1 Processor -- start 2023-05-10T01:10:17.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.807+0000 7fc0bf59e700 1 -- start start 2023-05-10T01:10:17.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bf59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0c00c6400 0x7fc0c0155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bf59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c006a130 con 0x7fc0c0153f80 2023-05-10T01:10:17.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bf59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c006a410 con 0x7fc0c00c1150 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bf59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c0069f50 con 0x7fc0c00c6400 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0be59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc0c0153f80 0x7fc0c00a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39936/0 (socket says 172.21.15.52:39936) 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0c00c6400 0x7fc0c0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0be59c700 1 -- 172.21.15.52:0/3677256005 learned_addr learned my addr 172.21.15.52:0/3677256005 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bed9d700 1 -- 172.21.15.52:0/3677256005 >> v1:172.21.15.172:6789/0 conn(0x7fc0c00c1150 legacy=0x7fc0c00c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bed9d700 1 -- 172.21.15.52:0/3677256005 >> v1:172.21.15.52:6789/0 conn(0x7fc0c0153f80 legacy=0x7fc0c00a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bed9d700 1 -- 172.21.15.52:0/3677256005 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c006a6f0 con 0x7fc0c00c6400 2023-05-10T01:10:17.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bd59a700 1 -- 172.21.15.52:0/3677256005 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487287521 0 0) 0x7fc0c006a130 con 0x7fc0c0153f80 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.808+0000 7fc0bed9d700 1 --2- 172.21.15.52:0/3677256005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00c6400 0x7fc0c0155370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc0b0009e60 tx=0x7fc0b0009780).ready entity=mon.0 client_cookie=1d84bb5a743dd797 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bd59a700 1 -- 172.21.15.52:0/3677256005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000e070 con 0x7fc0c00c6400 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bd59a700 1 -- 172.21.15.52:0/3677256005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b000bc30 con 0x7fc0c00c6400 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bd59a700 1 -- 172.21.15.52:0/3677256005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0012410 con 0x7fc0c00c6400 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 -- 172.21.15.52:0/3677256005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00c6400 msgr2=0x7fc0c0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/3677256005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00c6400 0x7fc0c0155370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc0b0009e60 tx=0x7fc0b0009780).stop 2023-05-10T01:10:17.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 -- 172.21.15.52:0/3677256005 shutdown_connections 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/3677256005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c00c6400 0x7fc0c0155370 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 -- 172.21.15.52:0/3677256005 >> 172.21.15.52:0/3677256005 conn(0x7fc0c00cb5f0 msgr2=0x7fc0c00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 -- 172.21.15.52:0/3677256005 shutdown_connections 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.809+0000 7fc0bf59e700 1 -- 172.21.15.52:0/3677256005 wait complete. 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.810+0000 7fc0bf59e700 1 Processor -- start 2023-05-10T01:10:17.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.810+0000 7fc0bf59e700 1 -- start start 2023-05-10T01:10:17.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0c00c1150 0x7fc0c014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c00c6400 0x7fc0c00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c7f10 con 0x7fc0c0153f80 2023-05-10T01:10:17.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00af360 con 0x7fc0c00c6400 2023-05-10T01:10:17.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00ae7e0 con 0x7fc0c00c1150 2023-05-10T01:10:17.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59162/0 (socket says 172.21.15.52:59162) 2023-05-10T01:10:17.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 -- 172.21.15.52:0/348769515 learned_addr learned my addr 172.21.15.52:0/348769515 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:17.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0be59c700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0c00c1150 0x7fc0c014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bdd9b700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c00c6400 0x7fc0c00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 -- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0c00c1150 msgr2=0x7fc0c014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0c00c1150 0x7fc0c014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 -- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c00c6400 msgr2=0x7fc0c00c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c00c6400 0x7fc0c00c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.811+0000 7fc0bed9d700 1 -- 172.21.15.52:0/348769515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009a20 con 0x7fc0c0153f80 2023-05-10T01:10:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0bed9d700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fc0c00668b0 tx=0x7fc0b0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0006320 con 0x7fc0c0153f80 2023-05-10T01:10:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0006480 con 0x7fc0c0153f80 2023-05-10T01:10:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00aeac0 con 0x7fc0c0153f80 2023-05-10T01:10:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0006820 con 0x7fc0c0153f80 2023-05-10T01:10:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.812+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c00af080 con 0x7fc0c0153f80 2023-05-10T01:10:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.813+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c014f180 con 0x7fc0c0153f80 2023-05-10T01:10:17.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.813+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc0b0027460 con 0x7fc0c0153f80 2023-05-10T01:10:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.813+0000 7fc0ae7fc700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 0x7fc09c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.813+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc0b007c140 con 0x7fc0c0153f80 2023-05-10T01:10:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.814+0000 7fc0be59c700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 0x7fc09c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:17.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.814+0000 7fc0be59c700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 0x7fc09c061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc0b8007fd0 tx=0x7fc0b8007db0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:17.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.817+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0c014f180 con 0x7fc0c0153f80 2023-05-10T01:10:17.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.991+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0c014f180 con 0x7fc0c0153f80 2023-05-10T01:10:17.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.992+0000 7fc0ae7fc700 1 -- 172.21.15.52:0/348769515 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0c014f180 con 0x7fc0c0153f80 2023-05-10T01:10:17.998 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:17.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 msgr2=0x7fc09c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 0x7fc09c061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc0b8007fd0 tx=0x7fc0b8007db0).stop 2023-05-10T01:10:17.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 msgr2=0x7fc0c00c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:17.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fc0c00668b0 tx=0x7fc0b0009780).stop 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 shutdown_connections 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc09c05ed90 0x7fc09c061250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0153f80 0x7fc0c00c7a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0c00c1150 0x7fc0c014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 --2- 172.21.15.52:0/348769515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c00c6400 0x7fc0c00c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 >> 172.21.15.52:0/348769515 conn(0x7fc0c00cb5f0 msgr2=0x7fc0c0155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 shutdown_connections 2023-05-10T01:10:18.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:17.994+0000 7fc0bf59e700 1 -- 172.21.15.52:0/348769515 wait complete. 2023-05-10T01:10:18.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.124+0000 7f7c3a2b9700 1 Processor -- start 2023-05-10T01:10:18.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.124+0000 7f7c3a2b9700 1 -- start start 2023-05-10T01:10:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c3a2b9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c34153f80 0x7f7c340a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c3a2b9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c34155770 con 0x7f7c340c5cf0 2023-05-10T01:10:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c3a2b9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3406a130 con 0x7f7c34155370 2023-05-10T01:10:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c3a2b9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34069f50 con 0x7f7c34153f80 2023-05-10T01:10:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c392b7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c34153f80 0x7f7c340a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c38ab6700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7c340c5cf0 0x7f7c340c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39950/0 (socket says 172.21.15.52:39950) 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c38ab6700 1 -- 172.21.15.52:0/3776308366 learned_addr learned my addr 172.21.15.52:0/3776308366 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c392b7700 1 -- 172.21.15.52:0/3776308366 >> v1:172.21.15.172:6789/0 conn(0x7f7c34155370 legacy=0x7f7c340c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c392b7700 1 -- 172.21.15.52:0/3776308366 >> v1:172.21.15.52:6789/0 conn(0x7f7c340c5cf0 legacy=0x7f7c340c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c392b7700 1 -- 172.21.15.52:0/3776308366 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3406a410 con 0x7f7c34153f80 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c392b7700 1 --2- 172.21.15.52:0/3776308366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34153f80 0x7f7c340a9d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f7c340aa7d0 tx=0x7f7c2c009780).ready entity=mon.0 client_cookie=1fd95dc06fcefd77 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.125+0000 7f7c33fff700 1 -- 172.21.15.52:0/3776308366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00e070 con 0x7f7c34153f80 2023-05-10T01:10:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c33fff700 1 -- 172.21.15.52:0/3776308366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00bbf0 con 0x7f7c34153f80 2023-05-10T01:10:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c33fff700 1 -- 172.21.15.52:0/3776308366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c012410 con 0x7f7c34153f80 2023-05-10T01:10:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/3776308366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34153f80 msgr2=0x7f7c340a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/3776308366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34153f80 0x7f7c340a9d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f7c340aa7d0 tx=0x7f7c2c009780).stop 2023-05-10T01:10:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/3776308366 shutdown_connections 2023-05-10T01:10:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/3776308366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34153f80 0x7f7c340a9d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/3776308366 >> 172.21.15.52:0/3776308366 conn(0x7f7c340cb5f0 msgr2=0x7f7c340c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/3776308366 shutdown_connections 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.126+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/3776308366 wait complete. 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.127+0000 7f7c3a2b9700 1 Processor -- start 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.127+0000 7f7c3a2b9700 1 -- start start 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c340c5cf0 0x7f7c34163e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 0x7f7c34144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340af2c0 con 0x7f7c34155370 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c2620 con 0x7f7c34153f80 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c3a2b9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341642f0 con 0x7f7c340c5cf0 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59174/0 (socket says 172.21.15.52:59174) 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 -- 172.21.15.52:0/617553848 learned_addr learned my addr 172.21.15.52:0/617553848 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c392b7700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c340c5cf0 0x7f7c34163e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c38ab6700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 0x7f7c34144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 -- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c340c5cf0 msgr2=0x7f7c34163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c340c5cf0 0x7f7c34163e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 -- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 msgr2=0x7f7c34144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 0x7f7c34144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c39ab8700 1 -- 172.21.15.52:0/617553848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009a20 con 0x7f7c34155370 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.128+0000 7f7c38ab6700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 0x7f7c34144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c39ab8700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7c24009470 tx=0x7f7c24006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24013460 con 0x7f7c34155370 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24013600 con 0x7f7c34155370 2023-05-10T01:10:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340c1cf0 con 0x7f7c34155370 2023-05-10T01:10:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240139c0 con 0x7f7c34155370 2023-05-10T01:10:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.129+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340c22b0 con 0x7f7c34155370 2023-05-10T01:10:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.130+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c34083110 con 0x7f7c34155370 2023-05-10T01:10:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.130+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7c2400f070 con 0x7f7c34155370 2023-05-10T01:10:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.130+0000 7f7c317fa700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 0x7f7c14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.131+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c24079320 con 0x7f7c34155370 2023-05-10T01:10:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.131+0000 7f7c392b7700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 0x7f7c14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.131+0000 7f7c392b7700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 0x7f7c14061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f7c2c009fd0 tx=0x7f7c2c009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.134+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c2404a8c0 con 0x7f7c34155370 2023-05-10T01:10:18.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.305+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c34047150 con 0x7f7c34155370 2023-05-10T01:10:18.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.306+0000 7f7c317fa700 1 -- 172.21.15.52:0/617553848 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c2404dee0 con 0x7f7c34155370 2023-05-10T01:10:18.310 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:18.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.307+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 msgr2=0x7f7c14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.307+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 0x7f7c14061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f7c2c009fd0 tx=0x7f7c2c009780).stop 2023-05-10T01:10:18.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 msgr2=0x7f7c340af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7c24009470 tx=0x7f7c24006ea0).stop 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 shutdown_connections 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7c1405ed90 0x7f7c14061250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c34155370 0x7f7c340af940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c340c5cf0 0x7f7c34163e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 --2- 172.21.15.52:0/617553848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c34153f80 0x7f7c34144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 >> 172.21.15.52:0/617553848 conn(0x7f7c340cb5f0 msgr2=0x7f7c340c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 shutdown_connections 2023-05-10T01:10:18.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.308+0000 7f7c3a2b9700 1 -- 172.21.15.52:0/617553848 wait complete. 2023-05-10T01:10:18.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.438+0000 7f5e9e710700 1 Processor -- start 2023-05-10T01:10:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9e710700 1 -- start start 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9e710700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e980aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9e710700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980c94c0 con 0x7f5e98068150 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9e710700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980cb7d0 con 0x7f5e98154460 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9e710700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980c88b0 con 0x7f5e98154080 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.439+0000 7f5e9ccad700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e98068150 0x7f5e98068570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39966/0 (socket says 172.21.15.52:39966) 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e9ccad700 1 -- 172.21.15.52:0/1887106842 learned_addr learned my addr 172.21.15.52:0/1887106842 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:18.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e97fff700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e980aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176209892 0 0) 0x7f5e980c94c0 con 0x7f5e98068150 2023-05-10T01:10:18.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e840033f0 con 0x7f5e98068150 2023-05-10T01:10:18.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503246040 0 0) 0x7f5e840033f0 con 0x7f5e98068150 2023-05-10T01:10:18.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 msgr2=0x7f5e980aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e980aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 >> v1:172.21.15.172:6789/0 conn(0x7f5e98154460 legacy=0x7f5e980a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980c8b90 con 0x7f5e98068150 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5e900017f0 con 0x7f5e98068150 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 >> v1:172.21.15.52:6789/0 conn(0x7f5e98068150 legacy=0x7f5e98068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e84003910 0x7f5e84003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84004690 0x7f5e84004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e84005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980c88b0 con 0x7f5e84003910 2023-05-10T01:10:18.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8400b910 con 0x7f5e84004690 2023-05-10T01:10:18.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8400bad0 con 0x7f5e98154080 2023-05-10T01:10:18.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e97fff700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e84003910 0x7f5e84003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e977fe700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84004690 0x7f5e84004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.440+0000 7f5e9ccad700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e84005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 -- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 msgr2=0x7f5e84005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e98154080 0x7f5e84005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 -- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84004690 msgr2=0x7f5e84004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84004690 0x7f5e84004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 -- 172.21.15.52:0/1887106842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840033f0 con 0x7f5e84003910 2023-05-10T01:10:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e977fe700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84004690 0x7f5e84004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e97fff700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e84003910 0x7f5e84003d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f5e88009a80 tx=0x7f5e88009060).ready entity=mon.0 client_cookie=c793569195e6d7c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88009430 con 0x7f5e84003910 2023-05-10T01:10:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800e640 con 0x7f5e84003910 2023-05-10T01:10:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e96ffd700 1 -- 172.21.15.52:0/1887106842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800e9c0 con 0x7f5e84003910 2023-05-10T01:10:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 -- 172.21.15.52:0/1887106842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e84003910 msgr2=0x7f5e84003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 --2- 172.21.15.52:0/1887106842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e84003910 0x7f5e84003d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f5e88009a80 tx=0x7f5e88009060).stop 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9ccad700 1 -- 172.21.15.52:0/1887106842 reap_dead start 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 -- 172.21.15.52:0/1887106842 shutdown_connections 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 -- 172.21.15.52:0/1887106842 >> 172.21.15.52:0/1887106842 conn(0x7f5e98067910 msgr2=0x7f5e980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 -- 172.21.15.52:0/1887106842 shutdown_connections 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.441+0000 7f5e9e710700 1 -- 172.21.15.52:0/1887106842 wait complete. 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.442+0000 7f5e9e710700 1 Processor -- start 2023-05-10T01:10:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 -- start start 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84003910 0x7f5e9814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e980af240 0x7f5e980abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814d1a0 con 0x7f5e981646f0 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980afb80 con 0x7f5e84003910 2023-05-10T01:10:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e9e710700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98157590 con 0x7f5e980af240 2023-05-10T01:10:18.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.443+0000 7f5e977fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59192/0 (socket says 172.21.15.52:59192) 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 -- 172.21.15.52:0/2215734611 learned_addr learned my addr 172.21.15.52:0/2215734611 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e97fff700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84003910 0x7f5e9814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e9ccad700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e980af240 0x7f5e980abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 -- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e980af240 msgr2=0x7f5e980abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e980af240 0x7f5e980abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 -- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84003910 msgr2=0x7f5e9814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84003910 0x7f5e9814ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 -- 172.21.15.52:0/2215734611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980a9e10 con 0x7f5e981646f0 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e977fe700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5e8c00e470 tx=0x7f5e8c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00eea0 con 0x7f5e981646f0 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c010450 con 0x7f5e981646f0 2023-05-10T01:10:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0107d0 con 0x7f5e981646f0 2023-05-10T01:10:18.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e980aa0f0 con 0x7f5e981646f0 2023-05-10T01:10:18.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.444+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e980af810 con 0x7f5e981646f0 2023-05-10T01:10:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.445+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e980aa610 con 0x7f5e981646f0 2023-05-10T01:10:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.446+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5e8c010c00 con 0x7f5e981646f0 2023-05-10T01:10:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.446+0000 7f5e7ffff700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 0x7f5e78061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.446+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5e8c079be0 con 0x7f5e981646f0 2023-05-10T01:10:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.446+0000 7f5e97fff700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 0x7f5e78061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.447+0000 7f5e97fff700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 0x7f5e78061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5e88006d50 tx=0x7f5e8801a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.450+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e8c04b180 con 0x7f5e981646f0 2023-05-10T01:10:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.622+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e9806c340 con 0x7f5e981646f0 2023-05-10T01:10:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.622+0000 7f5e7ffff700 1 -- 172.21.15.52:0/2215734611 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e8c04e7a0 con 0x7f5e981646f0 2023-05-10T01:10:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:18.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 msgr2=0x7f5e78061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 0x7f5e78061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5e88006d50 tx=0x7f5e8801a000).stop 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 msgr2=0x7f5e980aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5e8c00e470 tx=0x7f5e8c009040).stop 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 shutdown_connections 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e7805ed90 0x7f5e78061250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e980af240 0x7f5e980abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e84003910 0x7f5e9814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 --2- 172.21.15.52:0/2215734611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e981646f0 0x7f5e980aed50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 >> 172.21.15.52:0/2215734611 conn(0x7f5e98067910 msgr2=0x7f5e9814e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 shutdown_connections 2023-05-10T01:10:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.624+0000 7f5e9e710700 1 -- 172.21.15.52:0/2215734611 wait complete. 2023-05-10T01:10:18.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.753+0000 7fe9309d3700 1 Processor -- start 2023-05-10T01:10:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.753+0000 7fe9309d3700 1 -- start start 2023-05-10T01:10:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe9309d3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe92c151bc0 0x7fe92c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe9309d3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe9309d3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c0c8740 con 0x7fe92c1517e0 2023-05-10T01:10:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe9309d3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c155d60 con 0x7fe92c0a76e0 2023-05-10T01:10:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe9309d3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c0c8460 con 0x7fe92c151bc0 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59200/0 (socket says 172.21.15.52:59200) 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 -- 172.21.15.52:0/577681832 learned_addr learned my addr 172.21.15.52:0/577681832 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92a59c700 1 --2- 172.21.15.52:0/577681832 >> v2:172.21.15.172:3300/0 conn(0x7fe92c151bc0 0x7fe92c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 -- 172.21.15.52:0/577681832 >> v2:172.21.15.172:3300/0 conn(0x7fe92c151bc0 msgr2=0x7fe92c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 --2- 172.21.15.52:0/577681832 >> v2:172.21.15.172:3300/0 conn(0x7fe92c151bc0 0x7fe92c1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 -- 172.21.15.52:0/577681832 >> v1:172.21.15.172:6789/0 conn(0x7fe92c1517e0 legacy=0x7fe92c152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 -- 172.21.15.52:0/577681832 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c155710 con 0x7fe92c0a76e0 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe92b59e700 1 --2- 172.21.15.52:0/577681832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe92c063390 tx=0x7fe924009840).ready entity=mon.0 client_cookie=367ad6079b086fd9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe929d9b700 1 -- 172.21.15.52:0/577681832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400e070 con 0x7fe92c0a76e0 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe929d9b700 1 -- 172.21.15.52:0/577681832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92400ba20 con 0x7fe92c0a76e0 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.754+0000 7fe929d9b700 1 -- 172.21.15.52:0/577681832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400bda0 con 0x7fe92c0a76e0 2023-05-10T01:10:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 -- 172.21.15.52:0/577681832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c0a76e0 msgr2=0x7fe92c0a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 --2- 172.21.15.52:0/577681832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe92c063390 tx=0x7fe924009840).stop 2023-05-10T01:10:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 -- 172.21.15.52:0/577681832 shutdown_connections 2023-05-10T01:10:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 --2- 172.21.15.52:0/577681832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c0a76e0 0x7fe92c0a7ae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 --2- 172.21.15.52:0/577681832 >> v2:172.21.15.172:3300/0 conn(0x7fe92c151bc0 0x7fe92c1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 -- 172.21.15.52:0/577681832 >> 172.21.15.52:0/577681832 conn(0x7fe92c05e810 msgr2=0x7fe92c0622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 -- 172.21.15.52:0/577681832 shutdown_connections 2023-05-10T01:10:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.755+0000 7fe9309d3700 1 -- 172.21.15.52:0/577681832 wait complete. 2023-05-10T01:10:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.756+0000 7fe9309d3700 1 Processor -- start 2023-05-10T01:10:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.756+0000 7fe9309d3700 1 -- start start 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 0x7fe92c14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92c151bc0 0x7fe92c14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c068640 con 0x7fe92c1517e0 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c14ba10 con 0x7fe92c0a76e0 2023-05-10T01:10:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe9309d3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0a51e0 con 0x7fe92c151bc0 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59206/0 (socket says 172.21.15.52:59206) 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 -- 172.21.15.52:0/4234210414 learned_addr learned my addr 172.21.15.52:0/4234210414 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92b59e700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92c151bc0 0x7fe92c14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92ad9d700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 0x7fe92c14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 -- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92c151bc0 msgr2=0x7fe92c14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92c151bc0 0x7fe92c14d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 -- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 msgr2=0x7fe92c14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 0x7fe92c14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92a59c700 1 -- 172.21.15.52:0/4234210414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924009ae0 con 0x7fe92c1517e0 2023-05-10T01:10:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.757+0000 7fe92ad9d700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 0x7fe92c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe92a59c700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe92000e930 tx=0x7fe920009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000c640 con 0x7fe92c1517e0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000c7a0 con 0x7fe92c1517e0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c067ff0 con 0x7fe92c1517e0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000cb20 con 0x7fe92c1517e0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.758+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c0a54c0 con 0x7fe92c1517e0 2023-05-10T01:10:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.759+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c0687f0 con 0x7fe92c1517e0 2023-05-10T01:10:18.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.759+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe920022070 con 0x7fe92c1517e0 2023-05-10T01:10:18.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.759+0000 7fe912ffd700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 0x7fe90c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:18.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.760+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe920079df0 con 0x7fe92c1517e0 2023-05-10T01:10:18.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.760+0000 7fe92ad9d700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 0x7fe90c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:18.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.760+0000 7fe92ad9d700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 0x7fe90c061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe91c001700 tx=0x7fe91c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.764+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe92c0687f0 con 0x7fe92c1517e0 2023-05-10T01:10:18.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.936+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92c047150 con 0x7fe92c1517e0 2023-05-10T01:10:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.937+0000 7fe912ffd700 1 -- 172.21.15.52:0/4234210414 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fe920016030 con 0x7fe92c1517e0 2023-05-10T01:10:18.942 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:18.943 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:18.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 msgr2=0x7fe90c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 0x7fe90c061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe91c001700 tx=0x7fe91c009040).stop 2023-05-10T01:10:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 msgr2=0x7fe92c0a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe92000e930 tx=0x7fe920009060).stop 2023-05-10T01:10:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 shutdown_connections 2023-05-10T01:10:18.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe90c05ed90 0x7fe90c061250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92c151bc0 0x7fe92c14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92c0a76e0 0x7fe92c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 --2- 172.21.15.52:0/4234210414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92c1517e0 0x7fe92c0a4870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:18.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 >> 172.21.15.52:0/4234210414 conn(0x7fe92c05e810 msgr2=0x7fe92c0c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 shutdown_connections 2023-05-10T01:10:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:18.939+0000 7fe9309d3700 1 -- 172.21.15.52:0/4234210414 wait complete. 2023-05-10T01:10:18.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:18.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.076+0000 7fe32f465700 1 Processor -- start 2023-05-10T01:10:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.076+0000 7fe32f465700 1 -- start start 2023-05-10T01:10:19.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe328153f80 0x7fe3280a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3280c5cf0 0x7fe3280c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3280c0140 0x7fe3280c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328069f50 con 0x7fe3280c0140 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32806a9d0 con 0x7fe328153f80 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32f465700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c6660 con 0x7fe3280c5cf0 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3280c0140 0x7fe3280c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3280c0140 0x7fe3280c0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59214/0 (socket says 172.21.15.52:59214) 2023-05-10T01:10:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 -- 172.21.15.52:0/156494274 learned_addr learned my addr 172.21.15.52:0/156494274 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32dc62700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3280c5cf0 0x7fe3280c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32e463700 1 --2- 172.21.15.52:0/156494274 >> v2:172.21.15.172:3300/0 conn(0x7fe328153f80 0x7fe3280a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 -- 172.21.15.52:0/156494274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3280c5cf0 msgr2=0x7fe3280c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3280c5cf0 0x7fe3280c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 -- 172.21.15.52:0/156494274 >> v2:172.21.15.172:3300/0 conn(0x7fe328153f80 msgr2=0x7fe3280a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 --2- 172.21.15.52:0/156494274 >> v2:172.21.15.172:3300/0 conn(0x7fe328153f80 0x7fe3280a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 -- 172.21.15.52:0/156494274 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32806a130 con 0x7fe3280c0140 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.077+0000 7fe32ec64700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c0140 0x7fe3280c0590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe3280caa30 tx=0x7fe3180090f0).ready entity=mon.0 client_cookie=fe8130adad47426 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32d461700 1 -- 172.21.15.52:0/156494274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800b600 con 0x7fe3280c0140 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32d461700 1 -- 172.21.15.52:0/156494274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800b760 con 0x7fe3280c0140 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32d461700 1 -- 172.21.15.52:0/156494274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800bae0 con 0x7fe3280c0140 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 -- 172.21.15.52:0/156494274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c0140 msgr2=0x7fe3280c0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c0140 0x7fe3280c0590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe3280caa30 tx=0x7fe3180090f0).stop 2023-05-10T01:10:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 -- 172.21.15.52:0/156494274 shutdown_connections 2023-05-10T01:10:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c0140 0x7fe3280c0590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 --2- 172.21.15.52:0/156494274 >> v2:172.21.15.172:3300/0 conn(0x7fe328153f80 0x7fe3280a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 --2- 172.21.15.52:0/156494274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3280c5cf0 0x7fe3280c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 -- 172.21.15.52:0/156494274 >> 172.21.15.52:0/156494274 conn(0x7fe3280cb5f0 msgr2=0x7fe3280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 -- 172.21.15.52:0/156494274 shutdown_connections 2023-05-10T01:10:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.078+0000 7fe32f465700 1 -- 172.21.15.52:0/156494274 wait complete. 2023-05-10T01:10:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.079+0000 7fe32f465700 1 Processor -- start 2023-05-10T01:10:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.079+0000 7fe32f465700 1 -- start start 2023-05-10T01:10:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 0x7fe3280c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe328153f80 0x7fe3281510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32814e150 con 0x7fe3280c5cf0 2023-05-10T01:10:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328168900 con 0x7fe3280c0140 2023-05-10T01:10:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32f465700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280a19d0 con 0x7fe328153f80 2023-05-10T01:10:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59220/0 (socket says 172.21.15.52:59220) 2023-05-10T01:10:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 -- 172.21.15.52:0/3900339622 learned_addr learned my addr 172.21.15.52:0/3900339622 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32ec64700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe328153f80 0x7fe3281510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32e463700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 0x7fe3280c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 -- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe328153f80 msgr2=0x7fe3281510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe328153f80 0x7fe3281510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 -- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 msgr2=0x7fe3280c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 0x7fe3280c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32dc62700 1 -- 172.21.15.52:0/3900339622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009370 con 0x7fe3280c5cf0 2023-05-10T01:10:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.080+0000 7fe32e463700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 0x7fe3280c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe32dc62700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe31c00d890 tx=0x7fe31c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0125f0 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c012750 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe328167e20 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c012ad0 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.081+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe328168340 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.082+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328083110 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.082+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe31c013480 con 0x7fe3280c5cf0 2023-05-10T01:10:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.082+0000 7fe3267fc700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 0x7fe308061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.083+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe31c0798c0 con 0x7fe3280c5cf0 2023-05-10T01:10:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.083+0000 7fe32e463700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 0x7fe308061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.083+0000 7fe32e463700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 0x7fe308061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe320009fd0 tx=0x7fe320009740).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.087+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe31c04ae00 con 0x7fe3280c5cf0 2023-05-10T01:10:19.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.261+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe328167e20 con 0x7fe3280c5cf0 2023-05-10T01:10:19.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.262+0000 7fe3267fc700 1 -- 172.21.15.52:0/3900339622 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe328167e20 con 0x7fe3280c5cf0 2023-05-10T01:10:19.270 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 msgr2=0x7fe308061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 0x7fe308061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe320009fd0 tx=0x7fe320009740).stop 2023-05-10T01:10:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 msgr2=0x7fe328167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe31c00d890 tx=0x7fe31c008040).stop 2023-05-10T01:10:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 shutdown_connections 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30805ed90 0x7fe308061250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe328153f80 0x7fe3281510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3280c0140 0x7fe3280c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 --2- 172.21.15.52:0/3900339622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3280c5cf0 0x7fe328167930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 >> 172.21.15.52:0/3900339622 conn(0x7fe3280cb5f0 msgr2=0x7fe3280c0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 shutdown_connections 2023-05-10T01:10:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.264+0000 7fe32f465700 1 -- 172.21.15.52:0/3900339622 wait complete. 2023-05-10T01:10:19.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:19.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.397+0000 7f2d893db700 1 Processor -- start 2023-05-10T01:10:19.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.397+0000 7f2d893db700 1 -- start start 2023-05-10T01:10:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d893db700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d840c1150 0x7f2d840c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d893db700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d893db700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840bfcb0 con 0x7f2d84157700 2023-05-10T01:10:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d893db700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8406a990 con 0x7f2d840c1150 2023-05-10T01:10:19.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d893db700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840aa400 con 0x7f2d840c6090 2023-05-10T01:10:19.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d840c1150 0x7f2d840c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d88bda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d840c1150 0x7f2d840c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:57554/0 (socket says 172.21.15.52:57554) 2023-05-10T01:10:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d88bda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50632/0 (socket says 172.21.15.52:50632) 2023-05-10T01:10:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 -- 172.21.15.52:0/3679840842 learned_addr learned my addr 172.21.15.52:0/3679840842 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d83fff700 1 --1- 172.21.15.52:0/3679840842 >> v1:172.21.15.172:6789/0 conn(0x7f2d84157700 0x7f2d840a9cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42548/0 (socket says 172.21.15.52:42548) 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d82ffd700 1 -- 172.21.15.52:0/3679840842 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408165985 0 0) 0x7f2d840bfcb0 con 0x7f2d84157700 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d82ffd700 1 -- 172.21.15.52:0/3679840842 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d700033f0 con 0x7f2d84157700 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 -- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 msgr2=0x7f2d8415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 -- 172.21.15.52:0/3679840842 >> v1:172.21.15.172:6789/0 conn(0x7f2d84157700 legacy=0x7f2d840a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d837fe700 1 -- 172.21.15.52:0/3679840842 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8406a130 con 0x7f2d840c1150 2023-05-10T01:10:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.398+0000 7f2d88bda700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d837fe700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c1150 0x7f2d840c5ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2d78006fd0 tx=0x7f2d780090f0).ready entity=mon.1 client_cookie=8343cf3ba4a7abe3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d82ffd700 1 -- 172.21.15.52:0/3679840842 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800f510 con 0x7f2d840c1150 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d82ffd700 1 -- 172.21.15.52:0/3679840842 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800f670 con 0x7f2d840c1150 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d82ffd700 1 -- 172.21.15.52:0/3679840842 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800f9f0 con 0x7f2d840c1150 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 -- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c1150 msgr2=0x7f2d840c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c1150 0x7f2d840c5ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2d78006fd0 tx=0x7f2d780090f0).stop 2023-05-10T01:10:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 -- 172.21.15.52:0/3679840842 shutdown_connections 2023-05-10T01:10:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d840c6090 0x7f2d8415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 --2- 172.21.15.52:0/3679840842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c1150 0x7f2d840c5ba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 -- 172.21.15.52:0/3679840842 >> 172.21.15.52:0/3679840842 conn(0x7f2d840cb5f0 msgr2=0x7f2d840c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 -- 172.21.15.52:0/3679840842 shutdown_connections 2023-05-10T01:10:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.399+0000 7f2d893db700 1 -- 172.21.15.52:0/3679840842 wait complete. 2023-05-10T01:10:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.400+0000 7f2d893db700 1 Processor -- start 2023-05-10T01:10:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 -- start start 2023-05-10T01:10:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c6090 0x7f2d84164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d84157700 0x7f2d841563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84154310 con 0x7f2d840c1150 2023-05-10T01:10:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84156e30 con 0x7f2d840c6090 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.401+0000 7f2d893db700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84154b00 con 0x7f2d84157700 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59234/0 (socket says 172.21.15.52:59234) 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 -- 172.21.15.52:0/3724152865 learned_addr learned my addr 172.21.15.52:0/3724152865 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d88bda700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d84157700 0x7f2d841563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d837fe700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c6090 0x7f2d84164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 -- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d84157700 msgr2=0x7f2d841563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d84157700 0x7f2d841563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 -- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c6090 msgr2=0x7f2d84164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c6090 0x7f2d84164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 -- 172.21.15.52:0/3724152865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009a20 con 0x7f2d840c1150 2023-05-10T01:10:19.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d83fff700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2d7400c450 tx=0x7f2d74007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740072e0 con 0x7f2d840c1150 2023-05-10T01:10:19.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d78009370 con 0x7f2d840c1150 2023-05-10T01:10:19.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74007440 con 0x7f2d840c1150 2023-05-10T01:10:19.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740058f0 con 0x7f2d840c1150 2023-05-10T01:10:19.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.402+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84156890 con 0x7f2d840c1150 2023-05-10T01:10:19.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.403+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84083110 con 0x7f2d840c1150 2023-05-10T01:10:19.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.404+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2d74010070 con 0x7f2d840c1150 2023-05-10T01:10:19.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.404+0000 7f2d6bfff700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 0x7f2d64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.404+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d740795b0 con 0x7f2d840c1150 2023-05-10T01:10:19.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.405+0000 7f2d837fe700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 0x7f2d64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.405+0000 7f2d837fe700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 0x7f2d64061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2d78009130 tx=0x7f2d78017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.408+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d7404ab50 con 0x7f2d840c1150 2023-05-10T01:10:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.581+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d84047150 con 0x7f2d840c1150 2023-05-10T01:10:19.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.582+0000 7f2d6bfff700 1 -- 172.21.15.52:0/3724152865 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2d7404e170 con 0x7f2d840c1150 2023-05-10T01:10:19.586 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 msgr2=0x7f2d64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 0x7f2d64061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2d78009130 tx=0x7f2d78017000).stop 2023-05-10T01:10:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 msgr2=0x7f2d841416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2d7400c450 tx=0x7f2d74007c80).stop 2023-05-10T01:10:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 shutdown_connections 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2d6405ed90 0x7f2d64061250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d84157700 0x7f2d841563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d840c1150 0x7f2d841416f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 --2- 172.21.15.52:0/3724152865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d840c6090 0x7f2d84164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 >> 172.21.15.52:0/3724152865 conn(0x7f2d840cb5f0 msgr2=0x7f2d84152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 shutdown_connections 2023-05-10T01:10:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.583+0000 7f2d893db700 1 -- 172.21.15.52:0/3724152865 wait complete. 2023-05-10T01:10:19.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.714+0000 7f750daf2700 1 Processor -- start 2023-05-10T01:10:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.714+0000 7f750daf2700 1 -- start start 2023-05-10T01:10:19.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f750daf2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7508154080 0x7f75080aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f750daf2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f75080685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f750daf2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75080c94c0 con 0x7f7508154460 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f750daf2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75080cb7d0 con 0x7f7508154080 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f750daf2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7508068a90 con 0x7f7508068150 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f75077fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7508154080 0x7f75080aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f7506ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7508154460 0x7f75080a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40026/0 (socket says 172.21.15.52:40026) 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f7506ffd700 1 -- 172.21.15.52:0/1161745997 learned_addr learned my addr 172.21.15.52:0/1161745997 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.715+0000 7f75077fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7508154080 0x7f75080aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59240/0 (socket says 172.21.15.52:59240) 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f7507fff700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f75080685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75077fe700 1 -- 172.21.15.52:0/1161745997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 msgr2=0x7f75080685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75077fe700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f75080685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75077fe700 1 -- 172.21.15.52:0/1161745997 >> v1:172.21.15.52:6789/0 conn(0x7f7508154460 legacy=0x7f75080a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75067fc700 1 -- 172.21.15.52:0/1161745997 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477928500 0 0) 0x7f75080c94c0 con 0x7f7508154460 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75077fe700 1 -- 172.21.15.52:0/1161745997 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080c88b0 con 0x7f7508154080 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f7507fff700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f75080685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75077fe700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f75080aac90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f74f8009760 tx=0x7f74f8009060).ready entity=mon.0 client_cookie=251315c3fba83ffc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75067fc700 1 -- 172.21.15.52:0/1161745997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800b580 con 0x7f7508154080 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75067fc700 1 -- 172.21.15.52:0/1161745997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f800b6e0 con 0x7f7508154080 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f75067fc700 1 -- 172.21.15.52:0/1161745997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800ba60 con 0x7f7508154080 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 -- 172.21.15.52:0/1161745997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 msgr2=0x7f75080aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f75080aac90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f74f8009760 tx=0x7f74f8009060).stop 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 -- 172.21.15.52:0/1161745997 shutdown_connections 2023-05-10T01:10:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f75080685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 --2- 172.21.15.52:0/1161745997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f75080aac90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 -- 172.21.15.52:0/1161745997 >> 172.21.15.52:0/1161745997 conn(0x7f7508067910 msgr2=0x7f75080cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 -- 172.21.15.52:0/1161745997 shutdown_connections 2023-05-10T01:10:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.716+0000 7f750daf2700 1 -- 172.21.15.52:0/1161745997 wait complete. 2023-05-10T01:10:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 Processor -- start 2023-05-10T01:10:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 -- start start 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f7508152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 0x7f75080c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.718+0000 7f750daf2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508152810 con 0x7f7508154080 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f750daf2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508152af0 con 0x7f7508154460 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f750daf2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7508152dd0 con 0x7f7508068150 2023-05-10T01:10:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59248/0 (socket says 172.21.15.52:59248) 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 -- 172.21.15.52:0/3947811902 learned_addr learned my addr 172.21.15.52:0/3947811902 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7507fff700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 0x7f75080c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f75077fe700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f7508152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 -- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 msgr2=0x7f7508152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f7508152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 -- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 msgr2=0x7f75080c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 0x7f75080c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 -- 172.21.15.52:0/3947811902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80092a0 con 0x7f7508154080 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7507fff700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 0x7f75080c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f75077fe700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f7508152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f7506ffd700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f74fc001eb0 tx=0x7f74fc007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0072e0 con 0x7f7508154080 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc007440 con 0x7f7508154080 2023-05-10T01:10:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75081530b0 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0057a0 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.719+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750814f0f0 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.720+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75081538b0 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.720+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74fc010070 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.721+0000 7f74ef7fe700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 0x7f74e8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.721+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f74fc0791f0 con 0x7f7508154080 2023-05-10T01:10:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.721+0000 7f75077fe700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 0x7f74e8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.721+0000 7f75077fe700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 0x7f74e8061220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f74f800b340 tx=0x7f74f8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.725+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75081538b0 con 0x7f7508154080 2023-05-10T01:10:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.897+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75081538b0 con 0x7f7508154080 2023-05-10T01:10:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.897+0000 7f74ef7fe700 1 -- 172.21.15.52:0/3947811902 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75081538b0 con 0x7f7508154080 2023-05-10T01:10:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 msgr2=0x7f74e8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 0x7f74e8061220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f74f800b340 tx=0x7f74f8017000).stop 2023-05-10T01:10:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 msgr2=0x7f750814ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f74fc001eb0 tx=0x7f74fc007e90).stop 2023-05-10T01:10:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 shutdown_connections 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74e805ed60 0x7f74e8061220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7508154460 0x7f75080c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7508068150 0x7f7508152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 --2- 172.21.15.52:0/3947811902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7508154080 0x7f750814ec00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 >> 172.21.15.52:0/3947811902 conn(0x7f7508067910 msgr2=0x7f75080ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 shutdown_connections 2023-05-10T01:10:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:19.899+0000 7f750daf2700 1 -- 172.21.15.52:0/3947811902 wait complete. 2023-05-10T01:10:19.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:20.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.032+0000 7f1004bbd700 1 Processor -- start 2023-05-10T01:10:20.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.032+0000 7f1004bbd700 1 -- start start 2023-05-10T01:10:20.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f1004bbd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10000c5d20 0x7f10000aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f1004bbd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1000153a90 0x7f1000153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f1004bbd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10000c8820 con 0x7f10000c6100 2023-05-10T01:10:20.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f1004bbd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000ca5f0 con 0x7f10000c5d20 2023-05-10T01:10:20.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f1004bbd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000c8b00 con 0x7f1000153a90 2023-05-10T01:10:20.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.033+0000 7f0ffe59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10000c5d20 0x7f10000aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffdd9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f10000c6100 0x7f1000069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40038/0 (socket says 172.21.15.52:40038) 2023-05-10T01:10:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffdd9b700 1 -- 172.21.15.52:0/3303709399 learned_addr learned my addr 172.21.15.52:0/3303709399 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10000c5d20 0x7f10000aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59254/0 (socket says 172.21.15.52:59254) 2023-05-10T01:10:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffed9d700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1000153a90 0x7f1000153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 -- 172.21.15.52:0/3303709399 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1000153a90 msgr2=0x7f1000153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1000153a90 0x7f1000153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 -- 172.21.15.52:0/3303709399 >> v1:172.21.15.52:6789/0 conn(0x7f10000c6100 legacy=0x7f1000069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffd59a700 1 -- 172.21.15.52:0/3303709399 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541490830 0 0) 0x7f10000c8820 con 0x7f10000c6100 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 -- 172.21.15.52:0/3303709399 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000c8de0 con 0x7f10000c5d20 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffe59c700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10000c5d20 0x7f10000aa200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0ff8009760 tx=0x7f0ff8009060).ready entity=mon.0 client_cookie=72408c770e8b3cd6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffd59a700 1 -- 172.21.15.52:0/3303709399 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800b580 con 0x7f10000c5d20 2023-05-10T01:10:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffd59a700 1 -- 172.21.15.52:0/3303709399 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff800b6e0 con 0x7f10000c5d20 2023-05-10T01:10:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.034+0000 7f0ffd59a700 1 -- 172.21.15.52:0/3303709399 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff800ba60 con 0x7f10000c5d20 2023-05-10T01:10:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 -- 172.21.15.52:0/3303709399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10000c5d20 msgr2=0x7f10000aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10000c5d20 0x7f10000aa200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0ff8009760 tx=0x7f0ff8009060).stop 2023-05-10T01:10:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 -- 172.21.15.52:0/3303709399 shutdown_connections 2023-05-10T01:10:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1000153a90 0x7f1000153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 --2- 172.21.15.52:0/3303709399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10000c5d20 0x7f10000aa200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 -- 172.21.15.52:0/3303709399 >> 172.21.15.52:0/3303709399 conn(0x7f10000cb6f0 msgr2=0x7f10000c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 -- 172.21.15.52:0/3303709399 shutdown_connections 2023-05-10T01:10:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.035+0000 7f1004bbd700 1 -- 172.21.15.52:0/3303709399 wait complete. 2023-05-10T01:10:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.036+0000 7f1004bbd700 1 Processor -- start 2023-05-10T01:10:20.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.036+0000 7f1004bbd700 1 -- start start 2023-05-10T01:10:20.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10000c5d20 0x7f100014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 0x7f10001543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000154dd0 con 0x7f1000153a90 2023-05-10T01:10:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000151620 con 0x7f10000c6100 2023-05-10T01:10:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1000151010 con 0x7f10000c5d20 2023-05-10T01:10:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59264/0 (socket says 172.21.15.52:59264) 2023-05-10T01:10:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 -- 172.21.15.52:0/4270222339 learned_addr learned my addr 172.21.15.52:0/4270222339 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffdd9b700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 0x7f10001543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffe59c700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10000c5d20 0x7f100014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 -- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10000c5d20 msgr2=0x7f100014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10000c5d20 0x7f100014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 -- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 msgr2=0x7f10001543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 0x7f10001543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 -- 172.21.15.52:0/4270222339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80092a0 con 0x7f1000153a90 2023-05-10T01:10:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffdd9b700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 0x7f10001543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0ffed9d700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0ff0007f20 tx=0x7f0ff0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000eca0 con 0x7f1000153a90 2023-05-10T01:10:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000ee00 con 0x7f1000153a90 2023-05-10T01:10:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10000b06e0 con 0x7f1000153a90 2023-05-10T01:10:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0014610 con 0x7f1000153a90 2023-05-10T01:10:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.037+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10000b09c0 con 0x7f1000153a90 2023-05-10T01:10:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.038+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100005e0e0 con 0x7f1000153a90 2023-05-10T01:10:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.039+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ff001b030 con 0x7f1000153a90 2023-05-10T01:10:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.039+0000 7f0fee7fc700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 0x7f0fdc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.039+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ff0079f30 con 0x7f1000153a90 2023-05-10T01:10:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.039+0000 7f0ffe59c700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 0x7f0fdc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.040+0000 7f0ffe59c700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 0x7f0fdc061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0ff800b340 tx=0x7f0ff8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.043+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ff004b470 con 0x7f1000153a90 2023-05-10T01:10:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.218+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10001517b0 con 0x7f1000153a90 2023-05-10T01:10:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.219+0000 7f0fee7fc700 1 -- 172.21.15.52:0/4270222339 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ff004ea90 con 0x7f1000153a90 2023-05-10T01:10:20.223 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:20.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 msgr2=0x7f0fdc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 0x7f0fdc061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0ff800b340 tx=0x7f0ff8017000).stop 2023-05-10T01:10:20.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 msgr2=0x7f10001548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0ff0007f20 tx=0x7f0ff0009860).stop 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 shutdown_connections 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0fdc05ed90 0x7f0fdc061250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1000153a90 0x7f10001548e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10000c5d20 0x7f100014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 --2- 172.21.15.52:0/4270222339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10000c6100 0x7f10001543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 >> 172.21.15.52:0/4270222339 conn(0x7f10000cb6f0 msgr2=0x7f10000aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 shutdown_connections 2023-05-10T01:10:20.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.220+0000 7f1004bbd700 1 -- 172.21.15.52:0/4270222339 wait complete. 2023-05-10T01:10:20.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:20.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.353+0000 7efc71473700 1 Processor -- start 2023-05-10T01:10:20.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.353+0000 7efc71473700 1 -- start start 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc71473700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efc6c154160 0x7efc6c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc71473700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc6c154540 0x7efc6c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc71473700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c0c0650 con 0x7efc6c069690 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc71473700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0c1af0 con 0x7efc6c154540 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc71473700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0bfd20 con 0x7efc6c154160 2023-05-10T01:10:20.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc6c154540 0x7efc6c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efc6c069690 0x7efc6c157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40054/0 (socket says 172.21.15.52:40054) 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6b7fe700 1 -- 172.21.15.52:0/2556820614 learned_addr learned my addr 172.21.15.52:0/2556820614 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6affd700 1 --2- 172.21.15.52:0/2556820614 >> v2:172.21.15.172:3300/0 conn(0x7efc6c154160 0x7efc6c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 -- 172.21.15.52:0/2556820614 >> v2:172.21.15.172:3300/0 conn(0x7efc6c154160 msgr2=0x7efc6c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 --2- 172.21.15.52:0/2556820614 >> v2:172.21.15.172:3300/0 conn(0x7efc6c154160 0x7efc6c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 -- 172.21.15.52:0/2556820614 >> v1:172.21.15.52:6789/0 conn(0x7efc6c069690 legacy=0x7efc6c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 -- 172.21.15.52:0/2556820614 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0c0000 con 0x7efc6c154540 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc69ffb700 1 -- 172.21.15.52:0/2556820614 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532725693 0 0) 0x7efc6c0c0650 con 0x7efc6c069690 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc6a7fc700 1 --2- 172.21.15.52:0/2556820614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c0c6150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7efc6c083020 tx=0x7efc54009060).ready entity=mon.0 client_cookie=183447a8bfc88c55 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc69ffb700 1 -- 172.21.15.52:0/2556820614 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540090d0 con 0x7efc6c154540 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.354+0000 7efc69ffb700 1 -- 172.21.15.52:0/2556820614 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400b580 con 0x7efc6c154540 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc69ffb700 1 -- 172.21.15.52:0/2556820614 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400b900 con 0x7efc6c154540 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 -- 172.21.15.52:0/2556820614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 msgr2=0x7efc6c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 --2- 172.21.15.52:0/2556820614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c0c6150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7efc6c083020 tx=0x7efc54009060).stop 2023-05-10T01:10:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 -- 172.21.15.52:0/2556820614 shutdown_connections 2023-05-10T01:10:20.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 --2- 172.21.15.52:0/2556820614 >> v2:172.21.15.172:3300/0 conn(0x7efc6c154160 0x7efc6c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 --2- 172.21.15.52:0/2556820614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c0c6150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 -- 172.21.15.52:0/2556820614 >> 172.21.15.52:0/2556820614 conn(0x7efc6c0cb6f0 msgr2=0x7efc6c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 -- 172.21.15.52:0/2556820614 shutdown_connections 2023-05-10T01:10:20.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.355+0000 7efc71473700 1 -- 172.21.15.52:0/2556820614 wait complete. 2023-05-10T01:10:20.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.356+0000 7efc71473700 1 Processor -- start 2023-05-10T01:10:20.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.356+0000 7efc71473700 1 -- start start 2023-05-10T01:10:20.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 0x7efc6c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 0x7efc6c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0aeb10 con 0x7efc6c154540 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0adc20 con 0x7efc6c069690 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc71473700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0adf00 con 0x7efc6c154160 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59278/0 (socket says 172.21.15.52:59278) 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 -- 172.21.15.52:0/553832111 learned_addr learned my addr 172.21.15.52:0/553832111 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6affd700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 0x7efc6c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6a7fc700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 0x7efc6c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 -- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 msgr2=0x7efc6c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 0x7efc6c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 -- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 msgr2=0x7efc6c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 0x7efc6c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6b7fe700 1 -- 172.21.15.52:0/553832111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540092a0 con 0x7efc6c154540 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6a7fc700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 0x7efc6c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.357+0000 7efc6affd700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 0x7efc6c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc6b7fe700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efc5c00c7e0 tx=0x7efc5c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c005d30 con 0x7efc6c154540 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c005e90 con 0x7efc6c154540 2023-05-10T01:10:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0ae1e0 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c007320 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.358+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0ae7a0 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.359+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0666b0 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.359+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efc5c010030 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.359+0000 7efc62ffd700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 0x7efc50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.360+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efc5c079a80 con 0x7efc6c154540 2023-05-10T01:10:20.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.360+0000 7efc6affd700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 0x7efc50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.360+0000 7efc6affd700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 0x7efc50061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efc6400bb60 tx=0x7efc64008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.364+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc5c04b020 con 0x7efc6c154540 2023-05-10T01:10:20.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.540+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc6c06c340 con 0x7efc6c154540 2023-05-10T01:10:20.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.541+0000 7efc62ffd700 1 -- 172.21.15.52:0/553832111 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7efc5c04e640 con 0x7efc6c154540 2023-05-10T01:10:20.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:20.546 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:20.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 msgr2=0x7efc50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 0x7efc50061250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efc6400bb60 tx=0x7efc64008040).stop 2023-05-10T01:10:20.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 msgr2=0x7efc6c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efc5c00c7e0 tx=0x7efc5c007f90).stop 2023-05-10T01:10:20.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 shutdown_connections 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc5005ed90 0x7efc50061250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc6c154540 0x7efc6c14ead0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc6c069690 0x7efc6c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 --2- 172.21.15.52:0/553832111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc6c154160 0x7efc6c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 >> 172.21.15.52:0/553832111 conn(0x7efc6c0cb6f0 msgr2=0x7efc6c14d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 shutdown_connections 2023-05-10T01:10:20.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.543+0000 7efc71473700 1 -- 172.21.15.52:0/553832111 wait complete. 2023-05-10T01:10:20.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:20.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:20.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.676+0000 7f17b51ba700 1 Processor -- start 2023-05-10T01:10:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.676+0000 7f17b51ba700 1 -- start start 2023-05-10T01:10:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b51ba700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17b0153f80 0x7f17b00a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b51ba700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 0x7f17b00c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b51ba700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b00c6690 con 0x7f17b00c5cf0 2023-05-10T01:10:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b51ba700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b0069f50 con 0x7f17b0153f80 2023-05-10T01:10:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b51ba700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b006a9d0 con 0x7f17b0155370 2023-05-10T01:10:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17affff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17b0153f80 0x7f17b00a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17b49b9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 0x7f17b00c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17af7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f17b00c5cf0 0x7f17b00c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42608/0 (socket says 172.21.15.52:42608) 2023-05-10T01:10:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.677+0000 7f17af7fe700 1 -- 172.21.15.52:0/1430159004 learned_addr learned my addr 172.21.15.52:0/1430159004 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17affff700 1 -- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 msgr2=0x7f17b00c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17affff700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 0x7f17b00c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17affff700 1 -- 172.21.15.52:0/1430159004 >> v1:172.21.15.172:6789/0 conn(0x7f17b00c5cf0 legacy=0x7f17b00c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17affff700 1 -- 172.21.15.52:0/1430159004 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b006a130 con 0x7f17b0153f80 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17aeffd700 1 -- 172.21.15.52:0/1430159004 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383918506 0 0) 0x7f17a4001110 con 0x7f17b00c5cf0 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b49b9700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 0x7f17b00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17affff700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0153f80 0x7f17b00a9d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f17a0009760 tx=0x7f17a0009060).ready entity=mon.1 client_cookie=33e9d39328dc1a0a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17aeffd700 1 -- 172.21.15.52:0/1430159004 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000f510 con 0x7f17b0153f80 2023-05-10T01:10:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17aeffd700 1 -- 172.21.15.52:0/1430159004 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000f670 con 0x7f17b0153f80 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17aeffd700 1 -- 172.21.15.52:0/1430159004 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000f9f0 con 0x7f17b0153f80 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 -- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0153f80 msgr2=0x7f17b00a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0153f80 0x7f17b00a9d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f17a0009760 tx=0x7f17a0009060).stop 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 -- 172.21.15.52:0/1430159004 shutdown_connections 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0155370 0x7f17b00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 --2- 172.21.15.52:0/1430159004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0153f80 0x7f17b00a9d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.678+0000 7f17b51ba700 1 -- 172.21.15.52:0/1430159004 >> 172.21.15.52:0/1430159004 conn(0x7f17b00cb5f0 msgr2=0x7f17b00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.679+0000 7f17b51ba700 1 -- 172.21.15.52:0/1430159004 shutdown_connections 2023-05-10T01:10:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.679+0000 7f17b51ba700 1 -- 172.21.15.52:0/1430159004 wait complete. 2023-05-10T01:10:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.680+0000 7f17b51ba700 1 Processor -- start 2023-05-10T01:10:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.680+0000 7f17b51ba700 1 -- start start 2023-05-10T01:10:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.680+0000 7f17b51ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.680+0000 7f17b51ba700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 0x7f17b00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0155370 0x7f17b00c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0164040 con 0x7f17b00c5cf0 2023-05-10T01:10:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00ae750 con 0x7f17b0155370 2023-05-10T01:10:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00aea30 con 0x7f17b0153f80 2023-05-10T01:10:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59288/0 (socket says 172.21.15.52:59288) 2023-05-10T01:10:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 -- 172.21.15.52:0/492893035 learned_addr learned my addr 172.21.15.52:0/492893035 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b49b9700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0155370 0x7f17b00c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17af7fe700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 0x7f17b00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 -- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 msgr2=0x7f17b00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 0x7f17b00c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 -- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0155370 msgr2=0x7f17b00c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0155370 0x7f17b00c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 -- 172.21.15.52:0/492893035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009a20 con 0x7f17b00c5cf0 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17af7fe700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 0x7f17b00c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17affff700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f17b00c1b70 tx=0x7f17a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000f7e0 con 0x7f17b00c5cf0 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000f940 con 0x7f17b00c5cf0 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00092a0 con 0x7f17b00c5cf0 2023-05-10T01:10:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a001b660 con 0x7f17b00c5cf0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.681+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b00aeff0 con 0x7f17b00c5cf0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.682+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b00ca8d0 con 0x7f17b00c5cf0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.683+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17a002c070 con 0x7f17b00c5cf0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.683+0000 7f1797fff700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 0x7f1790061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.683+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f17a007b510 con 0x7f17b00c5cf0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.683+0000 7f17af7fe700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 0x7f1790061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.684+0000 7f17af7fe700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 0x7f1790061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f17a4007fd0 tx=0x7f17a4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.687+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17a004cb60 con 0x7f17b00c5cf0 2023-05-10T01:10:20.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.860+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f17b0083110 con 0x7f17b00c5cf0 2023-05-10T01:10:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.861+0000 7f1797fff700 1 -- 172.21.15.52:0/492893035 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f17a0006b30 con 0x7f17b00c5cf0 2023-05-10T01:10:20.865 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 msgr2=0x7f1790061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 0x7f1790061250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f17a4007fd0 tx=0x7f17a4009040).stop 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 msgr2=0x7f17b0150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f17b00c1b70 tx=0x7f17a0017000).stop 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 shutdown_connections 2023-05-10T01:10:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.862+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179005ed90 0x7f1790061250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b0155370 0x7f17b00c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b00c5cf0 0x7f17b0150c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 --2- 172.21.15.52:0/492893035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b0153f80 0x7f17b00c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 >> 172.21.15.52:0/492893035 conn(0x7f17b00cb5f0 msgr2=0x7f17b00bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 shutdown_connections 2023-05-10T01:10:20.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.863+0000 7f17b51ba700 1 -- 172.21.15.52:0/492893035 wait complete. 2023-05-10T01:10:20.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:20.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.996+0000 7fb438e2a700 1 Processor -- start 2023-05-10T01:10:21.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.996+0000 7fb438e2a700 1 -- start start 2023-05-10T01:10:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb438e2a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb434153ba0 0x7fb4340698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb438e2a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4340bdf10 0x7fb434067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb438e2a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43405e750 con 0x7fb434153f80 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb438e2a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb434069ee0 con 0x7fb434153ba0 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb438e2a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340bf530 con 0x7fb4340bdf10 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb434153ba0 0x7fb4340698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb432ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb434153f80 0x7fb4340bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40082/0 (socket says 172.21.15.52:40082) 2023-05-10T01:10:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb434153ba0 0x7fb4340698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59296/0 (socket says 172.21.15.52:59296) 2023-05-10T01:10:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb432ffd700 1 -- 172.21.15.52:0/1562307175 learned_addr learned my addr 172.21.15.52:0/1562307175 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb433fff700 1 --2- 172.21.15.52:0/1562307175 >> v2:172.21.15.172:3300/0 conn(0x7fb4340bdf10 0x7fb434067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 -- 172.21.15.52:0/1562307175 >> v2:172.21.15.172:3300/0 conn(0x7fb4340bdf10 msgr2=0x7fb434067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 --2- 172.21.15.52:0/1562307175 >> v2:172.21.15.172:3300/0 conn(0x7fb4340bdf10 0x7fb434067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 -- 172.21.15.52:0/1562307175 >> v1:172.21.15.52:6789/0 conn(0x7fb434153f80 legacy=0x7fb4340bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 -- 172.21.15.52:0/1562307175 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434068440 con 0x7fb434153ba0 2023-05-10T01:10:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4327fc700 1 -- 172.21.15.52:0/1562307175 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358003252 0 0) 0x7fb43405e750 con 0x7fb434153f80 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.997+0000 7fb4337fe700 1 --2- 172.21.15.52:0/1562307175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153ba0 0x7fb4340698b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb434158a10 tx=0x7fb424009060).ready entity=mon.0 client_cookie=ed24670f2d463cb8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb4327fc700 1 -- 172.21.15.52:0/1562307175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400b580 con 0x7fb434153ba0 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb4327fc700 1 -- 172.21.15.52:0/1562307175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42400b6e0 con 0x7fb434153ba0 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb4327fc700 1 -- 172.21.15.52:0/1562307175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400ba60 con 0x7fb434153ba0 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 -- 172.21.15.52:0/1562307175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153ba0 msgr2=0x7fb4340698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 --2- 172.21.15.52:0/1562307175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153ba0 0x7fb4340698b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb434158a10 tx=0x7fb424009060).stop 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 -- 172.21.15.52:0/1562307175 shutdown_connections 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 --2- 172.21.15.52:0/1562307175 >> v2:172.21.15.172:3300/0 conn(0x7fb4340bdf10 0x7fb434067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 --2- 172.21.15.52:0/1562307175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153ba0 0x7fb4340698b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 -- 172.21.15.52:0/1562307175 >> 172.21.15.52:0/1562307175 conn(0x7fb434062d70 msgr2=0x7fb43405dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 -- 172.21.15.52:0/1562307175 shutdown_connections 2023-05-10T01:10:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.998+0000 7fb438e2a700 1 -- 172.21.15.52:0/1562307175 wait complete. 2023-05-10T01:10:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.999+0000 7fb438e2a700 1 Processor -- start 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:20.999+0000 7fb438e2a700 1 -- start start 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4340bdf10 0x7fb4340c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 0x7fb4340c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341543b0 con 0x7fb434153f80 2023-05-10T01:10:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340c0fb0 con 0x7fb434153ba0 2023-05-10T01:10:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb438e2a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340c1230 con 0x7fb4340bdf10 2023-05-10T01:10:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb433fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb433fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59306/0 (socket says 172.21.15.52:59306) 2023-05-10T01:10:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb433fff700 1 -- 172.21.15.52:0/2146210894 learned_addr learned my addr 172.21.15.52:0/2146210894 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb4337fe700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4340bdf10 0x7fb4340c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.000+0000 7fb432ffd700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 0x7fb4340c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 -- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4340bdf10 msgr2=0x7fb4340c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4340bdf10 0x7fb4340c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 -- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 msgr2=0x7fb4340c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 0x7fb4340c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 -- 172.21.15.52:0/2146210894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240092a0 con 0x7fb434153f80 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb432ffd700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 0x7fb4340c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb433fff700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb42c007f30 tx=0x7fb42c0098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00ec40 con 0x7fb434153f80 2023-05-10T01:10:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00eda0 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4340c1510 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c014610 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.001+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4340c1ad0 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.002+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434154520 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.002+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb42c01b030 con 0x7fb434153f80 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.002+0000 7fb41b7fe700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 0x7fb414061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.003+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb42c079f40 con 0x7fb434153f80 2023-05-10T01:10:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.003+0000 7fb4337fe700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 0x7fb414061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.003+0000 7fb4337fe700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 0x7fb414061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb424009fd0 tx=0x7fb424017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.007+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb434154520 con 0x7fb434153f80 2023-05-10T01:10:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.182+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb434154520 con 0x7fb434153f80 2023-05-10T01:10:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.182+0000 7fb41b7fe700 1 -- 172.21.15.52:0/2146210894 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb434154520 con 0x7fb434153f80 2023-05-10T01:10:21.188 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 msgr2=0x7fb414061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 0x7fb414061250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb424009fd0 tx=0x7fb424017000).stop 2023-05-10T01:10:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 msgr2=0x7fb4341442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb42c007f30 tx=0x7fb42c0098e0).stop 2023-05-10T01:10:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 shutdown_connections 2023-05-10T01:10:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb41405ed90 0x7fb414061250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb434153f80 0x7fb4341442f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4340bdf10 0x7fb4340c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 --2- 172.21.15.52:0/2146210894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb434153ba0 0x7fb4340c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 >> 172.21.15.52:0/2146210894 conn(0x7fb434062d70 msgr2=0x7fb4341533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 shutdown_connections 2023-05-10T01:10:21.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.184+0000 7fb438e2a700 1 -- 172.21.15.52:0/2146210894 wait complete. 2023-05-10T01:10:21.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:21.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.318+0000 7fcf09949700 1 Processor -- start 2023-05-10T01:10:21.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.318+0000 7fcf09949700 1 -- start start 2023-05-10T01:10:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf09949700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf09949700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcf040c18c0 0x7fcf040bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf09949700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040c2a40 con 0x7fcf04150f10 2023-05-10T01:10:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf09949700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf040c1e30 con 0x7fcf040c18c0 2023-05-10T01:10:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf09949700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c2110 con 0x7fcf0406a450 2023-05-10T01:10:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf027fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf037fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcf040c18c0 0x7fcf040bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf027fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50716/0 (socket says 172.21.15.52:50716) 2023-05-10T01:10:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf02ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcf04150f10 0x7fcf04069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42632/0 (socket says 172.21.15.52:42632) 2023-05-10T01:10:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.319+0000 7fcf027fc700 1 -- 172.21.15.52:0/1480125896 learned_addr learned my addr 172.21.15.52:0/1480125896 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf01ffb700 1 -- 172.21.15.52:0/1480125896 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502458737 0 0) 0x7fcf040c2a40 con 0x7fcf04150f10 2023-05-10T01:10:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf027fc700 1 -- 172.21.15.52:0/1480125896 >> v2:172.21.15.172:3300/0 conn(0x7fcf040c18c0 msgr2=0x7fcf040bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf027fc700 1 --2- 172.21.15.52:0/1480125896 >> v2:172.21.15.172:3300/0 conn(0x7fcf040c18c0 0x7fcf040bbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf027fc700 1 -- 172.21.15.52:0/1480125896 >> v1:172.21.15.172:6789/0 conn(0x7fcf04150f10 legacy=0x7fcf04069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf027fc700 1 -- 172.21.15.52:0/1480125896 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040c23f0 con 0x7fcf0406a450 2023-05-10T01:10:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf027fc700 1 --2- 172.21.15.52:0/1480125896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcef8009810 tx=0x7fcef8009060).ready entity=mon.2 client_cookie=5c299c046edecbef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf01ffb700 1 -- 172.21.15.52:0/1480125896 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8005880 con 0x7fcf0406a450 2023-05-10T01:10:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf01ffb700 1 -- 172.21.15.52:0/1480125896 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80059e0 con 0x7fcf0406a450 2023-05-10T01:10:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf01ffb700 1 -- 172.21.15.52:0/1480125896 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8005d60 con 0x7fcf0406a450 2023-05-10T01:10:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 -- 172.21.15.52:0/1480125896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 msgr2=0x7fcf04066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 --2- 172.21.15.52:0/1480125896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcef8009810 tx=0x7fcef8009060).stop 2023-05-10T01:10:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 -- 172.21.15.52:0/1480125896 shutdown_connections 2023-05-10T01:10:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 --2- 172.21.15.52:0/1480125896 >> v2:172.21.15.172:3300/0 conn(0x7fcf040c18c0 0x7fcf040bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 --2- 172.21.15.52:0/1480125896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf0406a450 0x7fcf04066390 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.320+0000 7fcf09949700 1 -- 172.21.15.52:0/1480125896 >> 172.21.15.52:0/1480125896 conn(0x7fcf040c4440 msgr2=0x7fcf04066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.321+0000 7fcf09949700 1 -- 172.21.15.52:0/1480125896 shutdown_connections 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.321+0000 7fcf09949700 1 -- 172.21.15.52:0/1480125896 wait complete. 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.322+0000 7fcf09949700 1 Processor -- start 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.322+0000 7fcf09949700 1 -- start start 2023-05-10T01:10:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.322+0000 7fcf09949700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0406a450 0x7fcf0413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf040c18c0 0x7fcf0413ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0413dd90 con 0x7fcf04150f10 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0413e290 con 0x7fcf0406a450 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0413e570 con 0x7fcf040c18c0 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59318/0 (socket says 172.21.15.52:59318) 2023-05-10T01:10:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 -- 172.21.15.52:0/578695896 learned_addr learned my addr 172.21.15.52:0/578695896 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf027fc700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf040c18c0 0x7fcf0413ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf02ffd700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0406a450 0x7fcf0413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 -- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf040c18c0 msgr2=0x7fcf0413ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf040c18c0 0x7fcf0413ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 -- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0406a450 msgr2=0x7fcf0413d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0406a450 0x7fcf0413d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 -- 172.21.15.52:0/578695896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009300 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf037fe700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fcef400e8d0 tx=0x7fcef4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400ee70 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef400c850 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0413e850 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400cbd0 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.323+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0413ee10 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.324+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0413f030 con 0x7fcf04150f10 2023-05-10T01:10:21.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.325+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcef4022070 con 0x7fcf04150f10 2023-05-10T01:10:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.325+0000 7fceeaffd700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 0x7fcee4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.325+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcef4079f40 con 0x7fcf04150f10 2023-05-10T01:10:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.325+0000 7fcf02ffd700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 0x7fcee4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.325+0000 7fcf02ffd700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 0x7fcee4061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcefc007fd0 tx=0x7fcefc007df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.329+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcef40a88f0 con 0x7fcf04150f10 2023-05-10T01:10:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.502+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf04047150 con 0x7fcf04150f10 2023-05-10T01:10:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.503+0000 7fceeaffd700 1 -- 172.21.15.52:0/578695896 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcef40160a0 con 0x7fcf04150f10 2023-05-10T01:10:21.507 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 msgr2=0x7fcee4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 0x7fcee4061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcefc007fd0 tx=0x7fcefc007df0).stop 2023-05-10T01:10:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 msgr2=0x7fcf040a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fcef400e8d0 tx=0x7fcef4009060).stop 2023-05-10T01:10:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 shutdown_connections 2023-05-10T01:10:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcee405ed90 0x7fcee4061250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf04150f10 0x7fcf040a6bc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0406a450 0x7fcf0413d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 --2- 172.21.15.52:0/578695896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf040c18c0 0x7fcf0413ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 >> 172.21.15.52:0/578695896 conn(0x7fcf040c4440 msgr2=0x7fcf041405a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 shutdown_connections 2023-05-10T01:10:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.504+0000 7fcf09949700 1 -- 172.21.15.52:0/578695896 wait complete. 2023-05-10T01:10:21.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 Processor -- start 2023-05-10T01:10:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 -- start start 2023-05-10T01:10:21.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9f40629b0 0x7fa9f41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f40bf940 con 0x7fa9f4063fa0 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f40a7c80 con 0x7fa9f4153cf0 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.636+0000 7fa9f94dc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f4067f50 con 0x7fa9f40629b0 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f27fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa9f4063fa0 0x7fa9f40622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40108/0 (socket says 172.21.15.52:40108) 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f27fc700 1 -- 172.21.15.52:0/3712706516 learned_addr learned my addr 172.21.15.52:0/3712706516 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f37fe700 1 --2- 172.21.15.52:0/3712706516 >> v2:172.21.15.172:3300/0 conn(0x7fa9f40629b0 0x7fa9f41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165637022 0 0) 0x7fa9f40bf940 con 0x7fa9f4063fa0 2023-05-10T01:10:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d40033f0 con 0x7fa9f4063fa0 2023-05-10T01:10:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731596276 0 0) 0x7fa9d40033f0 con 0x7fa9f4063fa0 2023-05-10T01:10:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 >> v2:172.21.15.172:3300/0 conn(0x7fa9f40629b0 msgr2=0x7fa9f41540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 --2- 172.21.15.52:0/3712706516 >> v2:172.21.15.172:3300/0 conn(0x7fa9f40629b0 0x7fa9f41540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 >> v1:172.21.15.172:6789/0 conn(0x7fa9f4153cf0 legacy=0x7fa9f40bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f40a7ef0 con 0x7fa9f4063fa0 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fa9dc001470 con 0x7fa9f4063fa0 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f37fe700 1 --2- 172.21.15.52:0/3712706516 >> v2:172.21.15.172:3300/0 conn(0x7fa9f40629b0 0x7fa9f41540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 >> v1:172.21.15.52:6789/0 conn(0x7fa9f4063fa0 legacy=0x7fa9f40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 0x7fa9d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d4004690 0x7fa9d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9d4005000 0x7fa9d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4067f50 con 0x7fa9d40038e0 2023-05-10T01:10:21.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d400bf60 con 0x7fa9d4004690 2023-05-10T01:10:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d400c0f0 con 0x7fa9d4005000 2023-05-10T01:10:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 0x7fa9d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f37fe700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9d4005000 0x7fa9d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.637+0000 7fa9f27fc700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d4004690 0x7fa9d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 -- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9d4005000 msgr2=0x7fa9d400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9d4005000 0x7fa9d400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 -- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d4004690 msgr2=0x7fa9d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d4004690 0x7fa9d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 -- 172.21.15.52:0/3712706516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40033f0 con 0x7fa9d40038e0 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f27fc700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d4004690 0x7fa9d4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f37fe700 1 -- 172.21.15.52:0/3712706516 reap_dead start 2023-05-10T01:10:21.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 0x7fa9d4003d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa9ec001730 tx=0x7fa9ec007bb0).ready entity=mon.0 client_cookie=d6f9ab8de6f8ae0c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec007020 con 0x7fa9d40038e0 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec007180 con 0x7fa9d40038e0 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f1ffb700 1 -- 172.21.15.52:0/3712706516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec007500 con 0x7fa9d40038e0 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 -- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 msgr2=0x7fa9d4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 0x7fa9d4003d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa9ec001730 tx=0x7fa9ec007bb0).stop 2023-05-10T01:10:21.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 -- 172.21.15.52:0/3712706516 shutdown_connections 2023-05-10T01:10:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/3712706516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9d40038e0 0x7fa9d4003d00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 -- 172.21.15.52:0/3712706516 >> 172.21.15.52:0/3712706516 conn(0x7fa9f405e810 msgr2=0x7fa9f40c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 -- 172.21.15.52:0/3712706516 shutdown_connections 2023-05-10T01:10:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.638+0000 7fa9f94dc700 1 -- 172.21.15.52:0/3712706516 wait complete. 2023-05-10T01:10:21.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 Processor -- start 2023-05-10T01:10:21.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 -- start start 2023-05-10T01:10:21.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 0x7fa9f40a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9f40a4870 0x7fa9f40a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4142280 con 0x7fa9f40c1f00 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40a51e0 con 0x7fa9d40038e0 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f94dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40c0e60 con 0x7fa9f40a4870 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.640+0000 7fa9f27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59336/0 (socket says 172.21.15.52:59336) 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 -- 172.21.15.52:0/2513662724 learned_addr learned my addr 172.21.15.52:0/2513662724 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 0x7fa9f40a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f37fe700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9f40a4870 0x7fa9f40a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 -- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9f40a4870 msgr2=0x7fa9f40a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9f40a4870 0x7fa9f40a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 -- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 msgr2=0x7fa9f40a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 0x7fa9f40a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 -- 172.21.15.52:0/2513662724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f40c1140 con 0x7fa9f40c1f00 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 0x7fa9f40a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f27fc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa9dc00e790 tx=0x7fa9dc001ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc010520 con 0x7fa9f40c1f00 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc010680 con 0x7fa9f40c1f00 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc010a00 con 0x7fa9f40c1f00 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f40c1420 con 0x7fa9f40c1f00 2023-05-10T01:10:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.641+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f40c19e0 con 0x7fa9f40c1f00 2023-05-10T01:10:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.642+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f406c340 con 0x7fa9f40c1f00 2023-05-10T01:10:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.642+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa9dc010d70 con 0x7fa9f40c1f00 2023-05-10T01:10:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.643+0000 7fa9eaffd700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 0x7fa9d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.643+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa9dc079670 con 0x7fa9f40c1f00 2023-05-10T01:10:21.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.643+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 0x7fa9d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.643+0000 7fa9f2ffd700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 0x7fa9d8061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa9ec001510 tx=0x7fa9ec015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.647+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9dc0498f0 con 0x7fa9f40c1f00 2023-05-10T01:10:21.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.818+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9f40a81d0 con 0x7fa9f40c1f00 2023-05-10T01:10:21.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.818+0000 7fa9eaffd700 1 -- 172.21.15.52:0/2513662724 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9dc04ac10 con 0x7fa9f40c1f00 2023-05-10T01:10:21.823 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:21.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 msgr2=0x7fa9d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 0x7fa9d8061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa9ec001510 tx=0x7fa9ec015000).stop 2023-05-10T01:10:21.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 msgr2=0x7fa9f40c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa9dc00e790 tx=0x7fa9dc001ca0).stop 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 shutdown_connections 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa9d805ed90 0x7fa9d8061250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9f40a4870 0x7fa9f40a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d40038e0 0x7fa9f40a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 --2- 172.21.15.52:0/2513662724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9f40c1f00 0x7fa9f40c2380 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 >> 172.21.15.52:0/2513662724 conn(0x7fa9f405e810 msgr2=0x7fa9f40c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 shutdown_connections 2023-05-10T01:10:21.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.820+0000 7fa9f94dc700 1 -- 172.21.15.52:0/2513662724 wait complete. 2023-05-10T01:10:21.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:21.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.949+0000 7f317cb08700 1 Processor -- start 2023-05-10T01:10:21.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.949+0000 7f317cb08700 1 -- start start 2023-05-10T01:10:21.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f317cb08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 0x7f3178154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f317cb08700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31780ad250 0x7f317814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f317cb08700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3178158960 con 0x7f31780c7750 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f317cb08700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780ad6d0 con 0x7f31780ad250 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f317cb08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3178155330 con 0x7f31780c7370 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31780ad250 0x7f317814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31780ad250 0x7f317814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59342/0 (socket says 172.21.15.52:59342) 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 -- 172.21.15.52:0/1366520090 learned_addr learned my addr 172.21.15.52:0/1366520090 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f31777fe700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 0x7f3178154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 -- 172.21.15.52:0/1366520090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 msgr2=0x7f3178154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 0x7f3178154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 -- 172.21.15.52:0/1366520090 >> v1:172.21.15.172:6789/0 conn(0x7f31780c7750 legacy=0x7f31780acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 -- 172.21.15.52:0/1366520090 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178157d50 con 0x7f31780ad250 2023-05-10T01:10:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f31777fe700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 0x7f3178154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.950+0000 7f3177fff700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317814dd60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3170009f20 tx=0x7f3170009840).ready entity=mon.0 client_cookie=c273417f2fd843a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f31767fc700 1 -- 172.21.15.52:0/1366520090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000e070 con 0x7f31780ad250 2023-05-10T01:10:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f31767fc700 1 -- 172.21.15.52:0/1366520090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000ba40 con 0x7f31780ad250 2023-05-10T01:10:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f31767fc700 1 -- 172.21.15.52:0/1366520090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000bdc0 con 0x7f31780ad250 2023-05-10T01:10:21.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 -- 172.21.15.52:0/1366520090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 msgr2=0x7f317814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317814dd60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3170009f20 tx=0x7f3170009840).stop 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 -- 172.21.15.52:0/1366520090 shutdown_connections 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7370 0x7f3178154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 --2- 172.21.15.52:0/1366520090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317814dd60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 -- 172.21.15.52:0/1366520090 >> 172.21.15.52:0/1366520090 conn(0x7f3178068320 msgr2=0x7f3178068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 -- 172.21.15.52:0/1366520090 shutdown_connections 2023-05-10T01:10:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.951+0000 7f317cb08700 1 -- 172.21.15.52:0/1366520090 wait complete. 2023-05-10T01:10:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.952+0000 7f317cb08700 1 Processor -- start 2023-05-10T01:10:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.952+0000 7f317cb08700 1 -- start start 2023-05-10T01:10:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 0x7f31780c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 0x7f3178167760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317813d6f0 con 0x7f31780ad250 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31781656d0 con 0x7f31780c7370 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f317cb08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780c9bc0 con 0x7f31780c7750 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f31777fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f31777fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59346/0 (socket says 172.21.15.52:59346) 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f31777fe700 1 -- 172.21.15.52:0/2340731210 learned_addr learned my addr 172.21.15.52:0/2340731210 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f3176ffd700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 0x7f31780c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.953+0000 7f3177fff700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 0x7f3178167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 -- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 msgr2=0x7f3178167760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 0x7f3178167760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 -- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 msgr2=0x7f31780c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 0x7f31780c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 -- 172.21.15.52:0/2340731210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170009ae0 con 0x7f31780ad250 2023-05-10T01:10:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f3176ffd700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 0x7f31780c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f3177fff700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 0x7f3178167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f31777fe700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f316800c880 tx=0x7f3168008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168010580 con 0x7f31780ad250 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31680106e0 con 0x7f31780ad250 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780c9ea0 con 0x7f31780ad250 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168010a60 con 0x7f31780ad250 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.954+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31780ca180 con 0x7f31780ad250 2023-05-10T01:10:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.955+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3178047150 con 0x7f31780ad250 2023-05-10T01:10:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.956+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f316801b460 con 0x7f31780ad250 2023-05-10T01:10:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.956+0000 7f315f7fe700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 0x7f3158061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.956+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f316807a810 con 0x7f31780ad250 2023-05-10T01:10:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.956+0000 7f3176ffd700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 0x7f3158061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.957+0000 7f3176ffd700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 0x7f3158061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f316c006fd0 tx=0x7f316c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:21.959+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f316804bd50 con 0x7f31780ad250 2023-05-10T01:10:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.134+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3178158030 con 0x7f31780ad250 2023-05-10T01:10:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.135+0000 7f315f7fe700 1 -- 172.21.15.52:0/2340731210 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f316804f370 con 0x7f31780ad250 2023-05-10T01:10:22.139 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 msgr2=0x7f3158061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 0x7f3158061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f316c006fd0 tx=0x7f316c008040).stop 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 msgr2=0x7f317813d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f316800c880 tx=0x7f3168008040).stop 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 shutdown_connections 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f315805ed90 0x7f3158061250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31780c7750 0x7f3178167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31780ad250 0x7f317813d200 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 --2- 172.21.15.52:0/2340731210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31780c7370 0x7f31780c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 >> 172.21.15.52:0/2340731210 conn(0x7f3178068320 msgr2=0x7f31780acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 shutdown_connections 2023-05-10T01:10:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.137+0000 7f317cb08700 1 -- 172.21.15.52:0/2340731210 wait complete. 2023-05-10T01:10:22.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:22.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:22.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.271+0000 7f51df94b700 1 Processor -- start 2023-05-10T01:10:22.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.271+0000 7f51df94b700 1 -- start start 2023-05-10T01:10:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51df94b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51d8154080 0x7f51d80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51df94b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d80685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51df94b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d80c94c0 con 0x7f51d8154460 2023-05-10T01:10:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51df94b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d80cb7d0 con 0x7f51d8154080 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51df94b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d8068a90 con 0x7f51d8068150 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51dd6e7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51d8154080 0x7f51d80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.272+0000 7f51dd6e7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51d8154080 0x7f51d80aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59354/0 (socket says 172.21.15.52:59354) 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 -- 172.21.15.52:0/2949359846 learned_addr learned my addr 172.21.15.52:0/2949359846 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51ddee8700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d80685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 -- 172.21.15.52:0/2949359846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 msgr2=0x7f51d80685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d80685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 -- 172.21.15.52:0/2949359846 >> v1:172.21.15.172:6789/0 conn(0x7f51d8154460 legacy=0x7f51d80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 -- 172.21.15.52:0/2949359846 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80c88b0 con 0x7f51d8154080 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51dd6e7700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154080 0x7f51d80aac90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f51d0006fd0 tx=0x7f51d00090f0).ready entity=mon.0 client_cookie=59ad453296803aae server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51d7fff700 1 -- 172.21.15.52:0/2949359846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000b600 con 0x7f51d8154080 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51d7fff700 1 -- 172.21.15.52:0/2949359846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000b760 con 0x7f51d8154080 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51d7fff700 1 -- 172.21.15.52:0/2949359846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000bae0 con 0x7f51d8154080 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51df94b700 1 -- 172.21.15.52:0/2949359846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154080 msgr2=0x7f51d80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.273+0000 7f51df94b700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154080 0x7f51d80aac90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f51d0006fd0 tx=0x7f51d00090f0).stop 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 -- 172.21.15.52:0/2949359846 shutdown_connections 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 --2- 172.21.15.52:0/2949359846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154080 0x7f51d80aac90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 -- 172.21.15.52:0/2949359846 >> 172.21.15.52:0/2949359846 conn(0x7f51d8067910 msgr2=0x7f51d80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 -- 172.21.15.52:0/2949359846 shutdown_connections 2023-05-10T01:10:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.274+0000 7f51df94b700 1 -- 172.21.15.52:0/2949359846 wait complete. 2023-05-10T01:10:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.275+0000 7f51df94b700 1 Processor -- start 2023-05-10T01:10:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.275+0000 7f51df94b700 1 -- start start 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d8154080 0x7f51d814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d8152f50 con 0x7f51d8154460 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c4460 con 0x7f51d8154080 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d8152ac0 con 0x7f51d8068150 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59362/0 (socket says 172.21.15.52:59362) 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 -- 172.21.15.52:0/942976428 learned_addr learned my addr 172.21.15.52:0/942976428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51dd6e7700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51dcee6700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d8154080 0x7f51d814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 -- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 msgr2=0x7f51d8157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d8157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 -- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d8154080 msgr2=0x7f51d814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d8154080 0x7f51d814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 -- 172.21.15.52:0/942976428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0009370 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51ddee8700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f51c8009fd0 tx=0x7f51c8009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c800ebf0 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c800ed50 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d80c46b0 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8014610 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.276+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d8152750 con 0x7f51d8154460 2023-05-10T01:10:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.277+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d80c4bb0 con 0x7f51d8154460 2023-05-10T01:10:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.278+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f51c801b030 con 0x7f51d8154460 2023-05-10T01:10:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.278+0000 7f51d57fa700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 0x7f51b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.278+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f51c8079e20 con 0x7f51d8154460 2023-05-10T01:10:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.278+0000 7f51dd6e7700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 0x7f51b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.279+0000 7f51dd6e7700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 0x7f51b8061250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f51d0009130 tx=0x7f51d0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.282+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f51c804b360 con 0x7f51d8154460 2023-05-10T01:10:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.454+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51d8152590 con 0x7f51d8154460 2023-05-10T01:10:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.454+0000 7f51d57fa700 1 -- 172.21.15.52:0/942976428 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f51c804e980 con 0x7f51d8154460 2023-05-10T01:10:22.461 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 msgr2=0x7f51b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 0x7f51b8061250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f51d0009130 tx=0x7f51d0017000).stop 2023-05-10T01:10:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 msgr2=0x7f51d80afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f51c8009fd0 tx=0x7f51c8009900).stop 2023-05-10T01:10:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 shutdown_connections 2023-05-10T01:10:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f51b805ed90 0x7f51b8061250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d8154460 0x7f51d80afbe0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d8068150 0x7f51d8157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 --2- 172.21.15.52:0/942976428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d8154080 0x7f51d814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 >> 172.21.15.52:0/942976428 conn(0x7f51d8067910 msgr2=0x7f51d814f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 shutdown_connections 2023-05-10T01:10:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.456+0000 7f51df94b700 1 -- 172.21.15.52:0/942976428 wait complete. 2023-05-10T01:10:22.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 Processor -- start 2023-05-10T01:10:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 -- start start 2023-05-10T01:10:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0bf8068150 0x7f0bf8068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf80c94c0 con 0x7f0bf8154460 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80cb7d0 con 0x7f0bf8068150 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.591+0000 7f0bfd707700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8068a60 con 0x7f0bf8154080 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0bf8068150 0x7f0bf8068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0bf8068150 0x7f0bf8068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59368/0 (socket says 172.21.15.52:59368) 2023-05-10T01:10:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 -- 172.21.15.52:0/2218419728 learned_addr learned my addr 172.21.15.52:0/2218419728 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 -- 172.21.15.52:0/2218419728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 msgr2=0x7f0bf80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf6ffd700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 -- 172.21.15.52:0/2218419728 >> v1:172.21.15.172:6789/0 conn(0x7f0bf8154460 legacy=0x7f0bf80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 -- 172.21.15.52:0/2218419728 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80c88b0 con 0x7f0bf8068150 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf6ffd700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:22.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf77fe700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8068570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0bf0009f20 tx=0x7f0bf0009840).ready entity=mon.0 client_cookie=b1aa382df5f68aba server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf5ffb700 1 -- 172.21.15.52:0/2218419728 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e070 con 0x7f0bf8068150 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf5ffb700 1 -- 172.21.15.52:0/2218419728 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000ba80 con 0x7f0bf8068150 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.592+0000 7f0bf5ffb700 1 -- 172.21.15.52:0/2218419728 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000be00 con 0x7f0bf8068150 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 -- 172.21.15.52:0/2218419728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 msgr2=0x7f0bf8068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8068570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0bf0009f20 tx=0x7f0bf0009840).stop 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 -- 172.21.15.52:0/2218419728 shutdown_connections 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 --2- 172.21.15.52:0/2218419728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8068570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 -- 172.21.15.52:0/2218419728 >> 172.21.15.52:0/2218419728 conn(0x7f0bf8067910 msgr2=0x7f0bf80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 -- 172.21.15.52:0/2218419728 shutdown_connections 2023-05-10T01:10:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.593+0000 7f0bfd707700 1 -- 172.21.15.52:0/2218419728 wait complete. 2023-05-10T01:10:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.594+0000 7f0bfd707700 1 Processor -- start 2023-05-10T01:10:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.594+0000 7f0bfd707700 1 -- start start 2023-05-10T01:10:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf8154460 0x7f0bf80ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8156950 con 0x7f0bf8068150 2023-05-10T01:10:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81553c0 con 0x7f0bf8154460 2023-05-10T01:10:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bfd707700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81556a0 con 0x7f0bf8154080 2023-05-10T01:10:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59372/0 (socket says 172.21.15.52:59372) 2023-05-10T01:10:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 -- 172.21.15.52:0/1681919410 learned_addr learned my addr 172.21.15.52:0/1681919410 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf77fe700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf8154460 0x7f0bf80ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf67fc700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 -- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 msgr2=0x7f0bf80c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 -- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf8154460 msgr2=0x7f0bf80ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf8154460 0x7f0bf80ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 -- 172.21.15.52:0/1681919410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0009ae0 con 0x7f0bf8068150 2023-05-10T01:10:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.595+0000 7f0bf6ffd700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0be800c880 tx=0x7f0be8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8010580 con 0x7f0bf8068150 2023-05-10T01:10:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80106e0 con 0x7f0bf8068150 2023-05-10T01:10:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf8155980 con 0x7f0bf8068150 2023-05-10T01:10:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8010a60 con 0x7f0bf8068150 2023-05-10T01:10:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf8155f40 con 0x7f0bf8068150 2023-05-10T01:10:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.596+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8066720 con 0x7f0bf8068150 2023-05-10T01:10:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.597+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0be801b460 con 0x7f0bf8068150 2023-05-10T01:10:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.597+0000 7f0bdeffd700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 0x7f0bd8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.597+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0be8079bd0 con 0x7f0bf8068150 2023-05-10T01:10:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.598+0000 7f0bf67fc700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 0x7f0bd8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.598+0000 7f0bf67fc700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 0x7f0bd8061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0bf8152c80 tx=0x7f0bec007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.602+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0be804b110 con 0x7f0bf8068150 2023-05-10T01:10:22.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.773+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0bf806bd30 con 0x7f0bf8068150 2023-05-10T01:10:22.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.773+0000 7f0bdeffd700 1 -- 172.21.15.52:0/1681919410 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0be804e730 con 0x7f0bf8068150 2023-05-10T01:10:22.778 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 msgr2=0x7f0bd8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 0x7f0bd8061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0bf8152c80 tx=0x7f0bec007d40).stop 2023-05-10T01:10:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 msgr2=0x7f0bf8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0be800c880 tx=0x7f0be8008040).stop 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 shutdown_connections 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0bd805ed90 0x7f0bd8061250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf8154460 0x7f0bf80ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf8068150 0x7f0bf8156460 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 --2- 172.21.15.52:0/1681919410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf8154080 0x7f0bf80c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 >> 172.21.15.52:0/1681919410 conn(0x7f0bf8067910 msgr2=0x7f0bf8152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 shutdown_connections 2023-05-10T01:10:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.775+0000 7f0bfd707700 1 -- 172.21.15.52:0/1681919410 wait complete. 2023-05-10T01:10:22.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.907+0000 7f6ff1f7a700 1 Processor -- start 2023-05-10T01:10:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.907+0000 7f6ff1f7a700 1 -- start start 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6ff1f7a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fec0a4a30 0x7f6fec0a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6ff1f7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec068a60 0x7f6fec068f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6ff1f7a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec14e930 con 0x7f6fec1549d0 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6ff1f7a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec137420 con 0x7f6fec0a4a30 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6ff1f7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec06a380 con 0x7f6fec068a60 2023-05-10T01:10:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fec0a4a30 0x7f6fec0a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fec0a4a30 0x7f6fec0a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59380/0 (socket says 172.21.15.52:59380) 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 -- 172.21.15.52:0/202595847 learned_addr learned my addr 172.21.15.52:0/202595847 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6febfff700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec068a60 0x7f6fec068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 -- 172.21.15.52:0/202595847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec068a60 msgr2=0x7f6fec068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec068a60 0x7f6fec068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 -- 172.21.15.52:0/202595847 >> v1:172.21.15.172:6789/0 conn(0x7f6fec1549d0 legacy=0x7f6fec154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 -- 172.21.15.52:0/202595847 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec069770 con 0x7f6fec0a4a30 2023-05-10T01:10:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6feb7fe700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec0a4a30 0x7f6fec0a4e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6fdc006fd0 tx=0x7f6fdc0090f0).ready entity=mon.0 client_cookie=d3d23e0950883503 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.908+0000 7f6fea7fc700 1 -- 172.21.15.52:0/202595847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00b600 con 0x7f6fec0a4a30 2023-05-10T01:10:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6fea7fc700 1 -- 172.21.15.52:0/202595847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00b760 con 0x7f6fec0a4a30 2023-05-10T01:10:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6fea7fc700 1 -- 172.21.15.52:0/202595847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00bae0 con 0x7f6fec0a4a30 2023-05-10T01:10:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/202595847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec0a4a30 msgr2=0x7f6fec0a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec0a4a30 0x7f6fec0a4e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6fdc006fd0 tx=0x7f6fdc0090f0).stop 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/202595847 shutdown_connections 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec068a60 0x7f6fec068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/202595847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec0a4a30 0x7f6fec0a4e10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/202595847 >> 172.21.15.52:0/202595847 conn(0x7f6fec0c4610 msgr2=0x7f6fec066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/202595847 shutdown_connections 2023-05-10T01:10:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.909+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/202595847 wait complete. 2023-05-10T01:10:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.910+0000 7f6ff1f7a700 1 Processor -- start 2023-05-10T01:10:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.910+0000 7f6ff1f7a700 1 -- start start 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec0a4a30 0x7f6fec1677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 0x7f6fec167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0a94c0 con 0x7f6fec068a60 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec1681c0 con 0x7f6fec1549d0 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6ff1f7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0a8c20 con 0x7f6fec0a4a30 2023-05-10T01:10:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59388/0 (socket says 172.21.15.52:59388) 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 -- 172.21.15.52:0/3060038511 learned_addr learned my addr 172.21.15.52:0/3060038511 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6febfff700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 0x7f6fec167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feaffd700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec0a4a30 0x7f6fec1677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 -- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec0a4a30 msgr2=0x7f6fec1677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec0a4a30 0x7f6fec1677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 -- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 msgr2=0x7f6fec167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 0x7f6fec167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6feb7fe700 1 -- 172.21.15.52:0/3060038511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc009370 con 0x7f6fec068a60 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.911+0000 7f6febfff700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 0x7f6fec167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6feb7fe700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6fec0637c0 tx=0x7f6fdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00bae0 con 0x7f6fec068a60 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc000c90 con 0x7f6fec068a60 2023-05-10T01:10:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec0a8f00 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc01c670 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.912+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec0be8b0 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.913+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec06c340 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.913+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6fdc02c070 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.913+0000 7f6fd37fe700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 0x7f6fcc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.914+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6fdc07b9d0 con 0x7f6fec068a60 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.914+0000 7f6feaffd700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 0x7f6fcc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.914+0000 7f6feaffd700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 0x7f6fcc061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6fec0a9800 tx=0x7f6fe0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:22.918+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6fdc04d0a0 con 0x7f6fec068a60 2023-05-10T01:10:23.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.092+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fec05dda0 con 0x7f6fec068a60 2023-05-10T01:10:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.093+0000 7f6fd37fe700 1 -- 172.21.15.52:0/3060038511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fdc020070 con 0x7f6fec068a60 2023-05-10T01:10:23.097 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.094+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 msgr2=0x7f6fcc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.094+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 0x7f6fcc061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6fec0a9800 tx=0x7f6fe0008040).stop 2023-05-10T01:10:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.094+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 msgr2=0x7f6fec163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.094+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6fec0637c0 tx=0x7f6fdc017000).stop 2023-05-10T01:10:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 shutdown_connections 2023-05-10T01:10:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6fcc05ed90 0x7f6fcc061250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fec1549d0 0x7f6fec167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fec068a60 0x7f6fec163920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 --2- 172.21.15.52:0/3060038511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6fec0a4a30 0x7f6fec1677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 >> 172.21.15.52:0/3060038511 conn(0x7f6fec0c4610 msgr2=0x7f6fec0c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 shutdown_connections 2023-05-10T01:10:23.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.095+0000 7f6ff1f7a700 1 -- 172.21.15.52:0/3060038511 wait complete. 2023-05-10T01:10:23.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:23.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.230+0000 7f89d4013700 1 Processor -- start 2023-05-10T01:10:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.230+0000 7f89d4013700 1 -- start start 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d4013700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc154460 0x7f89cc0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d4013700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d4013700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0c94c0 con 0x7f89cc154080 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d4013700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0cb7d0 con 0x7f89cc154460 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d4013700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc068a90 con 0x7f89cc068150 2023-05-10T01:10:23.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc154460 0x7f89cc0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89cc154460 0x7f89cc0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59396/0 (socket says 172.21.15.52:59396) 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 -- 172.21.15.52:0/3421903643 learned_addr learned my addr 172.21.15.52:0/3421903643 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d25b0700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 -- 172.21.15.52:0/3421903643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 msgr2=0x7f89cc0685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc0685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 -- 172.21.15.52:0/3421903643 >> v1:172.21.15.172:6789/0 conn(0x7f89cc154080 legacy=0x7f89cc0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.231+0000 7f89d15ae700 1 -- 172.21.15.52:0/3421903643 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0c88b0 con 0x7f89cc154460 2023-05-10T01:10:23.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d15ae700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154460 0x7f89cc0aac90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f89c0006fd0 tx=0x7f89c00090f0).ready entity=mon.0 client_cookie=b98f9ca2a0ad7ba6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d0dad700 1 -- 172.21.15.52:0/3421903643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000b600 con 0x7f89cc154460 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d0dad700 1 -- 172.21.15.52:0/3421903643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000b760 con 0x7f89cc154460 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d0dad700 1 -- 172.21.15.52:0/3421903643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000bae0 con 0x7f89cc154460 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 -- 172.21.15.52:0/3421903643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154460 msgr2=0x7f89cc0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154460 0x7f89cc0aac90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f89c0006fd0 tx=0x7f89c00090f0).stop 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 -- 172.21.15.52:0/3421903643 shutdown_connections 2023-05-10T01:10:23.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 --2- 172.21.15.52:0/3421903643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154460 0x7f89cc0aac90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 -- 172.21.15.52:0/3421903643 >> 172.21.15.52:0/3421903643 conn(0x7f89cc067910 msgr2=0x7f89cc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:23.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 -- 172.21.15.52:0/3421903643 shutdown_connections 2023-05-10T01:10:23.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.232+0000 7f89d4013700 1 -- 172.21.15.52:0/3421903643 wait complete. 2023-05-10T01:10:23.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.233+0000 7f89d4013700 1 Processor -- start 2023-05-10T01:10:23.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.233+0000 7f89d4013700 1 -- start start 2023-05-10T01:10:23.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 0x7f89cc156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc152750 con 0x7f89cc154080 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc14f220 con 0x7f89cc154460 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d4013700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc157470 con 0x7f89cc068150 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d15ae700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d15ae700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59402/0 (socket says 172.21.15.52:59402) 2023-05-10T01:10:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d15ae700 1 -- 172.21.15.52:0/3054917875 learned_addr learned my addr 172.21.15.52:0/3054917875 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d25b0700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 0x7f89cc156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.234+0000 7f89d1daf700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 -- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 msgr2=0x7f89cc14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 -- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 msgr2=0x7f89cc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 0x7f89cc156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 -- 172.21.15.52:0/3054917875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0009370 con 0x7f89cc154080 2023-05-10T01:10:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d25b0700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 0x7f89cc156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d1daf700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:23.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d15ae700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f89cc06bb20 tx=0x7f89c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000b8d0 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000ba30 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc152100 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c001b660 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.235+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc0c21b0 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.236+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc066720 con 0x7f89cc154080 2023-05-10T01:10:23.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.236+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f89c002b070 con 0x7f89cc154080 2023-05-10T01:10:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.237+0000 7f89c9ffb700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 0x7f89ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.237+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f89c007b580 con 0x7f89cc154080 2023-05-10T01:10:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.237+0000 7f89d1daf700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 0x7f89ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.237+0000 7f89d1daf700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 0x7f89ac061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f89cc151ba0 tx=0x7f89c4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.241+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89c0050440 con 0x7f89cc154080 2023-05-10T01:10:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.415+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89cc06c340 con 0x7f89cc154080 2023-05-10T01:10:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.416+0000 7f89c9ffb700 1 -- 172.21.15.52:0/3054917875 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89c001f020 con 0x7f89cc154080 2023-05-10T01:10:23.420 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 msgr2=0x7f89ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 0x7f89ac061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f89cc151ba0 tx=0x7f89c4009040).stop 2023-05-10T01:10:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 msgr2=0x7f89cc0c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f89cc06bb20 tx=0x7f89c0017000).stop 2023-05-10T01:10:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 shutdown_connections 2023-05-10T01:10:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89ac05ed90 0x7f89ac061250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc154460 0x7f89cc156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89cc068150 0x7f89cc14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 --2- 172.21.15.52:0/3054917875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89cc154080 0x7f89cc0c1cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 >> 172.21.15.52:0/3054917875 conn(0x7f89cc067910 msgr2=0x7f89cc0abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 shutdown_connections 2023-05-10T01:10:23.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.418+0000 7f89d4013700 1 -- 172.21.15.52:0/3054917875 wait complete. 2023-05-10T01:10:23.452 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-05-10T01:10:23.453 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:10:23.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-05-10T01:10:23.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.568+0000 7fd3f52a1700 1 Processor -- start 2023-05-10T01:10:23.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.568+0000 7fd3f52a1700 1 -- start start 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3f52a1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3f0154e40 0x7fd3f00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3f52a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f0158960 con 0x7fd3f00c7370 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3f52a1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f01552f0 con 0x7fd3f00ad030 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3f52a1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f0157d50 con 0x7fd3f0154e40 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3effff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd3f00c7370 0x7fd3f00c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40192/0 (socket says 172.21.15.52:40192) 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3effff700 1 -- 172.21.15.52:0/1525657193 learned_addr learned my addr 172.21.15.52:0/1525657193 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3ef7fe700 1 --2- 172.21.15.52:0/1525657193 >> v2:172.21.15.172:3300/0 conn(0x7fd3f0154e40 0x7fd3f00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898873576 0 0) 0x7fd3f0158960 con 0x7fd3f00c7370 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.569+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc0033f0 con 0x7fd3f00c7370 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248885817 0 0) 0x7fd3f01552f0 con 0x7fd3f00ad030 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f0158960 con 0x7fd3f00ad030 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 322451504 0 0) 0x7fd3dc0033f0 con 0x7fd3f00c7370 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 >> v2:172.21.15.172:3300/0 conn(0x7fd3f0154e40 msgr2=0x7fd3f00acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 --2- 172.21.15.52:0/1525657193 >> v2:172.21.15.172:3300/0 conn(0x7fd3f0154e40 0x7fd3f00acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 >> v1:172.21.15.172:6789/0 conn(0x7fd3f00ad030 legacy=0x7fd3f014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0158030 con 0x7fd3f00c7370 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd3e00013f0 con 0x7fd3f00c7370 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 >> v1:172.21.15.52:6789/0 conn(0x7fd3f00c7370 legacy=0x7fd3f00c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc003ac0 0x7fd3dc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc004690 0x7fd3dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 0x7fd3dc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0157d50 con 0x7fd3dc005000 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00beb0 con 0x7fd3dc003ac0 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00c070 con 0x7fd3dc004690 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 0x7fd3dc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3effff700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc003ac0 0x7fd3dc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3ef7fe700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc004690 0x7fd3dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc004690 msgr2=0x7fd3dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc004690 0x7fd3dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc003ac0 msgr2=0x7fd3dc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc003ac0 0x7fd3dc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/1525657193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0033f0 con 0x7fd3dc005000 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3ef7fe700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc004690 0x7fd3dc004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/1525657193 reap_dead start 2023-05-10T01:10:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 0x7fd3dc00b8e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fd3e8001f90 tx=0x7fd3e8007f30).ready entity=mon.0 client_cookie=e184b21d97844e7d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8006a20 con 0x7fd3dc005000 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8006b80 con 0x7fd3dc005000 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.570+0000 7fd3eeffd700 1 -- 172.21.15.52:0/1525657193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800c8b0 con 0x7fd3dc005000 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 -- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 msgr2=0x7fd3dc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 0x7fd3dc00b8e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fd3e8001f90 tx=0x7fd3e8007f30).stop 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 -- 172.21.15.52:0/1525657193 shutdown_connections 2023-05-10T01:10:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/1525657193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3dc005000 0x7fd3dc00b8e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 -- 172.21.15.52:0/1525657193 >> 172.21.15.52:0/1525657193 conn(0x7fd3f0068320 msgr2=0x7fd3f0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 -- 172.21.15.52:0/1525657193 shutdown_connections 2023-05-10T01:10:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.571+0000 7fd3f52a1700 1 -- 172.21.15.52:0/1525657193 wait complete. 2023-05-10T01:10:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.572+0000 7fd3f52a1700 1 Processor -- start 2023-05-10T01:10:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.572+0000 7fd3f52a1700 1 -- start start 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc005000 0x7fd3f00c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 0x7fd3f014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00ada90 con 0x7fd3f01532d0 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0153c40 con 0x7fd3f00c2610 2023-05-10T01:10:23.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f52a1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00adce0 con 0x7fd3dc005000 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59424/0 (socket says 172.21.15.52:59424) 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/735090232 learned_addr learned my addr 172.21.15.52:0/735090232 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3effff700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc005000 0x7fd3f00c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3ef7fe700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 0x7fd3f014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc005000 msgr2=0x7fd3f00c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc005000 0x7fd3f00c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 msgr2=0x7fd3f014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 0x7fd3f014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 -- 172.21.15.52:0/735090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00adfc0 con 0x7fd3f01532d0 2023-05-10T01:10:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3ef7fe700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 0x7fd3f014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.573+0000 7fd3f4aa0700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd3f0083f60 tx=0x7fd3e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.574+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8006a20 con 0x7fd3f01532d0 2023-05-10T01:10:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.574+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800c8b0 con 0x7fd3f01532d0 2023-05-10T01:10:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.574+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801f440 con 0x7fd3f01532d0 2023-05-10T01:10:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.574+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00ae2a0 con 0x7fd3f01532d0 2023-05-10T01:10:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.574+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f00ae860 con 0x7fd3f01532d0 2023-05-10T01:10:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.575+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f00aebd0 con 0x7fd3f01532d0 2023-05-10T01:10:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.575+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd3e8010070 con 0x7fd3f01532d0 2023-05-10T01:10:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.575+0000 7fd3d7fff700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 0x7fd3d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.575+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd3e807b0a0 con 0x7fd3f01532d0 2023-05-10T01:10:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.575+0000 7fd3effff700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 0x7fd3d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.576+0000 7fd3effff700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 0x7fd3d0061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd3e0000e10 tx=0x7fd3e0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.579+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3e804c640 con 0x7fd3f01532d0 2023-05-10T01:10:23.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:23.821+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fd3f0047150 con 0x7fd3f01532d0 2023-05-10T01:10:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.528+0000 7fd3d7fff700 1 -- 172.21.15.52:0/735090232 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd3e8025070 con 0x7fd3f01532d0 2023-05-10T01:10:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 msgr2=0x7fd3d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 0x7fd3d0061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd3e0000e10 tx=0x7fd3e0009040).stop 2023-05-10T01:10:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 msgr2=0x7fd3f0153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd3f0083f60 tx=0x7fd3e8015000).stop 2023-05-10T01:10:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 shutdown_connections 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd3d005ed90 0x7fd3d0061250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f01532d0 0x7fd3f0153750 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3dc005000 0x7fd3f00c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 --2- 172.21.15.52:0/735090232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3f00c2610 0x7fd3f014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 >> 172.21.15.52:0/735090232 conn(0x7fd3f0068320 msgr2=0x7fd3f0150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 shutdown_connections 2023-05-10T01:10:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.531+0000 7fd3f52a1700 1 -- 172.21.15.52:0/735090232 wait complete. 2023-05-10T01:10:24.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:10:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 Processor -- start 2023-05-10T01:10:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 -- start start 2023-05-10T01:10:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feaf40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feaf4153a90 0x7feaf4153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40c8820 con 0x7feaf40c5d20 2023-05-10T01:10:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40ca5f0 con 0x7feaf4153a90 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.675+0000 7feafa678700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c8b00 con 0x7feaf40aa200 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feaf40c5d20 0x7feaf4069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40212/0 (socket says 172.21.15.52:40212) 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf3fff700 1 -- 172.21.15.52:0/2816259918 learned_addr learned my addr 172.21.15.52:0/2816259918 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf8c15700 1 --2- 172.21.15.52:0/2816259918 >> v2:172.21.15.172:3300/0 conn(0x7feaf4153a90 0x7feaf4153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf37fe700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feaf40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204787405 0 0) 0x7feaf40c8820 con 0x7feaf40c5d20 2023-05-10T01:10:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae00033f0 con 0x7feaf40c5d20 2023-05-10T01:10:24.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933501963 0 0) 0x7feae00033f0 con 0x7feaf40c5d20 2023-05-10T01:10:24.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 msgr2=0x7feaf40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:24.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feaf40c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 >> v2:172.21.15.172:3300/0 conn(0x7feaf4153a90 msgr2=0x7feaf4153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:24.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 --2- 172.21.15.52:0/2816259918 >> v2:172.21.15.172:3300/0 conn(0x7feaf4153a90 0x7feaf4153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40c8de0 con 0x7feaf40c5d20 2023-05-10T01:10:24.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7feae4001470 con 0x7feaf40c5d20 2023-05-10T01:10:24.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 >> v1:172.21.15.52:6789/0 conn(0x7feaf40c5d20 legacy=0x7feaf4069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feae00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae0003e10 0x7feae0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feae0004b80 0x7feae0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40ca5f0 con 0x7feae0004b80 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c8b00 con 0x7feae0003e10 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae000b8e0 con 0x7feaf40aa200 2023-05-10T01:10:24.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf8c15700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feae0004b80 0x7feae0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf3fff700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feae00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.676+0000 7feaf37fe700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae0003e10 0x7feae0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 -- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 msgr2=0x7feae00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf40aa200 0x7feae00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 -- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae0003e10 msgr2=0x7feae0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feae0003e10 0x7feae0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 -- 172.21.15.52:0/2816259918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00033f0 con 0x7feae0004b80 2023-05-10T01:10:24.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feae0004b80 0x7feae0005000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feaec00e240 tx=0x7feaec00b040).ready entity=mon.0 client_cookie=5b604c1cb0ca3bb6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec009ac0 con 0x7feae0004b80 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec00f040 con 0x7feae0004b80 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf2ffd700 1 -- 172.21.15.52:0/2816259918 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec00ed00 con 0x7feae0004b80 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feafa678700 1 -- 172.21.15.52:0/2816259918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feae0004b80 msgr2=0x7feae0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feafa678700 1 --2- 172.21.15.52:0/2816259918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feae0004b80 0x7feae0005000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feaec00e240 tx=0x7feaec00b040).stop 2023-05-10T01:10:24.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feaf8c15700 1 -- 172.21.15.52:0/2816259918 reap_dead start 2023-05-10T01:10:24.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feafa678700 1 -- 172.21.15.52:0/2816259918 shutdown_connections 2023-05-10T01:10:24.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feafa678700 1 -- 172.21.15.52:0/2816259918 >> 172.21.15.52:0/2816259918 conn(0x7feaf40cb6f0 msgr2=0x7feaf40c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:24.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.677+0000 7feafa678700 1 -- 172.21.15.52:0/2816259918 shutdown_connections 2023-05-10T01:10:24.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.678+0000 7feafa678700 1 -- 172.21.15.52:0/2816259918 wait complete. 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.679+0000 7feafa678700 1 Processor -- start 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.679+0000 7feafa678700 1 -- start start 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.679+0000 7feafa678700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf4068460 0x7feaf4068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.679+0000 7feafa678700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.679+0000 7feafa678700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4168720 0x7feaf41670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feafa678700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40ae940 con 0x7feaf40c3b90 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feafa678700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4164c80 con 0x7feaf4168720 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feafa678700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40add30 con 0x7feaf4068460 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59442/0 (socket says 172.21.15.52:59442) 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 -- 172.21.15.52:0/3132173385 learned_addr learned my addr 172.21.15.52:0/3132173385 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf3fff700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf4068460 0x7feaf4068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf8c15700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4168720 0x7feaf41670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 -- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf4068460 msgr2=0x7feaf4068840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf4068460 0x7feaf4068840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 -- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4168720 msgr2=0x7feaf41670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4168720 0x7feaf41670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 -- 172.21.15.52:0/3132173385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40ae010 con 0x7feaf40c3b90 2023-05-10T01:10:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feaf37fe700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7feae8009fd0 tx=0x7feae8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800f940 con 0x7feaf40c3b90 2023-05-10T01:10:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800faa0 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf40ae2f0 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800fe20 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.680+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4168ba0 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.681+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf4066720 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.682+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feae8024070 con 0x7feaf40c3b90 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.682+0000 7feadbfff700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 0x7fead4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.682+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feae807a590 con 0x7feaf40c3b90 2023-05-10T01:10:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.682+0000 7feaf3fff700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 0x7fead4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.683+0000 7feaf3fff700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 0x7fead4061280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7feae40015a0 tx=0x7feae4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.686+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feae804bb30 con 0x7feaf40c3b90 2023-05-10T01:10:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.860+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feaf406c340 con 0x7feaf40c3b90 2023-05-10T01:10:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.863+0000 7feadbfff700 1 -- 172.21.15.52:0/3132173385 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7feae8018020 con 0x7feaf40c3b90 2023-05-10T01:10:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 msgr2=0x7fead4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 0x7fead4061280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7feae40015a0 tx=0x7feae4009040).stop 2023-05-10T01:10:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 msgr2=0x7feaf4164790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7feae8009fd0 tx=0x7feae8009060).stop 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 shutdown_connections 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fead405edc0 0x7fead4061280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf4168720 0x7feaf41670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feaf4068460 0x7feaf4068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 --2- 172.21.15.52:0/3132173385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feaf40c3b90 0x7feaf4164790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 >> 172.21.15.52:0/3132173385 conn(0x7feaf40cb6f0 msgr2=0x7feaf414f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 shutdown_connections 2023-05-10T01:10:24.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:24.865+0000 7feafa678700 1 -- 172.21.15.52:0/3132173385 wait complete. 2023-05-10T01:10:24.881 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:10:24.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:10:24.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:10:24.941 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:10:24.942 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:10:24.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:24.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-05-10T01:10:24.984 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:10:24.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:24.985 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:10:25.039 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-05-10T01:10:25.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:25.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-05-10T01:10:25.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:10:25.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:25.084 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-10T01:10:25.140 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-05-10T01:10:25.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:25.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-05-10T01:10:25.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:10:25.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:25.182 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-10T01:10:25.239 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-05-10T01:10:25.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:25.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-05-10T01:10:25.282 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:10:25.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:25.284 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-10T01:10:25.339 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:10:25.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:25.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 Processor -- start 2023-05-10T01:10:25.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 -- start start 2023-05-10T01:10:25.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30ac1570c0 0x7f30ac1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30ac0629b0 0x7f30ac1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac158110 con 0x7f30ac062fe0 2023-05-10T01:10:25.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac069030 con 0x7f30ac1570c0 2023-05-10T01:10:25.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.456+0000 7f30b1086700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac157b30 con 0x7f30ac0629b0 2023-05-10T01:10:25.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30ac1570c0 0x7f30ac1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30ac1570c0 0x7f30ac1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59448/0 (socket says 172.21.15.52:59448) 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 -- 172.21.15.52:0/905558042 learned_addr learned my addr 172.21.15.52:0/905558042 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30ab59e700 1 --2- 172.21.15.52:0/905558042 >> v2:172.21.15.172:3300/0 conn(0x7f30ac0629b0 0x7f30ac1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 -- 172.21.15.52:0/905558042 >> v2:172.21.15.172:3300/0 conn(0x7f30ac0629b0 msgr2=0x7f30ac1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 --2- 172.21.15.52:0/905558042 >> v2:172.21.15.172:3300/0 conn(0x7f30ac0629b0 0x7f30ac1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 -- 172.21.15.52:0/905558042 >> v1:172.21.15.172:6789/0 conn(0x7f30ac062fe0 legacy=0x7f30ac0622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 -- 172.21.15.52:0/905558042 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac067f50 con 0x7f30ac1570c0 2023-05-10T01:10:25.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30aad9d700 1 --2- 172.21.15.52:0/905558042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac1574a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f30ac0c3020 tx=0x7f30a4009840).ready entity=mon.0 client_cookie=32a659bb440199f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30a9d9b700 1 -- 172.21.15.52:0/905558042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400e070 con 0x7f30ac1570c0 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30a9d9b700 1 -- 172.21.15.52:0/905558042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400ba50 con 0x7f30ac1570c0 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.457+0000 7f30a9d9b700 1 -- 172.21.15.52:0/905558042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400bdd0 con 0x7f30ac1570c0 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 -- 172.21.15.52:0/905558042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 msgr2=0x7f30ac1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 --2- 172.21.15.52:0/905558042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac1574a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f30ac0c3020 tx=0x7f30a4009840).stop 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 -- 172.21.15.52:0/905558042 shutdown_connections 2023-05-10T01:10:25.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 --2- 172.21.15.52:0/905558042 >> v2:172.21.15.172:3300/0 conn(0x7f30ac0629b0 0x7f30ac1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 --2- 172.21.15.52:0/905558042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac1574a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 -- 172.21.15.52:0/905558042 >> 172.21.15.52:0/905558042 conn(0x7f30ac0c8a90 msgr2=0x7f30ac0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:25.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 -- 172.21.15.52:0/905558042 shutdown_connections 2023-05-10T01:10:25.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.458+0000 7f30b1086700 1 -- 172.21.15.52:0/905558042 wait complete. 2023-05-10T01:10:25.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.459+0000 7f30b1086700 1 Processor -- start 2023-05-10T01:10:25.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.459+0000 7f30b1086700 1 -- start start 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30ac0629b0 0x7f30ac0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac062fe0 0x7f30ac151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac1654c0 con 0x7f30ac1570c0 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac152130 con 0x7f30ac062fe0 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30b1086700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac1651e0 con 0x7f30ac0629b0 2023-05-10T01:10:25.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59458/0 (socket says 172.21.15.52:59458) 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 -- 172.21.15.52:0/2724822272 learned_addr learned my addr 172.21.15.52:0/2724822272 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30aa59c700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac062fe0 0x7f30ac151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30aad9d700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30ac0629b0 0x7f30ac0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 -- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30ac0629b0 msgr2=0x7f30ac0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30ac0629b0 0x7f30ac0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 -- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac062fe0 msgr2=0x7f30ac151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac062fe0 0x7f30ac151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 -- 172.21.15.52:0/2724822272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4009ae0 con 0x7f30ac1570c0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30ab59e700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f309c00d890 tx=0x7f309c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.460+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c011590 con 0x7f30ac1570c0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.461+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c0116f0 con 0x7f30ac1570c0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.461+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac1657d0 con 0x7f30ac1570c0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.461+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c011a70 con 0x7f30ac1570c0 2023-05-10T01:10:25.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.461+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac165d90 con 0x7f30ac1570c0 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.462+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac06c340 con 0x7f30ac1570c0 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.462+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f309c01c460 con 0x7f30ac1570c0 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.462+0000 7f30a2ffd700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 0x7f3090061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.462+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f309c079980 con 0x7f30ac1570c0 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.462+0000 7f30aad9d700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 0x7f3090061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.463+0000 7f30aad9d700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 0x7f3090061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f30a4009930 tx=0x7f30a4009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.466+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f309c04aec0 con 0x7f30ac1570c0 2023-05-10T01:10:25.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.685+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30ac064820 con 0x7f30ac1570c0 2023-05-10T01:10:25.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.686+0000 7f30a2ffd700 1 -- 172.21.15.52:0/2724822272 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f309c04e4e0 con 0x7f30ac1570c0 2023-05-10T01:10:25.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:25.690 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:25.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.687+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 msgr2=0x7f3090061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 0x7f3090061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f30a4009930 tx=0x7f30a4009840).stop 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 msgr2=0x7f30ac151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f309c00d890 tx=0x7f309c008040).stop 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 shutdown_connections 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f309005ed90 0x7f3090061250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ac1570c0 0x7f30ac151c40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30ac0629b0 0x7f30ac0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 --2- 172.21.15.52:0/2724822272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac062fe0 0x7f30ac151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 >> 172.21.15.52:0/2724822272 conn(0x7f30ac0c8a90 msgr2=0x7f30ac152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 shutdown_connections 2023-05-10T01:10:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.688+0000 7f30b1086700 1 -- 172.21.15.52:0/2724822272 wait complete. 2023-05-10T01:10:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:25.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:25.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.818+0000 7f1613d1e700 1 Processor -- start 2023-05-10T01:10:25.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.819+0000 7f1613d1e700 1 -- start start 2023-05-10T01:10:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.819+0000 7f1613d1e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f160c154540 0x7f160c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1613d1e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c0c0650 con 0x7f160c154160 2023-05-10T01:10:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1613d1e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c069fb0 con 0x7f160c069b80 2023-05-10T01:10:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1613d1e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0bfd20 con 0x7f160c154540 2023-05-10T01:10:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f16112b9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f160c154540 0x7f160c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1611aba700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f160c154160 0x7f160c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40246/0 (socket says 172.21.15.52:40246) 2023-05-10T01:10:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1611aba700 1 -- 172.21.15.52:0/13692397 learned_addr learned my addr 172.21.15.52:0/13692397 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f16112b9700 1 -- 172.21.15.52:0/13692397 >> v1:172.21.15.172:6789/0 conn(0x7f160c069b80 legacy=0x7f160c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f16112b9700 1 -- 172.21.15.52:0/13692397 >> v1:172.21.15.52:6789/0 conn(0x7f160c154160 legacy=0x7f160c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1610ab8700 1 -- 172.21.15.52:0/13692397 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190012379 0 0) 0x7f160c0c0650 con 0x7f160c154160 2023-05-10T01:10:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f16112b9700 1 -- 172.21.15.52:0/13692397 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0c0000 con 0x7f160c154540 2023-05-10T01:10:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f16112b9700 1 --2- 172.21.15.52:0/13692397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154540 0x7f160c069690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1600009760 tx=0x7f1600009060).ready entity=mon.0 client_cookie=481f435e5883e3bf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1610ab8700 1 -- 172.21.15.52:0/13692397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000b580 con 0x7f160c154540 2023-05-10T01:10:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1610ab8700 1 -- 172.21.15.52:0/13692397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000b6e0 con 0x7f160c154540 2023-05-10T01:10:25.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.820+0000 7f1610ab8700 1 -- 172.21.15.52:0/13692397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000ba60 con 0x7f160c154540 2023-05-10T01:10:25.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 -- 172.21.15.52:0/13692397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154540 msgr2=0x7f160c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 --2- 172.21.15.52:0/13692397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154540 0x7f160c069690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f1600009760 tx=0x7f1600009060).stop 2023-05-10T01:10:25.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 -- 172.21.15.52:0/13692397 shutdown_connections 2023-05-10T01:10:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 --2- 172.21.15.52:0/13692397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154540 0x7f160c069690 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 -- 172.21.15.52:0/13692397 >> 172.21.15.52:0/13692397 conn(0x7f160c0cb740 msgr2=0x7f160c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 -- 172.21.15.52:0/13692397 shutdown_connections 2023-05-10T01:10:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.821+0000 7f1613d1e700 1 -- 172.21.15.52:0/13692397 wait complete. 2023-05-10T01:10:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.822+0000 7f1613d1e700 1 Processor -- start 2023-05-10T01:10:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.822+0000 7f1613d1e700 1 -- start start 2023-05-10T01:10:25.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160c069b80 0x7f160c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f160c154540 0x7f160c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c151fa0 con 0x7f160c154160 2023-05-10T01:10:25.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c152430 con 0x7f160c069b80 2023-05-10T01:10:25.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c151390 con 0x7f160c154540 2023-05-10T01:10:25.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59470/0 (socket says 172.21.15.52:59470) 2023-05-10T01:10:25.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 -- 172.21.15.52:0/2772835149 learned_addr learned my addr 172.21.15.52:0/2772835149 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:25.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1611aba700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160c069b80 0x7f160c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16122bb700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f160c154540 0x7f160c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 -- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f160c154540 msgr2=0x7f160c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f160c154540 0x7f160c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 -- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160c069b80 msgr2=0x7f160c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:25.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160c069b80 0x7f160c0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:25.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 -- 172.21.15.52:0/2772835149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000092a0 con 0x7f160c154160 2023-05-10T01:10:25.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f16112b9700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f160c083050 tx=0x7f1600017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000ba60 con 0x7f160c154160 2023-05-10T01:10:25.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600000c90 con 0x7f160c154160 2023-05-10T01:10:25.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c151670 con 0x7f160c154160 2023-05-10T01:10:25.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.823+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160001b670 con 0x7f160c154160 2023-05-10T01:10:25.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.824+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c151c30 con 0x7f160c154160 2023-05-10T01:10:25.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.825+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c0666b0 con 0x7f160c154160 2023-05-10T01:10:25.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.825+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f160002a070 con 0x7f160c154160 2023-05-10T01:10:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.825+0000 7f1609ffb700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 0x7f15ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.825+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f160007b1f0 con 0x7f160c154160 2023-05-10T01:10:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.826+0000 7f1611aba700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 0x7f15ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.826+0000 7f1611aba700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 0x7f15ec061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1604001560 tx=0x7f1604009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:25.830+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f160004c790 con 0x7f160c154160 2023-05-10T01:10:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.003+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f160c06c340 con 0x7f160c154160 2023-05-10T01:10:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.004+0000 7f1609ffb700 1 -- 172.21.15.52:0/2772835149 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f1600028090 con 0x7f160c154160 2023-05-10T01:10:26.008 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:26.008 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:26.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 msgr2=0x7f15ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 0x7f15ec061250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f1604001560 tx=0x7f1604009040).stop 2023-05-10T01:10:26.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 msgr2=0x7f160c0af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f160c083050 tx=0x7f1600017000).stop 2023-05-10T01:10:26.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 shutdown_connections 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f15ec05ed90 0x7f15ec061250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f160c154540 0x7f160c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160c069b80 0x7f160c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 --2- 172.21.15.52:0/2772835149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f160c154160 0x7f160c0af840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 >> 172.21.15.52:0/2772835149 conn(0x7f160c0cb740 msgr2=0x7f160c0aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 shutdown_connections 2023-05-10T01:10:26.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.006+0000 7f1613d1e700 1 -- 172.21.15.52:0/2772835149 wait complete. 2023-05-10T01:10:26.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:09:51.441867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:09:52.727675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:10:26.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:26.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.140+0000 7fc610104700 1 Processor -- start 2023-05-10T01:10:26.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.140+0000 7fc610104700 1 -- start start 2023-05-10T01:10:26.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc610104700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc6080a6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc610104700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc608150f80 0x7fc6080a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc610104700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc608064e80 con 0x7fc608150ba0 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc610104700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc608065a00 con 0x7fc608150f80 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc610104700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a7150 con 0x7fc608068660 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60dea0700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc608150ba0 0x7fc608067f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40260/0 (socket says 172.21.15.52:40260) 2023-05-10T01:10:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60dea0700 1 -- 172.21.15.52:0/2107880884 learned_addr learned my addr 172.21.15.52:0/2107880884 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60d69f700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc6080a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/2107880884 >> v2:172.21.15.172:3300/0 conn(0x7fc608150f80 0x7fc6080a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751971323 0 0) 0x7fc608064e80 con 0x7fc608150ba0 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.141+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f40033f0 con 0x7fc608150ba0 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151830193 0 0) 0x7fc5f40033f0 con 0x7fc608150ba0 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 msgr2=0x7fc6080a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc6080a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 >> v2:172.21.15.172:3300/0 conn(0x7fc608150f80 msgr2=0x7fc6080a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 --2- 172.21.15.52:0/2107880884 >> v2:172.21.15.172:3300/0 conn(0x7fc608150f80 0x7fc6080a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080635a0 con 0x7fc608150ba0 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fc6000017f0 con 0x7fc608150ba0 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 >> v1:172.21.15.52:6789/0 conn(0x7fc608150ba0 legacy=0x7fc608067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5f40038e0 0x7fc5f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4004690 0x7fc5f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc5f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608065a00 con 0x7fc5f40038e0 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a7150 con 0x7fc5f4004690 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f400daf0 con 0x7fc608068660 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5f40038e0 0x7fc5f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60d69f700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4004690 0x7fc5f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc5f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 -- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 msgr2=0x7fc5f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc5f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 -- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4004690 msgr2=0x7fc5f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4004690 0x7fc5f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 -- 172.21.15.52:0/2107880884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40033f0 con 0x7fc5f40038e0 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60d69f700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4004690 0x7fc5f4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc608068660 0x7fc5f4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.142+0000 7fc60dea0700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5f40038e0 0x7fc5f4003d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fc60000c530 tx=0x7fc600002210).ready entity=mon.0 client_cookie=ef9d7dc2dae4a9b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600007de0 con 0x7fc5f40038e0 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60000ce60 con 0x7fc5f40038e0 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc60ce9e700 1 -- 172.21.15.52:0/2107880884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600005d30 con 0x7fc5f40038e0 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 -- 172.21.15.52:0/2107880884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5f40038e0 msgr2=0x7fc5f4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 --2- 172.21.15.52:0/2107880884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5f40038e0 0x7fc5f4003d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fc60000c530 tx=0x7fc600002210).stop 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc60e6a1700 1 -- 172.21.15.52:0/2107880884 reap_dead start 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 -- 172.21.15.52:0/2107880884 shutdown_connections 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 -- 172.21.15.52:0/2107880884 >> 172.21.15.52:0/2107880884 conn(0x7fc6080c8410 msgr2=0x7fc6080c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 -- 172.21.15.52:0/2107880884 shutdown_connections 2023-05-10T01:10:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.143+0000 7fc610104700 1 -- 172.21.15.52:0/2107880884 wait complete. 2023-05-10T01:10:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.144+0000 7fc610104700 1 Processor -- start 2023-05-10T01:10:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.144+0000 7fc610104700 1 -- start start 2023-05-10T01:10:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f40038e0 0x7fc6080aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6081496f0 0x7fc6080a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a7430 con 0x7fc608149b70 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a7710 con 0x7fc5f40038e0 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc610104700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a9ac0 con 0x7fc6081496f0 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59492/0 (socket says 172.21.15.52:59492) 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 -- 172.21.15.52:0/4182263575 learned_addr learned my addr 172.21.15.52:0/4182263575 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60dea0700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f40038e0 0x7fc6080aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60d69f700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6081496f0 0x7fc6080a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 -- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6081496f0 msgr2=0x7fc6080a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6081496f0 0x7fc6080a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 -- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f40038e0 msgr2=0x7fc6080aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f40038e0 0x7fc6080aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.145+0000 7fc60e6a1700 1 -- 172.21.15.52:0/4182263575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080a9da0 con 0x7fc608149b70 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc60e6a1700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc6081513f0 tx=0x7fc5f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8015440 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80155a0 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8015940 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6080aa080 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.146+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6080abf60 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.147+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6080a7880 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.147+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc5f800f070 con 0x7fc608149b70 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.147+0000 7fc605ffb700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 0x7fc5e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.147+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc5f8079920 con 0x7fc608149b70 2023-05-10T01:10:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.147+0000 7fc60dea0700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 0x7fc5e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.148+0000 7fc60dea0700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 0x7fc5e8061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc600002250 tx=0x7fc600015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.151+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5f804aec0 con 0x7fc608149b70 2023-05-10T01:10:26.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.324+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc60806c340 con 0x7fc608149b70 2023-05-10T01:10:26.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.324+0000 7fc605ffb700 1 -- 172.21.15.52:0/4182263575 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc5f804e4e0 con 0x7fc608149b70 2023-05-10T01:10:26.328 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 msgr2=0x7fc5e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 0x7fc5e8061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc600002250 tx=0x7fc600015000).stop 2023-05-10T01:10:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 msgr2=0x7fc6080a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc6081513f0 tx=0x7fc5f8008040).stop 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 shutdown_connections 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc5e805ed90 0x7fc5e8061250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc608149b70 0x7fc6080a94f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f40038e0 0x7fc6080aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 --2- 172.21.15.52:0/4182263575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6081496f0 0x7fc6080a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 >> 172.21.15.52:0/4182263575 conn(0x7fc6080c8410 msgr2=0x7fc6080bd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 shutdown_connections 2023-05-10T01:10:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.326+0000 7fc610104700 1 -- 172.21.15.52:0/4182263575 wait complete. 2023-05-10T01:10:26.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.457+0000 7fd5058af700 1 Processor -- start 2023-05-10T01:10:26.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.457+0000 7fd5058af700 1 -- start start 2023-05-10T01:10:26.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd5058af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 0x7fd5001544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd5058af700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd500155570 0x7fd500068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd5058af700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5000c6310 con 0x7fd500154110 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd5058af700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5000c6830 con 0x7fd500155570 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd5058af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001550e0 con 0x7fd5000cb410 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd4ff7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd500155570 0x7fd500068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd4fe7fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 0x7fd5001544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd4feffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd500154110 0x7fd5000c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42818/0 (socket says 172.21.15.52:42818) 2023-05-10T01:10:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.458+0000 7fd4feffd700 1 -- 172.21.15.52:0/1111116551 learned_addr learned my addr 172.21.15.52:0/1111116551 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1111116551 >> v2:172.21.15.172:3300/0 conn(0x7fd500155570 msgr2=0x7fd500068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fe7fc700 1 --2- 172.21.15.52:0/1111116551 >> v2:172.21.15.172:3300/0 conn(0x7fd500155570 0x7fd500068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1111116551 >> v1:172.21.15.172:6789/0 conn(0x7fd500154110 legacy=0x7fd5000c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1111116551 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000c6550 con 0x7fd5000cb410 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fe7fc700 1 --2- 172.21.15.52:0/1111116551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 0x7fd5001544f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd4f4009790 tx=0x7fd4f4009060).ready entity=mon.2 client_cookie=6fc3d671855bd97 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fdffb700 1 -- 172.21.15.52:0/1111116551 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400f510 con 0x7fd5000cb410 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fdffb700 1 -- 172.21.15.52:0/1111116551 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400f670 con 0x7fd5000cb410 2023-05-10T01:10:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd4fdffb700 1 -- 172.21.15.52:0/1111116551 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400f9f0 con 0x7fd5000cb410 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 -- 172.21.15.52:0/1111116551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 msgr2=0x7fd5001544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 --2- 172.21.15.52:0/1111116551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 0x7fd5001544f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd4f4009790 tx=0x7fd4f4009060).stop 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 -- 172.21.15.52:0/1111116551 shutdown_connections 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 --2- 172.21.15.52:0/1111116551 >> v2:172.21.15.172:3300/0 conn(0x7fd500155570 0x7fd500068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 --2- 172.21.15.52:0/1111116551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5000cb410 0x7fd5001544f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 -- 172.21.15.52:0/1111116551 >> 172.21.15.52:0/1111116551 conn(0x7fd5000678d0 msgr2=0x7fd5000cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 -- 172.21.15.52:0/1111116551 shutdown_connections 2023-05-10T01:10:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.459+0000 7fd5058af700 1 -- 172.21.15.52:0/1111116551 wait complete. 2023-05-10T01:10:26.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 Processor -- start 2023-05-10T01:10:26.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 -- start start 2023-05-10T01:10:26.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5000cb410 0x7fd5000c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd500155570 0x7fd50014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500148800 con 0x7fd500154110 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500147e60 con 0x7fd5000cb410 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.461+0000 7fd5058af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd500148140 con 0x7fd500155570 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59504/0 (socket says 172.21.15.52:59504) 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1629905187 learned_addr learned my addr 172.21.15.52:0/1629905187 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4feffd700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5000cb410 0x7fd5000c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4ff7fe700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd500155570 0x7fd50014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd500155570 msgr2=0x7fd50014a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd500155570 0x7fd50014a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5000cb410 msgr2=0x7fd5000c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5000cb410 0x7fd5000c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 -- 172.21.15.52:0/1629905187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40092a0 con 0x7fd500154110 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4fe7fc700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd4f4009e30 tx=0x7fd4f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400f7e0 con 0x7fd500154110 2023-05-10T01:10:26.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400f960 con 0x7fd500154110 2023-05-10T01:10:26.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401b660 con 0x7fd500154110 2023-05-10T01:10:26.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500148420 con 0x7fd500154110 2023-05-10T01:10:26.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.462+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5000b0840 con 0x7fd500154110 2023-05-10T01:10:26.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.463+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500066720 con 0x7fd500154110 2023-05-10T01:10:26.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.463+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd4f402c070 con 0x7fd500154110 2023-05-10T01:10:26.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.464+0000 7fd4e6ffd700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 0x7fd4e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.464+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd4f407b3b0 con 0x7fd500154110 2023-05-10T01:10:26.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.464+0000 7fd4feffd700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 0x7fd4e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.464+0000 7fd4feffd700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 0x7fd4e0061250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd4f8007fd0 tx=0x7fd4f8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.468+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4f404c950 con 0x7fd500154110 2023-05-10T01:10:26.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:10:26.589 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:10:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.647+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd500154a90 con 0x7fd500154110 2023-05-10T01:10:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.647+0000 7fd4e6ffd700 1 -- 172.21.15.52:0/1629905187 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4f404ff70 con 0x7fd500154110 2023-05-10T01:10:26.651 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 msgr2=0x7fd4e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 0x7fd4e0061250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd4f8007fd0 tx=0x7fd4f8009040).stop 2023-05-10T01:10:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 msgr2=0x7fd5000b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd4f4009e30 tx=0x7fd4f4017000).stop 2023-05-10T01:10:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 shutdown_connections 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4e005ed90 0x7fd4e0061250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd500155570 0x7fd50014a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5000cb410 0x7fd5000c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 --2- 172.21.15.52:0/1629905187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd500154110 0x7fd5000b0350 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 >> 172.21.15.52:0/1629905187 conn(0x7fd5000678d0 msgr2=0x7fd500068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 shutdown_connections 2023-05-10T01:10:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.649+0000 7fd5058af700 1 -- 172.21.15.52:0/1629905187 wait complete. 2023-05-10T01:10:26.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:10:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.821+0000 7fef06430700 1 Processor -- start 2023-05-10T01:10:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.821+0000 7fef06430700 1 -- start start 2023-05-10T01:10:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef000aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 0x7fef000a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef000aa140 0x7fef00068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000aa560 con 0x7fef000aa140 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000c94c0 con 0x7fef00154460 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef06430700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000cb7d0 con 0x7fef00154080 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef000aa140 0x7fef00068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef000aa140 0x7fef00068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59514/0 (socket says 172.21.15.52:59514) 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 -- 172.21.15.52:0/953192207 learned_addr learned my addr 172.21.15.52:0/953192207 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7feefffff700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef000aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7feef7fff700 1 --2- 172.21.15.52:0/953192207 >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 0x7fef000a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 -- 172.21.15.52:0/953192207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 msgr2=0x7fef000aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef000aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 -- 172.21.15.52:0/953192207 >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 msgr2=0x7fef000a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 --2- 172.21.15.52:0/953192207 >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 0x7fef000a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7fef049cd700 1 -- 172.21.15.52:0/953192207 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000c88b0 con 0x7fef000aa140 2023-05-10T01:10:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7feefffff700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef000aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.822+0000 7feef7fff700 1 --2- 172.21.15.52:0/953192207 >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 0x7fef000a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef049cd700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef000aa140 0x7fef00068150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fef00083c40 tx=0x7feef8009840).ready entity=mon.0 client_cookie=8f422934c43866d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7feeff7fe700 1 -- 172.21.15.52:0/953192207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800e070 con 0x7fef000aa140 2023-05-10T01:10:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7feeff7fe700 1 -- 172.21.15.52:0/953192207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800ba50 con 0x7fef000aa140 2023-05-10T01:10:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7feeff7fe700 1 -- 172.21.15.52:0/953192207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800bdd0 con 0x7fef000aa140 2023-05-10T01:10:26.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 -- 172.21.15.52:0/953192207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef000aa140 msgr2=0x7fef00068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef000aa140 0x7fef00068150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fef00083c40 tx=0x7feef8009840).stop 2023-05-10T01:10:26.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 -- 172.21.15.52:0/953192207 shutdown_connections 2023-05-10T01:10:26.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef000aa140 0x7fef00068150 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 --2- 172.21.15.52:0/953192207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef000aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 --2- 172.21.15.52:0/953192207 >> v2:172.21.15.172:3300/0 conn(0x7fef00154460 0x7fef000a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 -- 172.21.15.52:0/953192207 >> 172.21.15.52:0/953192207 conn(0x7fef00067910 msgr2=0x7fef000cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 -- 172.21.15.52:0/953192207 shutdown_connections 2023-05-10T01:10:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.823+0000 7fef06430700 1 -- 172.21.15.52:0/953192207 wait complete. 2023-05-10T01:10:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.824+0000 7fef06430700 1 Processor -- start 2023-05-10T01:10:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.824+0000 7fef06430700 1 -- start start 2023-05-10T01:10:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef000aa140 0x7fef000b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef00150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00150e30 con 0x7fef00154460 2023-05-10T01:10:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0013c130 con 0x7fef000aa140 2023-05-10T01:10:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef06430700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000afb90 con 0x7fef00154080 2023-05-10T01:10:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef049cd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef049cd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59520/0 (socket says 172.21.15.52:59520) 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7fef049cd700 1 -- 172.21.15.52:0/391620202 learned_addr learned my addr 172.21.15.52:0/391620202 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7feefffff700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef000aa140 0x7fef000b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.825+0000 7feef7fff700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef00150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 -- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 msgr2=0x7fef00150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef00150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 -- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef000aa140 msgr2=0x7fef000b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef000aa140 0x7fef000b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 -- 172.21.15.52:0/391620202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009ae0 con 0x7fef00154460 2023-05-10T01:10:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef049cd700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7feef8009fd0 tx=0x7feef8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80032f0 con 0x7fef00154460 2023-05-10T01:10:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef80092e0 con 0x7fef00154460 2023-05-10T01:10:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000aef80 con 0x7fef00154460 2023-05-10T01:10:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef801e6a0 con 0x7fef00154460 2023-05-10T01:10:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.826+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000af540 con 0x7fef00154460 2023-05-10T01:10:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.827+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00066720 con 0x7fef00154460 2023-05-10T01:10:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.827+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feef8025030 con 0x7fef00154460 2023-05-10T01:10:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.827+0000 7feefcff9700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 0x7feee4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.827+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feef807b080 con 0x7fef00154460 2023-05-10T01:10:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.828+0000 7feefffff700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 0x7feee4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.828+0000 7feefffff700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 0x7feee4061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef000b07b0 tx=0x7feef0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:26.831+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feef804c6d0 con 0x7fef00154460 2023-05-10T01:10:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.003+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef000afd00 con 0x7fef00154460 2023-05-10T01:10:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.004+0000 7feefcff9700 1 -- 172.21.15.52:0/391620202 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7feef8023070 con 0x7fef00154460 2023-05-10T01:10:27.009 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:27.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 msgr2=0x7feee4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 0x7feee4061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef000b07b0 tx=0x7feef0008040).stop 2023-05-10T01:10:27.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 msgr2=0x7fef00150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7feef8009fd0 tx=0x7feef8009840).stop 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 shutdown_connections 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feee405ed90 0x7feee4061250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef00154460 0x7fef00150940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef000aa140 0x7fef000b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 --2- 172.21.15.52:0/391620202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef00154080 0x7fef00150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 >> 172.21.15.52:0/391620202 conn(0x7fef00067910 msgr2=0x7fef000c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 shutdown_connections 2023-05-10T01:10:27.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.006+0000 7fef06430700 1 -- 172.21.15.52:0/391620202 wait complete. 2023-05-10T01:10:27.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:10:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.137+0000 7ff1526c4700 1 Processor -- start 2023-05-10T01:10:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.137+0000 7ff1526c4700 1 -- start start 2023-05-10T01:10:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff1526c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff1526c4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 0x7ff14c068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff1526c4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0c94c0 con 0x7ff14c154460 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff1526c4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0cb7d0 con 0x7ff14c068150 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff1526c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c068a60 con 0x7ff14c154080 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff14bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.138+0000 7ff150c61700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 0x7ff14c068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff143fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff14c154460 0x7ff14c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:42846/0 (socket says 172.21.15.52:42846) 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff150c61700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 0x7ff14c068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:57848/0 (socket says 172.21.15.52:57848) 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff143fff700 1 -- 172.21.15.52:0/822208536 learned_addr learned my addr 172.21.15.52:0/822208536 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:50928/0 (socket says 172.21.15.52:50928) 2023-05-10T01:10:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 -- 172.21.15.52:0/822208536 >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 msgr2=0x7ff14c068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 --2- 172.21.15.52:0/822208536 >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 0x7ff14c068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 -- 172.21.15.52:0/822208536 >> v1:172.21.15.172:6789/0 conn(0x7ff14c154460 legacy=0x7ff14c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 -- 172.21.15.52:0/822208536 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0c88b0 con 0x7ff14c154080 2023-05-10T01:10:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14bfff700 1 --2- 172.21.15.52:0/822208536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff13c009760 tx=0x7ff13c009060).ready entity=mon.2 client_cookie=dfed40af22b3c30 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14b7fe700 1 -- 172.21.15.52:0/822208536 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00f510 con 0x7ff14c154080 2023-05-10T01:10:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14b7fe700 1 -- 172.21.15.52:0/822208536 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c00f670 con 0x7ff14c154080 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.139+0000 7ff14b7fe700 1 -- 172.21.15.52:0/822208536 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00f9f0 con 0x7ff14c154080 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 -- 172.21.15.52:0/822208536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 msgr2=0x7ff14c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 --2- 172.21.15.52:0/822208536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff13c009760 tx=0x7ff13c009060).stop 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 -- 172.21.15.52:0/822208536 shutdown_connections 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 --2- 172.21.15.52:0/822208536 >> v2:172.21.15.172:3300/0 conn(0x7ff14c068150 0x7ff14c068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 --2- 172.21.15.52:0/822208536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154080 0x7ff14c0aac90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 -- 172.21.15.52:0/822208536 >> 172.21.15.52:0/822208536 conn(0x7ff14c067910 msgr2=0x7ff14c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 -- 172.21.15.52:0/822208536 shutdown_connections 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.140+0000 7ff1526c4700 1 -- 172.21.15.52:0/822208536 wait complete. 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.141+0000 7ff1526c4700 1 Processor -- start 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.141+0000 7ff1526c4700 1 -- start start 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff14c154080 0x7ff14c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154460 0x7ff14c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c157050 con 0x7ff14c068150 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c152c00 con 0x7ff14c154080 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff1526c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c152ee0 con 0x7ff14c154460 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59530/0 (socket says 172.21.15.52:59530) 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 -- 172.21.15.52:0/4199057840 learned_addr learned my addr 172.21.15.52:0/4199057840 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff143fff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff14c154080 0x7ff14c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff150c61700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154460 0x7ff14c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 -- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154460 msgr2=0x7ff14c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154460 0x7ff14c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 -- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff14c154080 msgr2=0x7ff14c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff14c154080 0x7ff14c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 -- 172.21.15.52:0/4199057840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0092a0 con 0x7ff14c068150 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff14bfff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff13c009e00 tx=0x7ff13c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.142+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c01a610 con 0x7ff14c068150 2023-05-10T01:10:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.143+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c01a770 con 0x7ff14c068150 2023-05-10T01:10:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.143+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c1531c0 con 0x7ff14c068150 2023-05-10T01:10:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.143+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c01ab10 con 0x7ff14c068150 2023-05-10T01:10:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.143+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c154ce0 con 0x7ff14c068150 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.144+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff13c00f070 con 0x7ff14c068150 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.144+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c066720 con 0x7ff14c068150 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.144+0000 7ff148ff9700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 0x7ff130061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.144+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff13c07ab50 con 0x7ff14c068150 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.144+0000 7ff143fff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 0x7ff130061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.145+0000 7ff143fff700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 0x7ff130061280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff14c0c1340 tx=0x7ff134000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.148+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff13c04c0f0 con 0x7ff14c068150 2023-05-10T01:10:27.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.320+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff14c0c8b90 con 0x7ff14c068150 2023-05-10T01:10:27.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.320+0000 7ff148ff9700 1 -- 172.21.15.52:0/4199057840 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff13c04f710 con 0x7ff14c068150 2023-05-10T01:10:27.325 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:10:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 msgr2=0x7ff130061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 0x7ff130061280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff14c0c1340 tx=0x7ff134000bc0).stop 2023-05-10T01:10:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 msgr2=0x7ff14c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff13c009e00 tx=0x7ff13c017000).stop 2023-05-10T01:10:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 shutdown_connections 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff13005edc0 0x7ff130061280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff14c154460 0x7ff14c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff14c068150 0x7ff14c156b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 --2- 172.21.15.52:0/4199057840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff14c154080 0x7ff14c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 >> 172.21.15.52:0/4199057840 conn(0x7ff14c067910 msgr2=0x7ff14c0ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 shutdown_connections 2023-05-10T01:10:27.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.322+0000 7ff1526c4700 1 -- 172.21.15.52:0/4199057840 wait complete. 2023-05-10T01:10:27.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:27.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.454+0000 7f3acfbb4700 1 Processor -- start 2023-05-10T01:10:27.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.454+0000 7f3acfbb4700 1 -- start start 2023-05-10T01:10:27.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acfbb4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ac8154030 0x7f3ac8069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acfbb4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 0x7f3ac8062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acfbb4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac8062950 con 0x7f3ac8063710 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acfbb4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac8154410 con 0x7f3ac8154030 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acfbb4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac8069fa0 con 0x7f3ac80bf4e0 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.455+0000 7f3acd950700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ac8154030 0x7f3ac8069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ac8154030 0x7f3ac8069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59538/0 (socket says 172.21.15.52:59538) 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 -- 172.21.15.52:0/326566027 learned_addr learned my addr 172.21.15.52:0/326566027 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd14f700 1 --2- 172.21.15.52:0/326566027 >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 0x7f3ac8062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 -- 172.21.15.52:0/326566027 >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 msgr2=0x7f3ac8062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 --2- 172.21.15.52:0/326566027 >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 0x7f3ac8062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 -- 172.21.15.52:0/326566027 >> v1:172.21.15.172:6789/0 conn(0x7f3ac8063710 legacy=0x7f3ac80bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 -- 172.21.15.52:0/326566027 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8062340 con 0x7f3ac8154030 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd14f700 1 --2- 172.21.15.52:0/326566027 >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 0x7f3ac8062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:27.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acd950700 1 --2- 172.21.15.52:0/326566027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8154030 0x7f3ac8069ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f3ac80aec60 tx=0x7f3ac0009840).ready entity=mon.0 client_cookie=687a27843589ab91 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acc94e700 1 -- 172.21.15.52:0/326566027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000e070 con 0x7f3ac8154030 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acc94e700 1 -- 172.21.15.52:0/326566027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000ba10 con 0x7f3ac8154030 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.456+0000 7f3acc94e700 1 -- 172.21.15.52:0/326566027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000bd90 con 0x7f3ac8154030 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 -- 172.21.15.52:0/326566027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8154030 msgr2=0x7f3ac8069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/326566027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8154030 0x7f3ac8069ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f3ac80aec60 tx=0x7f3ac0009840).stop 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 -- 172.21.15.52:0/326566027 shutdown_connections 2023-05-10T01:10:27.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/326566027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8154030 0x7f3ac8069ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/326566027 >> v2:172.21.15.172:3300/0 conn(0x7f3ac80bf4e0 0x7f3ac8062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 -- 172.21.15.52:0/326566027 >> 172.21.15.52:0/326566027 conn(0x7f3ac80c8a90 msgr2=0x7f3ac80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 -- 172.21.15.52:0/326566027 shutdown_connections 2023-05-10T01:10:27.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.457+0000 7f3acfbb4700 1 -- 172.21.15.52:0/326566027 wait complete. 2023-05-10T01:10:27.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.458+0000 7f3acfbb4700 1 Processor -- start 2023-05-10T01:10:27.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.458+0000 7f3acfbb4700 1 -- start start 2023-05-10T01:10:27.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 0x7f3ac80ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 0x7f3ac80aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80ae5b0 con 0x7f3ac8063710 2023-05-10T01:10:27.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80aea80 con 0x7f3ac8154030 2023-05-10T01:10:27.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80c02b0 con 0x7f3ac80bf4e0 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59544/0 (socket says 172.21.15.52:59544) 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 -- 172.21.15.52:0/534377737 learned_addr learned my addr 172.21.15.52:0/534377737 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd14f700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 0x7f3ac80ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3ace151700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 0x7f3ac80aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 -- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 msgr2=0x7f3ac80ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 0x7f3ac80ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 -- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 msgr2=0x7f3ac80aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 0x7f3ac80aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 -- 172.21.15.52:0/534377737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0009ae0 con 0x7f3ac8063710 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd14f700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 0x7f3ac80ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3ace151700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 0x7f3ac80aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acd950700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3ac8067b30 tx=0x7f3ac0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0013d50 con 0x7f3ac8063710 2023-05-10T01:10:27.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac001d410 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac80ae7a0 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.459+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac001d790 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.460+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac80bffc0 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.460+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac806c340 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.461+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ac001b040 con 0x7f3ac8063710 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.461+0000 7f3ac5ffb700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 0x7f3aa8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.461+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ac007b560 con 0x7f3ac8063710 2023-05-10T01:10:27.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.462+0000 7f3acd14f700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 0x7f3aa8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.462+0000 7f3acd14f700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 0x7f3aa8061220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3ac80c4d00 tx=0x7f3abc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.465+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ac004cb00 con 0x7f3ac8063710 2023-05-10T01:10:27.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.680+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ac806c340 con 0x7f3ac8063710 2023-05-10T01:10:27.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.681+0000 7f3ac5ffb700 1 -- 172.21.15.52:0/534377737 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f3ac0050120 con 0x7f3ac8063710 2023-05-10T01:10:27.685 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:27.685 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:27.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 msgr2=0x7f3aa8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 0x7f3aa8061220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3ac80c4d00 tx=0x7f3abc008040).stop 2023-05-10T01:10:27.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 msgr2=0x7f3ac80ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3ac8067b30 tx=0x7f3ac0009840).stop 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 shutdown_connections 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3aa805ed60 0x7f3aa8061220 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ac8154030 0x7f3ac80aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ac8063710 0x7f3ac80ae0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 --2- 172.21.15.52:0/534377737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ac80bf4e0 0x7f3ac80ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 >> 172.21.15.52:0/534377737 conn(0x7f3ac80c8a90 msgr2=0x7f3ac80c3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 shutdown_connections 2023-05-10T01:10:27.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.683+0000 7f3acfbb4700 1 -- 172.21.15.52:0/534377737 wait complete. 2023-05-10T01:10:27.689 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:27.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:27.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.810+0000 7f823c7a4700 1 Processor -- start 2023-05-10T01:10:27.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.810+0000 7f823c7a4700 1 -- start start 2023-05-10T01:10:27.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f823c7a4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8234063e20 0x7f82340bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f823c7a4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8234062b00 con 0x7f8234154170 2023-05-10T01:10:27.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f823c7a4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8234068330 con 0x7f8234153d90 2023-05-10T01:10:27.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f823c7a4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8234068610 con 0x7f8234063e20 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f8239d3f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8234154170 0x7f8234063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40338/0 (socket says 172.21.15.52:40338) 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.811+0000 7f8239d3f700 1 -- 172.21.15.52:0/442271737 learned_addr learned my addr 172.21.15.52:0/442271737 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> v2:172.21.15.172:3300/0 conn(0x7f8234063e20 0x7f82340bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054965598 0 0) 0x7f8234062b00 con 0x7f8234154170 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82200033f0 con 0x7f8234154170 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998954690 0 0) 0x7f82200033f0 con 0x7f8234154170 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 >> v2:172.21.15.172:3300/0 conn(0x7f8234063e20 msgr2=0x7f82340bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 --2- 172.21.15.52:0/442271737 >> v2:172.21.15.172:3300/0 conn(0x7f8234063e20 0x7f82340bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 >> v1:172.21.15.172:6789/0 conn(0x7f8234153d90 legacy=0x7f8234069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340624b0 con 0x7f8234154170 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f82280017f0 con 0x7f8234154170 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 >> v1:172.21.15.52:6789/0 conn(0x7f8234154170 legacy=0x7f8234063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82200038e0 0x7f8220003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220004690 0x7f8220004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 0x7f822000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234068610 con 0x7f8220005000 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822000be00 con 0x7f82200038e0 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822000bfc0 con 0x7f8220004690 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> v2:172.21.15.172:3300/0 conn(0x7f8234063e20 0x7f82340bd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 0x7f822000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f823a540700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82200038e0 0x7f8220003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.812+0000 7f8239d3f700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220004690 0x7f8220004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 -- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220004690 msgr2=0x7f8220004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220004690 0x7f8220004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 -- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82200038e0 msgr2=0x7f8220003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82200038e0 0x7f8220003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 -- 172.21.15.52:0/442271737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200033f0 con 0x7f8220005000 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 -- 172.21.15.52:0/442271737 reap_dead start 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823ad41700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 0x7f822000b8e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8224009c30 tx=0x7f8224009060).ready entity=mon.0 client_cookie=a2462cab51271e12 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240095c0 con 0x7f8220005000 2023-05-10T01:10:27.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822400e710 con 0x7f8220005000 2023-05-10T01:10:27.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823953e700 1 -- 172.21.15.52:0/442271737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400eab0 con 0x7f8220005000 2023-05-10T01:10:27.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 -- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 msgr2=0x7f822000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 0x7f822000b8e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8224009c30 tx=0x7f8224009060).stop 2023-05-10T01:10:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 -- 172.21.15.52:0/442271737 shutdown_connections 2023-05-10T01:10:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 --2- 172.21.15.52:0/442271737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8220005000 0x7f822000b8e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 -- 172.21.15.52:0/442271737 >> 172.21.15.52:0/442271737 conn(0x7f82340c8a90 msgr2=0x7f82340c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 -- 172.21.15.52:0/442271737 shutdown_connections 2023-05-10T01:10:27.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.813+0000 7f823c7a4700 1 -- 172.21.15.52:0/442271737 wait complete. 2023-05-10T01:10:27.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.814+0000 7f823c7a4700 1 Processor -- start 2023-05-10T01:10:27.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 -- start start 2023-05-10T01:10:27.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220005000 0x7f823414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 0x7f82341675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c6490 con 0x7f8234156b20 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c6a50 con 0x7f82341671a0 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f823c7a4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8234167ad0 con 0x7f8220005000 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f8239d3f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f8239d3f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59566/0 (socket says 172.21.15.52:59566) 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.815+0000 7f8239d3f700 1 -- 172.21.15.52:0/2813993944 learned_addr learned my addr 172.21.15.52:0/2813993944 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:27.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f823a540700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220005000 0x7f823414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f823ad41700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 0x7f82341675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 -- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220005000 msgr2=0x7f823414f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220005000 0x7f823414f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 -- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 msgr2=0x7f82341675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 0x7f82341675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:27.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 -- 172.21.15.52:0/2813993944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82341575b0 con 0x7f8234156b20 2023-05-10T01:10:27.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f823ad41700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 0x7f82341675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:27.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f8239d3f700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8228007710 tx=0x7f8228001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822800f9a0 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822800fb00 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8234157890 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822800fea0 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.816+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823414fa80 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.817+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8234157a20 con 0x7f8234156b20 2023-05-10T01:10:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.817+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8228012560 con 0x7f8234156b20 2023-05-10T01:10:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.818+0000 7f82327fc700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 0x7f8214061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.818+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f82280796d0 con 0x7f8234156b20 2023-05-10T01:10:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.818+0000 7f823a540700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 0x7f8214061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.818+0000 7f823a540700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 0x7f8214061250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f822c007fd0 tx=0x7f822c007b90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.822+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f822804ac10 con 0x7f8234156b20 2023-05-10T01:10:27.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.993+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f823406c340 con 0x7f8234156b20 2023-05-10T01:10:27.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.994+0000 7f82327fc700 1 -- 172.21.15.52:0/2813993944 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f8228019020 con 0x7f8234156b20 2023-05-10T01:10:27.998 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:27.998 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:27.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 msgr2=0x7f8214061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 0x7f8214061250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f822c007fd0 tx=0x7f822c007b90).stop 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 msgr2=0x7f8234156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8228007710 tx=0x7f8228001d90).stop 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 shutdown_connections 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f821405ed90 0x7f8214061250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82341671a0 0x7f82341675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8220005000 0x7f823414f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 --2- 172.21.15.52:0/2813993944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234156b20 0x7f8234156fa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 >> 172.21.15.52:0/2813993944 conn(0x7f82340c8a90 msgr2=0x7f82340ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 shutdown_connections 2023-05-10T01:10:28.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:27.996+0000 7f823c7a4700 1 -- 172.21.15.52:0/2813993944 wait complete. 2023-05-10T01:10:28.012 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:10:28.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:28.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.125+0000 7f0ea821f700 1 Processor -- start 2023-05-10T01:10:28.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 -- start start 2023-05-10T01:10:28.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ea0154160 0x7f0ea00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0154540 0x7f0ea00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00c0650 con 0x7f0ea0069690 2023-05-10T01:10:28.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00c1af0 con 0x7f0ea0154160 2023-05-10T01:10:28.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.126+0000 7f0ea821f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00bfd20 con 0x7f0ea0154540 2023-05-10T01:10:28.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ea0154160 0x7f0ea00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ea0154160 0x7f0ea00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59574/0 (socket says 172.21.15.52:59574) 2023-05-10T01:10:28.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 -- 172.21.15.52:0/1622089025 learned_addr learned my addr 172.21.15.52:0/1622089025 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea57ba700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0154540 0x7f0ea00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 -- 172.21.15.52:0/1622089025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0154540 msgr2=0x7f0ea00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:28.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0154540 0x7f0ea00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 -- 172.21.15.52:0/1622089025 >> v1:172.21.15.172:6789/0 conn(0x7f0ea0069690 legacy=0x7f0ea0157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 -- 172.21.15.52:0/1622089025 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00c0000 con 0x7f0ea0154160 2023-05-10T01:10:28.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea5fbb700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea00c5c60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0e98006fd0 tx=0x7f0e980090f0).ready entity=mon.0 client_cookie=2ca28d5615508df1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea4fb9700 1 -- 172.21.15.52:0/1622089025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800b580 con 0x7f0ea0154160 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea4fb9700 1 -- 172.21.15.52:0/1622089025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800b6e0 con 0x7f0ea0154160 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.127+0000 7f0ea4fb9700 1 -- 172.21.15.52:0/1622089025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ba60 con 0x7f0ea0154160 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 -- 172.21.15.52:0/1622089025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 msgr2=0x7f0ea00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea00c5c60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0e98006fd0 tx=0x7f0e980090f0).stop 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 -- 172.21.15.52:0/1622089025 shutdown_connections 2023-05-10T01:10:28.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea00c5c60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 --2- 172.21.15.52:0/1622089025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0154540 0x7f0ea00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 -- 172.21.15.52:0/1622089025 >> 172.21.15.52:0/1622089025 conn(0x7f0ea00cb740 msgr2=0x7f0ea00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 -- 172.21.15.52:0/1622089025 shutdown_connections 2023-05-10T01:10:28.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.128+0000 7f0ea821f700 1 -- 172.21.15.52:0/1622089025 wait complete. 2023-05-10T01:10:28.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.129+0000 7f0ea821f700 1 Processor -- start 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.129+0000 7f0ea821f700 1 -- start start 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0069690 0x7f0ea0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea0154540 0x7f0ea01571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea0158470 con 0x7f0ea0154160 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00a9990 con 0x7f0ea0154540 2023-05-10T01:10:28.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea821f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea0157860 con 0x7f0ea0069690 2023-05-10T01:10:28.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59580/0 (socket says 172.21.15.52:59580) 2023-05-10T01:10:28.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 -- 172.21.15.52:0/112729509 learned_addr learned my addr 172.21.15.52:0/112729509 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea5fbb700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0069690 0x7f0ea0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea67bc700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea0154540 0x7f0ea01571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 -- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0069690 msgr2=0x7f0ea0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0069690 0x7f0ea0153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 -- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea0154540 msgr2=0x7f0ea01571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea0154540 0x7f0ea01571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 -- 172.21.15.52:0/112729509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009370 con 0x7f0ea0154160 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0ea57ba700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0e9400e900 tx=0x7f0e94009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.130+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94012600 con 0x7f0ea0154160 2023-05-10T01:10:28.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.131+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94012760 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.131+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea0157b40 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.131+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94012ae0 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.131+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea0158100 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.132+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea00666b0 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.132+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0e94022070 con 0x7f0ea0154160 2023-05-10T01:10:28.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.132+0000 7f0e9dffb700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 0x7f0e80061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.132+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e94079e10 con 0x7f0ea0154160 2023-05-10T01:10:28.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.133+0000 7f0ea5fbb700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 0x7f0e80061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.133+0000 7f0ea5fbb700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 0x7f0e80061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0e98009fd0 tx=0x7f0e98017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.136+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e9404b350 con 0x7f0ea0154160 2023-05-10T01:10:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.352+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ea006c340 con 0x7f0ea0154160 2023-05-10T01:10:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.353+0000 7f0e9dffb700 1 -- 172.21.15.52:0/112729509 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f0e94016030 con 0x7f0ea0154160 2023-05-10T01:10:28.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:28.357 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 msgr2=0x7f0e80061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 0x7f0e80061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0e98009fd0 tx=0x7f0e98017000).stop 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 msgr2=0x7f0ea0156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0e9400e900 tx=0x7f0e94009060).stop 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 shutdown_connections 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e8005ed90 0x7f0e80061250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea0154540 0x7f0ea01571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ea0069690 0x7f0ea0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 --2- 172.21.15.52:0/112729509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ea0154160 0x7f0ea0156cc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 >> 172.21.15.52:0/112729509 conn(0x7f0ea00cb740 msgr2=0x7f0ea00c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 shutdown_connections 2023-05-10T01:10:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.355+0000 7f0ea821f700 1 -- 172.21.15.52:0/112729509 wait complete. 2023-05-10T01:10:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:28.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.484+0000 7f482cf62700 1 Processor -- start 2023-05-10T01:10:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.484+0000 7f482cf62700 1 -- start start 2023-05-10T01:10:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48280c7370 0x7f4828154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48280c7750 0x7f48280acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280ad030 0x7f482814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4828158960 con 0x7f48280c7370 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4828155330 con 0x7f48280c7750 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f482cf62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4828157d50 con 0x7f48280ad030 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48280c7370 0x7f4828154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48280c7370 0x7f4828154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59586/0 (socket says 172.21.15.52:59586) 2023-05-10T01:10:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 -- 172.21.15.52:0/3168273275 learned_addr learned my addr 172.21.15.52:0/3168273275 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f4827fff700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280ad030 0x7f482814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f4826ffd700 1 --2- 172.21.15.52:0/3168273275 >> v2:172.21.15.172:3300/0 conn(0x7f48280c7750 0x7f48280acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 -- 172.21.15.52:0/3168273275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280ad030 msgr2=0x7f482814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280ad030 0x7f482814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 -- 172.21.15.52:0/3168273275 >> v2:172.21.15.172:3300/0 conn(0x7f48280c7750 msgr2=0x7f48280acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 --2- 172.21.15.52:0/3168273275 >> v2:172.21.15.172:3300/0 conn(0x7f48280c7750 0x7f48280acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 -- 172.21.15.52:0/3168273275 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828158030 con 0x7f48280c7370 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.485+0000 7f48277fe700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f4828154e40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4828084340 tx=0x7f48180090f0).ready entity=mon.0 client_cookie=5e84ae29377d4af server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f48267fc700 1 -- 172.21.15.52:0/3168273275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800f510 con 0x7f48280c7370 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f48267fc700 1 -- 172.21.15.52:0/3168273275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481800f670 con 0x7f48280c7370 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f48267fc700 1 -- 172.21.15.52:0/3168273275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800f9f0 con 0x7f48280c7370 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 -- 172.21.15.52:0/3168273275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 msgr2=0x7f4828154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f4828154e40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4828084340 tx=0x7f48180090f0).stop 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 -- 172.21.15.52:0/3168273275 shutdown_connections 2023-05-10T01:10:28.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280ad030 0x7f482814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 --2- 172.21.15.52:0/3168273275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f4828154e40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 --2- 172.21.15.52:0/3168273275 >> v2:172.21.15.172:3300/0 conn(0x7f48280c7750 0x7f48280acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 -- 172.21.15.52:0/3168273275 >> 172.21.15.52:0/3168273275 conn(0x7f4828068320 msgr2=0x7f4828068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 -- 172.21.15.52:0/3168273275 shutdown_connections 2023-05-10T01:10:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.486+0000 7f482cf62700 1 -- 172.21.15.52:0/3168273275 wait complete. 2023-05-10T01:10:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 Processor -- start 2023-05-10T01:10:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 -- start start 2023-05-10T01:10:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 0x7f482814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 0x7f48280b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c1d80 con 0x7f48280c7370 2023-05-10T01:10:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c2060 con 0x7f48280ad030 2023-05-10T01:10:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f482cf62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c2340 con 0x7f48280c7750 2023-05-10T01:10:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f4826ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f4826ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59594/0 (socket says 172.21.15.52:59594) 2023-05-10T01:10:28.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f4826ffd700 1 -- 172.21.15.52:0/1483963281 learned_addr learned my addr 172.21.15.52:0/1483963281 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.488+0000 7f4827fff700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 0x7f48280b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f48277fe700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 0x7f482814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 -- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 msgr2=0x7f48280b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 0x7f48280b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 -- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 msgr2=0x7f482814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 0x7f482814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 -- 172.21.15.52:0/1483963281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009370 con 0x7f48280c7370 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f48277fe700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 0x7f482814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:28.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4827fff700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 0x7f48280b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f4826ffd700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f481c00e900 tx=0x7f481c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00c640 con 0x7f48280c7370 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c00c7a0 con 0x7f48280c7370 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280c2620 con 0x7f48280c7370 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00cb20 con 0x7f48280c7370 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.489+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482814eab0 con 0x7f48280c7370 2023-05-10T01:10:28.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.490+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280c2ac0 con 0x7f48280c7370 2023-05-10T01:10:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.490+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f481c022070 con 0x7f48280c7370 2023-05-10T01:10:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.491+0000 7f480f7fe700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 0x7f4808061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.491+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f481c079df0 con 0x7f48280c7370 2023-05-10T01:10:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.491+0000 7f48277fe700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 0x7f4808061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.491+0000 7f48277fe700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 0x7f4808061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f4818009130 tx=0x7f4818017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.495+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f481c04b390 con 0x7f48280c7370 2023-05-10T01:10:28.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.710+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4828047150 con 0x7f48280c7370 2023-05-10T01:10:28.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.710+0000 7f480f7fe700 1 -- 172.21.15.52:0/1483963281 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f481c016070 con 0x7f48280c7370 2023-05-10T01:10:28.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:28.715 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3208972354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3208972354},{"type":"v1","addr":"172.21.15.52:6833","nonce":3208972354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2257467300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2257467300},{"type":"v1","addr":"172.21.15.172:6837","nonce":2257467300}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1510781843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1510781843},{"type":"v1","addr":"172.21.15.52:6835","nonce":1510781843}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:09:53.750190+0000","modified":"2023-05-10T01:09:56.757913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2330058526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2330058526},{"type":"v1","addr":"172.21.15.172:6836","nonce":2330058526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-05-10T01:10:28.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 msgr2=0x7f4808061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 0x7f4808061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f4818009130 tx=0x7f4818017000).stop 2023-05-10T01:10:28.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 msgr2=0x7f48280b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f481c00e900 tx=0x7f481c009060).stop 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 shutdown_connections 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f480805ed90 0x7f4808061250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48280c7750 0x7f48280b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48280ad030 0x7f482814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 --2- 172.21.15.52:0/1483963281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280c7370 0x7f48280b0280 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 >> 172.21.15.52:0/1483963281 conn(0x7f4828068320 msgr2=0x7f48280c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 shutdown_connections 2023-05-10T01:10:28.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.712+0000 7f482cf62700 1 -- 172.21.15.52:0/1483963281 wait complete. 2023-05-10T01:10:28.719 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-05-10T01:10:28.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:28.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.841+0000 7fb3c3f75700 1 Processor -- start 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.841+0000 7fb3c3f75700 1 -- start start 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c3f75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154160 0x7fb3bc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c3f75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3bc154540 0x7fb3bc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c3f75700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc0c0650 con 0x7fb3bc069690 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c3f75700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0c1af0 con 0x7fb3bc154540 2023-05-10T01:10:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c3f75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0bfd20 con 0x7fb3bc154160 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c1510700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3bc154540 0x7fb3bc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c1510700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3bc154540 0x7fb3bc0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59600/0 (socket says 172.21.15.52:59600) 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.842+0000 7fb3c1510700 1 -- 172.21.15.52:0/1072465083 learned_addr learned my addr 172.21.15.52:0/1072465083 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1d11700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154160 0x7fb3bc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1510700 1 -- 172.21.15.52:0/1072465083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154160 msgr2=0x7fb3bc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:28.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1510700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154160 0x7fb3bc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1510700 1 -- 172.21.15.52:0/1072465083 >> v1:172.21.15.172:6789/0 conn(0x7fb3bc069690 legacy=0x7fb3bc157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:28.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1510700 1 -- 172.21.15.52:0/1072465083 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0c0000 con 0x7fb3bc154540 2023-05-10T01:10:28.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c1510700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc154540 0x7fb3bc0c6150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fb3b0006fd0 tx=0x7fb3b00090f0).ready entity=mon.0 client_cookie=a6beb86e4b845206 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c0d0f700 1 -- 172.21.15.52:0/1072465083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000b600 con 0x7fb3bc154540 2023-05-10T01:10:28.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c0d0f700 1 -- 172.21.15.52:0/1072465083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000b760 con 0x7fb3bc154540 2023-05-10T01:10:28.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c0d0f700 1 -- 172.21.15.52:0/1072465083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000bb00 con 0x7fb3bc154540 2023-05-10T01:10:28.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 -- 172.21.15.52:0/1072465083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc154540 msgr2=0x7fb3bc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc154540 0x7fb3bc0c6150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fb3b0006fd0 tx=0x7fb3b00090f0).stop 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 -- 172.21.15.52:0/1072465083 shutdown_connections 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154160 0x7fb3bc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/1072465083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc154540 0x7fb3bc0c6150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.843+0000 7fb3c3f75700 1 -- 172.21.15.52:0/1072465083 >> 172.21.15.52:0/1072465083 conn(0x7fb3bc0cb6f0 msgr2=0x7fb3bc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.844+0000 7fb3c3f75700 1 -- 172.21.15.52:0/1072465083 shutdown_connections 2023-05-10T01:10:28.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.844+0000 7fb3c3f75700 1 -- 172.21.15.52:0/1072465083 wait complete. 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 Processor -- start 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 -- start start 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 0x7fb3bc0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 0x7fb3bc0ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc164f10 con 0x7fb3bc069690 2023-05-10T01:10:28.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1500e0 con 0x7fb3bc154160 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c3f75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0ab9a0 con 0x7fb3bc154540 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c1d11700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c1d11700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59604/0 (socket says 172.21.15.52:59604) 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.845+0000 7fb3c1d11700 1 -- 172.21.15.52:0/4064372772 learned_addr learned my addr 172.21.15.52:0/4064372772 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 -- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 msgr2=0x7fb3bc0ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c2512700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 0x7fb3bc0ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 0x7fb3bc0ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1510700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 0x7fb3bc0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 -- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 msgr2=0x7fb3bc0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 0x7fb3bc0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 -- 172.21.15.52:0/4064372772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009370 con 0x7fb3bc069690 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c2512700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 0x7fb3bc0ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1510700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 0x7fb3bc0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:28.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c1d11700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fb3b400d890 tx=0x7fb3b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40125f0 con 0x7fb3bc069690 2023-05-10T01:10:28.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4012750 con 0x7fb3bc069690 2023-05-10T01:10:28.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc1524f0 con 0x7fb3bc069690 2023-05-10T01:10:28.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4012ad0 con 0x7fb3bc069690 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.846+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc151bc0 con 0x7fb3bc069690 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.847+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb3b4013480 con 0x7fb3bc069690 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.847+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc1527d0 con 0x7fb3bc069690 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.848+0000 7fb3b9ffb700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 0x7fb39c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.848+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb3b4079a80 con 0x7fb3bc069690 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.848+0000 7fb3c1510700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 0x7fb39c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:28.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.848+0000 7fb3c1510700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 0x7fb39c061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb3b0006fd0 tx=0x7fb3b0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:28.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:28.852+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3b404afc0 con 0x7fb3bc069690 2023-05-10T01:10:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.027+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3bc0666b0 con 0x7fb3bc069690 2023-05-10T01:10:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.028+0000 7fb3b9ffb700 1 -- 172.21.15.52:0/4064372772 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fb3b404e5e0 con 0x7fb3bc069690 2023-05-10T01:10:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:29.167 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:09:54.751696+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:09:51.441867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T01:09:52.727675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:29.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 msgr2=0x7fb39c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 0x7fb39c061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb3b0006fd0 tx=0x7fb3b0017000).stop 2023-05-10T01:10:29.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 msgr2=0x7fb3bc14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fb3b400d890 tx=0x7fb3b4008040).stop 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 shutdown_connections 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb39c05ed90 0x7fb39c061250 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3bc154540 0x7fb3bc0ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3bc069690 0x7fb3bc14fbf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 --2- 172.21.15.52:0/4064372772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3bc154160 0x7fb3bc0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 >> 172.21.15.52:0/4064372772 conn(0x7fb3bc0cb6f0 msgr2=0x7fb3bc0abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 shutdown_connections 2023-05-10T01:10:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.030+0000 7fb3c3f75700 1 -- 172.21.15.52:0/4064372772 wait complete. 2023-05-10T01:10:29.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:10:29.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.288+0000 7f9c9abd1700 1 Processor -- start 2023-05-10T01:10:29.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.288+0000 7f9c9abd1700 1 -- start start 2023-05-10T01:10:29.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9abd1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 0x7f9c940c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9abd1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 0x7f9c940c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9abd1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940c0650 con 0x7f9c94154540 2023-05-10T01:10:29.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9abd1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c940c1af0 con 0x7f9c94154160 2023-05-10T01:10:29.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9abd1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940bfd20 con 0x7f9c94069da0 2023-05-10T01:10:29.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c93fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9c94154540 0x7f9c94069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40396/0 (socket says 172.21.15.52:40396) 2023-05-10T01:10:29.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c93fff700 1 -- 172.21.15.52:0/3727375150 learned_addr learned my addr 172.21.15.52:0/3727375150 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:29.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9916e700 1 --2- 172.21.15.52:0/3727375150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 0x7f9c940c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c9896d700 1 --2- 172.21.15.52:0/3727375150 >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 0x7f9c940c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c937fe700 1 -- 172.21.15.52:0/3727375150 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120828756 0 0) 0x7f9c940c0650 con 0x7f9c94154540 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.289+0000 7f9c937fe700 1 -- 172.21.15.52:0/3727375150 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c740033f0 con 0x7f9c94154540 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9916e700 1 -- 172.21.15.52:0/3727375150 >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 msgr2=0x7f9c940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9916e700 1 --2- 172.21.15.52:0/3727375150 >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 0x7f9c940c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9916e700 1 -- 172.21.15.52:0/3727375150 >> v1:172.21.15.52:6789/0 conn(0x7f9c94154540 legacy=0x7f9c94069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9916e700 1 -- 172.21.15.52:0/3727375150 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940c0000 con 0x7f9c94069da0 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9896d700 1 --2- 172.21.15.52:0/3727375150 >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 0x7f9c940c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9916e700 1 --2- 172.21.15.52:0/3727375150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 0x7f9c940c6150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9c7c009760 tx=0x7f9c7c009060).ready entity=mon.2 client_cookie=588935064dcd08cb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c937fe700 1 -- 172.21.15.52:0/3727375150 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0090d0 con 0x7f9c94069da0 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c937fe700 1 -- 172.21.15.52:0/3727375150 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00d4a0 con 0x7f9c94069da0 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c937fe700 1 -- 172.21.15.52:0/3727375150 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00d820 con 0x7f9c94069da0 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 -- 172.21.15.52:0/3727375150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 msgr2=0x7f9c940c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/3727375150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 0x7f9c940c6150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9c7c009760 tx=0x7f9c7c009060).stop 2023-05-10T01:10:29.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 -- 172.21.15.52:0/3727375150 shutdown_connections 2023-05-10T01:10:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/3727375150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94069da0 0x7f9c940c6150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/3727375150 >> v2:172.21.15.172:3300/0 conn(0x7f9c94154160 0x7f9c940c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 -- 172.21.15.52:0/3727375150 >> 172.21.15.52:0/3727375150 conn(0x7f9c940cb6f0 msgr2=0x7f9c940c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.290+0000 7f9c9abd1700 1 -- 172.21.15.52:0/3727375150 shutdown_connections 2023-05-10T01:10:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.291+0000 7f9c9abd1700 1 -- 172.21.15.52:0/3727375150 wait complete. 2023-05-10T01:10:29.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 Processor -- start 2023-05-10T01:10:29.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 -- start start 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c94154160 0x7f9c941636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94154540 0x7f9c94159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c36d0 con 0x7f9c94069da0 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94151360 con 0x7f9c94154160 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.292+0000 7f9c9abd1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94151640 con 0x7f9c94154540 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59618/0 (socket says 172.21.15.52:59618) 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 -- 172.21.15.52:0/1387917966 learned_addr learned my addr 172.21.15.52:0/1387917966 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 -- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94154540 msgr2=0x7f9c94159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94154540 0x7f9c94159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 -- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c94154160 msgr2=0x7f9c941636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c94154160 0x7f9c941636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 -- 172.21.15.52:0/1387917966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c009a20 con 0x7f9c94069da0 2023-05-10T01:10:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9896d700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f9c8c00c0f0 tx=0x7f9c8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c00cd90 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c00f040 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0092a0 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c013610 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.293+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c94151c00 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.294+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940c39b0 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.294+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9c8c0139c0 con 0x7f9c94069da0 2023-05-10T01:10:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.295+0000 7f9c90ff9700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 0x7f9c78061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.295+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9c8c07a6e0 con 0x7f9c94069da0 2023-05-10T01:10:29.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.295+0000 7f9c93fff700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 0x7f9c78061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.295+0000 7f9c93fff700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 0x7f9c78061220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9c940aa2a0 tx=0x7f9c84007850).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.299+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c8c04bc80 con 0x7f9c94069da0 2023-05-10T01:10:29.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.514+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9c940666b0 con 0x7f9c94069da0 2023-05-10T01:10:29.541 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:10:29.538+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:10:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.540+0000 7f9c90ff9700 1 -- 172.21.15.52:0/1387917966 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9c8c04f2a0 con 0x7f9c94069da0 2023-05-10T01:10:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.542+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 msgr2=0x7f9c78061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.542+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 0x7f9c78061220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9c940aa2a0 tx=0x7f9c84007850).stop 2023-05-10T01:10:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.542+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 msgr2=0x7f9c94150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.542+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f9c8c00c0f0 tx=0x7f9c8c00b040).stop 2023-05-10T01:10:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 shutdown_connections 2023-05-10T01:10:29.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c7805ed60 0x7f9c78061220 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c94154540 0x7f9c94159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:29.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c94069da0 0x7f9c94150b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 --2- 172.21.15.52:0/1387917966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c94154160 0x7f9c941636f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:29.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 >> 172.21.15.52:0/1387917966 conn(0x7f9c940cb6f0 msgr2=0x7f9c940abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:29.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 shutdown_connections 2023-05-10T01:10:29.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.543+0000 7f9c9abd1700 1 -- 172.21.15.52:0/1387917966 wait complete. 2023-05-10T01:10:29.550 INFO:tasks.ceph.mds.b.smithi172.stderr: -1485> 2023-05-10T01:09:59.599+0000 7f1d3c937700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:10:29.550 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:10:29.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:10:29.572 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:10:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.679+0000 7ff2c86dd700 1 Processor -- start 2023-05-10T01:10:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.679+0000 7ff2c86dd700 1 -- start start 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c86dd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 0x7ff2c00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c86dd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2c0154460 0x7ff2c00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c86dd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c00aa560 con 0x7ff2c00aa140 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c86dd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00c94c0 con 0x7ff2c0154460 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c86dd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00cb7d0 con 0x7ff2c0154080 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c6c7a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff2c00aa140 0x7ff2c0068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40408/0 (socket says 172.21.15.52:40408) 2023-05-10T01:10:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c6c7a700 1 -- 172.21.15.52:0/918075892 learned_addr learned my addr 172.21.15.52:0/918075892 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/918075892 >> v2:172.21.15.172:3300/0 conn(0x7ff2c0154460 0x7ff2c00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c6479700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 0x7ff2c00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c5477700 1 -- 172.21.15.52:0/918075892 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494306389 0 0) 0x7ff2b0001110 con 0x7ff2c00aa140 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.680+0000 7ff2c5477700 1 -- 172.21.15.52:0/918075892 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac0033f0 con 0x7ff2c00aa140 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5c78700 1 -- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 msgr2=0x7ff2c00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 0x7ff2c00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5c78700 1 -- 172.21.15.52:0/918075892 >> v1:172.21.15.52:6789/0 conn(0x7ff2c00aa140 legacy=0x7ff2c0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5c78700 1 -- 172.21.15.52:0/918075892 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00c88b0 con 0x7ff2c0154460 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c6479700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 0x7ff2c00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c0154460 0x7ff2c00a9c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff2b4009760 tx=0x7ff2b4009060).ready entity=mon.1 client_cookie=aa67a7af4cc7c191 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5477700 1 -- 172.21.15.52:0/918075892 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400d4a0 con 0x7ff2c0154460 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5477700 1 -- 172.21.15.52:0/918075892 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400d600 con 0x7ff2c0154460 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c5477700 1 -- 172.21.15.52:0/918075892 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400d980 con 0x7ff2c0154460 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c86dd700 1 -- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c0154460 msgr2=0x7ff2c00a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.681+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c0154460 0x7ff2c00a9c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff2b4009760 tx=0x7ff2b4009060).stop 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 -- 172.21.15.52:0/918075892 shutdown_connections 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154080 0x7ff2c00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/918075892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c0154460 0x7ff2c00a9c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 -- 172.21.15.52:0/918075892 >> 172.21.15.52:0/918075892 conn(0x7ff2c0067910 msgr2=0x7ff2c00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 -- 172.21.15.52:0/918075892 shutdown_connections 2023-05-10T01:10:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.682+0000 7ff2c86dd700 1 -- 172.21.15.52:0/918075892 wait complete. 2023-05-10T01:10:29.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 Processor -- start 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 -- start start 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c00aa140 0x7ff2c0164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154460 0x7ff2c0157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c014f930 con 0x7ff2c0154080 2023-05-10T01:10:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0168a00 con 0x7ff2c00aa140 2023-05-10T01:10:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c86dd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0150eb0 con 0x7ff2c0154460 2023-05-10T01:10:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.683+0000 7ff2c5c78700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59630/0 (socket says 172.21.15.52:59630) 2023-05-10T01:10:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 -- 172.21.15.52:0/1395904217 learned_addr learned my addr 172.21.15.52:0/1395904217 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c6c7a700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154460 0x7ff2c0157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c6479700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c00aa140 0x7ff2c0164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 -- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154460 msgr2=0x7ff2c0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154460 0x7ff2c0157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 -- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c00aa140 msgr2=0x7ff2c0164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c00aa140 0x7ff2c0164580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 -- 172.21.15.52:0/1395904217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009a20 con 0x7ff2c0154080 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c5c78700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ff2c006bb20 tx=0x7ff2b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4000c90 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400d770 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40092a0 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b401d640 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.684+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c0151470 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.685+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c0066720 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.685+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff2b400f070 con 0x7ff2c0154080 2023-05-10T01:10:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.686+0000 7ff2be7fc700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 0x7ff2a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.686+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff2b407b1b0 con 0x7ff2c0154080 2023-05-10T01:10:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.686+0000 7ff2c6479700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 0x7ff2a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.686+0000 7ff2c6479700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 0x7ff2a0061220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff2b80099f0 tx=0x7ff2b800b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.690+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff2b404c700 con 0x7ff2c0154080 2023-05-10T01:10:29.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:29.905+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff2c00c8b90 con 0x7ff2c0154080 2023-05-10T01:10:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.557+0000 7ff2be7fc700 1 -- 172.21.15.52:0/1395904217 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff2b404fd20 con 0x7ff2c0154080 2023-05-10T01:10:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 msgr2=0x7ff2a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 0x7ff2a0061220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff2b80099f0 tx=0x7ff2b800b040).stop 2023-05-10T01:10:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 msgr2=0x7ff2c0168510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ff2c006bb20 tx=0x7ff2b4016000).stop 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 shutdown_connections 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff2a005ed60 0x7ff2a0061220 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2c0154460 0x7ff2c0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2c00aa140 0x7ff2c0164580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 --2- 172.21.15.52:0/1395904217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2c0154080 0x7ff2c0168510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 >> 172.21.15.52:0/1395904217 conn(0x7ff2c0067910 msgr2=0x7ff2c00c1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 shutdown_connections 2023-05-10T01:10:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.560+0000 7ff2c86dd700 1 -- 172.21.15.52:0/1395904217 wait complete. 2023-05-10T01:10:30.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:10:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.703+0000 7f4669f9a700 1 Processor -- start 2023-05-10T01:10:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.703+0000 7f4669f9a700 1 -- start start 2023-05-10T01:10:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4669f9a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46640c5d20 0x7f46640aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4669f9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f4664153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4669f9a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640c8820 con 0x7f46640c6100 2023-05-10T01:10:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4669f9a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640ca5f0 con 0x7f46640c5d20 2023-05-10T01:10:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4669f9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640c8b00 con 0x7f4664153a90 2023-05-10T01:10:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46640c5d20 0x7f46640aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46640c5d20 0x7f46640aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59636/0 (socket says 172.21.15.52:59636) 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 -- 172.21.15.52:0/1980858238 learned_addr learned my addr 172.21.15.52:0/1980858238 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f4663fff700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f4664153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 -- 172.21.15.52:0/1980858238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 msgr2=0x7f4664153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f4664153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 -- 172.21.15.52:0/1980858238 >> v1:172.21.15.172:6789/0 conn(0x7f46640c6100 legacy=0x7f4664069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.704+0000 7f46637fe700 1 -- 172.21.15.52:0/1980858238 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640c8de0 con 0x7f46640c5d20 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f46637fe700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c5d20 0x7f46640aa200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f4654006fd0 tx=0x7f46540090f0).ready entity=mon.0 client_cookie=4e039e66671b93c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f46627fc700 1 -- 172.21.15.52:0/1980858238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400b600 con 0x7f46640c5d20 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f46627fc700 1 -- 172.21.15.52:0/1980858238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400b760 con 0x7f46640c5d20 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f46627fc700 1 -- 172.21.15.52:0/1980858238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400bae0 con 0x7f46640c5d20 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 -- 172.21.15.52:0/1980858238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c5d20 msgr2=0x7f46640aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c5d20 0x7f46640aa200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f4654006fd0 tx=0x7f46540090f0).stop 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 -- 172.21.15.52:0/1980858238 shutdown_connections 2023-05-10T01:10:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f4664153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 --2- 172.21.15.52:0/1980858238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c5d20 0x7f46640aa200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 -- 172.21.15.52:0/1980858238 >> 172.21.15.52:0/1980858238 conn(0x7f46640cb6f0 msgr2=0x7f46640c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 -- 172.21.15.52:0/1980858238 shutdown_connections 2023-05-10T01:10:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.705+0000 7f4669f9a700 1 -- 172.21.15.52:0/1980858238 wait complete. 2023-05-10T01:10:30.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.706+0000 7f4669f9a700 1 Processor -- start 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 -- start start 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 0x7f4664149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f466414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640adbb0 con 0x7f46640c6100 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ae6c0 con 0x7f46640c5d20 2023-05-10T01:10:30.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4669f9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640add90 con 0x7f4664153a90 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4662ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4662ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59644/0 (socket says 172.21.15.52:59644) 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.707+0000 7f4662ffd700 1 -- 172.21.15.52:0/3892520225 learned_addr learned my addr 172.21.15.52:0/3892520225 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f46637fe700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 0x7f4664149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4663fff700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f466414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 -- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 msgr2=0x7f466414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f466414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 -- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 msgr2=0x7f4664149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:30.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 0x7f4664149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:30.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 -- 172.21.15.52:0/3892520225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009370 con 0x7f46640c6100 2023-05-10T01:10:30.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f46637fe700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 0x7f4664149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:30.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4662ffd700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f465800c4c0 tx=0x7f4658007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658007020 con 0x7f46640c6100 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658001e90 con 0x7f46640c6100 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640ae070 con 0x7f46640c6100 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580073b0 con 0x7f46640c6100 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.708+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46641503a0 con 0x7f46640c6100 2023-05-10T01:10:30.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.709+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4664066720 con 0x7f46640c6100 2023-05-10T01:10:30.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.709+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4658010070 con 0x7f46640c6100 2023-05-10T01:10:30.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.710+0000 7f464b7fe700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 0x7f4644061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:30.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.710+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f46580794b0 con 0x7f46640c6100 2023-05-10T01:10:30.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.710+0000 7f46637fe700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 0x7f4644061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:30.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.710+0000 7f46637fe700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 0x7f4644061280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4654009130 tx=0x7f4654017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:30.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.714+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f465804aa00 con 0x7f46640c6100 2023-05-10T01:10:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:30.886+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f466406c340 con 0x7f46640c6100 2023-05-10T01:10:31.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.562+0000 7f464b7fe700 1 -- 172.21.15.52:0/3892520225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f465804e020 con 0x7f46640c6100 2023-05-10T01:10:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.565+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 msgr2=0x7f4644061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.565+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 0x7f4644061280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4654009130 tx=0x7f4654017000).stop 2023-05-10T01:10:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.565+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 msgr2=0x7f466414e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.565+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f465800c4c0 tx=0x7f4658007e00).stop 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 shutdown_connections 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f464405edc0 0x7f4644061280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4664153a90 0x7f466414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46640c5d20 0x7f4664149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 --2- 172.21.15.52:0/3892520225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46640c6100 0x7f466414e330 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 >> 172.21.15.52:0/3892520225 conn(0x7f46640cb6f0 msgr2=0x7f466414c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 shutdown_connections 2023-05-10T01:10:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.566+0000 7f4669f9a700 1 -- 172.21.15.52:0/3892520225 wait complete. 2023-05-10T01:10:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:10:31.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:10:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.703+0000 7fbbfb7c9700 1 Processor -- start 2023-05-10T01:10:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 -- start start 2023-05-10T01:10:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c5d20 0x7fbbf40aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbf40c6100 0x7fbbf4069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 0x7fbbf4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40c8820 con 0x7fbbf40c6100 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40c8b00 con 0x7fbbf4153a90 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.704+0000 7fbbfb7c9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40c8de0 con 0x7fbbf40c5d20 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbf40c6100 0x7fbbf4069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbf40c6100 0x7fbbf4069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59652/0 (socket says 172.21.15.52:59652) 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 -- 172.21.15.52:0/591017168 learned_addr learned my addr 172.21.15.52:0/591017168 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf9d66700 1 --2- 172.21.15.52:0/591017168 >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 0x7fbbf4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf9565700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c5d20 0x7fbbf40aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 -- 172.21.15.52:0/591017168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c5d20 msgr2=0x7fbbf40aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:31.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c5d20 0x7fbbf40aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 -- 172.21.15.52:0/591017168 >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 msgr2=0x7fbbf4153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:31.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 --2- 172.21.15.52:0/591017168 >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 0x7fbbf4153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 -- 172.21.15.52:0/591017168 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40c90c0 con 0x7fbbf40c6100 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf9d66700 1 --2- 172.21.15.52:0/591017168 >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 0x7fbbf4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf8d64700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf40c6100 0x7fbbf4069fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fbbf406c030 tx=0x7fbbe80090f0).ready entity=mon.0 client_cookie=445b24a1e61887e5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf3fff700 1 -- 172.21.15.52:0/591017168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800b600 con 0x7fbbf40c6100 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf3fff700 1 -- 172.21.15.52:0/591017168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe800b760 con 0x7fbbf40c6100 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.705+0000 7fbbf3fff700 1 -- 172.21.15.52:0/591017168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800bae0 con 0x7fbbf40c6100 2023-05-10T01:10:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/591017168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf40c6100 msgr2=0x7fbbf4069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf40c6100 0x7fbbf4069fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fbbf406c030 tx=0x7fbbe80090f0).stop 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/591017168 shutdown_connections 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/591017168 >> v2:172.21.15.172:3300/0 conn(0x7fbbf4153a90 0x7fbbf4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c5d20 0x7fbbf40aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/591017168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf40c6100 0x7fbbf4069fe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/591017168 >> 172.21.15.52:0/591017168 conn(0x7fbbf40cb6f0 msgr2=0x7fbbf40c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/591017168 shutdown_connections 2023-05-10T01:10:31.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.706+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/591017168 wait complete. 2023-05-10T01:10:31.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.707+0000 7fbbfb7c9700 1 Processor -- start 2023-05-10T01:10:31.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.707+0000 7fbbfb7c9700 1 -- start start 2023-05-10T01:10:31.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf40c5d20 0x7fbbf41503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c6100 0x7fbbf414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4150890 con 0x7fbbf4153a90 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4164520 con 0x7fbbf40c5d20 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbfb7c9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41533d0 con 0x7fbbf40c6100 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59660/0 (socket says 172.21.15.52:59660) 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 -- 172.21.15.52:0/773521090 learned_addr learned my addr 172.21.15.52:0/773521090 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9565700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf40c5d20 0x7fbbf41503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf8d64700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c6100 0x7fbbf414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 -- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c6100 msgr2=0x7fbbf414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c6100 0x7fbbf414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 -- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf40c5d20 msgr2=0x7fbbf41503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf40c5d20 0x7fbbf41503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 -- 172.21.15.52:0/773521090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8009370 con 0x7fbbf4153a90 2023-05-10T01:10:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.708+0000 7fbbf9d66700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fbbe400d860 tx=0x7fbbe4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.709+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011590 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.709+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40116f0 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.709+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011a90 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.709+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf41647c0 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.709+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf4152e10 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.710+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4066720 con 0x7fbbf4153a90 2023-05-10T01:10:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.710+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbbe4012420 con 0x7fbbf4153a90 2023-05-10T01:10:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.710+0000 7fbbf17fa700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 0x7fbbd4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.710+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7fbbe40794a0 con 0x7fbbf4153a90 2023-05-10T01:10:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.711+0000 7fbbf9565700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 0x7fbbd4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.711+0000 7fbbf9565700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 0x7fbbd4061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbbec0075a0 tx=0x7fbbec0097e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.714+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbbe404ab40 con 0x7fbbf4153a90 2023-05-10T01:10:31.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:31.898+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbf4164950 con 0x7fbbf4153a90 2023-05-10T01:10:32.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.566+0000 7fbbf17fa700 1 -- 172.21.15.52:0/773521090 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbbe404e160 con 0x7fbbf4153a90 2023-05-10T01:10:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 msgr2=0x7fbbd4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 0x7fbbd4061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbbec0075a0 tx=0x7fbbec0097e0).stop 2023-05-10T01:10:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 msgr2=0x7fbbf40aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fbbe400d860 tx=0x7fbbe4008040).stop 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 shutdown_connections 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbbd405ed90 0x7fbbd4061250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbf4153a90 0x7fbbf40aed50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf40c5d20 0x7fbbf41503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 --2- 172.21.15.52:0/773521090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbf40c6100 0x7fbbf414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.570+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 >> 172.21.15.52:0/773521090 conn(0x7fbbf40cb6f0 msgr2=0x7fbbf414f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.571+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 shutdown_connections 2023-05-10T01:10:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.571+0000 7fbbfb7c9700 1 -- 172.21.15.52:0/773521090 wait complete. 2023-05-10T01:10:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:10:32.597 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:10:32.597 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:10:32.597 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:10:32.597 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:10:32.598 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:10:32.598 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:10:32.598 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:10:32.598 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:10:32.599 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:10:32.599 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:10:32.599 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:10:32.600 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:10:32.600 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:10:32.600 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:10:32.601 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:10:32.601 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:10:32.609 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:10:32.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:10:32.611 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:10:32.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:10:32.614 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:10:32.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:10:32.616 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:10:32.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:10:32.654 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:10:32.655 DEBUG:teuthology.parallel:result is None 2023-05-10T01:10:32.659 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:10:32.659 DEBUG:teuthology.parallel:result is None 2023-05-10T01:10:32.660 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:10:32.660 DEBUG:teuthology.parallel:result is None 2023-05-10T01:10:32.661 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:10:32.662 DEBUG:teuthology.parallel:result is None 2023-05-10T01:10:32.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:10:32.738 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:10:32.738 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:10:32.748 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:10:32.749 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:10:32.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.804+0000 7faf68fda700 1 Processor -- start 2023-05-10T01:10:32.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.804+0000 7faf68fda700 1 -- start start 2023-05-10T01:10:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf68fda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf64150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf68fda700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 0x7faf64065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf68fda700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640653b0 con 0x7faf64150080 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf68fda700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640645c0 con 0x7faf64154a00 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf68fda700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640647a0 con 0x7faf64154540 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf637fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faf64150080 0x7faf64153e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40472/0 (socket says 172.21.15.52:40472) 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf637fe700 1 -- 172.21.15.52:0/2260380834 learned_addr learned my addr 172.21.15.52:0/2260380834 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf62ffd700 1 --2- 172.21.15.52:0/2260380834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf64150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf63fff700 1 --2- 172.21.15.52:0/2260380834 >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 0x7faf64065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865940575 0 0) 0x7faf640653b0 con 0x7faf64150080 2023-05-10T01:10:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf500033f0 con 0x7faf64150080 2023-05-10T01:10:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424070246 0 0) 0x7faf500033f0 con 0x7faf64150080 2023-05-10T01:10:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf62ffd700 1 -- 172.21.15.52:0/2260380834 >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 msgr2=0x7faf64065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf62ffd700 1 --2- 172.21.15.52:0/2260380834 >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 0x7faf64065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf62ffd700 1 -- 172.21.15.52:0/2260380834 >> v1:172.21.15.52:6789/0 conn(0x7faf64150080 legacy=0x7faf64153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf62ffd700 1 -- 172.21.15.52:0/2260380834 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64064a80 con 0x7faf64154540 2023-05-10T01:10:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.805+0000 7faf63fff700 1 --2- 172.21.15.52:0/2260380834 >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 0x7faf64065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf62ffd700 1 --2- 172.21.15.52:0/2260380834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf64150460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faf58009760 tx=0x7faf58009060).ready entity=mon.2 client_cookie=6bca05c00958a04f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54001470 con 0x7faf64154540 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58011400 con 0x7faf64154540 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf627fc700 1 -- 172.21.15.52:0/2260380834 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58011780 con 0x7faf64154540 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 -- 172.21.15.52:0/2260380834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 msgr2=0x7faf64150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 --2- 172.21.15.52:0/2260380834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf64150460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faf58009760 tx=0x7faf58009060).stop 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 -- 172.21.15.52:0/2260380834 shutdown_connections 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 --2- 172.21.15.52:0/2260380834 >> v2:172.21.15.172:3300/0 conn(0x7faf64154a00 0x7faf64065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 --2- 172.21.15.52:0/2260380834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf64150460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 -- 172.21.15.52:0/2260380834 >> 172.21.15.52:0/2260380834 conn(0x7faf640c3150 msgr2=0x7faf640c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 -- 172.21.15.52:0/2260380834 shutdown_connections 2023-05-10T01:10:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.806+0000 7faf68fda700 1 -- 172.21.15.52:0/2260380834 wait complete. 2023-05-10T01:10:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.807+0000 7faf68fda700 1 Processor -- start 2023-05-10T01:10:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 -- start start 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf64150080 0x7faf640c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf640c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c0200 con 0x7faf64154a00 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c1780 con 0x7faf64150080 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf68fda700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6413fac0 con 0x7faf64154540 2023-05-10T01:10:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf63fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf63fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59696/0 (socket says 172.21.15.52:59696) 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.808+0000 7faf63fff700 1 -- 172.21.15.52:0/3917903494 learned_addr learned my addr 172.21.15.52:0/3917903494 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf62ffd700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf640c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf637fe700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf64150080 0x7faf640c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 -- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 msgr2=0x7faf640c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf640c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 -- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf64150080 msgr2=0x7faf640c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf64150080 0x7faf640c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 -- 172.21.15.52:0/3917903494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009a20 con 0x7faf64154a00 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf63fff700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7faf5c009f20 tx=0x7faf5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00cb70 con 0x7faf64154a00 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00f040 con 0x7faf64154a00 2023-05-10T01:10:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf580092a0 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c013400 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.809+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640be030 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.810+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf640be1c0 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.810+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faf5c0137f0 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.811+0000 7faf4b7fe700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 0x7faf44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.811+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7faf5c07a2c0 con 0x7faf64154a00 2023-05-10T01:10:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.811+0000 7faf637fe700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 0x7faf44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.811+0000 7faf637fe700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 0x7faf44061250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7faf54004b30 tx=0x7faf54001680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:32.815+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf5c04bb60 con 0x7faf64154a00 2023-05-10T01:10:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.006+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faf64047150 con 0x7faf64154a00 2023-05-10T01:10:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.780+0000 7faf4b7fe700 1 -- 172.21.15.52:0/3917903494 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7faf5c04f180 con 0x7faf64154a00 2023-05-10T01:10:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 msgr2=0x7faf44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 0x7faf44061250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7faf54004b30 tx=0x7faf54001680).stop 2023-05-10T01:10:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 msgr2=0x7faf640ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7faf5c009f20 tx=0x7faf5c00b040).stop 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 shutdown_connections 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf4405ed90 0x7faf44061250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf64154a00 0x7faf640ab7f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf64150080 0x7faf640c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 --2- 172.21.15.52:0/3917903494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf64154540 0x7faf640c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 >> 172.21.15.52:0/3917903494 conn(0x7faf640c3150 msgr2=0x7faf640c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:33.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 shutdown_connections 2023-05-10T01:10:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.783+0000 7faf68fda700 1 -- 172.21.15.52:0/3917903494 wait complete. 2023-05-10T01:10:33.789 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:10:33.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:10:33.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.922+0000 7f8b1eaba700 1 Processor -- start 2023-05-10T01:10:33.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.922+0000 7f8b1eaba700 1 -- start start 2023-05-10T01:10:33.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1eaba700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 0x7f8b180c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1eaba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b18063e20 0x7f8b180abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1eaba700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180bdc20 con 0x7f8b1813b920 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1eaba700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180c53f0 con 0x7f8b18063e20 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1eaba700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180c4e30 con 0x7f8b1813b540 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1d057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b18063e20 0x7f8b180abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1d057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b18063e20 0x7f8b180abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59708/0 (socket says 172.21.15.52:59708) 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.923+0000 7f8b1d057700 1 -- 172.21.15.52:0/3933987216 learned_addr learned my addr 172.21.15.52:0/3933987216 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3933987216 >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 0x7f8b180c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1d057700 1 -- 172.21.15.52:0/3933987216 >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 msgr2=0x7f8b180c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1d057700 1 --2- 172.21.15.52:0/3933987216 >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 0x7f8b180c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1d057700 1 -- 172.21.15.52:0/3933987216 >> v1:172.21.15.172:6789/0 conn(0x7f8b1813b920 legacy=0x7f8b18063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1d057700 1 -- 172.21.15.52:0/3933987216 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180c5110 con 0x7f8b18063e20 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3933987216 >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 0x7f8b180c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:33.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1d057700 1 --2- 172.21.15.52:0/3933987216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b18063e20 0x7f8b180abb10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f8b18067b00 tx=0x7f8b000090f0).ready entity=mon.0 client_cookie=c5b320d84f9961b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b177fe700 1 -- 172.21.15.52:0/3933987216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000b5a0 con 0x7f8b18063e20 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b177fe700 1 -- 172.21.15.52:0/3933987216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000b700 con 0x7f8b18063e20 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b177fe700 1 -- 172.21.15.52:0/3933987216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000ba80 con 0x7f8b18063e20 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3933987216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b18063e20 msgr2=0x7f8b180abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.924+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3933987216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b18063e20 0x7f8b180abb10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f8b18067b00 tx=0x7f8b000090f0).stop 2023-05-10T01:10:33.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3933987216 shutdown_connections 2023-05-10T01:10:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3933987216 >> v2:172.21.15.172:3300/0 conn(0x7f8b1813b540 0x7f8b180c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3933987216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b18063e20 0x7f8b180abb10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3933987216 >> 172.21.15.52:0/3933987216 conn(0x7f8b180c8a90 msgr2=0x7f8b180c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3933987216 shutdown_connections 2023-05-10T01:10:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.925+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3933987216 wait complete. 2023-05-10T01:10:33.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.926+0000 7f8b1eaba700 1 Processor -- start 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.926+0000 7f8b1eaba700 1 -- start start 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 0x7f8b18167360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 0x7f8b18062460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180683d0 con 0x7f8b1813b920 2023-05-10T01:10:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18168290 con 0x7f8b18063e20 2023-05-10T01:10:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18167cd0 con 0x7f8b1813b540 2023-05-10T01:10:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59716/0 (socket says 172.21.15.52:59716) 2023-05-10T01:10:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 -- 172.21.15.52:0/3270063433 learned_addr learned my addr 172.21.15.52:0/3270063433 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b17fff700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 0x7f8b18062460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 0x7f8b18167360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 -- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 msgr2=0x7f8b18062460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 0x7f8b18062460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 -- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 msgr2=0x7f8b18167360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 0x7f8b18167360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 -- 172.21.15.52:0/3270063433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009370 con 0x7f8b1813b920 2023-05-10T01:10:33.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b17fff700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 0x7f8b18062460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 0x7f8b18167360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1d057700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f8b00009130 tx=0x7f8b00015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000ba80 con 0x7f8b1813b920 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0001c420 con 0x7f8b1813b920 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b18167fb0 con 0x7f8b1813b920 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0001c7e0 con 0x7f8b1813b920 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.927+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b18167850 con 0x7f8b1813b920 2023-05-10T01:10:33.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.928+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18068510 con 0x7f8b1813b920 2023-05-10T01:10:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.929+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8b0002c070 con 0x7f8b1813b920 2023-05-10T01:10:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.929+0000 7f8b14ff9700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 0x7f8afc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.929+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8b0007b830 con 0x7f8b1813b920 2023-05-10T01:10:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.929+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 0x7f8afc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.930+0000 7f8b1c856700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 0x7f8afc061250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8b1000aa90 tx=0x7f8b10008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:33.933+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b18068510 con 0x7f8b1813b920 2023-05-10T01:10:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.176+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8b18068510 con 0x7f8b1813b920 2023-05-10T01:10:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.176+0000 7f8b14ff9700 1 -- 172.21.15.52:0/3270063433 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8b18068510 con 0x7f8b1813b920 2023-05-10T01:10:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:34.180 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:10:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:10:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:10:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:10:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:10:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:10:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:10:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:10:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:10:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:10:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:10:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:10:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:10:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:10:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:10:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:10:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mds", 2023-05-10T01:10:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpkTkhwIxAA866hMmqQFkv2qkStOJBo+g==", 2023-05-10T01:10:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mds" 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mgr", 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpkiFNwIxAABcvEqzubKLfzHpq7GQ+Pbg==", 2023-05-10T01:10:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-osd", 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpkTF5wIxAAKUaHV3N8JkjrKQlAfhMcRQ==", 2023-05-10T01:10:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-osd" 2023-05-10T01:10:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd", 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpkHWhwIxAAjmR/ciNiSq+/Q3w/p5OSXg==", 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpktXNwIxAAFZnPxgOHgOOnKO6G7q5OwQ==", 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rgw", 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDP7lpk3HxwIxAAIAwNgE3lTQgCRqZg+T8jvw==", 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:10:34.219 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:10:34.222 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:10:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 msgr2=0x7f8afc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 0x7f8afc061250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8b1000aa90 tx=0x7f8b10008040).stop 2023-05-10T01:10:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 msgr2=0x7f8b180c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f8b00009130 tx=0x7f8b00015000).stop 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 shutdown_connections 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8afc05ed90 0x7f8afc061250 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1813b920 0x7f8b180c6090 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b18063e20 0x7f8b18167360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 --2- 172.21.15.52:0/3270063433 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b1813b540 0x7f8b18062460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 >> 172.21.15.52:0/3270063433 conn(0x7f8b180c8a90 msgr2=0x7f8b1813a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 shutdown_connections 2023-05-10T01:10:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.178+0000 7f8b1eaba700 1 -- 172.21.15.52:0/3270063433 wait complete. 2023-05-10T01:10:34.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-10T01:10:34.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.339+0000 7efe7bdaf700 1 Processor -- start 2023-05-10T01:10:34.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.339+0000 7efe7bdaf700 1 -- start start 2023-05-10T01:10:34.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7bdaf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe74154160 0x7efe740c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7bdaf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe74154540 0x7efe740c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7bdaf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740c0650 con 0x7efe74069690 2023-05-10T01:10:34.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7bdaf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740c1af0 con 0x7efe74154540 2023-05-10T01:10:34.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7bdaf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740bfd20 con 0x7efe74154160 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7934a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe74154540 0x7efe740c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7934a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe74154540 0x7efe740c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59720/0 (socket says 172.21.15.52:59720) 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.340+0000 7efe7934a700 1 -- 172.21.15.52:0/3452841280 learned_addr learned my addr 172.21.15.52:0/3452841280 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe79b4b700 1 --2- 172.21.15.52:0/3452841280 >> v2:172.21.15.172:3300/0 conn(0x7efe74154160 0x7efe740c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7934a700 1 -- 172.21.15.52:0/3452841280 >> v2:172.21.15.172:3300/0 conn(0x7efe74154160 msgr2=0x7efe740c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7934a700 1 --2- 172.21.15.52:0/3452841280 >> v2:172.21.15.172:3300/0 conn(0x7efe74154160 0x7efe740c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7934a700 1 -- 172.21.15.52:0/3452841280 >> v1:172.21.15.172:6789/0 conn(0x7efe74069690 legacy=0x7efe74157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7934a700 1 -- 172.21.15.52:0/3452841280 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740c0000 con 0x7efe74154540 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7934a700 1 --2- 172.21.15.52:0/3452841280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740c6150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7efe74083020 tx=0x7efe680090f0).ready entity=mon.0 client_cookie=8941d2f85bfe7dab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe78b49700 1 -- 172.21.15.52:0/3452841280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800b5a0 con 0x7efe74154540 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe78b49700 1 -- 172.21.15.52:0/3452841280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800b700 con 0x7efe74154540 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe78b49700 1 -- 172.21.15.52:0/3452841280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800ba80 con 0x7efe74154540 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3452841280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 msgr2=0x7efe740c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.341+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3452841280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740c6150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7efe74083020 tx=0x7efe680090f0).stop 2023-05-10T01:10:34.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3452841280 shutdown_connections 2023-05-10T01:10:34.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3452841280 >> v2:172.21.15.172:3300/0 conn(0x7efe74154160 0x7efe740c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3452841280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740c6150 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3452841280 >> 172.21.15.52:0/3452841280 conn(0x7efe740cb740 msgr2=0x7efe740c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:34.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3452841280 shutdown_connections 2023-05-10T01:10:34.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.342+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3452841280 wait complete. 2023-05-10T01:10:34.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 Processor -- start 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 -- start start 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe74069690 0x7efe74150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe74154160 0x7efe740b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe741507f0 con 0x7efe74154540 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74152820 con 0x7efe74069690 2023-05-10T01:10:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.343+0000 7efe7bdaf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe74157d30 con 0x7efe74154160 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59730/0 (socket says 172.21.15.52:59730) 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 -- 172.21.15.52:0/3282710312 learned_addr learned my addr 172.21.15.52:0/3282710312 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe79b4b700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe74069690 0x7efe74150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7934a700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe74154160 0x7efe740b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 -- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe74154160 msgr2=0x7efe740b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe74154160 0x7efe740b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 -- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe74069690 msgr2=0x7efe74150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe74069690 0x7efe74150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 -- 172.21.15.52:0/3282710312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009370 con 0x7efe74154540 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7a34c700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7efe6400c810 tx=0x7efe64002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64010510 con 0x7efe74154540 2023-05-10T01:10:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe640106b0 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe740b0210 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64010a70 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.344+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe74157ad0 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.345+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe740affc0 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.346+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efe64019030 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.346+0000 7efe71ffb700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 0x7efe54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.346+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efe64078ec0 con 0x7efe74154540 2023-05-10T01:10:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.346+0000 7efe79b4b700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 0x7efe54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.347+0000 7efe79b4b700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 0x7efe54061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efe6c00bbc0 tx=0x7efe6c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.350+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe640488f0 con 0x7efe74154540 2023-05-10T01:10:34.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.591+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7efe740666b0 con 0x7efe74154540 2023-05-10T01:10:34.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.595+0000 7efe71ffb700 1 -- 172.21.15.52:0/3282710312 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe6404a860 con 0x7efe74154540 2023-05-10T01:10:34.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.596+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 msgr2=0x7efe54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 0x7efe54061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efe6c00bbc0 tx=0x7efe6c008040).stop 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 msgr2=0x7efe740aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7efe6400c810 tx=0x7efe64002560).stop 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 shutdown_connections 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efe5405ed90 0x7efe54061250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe74154540 0x7efe740aeb00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe74069690 0x7efe74150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 --2- 172.21.15.52:0/3282710312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe74154160 0x7efe740b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 >> 172.21.15.52:0/3282710312 conn(0x7efe740cb740 msgr2=0x7efe740ac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 shutdown_connections 2023-05-10T01:10:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.597+0000 7efe7bdaf700 1 -- 172.21.15.52:0/3282710312 wait complete. 2023-05-10T01:10:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:34.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-10T01:10:34.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.728+0000 7fc8623c5700 1 Processor -- start 2023-05-10T01:10:34.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.728+0000 7fc8623c5700 1 -- start start 2023-05-10T01:10:34.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc8623c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc85c154030 0x7fc85c069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc8623c5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c062950 con 0x7fc85c063e20 2023-05-10T01:10:34.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc8623c5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c069fa0 con 0x7fc85c0bf4e0 2023-05-10T01:10:34.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc8623c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c154410 con 0x7fc85c154030 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc85c154030 0x7fc85c069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc85c154030 0x7fc85c069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59734/0 (socket says 172.21.15.52:59734) 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 -- 172.21.15.52:0/1471934344 learned_addr learned my addr 172.21.15.52:0/1471934344 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc860962700 1 --1- 172.21.15.52:0/1471934344 >> v1:172.21.15.52:6789/0 conn(0x7fc85c063e20 0x7fc85c0bd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40522/0 (socket says 172.21.15.52:40522) 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 -- 172.21.15.52:0/1471934344 >> v1:172.21.15.172:6789/0 conn(0x7fc85c0bf4e0 legacy=0x7fc85c063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 -- 172.21.15.52:0/1471934344 >> v1:172.21.15.52:6789/0 conn(0x7fc85c063e20 legacy=0x7fc85c0bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85bfff700 1 -- 172.21.15.52:0/1471934344 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c062340 con 0x7fc85c154030 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.729+0000 7fc85affd700 1 -- 172.21.15.52:0/1471934344 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744541811 0 0) 0x7fc85c062950 con 0x7fc85c063e20 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc85bfff700 1 --2- 172.21.15.52:0/1471934344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c154030 0x7fc85c069ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fc84c006fd0 tx=0x7fc84c0090f0).ready entity=mon.0 client_cookie=fb713c2ba088f7e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc85affd700 1 -- 172.21.15.52:0/1471934344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00b600 con 0x7fc85c154030 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc85affd700 1 -- 172.21.15.52:0/1471934344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00b760 con 0x7fc85c154030 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc85affd700 1 -- 172.21.15.52:0/1471934344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00bae0 con 0x7fc85c154030 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 -- 172.21.15.52:0/1471934344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c154030 msgr2=0x7fc85c069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1471934344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c154030 0x7fc85c069ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fc84c006fd0 tx=0x7fc84c0090f0).stop 2023-05-10T01:10:34.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 -- 172.21.15.52:0/1471934344 shutdown_connections 2023-05-10T01:10:34.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1471934344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c154030 0x7fc85c069ab0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 -- 172.21.15.52:0/1471934344 >> 172.21.15.52:0/1471934344 conn(0x7fc85c0c8a90 msgr2=0x7fc85c0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:34.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 -- 172.21.15.52:0/1471934344 shutdown_connections 2023-05-10T01:10:34.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.730+0000 7fc8623c5700 1 -- 172.21.15.52:0/1471934344 wait complete. 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.731+0000 7fc8623c5700 1 Processor -- start 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 -- start start 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 0x7fc85c163f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 0x7fc85c0a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0acbc0 con 0x7fc85c063e20 2023-05-10T01:10:34.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0a9d50 con 0x7fc85c154030 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc8623c5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ac8e0 con 0x7fc85c0bf4e0 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59740/0 (socket says 172.21.15.52:59740) 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.732+0000 7fc85bfff700 1 -- 172.21.15.52:0/1582360935 learned_addr learned my addr 172.21.15.52:0/1582360935 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc860962700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 0x7fc85c0a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85b7fe700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 0x7fc85c163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 -- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 msgr2=0x7fc85c163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 0x7fc85c163f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 -- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 msgr2=0x7fc85c0a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 0x7fc85c0a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 -- 172.21.15.52:0/1582360935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c009370 con 0x7fc85c063e20 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc860962700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 0x7fc85c0a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85b7fe700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 0x7fc85c163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc85bfff700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fc84c009f50 tx=0x7fc84c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00b8d0 con 0x7fc85c063e20 2023-05-10T01:10:34.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00ba30 con 0x7fc85c063e20 2023-05-10T01:10:34.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0a9700 con 0x7fc85c063e20 2023-05-10T01:10:34.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c01a430 con 0x7fc85c063e20 2023-05-10T01:10:34.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.733+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c0ade40 con 0x7fc85c063e20 2023-05-10T01:10:34.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.734+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c0a9560 con 0x7fc85c063e20 2023-05-10T01:10:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.734+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc84c02b070 con 0x7fc85c063e20 2023-05-10T01:10:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.735+0000 7fc843fff700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 0x7fc83c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.735+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc84c07b020 con 0x7fc85c063e20 2023-05-10T01:10:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.735+0000 7fc85b7fe700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 0x7fc83c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:34.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.735+0000 7fc85b7fe700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 0x7fc83c061220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc85c155500 tx=0x7fc850009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:34.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.739+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc85c0a9560 con 0x7fc85c063e20 2023-05-10T01:10:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.982+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc85c0a9560 con 0x7fc85c063e20 2023-05-10T01:10:34.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.986+0000 7fc843fff700 1 -- 172.21.15.52:0/1582360935 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc85c0a9560 con 0x7fc85c063e20 2023-05-10T01:10:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 msgr2=0x7fc83c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 0x7fc83c061220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc85c155500 tx=0x7fc850009040).stop 2023-05-10T01:10:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 msgr2=0x7fc85c0ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fc84c009f50 tx=0x7fc84c017000).stop 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 shutdown_connections 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc83c05ed60 0x7fc83c061220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85c154030 0x7fc85c0a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc85c063e20 0x7fc85c0ad950 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 --2- 172.21.15.52:0/1582360935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85c0bf4e0 0x7fc85c163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 >> 172.21.15.52:0/1582360935 conn(0x7fc85c0c8a90 msgr2=0x7fc85c1547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 shutdown_connections 2023-05-10T01:10:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:34.988+0000 7fc8623c5700 1 -- 172.21.15.52:0/1582360935 wait complete. 2023-05-10T01:10:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:35.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-10T01:10:35.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.117+0000 7f56d85a9700 1 Processor -- start 2023-05-10T01:10:35.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.117+0000 7f56d85a9700 1 -- start start 2023-05-10T01:10:35.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.118+0000 7f56d85a9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.118+0000 7f56d85a9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.118+0000 7f56d85a9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d0067550 con 0x7f56d0153ea0 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.118+0000 7f56d85a9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d0065990 con 0x7f56d0068c60 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.118+0000 7f56d85a9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00bc9a0 con 0x7f56d0064ff0 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5b44700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5b44700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:58072/0 (socket says 172.21.15.52:58072) 2023-05-10T01:10:35.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:51154/0 (socket says 172.21.15.52:51154) 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5b44700 1 -- 172.21.15.52:0/3030564363 learned_addr learned my addr 172.21.15.52:0/3030564363 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5343700 1 -- 172.21.15.52:0/3030564363 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562110297 0 0) 0x7f56c8001110 con 0x7f56d0153ea0 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5343700 1 -- 172.21.15.52:0/3030564363 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b80033f0 con 0x7f56d0153ea0 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 -- 172.21.15.52:0/3030564363 >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 msgr2=0x7f56d0154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 --2- 172.21.15.52:0/3030564363 >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 -- 172.21.15.52:0/3030564363 >> v1:172.21.15.172:6789/0 conn(0x7f56d0153ea0 legacy=0x7f56d0066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d6b46700 1 -- 172.21.15.52:0/3030564363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d00bcc80 con 0x7f56d0064ff0 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.119+0000 7f56d5b44700 1 --2- 172.21.15.52:0/3030564363 >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d6b46700 1 --2- 172.21.15.52:0/3030564363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f56cc009e60 tx=0x7f56cc009780).ready entity=mon.2 client_cookie=4ec914ca2bc4b7cd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d5343700 1 -- 172.21.15.52:0/3030564363 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00e070 con 0x7f56d0064ff0 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d5343700 1 -- 172.21.15.52:0/3030564363 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00bab0 con 0x7f56d0064ff0 2023-05-10T01:10:35.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d5343700 1 -- 172.21.15.52:0/3030564363 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00be30 con 0x7f56d0064ff0 2023-05-10T01:10:35.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 -- 172.21.15.52:0/3030564363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 msgr2=0x7f56d00654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 --2- 172.21.15.52:0/3030564363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f56cc009e60 tx=0x7f56cc009780).stop 2023-05-10T01:10:35.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 -- 172.21.15.52:0/3030564363 shutdown_connections 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 --2- 172.21.15.52:0/3030564363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0064ff0 0x7f56d00654a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 --2- 172.21.15.52:0/3030564363 >> v2:172.21.15.172:3300/0 conn(0x7f56d0068c60 0x7f56d0154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 -- 172.21.15.52:0/3030564363 >> 172.21.15.52:0/3030564363 conn(0x7f56d00c4420 msgr2=0x7f56d00c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 -- 172.21.15.52:0/3030564363 shutdown_connections 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.120+0000 7f56d85a9700 1 -- 172.21.15.52:0/3030564363 wait complete. 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.121+0000 7f56d85a9700 1 Processor -- start 2023-05-10T01:10:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.121+0000 7f56d85a9700 1 -- start start 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0153ea0 0x7f56d0155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d0155c60 0x7f56d01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0158370 con 0x7f56d0064ff0 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d01560a0 con 0x7f56d0155c60 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d85a9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0157760 con 0x7f56d0153ea0 2023-05-10T01:10:35.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d6345700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d6345700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59754/0 (socket says 172.21.15.52:59754) 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d6345700 1 -- 172.21.15.52:0/1343770911 learned_addr learned my addr 172.21.15.52:0/1343770911 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d6b46700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d0155c60 0x7f56d01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.122+0000 7f56d5b44700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0153ea0 0x7f56d0155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 -- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0153ea0 msgr2=0x7f56d0155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0153ea0 0x7f56d0155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 -- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d0155c60 msgr2=0x7f56d01569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d0155c60 0x7f56d01569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 -- 172.21.15.52:0/1343770911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0009370 con 0x7f56d0064ff0 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d6345700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f56c800c440 tx=0x7f56c8007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800f470 con 0x7f56d0064ff0 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c800f5d0 con 0x7f56d0064ff0 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800f990 con 0x7f56d0064ff0 2023-05-10T01:10:35.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc009a20 con 0x7f56d0064ff0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.123+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d0157d20 con 0x7f56d0064ff0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.124+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d006c340 con 0x7f56d0064ff0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.124+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f56c8019030 con 0x7f56d0064ff0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.124+0000 7f56be7fc700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 0x7f56b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.125+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f56c8078ae0 con 0x7f56d0064ff0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.125+0000 7f56d5b44700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 0x7f56b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.125+0000 7f56d5b44700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 0x7f56b0061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f56c0009340 tx=0x7f56c0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.128+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f56c804a370 con 0x7f56d0064ff0 2023-05-10T01:10:35.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.369+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f56d0067550 con 0x7f56d0064ff0 2023-05-10T01:10:35.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.372+0000 7f56be7fc700 1 -- 172.21.15.52:0/1343770911 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56d0067550 con 0x7f56d0064ff0 2023-05-10T01:10:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 msgr2=0x7f56b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 0x7f56b0061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f56c0009340 tx=0x7f56c0008040).stop 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 msgr2=0x7f56d0146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f56c800c440 tx=0x7f56c8007b00).stop 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 shutdown_connections 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f56b005ed90 0x7f56b0061250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d0155c60 0x7f56d01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d0064ff0 0x7f56d0146780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 --2- 172.21.15.52:0/1343770911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56d0153ea0 0x7f56d0155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 >> 172.21.15.52:0/1343770911 conn(0x7f56d00c4420 msgr2=0x7f56d0066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:35.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 shutdown_connections 2023-05-10T01:10:35.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.374+0000 7f56d85a9700 1 -- 172.21.15.52:0/1343770911 wait complete. 2023-05-10T01:10:35.380 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:35.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-10T01:10:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.503+0000 7f7d10f47700 1 Processor -- start 2023-05-10T01:10:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.503+0000 7f7d10f47700 1 -- start start 2023-05-10T01:10:35.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d10f47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 0x7f7d0c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d10f47700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d0c069da0 0x7f7d0c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d10f47700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0c0650 con 0x7f7d0c154540 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d10f47700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c1af0 con 0x7f7d0c069da0 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d10f47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0bfd20 con 0x7f7d0c154160 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d09d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7d0c154540 0x7f7d0c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40548/0 (socket says 172.21.15.52:40548) 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d09d9b700 1 -- 172.21.15.52:0/434032584 learned_addr learned my addr 172.21.15.52:0/434032584 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:35.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d0ad9d700 1 --2- 172.21.15.52:0/434032584 >> v2:172.21.15.172:3300/0 conn(0x7f7d0c069da0 0x7f7d0c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 0x7f7d0c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d0959a700 1 -- 172.21.15.52:0/434032584 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291304789 0 0) 0x7f7d0c0c0650 con 0x7f7d0c154540 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.504+0000 7f7d0959a700 1 -- 172.21.15.52:0/434032584 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cec0033f0 con 0x7f7d0c154540 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0ad9d700 1 -- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 msgr2=0x7f7d0c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0ad9d700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 0x7f7d0c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0ad9d700 1 -- 172.21.15.52:0/434032584 >> v1:172.21.15.52:6789/0 conn(0x7f7d0c154540 legacy=0x7f7d0c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0ad9d700 1 -- 172.21.15.52:0/434032584 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0c0000 con 0x7f7d0c069da0 2023-05-10T01:10:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 0x7f7d0c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0ad9d700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0c6150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7cfc009e60 tx=0x7f7cfc009780).ready entity=mon.1 client_cookie=e6f149dfba907821 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0959a700 1 -- 172.21.15.52:0/434032584 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00e070 con 0x7f7d0c069da0 2023-05-10T01:10:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0959a700 1 -- 172.21.15.52:0/434032584 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bab0 con 0x7f7d0c069da0 2023-05-10T01:10:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d0959a700 1 -- 172.21.15.52:0/434032584 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00be30 con 0x7f7d0c069da0 2023-05-10T01:10:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d10f47700 1 -- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 msgr2=0x7f7d0c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.505+0000 7f7d10f47700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0c6150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7cfc009e60 tx=0x7f7cfc009780).stop 2023-05-10T01:10:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 -- 172.21.15.52:0/434032584 shutdown_connections 2023-05-10T01:10:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0c6150 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 --2- 172.21.15.52:0/434032584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154160 0x7f7d0c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 -- 172.21.15.52:0/434032584 >> 172.21.15.52:0/434032584 conn(0x7f7d0c0cb6f0 msgr2=0x7f7d0c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 -- 172.21.15.52:0/434032584 shutdown_connections 2023-05-10T01:10:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.506+0000 7f7d10f47700 1 -- 172.21.15.52:0/434032584 wait complete. 2023-05-10T01:10:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 Processor -- start 2023-05-10T01:10:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 -- start start 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 0x7f7d0c166660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c167510 con 0x7f7d0c154160 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c144ef0 con 0x7f7d0c069da0 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.507+0000 7f7d10f47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c149520 con 0x7f7d0c154540 2023-05-10T01:10:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59768/0 (socket says 172.21.15.52:59768) 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 -- 172.21.15.52:0/4220346929 learned_addr learned my addr 172.21.15.52:0/4220346929 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d0ad9d700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 0x7f7d0c166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 -- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 msgr2=0x7f7d0c166660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 0x7f7d0c166660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 -- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 msgr2=0x7f7d0c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 -- 172.21.15.52:0/4220346929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040092a0 con 0x7f7d0c154160 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d0ad9d700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 0x7f7d0c166660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d09d9b700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f7d0c06aaf0 tx=0x7f7cf4007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400ce10 con 0x7f7d0c154160 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf40072e0 con 0x7f7d0c154160 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc009a20 con 0x7f7d0c154160 2023-05-10T01:10:35.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40057a0 con 0x7f7d0c154160 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.508+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c149ae0 con 0x7f7d0c154160 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.509+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c158d30 con 0x7f7d0c154160 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.509+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7cf401a060 con 0x7f7d0c154160 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.510+0000 7f7d027fc700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 0x7f7cf0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.510+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7cf4078d10 con 0x7f7d0c154160 2023-05-10T01:10:35.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.510+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 0x7f7cf0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.510+0000 7f7d0a59c700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 0x7f7cf0061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7d04009270 tx=0x7f7d04008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.514+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cf404a600 con 0x7f7d0c154160 2023-05-10T01:10:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.754+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7d0c0c02e0 con 0x7f7d0c154160 2023-05-10T01:10:35.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.757+0000 7f7d027fc700 1 -- 172.21.15.52:0/4220346929 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7cf4018070 con 0x7f7d0c154160 2023-05-10T01:10:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 msgr2=0x7f7cf0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 0x7f7cf0061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7d04009270 tx=0x7f7d04008040).stop 2023-05-10T01:10:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 msgr2=0x7f7d0c144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f7d0c06aaf0 tx=0x7f7cf4007bf0).stop 2023-05-10T01:10:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 shutdown_connections 2023-05-10T01:10:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7cf005ed90 0x7f7cf0061250 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d0c154540 0x7f7d0c166660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d0c069da0 0x7f7d0c0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 --2- 172.21.15.52:0/4220346929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d0c154160 0x7f7d0c144a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 >> 172.21.15.52:0/4220346929 conn(0x7f7d0c0cb6f0 msgr2=0x7f7d0c0ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 shutdown_connections 2023-05-10T01:10:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.759+0000 7f7d10f47700 1 -- 172.21.15.52:0/4220346929 wait complete. 2023-05-10T01:10:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:35.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-10T01:10:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.889+0000 7f5efb61e700 1 Processor -- start 2023-05-10T01:10:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.889+0000 7f5efb61e700 1 -- start start 2023-05-10T01:10:35.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5efb61e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 0x7f5ef40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5efb61e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ef4154540 0x7f5ef40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5efb61e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40c0650 con 0x7f5ef4069690 2023-05-10T01:10:35.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5efb61e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40c1af0 con 0x7f5ef4154540 2023-05-10T01:10:35.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5efb61e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40bfd20 con 0x7f5ef4154160 2023-05-10T01:10:35.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5ef8bb9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ef4154540 0x7f5ef40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5ef8bb9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ef4154540 0x7f5ef40c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59776/0 (socket says 172.21.15.52:59776) 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.890+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1004702454 learned_addr learned my addr 172.21.15.52:0/1004702454 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef93ba700 1 --2- 172.21.15.52:0/1004702454 >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 0x7f5ef40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1004702454 >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 msgr2=0x7f5ef40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef8bb9700 1 --2- 172.21.15.52:0/1004702454 >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 0x7f5ef40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1004702454 >> v1:172.21.15.172:6789/0 conn(0x7f5ef4069690 legacy=0x7f5ef4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1004702454 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40c0000 con 0x7f5ef4154540 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef93ba700 1 --2- 172.21.15.52:0/1004702454 >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 0x7f5ef40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef8bb9700 1 --2- 172.21.15.52:0/1004702454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154540 0x7f5ef40c6150 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f5ef4083020 tx=0x7f5ee80090f0).ready entity=mon.0 client_cookie=65d5e888e5d4c1a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef3fff700 1 -- 172.21.15.52:0/1004702454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800b600 con 0x7f5ef4154540 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef3fff700 1 -- 172.21.15.52:0/1004702454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800b760 con 0x7f5ef4154540 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.891+0000 7f5ef3fff700 1 -- 172.21.15.52:0/1004702454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800bae0 con 0x7f5ef4154540 2023-05-10T01:10:35.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 -- 172.21.15.52:0/1004702454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154540 msgr2=0x7f5ef40c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1004702454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154540 0x7f5ef40c6150 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f5ef4083020 tx=0x7f5ee80090f0).stop 2023-05-10T01:10:35.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 -- 172.21.15.52:0/1004702454 shutdown_connections 2023-05-10T01:10:35.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1004702454 >> v2:172.21.15.172:3300/0 conn(0x7f5ef4154160 0x7f5ef40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1004702454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154540 0x7f5ef40c6150 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 -- 172.21.15.52:0/1004702454 >> 172.21.15.52:0/1004702454 conn(0x7f5ef40cb740 msgr2=0x7f5ef40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:35.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 -- 172.21.15.52:0/1004702454 shutdown_connections 2023-05-10T01:10:35.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.892+0000 7f5efb61e700 1 -- 172.21.15.52:0/1004702454 wait complete. 2023-05-10T01:10:35.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.893+0000 7f5efb61e700 1 Processor -- start 2023-05-10T01:10:35.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.893+0000 7f5efb61e700 1 -- start start 2023-05-10T01:10:35.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ef4069690 0x7f5ef414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ef4154540 0x7f5ef40aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c1de0 con 0x7f5ef4154160 2023-05-10T01:10:35.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40ca410 con 0x7f5ef4069690 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5efb61e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c20a0 con 0x7f5ef4154540 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59782/0 (socket says 172.21.15.52:59782) 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1951541511 learned_addr learned my addr 172.21.15.52:0/1951541511 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef93ba700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ef4069690 0x7f5ef414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef9bbb700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ef4154540 0x7f5ef40aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ef4154540 msgr2=0x7f5ef40aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ef4154540 0x7f5ef40aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ef4069690 msgr2=0x7f5ef414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ef4069690 0x7f5ef414dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 -- 172.21.15.52:0/1951541511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009370 con 0x7f5ef4154160 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef8bb9700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5ee8011000 tx=0x7f5ee8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.894+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800bea0 con 0x7f5ef4154160 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.895+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800b8d0 con 0x7f5ef4154160 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.895+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee801b660 con 0x7f5ef4154160 2023-05-10T01:10:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.895+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40aefd0 con 0x7f5ef4154160 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.895+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40c9e50 con 0x7f5ef4154160 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.895+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef40a9fe0 con 0x7f5ef4154160 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.896+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5ee800f070 con 0x7f5ef4154160 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.896+0000 7f5ef17fa700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 0x7f5ed4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.896+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5ee807aea0 con 0x7f5ef4154160 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.896+0000 7f5ef93ba700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 0x7f5ed4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.897+0000 7f5ef93ba700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 0x7f5ed4061280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5eec006d80 tx=0x7f5eec008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:35.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:35.900+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ee804c810 con 0x7f5ef4154160 2023-05-10T01:10:36.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.140+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5ef40666b0 con 0x7f5ef4154160 2023-05-10T01:10:36.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.144+0000 7f5ef17fa700 1 -- 172.21.15.52:0/1951541511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ee804fe30 con 0x7f5ef4154160 2023-05-10T01:10:36.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 msgr2=0x7f5ed4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 0x7f5ed4061280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5eec006d80 tx=0x7f5eec008040).stop 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 msgr2=0x7f5ef40ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5ee8011000 tx=0x7f5ee8017000).stop 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 shutdown_connections 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ed405edc0 0x7f5ed4061280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ef4154540 0x7f5ef40aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ef4069690 0x7f5ef414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 --2- 172.21.15.52:0/1951541511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ef4154160 0x7f5ef40ae5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 >> 172.21.15.52:0/1951541511 conn(0x7f5ef40cb740 msgr2=0x7f5ef40abc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 shutdown_connections 2023-05-10T01:10:36.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.146+0000 7f5efb61e700 1 -- 172.21.15.52:0/1951541511 wait complete. 2023-05-10T01:10:36.153 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:36.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-10T01:10:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.275+0000 7f5d7848c700 1 Processor -- start 2023-05-10T01:10:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.275+0000 7f5d7848c700 1 -- start start 2023-05-10T01:10:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d7848c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d70154160 0x7f5d700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d7848c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700c0650 con 0x7f5d70069da0 2023-05-10T01:10:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d7848c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700bfd20 con 0x7f5d70154540 2023-05-10T01:10:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d7848c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700c0000 con 0x7f5d70154160 2023-05-10T01:10:36.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d76228700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d70154160 0x7f5d700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d76228700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d70154160 0x7f5d700c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59788/0 (socket says 172.21.15.52:59788) 2023-05-10T01:10:36.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d76228700 1 -- 172.21.15.52:0/936568694 learned_addr learned my addr 172.21.15.52:0/936568694 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:36.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.276+0000 7f5d76a29700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d70069da0 0x7f5d700c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40574/0 (socket says 172.21.15.52:40574) 2023-05-10T01:10:36.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d76228700 1 -- 172.21.15.52:0/936568694 >> v1:172.21.15.172:6789/0 conn(0x7f5d70154540 legacy=0x7f5d70069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d76228700 1 -- 172.21.15.52:0/936568694 >> v1:172.21.15.52:6789/0 conn(0x7f5d70069da0 legacy=0x7f5d700c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d75226700 1 -- 172.21.15.52:0/936568694 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299574496 0 0) 0x7f5d700c0650 con 0x7f5d70069da0 2023-05-10T01:10:36.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d76228700 1 -- 172.21.15.52:0/936568694 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700c02e0 con 0x7f5d70154160 2023-05-10T01:10:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d76228700 1 --2- 172.21.15.52:0/936568694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70154160 0x7f5d700c5c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f5d68006fd0 tx=0x7f5d680090f0).ready entity=mon.0 client_cookie=767782ebe68c5dfb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d75226700 1 -- 172.21.15.52:0/936568694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800b600 con 0x7f5d70154160 2023-05-10T01:10:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d75226700 1 -- 172.21.15.52:0/936568694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800b760 con 0x7f5d70154160 2023-05-10T01:10:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d75226700 1 -- 172.21.15.52:0/936568694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800bb00 con 0x7f5d70154160 2023-05-10T01:10:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d7848c700 1 -- 172.21.15.52:0/936568694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70154160 msgr2=0x7f5d700c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.277+0000 7f5d7848c700 1 --2- 172.21.15.52:0/936568694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70154160 0x7f5d700c5c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f5d68006fd0 tx=0x7f5d680090f0).stop 2023-05-10T01:10:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.278+0000 7f5d7848c700 1 -- 172.21.15.52:0/936568694 shutdown_connections 2023-05-10T01:10:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.278+0000 7f5d7848c700 1 --2- 172.21.15.52:0/936568694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70154160 0x7f5d700c5c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.278+0000 7f5d7848c700 1 -- 172.21.15.52:0/936568694 >> 172.21.15.52:0/936568694 conn(0x7f5d700cb6f0 msgr2=0x7f5d700c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.278+0000 7f5d7848c700 1 -- 172.21.15.52:0/936568694 shutdown_connections 2023-05-10T01:10:36.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.278+0000 7f5d7848c700 1 -- 172.21.15.52:0/936568694 wait complete. 2023-05-10T01:10:36.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 Processor -- start 2023-05-10T01:10:36.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 -- start start 2023-05-10T01:10:36.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 0x7f5d70142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 0x7f5d70152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70165680 con 0x7f5d70069da0 2023-05-10T01:10:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70164a70 con 0x7f5d70154540 2023-05-10T01:10:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d7848c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70164d50 con 0x7f5d70154160 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.279+0000 7f5d76228700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59794/0 (socket says 172.21.15.52:59794) 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 -- 172.21.15.52:0/1070336405 learned_addr learned my addr 172.21.15.52:0/1070336405 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76a29700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 0x7f5d70152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d75a27700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 0x7f5d70142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 -- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 msgr2=0x7f5d70142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 0x7f5d70142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 -- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 msgr2=0x7f5d70152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 0x7f5d70152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 -- 172.21.15.52:0/1070336405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009370 con 0x7f5d70069da0 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76a29700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 0x7f5d70152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d75a27700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 0x7f5d70142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:36.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d76228700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f5d68009f50 tx=0x7f5d68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680069b0 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800b8d0 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70165030 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68024470 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.280+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d70164660 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.281+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d700c1e60 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.281+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5d6800f070 con 0x7f5d70069da0 2023-05-10T01:10:36.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.282+0000 7f5d6e7fc700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 0x7f5d50061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.282+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5d6807b510 con 0x7f5d70069da0 2023-05-10T01:10:36.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.282+0000 7f5d75a27700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 0x7f5d50061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.282+0000 7f5d75a27700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 0x7f5d50061220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f5d700b0ea0 tx=0x7f5d64008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.286+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d6804ce00 con 0x7f5d70069da0 2023-05-10T01:10:36.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.527+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5d700666b0 con 0x7f5d70069da0 2023-05-10T01:10:36.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.531+0000 7f5d6e7fc700 1 -- 172.21.15.52:0/1070336405 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5d68050420 con 0x7f5d70069da0 2023-05-10T01:10:36.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 msgr2=0x7f5d50061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 0x7f5d50061220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f5d700b0ea0 tx=0x7f5d64008040).stop 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 msgr2=0x7f5d700c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f5d68009f50 tx=0x7f5d68017000).stop 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 shutdown_connections 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d5005ed60 0x7f5d50061220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d70154540 0x7f5d70152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d70069da0 0x7f5d700c3430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 --2- 172.21.15.52:0/1070336405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d70154160 0x7f5d70142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 >> 172.21.15.52:0/1070336405 conn(0x7f5d700cb6f0 msgr2=0x7f5d701534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 shutdown_connections 2023-05-10T01:10:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.533+0000 7f5d7848c700 1 -- 172.21.15.52:0/1070336405 wait complete. 2023-05-10T01:10:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:updated 2023-05-10T01:10:36.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 Processor -- start 2023-05-10T01:10:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 -- start start 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59c4154160 0x7f59c40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4154540 0x7f59c40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59c4069690 0x7f59c4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40c0650 con 0x7f59c4069690 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c406a010 con 0x7f59c4154160 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.662+0000 7f59c9c84700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40bfd20 con 0x7f59c4154540 2023-05-10T01:10:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59c4069690 0x7f59c4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59c4069690 0x7f59c4069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59806/0 (socket says 172.21.15.52:59806) 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 -- 172.21.15.52:0/2678388682 learned_addr learned my addr 172.21.15.52:0/2678388682 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c2ffd700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4154540 0x7f59c40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c37fe700 1 --2- 172.21.15.52:0/2678388682 >> v2:172.21.15.172:3300/0 conn(0x7f59c4154160 0x7f59c40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 -- 172.21.15.52:0/2678388682 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4154540 msgr2=0x7f59c40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4154540 0x7f59c40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 -- 172.21.15.52:0/2678388682 >> v2:172.21.15.172:3300/0 conn(0x7f59c4154160 msgr2=0x7f59c40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 --2- 172.21.15.52:0/2678388682 >> v2:172.21.15.172:3300/0 conn(0x7f59c4154160 0x7f59c40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 -- 172.21.15.52:0/2678388682 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40c0000 con 0x7f59c4069690 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c3fff700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4069690 0x7f59c4069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f59c4083020 tx=0x7f59bc009840).ready entity=mon.0 client_cookie=4bfbf917674e5bd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c27fc700 1 -- 172.21.15.52:0/2678388682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00e070 con 0x7f59c4069690 2023-05-10T01:10:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c27fc700 1 -- 172.21.15.52:0/2678388682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00ba50 con 0x7f59c4069690 2023-05-10T01:10:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.663+0000 7f59c27fc700 1 -- 172.21.15.52:0/2678388682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00bdd0 con 0x7f59c4069690 2023-05-10T01:10:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 -- 172.21.15.52:0/2678388682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4069690 msgr2=0x7f59c4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4069690 0x7f59c4069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f59c4083020 tx=0x7f59bc009840).stop 2023-05-10T01:10:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 -- 172.21.15.52:0/2678388682 shutdown_connections 2023-05-10T01:10:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4069690 0x7f59c4069b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 --2- 172.21.15.52:0/2678388682 >> v2:172.21.15.172:3300/0 conn(0x7f59c4154160 0x7f59c40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 --2- 172.21.15.52:0/2678388682 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4154540 0x7f59c40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 -- 172.21.15.52:0/2678388682 >> 172.21.15.52:0/2678388682 conn(0x7f59c40cb740 msgr2=0x7f59c40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 -- 172.21.15.52:0/2678388682 shutdown_connections 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.664+0000 7f59c9c84700 1 -- 172.21.15.52:0/2678388682 wait complete. 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.665+0000 7f59c9c84700 1 Processor -- start 2023-05-10T01:10:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.665+0000 7f59c9c84700 1 -- start start 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4069690 0x7f59c4159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59c4154160 0x7f59c4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4151cd0 con 0x7f59c4154540 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4164330 con 0x7f59c4154160 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c9c84700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4164610 con 0x7f59c4069690 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59810/0 (socket says 172.21.15.52:59810) 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 -- 172.21.15.52:0/4254804665 learned_addr learned my addr 172.21.15.52:0/4254804665 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c37fe700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4069690 0x7f59c4159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c2ffd700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59c4154160 0x7f59c4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 -- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4069690 msgr2=0x7f59c4159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4069690 0x7f59c4159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 -- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59c4154160 msgr2=0x7f59c4154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59c4154160 0x7f59c4154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 -- 172.21.15.52:0/4254804665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc009ae0 con 0x7f59c4154540 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59c3fff700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f59bc009fd0 tx=0x7f59bc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.666+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00bdd0 con 0x7f59c4154540 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.667+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc009500 con 0x7f59c4154540 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.667+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c41648f0 con 0x7f59c4154540 2023-05-10T01:10:36.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.667+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc01d6b0 con 0x7f59c4154540 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.667+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4163e90 con 0x7f59c4154540 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.668+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c41506c0 con 0x7f59c4154540 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.668+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f59bc024030 con 0x7f59c4154540 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.668+0000 7f59bb7fe700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 0x7f59a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.668+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f59bc07ac00 con 0x7f59c4154540 2023-05-10T01:10:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.668+0000 7f59c37fe700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 0x7f59a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.669+0000 7f59c37fe700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 0x7f59a8061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f59ac00bb10 tx=0x7f59ac008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.672+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59c41506c0 con 0x7f59c4154540 2023-05-10T01:10:36.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.848+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c41506c0 con 0x7f59c4154540 2023-05-10T01:10:36.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.849+0000 7f59bb7fe700 1 -- 172.21.15.52:0/4254804665 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13808 (secure 0 0 0) 0x7f59c41506c0 con 0x7f59c4154540 2023-05-10T01:10:36.853 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:36.853 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:10:33.777821+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:36.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 msgr2=0x7f59a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 0x7f59a8061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f59ac00bb10 tx=0x7f59ac008040).stop 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 msgr2=0x7f59c4157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f59bc009fd0 tx=0x7f59bc009840).stop 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 shutdown_connections 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f59a805ed90 0x7f59a8061250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4154540 0x7f59c4157140 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59c4069690 0x7f59c4159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 --2- 172.21.15.52:0/4254804665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59c4154160 0x7f59c4154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 >> 172.21.15.52:0/4254804665 conn(0x7f59c40cb740 msgr2=0x7f59c4156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 shutdown_connections 2023-05-10T01:10:36.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.851+0000 7f59c9c84700 1 -- 172.21.15.52:0/4254804665 wait complete. 2023-05-10T01:10:36.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:10:36.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:10:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.983+0000 7f01ad44f700 1 Processor -- start 2023-05-10T01:10:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.983+0000 7f01ad44f700 1 -- start start 2023-05-10T01:10:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01ad44f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01a80c6100 0x7f01a81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01ad44f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80ca5f0 con 0x7f01a80c5d20 2023-05-10T01:10:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01ad44f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80c8820 con 0x7f01a80aa200 2023-05-10T01:10:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01ad44f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80c6550 con 0x7f01a80c6100 2023-05-10T01:10:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01a6ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f01a80c5d20 0x7f01a8069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40600/0 (socket says 172.21.15.52:40600) 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01a6ffd700 1 -- 172.21.15.52:0/3589865503 learned_addr learned my addr 172.21.15.52:0/3589865503 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.984+0000 7f01a77fe700 1 --2- 172.21.15.52:0/3589865503 >> v2:172.21.15.172:3300/0 conn(0x7f01a80c6100 0x7f01a81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299391559 0 0) 0x7f01a80ca5f0 con 0x7f01a80c5d20 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01880033f0 con 0x7f01a80c5d20 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091958992 0 0) 0x7f01880033f0 con 0x7f01a80c5d20 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 >> v2:172.21.15.172:3300/0 conn(0x7f01a80c6100 msgr2=0x7f01a81541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 --2- 172.21.15.52:0/3589865503 >> v2:172.21.15.172:3300/0 conn(0x7f01a80c6100 0x7f01a81541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 >> v1:172.21.15.172:6789/0 conn(0x7f01a80aa200 legacy=0x7f01a8153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80c8b00 con 0x7f01a80c5d20 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f01a00017f0 con 0x7f01a80c5d20 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 >> v1:172.21.15.52:6789/0 conn(0x7f01a80c5d20 legacy=0x7f01a8069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01880038e0 0x7f0188003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 0x7f0188004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188005000 0x7f018800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018800bdd0 con 0x7f0188004690 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018800bf40 con 0x7f0188005000 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018800c100 con 0x7f01880038e0 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 0x7f0188004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a6ffd700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01880038e0 0x7f0188003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a77fe700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188005000 0x7f018800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 -- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01880038e0 msgr2=0x7f0188003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01880038e0 0x7f0188003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 -- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188005000 msgr2=0x7f018800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188005000 0x7f018800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 -- 172.21.15.52:0/3589865503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880033f0 con 0x7f0188004690 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a77fe700 1 -- 172.21.15.52:0/3589865503 reap_dead start 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.985+0000 7f01a67fc700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 0x7f0188004b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f0190001820 tx=0x7f0190007b90).ready entity=mon.0 client_cookie=a51c1c679cabe2f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190007ea0 con 0x7f0188004690 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190012400 con 0x7f0188004690 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01a5ffb700 1 -- 172.21.15.52:0/3589865503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900127c0 con 0x7f0188004690 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 -- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 msgr2=0x7f0188004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 0x7f0188004b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f0190001820 tx=0x7f0190007b90).stop 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 -- 172.21.15.52:0/3589865503 shutdown_connections 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 --2- 172.21.15.52:0/3589865503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004690 0x7f0188004b10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:36.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 -- 172.21.15.52:0/3589865503 >> 172.21.15.52:0/3589865503 conn(0x7f01a80cb6f0 msgr2=0x7f01a80c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:36.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 -- 172.21.15.52:0/3589865503 shutdown_connections 2023-05-10T01:10:36.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.986+0000 7f01ad44f700 1 -- 172.21.15.52:0/3589865503 wait complete. 2023-05-10T01:10:36.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.987+0000 7f01ad44f700 1 Processor -- start 2023-05-10T01:10:36.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.987+0000 7f01ad44f700 1 -- start start 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 0x7f01a80c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 0x7f01a80acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8152e80 con 0x7f01a80c2690 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8153140 con 0x7f01a80acb10 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01ad44f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80ad480 con 0x7f0188004690 2023-05-10T01:10:36.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01a67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01a67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59830/0 (socket says 172.21.15.52:59830) 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.988+0000 7f01a67fc700 1 -- 172.21.15.52:0/1020262615 learned_addr learned my addr 172.21.15.52:0/1020262615 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a6ffd700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 0x7f01a80c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a77fe700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 0x7f01a80acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 -- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 msgr2=0x7f01a80c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 0x7f01a80c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 -- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 msgr2=0x7f01a80acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 0x7f01a80acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 -- 172.21.15.52:0/1020262615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80c4cf0 con 0x7f01a80c2690 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a77fe700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 0x7f01a80acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a6ffd700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 0x7f01a80c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01a67fc700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0190001e10 tx=0x7f0190016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190007ea0 con 0x7f01a80c2690 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900116f0 con 0x7f01a80c2690 2023-05-10T01:10:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a8150000 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190011ab0 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.989+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80c4730 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.990+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8066720 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.990+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0190024020 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.990+0000 7f019effd700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 0x7f018c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.991+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f019007a500 con 0x7f01a80c2690 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.991+0000 7f01a6ffd700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 0x7f018c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.991+0000 7f01a6ffd700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 0x7f018c061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f01a0001460 tx=0x7f01a0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:36.995+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f019004bdf0 con 0x7f01a80c2690 2023-05-10T01:10:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.169+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f01a8153280 con 0x7f01a80c2690 2023-05-10T01:10:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.169+0000 7f019effd700 1 -- 172.21.15.52:0/1020262615 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f019004f410 con 0x7f01a80c2690 2023-05-10T01:10:37.174 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:10:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 msgr2=0x7f018c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 0x7f018c061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f01a0001460 tx=0x7f01a0009040).stop 2023-05-10T01:10:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 msgr2=0x7f01a814fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0190001e10 tx=0x7f0190016000).stop 2023-05-10T01:10:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 shutdown_connections 2023-05-10T01:10:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f018c05ed90 0x7f018c061250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01a80acb10 0x7f01a80acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0188004690 0x7f01a80c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 --2- 172.21.15.52:0/1020262615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a80c2690 0x7f01a814fb10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 >> 172.21.15.52:0/1020262615 conn(0x7f01a80cb6f0 msgr2=0x7f01a8150340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 shutdown_connections 2023-05-10T01:10:37.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.171+0000 7f01ad44f700 1 -- 172.21.15.52:0/1020262615 wait complete. 2023-05-10T01:10:37.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:10:37.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.302+0000 7f3678188700 1 Processor -- start 2023-05-10T01:10:37.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.303+0000 7f3678188700 1 -- start start 2023-05-10T01:10:37.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.303+0000 7f3678188700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36700629b0 0x7f36700635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.303+0000 7f3678188700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367014eac0 con 0x7f367014e6e0 2023-05-10T01:10:37.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.303+0000 7f3678188700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3670154ca0 con 0x7f3670155130 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.303+0000 7f3678188700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700c6010 con 0x7f36700629b0 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3675f24700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f367014e6e0 0x7f36700c4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40620/0 (socket says 172.21.15.52:40620) 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3675f24700 1 -- 172.21.15.52:0/921546632 learned_addr learned my addr 172.21.15.52:0/921546632 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3676725700 1 --2- 172.21.15.52:0/921546632 >> v2:172.21.15.52:3300/0 conn(0x7f36700629b0 0x7f36700635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3674f22700 1 -- 172.21.15.52:0/921546632 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197871685 0 0) 0x7f367014eac0 con 0x7f367014e6e0 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3674f22700 1 -- 172.21.15.52:0/921546632 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f365c0033f0 con 0x7f367014e6e0 2023-05-10T01:10:37.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3676725700 1 -- 172.21.15.52:0/921546632 >> v1:172.21.15.172:6789/0 conn(0x7f3670155130 legacy=0x7f36700622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3676725700 1 -- 172.21.15.52:0/921546632 >> v1:172.21.15.52:6789/0 conn(0x7f367014e6e0 legacy=0x7f36700c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3676725700 1 -- 172.21.15.52:0/921546632 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670154650 con 0x7f36700629b0 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3676725700 1 --2- 172.21.15.52:0/921546632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36700629b0 0x7f36700635f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f3660009760 tx=0x7f3660009060).ready entity=mon.0 client_cookie=44cc330661241ee6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3674f22700 1 -- 172.21.15.52:0/921546632 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600090d0 con 0x7f36700629b0 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3674f22700 1 -- 172.21.15.52:0/921546632 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366000f510 con 0x7f36700629b0 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.304+0000 7f3674f22700 1 -- 172.21.15.52:0/921546632 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000f890 con 0x7f36700629b0 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 -- 172.21.15.52:0/921546632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36700629b0 msgr2=0x7f36700635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 --2- 172.21.15.52:0/921546632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36700629b0 0x7f36700635f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f3660009760 tx=0x7f3660009060).stop 2023-05-10T01:10:37.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 -- 172.21.15.52:0/921546632 shutdown_connections 2023-05-10T01:10:37.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 --2- 172.21.15.52:0/921546632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36700629b0 0x7f36700635f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 -- 172.21.15.52:0/921546632 >> 172.21.15.52:0/921546632 conn(0x7f367005e810 msgr2=0x7f36700c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 -- 172.21.15.52:0/921546632 shutdown_connections 2023-05-10T01:10:37.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.305+0000 7f3678188700 1 -- 172.21.15.52:0/921546632 wait complete. 2023-05-10T01:10:37.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.306+0000 7f3678188700 1 Processor -- start 2023-05-10T01:10:37.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.306+0000 7f3678188700 1 -- start start 2023-05-10T01:10:37.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.306+0000 7f3678188700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 0x7f367014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.306+0000 7f3678188700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 0x7f3670152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670152b50 con 0x7f3670155130 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700a8770 con 0x7f36700629b0 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700c2190 con 0x7f367014e6e0 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59846/0 (socket says 172.21.15.52:59846) 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 -- 172.21.15.52:0/2320410887 learned_addr learned my addr 172.21.15.52:0/2320410887 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3675f24700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 0x7f367014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3675723700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 0x7f3670152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 -- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 msgr2=0x7f3670152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 0x7f3670152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 -- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 msgr2=0x7f367014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 0x7f367014d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 -- 172.21.15.52:0/2320410887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600092a0 con 0x7f3670155130 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3675723700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 0x7f3670152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3675f24700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 0x7f367014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3676725700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f3660009e00 tx=0x7f3660017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000f890 con 0x7f3670155130 2023-05-10T01:10:37.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366001b440 con 0x7f3670155130 2023-05-10T01:10:37.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700c2470 con 0x7f3670155130 2023-05-10T01:10:37.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366001b800 con 0x7f3670155130 2023-05-10T01:10:37.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.307+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367014ddb0 con 0x7f3670155130 2023-05-10T01:10:37.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.308+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36700a8900 con 0x7f3670155130 2023-05-10T01:10:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.309+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f366000f070 con 0x7f3670155130 2023-05-10T01:10:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.309+0000 7f366dffb700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 0x7f3650061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.309+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f366007b010 con 0x7f3670155130 2023-05-10T01:10:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.309+0000 7f3675f24700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 0x7f3650061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.310+0000 7f3675f24700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 0x7f3650061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3668005ad0 tx=0x7f3668009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.313+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f366004c900 con 0x7f3670155130 2023-05-10T01:10:37.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.484+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36700a8540 con 0x7f3670155130 2023-05-10T01:10:37.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.484+0000 7f366dffb700 1 -- 172.21.15.52:0/2320410887 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36700a8540 con 0x7f3670155130 2023-05-10T01:10:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:10:37.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 msgr2=0x7f3650061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 0x7f3650061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3668005ad0 tx=0x7f3668009040).stop 2023-05-10T01:10:37.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 msgr2=0x7f3670152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f3660009e00 tx=0x7f3660017000).stop 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 shutdown_connections 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f365005ed90 0x7f3650061250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3670155130 0x7f3670152660 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36700629b0 0x7f367014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 --2- 172.21.15.52:0/2320410887 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f367014e6e0 0x7f3670152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 >> 172.21.15.52:0/2320410887 conn(0x7f367005e810 msgr2=0x7f3670067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 shutdown_connections 2023-05-10T01:10:37.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.486+0000 7f3678188700 1 -- 172.21.15.52:0/2320410887 wait complete. 2023-05-10T01:10:37.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:10:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 Processor -- start 2023-05-10T01:10:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 -- start start 2023-05-10T01:10:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 0x7ff36c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 0x7ff36c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff36c0672a0 0x7ff36c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c137460 con 0x7ff36c0672a0 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c0c3510 con 0x7ff36c066e40 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.616+0000 7ff371ea1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c158420 con 0x7ff36c14e1f0 2023-05-10T01:10:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff36c0672a0 0x7ff36c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff36c0672a0 0x7ff36c157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59854/0 (socket says 172.21.15.52:59854) 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 -- 172.21.15.52:0/3167240342 learned_addr learned my addr 172.21.15.52:0/3167240342 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36b7fe700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 0x7ff36c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 -- 172.21.15.52:0/3167240342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 msgr2=0x7ff36c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36affd700 1 --2- 172.21.15.52:0/3167240342 >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 0x7ff36c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 0x7ff36c14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 -- 172.21.15.52:0/3167240342 >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 msgr2=0x7ff36c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3167240342 >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 0x7ff36c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 -- 172.21.15.52:0/3167240342 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0683c0 con 0x7ff36c0672a0 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36b7fe700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 0x7ff36c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36affd700 1 --2- 172.21.15.52:0/3167240342 >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 0x7ff36c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c0672a0 0x7ff36c157f30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ff36c069fa0 tx=0x7ff3640090f0).ready entity=mon.0 client_cookie=d7d22d1defdad28a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36a7fc700 1 -- 172.21.15.52:0/3167240342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400b600 con 0x7ff36c0672a0 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36a7fc700 1 -- 172.21.15.52:0/3167240342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400b760 con 0x7ff36c0672a0 2023-05-10T01:10:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.617+0000 7ff36a7fc700 1 -- 172.21.15.52:0/3167240342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400bae0 con 0x7ff36c0672a0 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 -- 172.21.15.52:0/3167240342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c0672a0 msgr2=0x7ff36c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c0672a0 0x7ff36c157f30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ff36c069fa0 tx=0x7ff3640090f0).stop 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 -- 172.21.15.52:0/3167240342 shutdown_connections 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c0672a0 0x7ff36c157f30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3167240342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c14e1f0 0x7ff36c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3167240342 >> v2:172.21.15.172:3300/0 conn(0x7ff36c066e40 0x7ff36c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 -- 172.21.15.52:0/3167240342 >> 172.21.15.52:0/3167240342 conn(0x7ff36c0c7bb0 msgr2=0x7ff36c0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 -- 172.21.15.52:0/3167240342 shutdown_connections 2023-05-10T01:10:37.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.618+0000 7ff371ea1700 1 -- 172.21.15.52:0/3167240342 wait complete. 2023-05-10T01:10:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.619+0000 7ff371ea1700 1 Processor -- start 2023-05-10T01:10:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.619+0000 7ff371ea1700 1 -- start start 2023-05-10T01:10:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff36c066e40 0x7ff36c13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c0672a0 0x7ff36c1348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c134de0 con 0x7ff36c14e1f0 2023-05-10T01:10:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0abb00 con 0x7ff36c066e40 2023-05-10T01:10:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff371ea1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0ab820 con 0x7ff36c0672a0 2023-05-10T01:10:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59860/0 (socket says 172.21.15.52:59860) 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 -- 172.21.15.52:0/3333722045 learned_addr learned my addr 172.21.15.52:0/3333722045 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36b7fe700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff36c066e40 0x7ff36c13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36affd700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c0672a0 0x7ff36c1348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 -- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c0672a0 msgr2=0x7ff36c1348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c0672a0 0x7ff36c1348f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 -- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff36c066e40 msgr2=0x7ff36c13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff36c066e40 0x7ff36c13aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 -- 172.21.15.52:0/3333722045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364009370 con 0x7ff36c14e1f0 2023-05-10T01:10:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.620+0000 7ff36bfff700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff36c064480 tx=0x7ff364017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.621+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400bae0 con 0x7ff36c14e1f0 2023-05-10T01:10:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.621+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36401c420 con 0x7ff36c14e1f0 2023-05-10T01:10:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.621+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c0bf8a0 con 0x7ff36c14e1f0 2023-05-10T01:10:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.621+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36401c7e0 con 0x7ff36c14e1f0 2023-05-10T01:10:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.621+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c0bfe60 con 0x7ff36c14e1f0 2023-05-10T01:10:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.622+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c06c340 con 0x7ff36c14e1f0 2023-05-10T01:10:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.622+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff36402c070 con 0x7ff36c14e1f0 2023-05-10T01:10:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.622+0000 7ff3537fe700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 0x7ff34c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.622+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff36407b570 con 0x7ff36c14e1f0 2023-05-10T01:10:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.623+0000 7ff36b7fe700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 0x7ff34c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.623+0000 7ff36b7fe700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 0x7ff34c061280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff36c0c1db0 tx=0x7ff35c0077b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.626+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff36404ce60 con 0x7ff36c14e1f0 2023-05-10T01:10:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.803+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff36c0c6d80 con 0x7ff36c14e1f0 2023-05-10T01:10:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.804+0000 7ff3537fe700 1 -- 172.21.15.52:0/3333722045 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff36402a020 con 0x7ff36c14e1f0 2023-05-10T01:10:37.808 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:37.808 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:10:37.808 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:37.808 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:10:37.809 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:37.810 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:10:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 msgr2=0x7ff34c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 0x7ff34c061280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff36c0c1db0 tx=0x7ff35c0077b0).stop 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 msgr2=0x7ff36c0aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff36c064480 tx=0x7ff364017000).stop 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 shutdown_connections 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff34c05edc0 0x7ff34c061280 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff36c14e1f0 0x7ff36c0aad60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff36c066e40 0x7ff36c13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 --2- 172.21.15.52:0/3333722045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff36c0672a0 0x7ff36c1348f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 >> 172.21.15.52:0/3333722045 conn(0x7ff36c0c7bb0 msgr2=0x7ff36c136c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.805+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 shutdown_connections 2023-05-10T01:10:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.806+0000 7ff371ea1700 1 -- 172.21.15.52:0/3333722045 wait complete. 2023-05-10T01:10:37.821 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:10:37.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:10:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.939+0000 7fae7e2e7700 1 Processor -- start 2023-05-10T01:10:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.939+0000 7fae7e2e7700 1 -- start start 2023-05-10T01:10:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7e2e7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae78153ff0 0x7fae78068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7e2e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 0x7fae780c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7e2e7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae780c9110 con 0x7fae780c60c0 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7e2e7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780c8820 con 0x7fae78153ff0 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7e2e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c6500 con 0x7fae78068640 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae78153ff0 0x7fae78068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae777fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 0x7fae780c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae78153ff0 0x7fae78068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:58188/0 (socket says 172.21.15.52:58188) 2023-05-10T01:10:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae7c884700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fae780c60c0 0x7fae780c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:43188/0 (socket says 172.21.15.52:43188) 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 -- 172.21.15.52:0/2152327733 learned_addr learned my addr 172.21.15.52:0/2152327733 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 -- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 msgr2=0x7fae780c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 0x7fae780c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 -- 172.21.15.52:0/2152327733 >> v1:172.21.15.172:6789/0 conn(0x7fae780c60c0 legacy=0x7fae780c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae77fff700 1 -- 172.21.15.52:0/2152327733 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780c8ac0 con 0x7fae78153ff0 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.940+0000 7fae777fe700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 0x7fae780c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae77fff700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78153ff0 0x7fae78068150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fae68009810 tx=0x7fae68009060).ready entity=mon.1 client_cookie=631cf09c757fd40 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae76ffd700 1 -- 172.21.15.52:0/2152327733 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68005880 con 0x7fae78153ff0 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae76ffd700 1 -- 172.21.15.52:0/2152327733 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680059e0 con 0x7fae78153ff0 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae76ffd700 1 -- 172.21.15.52:0/2152327733 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68005d60 con 0x7fae78153ff0 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 -- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78153ff0 msgr2=0x7fae78068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78153ff0 0x7fae78068150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fae68009810 tx=0x7fae68009060).stop 2023-05-10T01:10:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 -- 172.21.15.52:0/2152327733 shutdown_connections 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78153ff0 0x7fae78068150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/2152327733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78068640 0x7fae780c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 -- 172.21.15.52:0/2152327733 >> 172.21.15.52:0/2152327733 conn(0x7fae780678d0 msgr2=0x7fae780cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 -- 172.21.15.52:0/2152327733 shutdown_connections 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.941+0000 7fae7e2e7700 1 -- 172.21.15.52:0/2152327733 wait complete. 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.942+0000 7fae7e2e7700 1 Processor -- start 2023-05-10T01:10:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 -- start start 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78068640 0x7fae7814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78153ff0 0x7fae780afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780b00f0 con 0x7fae780c60c0 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c30a0 con 0x7fae78068640 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae7e2e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c3380 con 0x7fae78153ff0 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.943+0000 7fae777fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59872/0 (socket says 172.21.15.52:59872) 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 -- 172.21.15.52:0/4269916027 learned_addr learned my addr 172.21.15.52:0/4269916027 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae77fff700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78068640 0x7fae7814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae7c884700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78153ff0 0x7fae780afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 -- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78153ff0 msgr2=0x7fae780afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78153ff0 0x7fae780afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 -- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78068640 msgr2=0x7fae7814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78068640 0x7fae7814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 -- 172.21.15.52:0/4269916027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0092a0 con 0x7fae780c60c0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae777fe700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fae6c00ea20 tx=0x7fae6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00c850 con 0x7fae780c60c0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00c9b0 con 0x7fae780c60c0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00cd30 con 0x7fae780c60c0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68009300 con 0x7fae780c60c0 2023-05-10T01:10:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.944+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae78169050 con 0x7fae780c60c0 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.945+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae78066720 con 0x7fae780c60c0 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.945+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae6c022070 con 0x7fae780c60c0 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.946+0000 7fae5ffff700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 0x7fae58061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.946+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fae6c079cc0 con 0x7fae780c60c0 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.946+0000 7fae77fff700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 0x7fae58061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.946+0000 7fae77fff700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 0x7fae58061220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fae6800b340 tx=0x7fae68016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:37.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:37.950+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae6c04b5b0 con 0x7fae780c60c0 2023-05-10T01:10:38.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.123+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fae7806c340 con 0x7fae780c60c0 2023-05-10T01:10:38.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.581+0000 7fae5ffff700 1 -- 172.21.15.52:0/4269916027 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7fae6c04ebd0 con 0x7fae780c60c0 2023-05-10T01:10:38.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 msgr2=0x7fae58061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 0x7fae58061220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fae6800b340 tx=0x7fae68016000).stop 2023-05-10T01:10:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 msgr2=0x7fae780af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fae6c00ea20 tx=0x7fae6c009060).stop 2023-05-10T01:10:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 shutdown_connections 2023-05-10T01:10:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae5805ed60 0x7fae58061220 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0x7fae6800b340 tx=0x7fae68016000).stop 2023-05-10T01:10:38.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae78153ff0 0x7fae780afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:38.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae78068640 0x7fae7814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:38.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 --2- 172.21.15.52:0/4269916027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae780c60c0 0x7fae780af710 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0x7fae6c00ea20 tx=0x7fae6c009060).stop 2023-05-10T01:10:38.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.585+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 >> 172.21.15.52:0/4269916027 conn(0x7fae780678d0 msgr2=0x7fae780bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:38.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.586+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 shutdown_connections 2023-05-10T01:10:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.586+0000 7fae7e2e7700 1 -- 172.21.15.52:0/4269916027 wait complete. 2023-05-10T01:10:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:10:38.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:10:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.728+0000 7ff2a8f97700 1 Processor -- start 2023-05-10T01:10:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.728+0000 7ff2a8f97700 1 -- start start 2023-05-10T01:10:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a8f97700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 0x7ff2a4155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a8f97700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a40629b0 0x7ff2a40635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a8f97700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a414eac0 con 0x7ff2a40c4d30 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a8f97700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a4154ca0 con 0x7ff2a40629b0 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a8f97700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40c6010 con 0x7ff2a414e6e0 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a40629b0 0x7ff2a40635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a1d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff2a40c4d30 0x7ff2a40622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40664/0 (socket says 172.21.15.52:40664) 2023-05-10T01:10:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a40629b0 0x7ff2a40635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59882/0 (socket says 172.21.15.52:59882) 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.729+0000 7ff2a1d9b700 1 -- 172.21.15.52:0/2066430349 learned_addr learned my addr 172.21.15.52:0/2066430349 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a259c700 1 --2- 172.21.15.52:0/2066430349 >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 0x7ff2a4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a2d9d700 1 -- 172.21.15.52:0/2066430349 >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 msgr2=0x7ff2a4155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a2d9d700 1 --2- 172.21.15.52:0/2066430349 >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 0x7ff2a4155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a2d9d700 1 -- 172.21.15.52:0/2066430349 >> v1:172.21.15.52:6789/0 conn(0x7ff2a40c4d30 legacy=0x7ff2a40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a2d9d700 1 -- 172.21.15.52:0/2066430349 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4154650 con 0x7ff2a40629b0 2023-05-10T01:10:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a159a700 1 -- 172.21.15.52:0/2066430349 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562979007 0 0) 0x7ff2a414eac0 con 0x7ff2a40c4d30 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a259c700 1 --2- 172.21.15.52:0/2066430349 >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 0x7ff2a4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a2d9d700 1 --2- 172.21.15.52:0/2066430349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40635f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7ff2a40c9af0 tx=0x7ff294009780).ready entity=mon.0 client_cookie=89f76a02fcc686ee server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a159a700 1 -- 172.21.15.52:0/2066430349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400e070 con 0x7ff2a40629b0 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a159a700 1 -- 172.21.15.52:0/2066430349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400bc30 con 0x7ff2a40629b0 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a159a700 1 -- 172.21.15.52:0/2066430349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294012410 con 0x7ff2a40629b0 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2066430349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 msgr2=0x7ff2a40635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.730+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2066430349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40635f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7ff2a40c9af0 tx=0x7ff294009780).stop 2023-05-10T01:10:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2066430349 shutdown_connections 2023-05-10T01:10:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2066430349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40635f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2066430349 >> v2:172.21.15.172:3300/0 conn(0x7ff2a414e6e0 0x7ff2a4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2066430349 >> 172.21.15.52:0/2066430349 conn(0x7ff2a405e810 msgr2=0x7ff2a40c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2066430349 shutdown_connections 2023-05-10T01:10:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.731+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2066430349 wait complete. 2023-05-10T01:10:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.732+0000 7ff2a8f97700 1 Processor -- start 2023-05-10T01:10:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.732+0000 7ff2a8f97700 1 -- start start 2023-05-10T01:10:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a40c4d30 0x7ff2a40aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a414e6e0 0x7ff2a40a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40a9060 con 0x7ff2a40629b0 2023-05-10T01:10:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40aaf60 con 0x7ff2a414e6e0 2023-05-10T01:10:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40a6dd0 con 0x7ff2a40c4d30 2023-05-10T01:10:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59884/0 (socket says 172.21.15.52:59884) 2023-05-10T01:10:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 -- 172.21.15.52:0/2348674390 learned_addr learned my addr 172.21.15.52:0/2348674390 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 -- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a40c4d30 msgr2=0x7ff2a40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a40c4d30 0x7ff2a40aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 -- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a414e6e0 msgr2=0x7ff2a40a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a414e6e0 0x7ff2a40a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 -- 172.21.15.52:0/2348674390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009a20 con 0x7ff2a40629b0 2023-05-10T01:10:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a259c700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7ff29c00d890 tx=0x7ff29c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0125f0 con 0x7ff2a40629b0 2023-05-10T01:10:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c012750 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c012ad0 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a40a8700 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.733+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a40a89a0 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.734+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a40c4890 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.735+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff29c013480 con 0x7ff2a40629b0 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.735+0000 7ff29a7fc700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 0x7ff288061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.735+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff29c079c30 con 0x7ff2a40629b0 2023-05-10T01:10:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.735+0000 7ff2a1d9b700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 0x7ff288061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.736+0000 7ff2a1d9b700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 0x7ff288061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff28c0011e0 tx=0x7ff28c007850).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.740+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff29c04b350 con 0x7ff2a40629b0 2023-05-10T01:10:38.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:38.911+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff2a406c340 con 0x7ff2a40629b0 2023-05-10T01:10:39.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.589+0000 7ff29a7fc700 1 -- 172.21.15.52:0/2348674390 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff29c04e970 con 0x7ff2a40629b0 2023-05-10T01:10:39.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 msgr2=0x7ff288061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 0x7ff288061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff28c0011e0 tx=0x7ff28c007850).stop 2023-05-10T01:10:39.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 msgr2=0x7ff2a40a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7ff29c00d890 tx=0x7ff29c008040).stop 2023-05-10T01:10:39.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 shutdown_connections 2023-05-10T01:10:39.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff28805ed90 0x7ff288061250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a414e6e0 0x7ff2a40a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a40629b0 0x7ff2a40a9480 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0x7ff29c00d890 tx=0x7ff29c008040).stop 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 --2- 172.21.15.52:0/2348674390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a40c4d30 0x7ff2a40aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.597+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 >> 172.21.15.52:0/2348674390 conn(0x7ff2a405e810 msgr2=0x7ff2a414d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.598+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 shutdown_connections 2023-05-10T01:10:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.599+0000 7ff2a8f97700 1 -- 172.21.15.52:0/2348674390 wait complete. 2023-05-10T01:10:39.609 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:10:39.628 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:10:39.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.747+0000 7f7398057700 1 Processor -- start 2023-05-10T01:10:39.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.747+0000 7f7398057700 1 -- start start 2023-05-10T01:10:39.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7398057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7390154080 0x7f73900aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7398057700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7398057700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73900c94c0 con 0x7f73900aa140 2023-05-10T01:10:39.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7398057700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73900aa5b0 con 0x7f7390154080 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7398057700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900cb7d0 con 0x7f7390154460 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7395df3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7390154080 0x7f73900aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7395df3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7390154080 0x7f73900aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59892/0 (socket says 172.21.15.52:59892) 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f7395df3700 1 -- 172.21.15.52:0/1960898768 learned_addr learned my addr 172.21.15.52:0/1960898768 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.748+0000 7f73965f4700 1 --1- 172.21.15.52:0/1960898768 >> v1:172.21.15.52:6789/0 conn(0x7f73900aa140 0x7f7390068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40676/0 (socket says 172.21.15.52:40676) 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f73955f2700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7395df3700 1 -- 172.21.15.52:0/1960898768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 msgr2=0x7f73900a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:39.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7395df3700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7395df3700 1 -- 172.21.15.52:0/1960898768 >> v1:172.21.15.52:6789/0 conn(0x7f73900aa140 legacy=0x7f7390068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7394df1700 1 -- 172.21.15.52:0/1960898768 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360914290 0 0) 0x7f73900c94c0 con 0x7f73900aa140 2023-05-10T01:10:39.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7395df3700 1 -- 172.21.15.52:0/1960898768 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900c88b0 con 0x7f7390154080 2023-05-10T01:10:39.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f73955f2700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7395df3700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f73900aac90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f7388009f20 tx=0x7f7388009840).ready entity=mon.0 client_cookie=fdaff0f25d2b93f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7394df1700 1 -- 172.21.15.52:0/1960898768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800e070 con 0x7f7390154080 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7394df1700 1 -- 172.21.15.52:0/1960898768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800ba80 con 0x7f7390154080 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.749+0000 7f7394df1700 1 -- 172.21.15.52:0/1960898768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800be00 con 0x7f7390154080 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 -- 172.21.15.52:0/1960898768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 msgr2=0x7f73900aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f73900aac90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f7388009f20 tx=0x7f7388009840).stop 2023-05-10T01:10:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 -- 172.21.15.52:0/1960898768 shutdown_connections 2023-05-10T01:10:39.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f73900aac90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 --2- 172.21.15.52:0/1960898768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 -- 172.21.15.52:0/1960898768 >> 172.21.15.52:0/1960898768 conn(0x7f7390067910 msgr2=0x7f73900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:39.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 -- 172.21.15.52:0/1960898768 shutdown_connections 2023-05-10T01:10:39.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.750+0000 7f7398057700 1 -- 172.21.15.52:0/1960898768 wait complete. 2023-05-10T01:10:39.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.751+0000 7f7398057700 1 Processor -- start 2023-05-10T01:10:39.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.751+0000 7f7398057700 1 -- start start 2023-05-10T01:10:39.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 0x7f7390141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c3a80 con 0x7f7390154080 2023-05-10T01:10:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739014c910 con 0x7f73900aa140 2023-05-10T01:10:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c2e70 con 0x7f7390154460 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59900/0 (socket says 172.21.15.52:59900) 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 -- 172.21.15.52:0/1735186558 learned_addr learned my addr 172.21.15.52:0/1735186558 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7395df3700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 0x7f7390141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73965f4700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 -- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 msgr2=0x7f73900ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 -- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 msgr2=0x7f7390141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 0x7f7390141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 -- 172.21.15.52:0/1735186558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009ae0 con 0x7f7390154080 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7395df3700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 0x7f7390141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f73955f2700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f738000d860 tx=0x7f7380008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011590 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800116f0 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73900c3150 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.752+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011a70 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.753+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900c3710 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.754+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7390066720 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.754+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7380012420 con 0x7f7390154080 2023-05-10T01:10:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.754+0000 7f737dffb700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 0x7f7370061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.754+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f7380079770 con 0x7f7390154080 2023-05-10T01:10:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.755+0000 7f7395df3700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 0x7f7370061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.755+0000 7f7395df3700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 0x7f7370061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f738800c010 tx=0x7f7388009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.759+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f738004ad10 con 0x7f7390154080 2023-05-10T01:10:39.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.976+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f73900c3bc0 con 0x7f7390154080 2023-05-10T01:10:39.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.985+0000 7f737dffb700 1 -- 172.21.15.52:0/1735186558 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f738004e330 con 0x7f7390154080 2023-05-10T01:10:39.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.994+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 msgr2=0x7f7370061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.994+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 0x7f7370061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f738800c010 tx=0x7f7388009840).stop 2023-05-10T01:10:39.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.994+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 msgr2=0x7f7390164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:39.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.994+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f738000d860 tx=0x7f7380008040).stop 2023-05-10T01:10:40.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 shutdown_connections 2023-05-10T01:10:40.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f737005ed90 0x7f7370061250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7390154460 0x7f73900ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73900aa140 0x7f7390141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 --2- 172.21.15.52:0/1735186558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7390154080 0x7f7390164360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:39.997+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 >> 172.21.15.52:0/1735186558 conn(0x7f7390067910 msgr2=0x7f739014d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.000+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 shutdown_connections 2023-05-10T01:10:40.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.001+0000 7f7398057700 1 -- 172.21.15.52:0/1735186558 wait complete. 2023-05-10T01:10:40.006 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 5 and data pool 6 2023-05-10T01:10:40.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.133+0000 7f843fb07700 1 Processor -- start 2023-05-10T01:10:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 -- start start 2023-05-10T01:10:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 0x7f84380c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84380c0650 con 0x7f8438154540 2023-05-10T01:10:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380c1af0 con 0x7f8438154160 2023-05-10T01:10:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.134+0000 7f843fb07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380bfd20 con 0x7f8438069da0 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843d8a3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 0x7f84380c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843d8a3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:58246/0 (socket says 172.21.15.52:58246) 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843d0a2700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8438154540 0x7f8438069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:43244/0 (socket says 172.21.15.52:43244) 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843d8a3700 1 -- 172.21.15.52:0/1881569609 learned_addr learned my addr 172.21.15.52:0/1881569609 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 -- 172.21.15.52:0/1881569609 >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 msgr2=0x7f84380c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 --2- 172.21.15.52:0/1881569609 >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 -- 172.21.15.52:0/1881569609 >> v1:172.21.15.172:6789/0 conn(0x7f8438154540 legacy=0x7f8438069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 -- 172.21.15.52:0/1881569609 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380c0000 con 0x7f8438069da0 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843c8a1700 1 -- 172.21.15.52:0/1881569609 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100507061 0 0) 0x7f84380c0650 con 0x7f8438154540 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843d8a3700 1 --2- 172.21.15.52:0/1881569609 >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843e0a4700 1 --2- 172.21.15.52:0/1881569609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 0x7f84380c6150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8430009e60 tx=0x7f8430009780).ready entity=mon.2 client_cookie=a821460820770ff6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843c8a1700 1 -- 172.21.15.52:0/1881569609 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000e070 con 0x7f8438069da0 2023-05-10T01:10:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843c8a1700 1 -- 172.21.15.52:0/1881569609 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843000bb60 con 0x7f8438069da0 2023-05-10T01:10:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.135+0000 7f843c8a1700 1 -- 172.21.15.52:0/1881569609 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430012410 con 0x7f8438069da0 2023-05-10T01:10:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 -- 172.21.15.52:0/1881569609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 msgr2=0x7f84380c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 --2- 172.21.15.52:0/1881569609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 0x7f84380c6150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8430009e60 tx=0x7f8430009780).stop 2023-05-10T01:10:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 -- 172.21.15.52:0/1881569609 shutdown_connections 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 --2- 172.21.15.52:0/1881569609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438069da0 0x7f84380c6150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 --2- 172.21.15.52:0/1881569609 >> v2:172.21.15.172:3300/0 conn(0x7f8438154160 0x7f84380c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 -- 172.21.15.52:0/1881569609 >> 172.21.15.52:0/1881569609 conn(0x7f84380cb740 msgr2=0x7f84380c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 -- 172.21.15.52:0/1881569609 shutdown_connections 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.136+0000 7f843fb07700 1 -- 172.21.15.52:0/1881569609 wait complete. 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.137+0000 7f843fb07700 1 Processor -- start 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.137+0000 7f843fb07700 1 -- start start 2023-05-10T01:10:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8438069da0 0x7f8438153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438154540 0x7f843814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438159890 con 0x7f8438154160 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84381525e0 con 0x7f8438069da0 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843fb07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8438159a80 con 0x7f8438154540 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59930/0 (socket says 172.21.15.52:59930) 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 -- 172.21.15.52:0/2854369017 learned_addr learned my addr 172.21.15.52:0/2854369017 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843e0a4700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438154540 0x7f843814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d8a3700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8438069da0 0x7f8438153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 -- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438154540 msgr2=0x7f843814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438154540 0x7f843814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 -- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8438069da0 msgr2=0x7f8438153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8438069da0 0x7f8438153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 -- 172.21.15.52:0/2854369017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009370 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.138+0000 7f843d0a2700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f842800c490 tx=0x7f8428007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.139+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280070d0 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.139+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428007230 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.139+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280056e0 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.139+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430009a20 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.139+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438152b90 con 0x7f8438154160 2023-05-10T01:10:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.140+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84380666b0 con 0x7f8438154160 2023-05-10T01:10:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.140+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8428010070 con 0x7f8438154160 2023-05-10T01:10:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.140+0000 7f8425ffb700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 0x7f8418061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.140+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8428079280 con 0x7f8438154160 2023-05-10T01:10:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.141+0000 7f843d8a3700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 0x7f8418061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.141+0000 7f843d8a3700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 0x7f8418061250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8434006fd0 tx=0x7f84340090f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.145+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f842804a820 con 0x7f8438154160 2023-05-10T01:10:40.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.319+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f843806c340 con 0x7f8438154160 2023-05-10T01:10:40.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.320+0000 7f8425ffb700 1 -- 172.21.15.52:0/2854369017 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f842804de40 con 0x7f8438154160 2023-05-10T01:10:40.324 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:40.325 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":33,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:10:39.977982+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:40.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 msgr2=0x7f8418061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 0x7f8418061250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8434006fd0 tx=0x7f84340090f0).stop 2023-05-10T01:10:40.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 msgr2=0x7f84381593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f842800c490 tx=0x7f8428007e00).stop 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 shutdown_connections 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f841805ed90 0x7f8418061250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8438154540 0x7f843814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8438069da0 0x7f8438153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 --2- 172.21.15.52:0/2854369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8438154160 0x7f84381593a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.322+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 >> 172.21.15.52:0/2854369017 conn(0x7f84380cb740 msgr2=0x7f8438154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.323+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 shutdown_connections 2023-05-10T01:10:40.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.323+0000 7f843fb07700 1 -- 172.21.15.52:0/2854369017 wait complete. 2023-05-10T01:10:40.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:40.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.452+0000 7f74ce27f700 1 Processor -- start 2023-05-10T01:10:40.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.452+0000 7f74ce27f700 1 -- start start 2023-05-10T01:10:40.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74ce27f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 0x7f74c81561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74ce27f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c80c8740 con 0x7f74c80a76e0 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74ce27f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c8155d60 con 0x7f74c81517e0 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74ce27f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c8460 con 0x7f74c8151bc0 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74cda7e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f74c80a76e0 0x7f74c80c64f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40724/0 (socket says 172.21.15.52:40724) 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74cda7e700 1 -- 172.21.15.52:0/897494465 learned_addr learned my addr 172.21.15.52:0/897494465 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74cca7c700 1 --2- 172.21.15.52:0/897494465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 0x7f74c81561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253092211 0 0) 0x7f74c80c8740 con 0x7f74c80a76e0 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b00033f0 con 0x7f74c80a76e0 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682051632 0 0) 0x7f74c8155d60 con 0x7f74c81517e0 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.453+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c80c8740 con 0x7f74c81517e0 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984784965 0 0) 0x7f74b00033f0 con 0x7f74c80a76e0 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74cca7c700 1 -- 172.21.15.52:0/897494465 >> v1:172.21.15.172:6789/0 conn(0x7f74c81517e0 legacy=0x7f74c8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74cca7c700 1 -- 172.21.15.52:0/897494465 >> v1:172.21.15.52:6789/0 conn(0x7f74c80a76e0 legacy=0x7f74c80c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74cca7c700 1 -- 172.21.15.52:0/897494465 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8155710 con 0x7f74c8151bc0 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74cca7c700 1 --2- 172.21.15.52:0/897494465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 0x7f74c81561f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f74b8009790 tx=0x7f74b8009060).ready entity=mon.2 client_cookie=455ada5b0a00fd0b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00017f0 con 0x7f74c8151bc0 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80090d0 con 0x7f74c8151bc0 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74b7fff700 1 -- 172.21.15.52:0/897494465 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011610 con 0x7f74c8151bc0 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74ce27f700 1 -- 172.21.15.52:0/897494465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 msgr2=0x7f74c81561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.454+0000 7f74ce27f700 1 --2- 172.21.15.52:0/897494465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 0x7f74c81561f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f74b8009790 tx=0x7f74b8009060).stop 2023-05-10T01:10:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.455+0000 7f74ce27f700 1 -- 172.21.15.52:0/897494465 shutdown_connections 2023-05-10T01:10:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.455+0000 7f74ce27f700 1 --2- 172.21.15.52:0/897494465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c8151bc0 0x7f74c81561f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.455+0000 7f74ce27f700 1 -- 172.21.15.52:0/897494465 >> 172.21.15.52:0/897494465 conn(0x7f74c805e810 msgr2=0x7f74c80622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.455+0000 7f74ce27f700 1 -- 172.21.15.52:0/897494465 shutdown_connections 2023-05-10T01:10:40.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.455+0000 7f74ce27f700 1 -- 172.21.15.52:0/897494465 wait complete. 2023-05-10T01:10:40.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.456+0000 7f74ce27f700 1 Processor -- start 2023-05-10T01:10:40.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.456+0000 7f74ce27f700 1 -- start start 2023-05-10T01:10:40.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c80a76e0 0x7f74c80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c8151bc0 0x7f74c81620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80ae970 con 0x7f74c81517e0 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80add60 con 0x7f74c8151bc0 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74ce27f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80ae040 con 0x7f74c80a76e0 2023-05-10T01:10:40.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59944/0 (socket says 172.21.15.52:59944) 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 -- 172.21.15.52:0/1848880435 learned_addr learned my addr 172.21.15.52:0/1848880435 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cd27d700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c80a76e0 0x7f74c80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cda7e700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c8151bc0 0x7f74c81620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 -- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c80a76e0 msgr2=0x7f74c80aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c80a76e0 0x7f74c80aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 -- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c8151bc0 msgr2=0x7f74c81620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c8151bc0 0x7f74c81620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 -- 172.21.15.52:0/1848880435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80092a0 con 0x7f74c81517e0 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.457+0000 7f74cca7c700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f74b8009d80 tx=0x7f74b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801c670 con 0x7f74c81517e0 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b801c7d0 con 0x7f74c81517e0 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80ae320 con 0x7f74c81517e0 2023-05-10T01:10:40.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b801cb70 con 0x7f74c81517e0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80ab170 con 0x7f74c81517e0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.458+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c80bfcb0 con 0x7f74c81517e0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.459+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74b8024030 con 0x7f74c81517e0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.459+0000 7f74b57fa700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 0x7f74a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.459+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f74b807a410 con 0x7f74c81517e0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.459+0000 7f74cd27d700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 0x7f74a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.460+0000 7f74cd27d700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 0x7f74a8061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f74c4003960 tx=0x7f74c4007bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.463+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74c80bfcb0 con 0x7f74c81517e0 2023-05-10T01:10:40.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.638+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c80bfcb0 con 0x7f74c81517e0 2023-05-10T01:10:40.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.638+0000 7f74b57fa700 1 -- 172.21.15.52:0/1848880435 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f74c80bfcb0 con 0x7f74c81517e0 2023-05-10T01:10:40.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:40.643 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":33,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:10:39.977982+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 msgr2=0x7f74a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 0x7f74a8061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f74c4003960 tx=0x7f74c4007bc0).stop 2023-05-10T01:10:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 msgr2=0x7f74c8161bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f74b8009d80 tx=0x7f74b8016000).stop 2023-05-10T01:10:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 shutdown_connections 2023-05-10T01:10:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74a805ed90 0x7f74a8061250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c8151bc0 0x7f74c81620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74c80a76e0 0x7f74c80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 --2- 172.21.15.52:0/1848880435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81517e0 0x7f74c8161bc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 >> 172.21.15.52:0/1848880435 conn(0x7f74c805e810 msgr2=0x7f74c8152160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 shutdown_connections 2023-05-10T01:10:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.640+0000 7f74ce27f700 1 -- 172.21.15.52:0/1848880435 wait complete. 2023-05-10T01:10:40.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:10:40.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 Processor -- start 2023-05-10T01:10:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 -- start start 2023-05-10T01:10:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c5d20 0x7f67540aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67540c6100 0x7f6754069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6754153a90 0x7f6754153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540c8820 con 0x7f6754153a90 2023-05-10T01:10:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540c8b00 con 0x7f67540c6100 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.772+0000 7f675a33e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c8de0 con 0x7f67540c5d20 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6754153a90 0x7f6754153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6754153a90 0x7f6754153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59954/0 (socket says 172.21.15.52:59954) 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 -- 172.21.15.52:0/4244110130 learned_addr learned my addr 172.21.15.52:0/4244110130 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f6753fff700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c5d20 0x7f67540aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67537fe700 1 --2- 172.21.15.52:0/4244110130 >> v2:172.21.15.172:3300/0 conn(0x7f67540c6100 0x7f6754069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 -- 172.21.15.52:0/4244110130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c5d20 msgr2=0x7f67540aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c5d20 0x7f67540aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 -- 172.21.15.52:0/4244110130 >> v2:172.21.15.172:3300/0 conn(0x7f67540c6100 msgr2=0x7f6754069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 --2- 172.21.15.52:0/4244110130 >> v2:172.21.15.172:3300/0 conn(0x7f67540c6100 0x7f6754069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 -- 172.21.15.52:0/4244110130 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540c90c0 con 0x7f6754153a90 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f67588db700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f6754153f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6754083f20 tx=0x7f674c009840).ready entity=mon.0 client_cookie=2bfdab1485dfa1d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f6752ffd700 1 -- 172.21.15.52:0/4244110130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00e070 con 0x7f6754153a90 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f6752ffd700 1 -- 172.21.15.52:0/4244110130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c00ba50 con 0x7f6754153a90 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.773+0000 7f6752ffd700 1 -- 172.21.15.52:0/4244110130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00bdd0 con 0x7f6754153a90 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 -- 172.21.15.52:0/4244110130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 msgr2=0x7f6754153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f6754153f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6754083f20 tx=0x7f674c009840).stop 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 -- 172.21.15.52:0/4244110130 shutdown_connections 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f6754153f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 --2- 172.21.15.52:0/4244110130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c5d20 0x7f67540aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 --2- 172.21.15.52:0/4244110130 >> v2:172.21.15.172:3300/0 conn(0x7f67540c6100 0x7f6754069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 -- 172.21.15.52:0/4244110130 >> 172.21.15.52:0/4244110130 conn(0x7f67540cb6f0 msgr2=0x7f67540c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 -- 172.21.15.52:0/4244110130 shutdown_connections 2023-05-10T01:10:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.774+0000 7f675a33e700 1 -- 172.21.15.52:0/4244110130 wait complete. 2023-05-10T01:10:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.775+0000 7f675a33e700 1 Processor -- start 2023-05-10T01:10:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.775+0000 7f675a33e700 1 -- start start 2023-05-10T01:10:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67540c5d20 0x7f6754164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c6100 0x7f67540a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540a2830 con 0x7f6754153a90 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540a2ab0 con 0x7f67540c5d20 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f675a33e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754151490 con 0x7f67540c6100 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59960/0 (socket says 172.21.15.52:59960) 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 -- 172.21.15.52:0/2405545053 learned_addr learned my addr 172.21.15.52:0/2405545053 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f6753fff700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67540c5d20 0x7f6754164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67537fe700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c6100 0x7f67540a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 -- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c6100 msgr2=0x7f67540a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c6100 0x7f67540a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 -- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67540c5d20 msgr2=0x7f6754164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67540c5d20 0x7f6754164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 -- 172.21.15.52:0/2405545053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c009ae0 con 0x7f6754153a90 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f67588db700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f6754083c40 tx=0x7f67540c7050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0092e0 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.776+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c007610 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.777+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6754151770 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.777+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0079d0 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.777+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6754151d30 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.778+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6754066720 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.778+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f674c026030 con 0x7f6754153a90 2023-05-10T01:10:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.778+0000 7f673bfff700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 0x7f6734061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.778+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f674c07b8e0 con 0x7f6754153a90 2023-05-10T01:10:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.778+0000 7f6753fff700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 0x7f6734061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.779+0000 7f6753fff700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 0x7f6734061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f67540c8ad0 tx=0x7f6744008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:40.782+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f674c04ce80 con 0x7f6754153a90 2023-05-10T01:10:41.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.002+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f675405e1e0 con 0x7f6754153a90 2023-05-10T01:10:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.986+0000 7f673bfff700 1 -- 172.21.15.52:0/2405545053 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f674c024030 con 0x7f6754153a90 2023-05-10T01:10:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 msgr2=0x7f6734061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 0x7f6734061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f67540c8ad0 tx=0x7f6744008040).stop 2023-05-10T01:10:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 msgr2=0x7f67541457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f6754083c40 tx=0x7f67540c7050).stop 2023-05-10T01:10:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 shutdown_connections 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f673405ed90 0x7f6734061250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754153a90 0x7f67541457e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67540c5d20 0x7f6754164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 --2- 172.21.15.52:0/2405545053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67540c6100 0x7f67540a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 >> 172.21.15.52:0/2405545053 conn(0x7f67540cb6f0 msgr2=0x7f67540697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 shutdown_connections 2023-05-10T01:10:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:41.988+0000 7f675a33e700 1 -- 172.21.15.52:0/2405545053 wait complete. 2023-05-10T01:10:42.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:10:42.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.130+0000 7f14402e9700 1 Processor -- start 2023-05-10T01:10:42.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.130+0000 7f14402e9700 1 -- start start 2023-05-10T01:10:42.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f14402e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14380aa200 0x7f14380c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f14402e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1438153a90 0x7f1438153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f14402e9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380c8820 con 0x7f14380c5d20 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f14402e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380ca5f0 con 0x7f14380aa200 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f14402e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380c8b00 con 0x7f1438153a90 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f143d884700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14380aa200 0x7f14380c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f143d884700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14380aa200 0x7f14380c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59968/0 (socket says 172.21.15.52:59968) 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.131+0000 7f143d884700 1 -- 172.21.15.52:0/251482056 learned_addr learned my addr 172.21.15.52:0/251482056 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d884700 1 -- 172.21.15.52:0/251482056 >> v2:172.21.15.172:3300/0 conn(0x7f1438153a90 msgr2=0x7f1438153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143e886700 1 --2- 172.21.15.52:0/251482056 >> v2:172.21.15.172:3300/0 conn(0x7f1438153a90 0x7f1438153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d884700 1 --2- 172.21.15.52:0/251482056 >> v2:172.21.15.172:3300/0 conn(0x7f1438153a90 0x7f1438153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d884700 1 -- 172.21.15.52:0/251482056 >> v1:172.21.15.172:6789/0 conn(0x7f14380c5d20 legacy=0x7f1438069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d884700 1 -- 172.21.15.52:0/251482056 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380c8de0 con 0x7f14380aa200 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d884700 1 --2- 172.21.15.52:0/251482056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380aa200 0x7f14380c6100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f14380c7330 tx=0x7f142c0090f0).ready entity=mon.0 client_cookie=211b8f5d2c54ad24 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d083700 1 -- 172.21.15.52:0/251482056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00b5a0 con 0x7f14380aa200 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d083700 1 -- 172.21.15.52:0/251482056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00b700 con 0x7f14380aa200 2023-05-10T01:10:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f143d083700 1 -- 172.21.15.52:0/251482056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00ba80 con 0x7f14380aa200 2023-05-10T01:10:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 -- 172.21.15.52:0/251482056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380aa200 msgr2=0x7f14380c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 --2- 172.21.15.52:0/251482056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380aa200 0x7f14380c6100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f14380c7330 tx=0x7f142c0090f0).stop 2023-05-10T01:10:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 -- 172.21.15.52:0/251482056 shutdown_connections 2023-05-10T01:10:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 --2- 172.21.15.52:0/251482056 >> v2:172.21.15.172:3300/0 conn(0x7f1438153a90 0x7f1438153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 --2- 172.21.15.52:0/251482056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380aa200 0x7f14380c6100 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.132+0000 7f14402e9700 1 -- 172.21.15.52:0/251482056 >> 172.21.15.52:0/251482056 conn(0x7f14380cb6f0 msgr2=0x7f14380c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.133+0000 7f14402e9700 1 -- 172.21.15.52:0/251482056 shutdown_connections 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.133+0000 7f14402e9700 1 -- 172.21.15.52:0/251482056 wait complete. 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 Processor -- start 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 -- start start 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14380aa200 0x7f14380afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1438153a90 0x7f143814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143814d300 con 0x7f14380c5d20 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380ae5a0 con 0x7f1438153a90 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f14402e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143814d770 con 0x7f14380aa200 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.134+0000 7f143d884700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59972/0 (socket says 172.21.15.52:59972) 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 -- 172.21.15.52:0/361460081 learned_addr learned my addr 172.21.15.52:0/361460081 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143e886700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1438153a90 0x7f143814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143e085700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14380aa200 0x7f14380afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 -- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14380aa200 msgr2=0x7f14380afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14380aa200 0x7f14380afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 -- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1438153a90 msgr2=0x7f143814ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1438153a90 0x7f143814ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 -- 172.21.15.52:0/361460081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009370 con 0x7f14380c5d20 2023-05-10T01:10:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f143d884700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f1438083c40 tx=0x7f142c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00b870 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00b9d0 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380b0420 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c01c670 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.135+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14380aead0 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.136+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1438066720 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.136+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f142c02c070 con 0x7f14380c5d20 2023-05-10T01:10:42.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.137+0000 7f14367fc700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.137+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f142c07b7b0 con 0x7f14380c5d20 2023-05-10T01:10:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.137+0000 7f143e085700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.137+0000 7f143e085700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 0x7f1418061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f143000b890 tx=0x7f1430008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.141+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f142c04cd50 con 0x7f14380c5d20 2023-05-10T01:10:42.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.360+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f14380c90c0 con 0x7f14380c5d20 2023-05-10T01:10:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.989+0000 7f14367fc700 1 -- 172.21.15.52:0/361460081 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f142c02a070 con 0x7f14380c5d20 2023-05-10T01:10:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 msgr2=0x7f1418061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 0x7f1418061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f143000b890 tx=0x7f1430008040).stop 2023-05-10T01:10:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 msgr2=0x7f14380b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f1438083c40 tx=0x7f142c015000).stop 2023-05-10T01:10:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 shutdown_connections 2023-05-10T01:10:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141805ed90 0x7f1418061250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1438153a90 0x7f143814ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14380aa200 0x7f14380afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 --2- 172.21.15.52:0/361460081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14380c5d20 0x7f14380b07f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 >> 172.21.15.52:0/361460081 conn(0x7f14380cb6f0 msgr2=0x7f1438152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 shutdown_connections 2023-05-10T01:10:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:42.992+0000 7f14402e9700 1 -- 172.21.15.52:0/361460081 wait complete. 2023-05-10T01:10:43.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.130+0000 7f8e4635a700 1 Processor -- start 2023-05-10T01:10:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.130+0000 7f8e4635a700 1 -- start start 2023-05-10T01:10:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e4635a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154160 0x7f8e400c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e4635a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e40069da0 0x7f8e400c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e4635a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400c0650 con 0x7f8e40154540 2023-05-10T01:10:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e4635a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400c1af0 con 0x7f8e40069da0 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e4635a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400bfd20 con 0x7f8e40154160 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e40069da0 0x7f8e400c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e40069da0 0x7f8e400c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59982/0 (socket says 172.21.15.52:59982) 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 -- 172.21.15.52:0/2574358780 learned_addr learned my addr 172.21.15.52:0/2574358780 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e3ffff700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154160 0x7f8e400c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 -- 172.21.15.52:0/2574358780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154160 msgr2=0x7f8e400c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154160 0x7f8e400c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 -- 172.21.15.52:0/2574358780 >> v1:172.21.15.172:6789/0 conn(0x7f8e40154540 legacy=0x7f8e40069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 -- 172.21.15.52:0/2574358780 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400c0000 con 0x7f8e40069da0 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e448f7700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40069da0 0x7f8e400c6150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8e38009f20 tx=0x7f8e38009840).ready entity=mon.0 client_cookie=8285de943b9a6435 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.131+0000 7f8e3effd700 1 -- 172.21.15.52:0/2574358780 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800e070 con 0x7f8e40069da0 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e3effd700 1 -- 172.21.15.52:0/2574358780 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800ba40 con 0x7f8e40069da0 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e3effd700 1 -- 172.21.15.52:0/2574358780 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800bdc0 con 0x7f8e40069da0 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 -- 172.21.15.52:0/2574358780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40069da0 msgr2=0x7f8e400c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40069da0 0x7f8e400c6150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8e38009f20 tx=0x7f8e38009840).stop 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 -- 172.21.15.52:0/2574358780 shutdown_connections 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154160 0x7f8e400c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2574358780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40069da0 0x7f8e400c6150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 -- 172.21.15.52:0/2574358780 >> 172.21.15.52:0/2574358780 conn(0x7f8e400cb740 msgr2=0x7f8e400c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 -- 172.21.15.52:0/2574358780 shutdown_connections 2023-05-10T01:10:43.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.132+0000 7f8e4635a700 1 -- 172.21.15.52:0/2574358780 wait complete. 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.133+0000 7f8e4635a700 1 Processor -- start 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.133+0000 7f8e4635a700 1 -- start start 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e40069da0 0x7f8e40141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154540 0x7f8e40150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40151180 con 0x7f8e40154160 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40151460 con 0x7f8e40069da0 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e4635a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40151740 con 0x7f8e40154540 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59986/0 (socket says 172.21.15.52:59986) 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 -- 172.21.15.52:0/2761668159 learned_addr learned my addr 172.21.15.52:0/2761668159 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3ffff700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e40069da0 0x7f8e40141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e448f7700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154540 0x7f8e40150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 -- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154540 msgr2=0x7f8e40150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154540 0x7f8e40150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 -- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e40069da0 msgr2=0x7f8e40141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e40069da0 0x7f8e40141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.134+0000 7f8e3f7fe700 1 -- 172.21.15.52:0/2761668159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009ae0 con 0x7f8e40154160 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e3f7fe700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8e34009440 tx=0x7f8e34006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34013460 con 0x7f8e40154160 2023-05-10T01:10:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e340135c0 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e40151a20 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34013940 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.135+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400c3a10 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.136+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e400666b0 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.136+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8e3401a060 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.136+0000 7f8e27fff700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 0x7f8e20061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.137+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e340790c0 con 0x7f8e40154160 2023-05-10T01:10:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.137+0000 7f8e3ffff700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 0x7f8e20061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.137+0000 7f8e3ffff700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 0x7f8e20061280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8e3000bbc0 tx=0x7f8e30008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.141+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e3404a660 con 0x7f8e40154160 2023-05-10T01:10:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.358+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e40151f40 con 0x7f8e40154160 2023-05-10T01:10:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.358+0000 7f8e27fff700 1 -- 172.21.15.52:0/2761668159 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f8e34018070 con 0x7f8e40154160 2023-05-10T01:10:43.363 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:43.363 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 msgr2=0x7f8e20061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 0x7f8e20061280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8e3000bbc0 tx=0x7f8e30008040).stop 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 msgr2=0x7f8e40150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8e34009440 tx=0x7f8e34006ee0).stop 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 shutdown_connections 2023-05-10T01:10:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8e2005edc0 0x7f8e20061280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e40154540 0x7f8e40150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e40069da0 0x7f8e40141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 --2- 172.21.15.52:0/2761668159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e40154160 0x7f8e40150670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 >> 172.21.15.52:0/2761668159 conn(0x7f8e400cb740 msgr2=0x7f8e400c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 shutdown_connections 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.360+0000 7f8e4635a700 1 -- 172.21.15.52:0/2761668159 wait complete. 2023-05-10T01:10:43.366 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:10:43.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:10:43.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.488+0000 7fc76d1d2700 1 Processor -- start 2023-05-10T01:10:43.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.488+0000 7fc76d1d2700 1 -- start start 2023-05-10T01:10:43.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76d1d2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc768154160 0x7fc7680c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76d1d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc768069da0 0x7fc7680c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76d1d2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680c0650 con 0x7fc768154540 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76d1d2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680c1af0 con 0x7fc768069da0 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76d1d2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680bfd20 con 0x7fc768154160 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc768069da0 0x7fc7680c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc768069da0 0x7fc7680c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59994/0 (socket says 172.21.15.52:59994) 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.489+0000 7fc76759e700 1 -- 172.21.15.52:0/2971761987 learned_addr learned my addr 172.21.15.52:0/2971761987 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc766d9d700 1 --2- 172.21.15.52:0/2971761987 >> v2:172.21.15.172:3300/0 conn(0x7fc768154160 0x7fc7680c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76759e700 1 -- 172.21.15.52:0/2971761987 >> v2:172.21.15.172:3300/0 conn(0x7fc768154160 msgr2=0x7fc7680c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76759e700 1 --2- 172.21.15.52:0/2971761987 >> v2:172.21.15.172:3300/0 conn(0x7fc768154160 0x7fc7680c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76759e700 1 -- 172.21.15.52:0/2971761987 >> v1:172.21.15.172:6789/0 conn(0x7fc768154540 legacy=0x7fc768069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76759e700 1 -- 172.21.15.52:0/2971761987 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680c0000 con 0x7fc768069da0 2023-05-10T01:10:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76759e700 1 --2- 172.21.15.52:0/2971761987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680c6150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc768083020 tx=0x7fc758009840).ready entity=mon.0 client_cookie=c6a40fb9df7bd45d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc765d9b700 1 -- 172.21.15.52:0/2971761987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800e070 con 0x7fc768069da0 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc765d9b700 1 -- 172.21.15.52:0/2971761987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800ba10 con 0x7fc768069da0 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc765d9b700 1 -- 172.21.15.52:0/2971761987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800bd90 con 0x7fc768069da0 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 -- 172.21.15.52:0/2971761987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 msgr2=0x7fc7680c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/2971761987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680c6150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fc768083020 tx=0x7fc758009840).stop 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 -- 172.21.15.52:0/2971761987 shutdown_connections 2023-05-10T01:10:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/2971761987 >> v2:172.21.15.172:3300/0 conn(0x7fc768154160 0x7fc7680c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/2971761987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680c6150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.490+0000 7fc76d1d2700 1 -- 172.21.15.52:0/2971761987 >> 172.21.15.52:0/2971761987 conn(0x7fc7680cb6f0 msgr2=0x7fc7680c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:43.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.491+0000 7fc76d1d2700 1 -- 172.21.15.52:0/2971761987 shutdown_connections 2023-05-10T01:10:43.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.491+0000 7fc76d1d2700 1 -- 172.21.15.52:0/2971761987 wait complete. 2023-05-10T01:10:43.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.492+0000 7fc76d1d2700 1 Processor -- start 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.492+0000 7fc76d1d2700 1 -- start start 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.492+0000 7fc76d1d2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.492+0000 7fc76d1d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc768154160 0x7fc7680b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.492+0000 7fc76d1d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc768154540 0x7fc7681446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76d1d2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680aeca0 con 0x7fc768069da0 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76d1d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680ae090 con 0x7fc768154160 2023-05-10T01:10:43.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76d1d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680ae370 con 0x7fc768154540 2023-05-10T01:10:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59996/0 (socket says 172.21.15.52:59996) 2023-05-10T01:10:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 -- 172.21.15.52:0/730160143 learned_addr learned my addr 172.21.15.52:0/730160143 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76659c700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc768154160 0x7fc7680b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76759e700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc768154540 0x7fc7681446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 -- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc768154540 msgr2=0x7fc7681446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc768154540 0x7fc7681446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 -- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc768154160 msgr2=0x7fc7680b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc768154160 0x7fc7680b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 -- 172.21.15.52:0/730160143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009ae0 con 0x7fc768069da0 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc766d9d700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc76000c850 tx=0x7fc760008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760010580 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600106e0 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7680ae650 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760010a60 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.493+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7680af620 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.494+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7680666b0 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.494+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc76001b460 con 0x7fc768069da0 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.495+0000 7fc75effd700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 0x7fc74c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.495+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc760079be0 con 0x7fc768069da0 2023-05-10T01:10:43.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.495+0000 7fc76659c700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 0x7fc74c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.495+0000 7fc76659c700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 0x7fc74c061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc768158e70 tx=0x7fc750008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.499+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc76004b120 con 0x7fc768069da0 2023-05-10T01:10:43.579 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:10:43.575+0000 7f44171e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:10:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.676+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc76806c340 con 0x7fc768069da0 2023-05-10T01:10:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.677+0000 7fc75effd700 1 -- 172.21.15.52:0/730160143 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fc76004e740 con 0x7fc768069da0 2023-05-10T01:10:43.681 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:43.681 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:10:40.979824+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:10:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 msgr2=0x7fc74c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 0x7fc74c061250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc768158e70 tx=0x7fc750008040).stop 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 msgr2=0x7fc7680af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fc76000c850 tx=0x7fc760008040).stop 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 shutdown_connections 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc74c05ed90 0x7fc74c061250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc768154540 0x7fc7681446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc768069da0 0x7fc7680af130 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 --2- 172.21.15.52:0/730160143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc768154160 0x7fc7680b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 >> 172.21.15.52:0/730160143 conn(0x7fc7680cb6f0 msgr2=0x7fc76814f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 shutdown_connections 2023-05-10T01:10:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.679+0000 7fc76d1d2700 1 -- 172.21.15.52:0/730160143 wait complete. 2023-05-10T01:10:43.695 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:10:43.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:10:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.808+0000 7f44cb778700 1 Processor -- start 2023-05-10T01:10:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.808+0000 7f44cb778700 1 -- start start 2023-05-10T01:10:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c40a6ac0 0x7f44c40a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c4067f50 0x7f44c40683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44c4150770 0x7f44c4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c4154990 con 0x7f44c4067f50 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c4155510 con 0x7f44c4150770 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44cb778700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4154be0 con 0x7f44c40a6ac0 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44c8d13700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c4067f50 0x7f44c40683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44c8d13700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c4067f50 0x7f44c40683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60008/0 (socket says 172.21.15.52:60008) 2023-05-10T01:10:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.809+0000 7f44c8d13700 1 -- 172.21.15.52:0/145772342 learned_addr learned my addr 172.21.15.52:0/145772342 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 -- 172.21.15.52:0/145772342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c40a6ac0 msgr2=0x7f44c40a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 --2- 172.21.15.52:0/145772342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c40a6ac0 0x7f44c40a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c9d15700 1 --2- 172.21.15.52:0/145772342 >> v2:172.21.15.172:3300/0 conn(0x7f44c4150770 0x7f44c4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 -- 172.21.15.52:0/145772342 >> v2:172.21.15.172:3300/0 conn(0x7f44c4150770 msgr2=0x7f44c4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 --2- 172.21.15.52:0/145772342 >> v2:172.21.15.172:3300/0 conn(0x7f44c4150770 0x7f44c4150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 -- 172.21.15.52:0/145772342 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4154ec0 con 0x7f44c4067f50 2023-05-10T01:10:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c8d13700 1 --2- 172.21.15.52:0/145772342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40683b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f44c40c1e70 tx=0x7f44b80090f0).ready entity=mon.0 client_cookie=49667d8c29e0405b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c3fff700 1 -- 172.21.15.52:0/145772342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800b690 con 0x7f44c4067f50 2023-05-10T01:10:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c3fff700 1 -- 172.21.15.52:0/145772342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800b7f0 con 0x7f44c4067f50 2023-05-10T01:10:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44c3fff700 1 -- 172.21.15.52:0/145772342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800bb70 con 0x7f44c4067f50 2023-05-10T01:10:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44cb778700 1 -- 172.21.15.52:0/145772342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 msgr2=0x7f44c40683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.810+0000 7f44cb778700 1 --2- 172.21.15.52:0/145772342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40683b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f44c40c1e70 tx=0x7f44b80090f0).stop 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 -- 172.21.15.52:0/145772342 shutdown_connections 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 --2- 172.21.15.52:0/145772342 >> v2:172.21.15.172:3300/0 conn(0x7f44c4150770 0x7f44c4150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 --2- 172.21.15.52:0/145772342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c40a6ac0 0x7f44c40a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 --2- 172.21.15.52:0/145772342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40683b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 -- 172.21.15.52:0/145772342 >> 172.21.15.52:0/145772342 conn(0x7f44c40c8370 msgr2=0x7f44c40c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:43.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 -- 172.21.15.52:0/145772342 shutdown_connections 2023-05-10T01:10:43.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.811+0000 7f44cb778700 1 -- 172.21.15.52:0/145772342 wait complete. 2023-05-10T01:10:43.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.812+0000 7f44cb778700 1 Processor -- start 2023-05-10T01:10:43.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.812+0000 7f44cb778700 1 -- start start 2023-05-10T01:10:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 0x7f44c4062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c4150770 0x7f44c40a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4144c60 con 0x7f44c4067f50 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4144f40 con 0x7f44c40a6ac0 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4145220 con 0x7f44c4150770 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60010/0 (socket says 172.21.15.52:60010) 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 -- 172.21.15.52:0/4150707785 learned_addr learned my addr 172.21.15.52:0/4150707785 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c8d13700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 0x7f44c4062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9d15700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c4150770 0x7f44c40a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 -- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c4150770 msgr2=0x7f44c40a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c4150770 0x7f44c40a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 -- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 msgr2=0x7f44c4062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 0x7f44c4062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 -- 172.21.15.52:0/4150707785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8009370 con 0x7f44c4067f50 2023-05-10T01:10:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c8d13700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 0x7f44c4062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c9514700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f44bc00bc30 tx=0x7f44bc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00c7a0 con 0x7f44c4067f50 2023-05-10T01:10:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc010070 con 0x7f44c4067f50 2023-05-10T01:10:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c4145500 con 0x7f44c4067f50 2023-05-10T01:10:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.813+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00c960 con 0x7f44c4067f50 2023-05-10T01:10:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.814+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c4146210 con 0x7f44c4067f50 2023-05-10T01:10:43.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.814+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c40bd260 con 0x7f44c4067f50 2023-05-10T01:10:43.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.815+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f44bc01c070 con 0x7f44c4067f50 2023-05-10T01:10:43.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.815+0000 7f44c17fa700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 0x7f44a4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:43.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.815+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44bc0792b0 con 0x7f44c4067f50 2023-05-10T01:10:43.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.815+0000 7f44c8d13700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 0x7f44a4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:43.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.816+0000 7f44c8d13700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 0x7f44a4061220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f44c40c1e70 tx=0x7f44b8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:43.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.820+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f44bc04a850 con 0x7f44c4067f50 2023-05-10T01:10:43.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.988+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44c405e810 con 0x7f44a405ed60 2023-05-10T01:10:44.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:43.999+0000 7f44c17fa700 1 -- 172.21.15.52:0/4150707785 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336350 (secure 0 0 0) 0x7f44c405e810 con 0x7f44a405ed60 2023-05-10T01:10:44.008 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:44.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 msgr2=0x7f44a4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 0x7f44a4061220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f44c40c1e70 tx=0x7f44b8017000).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 msgr2=0x7f44c40a86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f44bc00bc30 tx=0x7f44bc009840).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 shutdown_connections 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44a405ed60 0x7f44a4061220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44c4150770 0x7f44c40a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c4067f50 0x7f44c40a86e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 --2- 172.21.15.52:0/4150707785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44c40a6ac0 0x7f44c4062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 >> 172.21.15.52:0/4150707785 conn(0x7f44c40c8370 msgr2=0x7f44c4147060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 shutdown_connections 2023-05-10T01:10:44.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.002+0000 7f44cb778700 1 -- 172.21.15.52:0/4150707785 wait complete. 2023-05-10T01:10:44.012 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:10:44.018 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-05-10T01:10:42.453360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":45084,"kb_used_data":2908,"kb_used_omap":0,"kb_used_meta":42112,"kb_avail":754929636,"statfs":{"total":773094113280,"available":773047947264,"internally_reserved":0,"allocated":2977792,"data_stored":1197221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43122688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4317,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.580108"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994758+0000","last_change":"2023-05-10T01:10:39.994758+0000","last_active":"2023-05-10T01:10:39.994758+0000","last_peered":"2023-05-10T01:10:39.994758+0000","last_clean":"2023-05-10T01:10:39.994758+0000","last_became_active":"2023-05-10T01:10:39.993937+0000","last_became_peered":"2023-05-10T01:10:39.993937+0000","last_unstale":"2023-05-10T01:10:39.994758+0000","last_undegraded":"2023-05-10T01:10:39.994758+0000","last_fullsized":"2023-05-10T01:10:39.994758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011349+0000","last_change":"2023-05-10T01:10:39.616320+0000","last_active":"2023-05-10T01:10:40.011349+0000","last_peered":"2023-05-10T01:10:40.011349+0000","last_clean":"2023-05-10T01:10:40.011349+0000","last_became_active":"2023-05-10T01:10:39.615994+0000","last_became_peered":"2023-05-10T01:10:39.615994+0000","last_unstale":"2023-05-10T01:10:40.011349+0000","last_undegraded":"2023-05-10T01:10:40.011349+0000","last_fullsized":"2023-05-10T01:10:40.011349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006213+0000","last_change":"2023-05-10T01:10:40.006213+0000","last_active":"2023-05-10T01:10:40.006213+0000","last_peered":"2023-05-10T01:10:40.006213+0000","last_clean":"2023-05-10T01:10:40.006213+0000","last_became_active":"2023-05-10T01:10:40.005931+0000","last_became_peered":"2023-05-10T01:10:40.005931+0000","last_unstale":"2023-05-10T01:10:40.006213+0000","last_undegraded":"2023-05-10T01:10:40.006213+0000","last_fullsized":"2023-05-10T01:10:40.006213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608163+0000","last_change":"2023-05-10T01:10:39.604319+0000","last_active":"2023-05-10T01:10:39.608163+0000","last_peered":"2023-05-10T01:10:39.608163+0000","last_clean":"2023-05-10T01:10:39.608163+0000","last_became_active":"2023-05-10T01:10:39.603628+0000","last_became_peered":"2023-05-10T01:10:39.603628+0000","last_unstale":"2023-05-10T01:10:39.608163+0000","last_undegraded":"2023-05-10T01:10:39.608163+0000","last_fullsized":"2023-05-10T01:10:39.608163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999213+0000","last_change":"2023-05-10T01:10:39.999213+0000","last_active":"2023-05-10T01:10:39.999213+0000","last_peered":"2023-05-10T01:10:39.999213+0000","last_clean":"2023-05-10T01:10:39.999213+0000","last_became_active":"2023-05-10T01:10:39.998946+0000","last_became_peered":"2023-05-10T01:10:39.998946+0000","last_unstale":"2023-05-10T01:10:39.999213+0000","last_undegraded":"2023-05-10T01:10:39.999213+0000","last_fullsized":"2023-05-10T01:10:39.999213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619031+0000","last_change":"2023-05-10T01:10:39.614495+0000","last_active":"2023-05-10T01:10:39.619031+0000","last_peered":"2023-05-10T01:10:39.619031+0000","last_clean":"2023-05-10T01:10:39.619031+0000","last_became_active":"2023-05-10T01:10:39.614255+0000","last_became_peered":"2023-05-10T01:10:39.614255+0000","last_unstale":"2023-05-10T01:10:39.619031+0000","last_undegraded":"2023-05-10T01:10:39.619031+0000","last_fullsized":"2023-05-10T01:10:39.619031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997816+0000","last_change":"2023-05-10T01:10:39.997816+0000","last_active":"2023-05-10T01:10:39.997816+0000","last_peered":"2023-05-10T01:10:39.997816+0000","last_clean":"2023-05-10T01:10:39.997816+0000","last_became_active":"2023-05-10T01:10:39.997551+0000","last_became_peered":"2023-05-10T01:10:39.997551+0000","last_unstale":"2023-05-10T01:10:39.997816+0000","last_undegraded":"2023-05-10T01:10:39.997816+0000","last_fullsized":"2023-05-10T01:10:39.997816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004038+0000","last_change":"2023-05-10T01:10:39.616012+0000","last_active":"2023-05-10T01:10:40.004038+0000","last_peered":"2023-05-10T01:10:40.004038+0000","last_clean":"2023-05-10T01:10:40.004038+0000","last_became_active":"2023-05-10T01:10:39.614553+0000","last_became_peered":"2023-05-10T01:10:39.614553+0000","last_unstale":"2023-05-10T01:10:40.004038+0000","last_undegraded":"2023-05-10T01:10:40.004038+0000","last_fullsized":"2023-05-10T01:10:40.004038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006142+0000","last_change":"2023-05-10T01:10:40.006142+0000","last_active":"2023-05-10T01:10:40.006142+0000","last_peered":"2023-05-10T01:10:40.006142+0000","last_clean":"2023-05-10T01:10:40.006142+0000","last_became_active":"2023-05-10T01:10:40.005854+0000","last_became_peered":"2023-05-10T01:10:40.005854+0000","last_unstale":"2023-05-10T01:10:40.006142+0000","last_undegraded":"2023-05-10T01:10:40.006142+0000","last_fullsized":"2023-05-10T01:10:40.006142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985577+0000","last_change":"2023-05-10T01:10:39.615111+0000","last_active":"2023-05-10T01:10:39.985577+0000","last_peered":"2023-05-10T01:10:39.985577+0000","last_clean":"2023-05-10T01:10:39.985577+0000","last_became_active":"2023-05-10T01:10:39.614850+0000","last_became_peered":"2023-05-10T01:10:39.614850+0000","last_unstale":"2023-05-10T01:10:39.985577+0000","last_undegraded":"2023-05-10T01:10:39.985577+0000","last_fullsized":"2023-05-10T01:10:39.985577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003018+0000","last_change":"2023-05-10T01:10:40.003018+0000","last_active":"2023-05-10T01:10:40.003018+0000","last_peered":"2023-05-10T01:10:40.003018+0000","last_clean":"2023-05-10T01:10:40.003018+0000","last_became_active":"2023-05-10T01:10:40.002698+0000","last_became_peered":"2023-05-10T01:10:40.002698+0000","last_unstale":"2023-05-10T01:10:40.003018+0000","last_undegraded":"2023-05-10T01:10:40.003018+0000","last_fullsized":"2023-05-10T01:10:40.003018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.990369+0000","last_change":"2023-05-10T01:10:39.609496+0000","last_active":"2023-05-10T01:10:39.990369+0000","last_peered":"2023-05-10T01:10:39.990369+0000","last_clean":"2023-05-10T01:10:39.990369+0000","last_became_active":"2023-05-10T01:10:39.608842+0000","last_became_peered":"2023-05-10T01:10:39.608842+0000","last_unstale":"2023-05-10T01:10:39.990369+0000","last_undegraded":"2023-05-10T01:10:39.990369+0000","last_fullsized":"2023-05-10T01:10:39.990369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999797+0000","last_change":"2023-05-10T01:10:39.999797+0000","last_active":"2023-05-10T01:10:39.999797+0000","last_peered":"2023-05-10T01:10:39.999797+0000","last_clean":"2023-05-10T01:10:39.999797+0000","last_became_active":"2023-05-10T01:10:39.999459+0000","last_became_peered":"2023-05-10T01:10:39.999459+0000","last_unstale":"2023-05-10T01:10:39.999797+0000","last_undegraded":"2023-05-10T01:10:39.999797+0000","last_fullsized":"2023-05-10T01:10:39.999797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621080+0000","last_change":"2023-05-10T01:10:39.618621+0000","last_active":"2023-05-10T01:10:39.621080+0000","last_peered":"2023-05-10T01:10:39.621080+0000","last_clean":"2023-05-10T01:10:39.621080+0000","last_became_active":"2023-05-10T01:10:39.618363+0000","last_became_peered":"2023-05-10T01:10:39.618363+0000","last_unstale":"2023-05-10T01:10:39.621080+0000","last_undegraded":"2023-05-10T01:10:39.621080+0000","last_fullsized":"2023-05-10T01:10:39.621080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.993950+0000","last_change":"2023-05-10T01:10:39.993950+0000","last_active":"2023-05-10T01:10:39.993950+0000","last_peered":"2023-05-10T01:10:39.993950+0000","last_clean":"2023-05-10T01:10:39.993950+0000","last_became_active":"2023-05-10T01:10:39.993713+0000","last_became_peered":"2023-05-10T01:10:39.993713+0000","last_unstale":"2023-05-10T01:10:39.993950+0000","last_undegraded":"2023-05-10T01:10:39.993950+0000","last_fullsized":"2023-05-10T01:10:39.993950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619162+0000","last_change":"2023-05-10T01:10:39.613223+0000","last_active":"2023-05-10T01:10:39.619162+0000","last_peered":"2023-05-10T01:10:39.619162+0000","last_clean":"2023-05-10T01:10:39.619162+0000","last_became_active":"2023-05-10T01:10:39.612593+0000","last_became_peered":"2023-05-10T01:10:39.612593+0000","last_unstale":"2023-05-10T01:10:39.619162+0000","last_undegraded":"2023-05-10T01:10:39.619162+0000","last_fullsized":"2023-05-10T01:10:39.619162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.990587+0000","last_change":"2023-05-10T01:10:39.990587+0000","last_active":"2023-05-10T01:10:39.990587+0000","last_peered":"2023-05-10T01:10:39.990587+0000","last_clean":"2023-05-10T01:10:39.990587+0000","last_became_active":"2023-05-10T01:10:39.990133+0000","last_became_peered":"2023-05-10T01:10:39.990133+0000","last_unstale":"2023-05-10T01:10:39.990587+0000","last_undegraded":"2023-05-10T01:10:39.990587+0000","last_fullsized":"2023-05-10T01:10:39.990587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619428+0000","last_change":"2023-05-10T01:10:39.612815+0000","last_active":"2023-05-10T01:10:39.619428+0000","last_peered":"2023-05-10T01:10:39.619428+0000","last_clean":"2023-05-10T01:10:39.619428+0000","last_became_active":"2023-05-10T01:10:39.612494+0000","last_became_peered":"2023-05-10T01:10:39.612494+0000","last_unstale":"2023-05-10T01:10:39.619428+0000","last_undegraded":"2023-05-10T01:10:39.619428+0000","last_fullsized":"2023-05-10T01:10:39.619428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004909+0000","last_change":"2023-05-10T01:10:40.004909+0000","last_active":"2023-05-10T01:10:40.004909+0000","last_peered":"2023-05-10T01:10:40.004909+0000","last_clean":"2023-05-10T01:10:40.004909+0000","last_became_active":"2023-05-10T01:10:40.004141+0000","last_became_peered":"2023-05-10T01:10:40.004141+0000","last_unstale":"2023-05-10T01:10:40.004909+0000","last_undegraded":"2023-05-10T01:10:40.004909+0000","last_fullsized":"2023-05-10T01:10:40.004909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616894+0000","last_change":"2023-05-10T01:10:39.611264+0000","last_active":"2023-05-10T01:10:39.616894+0000","last_peered":"2023-05-10T01:10:39.616894+0000","last_clean":"2023-05-10T01:10:39.616894+0000","last_became_active":"2023-05-10T01:10:39.610946+0000","last_became_peered":"2023-05-10T01:10:39.610946+0000","last_unstale":"2023-05-10T01:10:39.616894+0000","last_undegraded":"2023-05-10T01:10:39.616894+0000","last_fullsized":"2023-05-10T01:10:39.616894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011048+0000","last_change":"2023-05-10T01:10:40.011048+0000","last_active":"2023-05-10T01:10:40.011048+0000","last_peered":"2023-05-10T01:10:40.011048+0000","last_clean":"2023-05-10T01:10:40.011048+0000","last_became_active":"2023-05-10T01:10:40.010727+0000","last_became_peered":"2023-05-10T01:10:40.010727+0000","last_unstale":"2023-05-10T01:10:40.011048+0000","last_undegraded":"2023-05-10T01:10:40.011048+0000","last_fullsized":"2023-05-10T01:10:40.011048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620954+0000","last_change":"2023-05-10T01:10:39.616434+0000","last_active":"2023-05-10T01:10:39.620954+0000","last_peered":"2023-05-10T01:10:39.620954+0000","last_clean":"2023-05-10T01:10:39.620954+0000","last_became_active":"2023-05-10T01:10:39.616024+0000","last_became_peered":"2023-05-10T01:10:39.616024+0000","last_unstale":"2023-05-10T01:10:39.620954+0000","last_undegraded":"2023-05-10T01:10:39.620954+0000","last_fullsized":"2023-05-10T01:10:39.620954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006109+0000","last_change":"2023-05-10T01:10:40.006109+0000","last_active":"2023-05-10T01:10:40.006109+0000","last_peered":"2023-05-10T01:10:40.006109+0000","last_clean":"2023-05-10T01:10:40.006109+0000","last_became_active":"2023-05-10T01:10:40.005808+0000","last_became_peered":"2023-05-10T01:10:40.005808+0000","last_unstale":"2023-05-10T01:10:40.006109+0000","last_undegraded":"2023-05-10T01:10:40.006109+0000","last_fullsized":"2023-05-10T01:10:40.006109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005609+0000","last_change":"2023-05-10T01:10:39.610745+0000","last_active":"2023-05-10T01:10:40.005609+0000","last_peered":"2023-05-10T01:10:40.005609+0000","last_clean":"2023-05-10T01:10:40.005609+0000","last_became_active":"2023-05-10T01:10:39.609804+0000","last_became_peered":"2023-05-10T01:10:39.609804+0000","last_unstale":"2023-05-10T01:10:40.005609+0000","last_undegraded":"2023-05-10T01:10:40.005609+0000","last_fullsized":"2023-05-10T01:10:40.005609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010320+0000","last_change":"2023-05-10T01:10:40.010320+0000","last_active":"2023-05-10T01:10:40.010320+0000","last_peered":"2023-05-10T01:10:40.010320+0000","last_clean":"2023-05-10T01:10:40.010320+0000","last_became_active":"2023-05-10T01:10:40.009945+0000","last_became_peered":"2023-05-10T01:10:40.009945+0000","last_unstale":"2023-05-10T01:10:40.010320+0000","last_undegraded":"2023-05-10T01:10:40.010320+0000","last_fullsized":"2023-05-10T01:10:40.010320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985702+0000","last_change":"2023-05-10T01:10:39.607355+0000","last_active":"2023-05-10T01:10:39.985702+0000","last_peered":"2023-05-10T01:10:39.985702+0000","last_clean":"2023-05-10T01:10:39.985702+0000","last_became_active":"2023-05-10T01:10:39.606838+0000","last_became_peered":"2023-05-10T01:10:39.606838+0000","last_unstale":"2023-05-10T01:10:39.985702+0000","last_undegraded":"2023-05-10T01:10:39.985702+0000","last_fullsized":"2023-05-10T01:10:39.985702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004832+0000","last_change":"2023-05-10T01:10:40.004832+0000","last_active":"2023-05-10T01:10:40.004832+0000","last_peered":"2023-05-10T01:10:40.004832+0000","last_clean":"2023-05-10T01:10:40.004832+0000","last_became_active":"2023-05-10T01:10:40.004524+0000","last_became_peered":"2023-05-10T01:10:40.004524+0000","last_unstale":"2023-05-10T01:10:40.004832+0000","last_undegraded":"2023-05-10T01:10:40.004832+0000","last_fullsized":"2023-05-10T01:10:40.004832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608016+0000","last_change":"2023-05-10T01:10:39.601710+0000","last_active":"2023-05-10T01:10:39.608016+0000","last_peered":"2023-05-10T01:10:39.608016+0000","last_clean":"2023-05-10T01:10:39.608016+0000","last_became_active":"2023-05-10T01:10:39.601385+0000","last_became_peered":"2023-05-10T01:10:39.601385+0000","last_unstale":"2023-05-10T01:10:39.608016+0000","last_undegraded":"2023-05-10T01:10:39.608016+0000","last_fullsized":"2023-05-10T01:10:39.608016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007430+0000","last_change":"2023-05-10T01:10:40.007430+0000","last_active":"2023-05-10T01:10:40.007430+0000","last_peered":"2023-05-10T01:10:40.007430+0000","last_clean":"2023-05-10T01:10:40.007430+0000","last_became_active":"2023-05-10T01:10:40.007171+0000","last_became_peered":"2023-05-10T01:10:40.007171+0000","last_unstale":"2023-05-10T01:10:40.007430+0000","last_undegraded":"2023-05-10T01:10:40.007430+0000","last_fullsized":"2023-05-10T01:10:40.007430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618766+0000","last_change":"2023-05-10T01:10:39.614146+0000","last_active":"2023-05-10T01:10:39.618766+0000","last_peered":"2023-05-10T01:10:39.618766+0000","last_clean":"2023-05-10T01:10:39.618766+0000","last_became_active":"2023-05-10T01:10:39.613855+0000","last_became_peered":"2023-05-10T01:10:39.613855+0000","last_unstale":"2023-05-10T01:10:39.618766+0000","last_undegraded":"2023-05-10T01:10:39.618766+0000","last_fullsized":"2023-05-10T01:10:39.618766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011808+0000","last_change":"2023-05-10T01:10:40.011808+0000","last_active":"2023-05-10T01:10:40.011808+0000","last_peered":"2023-05-10T01:10:40.011808+0000","last_clean":"2023-05-10T01:10:40.011808+0000","last_became_active":"2023-05-10T01:10:40.011384+0000","last_became_peered":"2023-05-10T01:10:40.011384+0000","last_unstale":"2023-05-10T01:10:40.011808+0000","last_undegraded":"2023-05-10T01:10:40.011808+0000","last_fullsized":"2023-05-10T01:10:40.011808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003331+0000","last_change":"2023-05-10T01:10:39.612373+0000","last_active":"2023-05-10T01:10:40.003331+0000","last_peered":"2023-05-10T01:10:40.003331+0000","last_clean":"2023-05-10T01:10:40.003331+0000","last_became_active":"2023-05-10T01:10:39.612046+0000","last_became_peered":"2023-05-10T01:10:39.612046+0000","last_unstale":"2023-05-10T01:10:40.003331+0000","last_undegraded":"2023-05-10T01:10:40.003331+0000","last_fullsized":"2023-05-10T01:10:40.003331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006902+0000","last_change":"2023-05-10T01:10:40.006902+0000","last_active":"2023-05-10T01:10:40.006902+0000","last_peered":"2023-05-10T01:10:40.006902+0000","last_clean":"2023-05-10T01:10:40.006902+0000","last_became_active":"2023-05-10T01:10:40.006622+0000","last_became_peered":"2023-05-10T01:10:40.006622+0000","last_unstale":"2023-05-10T01:10:40.006902+0000","last_undegraded":"2023-05-10T01:10:40.006902+0000","last_fullsized":"2023-05-10T01:10:40.006902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623600+0000","last_change":"2023-05-10T01:10:39.618879+0000","last_active":"2023-05-10T01:10:39.623600+0000","last_peered":"2023-05-10T01:10:39.623600+0000","last_clean":"2023-05-10T01:10:39.623600+0000","last_became_active":"2023-05-10T01:10:39.618324+0000","last_became_peered":"2023-05-10T01:10:39.618324+0000","last_unstale":"2023-05-10T01:10:39.623600+0000","last_undegraded":"2023-05-10T01:10:39.623600+0000","last_fullsized":"2023-05-10T01:10:39.623600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000238+0000","last_change":"2023-05-10T01:10:40.000238+0000","last_active":"2023-05-10T01:10:40.000238+0000","last_peered":"2023-05-10T01:10:40.000238+0000","last_clean":"2023-05-10T01:10:40.000238+0000","last_became_active":"2023-05-10T01:10:39.999959+0000","last_became_peered":"2023-05-10T01:10:39.999959+0000","last_unstale":"2023-05-10T01:10:40.000238+0000","last_undegraded":"2023-05-10T01:10:40.000238+0000","last_fullsized":"2023-05-10T01:10:40.000238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617847+0000","last_change":"2023-05-10T01:10:39.615895+0000","last_active":"2023-05-10T01:10:39.617847+0000","last_peered":"2023-05-10T01:10:39.617847+0000","last_clean":"2023-05-10T01:10:39.617847+0000","last_became_active":"2023-05-10T01:10:39.615467+0000","last_became_peered":"2023-05-10T01:10:39.615467+0000","last_unstale":"2023-05-10T01:10:39.617847+0000","last_undegraded":"2023-05-10T01:10:39.617847+0000","last_fullsized":"2023-05-10T01:10:39.617847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006939+0000","last_change":"2023-05-10T01:10:40.006939+0000","last_active":"2023-05-10T01:10:40.006939+0000","last_peered":"2023-05-10T01:10:40.006939+0000","last_clean":"2023-05-10T01:10:40.006939+0000","last_became_active":"2023-05-10T01:10:40.006185+0000","last_became_peered":"2023-05-10T01:10:40.006185+0000","last_unstale":"2023-05-10T01:10:40.006939+0000","last_undegraded":"2023-05-10T01:10:40.006939+0000","last_fullsized":"2023-05-10T01:10:40.006939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.992105+0000","last_change":"2023-05-10T01:10:39.614397+0000","last_active":"2023-05-10T01:10:39.992105+0000","last_peered":"2023-05-10T01:10:39.992105+0000","last_clean":"2023-05-10T01:10:39.992105+0000","last_became_active":"2023-05-10T01:10:39.614118+0000","last_became_peered":"2023-05-10T01:10:39.614118+0000","last_unstale":"2023-05-10T01:10:39.992105+0000","last_undegraded":"2023-05-10T01:10:39.992105+0000","last_fullsized":"2023-05-10T01:10:39.992105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010317+0000","last_change":"2023-05-10T01:10:40.010317+0000","last_active":"2023-05-10T01:10:40.010317+0000","last_peered":"2023-05-10T01:10:40.010317+0000","last_clean":"2023-05-10T01:10:40.010317+0000","last_became_active":"2023-05-10T01:10:40.010018+0000","last_became_peered":"2023-05-10T01:10:40.010018+0000","last_unstale":"2023-05-10T01:10:40.010317+0000","last_undegraded":"2023-05-10T01:10:40.010317+0000","last_fullsized":"2023-05-10T01:10:40.010317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617201+0000","last_change":"2023-05-10T01:10:39.612604+0000","last_active":"2023-05-10T01:10:39.617201+0000","last_peered":"2023-05-10T01:10:39.617201+0000","last_clean":"2023-05-10T01:10:39.617201+0000","last_became_active":"2023-05-10T01:10:39.608956+0000","last_became_peered":"2023-05-10T01:10:39.608956+0000","last_unstale":"2023-05-10T01:10:39.617201+0000","last_undegraded":"2023-05-10T01:10:39.617201+0000","last_fullsized":"2023-05-10T01:10:39.617201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.001769+0000","last_change":"2023-05-10T01:10:40.001769+0000","last_active":"2023-05-10T01:10:40.001769+0000","last_peered":"2023-05-10T01:10:40.001769+0000","last_clean":"2023-05-10T01:10:40.001769+0000","last_became_active":"2023-05-10T01:10:40.001365+0000","last_became_peered":"2023-05-10T01:10:40.001365+0000","last_unstale":"2023-05-10T01:10:40.001769+0000","last_undegraded":"2023-05-10T01:10:40.001769+0000","last_fullsized":"2023-05-10T01:10:40.001769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.989501+0000","last_change":"2023-05-10T01:10:39.602903+0000","last_active":"2023-05-10T01:10:39.989501+0000","last_peered":"2023-05-10T01:10:39.989501+0000","last_clean":"2023-05-10T01:10:39.989501+0000","last_became_active":"2023-05-10T01:10:39.602590+0000","last_became_peered":"2023-05-10T01:10:39.602590+0000","last_unstale":"2023-05-10T01:10:39.989501+0000","last_undegraded":"2023-05-10T01:10:39.989501+0000","last_fullsized":"2023-05-10T01:10:39.989501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003446+0000","last_change":"2023-05-10T01:10:40.003446+0000","last_active":"2023-05-10T01:10:40.003446+0000","last_peered":"2023-05-10T01:10:40.003446+0000","last_clean":"2023-05-10T01:10:40.003446+0000","last_became_active":"2023-05-10T01:10:40.002760+0000","last_became_peered":"2023-05-10T01:10:40.002760+0000","last_unstale":"2023-05-10T01:10:40.003446+0000","last_undegraded":"2023-05-10T01:10:40.003446+0000","last_fullsized":"2023-05-10T01:10:40.003446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615791+0000","last_change":"2023-05-10T01:10:39.607913+0000","last_active":"2023-05-10T01:10:39.615791+0000","last_peered":"2023-05-10T01:10:39.615791+0000","last_clean":"2023-05-10T01:10:39.615791+0000","last_became_active":"2023-05-10T01:10:39.607475+0000","last_became_peered":"2023-05-10T01:10:39.607475+0000","last_unstale":"2023-05-10T01:10:39.615791+0000","last_undegraded":"2023-05-10T01:10:39.615791+0000","last_fullsized":"2023-05-10T01:10:39.615791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004581+0000","last_change":"2023-05-10T01:10:40.004581+0000","last_active":"2023-05-10T01:10:40.004581+0000","last_peered":"2023-05-10T01:10:40.004581+0000","last_clean":"2023-05-10T01:10:40.004581+0000","last_became_active":"2023-05-10T01:10:40.004318+0000","last_became_peered":"2023-05-10T01:10:40.004318+0000","last_unstale":"2023-05-10T01:10:40.004581+0000","last_undegraded":"2023-05-10T01:10:40.004581+0000","last_fullsized":"2023-05-10T01:10:40.004581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616003+0000","last_change":"2023-05-10T01:10:39.613438+0000","last_active":"2023-05-10T01:10:39.616003+0000","last_peered":"2023-05-10T01:10:39.616003+0000","last_clean":"2023-05-10T01:10:39.616003+0000","last_became_active":"2023-05-10T01:10:39.613120+0000","last_became_peered":"2023-05-10T01:10:39.613120+0000","last_unstale":"2023-05-10T01:10:39.616003+0000","last_undegraded":"2023-05-10T01:10:39.616003+0000","last_fullsized":"2023-05-10T01:10:39.616003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003552+0000","last_change":"2023-05-10T01:10:40.003552+0000","last_active":"2023-05-10T01:10:40.003552+0000","last_peered":"2023-05-10T01:10:40.003552+0000","last_clean":"2023-05-10T01:10:40.003552+0000","last_became_active":"2023-05-10T01:10:40.003260+0000","last_became_peered":"2023-05-10T01:10:40.003260+0000","last_unstale":"2023-05-10T01:10:40.003552+0000","last_undegraded":"2023-05-10T01:10:40.003552+0000","last_fullsized":"2023-05-10T01:10:40.003552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615226+0000","last_change":"2023-05-10T01:10:39.609505+0000","last_active":"2023-05-10T01:10:39.615226+0000","last_peered":"2023-05-10T01:10:39.615226+0000","last_clean":"2023-05-10T01:10:39.615226+0000","last_became_active":"2023-05-10T01:10:39.609211+0000","last_became_peered":"2023-05-10T01:10:39.609211+0000","last_unstale":"2023-05-10T01:10:39.615226+0000","last_undegraded":"2023-05-10T01:10:39.615226+0000","last_fullsized":"2023-05-10T01:10:39.615226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006151+0000","last_change":"2023-05-10T01:10:40.006151+0000","last_active":"2023-05-10T01:10:40.006151+0000","last_peered":"2023-05-10T01:10:40.006151+0000","last_clean":"2023-05-10T01:10:40.006151+0000","last_became_active":"2023-05-10T01:10:40.005832+0000","last_became_peered":"2023-05-10T01:10:40.005832+0000","last_unstale":"2023-05-10T01:10:40.006151+0000","last_undegraded":"2023-05-10T01:10:40.006151+0000","last_fullsized":"2023-05-10T01:10:40.006151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614846+0000","last_change":"2023-05-10T01:10:39.612138+0000","last_active":"2023-05-10T01:10:39.614846+0000","last_peered":"2023-05-10T01:10:39.614846+0000","last_clean":"2023-05-10T01:10:39.614846+0000","last_became_active":"2023-05-10T01:10:39.611842+0000","last_became_peered":"2023-05-10T01:10:39.611842+0000","last_unstale":"2023-05-10T01:10:39.614846+0000","last_undegraded":"2023-05-10T01:10:39.614846+0000","last_fullsized":"2023-05-10T01:10:39.614846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005175+0000","last_change":"2023-05-10T01:10:40.005175+0000","last_active":"2023-05-10T01:10:40.005175+0000","last_peered":"2023-05-10T01:10:40.005175+0000","last_clean":"2023-05-10T01:10:40.005175+0000","last_became_active":"2023-05-10T01:10:40.004824+0000","last_became_peered":"2023-05-10T01:10:40.004824+0000","last_unstale":"2023-05-10T01:10:40.005175+0000","last_undegraded":"2023-05-10T01:10:40.005175+0000","last_fullsized":"2023-05-10T01:10:40.005175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.610388+0000","last_change":"2023-05-10T01:10:39.609186+0000","last_active":"2023-05-10T01:10:39.610388+0000","last_peered":"2023-05-10T01:10:39.610388+0000","last_clean":"2023-05-10T01:10:39.610388+0000","last_became_active":"2023-05-10T01:10:39.608884+0000","last_became_peered":"2023-05-10T01:10:39.608884+0000","last_unstale":"2023-05-10T01:10:39.610388+0000","last_undegraded":"2023-05-10T01:10:39.610388+0000","last_fullsized":"2023-05-10T01:10:39.610388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007766+0000","last_change":"2023-05-10T01:10:40.007766+0000","last_active":"2023-05-10T01:10:40.007766+0000","last_peered":"2023-05-10T01:10:40.007766+0000","last_clean":"2023-05-10T01:10:40.007766+0000","last_became_active":"2023-05-10T01:10:40.007357+0000","last_became_peered":"2023-05-10T01:10:40.007357+0000","last_unstale":"2023-05-10T01:10:40.007766+0000","last_undegraded":"2023-05-10T01:10:40.007766+0000","last_fullsized":"2023-05-10T01:10:40.007766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614776+0000","last_change":"2023-05-10T01:10:39.613627+0000","last_active":"2023-05-10T01:10:39.614776+0000","last_peered":"2023-05-10T01:10:39.614776+0000","last_clean":"2023-05-10T01:10:39.614776+0000","last_became_active":"2023-05-10T01:10:39.613214+0000","last_became_peered":"2023-05-10T01:10:39.613214+0000","last_unstale":"2023-05-10T01:10:39.614776+0000","last_undegraded":"2023-05-10T01:10:39.614776+0000","last_fullsized":"2023-05-10T01:10:39.614776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.009279+0000","last_change":"2023-05-10T01:10:40.009279+0000","last_active":"2023-05-10T01:10:40.009279+0000","last_peered":"2023-05-10T01:10:40.009279+0000","last_clean":"2023-05-10T01:10:40.009279+0000","last_became_active":"2023-05-10T01:10:40.009016+0000","last_became_peered":"2023-05-10T01:10:40.009016+0000","last_unstale":"2023-05-10T01:10:40.009279+0000","last_undegraded":"2023-05-10T01:10:40.009279+0000","last_fullsized":"2023-05-10T01:10:40.009279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623487+0000","last_change":"2023-05-10T01:10:39.618394+0000","last_active":"2023-05-10T01:10:39.623487+0000","last_peered":"2023-05-10T01:10:39.623487+0000","last_clean":"2023-05-10T01:10:39.623487+0000","last_became_active":"2023-05-10T01:10:39.618125+0000","last_became_peered":"2023-05-10T01:10:39.618125+0000","last_unstale":"2023-05-10T01:10:39.623487+0000","last_undegraded":"2023-05-10T01:10:39.623487+0000","last_fullsized":"2023-05-10T01:10:39.623487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000330+0000","last_change":"2023-05-10T01:10:40.000330+0000","last_active":"2023-05-10T01:10:40.000330+0000","last_peered":"2023-05-10T01:10:40.000330+0000","last_clean":"2023-05-10T01:10:40.000330+0000","last_became_active":"2023-05-10T01:10:39.999978+0000","last_became_peered":"2023-05-10T01:10:39.999978+0000","last_unstale":"2023-05-10T01:10:40.000330+0000","last_undegraded":"2023-05-10T01:10:40.000330+0000","last_fullsized":"2023-05-10T01:10:40.000330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615233+0000","last_change":"2023-05-10T01:10:39.607266+0000","last_active":"2023-05-10T01:10:39.615233+0000","last_peered":"2023-05-10T01:10:39.615233+0000","last_clean":"2023-05-10T01:10:39.615233+0000","last_became_active":"2023-05-10T01:10:39.606949+0000","last_became_peered":"2023-05-10T01:10:39.606949+0000","last_unstale":"2023-05-10T01:10:39.615233+0000","last_undegraded":"2023-05-10T01:10:39.615233+0000","last_fullsized":"2023-05-10T01:10:39.615233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.002561+0000","last_change":"2023-05-10T01:10:40.002561+0000","last_active":"2023-05-10T01:10:40.002561+0000","last_peered":"2023-05-10T01:10:40.002561+0000","last_clean":"2023-05-10T01:10:40.002561+0000","last_became_active":"2023-05-10T01:10:40.002205+0000","last_became_peered":"2023-05-10T01:10:40.002205+0000","last_unstale":"2023-05-10T01:10:40.002561+0000","last_undegraded":"2023-05-10T01:10:40.002561+0000","last_fullsized":"2023-05-10T01:10:40.002561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623649+0000","last_change":"2023-05-10T01:10:39.618905+0000","last_active":"2023-05-10T01:10:39.623649+0000","last_peered":"2023-05-10T01:10:39.623649+0000","last_clean":"2023-05-10T01:10:39.623649+0000","last_became_active":"2023-05-10T01:10:39.618636+0000","last_became_peered":"2023-05-10T01:10:39.618636+0000","last_unstale":"2023-05-10T01:10:39.623649+0000","last_undegraded":"2023-05-10T01:10:39.623649+0000","last_fullsized":"2023-05-10T01:10:39.623649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005764+0000","last_change":"2023-05-10T01:10:40.005764+0000","last_active":"2023-05-10T01:10:40.005764+0000","last_peered":"2023-05-10T01:10:40.005764+0000","last_clean":"2023-05-10T01:10:40.005764+0000","last_became_active":"2023-05-10T01:10:40.005423+0000","last_became_peered":"2023-05-10T01:10:40.005423+0000","last_unstale":"2023-05-10T01:10:40.005764+0000","last_undegraded":"2023-05-10T01:10:40.005764+0000","last_fullsized":"2023-05-10T01:10:40.005764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617777+0000","last_change":"2023-05-10T01:10:39.610015+0000","last_active":"2023-05-10T01:10:39.617777+0000","last_peered":"2023-05-10T01:10:39.617777+0000","last_clean":"2023-05-10T01:10:39.617777+0000","last_became_active":"2023-05-10T01:10:39.608014+0000","last_became_peered":"2023-05-10T01:10:39.608014+0000","last_unstale":"2023-05-10T01:10:39.617777+0000","last_undegraded":"2023-05-10T01:10:39.617777+0000","last_fullsized":"2023-05-10T01:10:39.617777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006967+0000","last_change":"2023-05-10T01:10:40.006967+0000","last_active":"2023-05-10T01:10:40.006967+0000","last_peered":"2023-05-10T01:10:40.006967+0000","last_clean":"2023-05-10T01:10:40.006967+0000","last_became_active":"2023-05-10T01:10:40.006634+0000","last_became_peered":"2023-05-10T01:10:40.006634+0000","last_unstale":"2023-05-10T01:10:40.006967+0000","last_undegraded":"2023-05-10T01:10:40.006967+0000","last_fullsized":"2023-05-10T01:10:40.006967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621005+0000","last_change":"2023-05-10T01:10:39.616775+0000","last_active":"2023-05-10T01:10:39.621005+0000","last_peered":"2023-05-10T01:10:39.621005+0000","last_clean":"2023-05-10T01:10:39.621005+0000","last_became_active":"2023-05-10T01:10:39.616121+0000","last_became_peered":"2023-05-10T01:10:39.616121+0000","last_unstale":"2023-05-10T01:10:39.621005+0000","last_undegraded":"2023-05-10T01:10:39.621005+0000","last_fullsized":"2023-05-10T01:10:39.621005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010384+0000","last_change":"2023-05-10T01:10:40.010384+0000","last_active":"2023-05-10T01:10:40.010384+0000","last_peered":"2023-05-10T01:10:40.010384+0000","last_clean":"2023-05-10T01:10:40.010384+0000","last_became_active":"2023-05-10T01:10:40.010063+0000","last_became_peered":"2023-05-10T01:10:40.010063+0000","last_unstale":"2023-05-10T01:10:40.010384+0000","last_undegraded":"2023-05-10T01:10:40.010384+0000","last_fullsized":"2023-05-10T01:10:40.010384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.002106+0000","last_change":"2023-05-10T01:10:39.610678+0000","last_active":"2023-05-10T01:10:40.002106+0000","last_peered":"2023-05-10T01:10:40.002106+0000","last_clean":"2023-05-10T01:10:40.002106+0000","last_became_active":"2023-05-10T01:10:39.610379+0000","last_became_peered":"2023-05-10T01:10:39.610379+0000","last_unstale":"2023-05-10T01:10:40.002106+0000","last_undegraded":"2023-05-10T01:10:40.002106+0000","last_fullsized":"2023-05-10T01:10:40.002106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007673+0000","last_change":"2023-05-10T01:10:40.007673+0000","last_active":"2023-05-10T01:10:40.007673+0000","last_peered":"2023-05-10T01:10:40.007673+0000","last_clean":"2023-05-10T01:10:40.007673+0000","last_became_active":"2023-05-10T01:10:40.007250+0000","last_became_peered":"2023-05-10T01:10:40.007250+0000","last_unstale":"2023-05-10T01:10:40.007673+0000","last_undegraded":"2023-05-10T01:10:40.007673+0000","last_fullsized":"2023-05-10T01:10:40.007673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.982317+0000","last_change":"2023-05-10T01:10:39.609089+0000","last_active":"2023-05-10T01:10:39.982317+0000","last_peered":"2023-05-10T01:10:39.982317+0000","last_clean":"2023-05-10T01:10:39.982317+0000","last_became_active":"2023-05-10T01:10:39.608796+0000","last_became_peered":"2023-05-10T01:10:39.608796+0000","last_unstale":"2023-05-10T01:10:39.982317+0000","last_undegraded":"2023-05-10T01:10:39.982317+0000","last_fullsized":"2023-05-10T01:10:39.982317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010330+0000","last_change":"2023-05-10T01:10:40.010330+0000","last_active":"2023-05-10T01:10:40.010330+0000","last_peered":"2023-05-10T01:10:40.010330+0000","last_clean":"2023-05-10T01:10:40.010330+0000","last_became_active":"2023-05-10T01:10:40.009933+0000","last_became_peered":"2023-05-10T01:10:40.009933+0000","last_unstale":"2023-05-10T01:10:40.010330+0000","last_undegraded":"2023-05-10T01:10:40.010330+0000","last_fullsized":"2023-05-10T01:10:40.010330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003941+0000","last_change":"2023-05-10T01:10:39.613626+0000","last_active":"2023-05-10T01:10:40.003941+0000","last_peered":"2023-05-10T01:10:40.003941+0000","last_clean":"2023-05-10T01:10:40.003941+0000","last_became_active":"2023-05-10T01:10:39.613263+0000","last_became_peered":"2023-05-10T01:10:39.613263+0000","last_unstale":"2023-05-10T01:10:40.003941+0000","last_undegraded":"2023-05-10T01:10:40.003941+0000","last_fullsized":"2023-05-10T01:10:40.003941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011917+0000","last_change":"2023-05-10T01:10:40.011917+0000","last_active":"2023-05-10T01:10:40.011917+0000","last_peered":"2023-05-10T01:10:40.011917+0000","last_clean":"2023-05-10T01:10:40.011917+0000","last_became_active":"2023-05-10T01:10:40.011658+0000","last_became_peered":"2023-05-10T01:10:40.011658+0000","last_unstale":"2023-05-10T01:10:40.011917+0000","last_undegraded":"2023-05-10T01:10:40.011917+0000","last_fullsized":"2023-05-10T01:10:40.011917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.612398+0000","last_change":"2023-05-10T01:10:39.606677+0000","last_active":"2023-05-10T01:10:39.612398+0000","last_peered":"2023-05-10T01:10:39.612398+0000","last_clean":"2023-05-10T01:10:39.612398+0000","last_became_active":"2023-05-10T01:10:39.606347+0000","last_became_peered":"2023-05-10T01:10:39.606347+0000","last_unstale":"2023-05-10T01:10:39.612398+0000","last_undegraded":"2023-05-10T01:10:39.612398+0000","last_fullsized":"2023-05-10T01:10:39.612398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994402+0000","last_change":"2023-05-10T01:10:39.994402+0000","last_active":"2023-05-10T01:10:39.994402+0000","last_peered":"2023-05-10T01:10:39.994402+0000","last_clean":"2023-05-10T01:10:39.994402+0000","last_became_active":"2023-05-10T01:10:39.994232+0000","last_became_peered":"2023-05-10T01:10:39.994232+0000","last_unstale":"2023-05-10T01:10:39.994402+0000","last_undegraded":"2023-05-10T01:10:39.994402+0000","last_fullsized":"2023-05-10T01:10:39.994402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620771+0000","last_change":"2023-05-10T01:10:39.615482+0000","last_active":"2023-05-10T01:10:39.620771+0000","last_peered":"2023-05-10T01:10:39.620771+0000","last_clean":"2023-05-10T01:10:39.620771+0000","last_became_active":"2023-05-10T01:10:39.615262+0000","last_became_peered":"2023-05-10T01:10:39.615262+0000","last_unstale":"2023-05-10T01:10:39.620771+0000","last_undegraded":"2023-05-10T01:10:39.620771+0000","last_fullsized":"2023-05-10T01:10:39.620771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004360+0000","last_change":"2023-05-10T01:10:40.004360+0000","last_active":"2023-05-10T01:10:40.004360+0000","last_peered":"2023-05-10T01:10:40.004360+0000","last_clean":"2023-05-10T01:10:40.004360+0000","last_became_active":"2023-05-10T01:10:40.003933+0000","last_became_peered":"2023-05-10T01:10:40.003933+0000","last_unstale":"2023-05-10T01:10:40.004360+0000","last_undegraded":"2023-05-10T01:10:40.004360+0000","last_fullsized":"2023-05-10T01:10:40.004360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620959+0000","last_change":"2023-05-10T01:10:39.616531+0000","last_active":"2023-05-10T01:10:39.620959+0000","last_peered":"2023-05-10T01:10:39.620959+0000","last_clean":"2023-05-10T01:10:39.620959+0000","last_became_active":"2023-05-10T01:10:39.616220+0000","last_became_peered":"2023-05-10T01:10:39.616220+0000","last_unstale":"2023-05-10T01:10:39.620959+0000","last_undegraded":"2023-05-10T01:10:39.620959+0000","last_fullsized":"2023-05-10T01:10:39.620959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006375+0000","last_change":"2023-05-10T01:10:40.006375+0000","last_active":"2023-05-10T01:10:40.006375+0000","last_peered":"2023-05-10T01:10:40.006375+0000","last_clean":"2023-05-10T01:10:40.006375+0000","last_became_active":"2023-05-10T01:10:40.006111+0000","last_became_peered":"2023-05-10T01:10:40.006111+0000","last_unstale":"2023-05-10T01:10:40.006375+0000","last_undegraded":"2023-05-10T01:10:40.006375+0000","last_fullsized":"2023-05-10T01:10:40.006375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.613943+0000","last_change":"2023-05-10T01:10:39.610025+0000","last_active":"2023-05-10T01:10:39.613943+0000","last_peered":"2023-05-10T01:10:39.613943+0000","last_clean":"2023-05-10T01:10:39.613943+0000","last_became_active":"2023-05-10T01:10:39.609773+0000","last_became_peered":"2023-05-10T01:10:39.609773+0000","last_unstale":"2023-05-10T01:10:39.613943+0000","last_undegraded":"2023-05-10T01:10:39.613943+0000","last_fullsized":"2023-05-10T01:10:39.613943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004528+0000","last_change":"2023-05-10T01:10:40.004528+0000","last_active":"2023-05-10T01:10:40.004528+0000","last_peered":"2023-05-10T01:10:40.004528+0000","last_clean":"2023-05-10T01:10:40.004528+0000","last_became_active":"2023-05-10T01:10:40.004122+0000","last_became_peered":"2023-05-10T01:10:40.004122+0000","last_unstale":"2023-05-10T01:10:40.004528+0000","last_undegraded":"2023-05-10T01:10:40.004528+0000","last_fullsized":"2023-05-10T01:10:40.004528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619374+0000","last_change":"2023-05-10T01:10:39.613386+0000","last_active":"2023-05-10T01:10:39.619374+0000","last_peered":"2023-05-10T01:10:39.619374+0000","last_clean":"2023-05-10T01:10:39.619374+0000","last_became_active":"2023-05-10T01:10:39.613094+0000","last_became_peered":"2023-05-10T01:10:39.613094+0000","last_unstale":"2023-05-10T01:10:39.619374+0000","last_undegraded":"2023-05-10T01:10:39.619374+0000","last_fullsized":"2023-05-10T01:10:39.619374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994741+0000","last_change":"2023-05-10T01:10:39.994741+0000","last_active":"2023-05-10T01:10:39.994741+0000","last_peered":"2023-05-10T01:10:39.994741+0000","last_clean":"2023-05-10T01:10:39.994741+0000","last_became_active":"2023-05-10T01:10:39.993662+0000","last_became_peered":"2023-05-10T01:10:39.993662+0000","last_unstale":"2023-05-10T01:10:39.994741+0000","last_undegraded":"2023-05-10T01:10:39.994741+0000","last_fullsized":"2023-05-10T01:10:39.994741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608294+0000","last_change":"2023-05-10T01:10:39.605063+0000","last_active":"2023-05-10T01:10:39.608294+0000","last_peered":"2023-05-10T01:10:39.608294+0000","last_clean":"2023-05-10T01:10:39.608294+0000","last_became_active":"2023-05-10T01:10:39.604783+0000","last_became_peered":"2023-05-10T01:10:39.604783+0000","last_unstale":"2023-05-10T01:10:39.608294+0000","last_undegraded":"2023-05-10T01:10:39.608294+0000","last_fullsized":"2023-05-10T01:10:39.608294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.012597+0000","last_change":"2023-05-10T01:10:40.012597+0000","last_active":"2023-05-10T01:10:40.012597+0000","last_peered":"2023-05-10T01:10:40.012597+0000","last_clean":"2023-05-10T01:10:40.012597+0000","last_became_active":"2023-05-10T01:10:40.012284+0000","last_became_peered":"2023-05-10T01:10:40.012284+0000","last_unstale":"2023-05-10T01:10:40.012597+0000","last_undegraded":"2023-05-10T01:10:40.012597+0000","last_fullsized":"2023-05-10T01:10:40.012597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615598+0000","last_change":"2023-05-10T01:10:39.609866+0000","last_active":"2023-05-10T01:10:39.615598+0000","last_peered":"2023-05-10T01:10:39.615598+0000","last_clean":"2023-05-10T01:10:39.615598+0000","last_became_active":"2023-05-10T01:10:39.609572+0000","last_became_peered":"2023-05-10T01:10:39.609572+0000","last_unstale":"2023-05-10T01:10:39.615598+0000","last_undegraded":"2023-05-10T01:10:39.615598+0000","last_fullsized":"2023-05-10T01:10:39.615598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003675+0000","last_change":"2023-05-10T01:10:40.003675+0000","last_active":"2023-05-10T01:10:40.003675+0000","last_peered":"2023-05-10T01:10:40.003675+0000","last_clean":"2023-05-10T01:10:40.003675+0000","last_became_active":"2023-05-10T01:10:40.003403+0000","last_became_peered":"2023-05-10T01:10:40.003403+0000","last_unstale":"2023-05-10T01:10:40.003675+0000","last_undegraded":"2023-05-10T01:10:40.003675+0000","last_fullsized":"2023-05-10T01:10:40.003675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005724+0000","last_change":"2023-05-10T01:10:39.614397+0000","last_active":"2023-05-10T01:10:40.005724+0000","last_peered":"2023-05-10T01:10:40.005724+0000","last_clean":"2023-05-10T01:10:40.005724+0000","last_became_active":"2023-05-10T01:10:39.614114+0000","last_became_peered":"2023-05-10T01:10:39.614114+0000","last_unstale":"2023-05-10T01:10:40.005724+0000","last_undegraded":"2023-05-10T01:10:40.005724+0000","last_fullsized":"2023-05-10T01:10:40.005724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.993084+0000","last_change":"2023-05-10T01:10:39.993084+0000","last_active":"2023-05-10T01:10:39.993084+0000","last_peered":"2023-05-10T01:10:39.993084+0000","last_clean":"2023-05-10T01:10:39.993084+0000","last_became_active":"2023-05-10T01:10:39.992770+0000","last_became_peered":"2023-05-10T01:10:39.992770+0000","last_unstale":"2023-05-10T01:10:39.993084+0000","last_undegraded":"2023-05-10T01:10:39.993084+0000","last_fullsized":"2023-05-10T01:10:39.993084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003432+0000","last_change":"2023-05-10T01:10:39.612192+0000","last_active":"2023-05-10T01:10:40.003432+0000","last_peered":"2023-05-10T01:10:40.003432+0000","last_clean":"2023-05-10T01:10:40.003432+0000","last_became_active":"2023-05-10T01:10:39.611914+0000","last_became_peered":"2023-05-10T01:10:39.611914+0000","last_unstale":"2023-05-10T01:10:40.003432+0000","last_undegraded":"2023-05-10T01:10:40.003432+0000","last_fullsized":"2023-05-10T01:10:40.003432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006210+0000","last_change":"2023-05-10T01:10:40.006210+0000","last_active":"2023-05-10T01:10:40.006210+0000","last_peered":"2023-05-10T01:10:40.006210+0000","last_clean":"2023-05-10T01:10:40.006210+0000","last_became_active":"2023-05-10T01:10:40.005921+0000","last_became_peered":"2023-05-10T01:10:40.005921+0000","last_unstale":"2023-05-10T01:10:40.006210+0000","last_undegraded":"2023-05-10T01:10:40.006210+0000","last_fullsized":"2023-05-10T01:10:40.006210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.991111+0000","last_change":"2023-05-10T01:10:39.606045+0000","last_active":"2023-05-10T01:10:39.991111+0000","last_peered":"2023-05-10T01:10:39.991111+0000","last_clean":"2023-05-10T01:10:39.991111+0000","last_became_active":"2023-05-10T01:10:39.605704+0000","last_became_peered":"2023-05-10T01:10:39.605704+0000","last_unstale":"2023-05-10T01:10:39.991111+0000","last_undegraded":"2023-05-10T01:10:39.991111+0000","last_fullsized":"2023-05-10T01:10:39.991111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997244+0000","last_change":"2023-05-10T01:10:39.997244+0000","last_active":"2023-05-10T01:10:39.997244+0000","last_peered":"2023-05-10T01:10:39.997244+0000","last_clean":"2023-05-10T01:10:39.997244+0000","last_became_active":"2023-05-10T01:10:39.996995+0000","last_became_peered":"2023-05-10T01:10:39.996995+0000","last_unstale":"2023-05-10T01:10:39.997244+0000","last_undegraded":"2023-05-10T01:10:39.997244+0000","last_fullsized":"2023-05-10T01:10:39.997244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616383+0000","last_change":"2023-05-10T01:10:39.613836+0000","last_active":"2023-05-10T01:10:39.616383+0000","last_peered":"2023-05-10T01:10:39.616383+0000","last_clean":"2023-05-10T01:10:39.616383+0000","last_became_active":"2023-05-10T01:10:39.612818+0000","last_became_peered":"2023-05-10T01:10:39.612818+0000","last_unstale":"2023-05-10T01:10:39.616383+0000","last_undegraded":"2023-05-10T01:10:39.616383+0000","last_fullsized":"2023-05-10T01:10:39.616383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000815+0000","last_change":"2023-05-10T01:10:40.000815+0000","last_active":"2023-05-10T01:10:40.000815+0000","last_peered":"2023-05-10T01:10:40.000815+0000","last_clean":"2023-05-10T01:10:40.000815+0000","last_became_active":"2023-05-10T01:10:40.000489+0000","last_became_peered":"2023-05-10T01:10:40.000489+0000","last_unstale":"2023-05-10T01:10:40.000815+0000","last_undegraded":"2023-05-10T01:10:40.000815+0000","last_fullsized":"2023-05-10T01:10:40.000815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618241+0000","last_change":"2023-05-10T01:10:39.613392+0000","last_active":"2023-05-10T01:10:39.618241+0000","last_peered":"2023-05-10T01:10:39.618241+0000","last_clean":"2023-05-10T01:10:39.618241+0000","last_became_active":"2023-05-10T01:10:39.613120+0000","last_became_peered":"2023-05-10T01:10:39.613120+0000","last_unstale":"2023-05-10T01:10:39.618241+0000","last_undegraded":"2023-05-10T01:10:39.618241+0000","last_fullsized":"2023-05-10T01:10:39.618241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997139+0000","last_change":"2023-05-10T01:10:39.997139+0000","last_active":"2023-05-10T01:10:39.997139+0000","last_peered":"2023-05-10T01:10:39.997139+0000","last_clean":"2023-05-10T01:10:39.997139+0000","last_became_active":"2023-05-10T01:10:39.996940+0000","last_became_peered":"2023-05-10T01:10:39.996940+0000","last_unstale":"2023-05-10T01:10:39.997139+0000","last_undegraded":"2023-05-10T01:10:39.997139+0000","last_fullsized":"2023-05-10T01:10:39.997139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003804+0000","last_change":"2023-05-10T01:10:39.616938+0000","last_active":"2023-05-10T01:10:40.003804+0000","last_peered":"2023-05-10T01:10:40.003804+0000","last_clean":"2023-05-10T01:10:40.003804+0000","last_became_active":"2023-05-10T01:10:39.616515+0000","last_became_peered":"2023-05-10T01:10:39.616515+0000","last_unstale":"2023-05-10T01:10:40.003804+0000","last_undegraded":"2023-05-10T01:10:40.003804+0000","last_fullsized":"2023-05-10T01:10:40.003804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005777+0000","last_change":"2023-05-10T01:10:40.005777+0000","last_active":"2023-05-10T01:10:40.005777+0000","last_peered":"2023-05-10T01:10:40.005777+0000","last_clean":"2023-05-10T01:10:40.005777+0000","last_became_active":"2023-05-10T01:10:40.005477+0000","last_became_peered":"2023-05-10T01:10:40.005477+0000","last_unstale":"2023-05-10T01:10:40.005777+0000","last_undegraded":"2023-05-10T01:10:40.005777+0000","last_fullsized":"2023-05-10T01:10:40.005777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000300+0000","last_change":"2023-05-10T01:10:39.610244+0000","last_active":"2023-05-10T01:10:40.000300+0000","last_peered":"2023-05-10T01:10:40.000300+0000","last_clean":"2023-05-10T01:10:40.000300+0000","last_became_active":"2023-05-10T01:10:39.609978+0000","last_became_peered":"2023-05-10T01:10:39.609978+0000","last_unstale":"2023-05-10T01:10:40.000300+0000","last_undegraded":"2023-05-10T01:10:40.000300+0000","last_fullsized":"2023-05-10T01:10:40.000300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005085+0000","last_change":"2023-05-10T01:10:40.005085+0000","last_active":"2023-05-10T01:10:40.005085+0000","last_peered":"2023-05-10T01:10:40.005085+0000","last_clean":"2023-05-10T01:10:40.005085+0000","last_became_active":"2023-05-10T01:10:40.004622+0000","last_became_peered":"2023-05-10T01:10:40.004622+0000","last_unstale":"2023-05-10T01:10:40.005085+0000","last_undegraded":"2023-05-10T01:10:40.005085+0000","last_fullsized":"2023-05-10T01:10:40.005085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.998692+0000","last_change":"2023-05-10T01:10:39.609163+0000","last_active":"2023-05-10T01:10:39.998692+0000","last_peered":"2023-05-10T01:10:39.998692+0000","last_clean":"2023-05-10T01:10:39.998692+0000","last_became_active":"2023-05-10T01:10:39.608857+0000","last_became_peered":"2023-05-10T01:10:39.608857+0000","last_unstale":"2023-05-10T01:10:39.998692+0000","last_undegraded":"2023-05-10T01:10:39.998692+0000","last_fullsized":"2023-05-10T01:10:39.998692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004331+0000","last_change":"2023-05-10T01:10:40.004331+0000","last_active":"2023-05-10T01:10:40.004331+0000","last_peered":"2023-05-10T01:10:40.004331+0000","last_clean":"2023-05-10T01:10:40.004331+0000","last_became_active":"2023-05-10T01:10:40.004062+0000","last_became_peered":"2023-05-10T01:10:40.004062+0000","last_unstale":"2023-05-10T01:10:40.004331+0000","last_undegraded":"2023-05-10T01:10:40.004331+0000","last_fullsized":"2023-05-10T01:10:40.004331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617183+0000","last_change":"2023-05-10T01:10:39.611890+0000","last_active":"2023-05-10T01:10:39.617183+0000","last_peered":"2023-05-10T01:10:39.617183+0000","last_clean":"2023-05-10T01:10:39.617183+0000","last_became_active":"2023-05-10T01:10:39.611591+0000","last_became_peered":"2023-05-10T01:10:39.611591+0000","last_unstale":"2023-05-10T01:10:39.617183+0000","last_undegraded":"2023-05-10T01:10:39.617183+0000","last_fullsized":"2023-05-10T01:10:39.617183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997087+0000","last_change":"2023-05-10T01:10:39.997087+0000","last_active":"2023-05-10T01:10:39.997087+0000","last_peered":"2023-05-10T01:10:39.997087+0000","last_clean":"2023-05-10T01:10:39.997087+0000","last_became_active":"2023-05-10T01:10:39.996788+0000","last_became_peered":"2023-05-10T01:10:39.996788+0000","last_unstale":"2023-05-10T01:10:39.997087+0000","last_undegraded":"2023-05-10T01:10:39.997087+0000","last_fullsized":"2023-05-10T01:10:39.997087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614816+0000","last_change":"2023-05-10T01:10:39.612911+0000","last_active":"2023-05-10T01:10:39.614816+0000","last_peered":"2023-05-10T01:10:39.614816+0000","last_clean":"2023-05-10T01:10:39.614816+0000","last_became_active":"2023-05-10T01:10:39.612427+0000","last_became_peered":"2023-05-10T01:10:39.612427+0000","last_unstale":"2023-05-10T01:10:39.614816+0000","last_undegraded":"2023-05-10T01:10:39.614816+0000","last_fullsized":"2023-05-10T01:10:39.614816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000819+0000","last_change":"2023-05-10T01:10:40.000819+0000","last_active":"2023-05-10T01:10:40.000819+0000","last_peered":"2023-05-10T01:10:40.000819+0000","last_clean":"2023-05-10T01:10:40.000819+0000","last_became_active":"2023-05-10T01:10:40.000534+0000","last_became_peered":"2023-05-10T01:10:40.000534+0000","last_unstale":"2023-05-10T01:10:40.000819+0000","last_undegraded":"2023-05-10T01:10:40.000819+0000","last_fullsized":"2023-05-10T01:10:40.000819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985807+0000","last_change":"2023-05-10T01:10:39.607141+0000","last_active":"2023-05-10T01:10:39.985807+0000","last_peered":"2023-05-10T01:10:39.985807+0000","last_clean":"2023-05-10T01:10:39.985807+0000","last_became_active":"2023-05-10T01:10:39.606490+0000","last_became_peered":"2023-05-10T01:10:39.606490+0000","last_unstale":"2023-05-10T01:10:39.985807+0000","last_undegraded":"2023-05-10T01:10:39.985807+0000","last_fullsized":"2023-05-10T01:10:39.985807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.991854+0000","last_change":"2023-05-10T01:10:39.991854+0000","last_active":"2023-05-10T01:10:39.991854+0000","last_peered":"2023-05-10T01:10:39.991854+0000","last_clean":"2023-05-10T01:10:39.991854+0000","last_became_active":"2023-05-10T01:10:39.991588+0000","last_became_peered":"2023-05-10T01:10:39.991588+0000","last_unstale":"2023-05-10T01:10:39.991854+0000","last_undegraded":"2023-05-10T01:10:39.991854+0000","last_fullsized":"2023-05-10T01:10:39.991854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617063+0000","last_change":"2023-05-10T01:10:39.611313+0000","last_active":"2023-05-10T01:10:39.617063+0000","last_peered":"2023-05-10T01:10:39.617063+0000","last_clean":"2023-05-10T01:10:39.617063+0000","last_became_active":"2023-05-10T01:10:39.611011+0000","last_became_peered":"2023-05-10T01:10:39.611011+0000","last_unstale":"2023-05-10T01:10:39.617063+0000","last_undegraded":"2023-05-10T01:10:39.617063+0000","last_fullsized":"2023-05-10T01:10:39.617063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007618+0000","last_change":"2023-05-10T01:10:40.007618+0000","last_active":"2023-05-10T01:10:40.007618+0000","last_peered":"2023-05-10T01:10:40.007618+0000","last_clean":"2023-05-10T01:10:40.007618+0000","last_became_active":"2023-05-10T01:10:40.007279+0000","last_became_peered":"2023-05-10T01:10:40.007279+0000","last_unstale":"2023-05-10T01:10:40.007618+0000","last_undegraded":"2023-05-10T01:10:40.007618+0000","last_fullsized":"2023-05-10T01:10:40.007618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621092+0000","last_change":"2023-05-10T01:10:39.618677+0000","last_active":"2023-05-10T01:10:39.621092+0000","last_peered":"2023-05-10T01:10:39.621092+0000","last_clean":"2023-05-10T01:10:39.621092+0000","last_became_active":"2023-05-10T01:10:39.618381+0000","last_became_peered":"2023-05-10T01:10:39.618381+0000","last_unstale":"2023-05-10T01:10:39.621092+0000","last_undegraded":"2023-05-10T01:10:39.621092+0000","last_fullsized":"2023-05-10T01:10:39.621092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004373+0000","last_change":"2023-05-10T01:10:40.004373+0000","last_active":"2023-05-10T01:10:40.004373+0000","last_peered":"2023-05-10T01:10:40.004373+0000","last_clean":"2023-05-10T01:10:40.004373+0000","last_became_active":"2023-05-10T01:10:40.003784+0000","last_became_peered":"2023-05-10T01:10:40.003784+0000","last_unstale":"2023-05-10T01:10:40.004373+0000","last_undegraded":"2023-05-10T01:10:40.004373+0000","last_fullsized":"2023-05-10T01:10:40.004373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616973+0000","last_change":"2023-05-10T01:10:39.608018+0000","last_active":"2023-05-10T01:10:39.616973+0000","last_peered":"2023-05-10T01:10:39.616973+0000","last_clean":"2023-05-10T01:10:39.616973+0000","last_became_active":"2023-05-10T01:10:39.607424+0000","last_became_peered":"2023-05-10T01:10:39.607424+0000","last_unstale":"2023-05-10T01:10:39.616973+0000","last_undegraded":"2023-05-10T01:10:39.616973+0000","last_fullsized":"2023-05-10T01:10:39.616973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.996040+0000","last_change":"2023-05-10T01:10:39.996040+0000","last_active":"2023-05-10T01:10:39.996040+0000","last_peered":"2023-05-10T01:10:39.996040+0000","last_clean":"2023-05-10T01:10:39.996040+0000","last_became_active":"2023-05-10T01:10:39.995768+0000","last_became_peered":"2023-05-10T01:10:39.995768+0000","last_unstale":"2023-05-10T01:10:39.996040+0000","last_undegraded":"2023-05-10T01:10:39.996040+0000","last_fullsized":"2023-05-10T01:10:39.996040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616092+0000","last_change":"2023-05-10T01:10:39.614592+0000","last_active":"2023-05-10T01:10:39.616092+0000","last_peered":"2023-05-10T01:10:39.616092+0000","last_clean":"2023-05-10T01:10:39.616092+0000","last_became_active":"2023-05-10T01:10:39.614211+0000","last_became_peered":"2023-05-10T01:10:39.614211+0000","last_unstale":"2023-05-10T01:10:39.616092+0000","last_undegraded":"2023-05-10T01:10:39.616092+0000","last_fullsized":"2023-05-10T01:10:39.616092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.602916+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:10:39.602916+0000","last_peered":"2023-05-10T01:10:39.602916+0000","last_clean":"2023-05-10T01:10:39.602916+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:10:39.602916+0000","last_undegraded":"2023-05-10T01:10:39.602916+0000","last_fullsized":"2023-05-10T01:10:39.602916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999727+0000","last_change":"2023-05-10T01:10:39.999727+0000","last_active":"2023-05-10T01:10:39.999727+0000","last_peered":"2023-05-10T01:10:39.999727+0000","last_clean":"2023-05-10T01:10:39.999727+0000","last_became_active":"2023-05-10T01:10:39.999469+0000","last_became_peered":"2023-05-10T01:10:39.999469+0000","last_unstale":"2023-05-10T01:10:39.999727+0000","last_undegraded":"2023-05-10T01:10:39.999727+0000","last_fullsized":"2023-05-10T01:10:39.999727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618456+0000","last_change":"2023-05-10T01:10:39.617346+0000","last_active":"2023-05-10T01:10:39.618456+0000","last_peered":"2023-05-10T01:10:39.618456+0000","last_clean":"2023-05-10T01:10:39.618456+0000","last_became_active":"2023-05-10T01:10:39.617028+0000","last_became_peered":"2023-05-10T01:10:39.617028+0000","last_unstale":"2023-05-10T01:10:39.618456+0000","last_undegraded":"2023-05-10T01:10:39.618456+0000","last_fullsized":"2023-05-10T01:10:39.618456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.605279+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:10:39.605279+0000","last_peered":"2023-05-10T01:10:39.605279+0000","last_clean":"2023-05-10T01:10:39.605279+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:10:39.605279+0000","last_undegraded":"2023-05-10T01:10:39.605279+0000","last_fullsized":"2023-05-10T01:10:39.605279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010669+0000","last_change":"2023-05-10T01:10:40.010669+0000","last_active":"2023-05-10T01:10:40.010669+0000","last_peered":"2023-05-10T01:10:40.010669+0000","last_clean":"2023-05-10T01:10:40.010669+0000","last_became_active":"2023-05-10T01:10:40.010414+0000","last_became_peered":"2023-05-10T01:10:40.010414+0000","last_unstale":"2023-05-10T01:10:40.010669+0000","last_undegraded":"2023-05-10T01:10:40.010669+0000","last_fullsized":"2023-05-10T01:10:40.010669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617105+0000","last_change":"2023-05-10T01:10:39.610227+0000","last_active":"2023-05-10T01:10:39.617105+0000","last_peered":"2023-05-10T01:10:39.617105+0000","last_clean":"2023-05-10T01:10:39.617105+0000","last_became_active":"2023-05-10T01:10:39.609687+0000","last_became_peered":"2023-05-10T01:10:39.609687+0000","last_unstale":"2023-05-10T01:10:39.617105+0000","last_undegraded":"2023-05-10T01:10:39.617105+0000","last_fullsized":"2023-05-10T01:10:39.617105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.595563+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:10:39.595563+0000","last_peered":"2023-05-10T01:10:39.595563+0000","last_clean":"2023-05-10T01:10:39.595563+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:10:39.595563+0000","last_undegraded":"2023-05-10T01:10:39.595563+0000","last_fullsized":"2023-05-10T01:10:39.595563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004630+0000","last_change":"2023-05-10T01:10:40.004630+0000","last_active":"2023-05-10T01:10:40.004630+0000","last_peered":"2023-05-10T01:10:40.004630+0000","last_clean":"2023-05-10T01:10:40.004630+0000","last_became_active":"2023-05-10T01:10:40.004365+0000","last_became_peered":"2023-05-10T01:10:40.004365+0000","last_unstale":"2023-05-10T01:10:40.004630+0000","last_undegraded":"2023-05-10T01:10:40.004630+0000","last_fullsized":"2023-05-10T01:10:40.004630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621067+0000","last_change":"2023-05-10T01:10:39.618560+0000","last_active":"2023-05-10T01:10:39.621067+0000","last_peered":"2023-05-10T01:10:39.621067+0000","last_clean":"2023-05-10T01:10:39.621067+0000","last_became_active":"2023-05-10T01:10:39.618253+0000","last_became_peered":"2023-05-10T01:10:39.618253+0000","last_unstale":"2023-05-10T01:10:39.621067+0000","last_undegraded":"2023-05-10T01:10:39.621067+0000","last_fullsized":"2023-05-10T01:10:39.621067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.601530+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:10:39.601530+0000","last_peered":"2023-05-10T01:10:39.601530+0000","last_clean":"2023-05-10T01:10:39.601530+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:10:39.601530+0000","last_undegraded":"2023-05-10T01:10:39.601530+0000","last_fullsized":"2023-05-10T01:10:39.601530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.604742+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:10:39.604742+0000","last_peered":"2023-05-10T01:10:39.604742+0000","last_clean":"2023-05-10T01:10:39.604742+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:10:39.604742+0000","last_undegraded":"2023-05-10T01:10:39.604742+0000","last_fullsized":"2023-05-10T01:10:39.604742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007440+0000","last_change":"2023-05-10T01:10:40.007440+0000","last_active":"2023-05-10T01:10:40.007440+0000","last_peered":"2023-05-10T01:10:40.007440+0000","last_clean":"2023-05-10T01:10:40.007440+0000","last_became_active":"2023-05-10T01:10:40.007166+0000","last_became_peered":"2023-05-10T01:10:40.007166+0000","last_unstale":"2023-05-10T01:10:40.007440+0000","last_undegraded":"2023-05-10T01:10:40.007440+0000","last_fullsized":"2023-05-10T01:10:40.007440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007009+0000","last_change":"2023-05-10T01:10:39.611537+0000","last_active":"2023-05-10T01:10:40.007009+0000","last_peered":"2023-05-10T01:10:40.007009+0000","last_clean":"2023-05-10T01:10:40.007009+0000","last_became_active":"2023-05-10T01:10:39.611235+0000","last_became_peered":"2023-05-10T01:10:39.611235+0000","last_unstale":"2023-05-10T01:10:40.007009+0000","last_undegraded":"2023-05-10T01:10:40.007009+0000","last_fullsized":"2023-05-10T01:10:40.007009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.605149+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:10:39.605149+0000","last_peered":"2023-05-10T01:10:39.605149+0000","last_clean":"2023-05-10T01:10:39.605149+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:10:39.605149+0000","last_undegraded":"2023-05-10T01:10:39.605149+0000","last_fullsized":"2023-05-10T01:10:39.605149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007076+0000","last_change":"2023-05-10T01:10:40.007076+0000","last_active":"2023-05-10T01:10:40.007076+0000","last_peered":"2023-05-10T01:10:40.007076+0000","last_clean":"2023-05-10T01:10:40.007076+0000","last_became_active":"2023-05-10T01:10:40.006709+0000","last_became_peered":"2023-05-10T01:10:40.006709+0000","last_unstale":"2023-05-10T01:10:40.007076+0000","last_undegraded":"2023-05-10T01:10:40.007076+0000","last_fullsized":"2023-05-10T01:10:40.007076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620794+0000","last_change":"2023-05-10T01:10:39.617548+0000","last_active":"2023-05-10T01:10:39.620794+0000","last_peered":"2023-05-10T01:10:39.620794+0000","last_clean":"2023-05-10T01:10:39.620794+0000","last_became_active":"2023-05-10T01:10:39.617276+0000","last_became_peered":"2023-05-10T01:10:39.617276+0000","last_unstale":"2023-05-10T01:10:39.620794+0000","last_undegraded":"2023-05-10T01:10:39.620794+0000","last_fullsized":"2023-05-10T01:10:39.620794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.607395+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:10:39.607395+0000","last_peered":"2023-05-10T01:10:39.607395+0000","last_clean":"2023-05-10T01:10:39.607395+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:10:39.607395+0000","last_undegraded":"2023-05-10T01:10:39.607395+0000","last_fullsized":"2023-05-10T01:10:39.607395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.001429+0000","last_change":"2023-05-10T01:10:40.001429+0000","last_active":"2023-05-10T01:10:40.001429+0000","last_peered":"2023-05-10T01:10:40.001429+0000","last_clean":"2023-05-10T01:10:40.001429+0000","last_became_active":"2023-05-10T01:10:40.001121+0000","last_became_peered":"2023-05-10T01:10:40.001121+0000","last_unstale":"2023-05-10T01:10:40.001429+0000","last_undegraded":"2023-05-10T01:10:40.001429+0000","last_fullsized":"2023-05-10T01:10:40.001429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615246+0000","last_change":"2023-05-10T01:10:39.607520+0000","last_active":"2023-05-10T01:10:39.615246+0000","last_peered":"2023-05-10T01:10:39.615246+0000","last_clean":"2023-05-10T01:10:39.615246+0000","last_became_active":"2023-05-10T01:10:39.606231+0000","last_became_peered":"2023-05-10T01:10:39.606231+0000","last_unstale":"2023-05-10T01:10:39.615246+0000","last_undegraded":"2023-05-10T01:10:39.615246+0000","last_fullsized":"2023-05-10T01:10:39.615246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.601804+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:10:39.601804+0000","last_peered":"2023-05-10T01:10:39.601804+0000","last_clean":"2023-05-10T01:10:39.601804+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:10:39.601804+0000","last_undegraded":"2023-05-10T01:10:39.601804+0000","last_fullsized":"2023-05-10T01:10:39.601804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010883+0000","last_change":"2023-05-10T01:10:40.010883+0000","last_active":"2023-05-10T01:10:40.010883+0000","last_peered":"2023-05-10T01:10:40.010883+0000","last_clean":"2023-05-10T01:10:40.010883+0000","last_became_active":"2023-05-10T01:10:40.010603+0000","last_became_peered":"2023-05-10T01:10:40.010603+0000","last_unstale":"2023-05-10T01:10:40.010883+0000","last_undegraded":"2023-05-10T01:10:40.010883+0000","last_fullsized":"2023-05-10T01:10:40.010883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614941+0000","last_change":"2023-05-10T01:10:39.610998+0000","last_active":"2023-05-10T01:10:39.614941+0000","last_peered":"2023-05-10T01:10:39.614941+0000","last_clean":"2023-05-10T01:10:39.614941+0000","last_became_active":"2023-05-10T01:10:39.610699+0000","last_became_peered":"2023-05-10T01:10:39.610699+0000","last_unstale":"2023-05-10T01:10:39.614941+0000","last_undegraded":"2023-05-10T01:10:39.614941+0000","last_fullsized":"2023-05-10T01:10:39.614941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.603603+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:10:39.603603+0000","last_peered":"2023-05-10T01:10:39.603603+0000","last_clean":"2023-05-10T01:10:39.603603+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:10:39.603603+0000","last_undegraded":"2023-05-10T01:10:39.603603+0000","last_fullsized":"2023-05-10T01:10:39.603603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5692,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366148,"statfs":{"total":96636764160,"available":96630935552,"internally_reserved":0,"allocated":380928,"data_stored":152640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366296,"statfs":{"total":96636764160,"available":96631087104,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5556,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366284,"statfs":{"total":96636764160,"available":96631074816,"internally_reserved":0,"allocated":372736,"data_stored":151996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5672,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366168,"statfs":{"total":96636764160,"available":96630956032,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5672,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366168,"statfs":{"total":96636764160,"available":96630956032,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5700,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366140,"statfs":{"total":96636764160,"available":96630927360,"internally_reserved":0,"allocated":389120,"data_stored":153554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:10:44.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:10:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.171+0000 7f4234cf9700 1 Processor -- start 2023-05-10T01:10:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.171+0000 7f4234cf9700 1 -- start start 2023-05-10T01:10:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f4234cf9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4230157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f4234cf9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300683c0 con 0x7f423014e1f0 2023-05-10T01:10:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f4234cf9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300be050 con 0x7f4230157f30 2023-05-10T01:10:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f4234cf9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4230137460 con 0x7f423014e5d0 2023-05-10T01:10:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f423014e1f0 0x7f4230066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40802/0 (socket says 172.21.15.52:40802) 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422e59c700 1 -- 172.21.15.52:0/3548892017 learned_addr learned my addr 172.21.15.52:0/3548892017 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422dd9b700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4230157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243408617 0 0) 0x7f42300683c0 con 0x7f423014e1f0 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100033f0 con 0x7f423014e1f0 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599991457 0 0) 0x7f42100033f0 con 0x7f423014e1f0 2023-05-10T01:10:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 msgr2=0x7f4230157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4230157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 >> v1:172.21.15.172:6789/0 conn(0x7f4230157f30 legacy=0x7f423015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230067550 con 0x7f423014e1f0 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f42280017f0 con 0x7f423014e1f0 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 >> v1:172.21.15.52:6789/0 conn(0x7f423014e1f0 legacy=0x7f4230066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4210003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.172+0000 7f422d59a700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210003e00 0x7f4210004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4210004b80 0x7f4210005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230137460 con 0x7f4210004b80 2023-05-10T01:10:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421000b8e0 con 0x7f4210003e00 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421000baa0 con 0x7f423014e5d0 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4210004b80 0x7f4210005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422dd9b700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210003e00 0x7f4210004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422e59c700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4210003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 -- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 msgr2=0x7f4210003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f423014e5d0 0x7f4210003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 -- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210003e00 msgr2=0x7f4210004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4210003e00 0x7f4210004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 -- 172.21.15.52:0/3548892017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100033f0 con 0x7f4210004b80 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422ed9d700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4210004b80 0x7f4210005000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f4220001820 tx=0x7f4220007b90).ready entity=mon.0 client_cookie=143a8e104f9fd8ac server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220007ea0 con 0x7f4210004b80 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220012400 con 0x7f4210004b80 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.173+0000 7f422d59a700 1 -- 172.21.15.52:0/3548892017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200127a0 con 0x7f4210004b80 2023-05-10T01:10:44.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 -- 172.21.15.52:0/3548892017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4210004b80 msgr2=0x7f4210005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 --2- 172.21.15.52:0/3548892017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4210004b80 0x7f4210005000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f4220001820 tx=0x7f4220007b90).stop 2023-05-10T01:10:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f422ed9d700 1 -- 172.21.15.52:0/3548892017 reap_dead start 2023-05-10T01:10:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 -- 172.21.15.52:0/3548892017 shutdown_connections 2023-05-10T01:10:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 -- 172.21.15.52:0/3548892017 >> 172.21.15.52:0/3548892017 conn(0x7f42300c7bb0 msgr2=0x7f42300c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 -- 172.21.15.52:0/3548892017 shutdown_connections 2023-05-10T01:10:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.174+0000 7f4234cf9700 1 -- 172.21.15.52:0/3548892017 wait complete. 2023-05-10T01:10:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.175+0000 7f4234cf9700 1 Processor -- start 2023-05-10T01:10:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.175+0000 7f4234cf9700 1 -- start start 2023-05-10T01:10:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4210004b80 0x7f4230167420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 0x7f4230165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300a9130 con 0x7f42300a87f0 2023-05-10T01:10:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300bfc30 con 0x7f4230168780 2023-05-10T01:10:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300bf300 con 0x7f4210004b80 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60034/0 (socket says 172.21.15.52:60034) 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 -- 172.21.15.52:0/4119399876 learned_addr learned my addr 172.21.15.52:0/4119399876 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422e59c700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4210004b80 0x7f4230167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422dd9b700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 0x7f4230165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 -- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4210004b80 msgr2=0x7f4230167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4210004b80 0x7f4230167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 -- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 msgr2=0x7f4230165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 0x7f4230165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 -- 172.21.15.52:0/4119399876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300bf5e0 con 0x7f42300a87f0 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422dd9b700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 0x7f4230165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f422ed9d700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f4220001e10 tx=0x7f4220016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220007ea0 con 0x7f42300a87f0 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220012e30 con 0x7f42300a87f0 2023-05-10T01:10:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42300bf8c0 con 0x7f42300a87f0 2023-05-10T01:10:44.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.176+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200117c0 con 0x7f42300a87f0 2023-05-10T01:10:44.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.177+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230165c00 con 0x7f42300a87f0 2023-05-10T01:10:44.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.177+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423006c340 con 0x7f42300a87f0 2023-05-10T01:10:44.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.178+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f422001b040 con 0x7f42300a87f0 2023-05-10T01:10:44.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.178+0000 7f42267fc700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 0x7f4214061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.178+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f422007a230 con 0x7f42300a87f0 2023-05-10T01:10:44.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.178+0000 7f422e59c700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 0x7f4214061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.179+0000 7f422e59c700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 0x7f4214061220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f42280011d0 tx=0x7f4228001d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.182+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f422004b7d0 con 0x7f42300a87f0 2023-05-10T01:10:44.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.352+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42300a9130 con 0x7f421405ed60 2023-05-10T01:10:44.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.362+0000 7f42267fc700 1 -- 172.21.15.52:0/4119399876 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336350 (secure 0 0 0) 0x7f42300a9130 con 0x7f421405ed60 2023-05-10T01:10:44.370 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:44.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 msgr2=0x7f4214061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 0x7f4214061220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f42280011d0 tx=0x7f4228001d90).stop 2023-05-10T01:10:44.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 msgr2=0x7f4230167bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f4220001e10 tx=0x7f4220016000).stop 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 shutdown_connections 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f421405ed60 0x7f4214061220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42300a87f0 0x7f4230167bd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4210004b80 0x7f4230167420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 --2- 172.21.15.52:0/4119399876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4230168780 0x7f4230165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 >> 172.21.15.52:0/4119399876 conn(0x7f42300c7bb0 msgr2=0x7f42300bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 shutdown_connections 2023-05-10T01:10:44.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.365+0000 7f4234cf9700 1 -- 172.21.15.52:0/4119399876 wait complete. 2023-05-10T01:10:44.374 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:10:44.381 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-05-10T01:10:42.453360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":45084,"kb_used_data":2908,"kb_used_omap":0,"kb_used_meta":42112,"kb_avail":754929636,"statfs":{"total":773094113280,"available":773047947264,"internally_reserved":0,"allocated":2977792,"data_stored":1197221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43122688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4317,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.580108"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994758+0000","last_change":"2023-05-10T01:10:39.994758+0000","last_active":"2023-05-10T01:10:39.994758+0000","last_peered":"2023-05-10T01:10:39.994758+0000","last_clean":"2023-05-10T01:10:39.994758+0000","last_became_active":"2023-05-10T01:10:39.993937+0000","last_became_peered":"2023-05-10T01:10:39.993937+0000","last_unstale":"2023-05-10T01:10:39.994758+0000","last_undegraded":"2023-05-10T01:10:39.994758+0000","last_fullsized":"2023-05-10T01:10:39.994758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011349+0000","last_change":"2023-05-10T01:10:39.616320+0000","last_active":"2023-05-10T01:10:40.011349+0000","last_peered":"2023-05-10T01:10:40.011349+0000","last_clean":"2023-05-10T01:10:40.011349+0000","last_became_active":"2023-05-10T01:10:39.615994+0000","last_became_peered":"2023-05-10T01:10:39.615994+0000","last_unstale":"2023-05-10T01:10:40.011349+0000","last_undegraded":"2023-05-10T01:10:40.011349+0000","last_fullsized":"2023-05-10T01:10:40.011349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006213+0000","last_change":"2023-05-10T01:10:40.006213+0000","last_active":"2023-05-10T01:10:40.006213+0000","last_peered":"2023-05-10T01:10:40.006213+0000","last_clean":"2023-05-10T01:10:40.006213+0000","last_became_active":"2023-05-10T01:10:40.005931+0000","last_became_peered":"2023-05-10T01:10:40.005931+0000","last_unstale":"2023-05-10T01:10:40.006213+0000","last_undegraded":"2023-05-10T01:10:40.006213+0000","last_fullsized":"2023-05-10T01:10:40.006213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608163+0000","last_change":"2023-05-10T01:10:39.604319+0000","last_active":"2023-05-10T01:10:39.608163+0000","last_peered":"2023-05-10T01:10:39.608163+0000","last_clean":"2023-05-10T01:10:39.608163+0000","last_became_active":"2023-05-10T01:10:39.603628+0000","last_became_peered":"2023-05-10T01:10:39.603628+0000","last_unstale":"2023-05-10T01:10:39.608163+0000","last_undegraded":"2023-05-10T01:10:39.608163+0000","last_fullsized":"2023-05-10T01:10:39.608163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999213+0000","last_change":"2023-05-10T01:10:39.999213+0000","last_active":"2023-05-10T01:10:39.999213+0000","last_peered":"2023-05-10T01:10:39.999213+0000","last_clean":"2023-05-10T01:10:39.999213+0000","last_became_active":"2023-05-10T01:10:39.998946+0000","last_became_peered":"2023-05-10T01:10:39.998946+0000","last_unstale":"2023-05-10T01:10:39.999213+0000","last_undegraded":"2023-05-10T01:10:39.999213+0000","last_fullsized":"2023-05-10T01:10:39.999213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619031+0000","last_change":"2023-05-10T01:10:39.614495+0000","last_active":"2023-05-10T01:10:39.619031+0000","last_peered":"2023-05-10T01:10:39.619031+0000","last_clean":"2023-05-10T01:10:39.619031+0000","last_became_active":"2023-05-10T01:10:39.614255+0000","last_became_peered":"2023-05-10T01:10:39.614255+0000","last_unstale":"2023-05-10T01:10:39.619031+0000","last_undegraded":"2023-05-10T01:10:39.619031+0000","last_fullsized":"2023-05-10T01:10:39.619031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997816+0000","last_change":"2023-05-10T01:10:39.997816+0000","last_active":"2023-05-10T01:10:39.997816+0000","last_peered":"2023-05-10T01:10:39.997816+0000","last_clean":"2023-05-10T01:10:39.997816+0000","last_became_active":"2023-05-10T01:10:39.997551+0000","last_became_peered":"2023-05-10T01:10:39.997551+0000","last_unstale":"2023-05-10T01:10:39.997816+0000","last_undegraded":"2023-05-10T01:10:39.997816+0000","last_fullsized":"2023-05-10T01:10:39.997816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004038+0000","last_change":"2023-05-10T01:10:39.616012+0000","last_active":"2023-05-10T01:10:40.004038+0000","last_peered":"2023-05-10T01:10:40.004038+0000","last_clean":"2023-05-10T01:10:40.004038+0000","last_became_active":"2023-05-10T01:10:39.614553+0000","last_became_peered":"2023-05-10T01:10:39.614553+0000","last_unstale":"2023-05-10T01:10:40.004038+0000","last_undegraded":"2023-05-10T01:10:40.004038+0000","last_fullsized":"2023-05-10T01:10:40.004038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006142+0000","last_change":"2023-05-10T01:10:40.006142+0000","last_active":"2023-05-10T01:10:40.006142+0000","last_peered":"2023-05-10T01:10:40.006142+0000","last_clean":"2023-05-10T01:10:40.006142+0000","last_became_active":"2023-05-10T01:10:40.005854+0000","last_became_peered":"2023-05-10T01:10:40.005854+0000","last_unstale":"2023-05-10T01:10:40.006142+0000","last_undegraded":"2023-05-10T01:10:40.006142+0000","last_fullsized":"2023-05-10T01:10:40.006142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985577+0000","last_change":"2023-05-10T01:10:39.615111+0000","last_active":"2023-05-10T01:10:39.985577+0000","last_peered":"2023-05-10T01:10:39.985577+0000","last_clean":"2023-05-10T01:10:39.985577+0000","last_became_active":"2023-05-10T01:10:39.614850+0000","last_became_peered":"2023-05-10T01:10:39.614850+0000","last_unstale":"2023-05-10T01:10:39.985577+0000","last_undegraded":"2023-05-10T01:10:39.985577+0000","last_fullsized":"2023-05-10T01:10:39.985577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003018+0000","last_change":"2023-05-10T01:10:40.003018+0000","last_active":"2023-05-10T01:10:40.003018+0000","last_peered":"2023-05-10T01:10:40.003018+0000","last_clean":"2023-05-10T01:10:40.003018+0000","last_became_active":"2023-05-10T01:10:40.002698+0000","last_became_peered":"2023-05-10T01:10:40.002698+0000","last_unstale":"2023-05-10T01:10:40.003018+0000","last_undegraded":"2023-05-10T01:10:40.003018+0000","last_fullsized":"2023-05-10T01:10:40.003018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.990369+0000","last_change":"2023-05-10T01:10:39.609496+0000","last_active":"2023-05-10T01:10:39.990369+0000","last_peered":"2023-05-10T01:10:39.990369+0000","last_clean":"2023-05-10T01:10:39.990369+0000","last_became_active":"2023-05-10T01:10:39.608842+0000","last_became_peered":"2023-05-10T01:10:39.608842+0000","last_unstale":"2023-05-10T01:10:39.990369+0000","last_undegraded":"2023-05-10T01:10:39.990369+0000","last_fullsized":"2023-05-10T01:10:39.990369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999797+0000","last_change":"2023-05-10T01:10:39.999797+0000","last_active":"2023-05-10T01:10:39.999797+0000","last_peered":"2023-05-10T01:10:39.999797+0000","last_clean":"2023-05-10T01:10:39.999797+0000","last_became_active":"2023-05-10T01:10:39.999459+0000","last_became_peered":"2023-05-10T01:10:39.999459+0000","last_unstale":"2023-05-10T01:10:39.999797+0000","last_undegraded":"2023-05-10T01:10:39.999797+0000","last_fullsized":"2023-05-10T01:10:39.999797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621080+0000","last_change":"2023-05-10T01:10:39.618621+0000","last_active":"2023-05-10T01:10:39.621080+0000","last_peered":"2023-05-10T01:10:39.621080+0000","last_clean":"2023-05-10T01:10:39.621080+0000","last_became_active":"2023-05-10T01:10:39.618363+0000","last_became_peered":"2023-05-10T01:10:39.618363+0000","last_unstale":"2023-05-10T01:10:39.621080+0000","last_undegraded":"2023-05-10T01:10:39.621080+0000","last_fullsized":"2023-05-10T01:10:39.621080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.993950+0000","last_change":"2023-05-10T01:10:39.993950+0000","last_active":"2023-05-10T01:10:39.993950+0000","last_peered":"2023-05-10T01:10:39.993950+0000","last_clean":"2023-05-10T01:10:39.993950+0000","last_became_active":"2023-05-10T01:10:39.993713+0000","last_became_peered":"2023-05-10T01:10:39.993713+0000","last_unstale":"2023-05-10T01:10:39.993950+0000","last_undegraded":"2023-05-10T01:10:39.993950+0000","last_fullsized":"2023-05-10T01:10:39.993950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619162+0000","last_change":"2023-05-10T01:10:39.613223+0000","last_active":"2023-05-10T01:10:39.619162+0000","last_peered":"2023-05-10T01:10:39.619162+0000","last_clean":"2023-05-10T01:10:39.619162+0000","last_became_active":"2023-05-10T01:10:39.612593+0000","last_became_peered":"2023-05-10T01:10:39.612593+0000","last_unstale":"2023-05-10T01:10:39.619162+0000","last_undegraded":"2023-05-10T01:10:39.619162+0000","last_fullsized":"2023-05-10T01:10:39.619162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.990587+0000","last_change":"2023-05-10T01:10:39.990587+0000","last_active":"2023-05-10T01:10:39.990587+0000","last_peered":"2023-05-10T01:10:39.990587+0000","last_clean":"2023-05-10T01:10:39.990587+0000","last_became_active":"2023-05-10T01:10:39.990133+0000","last_became_peered":"2023-05-10T01:10:39.990133+0000","last_unstale":"2023-05-10T01:10:39.990587+0000","last_undegraded":"2023-05-10T01:10:39.990587+0000","last_fullsized":"2023-05-10T01:10:39.990587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619428+0000","last_change":"2023-05-10T01:10:39.612815+0000","last_active":"2023-05-10T01:10:39.619428+0000","last_peered":"2023-05-10T01:10:39.619428+0000","last_clean":"2023-05-10T01:10:39.619428+0000","last_became_active":"2023-05-10T01:10:39.612494+0000","last_became_peered":"2023-05-10T01:10:39.612494+0000","last_unstale":"2023-05-10T01:10:39.619428+0000","last_undegraded":"2023-05-10T01:10:39.619428+0000","last_fullsized":"2023-05-10T01:10:39.619428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004909+0000","last_change":"2023-05-10T01:10:40.004909+0000","last_active":"2023-05-10T01:10:40.004909+0000","last_peered":"2023-05-10T01:10:40.004909+0000","last_clean":"2023-05-10T01:10:40.004909+0000","last_became_active":"2023-05-10T01:10:40.004141+0000","last_became_peered":"2023-05-10T01:10:40.004141+0000","last_unstale":"2023-05-10T01:10:40.004909+0000","last_undegraded":"2023-05-10T01:10:40.004909+0000","last_fullsized":"2023-05-10T01:10:40.004909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616894+0000","last_change":"2023-05-10T01:10:39.611264+0000","last_active":"2023-05-10T01:10:39.616894+0000","last_peered":"2023-05-10T01:10:39.616894+0000","last_clean":"2023-05-10T01:10:39.616894+0000","last_became_active":"2023-05-10T01:10:39.610946+0000","last_became_peered":"2023-05-10T01:10:39.610946+0000","last_unstale":"2023-05-10T01:10:39.616894+0000","last_undegraded":"2023-05-10T01:10:39.616894+0000","last_fullsized":"2023-05-10T01:10:39.616894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011048+0000","last_change":"2023-05-10T01:10:40.011048+0000","last_active":"2023-05-10T01:10:40.011048+0000","last_peered":"2023-05-10T01:10:40.011048+0000","last_clean":"2023-05-10T01:10:40.011048+0000","last_became_active":"2023-05-10T01:10:40.010727+0000","last_became_peered":"2023-05-10T01:10:40.010727+0000","last_unstale":"2023-05-10T01:10:40.011048+0000","last_undegraded":"2023-05-10T01:10:40.011048+0000","last_fullsized":"2023-05-10T01:10:40.011048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620954+0000","last_change":"2023-05-10T01:10:39.616434+0000","last_active":"2023-05-10T01:10:39.620954+0000","last_peered":"2023-05-10T01:10:39.620954+0000","last_clean":"2023-05-10T01:10:39.620954+0000","last_became_active":"2023-05-10T01:10:39.616024+0000","last_became_peered":"2023-05-10T01:10:39.616024+0000","last_unstale":"2023-05-10T01:10:39.620954+0000","last_undegraded":"2023-05-10T01:10:39.620954+0000","last_fullsized":"2023-05-10T01:10:39.620954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006109+0000","last_change":"2023-05-10T01:10:40.006109+0000","last_active":"2023-05-10T01:10:40.006109+0000","last_peered":"2023-05-10T01:10:40.006109+0000","last_clean":"2023-05-10T01:10:40.006109+0000","last_became_active":"2023-05-10T01:10:40.005808+0000","last_became_peered":"2023-05-10T01:10:40.005808+0000","last_unstale":"2023-05-10T01:10:40.006109+0000","last_undegraded":"2023-05-10T01:10:40.006109+0000","last_fullsized":"2023-05-10T01:10:40.006109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005609+0000","last_change":"2023-05-10T01:10:39.610745+0000","last_active":"2023-05-10T01:10:40.005609+0000","last_peered":"2023-05-10T01:10:40.005609+0000","last_clean":"2023-05-10T01:10:40.005609+0000","last_became_active":"2023-05-10T01:10:39.609804+0000","last_became_peered":"2023-05-10T01:10:39.609804+0000","last_unstale":"2023-05-10T01:10:40.005609+0000","last_undegraded":"2023-05-10T01:10:40.005609+0000","last_fullsized":"2023-05-10T01:10:40.005609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010320+0000","last_change":"2023-05-10T01:10:40.010320+0000","last_active":"2023-05-10T01:10:40.010320+0000","last_peered":"2023-05-10T01:10:40.010320+0000","last_clean":"2023-05-10T01:10:40.010320+0000","last_became_active":"2023-05-10T01:10:40.009945+0000","last_became_peered":"2023-05-10T01:10:40.009945+0000","last_unstale":"2023-05-10T01:10:40.010320+0000","last_undegraded":"2023-05-10T01:10:40.010320+0000","last_fullsized":"2023-05-10T01:10:40.010320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985702+0000","last_change":"2023-05-10T01:10:39.607355+0000","last_active":"2023-05-10T01:10:39.985702+0000","last_peered":"2023-05-10T01:10:39.985702+0000","last_clean":"2023-05-10T01:10:39.985702+0000","last_became_active":"2023-05-10T01:10:39.606838+0000","last_became_peered":"2023-05-10T01:10:39.606838+0000","last_unstale":"2023-05-10T01:10:39.985702+0000","last_undegraded":"2023-05-10T01:10:39.985702+0000","last_fullsized":"2023-05-10T01:10:39.985702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004832+0000","last_change":"2023-05-10T01:10:40.004832+0000","last_active":"2023-05-10T01:10:40.004832+0000","last_peered":"2023-05-10T01:10:40.004832+0000","last_clean":"2023-05-10T01:10:40.004832+0000","last_became_active":"2023-05-10T01:10:40.004524+0000","last_became_peered":"2023-05-10T01:10:40.004524+0000","last_unstale":"2023-05-10T01:10:40.004832+0000","last_undegraded":"2023-05-10T01:10:40.004832+0000","last_fullsized":"2023-05-10T01:10:40.004832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608016+0000","last_change":"2023-05-10T01:10:39.601710+0000","last_active":"2023-05-10T01:10:39.608016+0000","last_peered":"2023-05-10T01:10:39.608016+0000","last_clean":"2023-05-10T01:10:39.608016+0000","last_became_active":"2023-05-10T01:10:39.601385+0000","last_became_peered":"2023-05-10T01:10:39.601385+0000","last_unstale":"2023-05-10T01:10:39.608016+0000","last_undegraded":"2023-05-10T01:10:39.608016+0000","last_fullsized":"2023-05-10T01:10:39.608016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007430+0000","last_change":"2023-05-10T01:10:40.007430+0000","last_active":"2023-05-10T01:10:40.007430+0000","last_peered":"2023-05-10T01:10:40.007430+0000","last_clean":"2023-05-10T01:10:40.007430+0000","last_became_active":"2023-05-10T01:10:40.007171+0000","last_became_peered":"2023-05-10T01:10:40.007171+0000","last_unstale":"2023-05-10T01:10:40.007430+0000","last_undegraded":"2023-05-10T01:10:40.007430+0000","last_fullsized":"2023-05-10T01:10:40.007430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618766+0000","last_change":"2023-05-10T01:10:39.614146+0000","last_active":"2023-05-10T01:10:39.618766+0000","last_peered":"2023-05-10T01:10:39.618766+0000","last_clean":"2023-05-10T01:10:39.618766+0000","last_became_active":"2023-05-10T01:10:39.613855+0000","last_became_peered":"2023-05-10T01:10:39.613855+0000","last_unstale":"2023-05-10T01:10:39.618766+0000","last_undegraded":"2023-05-10T01:10:39.618766+0000","last_fullsized":"2023-05-10T01:10:39.618766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011808+0000","last_change":"2023-05-10T01:10:40.011808+0000","last_active":"2023-05-10T01:10:40.011808+0000","last_peered":"2023-05-10T01:10:40.011808+0000","last_clean":"2023-05-10T01:10:40.011808+0000","last_became_active":"2023-05-10T01:10:40.011384+0000","last_became_peered":"2023-05-10T01:10:40.011384+0000","last_unstale":"2023-05-10T01:10:40.011808+0000","last_undegraded":"2023-05-10T01:10:40.011808+0000","last_fullsized":"2023-05-10T01:10:40.011808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003331+0000","last_change":"2023-05-10T01:10:39.612373+0000","last_active":"2023-05-10T01:10:40.003331+0000","last_peered":"2023-05-10T01:10:40.003331+0000","last_clean":"2023-05-10T01:10:40.003331+0000","last_became_active":"2023-05-10T01:10:39.612046+0000","last_became_peered":"2023-05-10T01:10:39.612046+0000","last_unstale":"2023-05-10T01:10:40.003331+0000","last_undegraded":"2023-05-10T01:10:40.003331+0000","last_fullsized":"2023-05-10T01:10:40.003331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006902+0000","last_change":"2023-05-10T01:10:40.006902+0000","last_active":"2023-05-10T01:10:40.006902+0000","last_peered":"2023-05-10T01:10:40.006902+0000","last_clean":"2023-05-10T01:10:40.006902+0000","last_became_active":"2023-05-10T01:10:40.006622+0000","last_became_peered":"2023-05-10T01:10:40.006622+0000","last_unstale":"2023-05-10T01:10:40.006902+0000","last_undegraded":"2023-05-10T01:10:40.006902+0000","last_fullsized":"2023-05-10T01:10:40.006902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623600+0000","last_change":"2023-05-10T01:10:39.618879+0000","last_active":"2023-05-10T01:10:39.623600+0000","last_peered":"2023-05-10T01:10:39.623600+0000","last_clean":"2023-05-10T01:10:39.623600+0000","last_became_active":"2023-05-10T01:10:39.618324+0000","last_became_peered":"2023-05-10T01:10:39.618324+0000","last_unstale":"2023-05-10T01:10:39.623600+0000","last_undegraded":"2023-05-10T01:10:39.623600+0000","last_fullsized":"2023-05-10T01:10:39.623600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000238+0000","last_change":"2023-05-10T01:10:40.000238+0000","last_active":"2023-05-10T01:10:40.000238+0000","last_peered":"2023-05-10T01:10:40.000238+0000","last_clean":"2023-05-10T01:10:40.000238+0000","last_became_active":"2023-05-10T01:10:39.999959+0000","last_became_peered":"2023-05-10T01:10:39.999959+0000","last_unstale":"2023-05-10T01:10:40.000238+0000","last_undegraded":"2023-05-10T01:10:40.000238+0000","last_fullsized":"2023-05-10T01:10:40.000238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617847+0000","last_change":"2023-05-10T01:10:39.615895+0000","last_active":"2023-05-10T01:10:39.617847+0000","last_peered":"2023-05-10T01:10:39.617847+0000","last_clean":"2023-05-10T01:10:39.617847+0000","last_became_active":"2023-05-10T01:10:39.615467+0000","last_became_peered":"2023-05-10T01:10:39.615467+0000","last_unstale":"2023-05-10T01:10:39.617847+0000","last_undegraded":"2023-05-10T01:10:39.617847+0000","last_fullsized":"2023-05-10T01:10:39.617847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006939+0000","last_change":"2023-05-10T01:10:40.006939+0000","last_active":"2023-05-10T01:10:40.006939+0000","last_peered":"2023-05-10T01:10:40.006939+0000","last_clean":"2023-05-10T01:10:40.006939+0000","last_became_active":"2023-05-10T01:10:40.006185+0000","last_became_peered":"2023-05-10T01:10:40.006185+0000","last_unstale":"2023-05-10T01:10:40.006939+0000","last_undegraded":"2023-05-10T01:10:40.006939+0000","last_fullsized":"2023-05-10T01:10:40.006939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.992105+0000","last_change":"2023-05-10T01:10:39.614397+0000","last_active":"2023-05-10T01:10:39.992105+0000","last_peered":"2023-05-10T01:10:39.992105+0000","last_clean":"2023-05-10T01:10:39.992105+0000","last_became_active":"2023-05-10T01:10:39.614118+0000","last_became_peered":"2023-05-10T01:10:39.614118+0000","last_unstale":"2023-05-10T01:10:39.992105+0000","last_undegraded":"2023-05-10T01:10:39.992105+0000","last_fullsized":"2023-05-10T01:10:39.992105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010317+0000","last_change":"2023-05-10T01:10:40.010317+0000","last_active":"2023-05-10T01:10:40.010317+0000","last_peered":"2023-05-10T01:10:40.010317+0000","last_clean":"2023-05-10T01:10:40.010317+0000","last_became_active":"2023-05-10T01:10:40.010018+0000","last_became_peered":"2023-05-10T01:10:40.010018+0000","last_unstale":"2023-05-10T01:10:40.010317+0000","last_undegraded":"2023-05-10T01:10:40.010317+0000","last_fullsized":"2023-05-10T01:10:40.010317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617201+0000","last_change":"2023-05-10T01:10:39.612604+0000","last_active":"2023-05-10T01:10:39.617201+0000","last_peered":"2023-05-10T01:10:39.617201+0000","last_clean":"2023-05-10T01:10:39.617201+0000","last_became_active":"2023-05-10T01:10:39.608956+0000","last_became_peered":"2023-05-10T01:10:39.608956+0000","last_unstale":"2023-05-10T01:10:39.617201+0000","last_undegraded":"2023-05-10T01:10:39.617201+0000","last_fullsized":"2023-05-10T01:10:39.617201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.001769+0000","last_change":"2023-05-10T01:10:40.001769+0000","last_active":"2023-05-10T01:10:40.001769+0000","last_peered":"2023-05-10T01:10:40.001769+0000","last_clean":"2023-05-10T01:10:40.001769+0000","last_became_active":"2023-05-10T01:10:40.001365+0000","last_became_peered":"2023-05-10T01:10:40.001365+0000","last_unstale":"2023-05-10T01:10:40.001769+0000","last_undegraded":"2023-05-10T01:10:40.001769+0000","last_fullsized":"2023-05-10T01:10:40.001769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.989501+0000","last_change":"2023-05-10T01:10:39.602903+0000","last_active":"2023-05-10T01:10:39.989501+0000","last_peered":"2023-05-10T01:10:39.989501+0000","last_clean":"2023-05-10T01:10:39.989501+0000","last_became_active":"2023-05-10T01:10:39.602590+0000","last_became_peered":"2023-05-10T01:10:39.602590+0000","last_unstale":"2023-05-10T01:10:39.989501+0000","last_undegraded":"2023-05-10T01:10:39.989501+0000","last_fullsized":"2023-05-10T01:10:39.989501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003446+0000","last_change":"2023-05-10T01:10:40.003446+0000","last_active":"2023-05-10T01:10:40.003446+0000","last_peered":"2023-05-10T01:10:40.003446+0000","last_clean":"2023-05-10T01:10:40.003446+0000","last_became_active":"2023-05-10T01:10:40.002760+0000","last_became_peered":"2023-05-10T01:10:40.002760+0000","last_unstale":"2023-05-10T01:10:40.003446+0000","last_undegraded":"2023-05-10T01:10:40.003446+0000","last_fullsized":"2023-05-10T01:10:40.003446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615791+0000","last_change":"2023-05-10T01:10:39.607913+0000","last_active":"2023-05-10T01:10:39.615791+0000","last_peered":"2023-05-10T01:10:39.615791+0000","last_clean":"2023-05-10T01:10:39.615791+0000","last_became_active":"2023-05-10T01:10:39.607475+0000","last_became_peered":"2023-05-10T01:10:39.607475+0000","last_unstale":"2023-05-10T01:10:39.615791+0000","last_undegraded":"2023-05-10T01:10:39.615791+0000","last_fullsized":"2023-05-10T01:10:39.615791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004581+0000","last_change":"2023-05-10T01:10:40.004581+0000","last_active":"2023-05-10T01:10:40.004581+0000","last_peered":"2023-05-10T01:10:40.004581+0000","last_clean":"2023-05-10T01:10:40.004581+0000","last_became_active":"2023-05-10T01:10:40.004318+0000","last_became_peered":"2023-05-10T01:10:40.004318+0000","last_unstale":"2023-05-10T01:10:40.004581+0000","last_undegraded":"2023-05-10T01:10:40.004581+0000","last_fullsized":"2023-05-10T01:10:40.004581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616003+0000","last_change":"2023-05-10T01:10:39.613438+0000","last_active":"2023-05-10T01:10:39.616003+0000","last_peered":"2023-05-10T01:10:39.616003+0000","last_clean":"2023-05-10T01:10:39.616003+0000","last_became_active":"2023-05-10T01:10:39.613120+0000","last_became_peered":"2023-05-10T01:10:39.613120+0000","last_unstale":"2023-05-10T01:10:39.616003+0000","last_undegraded":"2023-05-10T01:10:39.616003+0000","last_fullsized":"2023-05-10T01:10:39.616003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003552+0000","last_change":"2023-05-10T01:10:40.003552+0000","last_active":"2023-05-10T01:10:40.003552+0000","last_peered":"2023-05-10T01:10:40.003552+0000","last_clean":"2023-05-10T01:10:40.003552+0000","last_became_active":"2023-05-10T01:10:40.003260+0000","last_became_peered":"2023-05-10T01:10:40.003260+0000","last_unstale":"2023-05-10T01:10:40.003552+0000","last_undegraded":"2023-05-10T01:10:40.003552+0000","last_fullsized":"2023-05-10T01:10:40.003552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615226+0000","last_change":"2023-05-10T01:10:39.609505+0000","last_active":"2023-05-10T01:10:39.615226+0000","last_peered":"2023-05-10T01:10:39.615226+0000","last_clean":"2023-05-10T01:10:39.615226+0000","last_became_active":"2023-05-10T01:10:39.609211+0000","last_became_peered":"2023-05-10T01:10:39.609211+0000","last_unstale":"2023-05-10T01:10:39.615226+0000","last_undegraded":"2023-05-10T01:10:39.615226+0000","last_fullsized":"2023-05-10T01:10:39.615226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006151+0000","last_change":"2023-05-10T01:10:40.006151+0000","last_active":"2023-05-10T01:10:40.006151+0000","last_peered":"2023-05-10T01:10:40.006151+0000","last_clean":"2023-05-10T01:10:40.006151+0000","last_became_active":"2023-05-10T01:10:40.005832+0000","last_became_peered":"2023-05-10T01:10:40.005832+0000","last_unstale":"2023-05-10T01:10:40.006151+0000","last_undegraded":"2023-05-10T01:10:40.006151+0000","last_fullsized":"2023-05-10T01:10:40.006151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614846+0000","last_change":"2023-05-10T01:10:39.612138+0000","last_active":"2023-05-10T01:10:39.614846+0000","last_peered":"2023-05-10T01:10:39.614846+0000","last_clean":"2023-05-10T01:10:39.614846+0000","last_became_active":"2023-05-10T01:10:39.611842+0000","last_became_peered":"2023-05-10T01:10:39.611842+0000","last_unstale":"2023-05-10T01:10:39.614846+0000","last_undegraded":"2023-05-10T01:10:39.614846+0000","last_fullsized":"2023-05-10T01:10:39.614846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005175+0000","last_change":"2023-05-10T01:10:40.005175+0000","last_active":"2023-05-10T01:10:40.005175+0000","last_peered":"2023-05-10T01:10:40.005175+0000","last_clean":"2023-05-10T01:10:40.005175+0000","last_became_active":"2023-05-10T01:10:40.004824+0000","last_became_peered":"2023-05-10T01:10:40.004824+0000","last_unstale":"2023-05-10T01:10:40.005175+0000","last_undegraded":"2023-05-10T01:10:40.005175+0000","last_fullsized":"2023-05-10T01:10:40.005175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.610388+0000","last_change":"2023-05-10T01:10:39.609186+0000","last_active":"2023-05-10T01:10:39.610388+0000","last_peered":"2023-05-10T01:10:39.610388+0000","last_clean":"2023-05-10T01:10:39.610388+0000","last_became_active":"2023-05-10T01:10:39.608884+0000","last_became_peered":"2023-05-10T01:10:39.608884+0000","last_unstale":"2023-05-10T01:10:39.610388+0000","last_undegraded":"2023-05-10T01:10:39.610388+0000","last_fullsized":"2023-05-10T01:10:39.610388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007766+0000","last_change":"2023-05-10T01:10:40.007766+0000","last_active":"2023-05-10T01:10:40.007766+0000","last_peered":"2023-05-10T01:10:40.007766+0000","last_clean":"2023-05-10T01:10:40.007766+0000","last_became_active":"2023-05-10T01:10:40.007357+0000","last_became_peered":"2023-05-10T01:10:40.007357+0000","last_unstale":"2023-05-10T01:10:40.007766+0000","last_undegraded":"2023-05-10T01:10:40.007766+0000","last_fullsized":"2023-05-10T01:10:40.007766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614776+0000","last_change":"2023-05-10T01:10:39.613627+0000","last_active":"2023-05-10T01:10:39.614776+0000","last_peered":"2023-05-10T01:10:39.614776+0000","last_clean":"2023-05-10T01:10:39.614776+0000","last_became_active":"2023-05-10T01:10:39.613214+0000","last_became_peered":"2023-05-10T01:10:39.613214+0000","last_unstale":"2023-05-10T01:10:39.614776+0000","last_undegraded":"2023-05-10T01:10:39.614776+0000","last_fullsized":"2023-05-10T01:10:39.614776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.009279+0000","last_change":"2023-05-10T01:10:40.009279+0000","last_active":"2023-05-10T01:10:40.009279+0000","last_peered":"2023-05-10T01:10:40.009279+0000","last_clean":"2023-05-10T01:10:40.009279+0000","last_became_active":"2023-05-10T01:10:40.009016+0000","last_became_peered":"2023-05-10T01:10:40.009016+0000","last_unstale":"2023-05-10T01:10:40.009279+0000","last_undegraded":"2023-05-10T01:10:40.009279+0000","last_fullsized":"2023-05-10T01:10:40.009279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623487+0000","last_change":"2023-05-10T01:10:39.618394+0000","last_active":"2023-05-10T01:10:39.623487+0000","last_peered":"2023-05-10T01:10:39.623487+0000","last_clean":"2023-05-10T01:10:39.623487+0000","last_became_active":"2023-05-10T01:10:39.618125+0000","last_became_peered":"2023-05-10T01:10:39.618125+0000","last_unstale":"2023-05-10T01:10:39.623487+0000","last_undegraded":"2023-05-10T01:10:39.623487+0000","last_fullsized":"2023-05-10T01:10:39.623487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000330+0000","last_change":"2023-05-10T01:10:40.000330+0000","last_active":"2023-05-10T01:10:40.000330+0000","last_peered":"2023-05-10T01:10:40.000330+0000","last_clean":"2023-05-10T01:10:40.000330+0000","last_became_active":"2023-05-10T01:10:39.999978+0000","last_became_peered":"2023-05-10T01:10:39.999978+0000","last_unstale":"2023-05-10T01:10:40.000330+0000","last_undegraded":"2023-05-10T01:10:40.000330+0000","last_fullsized":"2023-05-10T01:10:40.000330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615233+0000","last_change":"2023-05-10T01:10:39.607266+0000","last_active":"2023-05-10T01:10:39.615233+0000","last_peered":"2023-05-10T01:10:39.615233+0000","last_clean":"2023-05-10T01:10:39.615233+0000","last_became_active":"2023-05-10T01:10:39.606949+0000","last_became_peered":"2023-05-10T01:10:39.606949+0000","last_unstale":"2023-05-10T01:10:39.615233+0000","last_undegraded":"2023-05-10T01:10:39.615233+0000","last_fullsized":"2023-05-10T01:10:39.615233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.002561+0000","last_change":"2023-05-10T01:10:40.002561+0000","last_active":"2023-05-10T01:10:40.002561+0000","last_peered":"2023-05-10T01:10:40.002561+0000","last_clean":"2023-05-10T01:10:40.002561+0000","last_became_active":"2023-05-10T01:10:40.002205+0000","last_became_peered":"2023-05-10T01:10:40.002205+0000","last_unstale":"2023-05-10T01:10:40.002561+0000","last_undegraded":"2023-05-10T01:10:40.002561+0000","last_fullsized":"2023-05-10T01:10:40.002561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.623649+0000","last_change":"2023-05-10T01:10:39.618905+0000","last_active":"2023-05-10T01:10:39.623649+0000","last_peered":"2023-05-10T01:10:39.623649+0000","last_clean":"2023-05-10T01:10:39.623649+0000","last_became_active":"2023-05-10T01:10:39.618636+0000","last_became_peered":"2023-05-10T01:10:39.618636+0000","last_unstale":"2023-05-10T01:10:39.623649+0000","last_undegraded":"2023-05-10T01:10:39.623649+0000","last_fullsized":"2023-05-10T01:10:39.623649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005764+0000","last_change":"2023-05-10T01:10:40.005764+0000","last_active":"2023-05-10T01:10:40.005764+0000","last_peered":"2023-05-10T01:10:40.005764+0000","last_clean":"2023-05-10T01:10:40.005764+0000","last_became_active":"2023-05-10T01:10:40.005423+0000","last_became_peered":"2023-05-10T01:10:40.005423+0000","last_unstale":"2023-05-10T01:10:40.005764+0000","last_undegraded":"2023-05-10T01:10:40.005764+0000","last_fullsized":"2023-05-10T01:10:40.005764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617777+0000","last_change":"2023-05-10T01:10:39.610015+0000","last_active":"2023-05-10T01:10:39.617777+0000","last_peered":"2023-05-10T01:10:39.617777+0000","last_clean":"2023-05-10T01:10:39.617777+0000","last_became_active":"2023-05-10T01:10:39.608014+0000","last_became_peered":"2023-05-10T01:10:39.608014+0000","last_unstale":"2023-05-10T01:10:39.617777+0000","last_undegraded":"2023-05-10T01:10:39.617777+0000","last_fullsized":"2023-05-10T01:10:39.617777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006967+0000","last_change":"2023-05-10T01:10:40.006967+0000","last_active":"2023-05-10T01:10:40.006967+0000","last_peered":"2023-05-10T01:10:40.006967+0000","last_clean":"2023-05-10T01:10:40.006967+0000","last_became_active":"2023-05-10T01:10:40.006634+0000","last_became_peered":"2023-05-10T01:10:40.006634+0000","last_unstale":"2023-05-10T01:10:40.006967+0000","last_undegraded":"2023-05-10T01:10:40.006967+0000","last_fullsized":"2023-05-10T01:10:40.006967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621005+0000","last_change":"2023-05-10T01:10:39.616775+0000","last_active":"2023-05-10T01:10:39.621005+0000","last_peered":"2023-05-10T01:10:39.621005+0000","last_clean":"2023-05-10T01:10:39.621005+0000","last_became_active":"2023-05-10T01:10:39.616121+0000","last_became_peered":"2023-05-10T01:10:39.616121+0000","last_unstale":"2023-05-10T01:10:39.621005+0000","last_undegraded":"2023-05-10T01:10:39.621005+0000","last_fullsized":"2023-05-10T01:10:39.621005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010384+0000","last_change":"2023-05-10T01:10:40.010384+0000","last_active":"2023-05-10T01:10:40.010384+0000","last_peered":"2023-05-10T01:10:40.010384+0000","last_clean":"2023-05-10T01:10:40.010384+0000","last_became_active":"2023-05-10T01:10:40.010063+0000","last_became_peered":"2023-05-10T01:10:40.010063+0000","last_unstale":"2023-05-10T01:10:40.010384+0000","last_undegraded":"2023-05-10T01:10:40.010384+0000","last_fullsized":"2023-05-10T01:10:40.010384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.002106+0000","last_change":"2023-05-10T01:10:39.610678+0000","last_active":"2023-05-10T01:10:40.002106+0000","last_peered":"2023-05-10T01:10:40.002106+0000","last_clean":"2023-05-10T01:10:40.002106+0000","last_became_active":"2023-05-10T01:10:39.610379+0000","last_became_peered":"2023-05-10T01:10:39.610379+0000","last_unstale":"2023-05-10T01:10:40.002106+0000","last_undegraded":"2023-05-10T01:10:40.002106+0000","last_fullsized":"2023-05-10T01:10:40.002106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007673+0000","last_change":"2023-05-10T01:10:40.007673+0000","last_active":"2023-05-10T01:10:40.007673+0000","last_peered":"2023-05-10T01:10:40.007673+0000","last_clean":"2023-05-10T01:10:40.007673+0000","last_became_active":"2023-05-10T01:10:40.007250+0000","last_became_peered":"2023-05-10T01:10:40.007250+0000","last_unstale":"2023-05-10T01:10:40.007673+0000","last_undegraded":"2023-05-10T01:10:40.007673+0000","last_fullsized":"2023-05-10T01:10:40.007673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.982317+0000","last_change":"2023-05-10T01:10:39.609089+0000","last_active":"2023-05-10T01:10:39.982317+0000","last_peered":"2023-05-10T01:10:39.982317+0000","last_clean":"2023-05-10T01:10:39.982317+0000","last_became_active":"2023-05-10T01:10:39.608796+0000","last_became_peered":"2023-05-10T01:10:39.608796+0000","last_unstale":"2023-05-10T01:10:39.982317+0000","last_undegraded":"2023-05-10T01:10:39.982317+0000","last_fullsized":"2023-05-10T01:10:39.982317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010330+0000","last_change":"2023-05-10T01:10:40.010330+0000","last_active":"2023-05-10T01:10:40.010330+0000","last_peered":"2023-05-10T01:10:40.010330+0000","last_clean":"2023-05-10T01:10:40.010330+0000","last_became_active":"2023-05-10T01:10:40.009933+0000","last_became_peered":"2023-05-10T01:10:40.009933+0000","last_unstale":"2023-05-10T01:10:40.010330+0000","last_undegraded":"2023-05-10T01:10:40.010330+0000","last_fullsized":"2023-05-10T01:10:40.010330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003941+0000","last_change":"2023-05-10T01:10:39.613626+0000","last_active":"2023-05-10T01:10:40.003941+0000","last_peered":"2023-05-10T01:10:40.003941+0000","last_clean":"2023-05-10T01:10:40.003941+0000","last_became_active":"2023-05-10T01:10:39.613263+0000","last_became_peered":"2023-05-10T01:10:39.613263+0000","last_unstale":"2023-05-10T01:10:40.003941+0000","last_undegraded":"2023-05-10T01:10:40.003941+0000","last_fullsized":"2023-05-10T01:10:40.003941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.011917+0000","last_change":"2023-05-10T01:10:40.011917+0000","last_active":"2023-05-10T01:10:40.011917+0000","last_peered":"2023-05-10T01:10:40.011917+0000","last_clean":"2023-05-10T01:10:40.011917+0000","last_became_active":"2023-05-10T01:10:40.011658+0000","last_became_peered":"2023-05-10T01:10:40.011658+0000","last_unstale":"2023-05-10T01:10:40.011917+0000","last_undegraded":"2023-05-10T01:10:40.011917+0000","last_fullsized":"2023-05-10T01:10:40.011917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.612398+0000","last_change":"2023-05-10T01:10:39.606677+0000","last_active":"2023-05-10T01:10:39.612398+0000","last_peered":"2023-05-10T01:10:39.612398+0000","last_clean":"2023-05-10T01:10:39.612398+0000","last_became_active":"2023-05-10T01:10:39.606347+0000","last_became_peered":"2023-05-10T01:10:39.606347+0000","last_unstale":"2023-05-10T01:10:39.612398+0000","last_undegraded":"2023-05-10T01:10:39.612398+0000","last_fullsized":"2023-05-10T01:10:39.612398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994402+0000","last_change":"2023-05-10T01:10:39.994402+0000","last_active":"2023-05-10T01:10:39.994402+0000","last_peered":"2023-05-10T01:10:39.994402+0000","last_clean":"2023-05-10T01:10:39.994402+0000","last_became_active":"2023-05-10T01:10:39.994232+0000","last_became_peered":"2023-05-10T01:10:39.994232+0000","last_unstale":"2023-05-10T01:10:39.994402+0000","last_undegraded":"2023-05-10T01:10:39.994402+0000","last_fullsized":"2023-05-10T01:10:39.994402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620771+0000","last_change":"2023-05-10T01:10:39.615482+0000","last_active":"2023-05-10T01:10:39.620771+0000","last_peered":"2023-05-10T01:10:39.620771+0000","last_clean":"2023-05-10T01:10:39.620771+0000","last_became_active":"2023-05-10T01:10:39.615262+0000","last_became_peered":"2023-05-10T01:10:39.615262+0000","last_unstale":"2023-05-10T01:10:39.620771+0000","last_undegraded":"2023-05-10T01:10:39.620771+0000","last_fullsized":"2023-05-10T01:10:39.620771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004360+0000","last_change":"2023-05-10T01:10:40.004360+0000","last_active":"2023-05-10T01:10:40.004360+0000","last_peered":"2023-05-10T01:10:40.004360+0000","last_clean":"2023-05-10T01:10:40.004360+0000","last_became_active":"2023-05-10T01:10:40.003933+0000","last_became_peered":"2023-05-10T01:10:40.003933+0000","last_unstale":"2023-05-10T01:10:40.004360+0000","last_undegraded":"2023-05-10T01:10:40.004360+0000","last_fullsized":"2023-05-10T01:10:40.004360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620959+0000","last_change":"2023-05-10T01:10:39.616531+0000","last_active":"2023-05-10T01:10:39.620959+0000","last_peered":"2023-05-10T01:10:39.620959+0000","last_clean":"2023-05-10T01:10:39.620959+0000","last_became_active":"2023-05-10T01:10:39.616220+0000","last_became_peered":"2023-05-10T01:10:39.616220+0000","last_unstale":"2023-05-10T01:10:39.620959+0000","last_undegraded":"2023-05-10T01:10:39.620959+0000","last_fullsized":"2023-05-10T01:10:39.620959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006375+0000","last_change":"2023-05-10T01:10:40.006375+0000","last_active":"2023-05-10T01:10:40.006375+0000","last_peered":"2023-05-10T01:10:40.006375+0000","last_clean":"2023-05-10T01:10:40.006375+0000","last_became_active":"2023-05-10T01:10:40.006111+0000","last_became_peered":"2023-05-10T01:10:40.006111+0000","last_unstale":"2023-05-10T01:10:40.006375+0000","last_undegraded":"2023-05-10T01:10:40.006375+0000","last_fullsized":"2023-05-10T01:10:40.006375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.613943+0000","last_change":"2023-05-10T01:10:39.610025+0000","last_active":"2023-05-10T01:10:39.613943+0000","last_peered":"2023-05-10T01:10:39.613943+0000","last_clean":"2023-05-10T01:10:39.613943+0000","last_became_active":"2023-05-10T01:10:39.609773+0000","last_became_peered":"2023-05-10T01:10:39.609773+0000","last_unstale":"2023-05-10T01:10:39.613943+0000","last_undegraded":"2023-05-10T01:10:39.613943+0000","last_fullsized":"2023-05-10T01:10:39.613943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004528+0000","last_change":"2023-05-10T01:10:40.004528+0000","last_active":"2023-05-10T01:10:40.004528+0000","last_peered":"2023-05-10T01:10:40.004528+0000","last_clean":"2023-05-10T01:10:40.004528+0000","last_became_active":"2023-05-10T01:10:40.004122+0000","last_became_peered":"2023-05-10T01:10:40.004122+0000","last_unstale":"2023-05-10T01:10:40.004528+0000","last_undegraded":"2023-05-10T01:10:40.004528+0000","last_fullsized":"2023-05-10T01:10:40.004528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.619374+0000","last_change":"2023-05-10T01:10:39.613386+0000","last_active":"2023-05-10T01:10:39.619374+0000","last_peered":"2023-05-10T01:10:39.619374+0000","last_clean":"2023-05-10T01:10:39.619374+0000","last_became_active":"2023-05-10T01:10:39.613094+0000","last_became_peered":"2023-05-10T01:10:39.613094+0000","last_unstale":"2023-05-10T01:10:39.619374+0000","last_undegraded":"2023-05-10T01:10:39.619374+0000","last_fullsized":"2023-05-10T01:10:39.619374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.994741+0000","last_change":"2023-05-10T01:10:39.994741+0000","last_active":"2023-05-10T01:10:39.994741+0000","last_peered":"2023-05-10T01:10:39.994741+0000","last_clean":"2023-05-10T01:10:39.994741+0000","last_became_active":"2023-05-10T01:10:39.993662+0000","last_became_peered":"2023-05-10T01:10:39.993662+0000","last_unstale":"2023-05-10T01:10:39.994741+0000","last_undegraded":"2023-05-10T01:10:39.994741+0000","last_fullsized":"2023-05-10T01:10:39.994741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.608294+0000","last_change":"2023-05-10T01:10:39.605063+0000","last_active":"2023-05-10T01:10:39.608294+0000","last_peered":"2023-05-10T01:10:39.608294+0000","last_clean":"2023-05-10T01:10:39.608294+0000","last_became_active":"2023-05-10T01:10:39.604783+0000","last_became_peered":"2023-05-10T01:10:39.604783+0000","last_unstale":"2023-05-10T01:10:39.608294+0000","last_undegraded":"2023-05-10T01:10:39.608294+0000","last_fullsized":"2023-05-10T01:10:39.608294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.012597+0000","last_change":"2023-05-10T01:10:40.012597+0000","last_active":"2023-05-10T01:10:40.012597+0000","last_peered":"2023-05-10T01:10:40.012597+0000","last_clean":"2023-05-10T01:10:40.012597+0000","last_became_active":"2023-05-10T01:10:40.012284+0000","last_became_peered":"2023-05-10T01:10:40.012284+0000","last_unstale":"2023-05-10T01:10:40.012597+0000","last_undegraded":"2023-05-10T01:10:40.012597+0000","last_fullsized":"2023-05-10T01:10:40.012597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615598+0000","last_change":"2023-05-10T01:10:39.609866+0000","last_active":"2023-05-10T01:10:39.615598+0000","last_peered":"2023-05-10T01:10:39.615598+0000","last_clean":"2023-05-10T01:10:39.615598+0000","last_became_active":"2023-05-10T01:10:39.609572+0000","last_became_peered":"2023-05-10T01:10:39.609572+0000","last_unstale":"2023-05-10T01:10:39.615598+0000","last_undegraded":"2023-05-10T01:10:39.615598+0000","last_fullsized":"2023-05-10T01:10:39.615598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003675+0000","last_change":"2023-05-10T01:10:40.003675+0000","last_active":"2023-05-10T01:10:40.003675+0000","last_peered":"2023-05-10T01:10:40.003675+0000","last_clean":"2023-05-10T01:10:40.003675+0000","last_became_active":"2023-05-10T01:10:40.003403+0000","last_became_peered":"2023-05-10T01:10:40.003403+0000","last_unstale":"2023-05-10T01:10:40.003675+0000","last_undegraded":"2023-05-10T01:10:40.003675+0000","last_fullsized":"2023-05-10T01:10:40.003675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005724+0000","last_change":"2023-05-10T01:10:39.614397+0000","last_active":"2023-05-10T01:10:40.005724+0000","last_peered":"2023-05-10T01:10:40.005724+0000","last_clean":"2023-05-10T01:10:40.005724+0000","last_became_active":"2023-05-10T01:10:39.614114+0000","last_became_peered":"2023-05-10T01:10:39.614114+0000","last_unstale":"2023-05-10T01:10:40.005724+0000","last_undegraded":"2023-05-10T01:10:40.005724+0000","last_fullsized":"2023-05-10T01:10:40.005724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.993084+0000","last_change":"2023-05-10T01:10:39.993084+0000","last_active":"2023-05-10T01:10:39.993084+0000","last_peered":"2023-05-10T01:10:39.993084+0000","last_clean":"2023-05-10T01:10:39.993084+0000","last_became_active":"2023-05-10T01:10:39.992770+0000","last_became_peered":"2023-05-10T01:10:39.992770+0000","last_unstale":"2023-05-10T01:10:39.993084+0000","last_undegraded":"2023-05-10T01:10:39.993084+0000","last_fullsized":"2023-05-10T01:10:39.993084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003432+0000","last_change":"2023-05-10T01:10:39.612192+0000","last_active":"2023-05-10T01:10:40.003432+0000","last_peered":"2023-05-10T01:10:40.003432+0000","last_clean":"2023-05-10T01:10:40.003432+0000","last_became_active":"2023-05-10T01:10:39.611914+0000","last_became_peered":"2023-05-10T01:10:39.611914+0000","last_unstale":"2023-05-10T01:10:40.003432+0000","last_undegraded":"2023-05-10T01:10:40.003432+0000","last_fullsized":"2023-05-10T01:10:40.003432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.006210+0000","last_change":"2023-05-10T01:10:40.006210+0000","last_active":"2023-05-10T01:10:40.006210+0000","last_peered":"2023-05-10T01:10:40.006210+0000","last_clean":"2023-05-10T01:10:40.006210+0000","last_became_active":"2023-05-10T01:10:40.005921+0000","last_became_peered":"2023-05-10T01:10:40.005921+0000","last_unstale":"2023-05-10T01:10:40.006210+0000","last_undegraded":"2023-05-10T01:10:40.006210+0000","last_fullsized":"2023-05-10T01:10:40.006210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.991111+0000","last_change":"2023-05-10T01:10:39.606045+0000","last_active":"2023-05-10T01:10:39.991111+0000","last_peered":"2023-05-10T01:10:39.991111+0000","last_clean":"2023-05-10T01:10:39.991111+0000","last_became_active":"2023-05-10T01:10:39.605704+0000","last_became_peered":"2023-05-10T01:10:39.605704+0000","last_unstale":"2023-05-10T01:10:39.991111+0000","last_undegraded":"2023-05-10T01:10:39.991111+0000","last_fullsized":"2023-05-10T01:10:39.991111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997244+0000","last_change":"2023-05-10T01:10:39.997244+0000","last_active":"2023-05-10T01:10:39.997244+0000","last_peered":"2023-05-10T01:10:39.997244+0000","last_clean":"2023-05-10T01:10:39.997244+0000","last_became_active":"2023-05-10T01:10:39.996995+0000","last_became_peered":"2023-05-10T01:10:39.996995+0000","last_unstale":"2023-05-10T01:10:39.997244+0000","last_undegraded":"2023-05-10T01:10:39.997244+0000","last_fullsized":"2023-05-10T01:10:39.997244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616383+0000","last_change":"2023-05-10T01:10:39.613836+0000","last_active":"2023-05-10T01:10:39.616383+0000","last_peered":"2023-05-10T01:10:39.616383+0000","last_clean":"2023-05-10T01:10:39.616383+0000","last_became_active":"2023-05-10T01:10:39.612818+0000","last_became_peered":"2023-05-10T01:10:39.612818+0000","last_unstale":"2023-05-10T01:10:39.616383+0000","last_undegraded":"2023-05-10T01:10:39.616383+0000","last_fullsized":"2023-05-10T01:10:39.616383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000815+0000","last_change":"2023-05-10T01:10:40.000815+0000","last_active":"2023-05-10T01:10:40.000815+0000","last_peered":"2023-05-10T01:10:40.000815+0000","last_clean":"2023-05-10T01:10:40.000815+0000","last_became_active":"2023-05-10T01:10:40.000489+0000","last_became_peered":"2023-05-10T01:10:40.000489+0000","last_unstale":"2023-05-10T01:10:40.000815+0000","last_undegraded":"2023-05-10T01:10:40.000815+0000","last_fullsized":"2023-05-10T01:10:40.000815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618241+0000","last_change":"2023-05-10T01:10:39.613392+0000","last_active":"2023-05-10T01:10:39.618241+0000","last_peered":"2023-05-10T01:10:39.618241+0000","last_clean":"2023-05-10T01:10:39.618241+0000","last_became_active":"2023-05-10T01:10:39.613120+0000","last_became_peered":"2023-05-10T01:10:39.613120+0000","last_unstale":"2023-05-10T01:10:39.618241+0000","last_undegraded":"2023-05-10T01:10:39.618241+0000","last_fullsized":"2023-05-10T01:10:39.618241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997139+0000","last_change":"2023-05-10T01:10:39.997139+0000","last_active":"2023-05-10T01:10:39.997139+0000","last_peered":"2023-05-10T01:10:39.997139+0000","last_clean":"2023-05-10T01:10:39.997139+0000","last_became_active":"2023-05-10T01:10:39.996940+0000","last_became_peered":"2023-05-10T01:10:39.996940+0000","last_unstale":"2023-05-10T01:10:39.997139+0000","last_undegraded":"2023-05-10T01:10:39.997139+0000","last_fullsized":"2023-05-10T01:10:39.997139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.003804+0000","last_change":"2023-05-10T01:10:39.616938+0000","last_active":"2023-05-10T01:10:40.003804+0000","last_peered":"2023-05-10T01:10:40.003804+0000","last_clean":"2023-05-10T01:10:40.003804+0000","last_became_active":"2023-05-10T01:10:39.616515+0000","last_became_peered":"2023-05-10T01:10:39.616515+0000","last_unstale":"2023-05-10T01:10:40.003804+0000","last_undegraded":"2023-05-10T01:10:40.003804+0000","last_fullsized":"2023-05-10T01:10:40.003804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005777+0000","last_change":"2023-05-10T01:10:40.005777+0000","last_active":"2023-05-10T01:10:40.005777+0000","last_peered":"2023-05-10T01:10:40.005777+0000","last_clean":"2023-05-10T01:10:40.005777+0000","last_became_active":"2023-05-10T01:10:40.005477+0000","last_became_peered":"2023-05-10T01:10:40.005477+0000","last_unstale":"2023-05-10T01:10:40.005777+0000","last_undegraded":"2023-05-10T01:10:40.005777+0000","last_fullsized":"2023-05-10T01:10:40.005777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000300+0000","last_change":"2023-05-10T01:10:39.610244+0000","last_active":"2023-05-10T01:10:40.000300+0000","last_peered":"2023-05-10T01:10:40.000300+0000","last_clean":"2023-05-10T01:10:40.000300+0000","last_became_active":"2023-05-10T01:10:39.609978+0000","last_became_peered":"2023-05-10T01:10:39.609978+0000","last_unstale":"2023-05-10T01:10:40.000300+0000","last_undegraded":"2023-05-10T01:10:40.000300+0000","last_fullsized":"2023-05-10T01:10:40.000300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.005085+0000","last_change":"2023-05-10T01:10:40.005085+0000","last_active":"2023-05-10T01:10:40.005085+0000","last_peered":"2023-05-10T01:10:40.005085+0000","last_clean":"2023-05-10T01:10:40.005085+0000","last_became_active":"2023-05-10T01:10:40.004622+0000","last_became_peered":"2023-05-10T01:10:40.004622+0000","last_unstale":"2023-05-10T01:10:40.005085+0000","last_undegraded":"2023-05-10T01:10:40.005085+0000","last_fullsized":"2023-05-10T01:10:40.005085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.998692+0000","last_change":"2023-05-10T01:10:39.609163+0000","last_active":"2023-05-10T01:10:39.998692+0000","last_peered":"2023-05-10T01:10:39.998692+0000","last_clean":"2023-05-10T01:10:39.998692+0000","last_became_active":"2023-05-10T01:10:39.608857+0000","last_became_peered":"2023-05-10T01:10:39.608857+0000","last_unstale":"2023-05-10T01:10:39.998692+0000","last_undegraded":"2023-05-10T01:10:39.998692+0000","last_fullsized":"2023-05-10T01:10:39.998692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004331+0000","last_change":"2023-05-10T01:10:40.004331+0000","last_active":"2023-05-10T01:10:40.004331+0000","last_peered":"2023-05-10T01:10:40.004331+0000","last_clean":"2023-05-10T01:10:40.004331+0000","last_became_active":"2023-05-10T01:10:40.004062+0000","last_became_peered":"2023-05-10T01:10:40.004062+0000","last_unstale":"2023-05-10T01:10:40.004331+0000","last_undegraded":"2023-05-10T01:10:40.004331+0000","last_fullsized":"2023-05-10T01:10:40.004331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617183+0000","last_change":"2023-05-10T01:10:39.611890+0000","last_active":"2023-05-10T01:10:39.617183+0000","last_peered":"2023-05-10T01:10:39.617183+0000","last_clean":"2023-05-10T01:10:39.617183+0000","last_became_active":"2023-05-10T01:10:39.611591+0000","last_became_peered":"2023-05-10T01:10:39.611591+0000","last_unstale":"2023-05-10T01:10:39.617183+0000","last_undegraded":"2023-05-10T01:10:39.617183+0000","last_fullsized":"2023-05-10T01:10:39.617183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.997087+0000","last_change":"2023-05-10T01:10:39.997087+0000","last_active":"2023-05-10T01:10:39.997087+0000","last_peered":"2023-05-10T01:10:39.997087+0000","last_clean":"2023-05-10T01:10:39.997087+0000","last_became_active":"2023-05-10T01:10:39.996788+0000","last_became_peered":"2023-05-10T01:10:39.996788+0000","last_unstale":"2023-05-10T01:10:39.997087+0000","last_undegraded":"2023-05-10T01:10:39.997087+0000","last_fullsized":"2023-05-10T01:10:39.997087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614816+0000","last_change":"2023-05-10T01:10:39.612911+0000","last_active":"2023-05-10T01:10:39.614816+0000","last_peered":"2023-05-10T01:10:39.614816+0000","last_clean":"2023-05-10T01:10:39.614816+0000","last_became_active":"2023-05-10T01:10:39.612427+0000","last_became_peered":"2023-05-10T01:10:39.612427+0000","last_unstale":"2023-05-10T01:10:39.614816+0000","last_undegraded":"2023-05-10T01:10:39.614816+0000","last_fullsized":"2023-05-10T01:10:39.614816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.000819+0000","last_change":"2023-05-10T01:10:40.000819+0000","last_active":"2023-05-10T01:10:40.000819+0000","last_peered":"2023-05-10T01:10:40.000819+0000","last_clean":"2023-05-10T01:10:40.000819+0000","last_became_active":"2023-05-10T01:10:40.000534+0000","last_became_peered":"2023-05-10T01:10:40.000534+0000","last_unstale":"2023-05-10T01:10:40.000819+0000","last_undegraded":"2023-05-10T01:10:40.000819+0000","last_fullsized":"2023-05-10T01:10:40.000819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.985807+0000","last_change":"2023-05-10T01:10:39.607141+0000","last_active":"2023-05-10T01:10:39.985807+0000","last_peered":"2023-05-10T01:10:39.985807+0000","last_clean":"2023-05-10T01:10:39.985807+0000","last_became_active":"2023-05-10T01:10:39.606490+0000","last_became_peered":"2023-05-10T01:10:39.606490+0000","last_unstale":"2023-05-10T01:10:39.985807+0000","last_undegraded":"2023-05-10T01:10:39.985807+0000","last_fullsized":"2023-05-10T01:10:39.985807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.991854+0000","last_change":"2023-05-10T01:10:39.991854+0000","last_active":"2023-05-10T01:10:39.991854+0000","last_peered":"2023-05-10T01:10:39.991854+0000","last_clean":"2023-05-10T01:10:39.991854+0000","last_became_active":"2023-05-10T01:10:39.991588+0000","last_became_peered":"2023-05-10T01:10:39.991588+0000","last_unstale":"2023-05-10T01:10:39.991854+0000","last_undegraded":"2023-05-10T01:10:39.991854+0000","last_fullsized":"2023-05-10T01:10:39.991854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617063+0000","last_change":"2023-05-10T01:10:39.611313+0000","last_active":"2023-05-10T01:10:39.617063+0000","last_peered":"2023-05-10T01:10:39.617063+0000","last_clean":"2023-05-10T01:10:39.617063+0000","last_became_active":"2023-05-10T01:10:39.611011+0000","last_became_peered":"2023-05-10T01:10:39.611011+0000","last_unstale":"2023-05-10T01:10:39.617063+0000","last_undegraded":"2023-05-10T01:10:39.617063+0000","last_fullsized":"2023-05-10T01:10:39.617063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007618+0000","last_change":"2023-05-10T01:10:40.007618+0000","last_active":"2023-05-10T01:10:40.007618+0000","last_peered":"2023-05-10T01:10:40.007618+0000","last_clean":"2023-05-10T01:10:40.007618+0000","last_became_active":"2023-05-10T01:10:40.007279+0000","last_became_peered":"2023-05-10T01:10:40.007279+0000","last_unstale":"2023-05-10T01:10:40.007618+0000","last_undegraded":"2023-05-10T01:10:40.007618+0000","last_fullsized":"2023-05-10T01:10:40.007618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621092+0000","last_change":"2023-05-10T01:10:39.618677+0000","last_active":"2023-05-10T01:10:39.621092+0000","last_peered":"2023-05-10T01:10:39.621092+0000","last_clean":"2023-05-10T01:10:39.621092+0000","last_became_active":"2023-05-10T01:10:39.618381+0000","last_became_peered":"2023-05-10T01:10:39.618381+0000","last_unstale":"2023-05-10T01:10:39.621092+0000","last_undegraded":"2023-05-10T01:10:39.621092+0000","last_fullsized":"2023-05-10T01:10:39.621092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004373+0000","last_change":"2023-05-10T01:10:40.004373+0000","last_active":"2023-05-10T01:10:40.004373+0000","last_peered":"2023-05-10T01:10:40.004373+0000","last_clean":"2023-05-10T01:10:40.004373+0000","last_became_active":"2023-05-10T01:10:40.003784+0000","last_became_peered":"2023-05-10T01:10:40.003784+0000","last_unstale":"2023-05-10T01:10:40.004373+0000","last_undegraded":"2023-05-10T01:10:40.004373+0000","last_fullsized":"2023-05-10T01:10:40.004373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616973+0000","last_change":"2023-05-10T01:10:39.608018+0000","last_active":"2023-05-10T01:10:39.616973+0000","last_peered":"2023-05-10T01:10:39.616973+0000","last_clean":"2023-05-10T01:10:39.616973+0000","last_became_active":"2023-05-10T01:10:39.607424+0000","last_became_peered":"2023-05-10T01:10:39.607424+0000","last_unstale":"2023-05-10T01:10:39.616973+0000","last_undegraded":"2023-05-10T01:10:39.616973+0000","last_fullsized":"2023-05-10T01:10:39.616973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.996040+0000","last_change":"2023-05-10T01:10:39.996040+0000","last_active":"2023-05-10T01:10:39.996040+0000","last_peered":"2023-05-10T01:10:39.996040+0000","last_clean":"2023-05-10T01:10:39.996040+0000","last_became_active":"2023-05-10T01:10:39.995768+0000","last_became_peered":"2023-05-10T01:10:39.995768+0000","last_unstale":"2023-05-10T01:10:39.996040+0000","last_undegraded":"2023-05-10T01:10:39.996040+0000","last_fullsized":"2023-05-10T01:10:39.996040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.616092+0000","last_change":"2023-05-10T01:10:39.614592+0000","last_active":"2023-05-10T01:10:39.616092+0000","last_peered":"2023-05-10T01:10:39.616092+0000","last_clean":"2023-05-10T01:10:39.616092+0000","last_became_active":"2023-05-10T01:10:39.614211+0000","last_became_peered":"2023-05-10T01:10:39.614211+0000","last_unstale":"2023-05-10T01:10:39.616092+0000","last_undegraded":"2023-05-10T01:10:39.616092+0000","last_fullsized":"2023-05-10T01:10:39.616092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.602916+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:10:39.602916+0000","last_peered":"2023-05-10T01:10:39.602916+0000","last_clean":"2023-05-10T01:10:39.602916+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:10:39.602916+0000","last_undegraded":"2023-05-10T01:10:39.602916+0000","last_fullsized":"2023-05-10T01:10:39.602916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.999727+0000","last_change":"2023-05-10T01:10:39.999727+0000","last_active":"2023-05-10T01:10:39.999727+0000","last_peered":"2023-05-10T01:10:39.999727+0000","last_clean":"2023-05-10T01:10:39.999727+0000","last_became_active":"2023-05-10T01:10:39.999469+0000","last_became_peered":"2023-05-10T01:10:39.999469+0000","last_unstale":"2023-05-10T01:10:39.999727+0000","last_undegraded":"2023-05-10T01:10:39.999727+0000","last_fullsized":"2023-05-10T01:10:39.999727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.618456+0000","last_change":"2023-05-10T01:10:39.617346+0000","last_active":"2023-05-10T01:10:39.618456+0000","last_peered":"2023-05-10T01:10:39.618456+0000","last_clean":"2023-05-10T01:10:39.618456+0000","last_became_active":"2023-05-10T01:10:39.617028+0000","last_became_peered":"2023-05-10T01:10:39.617028+0000","last_unstale":"2023-05-10T01:10:39.618456+0000","last_undegraded":"2023-05-10T01:10:39.618456+0000","last_fullsized":"2023-05-10T01:10:39.618456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.605279+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:10:39.605279+0000","last_peered":"2023-05-10T01:10:39.605279+0000","last_clean":"2023-05-10T01:10:39.605279+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:10:39.605279+0000","last_undegraded":"2023-05-10T01:10:39.605279+0000","last_fullsized":"2023-05-10T01:10:39.605279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010669+0000","last_change":"2023-05-10T01:10:40.010669+0000","last_active":"2023-05-10T01:10:40.010669+0000","last_peered":"2023-05-10T01:10:40.010669+0000","last_clean":"2023-05-10T01:10:40.010669+0000","last_became_active":"2023-05-10T01:10:40.010414+0000","last_became_peered":"2023-05-10T01:10:40.010414+0000","last_unstale":"2023-05-10T01:10:40.010669+0000","last_undegraded":"2023-05-10T01:10:40.010669+0000","last_fullsized":"2023-05-10T01:10:40.010669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.617105+0000","last_change":"2023-05-10T01:10:39.610227+0000","last_active":"2023-05-10T01:10:39.617105+0000","last_peered":"2023-05-10T01:10:39.617105+0000","last_clean":"2023-05-10T01:10:39.617105+0000","last_became_active":"2023-05-10T01:10:39.609687+0000","last_became_peered":"2023-05-10T01:10:39.609687+0000","last_unstale":"2023-05-10T01:10:39.617105+0000","last_undegraded":"2023-05-10T01:10:39.617105+0000","last_fullsized":"2023-05-10T01:10:39.617105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.595563+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:10:39.595563+0000","last_peered":"2023-05-10T01:10:39.595563+0000","last_clean":"2023-05-10T01:10:39.595563+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:10:39.595563+0000","last_undegraded":"2023-05-10T01:10:39.595563+0000","last_fullsized":"2023-05-10T01:10:39.595563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.004630+0000","last_change":"2023-05-10T01:10:40.004630+0000","last_active":"2023-05-10T01:10:40.004630+0000","last_peered":"2023-05-10T01:10:40.004630+0000","last_clean":"2023-05-10T01:10:40.004630+0000","last_became_active":"2023-05-10T01:10:40.004365+0000","last_became_peered":"2023-05-10T01:10:40.004365+0000","last_unstale":"2023-05-10T01:10:40.004630+0000","last_undegraded":"2023-05-10T01:10:40.004630+0000","last_fullsized":"2023-05-10T01:10:40.004630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.621067+0000","last_change":"2023-05-10T01:10:39.618560+0000","last_active":"2023-05-10T01:10:39.621067+0000","last_peered":"2023-05-10T01:10:39.621067+0000","last_clean":"2023-05-10T01:10:39.621067+0000","last_became_active":"2023-05-10T01:10:39.618253+0000","last_became_peered":"2023-05-10T01:10:39.618253+0000","last_unstale":"2023-05-10T01:10:39.621067+0000","last_undegraded":"2023-05-10T01:10:39.621067+0000","last_fullsized":"2023-05-10T01:10:39.621067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.601530+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:10:39.601530+0000","last_peered":"2023-05-10T01:10:39.601530+0000","last_clean":"2023-05-10T01:10:39.601530+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:10:39.601530+0000","last_undegraded":"2023-05-10T01:10:39.601530+0000","last_fullsized":"2023-05-10T01:10:39.601530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.604742+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:10:39.604742+0000","last_peered":"2023-05-10T01:10:39.604742+0000","last_clean":"2023-05-10T01:10:39.604742+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:10:39.604742+0000","last_undegraded":"2023-05-10T01:10:39.604742+0000","last_fullsized":"2023-05-10T01:10:39.604742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007440+0000","last_change":"2023-05-10T01:10:40.007440+0000","last_active":"2023-05-10T01:10:40.007440+0000","last_peered":"2023-05-10T01:10:40.007440+0000","last_clean":"2023-05-10T01:10:40.007440+0000","last_became_active":"2023-05-10T01:10:40.007166+0000","last_became_peered":"2023-05-10T01:10:40.007166+0000","last_unstale":"2023-05-10T01:10:40.007440+0000","last_undegraded":"2023-05-10T01:10:40.007440+0000","last_fullsized":"2023-05-10T01:10:40.007440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007009+0000","last_change":"2023-05-10T01:10:39.611537+0000","last_active":"2023-05-10T01:10:40.007009+0000","last_peered":"2023-05-10T01:10:40.007009+0000","last_clean":"2023-05-10T01:10:40.007009+0000","last_became_active":"2023-05-10T01:10:39.611235+0000","last_became_peered":"2023-05-10T01:10:39.611235+0000","last_unstale":"2023-05-10T01:10:40.007009+0000","last_undegraded":"2023-05-10T01:10:40.007009+0000","last_fullsized":"2023-05-10T01:10:40.007009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.605149+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:10:39.605149+0000","last_peered":"2023-05-10T01:10:39.605149+0000","last_clean":"2023-05-10T01:10:39.605149+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:10:39.605149+0000","last_undegraded":"2023-05-10T01:10:39.605149+0000","last_fullsized":"2023-05-10T01:10:39.605149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.007076+0000","last_change":"2023-05-10T01:10:40.007076+0000","last_active":"2023-05-10T01:10:40.007076+0000","last_peered":"2023-05-10T01:10:40.007076+0000","last_clean":"2023-05-10T01:10:40.007076+0000","last_became_active":"2023-05-10T01:10:40.006709+0000","last_became_peered":"2023-05-10T01:10:40.006709+0000","last_unstale":"2023-05-10T01:10:40.007076+0000","last_undegraded":"2023-05-10T01:10:40.007076+0000","last_fullsized":"2023-05-10T01:10:40.007076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.620794+0000","last_change":"2023-05-10T01:10:39.617548+0000","last_active":"2023-05-10T01:10:39.620794+0000","last_peered":"2023-05-10T01:10:39.620794+0000","last_clean":"2023-05-10T01:10:39.620794+0000","last_became_active":"2023-05-10T01:10:39.617276+0000","last_became_peered":"2023-05-10T01:10:39.617276+0000","last_unstale":"2023-05-10T01:10:39.620794+0000","last_undegraded":"2023-05-10T01:10:39.620794+0000","last_fullsized":"2023-05-10T01:10:39.620794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.607395+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:10:39.607395+0000","last_peered":"2023-05-10T01:10:39.607395+0000","last_clean":"2023-05-10T01:10:39.607395+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:10:39.607395+0000","last_undegraded":"2023-05-10T01:10:39.607395+0000","last_fullsized":"2023-05-10T01:10:39.607395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.001429+0000","last_change":"2023-05-10T01:10:40.001429+0000","last_active":"2023-05-10T01:10:40.001429+0000","last_peered":"2023-05-10T01:10:40.001429+0000","last_clean":"2023-05-10T01:10:40.001429+0000","last_became_active":"2023-05-10T01:10:40.001121+0000","last_became_peered":"2023-05-10T01:10:40.001121+0000","last_unstale":"2023-05-10T01:10:40.001429+0000","last_undegraded":"2023-05-10T01:10:40.001429+0000","last_fullsized":"2023-05-10T01:10:40.001429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.615246+0000","last_change":"2023-05-10T01:10:39.607520+0000","last_active":"2023-05-10T01:10:39.615246+0000","last_peered":"2023-05-10T01:10:39.615246+0000","last_clean":"2023-05-10T01:10:39.615246+0000","last_became_active":"2023-05-10T01:10:39.606231+0000","last_became_peered":"2023-05-10T01:10:39.606231+0000","last_unstale":"2023-05-10T01:10:39.615246+0000","last_undegraded":"2023-05-10T01:10:39.615246+0000","last_fullsized":"2023-05-10T01:10:39.615246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.601804+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:10:39.601804+0000","last_peered":"2023-05-10T01:10:39.601804+0000","last_clean":"2023-05-10T01:10:39.601804+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:10:39.601804+0000","last_undegraded":"2023-05-10T01:10:39.601804+0000","last_fullsized":"2023-05-10T01:10:39.601804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-10T01:10:40.010883+0000","last_change":"2023-05-10T01:10:40.010883+0000","last_active":"2023-05-10T01:10:40.010883+0000","last_peered":"2023-05-10T01:10:40.010883+0000","last_clean":"2023-05-10T01:10:40.010883+0000","last_became_active":"2023-05-10T01:10:40.010603+0000","last_became_peered":"2023-05-10T01:10:40.010603+0000","last_unstale":"2023-05-10T01:10:40.010883+0000","last_undegraded":"2023-05-10T01:10:40.010883+0000","last_fullsized":"2023-05-10T01:10:40.010883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:39.581830+0000","last_clean_scrub_stamp":"2023-05-10T01:10:39.581830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.614941+0000","last_change":"2023-05-10T01:10:39.610998+0000","last_active":"2023-05-10T01:10:39.614941+0000","last_peered":"2023-05-10T01:10:39.614941+0000","last_clean":"2023-05-10T01:10:39.614941+0000","last_became_active":"2023-05-10T01:10:39.610699+0000","last_became_peered":"2023-05-10T01:10:39.610699+0000","last_unstale":"2023-05-10T01:10:39.614941+0000","last_undegraded":"2023-05-10T01:10:39.614941+0000","last_fullsized":"2023-05-10T01:10:39.614941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:10:38.576991+0000","last_clean_scrub_stamp":"2023-05-10T01:10:38.576991+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-10T01:10:39.603603+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:10:39.603603+0000","last_peered":"2023-05-10T01:10:39.603603+0000","last_clean":"2023-05-10T01:10:39.603603+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:10:39.603603+0000","last_undegraded":"2023-05-10T01:10:39.603603+0000","last_fullsized":"2023-05-10T01:10:39.603603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5692,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366148,"statfs":{"total":96636764160,"available":96630935552,"internally_reserved":0,"allocated":380928,"data_stored":152640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366296,"statfs":{"total":96636764160,"available":96631087104,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5624,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366216,"statfs":{"total":96636764160,"available":96631005184,"internally_reserved":0,"allocated":376832,"data_stored":152030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5556,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366284,"statfs":{"total":96636764160,"available":96631074816,"internally_reserved":0,"allocated":372736,"data_stored":151996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5672,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366168,"statfs":{"total":96636764160,"available":96630956032,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5672,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366168,"statfs":{"total":96636764160,"available":96630956032,"internally_reserved":0,"allocated":360448,"data_stored":144817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5700,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366140,"statfs":{"total":96636764160,"available":96630927360,"internally_reserved":0,"allocated":389120,"data_stored":153554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:10:44.389 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:10:44.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:10:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.542+0000 7ff4e348b700 1 Processor -- start 2023-05-10T01:10:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.542+0000 7ff4e348b700 1 -- start start 2023-05-10T01:10:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e348b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4dc150a80 0x7ff4dc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e348b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e348b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc155730 con 0x7ff4dc0c2690 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e348b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc0bd1f0 con 0x7ff4dc0bc880 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e348b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc154b20 con 0x7ff4dc150a80 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e0a26700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e0a26700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60040/0 (socket says 172.21.15.52:60040) 2023-05-10T01:10:44.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e0a26700 1 -- 172.21.15.52:0/1904192611 learned_addr learned my addr 172.21.15.52:0/1904192611 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.543+0000 7ff4e1a28700 1 --1- 172.21.15.52:0/1904192611 >> v1:172.21.15.52:6789/0 conn(0x7ff4dc0c2690 0x7ff4dc0c2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40826/0 (socket says 172.21.15.52:40826) 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e1227700 1 --2- 172.21.15.52:0/1904192611 >> v2:172.21.15.172:3300/0 conn(0x7ff4dc150a80 0x7ff4dc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e0a26700 1 -- 172.21.15.52:0/1904192611 >> v2:172.21.15.172:3300/0 conn(0x7ff4dc150a80 msgr2=0x7ff4dc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e0a26700 1 --2- 172.21.15.52:0/1904192611 >> v2:172.21.15.172:3300/0 conn(0x7ff4dc150a80 0x7ff4dc150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e0a26700 1 -- 172.21.15.52:0/1904192611 >> v1:172.21.15.52:6789/0 conn(0x7ff4dc0c2690 legacy=0x7ff4dc0c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4dbfff700 1 -- 172.21.15.52:0/1904192611 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779995616 0 0) 0x7ff4dc155730 con 0x7ff4dc0c2690 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e0a26700 1 -- 172.21.15.52:0/1904192611 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc154e00 con 0x7ff4dc0bc880 2023-05-10T01:10:44.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e0a26700 1 --2- 172.21.15.52:0/1904192611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff4dc062f60 tx=0x7ff4d00090f0).ready entity=mon.0 client_cookie=68719c3ed3ccd8f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4dbfff700 1 -- 172.21.15.52:0/1904192611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000b600 con 0x7ff4dc0bc880 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4dbfff700 1 -- 172.21.15.52:0/1904192611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000b760 con 0x7ff4dc0bc880 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4dbfff700 1 -- 172.21.15.52:0/1904192611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000bae0 con 0x7ff4dc0bc880 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 -- 172.21.15.52:0/1904192611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 msgr2=0x7ff4dc0bcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 --2- 172.21.15.52:0/1904192611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff4dc062f60 tx=0x7ff4d00090f0).stop 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 -- 172.21.15.52:0/1904192611 shutdown_connections 2023-05-10T01:10:44.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 --2- 172.21.15.52:0/1904192611 >> v2:172.21.15.172:3300/0 conn(0x7ff4dc150a80 0x7ff4dc150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 --2- 172.21.15.52:0/1904192611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0bcd00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.544+0000 7ff4e348b700 1 -- 172.21.15.52:0/1904192611 >> 172.21.15.52:0/1904192611 conn(0x7ff4dc0c3d80 msgr2=0x7ff4dc0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.545+0000 7ff4e348b700 1 -- 172.21.15.52:0/1904192611 shutdown_connections 2023-05-10T01:10:44.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.545+0000 7ff4e348b700 1 -- 172.21.15.52:0/1904192611 wait complete. 2023-05-10T01:10:44.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.546+0000 7ff4e348b700 1 Processor -- start 2023-05-10T01:10:44.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.546+0000 7ff4e348b700 1 -- start start 2023-05-10T01:10:44.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.546+0000 7ff4e348b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4dc0c2690 0x7ff4dc151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4dc150a80 0x7ff4dc147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc154930 con 0x7ff4dc0bc880 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc143e70 con 0x7ff4dc150a80 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0aa270 con 0x7ff4dc0c2690 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60044/0 (socket says 172.21.15.52:60044) 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 -- 172.21.15.52:0/3436942902 learned_addr learned my addr 172.21.15.52:0/3436942902 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e0a26700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4dc0c2690 0x7ff4dc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1a28700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4dc150a80 0x7ff4dc147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 -- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4dc0c2690 msgr2=0x7ff4dc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4dc0c2690 0x7ff4dc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 -- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4dc150a80 msgr2=0x7ff4dc147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4dc150a80 0x7ff4dc147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 -- 172.21.15.52:0/3436942902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009370 con 0x7ff4dc0bc880 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e1227700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ff4d400d890 tx=0x7ff4d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40125f0 con 0x7ff4dc0bc880 2023-05-10T01:10:44.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4012750 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc148250 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4012ad0 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.547+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc148810 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.548+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc0aa440 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.549+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff4d4013480 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.549+0000 7ff4d97fa700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 0x7ff4bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.549+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff4d4079a20 con 0x7ff4dc0bc880 2023-05-10T01:10:44.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.549+0000 7ff4e0a26700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 0x7ff4bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.549+0000 7ff4e0a26700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 0x7ff4bc061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff4d0009130 tx=0x7ff4d0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.553+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4d404af60 con 0x7ff4dc0bc880 2023-05-10T01:10:44.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.792+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff4dc06c340 con 0x7ff4dc0bc880 2023-05-10T01:10:44.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.795+0000 7ff4d97fa700 1 -- 172.21.15.52:0/3436942902 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff4d404e580 con 0x7ff4dc0bc880 2023-05-10T01:10:44.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.797+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 msgr2=0x7ff4bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.797+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 0x7ff4bc061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff4d0009130 tx=0x7ff4d0017000).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.797+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 msgr2=0x7ff4dc0a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.797+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7ff4d400d890 tx=0x7ff4d4008040).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 shutdown_connections 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4bc05ed90 0x7ff4bc061250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4dc150a80 0x7ff4dc147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4dc0bc880 0x7ff4dc0a6a80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 --2- 172.21.15.52:0/3436942902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4dc0c2690 0x7ff4dc151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 >> 172.21.15.52:0/3436942902 conn(0x7ff4dc0c3d80 msgr2=0x7ff4dc0abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 shutdown_connections 2023-05-10T01:10:44.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.798+0000 7ff4e348b700 1 -- 172.21.15.52:0/3436942902 wait complete. 2023-05-10T01:10:44.803 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:10:44.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:10:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 Processor -- start 2023-05-10T01:10:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 -- start start 2023-05-10T01:10:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2384065700 0x7f2384154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2384067550 con 0x7f2384153ea0 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840bc9a0 con 0x7f2384068c60 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.926+0000 7f238a9a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840bcc80 con 0x7f2384065700 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2388f44700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2384065700 0x7f2384154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2383fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2384153ea0 0x7f2384066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40836/0 (socket says 172.21.15.52:40836) 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2383fff700 1 -- 172.21.15.52:0/2280579789 learned_addr learned my addr 172.21.15.52:0/2280579789 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2388f44700 1 -- 172.21.15.52:0/2280579789 >> v1:172.21.15.172:6789/0 conn(0x7f2384068c60 legacy=0x7f2384064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2388f44700 1 -- 172.21.15.52:0/2280579789 >> v1:172.21.15.52:6789/0 conn(0x7f2384153ea0 legacy=0x7f2384066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2388f44700 1 -- 172.21.15.52:0/2280579789 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840bcf60 con 0x7f2384065700 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f2388f44700 1 --2- 172.21.15.52:0/2280579789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384065700 0x7f2384154280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f237c009e60 tx=0x7f237c009780).ready entity=mon.0 client_cookie=67cffcac706d0218 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f23837fe700 1 -- 172.21.15.52:0/2280579789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00e070 con 0x7f2384065700 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f23837fe700 1 -- 172.21.15.52:0/2280579789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00bbf0 con 0x7f2384065700 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.927+0000 7f23837fe700 1 -- 172.21.15.52:0/2280579789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c012410 con 0x7f2384065700 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 -- 172.21.15.52:0/2280579789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384065700 msgr2=0x7f2384154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2280579789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384065700 0x7f2384154280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f237c009e60 tx=0x7f237c009780).stop 2023-05-10T01:10:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 -- 172.21.15.52:0/2280579789 shutdown_connections 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2280579789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384065700 0x7f2384154280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 -- 172.21.15.52:0/2280579789 >> 172.21.15.52:0/2280579789 conn(0x7f23840c4420 msgr2=0x7f23840c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 -- 172.21.15.52:0/2280579789 shutdown_connections 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.928+0000 7f238a9a7700 1 -- 172.21.15.52:0/2280579789 wait complete. 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.929+0000 7f238a9a7700 1 Processor -- start 2023-05-10T01:10:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.929+0000 7f238a9a7700 1 -- start start 2023-05-10T01:10:44.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2384065700 0x7f238414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238414a0c0 0x7f23840ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840a9280 con 0x7f2384153ea0 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c5b80 con 0x7f238414a0c0 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2384153c80 con 0x7f2384065700 2023-05-10T01:10:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60060/0 (socket says 172.21.15.52:60060) 2023-05-10T01:10:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 -- 172.21.15.52:0/2034026401 learned_addr learned my addr 172.21.15.52:0/2034026401 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f2383fff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2384065700 0x7f238414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f2388f44700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238414a0c0 0x7f23840ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 -- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2384065700 msgr2=0x7f238414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2384065700 0x7f238414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 -- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238414a0c0 msgr2=0x7f23840ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238414a0c0 0x7f23840ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 -- 172.21.15.52:0/2034026401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009a20 con 0x7f2384153ea0 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f237bfff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f236c00c470 tx=0x7f236c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00f470 con 0x7f2384153ea0 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00f5f0 con 0x7f2384153ea0 2023-05-10T01:10:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00f9b0 con 0x7f2384153ea0 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23840a94d0 con 0x7f2384153ea0 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.930+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23840c5810 con 0x7f2384153ea0 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.931+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238406c340 con 0x7f2384153ea0 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.932+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f236c019030 con 0x7f2384153ea0 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.932+0000 7f2380ff9700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 0x7f2368061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.932+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f236c079850 con 0x7f2384153ea0 2023-05-10T01:10:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.932+0000 7f2383fff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 0x7f2368061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.933+0000 7f2383fff700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 0x7f2368061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f23740016a0 tx=0x7f2374009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:44.936+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f236c04ae10 con 0x7f2384153ea0 2023-05-10T01:10:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.153+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23840bd240 con 0x7f2384153ea0 2023-05-10T01:10:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.154+0000 7f2380ff9700 1 -- 172.21.15.52:0/2034026401 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f236c021020 con 0x7f2384153ea0 2023-05-10T01:10:45.159 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:10:45.159 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:10:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 msgr2=0x7f2368061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 0x7f2368061250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f23740016a0 tx=0x7f2374009040).stop 2023-05-10T01:10:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 msgr2=0x7f2384149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f236c00c470 tx=0x7f236c007de0).stop 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 shutdown_connections 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f236805ed90 0x7f2368061250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238414a0c0 0x7f23840ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2384065700 0x7f238414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 --2- 172.21.15.52:0/2034026401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2384153ea0 0x7f2384149bd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 >> 172.21.15.52:0/2034026401 conn(0x7f23840c4420 msgr2=0x7f238415a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 shutdown_connections 2023-05-10T01:10:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.156+0000 7f238a9a7700 1 -- 172.21.15.52:0/2034026401 wait complete. 2023-05-10T01:10:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:10:45.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:10:39.978430+0000', 'modified': '2023-05-10T01:10:42.985724+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4935}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4935': {'gid': 4935, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/1729070625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 1729070625}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 1729070625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:10:45.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:10:45.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-10T01:10:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 Processor -- start 2023-05-10T01:10:45.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 -- start start 2023-05-10T01:10:45.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffbdc154160 0x7ffbdc0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc0a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 0x7ffbdc0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.698+0000 7ffbe260c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0ab1f0 con 0x7ffbdc154160 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbe260c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0c08a0 con 0x7ffbdc0aa1f0 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbe260c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0bfc90 con 0x7ffbdc154540 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffbdc154160 0x7ffbdc0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffbdc154160 0x7ffbdc0aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60066/0 (socket says 172.21.15.52:60066) 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2880365636 learned_addr learned my addr 172.21.15.52:0/2880365636 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc0a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2880365636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 msgr2=0x7ffbdc0a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/2880365636 >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 0x7ffbdc0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc0a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2880365636 >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 msgr2=0x7ffbdc0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2880365636 >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 0x7ffbdc0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2880365636 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0bff70 con 0x7ffbdc154160 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc0a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/2880365636 >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 0x7ffbdc0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc0aad00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ffbdc0c5220 tx=0x7ffbc40090f0).ready entity=mon.0 client_cookie=279e278361f06273 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdaffd700 1 -- 172.21.15.52:0/2880365636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400b600 con 0x7ffbdc154160 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdaffd700 1 -- 172.21.15.52:0/2880365636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400b760 con 0x7ffbdc154160 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.699+0000 7ffbdaffd700 1 -- 172.21.15.52:0/2880365636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400bae0 con 0x7ffbdc154160 2023-05-10T01:10:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 -- 172.21.15.52:0/2880365636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 msgr2=0x7ffbdc0aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc0aad00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ffbdc0c5220 tx=0x7ffbc40090f0).stop 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 -- 172.21.15.52:0/2880365636 shutdown_connections 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 --2- 172.21.15.52:0/2880365636 >> v2:172.21.15.172:3300/0 conn(0x7ffbdc0aa1f0 0x7ffbdc0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc0aad00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 --2- 172.21.15.52:0/2880365636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc0a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 -- 172.21.15.52:0/2880365636 >> 172.21.15.52:0/2880365636 conn(0x7ffbdc0cb6c0 msgr2=0x7ffbdc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 -- 172.21.15.52:0/2880365636 shutdown_connections 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.700+0000 7ffbe260c700 1 -- 172.21.15.52:0/2880365636 wait complete. 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.701+0000 7ffbe260c700 1 Processor -- start 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.701+0000 7ffbe260c700 1 -- start start 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbdc0aa1f0 0x7ffbdc14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0c2960 con 0x7ffbdc154160 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc157e60 con 0x7ffbdc0aa1f0 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe260c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1575c0 con 0x7ffbdc154540 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60074/0 (socket says 172.21.15.52:60074) 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbdc0aa1f0 0x7ffbdc14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/348892725 learned_addr learned my addr 172.21.15.52:0/348892725 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 msgr2=0x7ffbdc157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbdc0aa1f0 msgr2=0x7ffbdc14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbdc0aa1f0 0x7ffbdc14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/348892725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4009370 con 0x7ffbdc154160 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.702+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ffbcc00c670 tx=0x7ffbcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.703+0000 7ffbd3fff700 1 -- 172.21.15.52:0/348892725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc015070 con 0x7ffbdc154160 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.703+0000 7ffbd3fff700 1 -- 172.21.15.52:0/348892725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc010580 con 0x7ffbdc154160 2023-05-10T01:10:45.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.703+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc157900 con 0x7ffbdc154160 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.703+0000 7ffbd3fff700 1 -- 172.21.15.52:0/348892725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc010900 con 0x7ffbdc154160 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.703+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc15a780 con 0x7ffbdc154160 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.704+0000 7ffbd3fff700 1 -- 172.21.15.52:0/348892725 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffbcc010d30 con 0x7ffbdc154160 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.704+0000 7ffbd3fff700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 0x7ffbc0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.704+0000 7ffbd3fff700 1 -- 172.21.15.52:0/348892725 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffbcc079810 con 0x7ffbdc154160 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.705+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 0x7ffbc0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.705+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 0x7ffbc0061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ffbc4009130 tx=0x7ffbc4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.706+0000 7ffbf3f9eb80 1 Processor -- start 2023-05-10T01:10:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.706+0000 7ffbf3f9eb80 1 -- start start 2023-05-10T01:10:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb7c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb779710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7445e0 con 0x55b5bb7c3560 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb6bb8a0 con 0x55b5bb7c8480 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb6d0900 con 0x55b5bb77f300 2023-05-10T01:10:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60078/0 (socket says 172.21.15.52:60078) 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.707+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2667072627 learned_addr learned my addr 172.21.15.52:0/2667072627 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb779710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb7c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 msgr2=0x55b5bb779710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb779710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 msgr2=0x55b5bb7c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb7c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 -- 172.21.15.52:0/2667072627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5bb573310 con 0x55b5bb7c3560 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ffbc4006fd0 tx=0x7ffbc401f040).ready entity=mon.0 client_cookie=fe72ac2ebb45a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbd17fa700 1 -- 172.21.15.52:0/2667072627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc401d910 con 0x55b5bb7c3560 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbd17fa700 1 -- 172.21.15.52:0/2667072627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc401da70 con 0x55b5bb7c3560 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.708+0000 7ffbd17fa700 1 -- 172.21.15.52:0/2667072627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc401de10 con 0x55b5bb7c3560 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2667072627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 msgr2=0x55b5bb7a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7ffbc4006fd0 tx=0x7ffbc401f040).stop 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2667072627 shutdown_connections 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb779710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb7a6c50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2667072627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb7c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2667072627 >> 172.21.15.52:0/2667072627 conn(0x55b5bb53be40 msgr2=0x55b5bb7c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2667072627 shutdown_connections 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2667072627 wait complete. 2023-05-10T01:10:45.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 -- start start 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.709+0000 7ffbf3f9eb80 1 Processor -- start 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb77f300 0x55b5bb7aade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb7c3560 0x55b5bb77a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb697ed0 con 0x55b5bb7c8480 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7a9a60 con 0x55b5bb77f300 2023-05-10T01:10:45.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7bf130 con 0x55b5bb7c3560 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbf3f9eb80 10 client.0 ll_register_callbacks cb 0x55b5bb73e200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbe0ba9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbe0ba9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60088/0 (socket says 172.21.15.52:60088) 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/661014458 learned_addr learned my addr 172.21.15.52:0/661014458 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.710+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb7c3560 0x55b5bb77a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb77f300 0x55b5bb7aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb7c3560 msgr2=0x55b5bb77a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb7c3560 0x55b5bb77a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb77f300 msgr2=0x55b5bb7aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb77f300 0x55b5bb7aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/661014458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0bff70 con 0x55b5bb7c8480 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7ffbd4007fd0 tx=0x7ffbd4007840).ready entity=mon.0 client_cookie=dc45edfc750272ec server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4007de0 con 0x55b5bb7c8480 2023-05-10T01:10:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffbd4018400 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5bb772460 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd40187d0 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 10 client.5112 fetch_fsmap learned FSMap version 15 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b5bb6c9880 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5bb772460 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffbd4016070 con 0x55b5bb7c8480 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 10 client.5112 fetch_fsmap finished waiting for FSMap version 15 2023-05-10T01:10:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 10 client.5112 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 20 client.5112 populate_metadata read hostname 'smithi052' 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb77a920 0x55b5bb7799d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 4 client.5112 mds_command: new command op to 4935 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.711+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 --> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5bb537ca0 con 0x55b5bb77a920 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb77a920 0x55b5bb7799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb77a920 0x55b5bb7799d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=af2cf3f3a3d6dfc3 server_cookie=6fccb97194146a3b in_seq=0 out_seq=0 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbba7fc700 10 client.5112 ms_handle_connect on v2:172.21.15.52:6833/1729070625 2023-05-10T01:10:45.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbba7fc700 1 -- 172.21.15.52:0/661014458 <== mds.0 v2:172.21.15.52:6833/1729070625 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55b5bb537ca0 con 0x55b5bb77a920 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbba7fc700 10 client.5112 handle_command_reply: tid=0 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.712+0000 7ffbf3f9eb80 1 client.5112 shutdown 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 msgr2=0x55b5bb7a3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7ffbd4007fd0 tx=0x7ffbd4007840).stop 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 shutdown_connections 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb77a920 0x55b5bb7799d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a3de0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb77f300 0x55b5bb7aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/661014458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb7c3560 0x55b5bb77a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbba7fc700 0 client.5112 ms_handle_reset on v2:172.21.15.52:6833/1729070625 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 >> 172.21.15.52:0/661014458 conn(0x55b5bb53be40 msgr2=0x55b5bb7c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 shutdown_connections 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/661014458 wait complete. 2023-05-10T01:10:45.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.713+0000 7ffbf3f9eb80 20 client.5112 trim_cache size 0 max 16384 2023-05-10T01:10:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.729+0000 7ffbf3f9eb80 1 Processor -- start 2023-05-10T01:10:45.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.729+0000 7ffbf3f9eb80 1 -- start start 2023-05-10T01:10:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb77e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 0x55b5bb7be340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb77de50 con 0x55b5bb7c8480 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7723a0 con 0x55b5bb7c3560 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb780a10 con 0x55b5bb77f300 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbe0ba9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbe0ba9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60096/0 (socket says 172.21.15.52:60096) 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.730+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/847713434 learned_addr learned my addr 172.21.15.52:0/847713434 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb77e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 0x55b5bb7be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 msgr2=0x55b5bb77e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb77e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 msgr2=0x55b5bb7be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 0x55b5bb7be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 -- 172.21.15.52:0/847713434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5bb6c5070 con 0x55b5bb7c8480 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 0x55b5bb7be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ffbd40070b0 tx=0x7ffbd401f000).ready entity=mon.0 client_cookie=119350027686bbe7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbd1ffb700 1 -- 172.21.15.52:0/847713434 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd402a070 con 0x55b5bb7c8480 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbd1ffb700 1 -- 172.21.15.52:0/847713434 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4013040 con 0x55b5bb7c8480 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbd1ffb700 1 -- 172.21.15.52:0/847713434 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4018400 con 0x55b5bb7c8480 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/847713434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 msgr2=0x55b5bb7a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.731+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ffbd40070b0 tx=0x7ffbd401f000).stop 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/847713434 shutdown_connections 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c8480 0x55b5bb7a89c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb77e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/847713434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c3560 0x55b5bb7be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/847713434 >> 172.21.15.52:0/847713434 conn(0x55b5bb53be40 msgr2=0x55b5bb7dcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/847713434 shutdown_connections 2023-05-10T01:10:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/847713434 wait complete. 2023-05-10T01:10:45.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 -- start start 2023-05-10T01:10:45.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.732+0000 7ffbf3f9eb80 1 Processor -- start 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb828a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb82cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7e3180 con 0x55b5bb7c3560 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb82d470 con 0x55b5bb7c8480 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5bb7df9c0 con 0x55b5bb77f300 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbf3f9eb80 10 client.0 ll_register_callbacks cb 0x55b5bb73e200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:10:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60100/0 (socket says 172.21.15.52:60100) 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/2442528114 learned_addr learned my addr 172.21.15.52:0/2442528114 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb828a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb82cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 msgr2=0x55b5bb828a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb828a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 msgr2=0x55b5bb82cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb82cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbdb7fe700 1 -- 172.21.15.52:0/2442528114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5bb6c9880 con 0x55b5bb7c3560 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.733+0000 7ffbe0ba9700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb82cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbdb7fe700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ffbcc00cc60 tx=0x7ffbcc050040).ready entity=mon.0 client_cookie=f5a2c6cdccccafa5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc053030 con 0x55b5bb7c3560 2023-05-10T01:10:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffbcc017e50 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbc401da70 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbcc04eb90 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 10 client.5118 fetch_fsmap learned FSMap version 15 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b5bb6c4dc0 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc401da70 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffbcc04ecf0 con 0x55b5bb7c3560 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 10 client.5118 fetch_fsmap finished waiting for FSMap version 15 2023-05-10T01:10:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 10 client.5118 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 20 client.5118 populate_metadata read hostname 'smithi052' 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb7e0c30 0x55b5bb7e1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 4 client.5118 mds_command: new command op to 4935 tid=0[{"prefix": "status"}] 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 --> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b5bb56eca0 con 0x55b5bb7e0c30 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb7e0c30 0x55b5bb7e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.734+0000 7ffbba7fc700 10 client.5118 ms_handle_connect on v2:172.21.15.52:6833/1729070625 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbdbfff700 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb7e0c30 0x55b5bb7e1010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9307933b608a640f server_cookie=294c4813f8efbf71 in_seq=0 out_seq=0 2023-05-10T01:10:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbba7fc700 1 -- 172.21.15.52:0/2442528114 <== mds.0 v2:172.21.15.52:6833/1729070625 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b5bb56eca0 con 0x55b5bb7e0c30 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbba7fc700 10 client.5118 handle_command_reply: tid=0 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 client.5118 shutdown 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 msgr2=0x55b5bb82c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ffbcc00cc60 tx=0x7ffbcc050040).stop 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 shutdown_connections 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:6833/1729070625,v1:172.21.15.52:6835/1729070625] conn(0x55b5bb7e0c30 0x55b5bb7e1010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5bb7c8480 0x55b5bb82cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b5bb77f300 0x55b5bb828a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbba7fc700 0 client.5118 ms_handle_reset on v2:172.21.15.52:6833/1729070625 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 --2- 172.21.15.52:0/2442528114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bb7c3560 0x55b5bb82c710 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 >> 172.21.15.52:0/2442528114 conn(0x55b5bb53be40 msgr2=0x55b5bb778610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 shutdown_connections 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 1 -- 172.21.15.52:0/2442528114 wait complete. 2023-05-10T01:10:45.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.735+0000 7ffbf3f9eb80 20 client.5118 trim_cache size 0 max 16384 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4935, 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:10:45.750 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 5.756386891, 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 15, 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 34, 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 34, 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 12.988669807999999 2023-05-10T01:10:45.751 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 msgr2=0x7ffbc0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 0x7ffbc0061250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ffbc4009130 tx=0x7ffbc4017000).stop 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 msgr2=0x7ffbdc156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ffbcc00c670 tx=0x7ffbcc008040).stop 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 shutdown_connections 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffbc005ed90 0x7ffbc0061250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffbdc154540 0x7ffbdc157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbdc0aa1f0 0x7ffbdc14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 --2- 172.21.15.52:0/348892725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbdc154160 0x7ffbdc156b20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 >> 172.21.15.52:0/348892725 conn(0x7ffbdc0cb6c0 msgr2=0x7ffbdc0689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 shutdown_connections 2023-05-10T01:10:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.736+0000 7ffbe260c700 1 -- 172.21.15.52:0/348892725 wait complete. 2023-05-10T01:10:45.755 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:10:45.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.855+0000 7f92efa67700 1 Processor -- start 2023-05-10T01:10:45.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.855+0000 7f92efa67700 1 -- start start 2023-05-10T01:10:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.856+0000 7f92efa67700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92e8154190 0x7f92e80635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.856+0000 7f92efa67700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e80c5c40 0x7f92e8063ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.856+0000 7f92efa67700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e80aaf30 con 0x7f92e8153db0 2023-05-10T01:10:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.856+0000 7f92efa67700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e8063fc0 con 0x7f92e8154190 2023-05-10T01:10:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.856+0000 7f92efa67700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80c1440 con 0x7f92e80c5c40 2023-05-10T01:10:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92e8154190 0x7f92e80635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92e8154190 0x7f92e80635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60108/0 (socket says 172.21.15.52:60108) 2023-05-10T01:10:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed803700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f92e8153db0 0x7f92e80c0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:43428/0 (socket says 172.21.15.52:43428) 2023-05-10T01:10:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 -- 172.21.15.52:0/3282287704 learned_addr learned my addr 172.21.15.52:0/3282287704 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ee004700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e80c5c40 0x7f92e8063ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 -- 172.21.15.52:0/3282287704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e80c5c40 msgr2=0x7f92e8063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e80c5c40 0x7f92e8063ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 -- 172.21.15.52:0/3282287704 >> v1:172.21.15.172:6789/0 conn(0x7f92e8153db0 legacy=0x7f92e80c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 -- 172.21.15.52:0/3282287704 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e80c1720 con 0x7f92e8154190 2023-05-10T01:10:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ed002700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e8154190 0x7f92e80635e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f92dc006fd0 tx=0x7f92dc0090f0).ready entity=mon.0 client_cookie=52641f430cf1ad7a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ec801700 1 -- 172.21.15.52:0/3282287704 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839224740 0 0) 0x7f92e80aaf30 con 0x7f92e8153db0 2023-05-10T01:10:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ec801700 1 -- 172.21.15.52:0/3282287704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00b580 con 0x7f92e8154190 2023-05-10T01:10:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ec801700 1 -- 172.21.15.52:0/3282287704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00b6e0 con 0x7f92e8154190 2023-05-10T01:10:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.857+0000 7f92ec801700 1 -- 172.21.15.52:0/3282287704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00ba60 con 0x7f92e8154190 2023-05-10T01:10:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 -- 172.21.15.52:0/3282287704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e8154190 msgr2=0x7f92e80635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e8154190 0x7f92e80635e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f92dc006fd0 tx=0x7f92dc0090f0).stop 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 -- 172.21.15.52:0/3282287704 shutdown_connections 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e80c5c40 0x7f92e8063ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 --2- 172.21.15.52:0/3282287704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e8154190 0x7f92e80635e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 -- 172.21.15.52:0/3282287704 >> 172.21.15.52:0/3282287704 conn(0x7f92e80cac90 msgr2=0x7f92e80cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 -- 172.21.15.52:0/3282287704 shutdown_connections 2023-05-10T01:10:45.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.858+0000 7f92efa67700 1 -- 172.21.15.52:0/3282287704 wait complete. 2023-05-10T01:10:45.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.859+0000 7f92efa67700 1 Processor -- start 2023-05-10T01:10:45.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.859+0000 7f92efa67700 1 -- start start 2023-05-10T01:10:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e8153db0 0x7f92e80c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 0x7f92e81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8155350 con 0x7f92e80c5c40 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e814edc0 con 0x7f92e8154190 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92efa67700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8154780 con 0x7f92e8153db0 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60112/0 (socket says 172.21.15.52:60112) 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 -- 172.21.15.52:0/3830329194 learned_addr learned my addr 172.21.15.52:0/3830329194 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed002700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e8153db0 0x7f92e80c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ee004700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 0x7f92e81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 -- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e8153db0 msgr2=0x7f92e80c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e8153db0 0x7f92e80c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 -- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 msgr2=0x7f92e81557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 0x7f92e81557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ed803700 1 -- 172.21.15.52:0/3830329194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc009370 con 0x7f92e80c5c40 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.860+0000 7f92ee004700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 0x7f92e81557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92ed803700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f92e000c560 tx=0x7f92e0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00072e0 con 0x7f92e80c5c40 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0007440 con 0x7f92e80c5c40 2023-05-10T01:10:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e8154a20 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00058f0 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.861+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e8154fe0 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.862+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8155630 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.862+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f92e0010070 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.863+0000 7f92e5ffb700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 0x7f92c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.863+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f92e0079180 con 0x7f92e80c5c40 2023-05-10T01:10:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.863+0000 7f92ed002700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 0x7f92c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:45.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.863+0000 7f92ed002700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 0x7f92c8061250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f92e81545b0 tx=0x7f92dc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:45.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:45.867+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f92e004a720 con 0x7f92e80c5c40 2023-05-10T01:10:46.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.084+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92e805ef90 con 0x7f92e80c5c40 2023-05-10T01:10:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.085+0000 7f92e5ffb700 1 -- 172.21.15.52:0/3830329194 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f92e004dd40 con 0x7f92e80c5c40 2023-05-10T01:10:46.091 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:10:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 msgr2=0x7f92c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 0x7f92c8061250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f92e81545b0 tx=0x7f92dc017000).stop 2023-05-10T01:10:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 msgr2=0x7f92e814e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f92e000c560 tx=0x7f92e0007c90).stop 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 shutdown_connections 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f92c805ed90 0x7f92c8061250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92e8154190 0x7f92e81557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80c5c40 0x7f92e814e8d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 --2- 172.21.15.52:0/3830329194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92e8153db0 0x7f92e80c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 >> 172.21.15.52:0/3830329194 conn(0x7f92e80cac90 msgr2=0x7f92e80ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 shutdown_connections 2023-05-10T01:10:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.087+0000 7f92efa67700 1 -- 172.21.15.52:0/3830329194 wait complete. 2023-05-10T01:10:46.103 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:10:46.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:10:46.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:10:46.105 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:10:46.106 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:46.106 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:10:46.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:10:46.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:10:46.109 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:10:46.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.110 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:10:46.128 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:10:46.128 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:10:46.129 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:10:46.129 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.129 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:10:46.130 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.130 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:46.131 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:46.131 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:10:46.131 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:10:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42190sec preferred_lft 42190sec 2023-05-10T01:10:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:10:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.133 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:46.134 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:46.134 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:10:46.134 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.135 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:10:46.136 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:10:46.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.137 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:10:46.192 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:10:46.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.193 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:10:46.249 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:10:46.250 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:10:46.250 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:10:46.250 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:10:46.250 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:10:46.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.252 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:10:46.252 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:10:46.252 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:10:46.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:10:46.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:10:46.253 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:10:46.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.350 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:10:46.364 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:10:46.365 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:10:46.365 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:10:46.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:10:46.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.429 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:46.484 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:10:46.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:46.563 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:46.564 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:10:46.606 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:10:46.607 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:10:46.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:10:46.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:10:46.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:10:46.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:10:46.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.828+0000 7f9e5a58f700 1 Processor -- start 2023-05-10T01:10:46.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.828+0000 7f9e5a58f700 1 -- start start 2023-05-10T01:10:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e5a58f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e54154160 0x7f9e540c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e5a58f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e5a58f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540c0650 con 0x7f9e54069690 2023-05-10T01:10:46.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e5a58f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540c1af0 con 0x7f9e54154160 2023-05-10T01:10:46.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e5a58f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540bfd20 con 0x7f9e54154540 2023-05-10T01:10:46.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e53fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e54154160 0x7f9e540c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e53fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e54154160 0x7f9e540c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60126/0 (socket says 172.21.15.52:60126) 2023-05-10T01:10:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.829+0000 7f9e53fff700 1 -- 172.21.15.52:0/1959814344 learned_addr learned my addr 172.21.15.52:0/1959814344 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e4bfff700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e53fff700 1 -- 172.21.15.52:0/1959814344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 msgr2=0x7f9e540c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e53fff700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e53fff700 1 -- 172.21.15.52:0/1959814344 >> v1:172.21.15.172:6789/0 conn(0x7f9e54069690 legacy=0x7f9e54157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e53fff700 1 -- 172.21.15.52:0/1959814344 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540c0000 con 0x7f9e54154160 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e53fff700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54154160 0x7f9e540c5c60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f9e44006fd0 tx=0x7f9e440090f0).ready entity=mon.0 client_cookie=37b4a5f38b244f53 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e537fe700 1 -- 172.21.15.52:0/1959814344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400b600 con 0x7f9e54154160 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e537fe700 1 -- 172.21.15.52:0/1959814344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4400b760 con 0x7f9e54154160 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e537fe700 1 -- 172.21.15.52:0/1959814344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400bb00 con 0x7f9e54154160 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e5a58f700 1 -- 172.21.15.52:0/1959814344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54154160 msgr2=0x7f9e540c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.830+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54154160 0x7f9e540c5c60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f9e44006fd0 tx=0x7f9e440090f0).stop 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 -- 172.21.15.52:0/1959814344 shutdown_connections 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54154160 0x7f9e540c5c60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/1959814344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 -- 172.21.15.52:0/1959814344 >> 172.21.15.52:0/1959814344 conn(0x7f9e540cb6f0 msgr2=0x7f9e540c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 -- 172.21.15.52:0/1959814344 shutdown_connections 2023-05-10T01:10:46.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.831+0000 7f9e5a58f700 1 -- 172.21.15.52:0/1959814344 wait complete. 2023-05-10T01:10:46.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 Processor -- start 2023-05-10T01:10:46.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 -- start start 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e54154160 0x7f9e541643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e541577d0 con 0x7f9e54069690 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54154950 con 0x7f9e54154160 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.832+0000 7f9e5a58f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54164bc0 con 0x7f9e54154540 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60132/0 (socket says 172.21.15.52:60132) 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 -- 172.21.15.52:0/3925789534 learned_addr learned my addr 172.21.15.52:0/3925789534 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e58b2c700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e4bfff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e54154160 0x7f9e541643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 -- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 msgr2=0x7f9e540abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 -- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e54154160 msgr2=0x7f9e541643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:46.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e54154160 0x7f9e541643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 -- 172.21.15.52:0/3925789534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009370 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e53fff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9e44009f50 tx=0x7f9e44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400b8d0 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4400ba30 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e54164ea0 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440246c0 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.833+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e54154ba0 con 0x7f9e54069690 2023-05-10T01:10:46.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.834+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e540666b0 con 0x7f9e54069690 2023-05-10T01:10:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.835+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9e4400f070 con 0x7f9e54069690 2023-05-10T01:10:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.835+0000 7f9e50ff9700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 0x7f9e38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.835+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e4407b8c0 con 0x7f9e54069690 2023-05-10T01:10:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.835+0000 7f9e4bfff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 0x7f9e38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.835+0000 7f9e4bfff700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 0x7f9e38061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9e540ac8a0 tx=0x7f9e3c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:46.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:46.839+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e4404ce60 con 0x7f9e54069690 2023-05-10T01:10:47.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.040+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e5406c340 con 0x7f9e3805ed90 2023-05-10T01:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.042+0000 7f9e50ff9700 1 -- 172.21.15.52:0/3925789534 <== mgr.4103 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9e5406c340 con 0x7f9e3805ed90 2023-05-10T01:10:47.046 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:10:47.046 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:10:47.046 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:10:47.046 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:10:47.047 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:10:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 msgr2=0x7f9e38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 0x7f9e38061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9e540ac8a0 tx=0x7f9e3c008040).stop 2023-05-10T01:10:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 msgr2=0x7f9e54165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9e44009f50 tx=0x7f9e44017000).stop 2023-05-10T01:10:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 shutdown_connections 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9e3805ed90 0x7f9e38061250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e54154540 0x7f9e540abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e54069690 0x7f9e54165560 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 --2- 172.21.15.52:0/3925789534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e54154160 0x7f9e541643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 >> 172.21.15.52:0/3925789534 conn(0x7f9e540cb6f0 msgr2=0x7f9e540ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 shutdown_connections 2023-05-10T01:10:47.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.044+0000 7f9e5a58f700 1 -- 172.21.15.52:0/3925789534 wait complete. 2023-05-10T01:10:47.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:10:47.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.174+0000 7f7049828700 1 Processor -- start 2023-05-10T01:10:47.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.174+0000 7f7049828700 1 -- start start 2023-05-10T01:10:47.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7049828700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70440cb410 0x7f70441544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7049828700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7044155570 0x7f7044068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7049828700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440c6310 con 0x7f7044154110 2023-05-10T01:10:47.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7049828700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440c6830 con 0x7f7044155570 2023-05-10T01:10:47.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7049828700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70441550e0 con 0x7f70440cb410 2023-05-10T01:10:47.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7042ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7044154110 0x7f70440c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40924/0 (socket says 172.21.15.52:40924) 2023-05-10T01:10:47.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7042ffd700 1 -- 172.21.15.52:0/638320517 learned_addr learned my addr 172.21.15.52:0/638320517 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:47.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 --2- 172.21.15.52:0/638320517 >> v2:172.21.15.52:3300/0 conn(0x7f7044155570 0x7f7044068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70427fc700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70440cb410 0x7f70441544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7041ffb700 1 -- 172.21.15.52:0/638320517 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916221402 0 0) 0x7f703c001610 con 0x7f7044154110 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7041ffb700 1 -- 172.21.15.52:0/638320517 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70240033f0 con 0x7f7044154110 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 -- 172.21.15.52:0/638320517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70440cb410 msgr2=0x7f70441544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70440cb410 0x7f70441544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 -- 172.21.15.52:0/638320517 >> v1:172.21.15.52:6789/0 conn(0x7f7044154110 legacy=0x7f70440c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 -- 172.21.15.52:0/638320517 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440c6550 con 0x7f7044155570 2023-05-10T01:10:47.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f70437fe700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f7044068150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7034009790 tx=0x7f7034009060).ready entity=mon.0 client_cookie=89e11a3d8b816740 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7041ffb700 1 -- 172.21.15.52:0/638320517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400f510 con 0x7f7044155570 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7041ffb700 1 -- 172.21.15.52:0/638320517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703400f670 con 0x7f7044155570 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.175+0000 7f7041ffb700 1 -- 172.21.15.52:0/638320517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703400f9f0 con 0x7f7044155570 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 -- 172.21.15.52:0/638320517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 msgr2=0x7f7044068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f7044068150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7034009790 tx=0x7f7034009060).stop 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 -- 172.21.15.52:0/638320517 shutdown_connections 2023-05-10T01:10:47.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f7044068150 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 --2- 172.21.15.52:0/638320517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70440cb410 0x7f70441544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 -- 172.21.15.52:0/638320517 >> 172.21.15.52:0/638320517 conn(0x7f70440678d0 msgr2=0x7f70440cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 -- 172.21.15.52:0/638320517 shutdown_connections 2023-05-10T01:10:47.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.176+0000 7f7049828700 1 -- 172.21.15.52:0/638320517 wait complete. 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.177+0000 7f7049828700 1 Processor -- start 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.177+0000 7f7049828700 1 -- start start 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70440cb410 0x7f70440aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7044154110 0x7f7044150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704414d2d0 con 0x7f7044155570 2023-05-10T01:10:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ab3e0 con 0x7f70440cb410 2023-05-10T01:10:47.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7049828700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ab6c0 con 0x7f7044154110 2023-05-10T01:10:47.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60150/0 (socket says 172.21.15.52:60150) 2023-05-10T01:10:47.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 -- 172.21.15.52:0/334749457 learned_addr learned my addr 172.21.15.52:0/334749457 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:47.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70427fc700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7044154110 0x7f7044150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f7042ffd700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70440cb410 0x7f70440aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 -- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7044154110 msgr2=0x7f7044150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7044154110 0x7f7044150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 -- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70440cb410 msgr2=0x7f70440aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70440cb410 0x7f70440aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 -- 172.21.15.52:0/334749457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340092a0 con 0x7f7044155570 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.178+0000 7f70437fe700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7044083c40 tx=0x7f7034017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:47.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.179+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034024070 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.179+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034011760 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.179+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011b00 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.179+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440ab9a0 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.179+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704414e0e0 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.180+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704414df40 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.180+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7034030070 con 0x7f7044155570 2023-05-10T01:10:47.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.180+0000 7f703affd700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 0x7f7028061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:47.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.181+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7034082ce0 con 0x7f7044155570 2023-05-10T01:10:47.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.181+0000 7f7042ffd700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 0x7f7028061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:47.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.181+0000 7f7042ffd700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 0x7f7028061280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f703c000f80 tx=0x7f703c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:47.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.184+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f704414df40 con 0x7f7044155570 2023-05-10T01:10:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:47.406+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f704414df40 con 0x7f7044155570 2023-05-10T01:10:48.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.009+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f703400f070 con 0x7f7044155570 2023-05-10T01:10:48.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.011+0000 7f703affd700 1 -- 172.21.15.52:0/334749457 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f70340499c0 con 0x7f7044155570 2023-05-10T01:10:48.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 msgr2=0x7f7028061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 0x7f7028061280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f703c000f80 tx=0x7f703c009040).stop 2023-05-10T01:10:48.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 msgr2=0x7f70440ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f7044083c40 tx=0x7f7034017000).stop 2023-05-10T01:10:48.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 shutdown_connections 2023-05-10T01:10:48.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702805edc0 0x7f7028061280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7044155570 0x7f70440ac920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70440cb410 0x7f70440aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 --2- 172.21.15.52:0/334749457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7044154110 0x7f7044150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 >> 172.21.15.52:0/334749457 conn(0x7f70440678d0 msgr2=0x7f70440c02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:48.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.013+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 shutdown_connections 2023-05-10T01:10:48.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.014+0000 7f7049828700 1 -- 172.21.15.52:0/334749457 wait complete. 2023-05-10T01:10:48.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:10:48.153 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:48.150+0000 7f0c22330680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:10:48.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.157+0000 7f59752f4700 1 Processor -- start 2023-05-10T01:10:48.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.157+0000 7f59752f4700 1 -- start start 2023-05-10T01:10:48.161 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:48.157+0000 7f4b77082680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:10:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f59752f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5970068860 0x7f59700aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f59752f4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59700c94c0 con 0x7f5970154080 2023-05-10T01:10:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f59752f4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59700cb7d0 con 0x7f5970154460 2023-05-10T01:10:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f59752f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59700c88b0 con 0x7f5970068860 2023-05-10T01:10:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596effd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5970154080 0x7f59700a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40968/0 (socket says 172.21.15.52:40968) 2023-05-10T01:10:48.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5970068860 0x7f59700aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596effd700 1 -- 172.21.15.52:0/2277144909 learned_addr learned my addr 172.21.15.52:0/2277144909 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:48.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596f7fe700 1 -- 172.21.15.52:0/2277144909 >> v1:172.21.15.172:6789/0 conn(0x7f5970154460 legacy=0x7f5970068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596f7fe700 1 -- 172.21.15.52:0/2277144909 >> v1:172.21.15.52:6789/0 conn(0x7f5970154080 legacy=0x7f59700a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596dffb700 1 -- 172.21.15.52:0/2277144909 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132374105 0 0) 0x7f59700c94c0 con 0x7f5970154080 2023-05-10T01:10:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596f7fe700 1 -- 172.21.15.52:0/2277144909 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700c8b90 con 0x7f5970068860 2023-05-10T01:10:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.158+0000 7f596f7fe700 1 --2- 172.21.15.52:0/2277144909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970068860 0x7f59700aac90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f5968009e60 tx=0x7f5968009780).ready entity=mon.0 client_cookie=a94073eee7f78ae3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f596dffb700 1 -- 172.21.15.52:0/2277144909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596800e070 con 0x7f5970068860 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f596dffb700 1 -- 172.21.15.52:0/2277144909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596800bc30 con 0x7f5970068860 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f596dffb700 1 -- 172.21.15.52:0/2277144909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968012410 con 0x7f5970068860 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 -- 172.21.15.52:0/2277144909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970068860 msgr2=0x7f59700aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 --2- 172.21.15.52:0/2277144909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970068860 0x7f59700aac90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f5968009e60 tx=0x7f5968009780).stop 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 -- 172.21.15.52:0/2277144909 shutdown_connections 2023-05-10T01:10:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 --2- 172.21.15.52:0/2277144909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970068860 0x7f59700aac90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 -- 172.21.15.52:0/2277144909 >> 172.21.15.52:0/2277144909 conn(0x7f5970067910 msgr2=0x7f59700cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 -- 172.21.15.52:0/2277144909 shutdown_connections 2023-05-10T01:10:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.159+0000 7f59752f4700 1 -- 172.21.15.52:0/2277144909 wait complete. 2023-05-10T01:10:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 Processor -- start 2023-05-10T01:10:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 -- start start 2023-05-10T01:10:48.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5970068860 0x7f59700ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5970154080 0x7f59700c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700b0ca0 con 0x7f5970154460 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700acd40 con 0x7f5970154080 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f59752f4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700ac730 con 0x7f5970068860 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60194/0 (socket says 172.21.15.52:60194) 2023-05-10T01:10:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f596f7fe700 1 -- 172.21.15.52:0/2873475020 learned_addr learned my addr 172.21.15.52:0/2873475020 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.161+0000 7f596e7fc700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5970154080 0x7f59700c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596effd700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5970068860 0x7f59700ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 -- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5970068860 msgr2=0x7f59700ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5970068860 0x7f59700ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 -- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5970154080 msgr2=0x7f59700c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5970154080 0x7f59700c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 -- 172.21.15.52:0/2873475020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968009a20 con 0x7f5970154460 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f596f7fe700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f596800b6c0 tx=0x7f5968009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680063d0 con 0x7f5970154460 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968006530 con 0x7f5970154460 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700b09c0 con 0x7f5970154460 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680068d0 con 0x7f5970154460 2023-05-10T01:10:48.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.162+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700c4990 con 0x7f5970154460 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.163+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59700ac590 con 0x7f5970154460 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.163+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f5968027460 con 0x7f5970154460 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.164+0000 7f5956ffd700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 0x7f59500612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.164+0000 7f596effd700 1 -- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 msgr2=0x7f59500612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.164+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f596807c040 con 0x7f5970154460 2023-05-10T01:10:48.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.164+0000 7f596effd700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 0x7f59500612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:10:48.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.168+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59700ac590 con 0x7f5970154460 2023-05-10T01:10:48.217 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:48.214+0000 7f0c22330680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:10:48.228 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:48.224+0000 7f4b77082680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:10:48.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.343+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f59700ac590 con 0x7f5970154460 2023-05-10T01:10:48.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.347+0000 7f5956ffd700 1 -- 172.21.15.52:0/2873475020 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f59700ac590 con 0x7f5970154460 2023-05-10T01:10:48.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 msgr2=0x7f59500612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:10:48.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 0x7f59500612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:48.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 msgr2=0x7f5970163800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f596800b6c0 tx=0x7f5968009780).stop 2023-05-10T01:10:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 shutdown_connections 2023-05-10T01:10:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f595005ede0 0x7f59500612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5970154460 0x7f5970163800 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5970068860 0x7f59700ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 --2- 172.21.15.52:0/2873475020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5970154080 0x7f59700c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 >> 172.21.15.52:0/2873475020 conn(0x7f5970067910 msgr2=0x7f59700c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 shutdown_connections 2023-05-10T01:10:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.349+0000 7f59752f4700 1 -- 172.21.15.52:0/2873475020 wait complete. 2023-05-10T01:10:48.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:48.366 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:10:48.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:48.385 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-05-10T01:10:48.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-05-10T01:10:48.491 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:48.487+0000 7f0c22330680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:10:48.519 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:48.513+0000 7f4b77082680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:10:48.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.603+0000 7f1d51992700 1 Processor -- start 2023-05-10T01:10:48.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.603+0000 7f1d51992700 1 -- start start 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d51992700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 0x7f1d4c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d51992700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 0x7f1d4c068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d51992700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0c94c0 con 0x7f1d4c154460 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d51992700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0cb7d0 con 0x7f1d4c068150 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d51992700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c068a60 con 0x7f1d4c154080 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4a7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d4c154460 0x7f1d4c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41018/0 (socket says 172.21.15.52:41018) 2023-05-10T01:10:48.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4a7fc700 1 -- 172.21.15.52:0/2604680996 learned_addr learned my addr 172.21.15.52:0/2604680996 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4b7fe700 1 --2- 172.21.15.52:0/2604680996 >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 0x7f1d4c068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 --2- 172.21.15.52:0/2604680996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 0x7f1d4c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d49ffb700 1 -- 172.21.15.52:0/2604680996 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121542927 0 0) 0x7f1d4c0c94c0 con 0x7f1d4c154460 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d49ffb700 1 -- 172.21.15.52:0/2604680996 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d380033f0 con 0x7f1d4c154460 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 -- 172.21.15.52:0/2604680996 >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 msgr2=0x7f1d4c068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 --2- 172.21.15.52:0/2604680996 >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 0x7f1d4c068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 -- 172.21.15.52:0/2604680996 >> v1:172.21.15.52:6789/0 conn(0x7f1d4c154460 legacy=0x7f1d4c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 -- 172.21.15.52:0/2604680996 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0c88b0 con 0x7f1d4c154080 2023-05-10T01:10:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4b7fe700 1 --2- 172.21.15.52:0/2604680996 >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 0x7f1d4c068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.604+0000 7f1d4affd700 1 --2- 172.21.15.52:0/2604680996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 0x7f1d4c0aac90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1d3c009760 tx=0x7f1d3c009060).ready entity=mon.2 client_cookie=d0f400d4c2f8a365 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d49ffb700 1 -- 172.21.15.52:0/2604680996 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c00d4a0 con 0x7f1d4c154080 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d49ffb700 1 -- 172.21.15.52:0/2604680996 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c00d600 con 0x7f1d4c154080 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d49ffb700 1 -- 172.21.15.52:0/2604680996 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c00d980 con 0x7f1d4c154080 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 -- 172.21.15.52:0/2604680996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 msgr2=0x7f1d4c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 --2- 172.21.15.52:0/2604680996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 0x7f1d4c0aac90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1d3c009760 tx=0x7f1d3c009060).stop 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 -- 172.21.15.52:0/2604680996 shutdown_connections 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 --2- 172.21.15.52:0/2604680996 >> v2:172.21.15.172:3300/0 conn(0x7f1d4c068150 0x7f1d4c068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 --2- 172.21.15.52:0/2604680996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154080 0x7f1d4c0aac90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 -- 172.21.15.52:0/2604680996 >> 172.21.15.52:0/2604680996 conn(0x7f1d4c067910 msgr2=0x7f1d4c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:48.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 -- 172.21.15.52:0/2604680996 shutdown_connections 2023-05-10T01:10:48.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.605+0000 7f1d51992700 1 -- 172.21.15.52:0/2604680996 wait complete. 2023-05-10T01:10:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.607+0000 7f1d51992700 1 Processor -- start 2023-05-10T01:10:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.607+0000 7f1d51992700 1 -- start start 2023-05-10T01:10:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.607+0000 7f1d51992700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 0x7f1d4c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.607+0000 7f1d51992700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154460 0x7f1d4c164510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c151880 con 0x7f1d4c154080 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ae630 con 0x7f1d4c068150 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0add00 con 0x7f1d4c154460 2023-05-10T01:10:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60240/0 (socket says 172.21.15.52:60240) 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 -- 172.21.15.52:0/4146885608 learned_addr learned my addr 172.21.15.52:0/4146885608 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 0x7f1d4c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4b7fe700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154460 0x7f1d4c164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154460 msgr2=0x7f1d4c164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154460 0x7f1d4c164510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 msgr2=0x7f1d4c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 0x7f1d4c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009a20 con 0x7f1d4c154080 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 0x7f1d4c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d4a7fc700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1d4000c410 tx=0x7f1d40007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000ce10 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d400072e0 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0092a0 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400057a0 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.608+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c0ae2c0 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.609+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0ae7e0 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.610+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1d4001a060 con 0x7f1d4c154080 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.610+0000 7f1d32ffd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.610+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d40079050 con 0x7f1d4c154080 2023-05-10T01:10:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.610+0000 7f1d4affd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.610+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:10:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.619+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d4c0ae7e0 con 0x7f1d4c154080 2023-05-10T01:10:48.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.811+0000 7f1d4affd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:48.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.811+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:10:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:48.818+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d4c0ae7a0 con 0x7f1d2c05ede0 2023-05-10T01:10:49.102 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:49.098+0000 7f0c22330680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:10:49.173 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:49.169+0000 7f0c22330680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:10:49.180 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:49.177+0000 7f4b77082680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:10:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:49.212+0000 7f1d4affd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:49.212+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:10:49.248 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:49.245+0000 7f4b77082680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:10:49.360 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:49.353+0000 7f0c22330680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:10:49.439 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:49.436+0000 7f4b77082680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:10:49.772 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:49.768+0000 7f0c22330680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:10:49.871 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:49.867+0000 7f4b77082680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:10:49.873 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:49.869+0000 7f0c22330680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:10:49.977 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:49.974+0000 7f4b77082680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:10:50.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:50.013+0000 7f1d4affd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:50.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:50.013+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:10:50.024 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:50.020+0000 7f0c22330680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:10:50.097 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:50.093+0000 7f0c22330680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:10:50.134 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:50.131+0000 7f4b77082680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:10:50.163 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:50.159+0000 7f0c22330680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:10:50.211 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:50.208+0000 7f4b77082680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:10:50.281 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:50.277+0000 7f4b77082680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:10:50.418 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:50.415+0000 7f0c22330680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:10:50.549 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:50.545+0000 7f4b77082680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:10:50.599 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:50.596+0000 7f0c22330680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:10:50.739 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:50.736+0000 7f4b77082680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:10:51.240 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.237+0000 7f0c22330680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:10:51.306 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.303+0000 7f0c22330680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:10:51.379 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.377+0000 7f0c22330680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:10:51.412 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.409+0000 7f4b77082680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:10:51.481 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.479+0000 7f4b77082680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:10:51.523 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.520+0000 7f0c22330680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:10:51.560 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.557+0000 7f4b77082680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:10:51.592 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.589+0000 7f0c22330680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:10:51.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:51.616+0000 7f1d4affd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:10:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:51.616+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:10:51.807 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.702+0000 7f0c22330680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:10:51.807 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.707+0000 7f4b77082680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:10:51.807 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.778+0000 7f4b77082680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:10:51.811 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:51.808+0000 7f0c22330680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:10:51.899 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:51.896+0000 7f4b77082680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:10:52.010 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:52.007+0000 7f4b77082680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:10:52.099 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.096+0000 7f0c22330680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:10:52.167 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.164+0000 7f0c22330680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:10:52.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:52.234+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 6) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f1d40010070 con 0x7f1d4c154080 2023-05-10T01:10:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:52.234+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:10:52.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:52.234+0000 7f1d32ffd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:10:52.292 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0ba0b12700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0ba0b12700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0ba0b12700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0ba0b12700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0ba0b12700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0b9db0c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0b9db0c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.294 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0b9db0c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.294 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0b9db0c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.294 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:10:52.289+0000 7f0b9db0c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:10:52.314 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:52.311+0000 7f4b77082680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:10:52.386 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:10:52.383+0000 7f4b77082680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:10:53.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.250+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f1d400772d0 con 0x7f1d4c154080 2023-05-10T01:10:53.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.250+0000 7f1d32ffd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c02fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.250+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d4c0ae7a0 con 0x7f1d2c05ede0 2023-05-10T01:10:53.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.252+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c02fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.253+0000 7f1d4affd700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c02fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1d4c0b0df0 tx=0x7f1d3c016000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.281+0000 7f1d32ffd700 1 -- 172.21.15.52:0/4146885608 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1d4c0ae7a0 con 0x7f1d2c05ede0 2023-05-10T01:10:53.284 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir0 2023-05-10T01:10:53.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 msgr2=0x7f1d2c02fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c02fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1d4c0b0df0 tx=0x7f1d3c016000).stop 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 msgr2=0x7f1d4c150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1d4000c410 tx=0x7f1d40007bd0).stop 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 shutdown_connections 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d2c05ede0 0x7f1d2c02fd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d4c154460 0x7f1d4c164510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c068150 0x7f1d4c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 --2- 172.21.15.52:0/4146885608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d4c154080 0x7f1d4c150f80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 >> 172.21.15.52:0/4146885608 conn(0x7f1d4c067910 msgr2=0x7f1d4c14f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 shutdown_connections 2023-05-10T01:10:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.284+0000 7f1d51992700 1 -- 172.21.15.52:0/4146885608 wait complete. 2023-05-10T01:10:53.301 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-05-10T01:10:53.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:53.302 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-05-10T01:10:53.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-05-10T01:10:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.526+0000 7fa3ec5e7700 1 Processor -- start 2023-05-10T01:10:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.526+0000 7fa3ec5e7700 1 -- start start 2023-05-10T01:10:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.527+0000 7fa3ec5e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 0x7fa3e41544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.527+0000 7fa3ec5e7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3e40cb410 0x7fa3e40c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.527+0000 7fa3ec5e7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e41550e0 con 0x7fa3e4155570 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.527+0000 7fa3ec5e7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40c6830 con 0x7fa3e40cb410 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.527+0000 7fa3ec5e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c6550 con 0x7fa3e4154110 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3e40cb410 0x7fa3e40c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3ea383700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 0x7fa3e41544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3e40cb410 0x7fa3e40c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:58710/0 (socket says 172.21.15.52:58710) 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 -- 172.21.15.52:0/727139052 learned_addr learned my addr 172.21.15.52:0/727139052 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3eab84700 1 --1- 172.21.15.52:0/727139052 >> v1:172.21.15.172:6789/0 conn(0x7fa3e4155570 0x7fa3e4068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:43706/0 (socket says 172.21.15.52:43706) 2023-05-10T01:10:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 -- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 msgr2=0x7fa3e41544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 0x7fa3e41544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 -- 172.21.15.52:0/727139052 >> v1:172.21.15.172:6789/0 conn(0x7fa3e4155570 legacy=0x7fa3e4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 -- 172.21.15.52:0/727139052 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4154a90 con 0x7fa3e40cb410 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9381700 1 -- 172.21.15.52:0/727139052 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489597820 0 0) 0x7fa3e41550e0 con 0x7fa3e4155570 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3ea383700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 0x7fa3e41544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.528+0000 7fa3e9b82700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e40c5c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa3d8006fd0 tx=0x7fa3d80090f0).ready entity=mon.1 client_cookie=ad6c5c5c9498c751 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3e9381700 1 -- 172.21.15.52:0/727139052 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800b580 con 0x7fa3e40cb410 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3e9381700 1 -- 172.21.15.52:0/727139052 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800b6e0 con 0x7fa3e40cb410 2023-05-10T01:10:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3e9381700 1 -- 172.21.15.52:0/727139052 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800ba60 con 0x7fa3e40cb410 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 msgr2=0x7fa3e40c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e40c5c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fa3d8006fd0 tx=0x7fa3d80090f0).stop 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/727139052 shutdown_connections 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4154110 0x7fa3e41544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/727139052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e40c5c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/727139052 >> 172.21.15.52:0/727139052 conn(0x7fa3e40678d0 msgr2=0x7fa3e40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/727139052 shutdown_connections 2023-05-10T01:10:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.529+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/727139052 wait complete. 2023-05-10T01:10:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.530+0000 7fa3ec5e7700 1 Processor -- start 2023-05-10T01:10:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.530+0000 7fa3ec5e7700 1 -- start start 2023-05-10T01:10:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4155570 0x7fa3e40a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40acc70 con 0x7fa3e4154110 2023-05-10T01:10:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40a3110 con 0x7fa3e40cb410 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3ec5e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40a33f0 con 0x7fa3e4155570 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3e9b82700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3e9b82700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60390/0 (socket says 172.21.15.52:60390) 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.531+0000 7fa3e9b82700 1 -- 172.21.15.52:0/4008499687 learned_addr learned my addr 172.21.15.52:0/4008499687 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3ea383700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3eab84700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4155570 0x7fa3e40a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 -- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4155570 msgr2=0x7fa3e40a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4155570 0x7fa3e40a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 -- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 msgr2=0x7fa3e41527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e41527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 -- 172.21.15.52:0/4008499687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009250 con 0x7fa3e4154110 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e9b82700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa3d8009130 tx=0x7fa3d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800b850 con 0x7fa3e4154110 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800b9b0 con 0x7fa3e4154110 2023-05-10T01:10:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d801c670 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d8009370 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.532+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e40a39b0 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.533+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e4066720 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.533+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fa3d802c070 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.534+0000 7fa3e27fc700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 0x7fa3c4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.534+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa3d807b6f0 con 0x7fa3e4154110 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.534+0000 7fa3ea383700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 0x7fa3c4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.534+0000 7fa3ea383700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 0x7fa3c4061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa3dc006fd0 tx=0x7fa3dc008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.538+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3d804cc80 con 0x7fa3e4154110 2023-05-10T01:10:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.735+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3e4154d70 con 0x7fa3c405ed40 2023-05-10T01:10:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.740+0000 7fa3e27fc700 1 -- 172.21.15.52:0/4008499687 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa3e4154d70 con 0x7fa3c405ed40 2023-05-10T01:10:53.743 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir1 2023-05-10T01:10:53.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 msgr2=0x7fa3c4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 0x7fa3c4061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa3dc006fd0 tx=0x7fa3dc008040).stop 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 msgr2=0x7fa3e40a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa3d8009130 tx=0x7fa3d8017000).stop 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 shutdown_connections 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3c405ed40 0x7fa3c4061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3e4155570 0x7fa3e40a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e40cb410 0x7fa3e41527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 --2- 172.21.15.52:0/4008499687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3e4154110 0x7fa3e40a19c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 >> 172.21.15.52:0/4008499687 conn(0x7fa3e40678d0 msgr2=0x7fa3e40c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 shutdown_connections 2023-05-10T01:10:53.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.742+0000 7fa3ec5e7700 1 -- 172.21.15.52:0/4008499687 wait complete. 2023-05-10T01:10:53.756 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-05-10T01:10:53.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:53.757 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-05-10T01:10:53.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-05-10T01:10:53.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.931+0000 7fa739af1700 1 Processor -- start 2023-05-10T01:10:53.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.931+0000 7fa739af1700 1 -- start start 2023-05-10T01:10:53.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa739af1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 0x7fa7340aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa739af1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa734068150 0x7fa734068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa739af1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7340c94c0 con 0x7fa734154460 2023-05-10T01:10:53.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa739af1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7340cb7d0 con 0x7fa734068150 2023-05-10T01:10:53.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa739af1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa734068a60 con 0x7fa734154080 2023-05-10T01:10:53.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa733fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa734068150 0x7fa734068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa733fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa734068150 0x7fa734068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60400/0 (socket says 172.21.15.52:60400) 2023-05-10T01:10:53.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.932+0000 7fa733fff700 1 -- 172.21.15.52:0/139231113 learned_addr learned my addr 172.21.15.52:0/139231113 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:53.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa7337fe700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 0x7fa7340aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa733fff700 1 -- 172.21.15.52:0/139231113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 msgr2=0x7fa7340aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa733fff700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 0x7fa7340aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa733fff700 1 -- 172.21.15.52:0/139231113 >> v1:172.21.15.172:6789/0 conn(0x7fa734154460 legacy=0x7fa7340a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa733fff700 1 -- 172.21.15.52:0/139231113 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340c88b0 con 0x7fa734068150 2023-05-10T01:10:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa7337fe700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 0x7fa7340aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:53.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa733fff700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734068150 0x7fa734068570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa72c009f20 tx=0x7fa72c009840).ready entity=mon.0 client_cookie=803fef5ec9fadbe9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa7327fc700 1 -- 172.21.15.52:0/139231113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00e070 con 0x7fa734068150 2023-05-10T01:10:53.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa7327fc700 1 -- 172.21.15.52:0/139231113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00ba40 con 0x7fa734068150 2023-05-10T01:10:53.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa7327fc700 1 -- 172.21.15.52:0/139231113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00bdc0 con 0x7fa734068150 2023-05-10T01:10:53.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 -- 172.21.15.52:0/139231113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734068150 msgr2=0x7fa734068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734068150 0x7fa734068570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa72c009f20 tx=0x7fa72c009840).stop 2023-05-10T01:10:53.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 -- 172.21.15.52:0/139231113 shutdown_connections 2023-05-10T01:10:53.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154080 0x7fa7340aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 --2- 172.21.15.52:0/139231113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734068150 0x7fa734068570 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 -- 172.21.15.52:0/139231113 >> 172.21.15.52:0/139231113 conn(0x7fa734067910 msgr2=0x7fa7340cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:53.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.933+0000 7fa739af1700 1 -- 172.21.15.52:0/139231113 shutdown_connections 2023-05-10T01:10:53.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.934+0000 7fa739af1700 1 -- 172.21.15.52:0/139231113 wait complete. 2023-05-10T01:10:53.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 Processor -- start 2023-05-10T01:10:53.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 -- start start 2023-05-10T01:10:53.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 0x7fa734157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 0x7fa73414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7341640d0 con 0x7fa734154080 2023-05-10T01:10:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa734150360 con 0x7fa734068150 2023-05-10T01:10:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.935+0000 7fa739af1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa734164350 con 0x7fa734154460 2023-05-10T01:10:53.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60404/0 (socket says 172.21.15.52:60404) 2023-05-10T01:10:53.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 -- 172.21.15.52:0/2940543102 learned_addr learned my addr 172.21.15.52:0/2940543102 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:53.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa733fff700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 0x7fa73414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa7337fe700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 0x7fa734157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 -- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 msgr2=0x7fa73414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 0x7fa73414ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 -- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 msgr2=0x7fa734157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:53.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 0x7fa734157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:53.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 -- 172.21.15.52:0/2940543102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009ae0 con 0x7fa734154080 2023-05-10T01:10:53.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa733fff700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 0x7fa73414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:53.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa7337fe700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 0x7fa734157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa732ffd700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa728009470 tx=0x7fa728006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728013460 con 0x7fa734154080 2023-05-10T01:10:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280135c0 con 0x7fa734154080 2023-05-10T01:10:53.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728013980 con 0x7fa734154080 2023-05-10T01:10:53.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa734164630 con 0x7fa734154080 2023-05-10T01:10:53.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.936+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa734164bf0 con 0x7fa734154080 2023-05-10T01:10:53.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.937+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734066720 con 0x7fa734154080 2023-05-10T01:10:53.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.938+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 7) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fa72800f070 con 0x7fa734154080 2023-05-10T01:10:53.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.938+0000 7fa71b7fe700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 0x7fa714061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:53.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.938+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa7280792a0 con 0x7fa734154080 2023-05-10T01:10:53.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.938+0000 7fa7337fe700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 0x7fa714061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:53.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.938+0000 7fa7337fe700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 0x7fa714061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa72400aa90 tx=0x7fa724008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:53.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:53.942+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa72804a830 con 0x7fa734154080 2023-05-10T01:10:54.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.140+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7340c8b90 con 0x7fa71405ed40 2023-05-10T01:10:54.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.144+0000 7fa71b7fe700 1 -- 172.21.15.52:0/2940543102 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa7340c8b90 con 0x7fa71405ed40 2023-05-10T01:10:54.171 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir2 2023-05-10T01:10:54.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 msgr2=0x7fa714061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 0x7fa714061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa72400aa90 tx=0x7fa724008040).stop 2023-05-10T01:10:54.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 msgr2=0x7fa734152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fa728009470 tx=0x7fa728006ec0).stop 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 shutdown_connections 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa71405ed40 0x7fa714061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa734154460 0x7fa73414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa734068150 0x7fa734157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 --2- 172.21.15.52:0/2940543102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa734154080 0x7fa734152cc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 >> 172.21.15.52:0/2940543102 conn(0x7fa734067910 msgr2=0x7fa7340c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:54.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 shutdown_connections 2023-05-10T01:10:54.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.146+0000 7fa739af1700 1 -- 172.21.15.52:0/2940543102 wait complete. 2023-05-10T01:10:54.179 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-05-10T01:10:54.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:54.180 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-05-10T01:10:54.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-05-10T01:10:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.363+0000 7f51a4f0a700 1 Processor -- start 2023-05-10T01:10:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.363+0000 7f51a4f0a700 1 -- start start 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.364+0000 7f51a4f0a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 0x7f51a00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.364+0000 7f51a4f0a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51a0068150 0x7f51a00685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.364+0000 7f51a4f0a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00c94c0 con 0x7f51a0154080 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.364+0000 7f51a4f0a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a00cb7d0 con 0x7f51a0068150 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.364+0000 7f51a4f0a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0068ab0 con 0x7f51a0154460 2023-05-10T01:10:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51a0068150 0x7f51a00685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f51a0154080 0x7f51a00a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41194/0 (socket says 172.21.15.52:41194) 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519e59c700 1 -- 172.21.15.52:0/3291859291 learned_addr learned my addr 172.21.15.52:0/3291859291 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519dd9b700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 0x7f51a00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 -- 172.21.15.52:0/3291859291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 msgr2=0x7f51a00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 0x7f51a00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 -- 172.21.15.52:0/3291859291 >> v1:172.21.15.52:6789/0 conn(0x7f51a0154080 legacy=0x7f51a00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519d59a700 1 -- 172.21.15.52:0/3291859291 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013539887 0 0) 0x7f51a00c94c0 con 0x7f51a0154080 2023-05-10T01:10:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 -- 172.21.15.52:0/3291859291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00c88b0 con 0x7f51a0068150 2023-05-10T01:10:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519dd9b700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 0x7f51a00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519ed9d700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a00685c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f5198009e60 tx=0x7f5198009780).ready entity=mon.0 client_cookie=520485e905d64b14 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519d59a700 1 -- 172.21.15.52:0/3291859291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800e070 con 0x7f51a0068150 2023-05-10T01:10:54.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519d59a700 1 -- 172.21.15.52:0/3291859291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800bc30 con 0x7f51a0068150 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.365+0000 7f519d59a700 1 -- 172.21.15.52:0/3291859291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198012410 con 0x7f51a0068150 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 -- 172.21.15.52:0/3291859291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 msgr2=0x7f51a00685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a00685c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f5198009e60 tx=0x7f5198009780).stop 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 -- 172.21.15.52:0/3291859291 shutdown_connections 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a00685c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/3291859291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154460 0x7f51a00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 -- 172.21.15.52:0/3291859291 >> 172.21.15.52:0/3291859291 conn(0x7f51a0067910 msgr2=0x7f51a00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:54.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 -- 172.21.15.52:0/3291859291 shutdown_connections 2023-05-10T01:10:54.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.366+0000 7f51a4f0a700 1 -- 172.21.15.52:0/3291859291 wait complete. 2023-05-10T01:10:54.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.367+0000 7f51a4f0a700 1 Processor -- start 2023-05-10T01:10:54.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.367+0000 7f51a4f0a700 1 -- start start 2023-05-10T01:10:54.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154080 0x7f51a0140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 0x7f51a0140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0141110 con 0x7f51a0068150 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0150290 con 0x7f51a0154460 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a01504e0 con 0x7f51a0154080 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60414/0 (socket says 172.21.15.52:60414) 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 -- 172.21.15.52:0/326258744 learned_addr learned my addr 172.21.15.52:0/326258744 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:54.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519dd9b700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154080 0x7f51a0140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519ed9d700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 0x7f51a0140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 -- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154080 msgr2=0x7f51a0140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154080 0x7f51a0140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 -- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 msgr2=0x7f51a0140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 0x7f51a0140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 -- 172.21.15.52:0/326258744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198009a20 con 0x7f51a0068150 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519ed9d700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 0x7f51a0140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f519e59c700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f519000c4e0 tx=0x7f5190007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900072e0 con 0x7f51a0068150 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190007440 con 0x7f51a0068150 2023-05-10T01:10:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a01507c0 con 0x7f51a0068150 2023-05-10T01:10:54.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900057a0 con 0x7f51a0068150 2023-05-10T01:10:54.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.368+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a0150d80 con 0x7f51a0068150 2023-05-10T01:10:54.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.369+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0066720 con 0x7f51a0068150 2023-05-10T01:10:54.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.370+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f519001a060 con 0x7f51a0068150 2023-05-10T01:10:54.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.370+0000 7f518e7fc700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 0x7f517c0612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.370+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f51900795b0 con 0x7f51a0068150 2023-05-10T01:10:54.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.370+0000 7f519dd9b700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 0x7f517c0612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.371+0000 7f519dd9b700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 0x7f517c0612c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f51a00aa190 tx=0x7f5194008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.374+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f519004a9d0 con 0x7f51a0068150 2023-05-10T01:10:54.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.573+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f51a00c8b90 con 0x7f517c05ee00 2023-05-10T01:10:54.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.578+0000 7f518e7fc700 1 -- 172.21.15.52:0/326258744 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f51a00c8b90 con 0x7f517c05ee00 2023-05-10T01:10:54.581 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir3 2023-05-10T01:10:54.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.579+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 msgr2=0x7f517c0612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.579+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 0x7f517c0612c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f51a00aa190 tx=0x7f5194008040).stop 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.579+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 msgr2=0x7f51a0152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.579+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f519000c4e0 tx=0x7f5190007c70).stop 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 shutdown_connections 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f517c05ee00 0x7f517c0612c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a0154460 0x7f51a0140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a0068150 0x7f51a0152620 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 --2- 172.21.15.52:0/326258744 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51a0154080 0x7f51a0140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 >> 172.21.15.52:0/326258744 conn(0x7f51a0067910 msgr2=0x7f51a00c0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 shutdown_connections 2023-05-10T01:10:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.580+0000 7f51a4f0a700 1 -- 172.21.15.52:0/326258744 wait complete. 2023-05-10T01:10:54.594 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-05-10T01:10:54.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:54.595 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-05-10T01:10:54.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-05-10T01:10:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.770+0000 7f4db66e9700 1 Processor -- start 2023-05-10T01:10:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.770+0000 7f4db66e9700 1 -- start start 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db66e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4db00cb410 0x7f4db01544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db66e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4db0155570 0x7f4db0068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db66e9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00c6310 con 0x7f4db0154110 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db66e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db00c6830 con 0x7f4db0155570 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db66e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db01550e0 con 0x7f4db00cb410 2023-05-10T01:10:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.771+0000 7f4db4c86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4db0155570 0x7f4db0068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4db0155570 0x7f4db0068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60426/0 (socket says 172.21.15.52:60426) 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 -- 172.21.15.52:0/409525086 learned_addr learned my addr 172.21.15.52:0/409525086 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4daf7fe700 1 --2- 172.21.15.52:0/409525086 >> v2:172.21.15.172:3300/0 conn(0x7f4db00cb410 0x7f4db01544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 -- 172.21.15.52:0/409525086 >> v2:172.21.15.172:3300/0 conn(0x7f4db00cb410 msgr2=0x7f4db01544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 --2- 172.21.15.52:0/409525086 >> v2:172.21.15.172:3300/0 conn(0x7f4db00cb410 0x7f4db01544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 -- 172.21.15.52:0/409525086 >> v1:172.21.15.172:6789/0 conn(0x7f4db0154110 legacy=0x7f4db00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 -- 172.21.15.52:0/409525086 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00c6550 con 0x7f4db0155570 2023-05-10T01:10:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4db4c86700 1 --2- 172.21.15.52:0/409525086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0155570 0x7f4db0068150 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4db0069350 tx=0x7f4da8009840).ready entity=mon.0 client_cookie=f29a2c2c052f13b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4daeffd700 1 -- 172.21.15.52:0/409525086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da800e070 con 0x7f4db0155570 2023-05-10T01:10:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4daeffd700 1 -- 172.21.15.52:0/409525086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da800ba20 con 0x7f4db0155570 2023-05-10T01:10:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.772+0000 7f4daeffd700 1 -- 172.21.15.52:0/409525086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da800bda0 con 0x7f4db0155570 2023-05-10T01:10:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 -- 172.21.15.52:0/409525086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0155570 msgr2=0x7f4db0068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 --2- 172.21.15.52:0/409525086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0155570 0x7f4db0068150 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4db0069350 tx=0x7f4da8009840).stop 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 -- 172.21.15.52:0/409525086 shutdown_connections 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 --2- 172.21.15.52:0/409525086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0155570 0x7f4db0068150 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 --2- 172.21.15.52:0/409525086 >> v2:172.21.15.172:3300/0 conn(0x7f4db00cb410 0x7f4db01544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 -- 172.21.15.52:0/409525086 >> 172.21.15.52:0/409525086 conn(0x7f4db00678d0 msgr2=0x7f4db00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 -- 172.21.15.52:0/409525086 shutdown_connections 2023-05-10T01:10:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.773+0000 7f4db66e9700 1 -- 172.21.15.52:0/409525086 wait complete. 2023-05-10T01:10:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.774+0000 7f4db66e9700 1 Processor -- start 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.774+0000 7f4db66e9700 1 -- start start 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 0x7f4db00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db0155570 0x7f4db00aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00aa630 con 0x7f4db00cb410 2023-05-10T01:10:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00af7a0 con 0x7f4db0155570 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00afa80 con 0x7f4db0154110 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60428/0 (socket says 172.21.15.52:60428) 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 -- 172.21.15.52:0/568527906 learned_addr learned my addr 172.21.15.52:0/568527906 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db4c86700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db0155570 0x7f4db00aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daf7fe700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 0x7f4db00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 -- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 msgr2=0x7f4db00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 0x7f4db00a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 -- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db0155570 msgr2=0x7f4db00aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db0155570 0x7f4db00aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 -- 172.21.15.52:0/568527906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009ae0 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daf7fe700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 0x7f4db00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4daffff700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f4d9800c4c0 tx=0x7f4d98007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98007020 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98007180 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db00afd60 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98007520 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.775+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db014d0d0 con 0x7f4db00cb410 2023-05-10T01:10:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.776+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db0066720 con 0x7f4db00cb410 2023-05-10T01:10:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.777+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f4d98010070 con 0x7f4db00cb410 2023-05-10T01:10:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.777+0000 7f4da7fff700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 0x7f4d940612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.777+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4d980794b0 con 0x7f4db00cb410 2023-05-10T01:10:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.777+0000 7f4daf7fe700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 0x7f4d940612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.778+0000 7f4daf7fe700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 0x7f4d940612f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4db00b0440 tx=0x7f4da0008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.781+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d9804a8d0 con 0x7f4db00cb410 2023-05-10T01:10:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.978+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4db00c6310 con 0x7f4d9405ee30 2023-05-10T01:10:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.983+0000 7f4da7fff700 1 -- 172.21.15.52:0/568527906 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4db00c6310 con 0x7f4d9405ee30 2023-05-10T01:10:54.985 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir4 2023-05-10T01:10:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 msgr2=0x7f4d940612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 0x7f4d940612f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4db00b0440 tx=0x7f4da0008040).stop 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 msgr2=0x7f4db014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f4d9800c4c0 tx=0x7f4d98007df0).stop 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 shutdown_connections 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d9405ee30 0x7f4d940612f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db0155570 0x7f4db00aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db00cb410 0x7f4db014cbe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 --2- 172.21.15.52:0/568527906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db0154110 0x7f4db00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 >> 172.21.15.52:0/568527906 conn(0x7f4db00678d0 msgr2=0x7f4db0156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 shutdown_connections 2023-05-10T01:10:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:54.985+0000 7f4db66e9700 1 -- 172.21.15.52:0/568527906 wait complete. 2023-05-10T01:10:55.000 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-05-10T01:10:55.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:55.001 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-05-10T01:10:55.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-05-10T01:10:55.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.177+0000 7faba732c700 1 Processor -- start 2023-05-10T01:10:55.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.177+0000 7faba732c700 1 -- start start 2023-05-10T01:10:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba732c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faba00c6400 0x7faba0155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba732c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba006a130 con 0x7faba00c1150 2023-05-10T01:10:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba732c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba006a410 con 0x7faba0153f80 2023-05-10T01:10:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba732c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba0069f50 con 0x7faba00c6400 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5b29700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faba00c1150 0x7faba00c5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41222/0 (socket says 172.21.15.52:41222) 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5b29700 1 -- 172.21.15.52:0/1480945472 learned_addr learned my addr 172.21.15.52:0/1480945472 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba6b2b700 1 --2- 172.21.15.52:0/1480945472 >> v2:172.21.15.172:3300/0 conn(0x7faba00c6400 0x7faba0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953197209 0 0) 0x7faba006a130 con 0x7faba00c1150 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab8c0033f0 con 0x7faba00c1150 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141840821 0 0) 0x7fab8c0033f0 con 0x7faba00c1150 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 >> v2:172.21.15.172:3300/0 conn(0x7faba00c6400 msgr2=0x7faba0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 --2- 172.21.15.52:0/1480945472 >> v2:172.21.15.172:3300/0 conn(0x7faba00c6400 0x7faba0155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 >> v1:172.21.15.172:6789/0 conn(0x7faba0153f80 legacy=0x7faba00a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba006a6f0 con 0x7faba00c1150 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fab94001470 con 0x7faba00c1150 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 >> v1:172.21.15.52:6789/0 conn(0x7faba00c1150 legacy=0x7faba00c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab8c0038e0 0x7fab8c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab8c004690 0x7fab8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7fab8c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0069f50 con 0x7fab8c005000 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00beb0 con 0x7fab8c004690 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.178+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00c070 con 0x7fab8c0038e0 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7fab8c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba5b29700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab8c004690 0x7fab8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba632a700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab8c0038e0 0x7fab8c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 -- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab8c0038e0 msgr2=0x7fab8c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab8c0038e0 0x7fab8c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 -- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab8c004690 msgr2=0x7fab8c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab8c004690 0x7fab8c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 -- 172.21.15.52:0/1480945472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0033f0 con 0x7fab8c005000 2023-05-10T01:10:55.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba632a700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab8c0038e0 0x7fab8c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:55.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 -- 172.21.15.52:0/1480945472 reap_dead start 2023-05-10T01:10:55.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba6b2b700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7fab8c00b8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7faba00c6800 tx=0x7fab90009060).ready entity=mon.0 client_cookie=4c001c62868ff087 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90009e90 con 0x7fab8c005000 2023-05-10T01:10:55.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab90009430 con 0x7fab8c005000 2023-05-10T01:10:55.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.179+0000 7faba5328700 1 -- 172.21.15.52:0/1480945472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000e870 con 0x7fab8c005000 2023-05-10T01:10:55.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 -- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 msgr2=0x7fab8c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7fab8c00b8e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7faba00c6800 tx=0x7fab90009060).stop 2023-05-10T01:10:55.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 -- 172.21.15.52:0/1480945472 shutdown_connections 2023-05-10T01:10:55.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 --2- 172.21.15.52:0/1480945472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7fab8c00b8e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 -- 172.21.15.52:0/1480945472 >> 172.21.15.52:0/1480945472 conn(0x7faba00cb5f0 msgr2=0x7faba00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:55.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 -- 172.21.15.52:0/1480945472 shutdown_connections 2023-05-10T01:10:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.180+0000 7faba732c700 1 -- 172.21.15.52:0/1480945472 wait complete. 2023-05-10T01:10:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 Processor -- start 2023-05-10T01:10:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 -- start start 2023-05-10T01:10:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 0x7faba00c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faba0167910 0x7faba0167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.181+0000 7faba732c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00a96e0 con 0x7fab8c005000 2023-05-10T01:10:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba732c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0165750 con 0x7faba0167910 2023-05-10T01:10:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba732c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba0165450 con 0x7faba00a9260 2023-05-10T01:10:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60450/0 (socket says 172.21.15.52:60450) 2023-05-10T01:10:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 -- 172.21.15.52:0/2603130319 learned_addr learned my addr 172.21.15.52:0/2603130319 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba5b29700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 0x7faba00c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba6b2b700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faba0167910 0x7faba0167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 -- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 msgr2=0x7faba00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 0x7faba00c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 -- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faba0167910 msgr2=0x7faba0167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faba0167910 0x7faba0167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 -- 172.21.15.52:0/2603130319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0168280 con 0x7fab8c005000 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba5b29700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 0x7faba00c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba632a700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fab9800e780 tx=0x7fab98009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800a4e0 con 0x7fab8c005000 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98010040 con 0x7fab8c005000 2023-05-10T01:10:55.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00c3df0 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800a850 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.182+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba00c43b0 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.183+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0165a30 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.183+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fab9801b030 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.184+0000 7fab9e7fc700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 0x7fab800612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.184+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fab98079480 con 0x7fab8c005000 2023-05-10T01:10:55.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.184+0000 7faba5b29700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 0x7fab800612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.184+0000 7faba5b29700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 0x7fab800612f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab940015a0 tx=0x7fab94009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.188+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab9804a950 con 0x7fab8c005000 2023-05-10T01:10:55.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.388+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faba0165890 con 0x7fab8005ee30 2023-05-10T01:10:55.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.393+0000 7fab9e7fc700 1 -- 172.21.15.52:0/2603130319 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fab94000ed0 con 0x7fab8005ee30 2023-05-10T01:10:55.396 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir5 2023-05-10T01:10:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 msgr2=0x7fab800612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 0x7fab800612f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fab940015a0 tx=0x7fab94009040).stop 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 msgr2=0x7faba00a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fab9800e780 tx=0x7fab98009040).stop 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 shutdown_connections 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fab8005ee30 0x7fab800612f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faba0167910 0x7faba0167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c005000 0x7faba00a2440 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 --2- 172.21.15.52:0/2603130319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faba00a9260 0x7faba00c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 >> 172.21.15.52:0/2603130319 conn(0x7faba00cb5f0 msgr2=0x7faba01515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 shutdown_connections 2023-05-10T01:10:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.395+0000 7faba732c700 1 -- 172.21.15.52:0/2603130319 wait complete. 2023-05-10T01:10:55.410 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-05-10T01:10:55.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:55.411 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-05-10T01:10:55.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-05-10T01:10:55.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.587+0000 7eff96d08700 1 Processor -- start 2023-05-10T01:10:55.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.587+0000 7eff96d08700 1 -- start start 2023-05-10T01:10:55.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff96d08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff90068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff96d08700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff90068640 0x7eff900c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff96d08700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff900c9110 con 0x7eff900c60c0 2023-05-10T01:10:55.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff96d08700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff900c6520 con 0x7eff90068640 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff96d08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c8820 con 0x7eff90153ff0 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff952a5700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7eff900c60c0 0x7eff900c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41244/0 (socket says 172.21.15.52:41244) 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff952a5700 1 -- 172.21.15.52:0/3601961338 learned_addr learned my addr 172.21.15.52:0/3601961338 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> v2:172.21.15.172:3300/0 conn(0x7eff90068640 0x7eff900c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff94aa4700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff90068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458801637 0 0) 0x7eff900c9110 con 0x7eff900c60c0 2023-05-10T01:10:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.588+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff740033f0 con 0x7eff900c60c0 2023-05-10T01:10:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090841348 0 0) 0x7eff740033f0 con 0x7eff900c60c0 2023-05-10T01:10:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 msgr2=0x7eff90068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff90068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 >> v2:172.21.15.172:3300/0 conn(0x7eff90068640 msgr2=0x7eff900c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 --2- 172.21.15.52:0/3601961338 >> v2:172.21.15.172:3300/0 conn(0x7eff90068640 0x7eff900c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900c8ac0 con 0x7eff900c60c0 2023-05-10T01:10:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7eff880017f0 con 0x7eff900c60c0 2023-05-10T01:10:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 >> v1:172.21.15.52:6789/0 conn(0x7eff900c60c0 legacy=0x7eff900c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff740038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff74003e10 0x7eff74004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74004b80 0x7eff74005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c6520 con 0x7eff74003e10 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c8820 con 0x7eff74004b80 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7400b8e0 con 0x7eff90153ff0 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> v2:172.21.15.172:3300/0 conn(0x7eff90068640 0x7eff900c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff74003e10 0x7eff74004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff94aa4700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff740038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff952a5700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74004b80 0x7eff74005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 -- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 msgr2=0x7eff740038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90153ff0 0x7eff740038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 -- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74004b80 msgr2=0x7eff74005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74004b80 0x7eff74005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 -- 172.21.15.52:0/3601961338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740033f0 con 0x7eff74003e10 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8ffff700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff74003e10 0x7eff74004690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7eff7c009c70 tx=0x7eff7c009060).ready entity=mon.0 client_cookie=af69631ba2307991 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0095c0 con 0x7eff74003e10 2023-05-10T01:10:55.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c00e6f0 con 0x7eff74003e10 2023-05-10T01:10:55.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.589+0000 7eff8f7fe700 1 -- 172.21.15.52:0/3601961338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00ea70 con 0x7eff74003e10 2023-05-10T01:10:55.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 -- 172.21.15.52:0/3601961338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff74003e10 msgr2=0x7eff74004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 --2- 172.21.15.52:0/3601961338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff74003e10 0x7eff74004690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7eff7c009c70 tx=0x7eff7c009060).stop 2023-05-10T01:10:55.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff952a5700 1 -- 172.21.15.52:0/3601961338 reap_dead start 2023-05-10T01:10:55.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 -- 172.21.15.52:0/3601961338 shutdown_connections 2023-05-10T01:10:55.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 -- 172.21.15.52:0/3601961338 >> 172.21.15.52:0/3601961338 conn(0x7eff900678d0 msgr2=0x7eff900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:55.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 -- 172.21.15.52:0/3601961338 shutdown_connections 2023-05-10T01:10:55.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.590+0000 7eff96d08700 1 -- 172.21.15.52:0/3601961338 wait complete. 2023-05-10T01:10:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.591+0000 7eff96d08700 1 Processor -- start 2023-05-10T01:10:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.591+0000 7eff96d08700 1 -- start start 2023-05-10T01:10:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74003e10 0x7eff90164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff900abd70 0x7eff900ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900ac6c0 con 0x7eff90150790 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff90143e10 con 0x7eff74003e10 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff96d08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff901649a0 con 0x7eff900abd70 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60470/0 (socket says 172.21.15.52:60470) 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 -- 172.21.15.52:0/687607395 learned_addr learned my addr 172.21.15.52:0/687607395 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff94aa4700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74003e10 0x7eff90164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff952a5700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff900abd70 0x7eff900ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 -- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff900abd70 msgr2=0x7eff900ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff900abd70 0x7eff900ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 -- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74003e10 msgr2=0x7eff90164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74003e10 0x7eff90164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.592+0000 7eff8ffff700 1 -- 172.21.15.52:0/687607395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90164c80 con 0x7eff90150790 2023-05-10T01:10:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff8ffff700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7eff7c00e4b0 tx=0x7eff7c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00ea70 con 0x7eff90150790 2023-05-10T01:10:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c00eeb0 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff90164f60 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c01b680 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.593+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff900af170 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.594+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff90066720 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.594+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7eff7c01bab0 con 0x7eff90150790 2023-05-10T01:10:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.594+0000 7eff8cff9700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 0x7eff780612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.594+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7eff7c07bdf0 con 0x7eff90150790 2023-05-10T01:10:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.595+0000 7eff94aa4700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 0x7eff780612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.595+0000 7eff94aa4700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 0x7eff780612f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7eff84006d20 tx=0x7eff84006f40).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.599+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff7c04d210 con 0x7eff90150790 2023-05-10T01:10:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.800+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7eff900c8da0 con 0x7eff7805ee30 2023-05-10T01:10:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.805+0000 7eff8cff9700 1 -- 172.21.15.52:0/687607395 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7eff900c8da0 con 0x7eff7805ee30 2023-05-10T01:10:55.808 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir6 2023-05-10T01:10:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 msgr2=0x7eff780612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 0x7eff780612f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7eff84006d20 tx=0x7eff84006f40).stop 2023-05-10T01:10:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 msgr2=0x7eff90143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7eff7c00e4b0 tx=0x7eff7c019000).stop 2023-05-10T01:10:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 shutdown_connections 2023-05-10T01:10:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7eff7805ee30 0x7eff780612f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff900abd70 0x7eff900ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff74003e10 0x7eff90164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 --2- 172.21.15.52:0/687607395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff90150790 0x7eff90143920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 >> 172.21.15.52:0/687607395 conn(0x7eff900678d0 msgr2=0x7eff90152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 shutdown_connections 2023-05-10T01:10:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.807+0000 7eff96d08700 1 -- 172.21.15.52:0/687607395 wait complete. 2023-05-10T01:10:55.821 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-05-10T01:10:55.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:55.822 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-05-10T01:10:55.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-05-10T01:10:56.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.998+0000 7f5f9359e700 1 Processor -- start 2023-05-10T01:10:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:55.998+0000 7f5f9359e700 1 -- start start 2023-05-10T01:10:56.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9359e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f9405e450 0x7f5f9414f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9359e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940c3160 con 0x7f5f9414f3a0 2023-05-10T01:10:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9405e930 con 0x7f5f940a7df0 2023-05-10T01:10:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9359e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9405ec10 con 0x7f5f9405e450 2023-05-10T01:10:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9259c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5f9414f3a0 0x7f5f940a76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41260/0 (socket says 172.21.15.52:41260) 2023-05-10T01:10:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9259c700 1 -- 172.21.15.52:0/2883297896 learned_addr learned my addr 172.21.15.52:0/2883297896 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f92d9d700 1 --2- 172.21.15.52:0/2883297896 >> v2:172.21.15.172:3300/0 conn(0x7f5f9405e450 0x7f5f9414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058633689 0 0) 0x7f5f940c3160 con 0x7f5f9414f3a0 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f780033f0 con 0x7f5f9414f3a0 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f92d9d700 1 -- 172.21.15.52:0/2883297896 >> v1:172.21.15.172:6789/0 conn(0x7f5f940a7df0 legacy=0x7f5f940bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102240900 0 0) 0x7f5f9405e930 con 0x7f5f940a7df0 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f92d9d700 1 -- 172.21.15.52:0/2883297896 >> v1:172.21.15.52:6789/0 conn(0x7f5f9414f3a0 legacy=0x7f5f940a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f92d9d700 1 -- 172.21.15.52:0/2883297896 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94063660 con 0x7f5f9405e450 2023-05-10T01:10:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.000+0000 7f5f92d9d700 1 --2- 172.21.15.52:0/2883297896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f9405e450 0x7f5f9414f780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5f8c009e60 tx=0x7f5f8c009780).ready entity=mon.1 client_cookie=868090452aff5874 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00e070 con 0x7f5f9405e450 2023-05-10T01:10:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00bb60 con 0x7f5f9405e450 2023-05-10T01:10:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9159a700 1 -- 172.21.15.52:0/2883297896 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00bee0 con 0x7f5f9405e450 2023-05-10T01:10:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 -- 172.21.15.52:0/2883297896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f9405e450 msgr2=0x7f5f9414f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 --2- 172.21.15.52:0/2883297896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f9405e450 0x7f5f9414f780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5f8c009e60 tx=0x7f5f8c009780).stop 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 -- 172.21.15.52:0/2883297896 shutdown_connections 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 --2- 172.21.15.52:0/2883297896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f9405e450 0x7f5f9414f780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 -- 172.21.15.52:0/2883297896 >> 172.21.15.52:0/2883297896 conn(0x7f5f94062d70 msgr2=0x7f5f9405dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 -- 172.21.15.52:0/2883297896 shutdown_connections 2023-05-10T01:10:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.001+0000 7f5f9359e700 1 -- 172.21.15.52:0/2883297896 wait complete. 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.002+0000 7f5f9359e700 1 Processor -- start 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.002+0000 7f5f9359e700 1 -- start start 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 0x7f5f9414e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f9414f3a0 0x7f5f94067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c0e90 con 0x7f5f9405e450 2023-05-10T01:10:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940688c0 con 0x7f5f940a7df0 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f94068ba0 con 0x7f5f9414f3a0 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60482/0 (socket says 172.21.15.52:60482) 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f9259c700 1 -- 172.21.15.52:0/3010995749 learned_addr learned my addr 172.21.15.52:0/3010995749 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.003+0000 7f5f91d9b700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 0x7f5f9414e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f92d9d700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f9414f3a0 0x7f5f94067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 -- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f9414f3a0 msgr2=0x7f5f94067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f9414f3a0 0x7f5f94067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 -- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 msgr2=0x7f5f9414e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 0x7f5f9414e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 -- 172.21.15.52:0/3010995749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c009a20 con 0x7f5f9405e450 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f91d9b700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 0x7f5f9414e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:56.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9259c700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5f8400c410 tx=0x7f5f84007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400ce70 con 0x7f5f9405e450 2023-05-10T01:10:56.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f840072e0 con 0x7f5f9405e450 2023-05-10T01:10:56.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f94068e80 con 0x7f5f9405e450 2023-05-10T01:10:56.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840057a0 con 0x7f5f9405e450 2023-05-10T01:10:56.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.004+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9414e950 con 0x7f5f9405e450 2023-05-10T01:10:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.005+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f940c0980 con 0x7f5f9405e450 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.006+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f5f84010070 con 0x7f5f9405e450 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.006+0000 7f5f827fc700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 0x7f5f700612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.007+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5f84079470 con 0x7f5f9405e450 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.007+0000 7f5f91d9b700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 0x7f5f700612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.007+0000 7f5f91d9b700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 0x7f5f700612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5f88007fd0 tx=0x7f5f88009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.010+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f8404a910 con 0x7f5f9405e450 2023-05-10T01:10:56.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.211+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f940c0fd0 con 0x7f5f7005ee30 2023-05-10T01:10:56.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.216+0000 7f5f827fc700 1 -- 172.21.15.52:0/3010995749 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5f880013d0 con 0x7f5f7005ee30 2023-05-10T01:10:56.219 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir7 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 msgr2=0x7f5f700612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 0x7f5f700612f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5f88007fd0 tx=0x7f5f88009040).stop 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 msgr2=0x7f5f94156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f5f8400c410 tx=0x7f5f84007c70).stop 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 shutdown_connections 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f7005ee30 0x7f5f700612f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f9414f3a0 0x7f5f94067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f9405e450 0x7f5f94156fc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 --2- 172.21.15.52:0/3010995749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f940a7df0 0x7f5f9414e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 >> 172.21.15.52:0/3010995749 conn(0x7f5f94062d70 msgr2=0x7f5f940ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 shutdown_connections 2023-05-10T01:10:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.218+0000 7f5f9359e700 1 -- 172.21.15.52:0/3010995749 wait complete. 2023-05-10T01:10:56.232 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-05-10T01:10:56.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:56.233 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-05-10T01:10:56.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-05-10T01:10:56.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.410+0000 7f50a9e35700 1 Processor -- start 2023-05-10T01:10:56.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.410+0000 7f50a9e35700 1 -- start start 2023-05-10T01:10:56.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a9e35700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50a40629b0 0x7f50a41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a9e35700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40bf940 con 0x7f50a4063fa0 2023-05-10T01:10:56.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a9e35700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40a7c80 con 0x7f50a4153cf0 2023-05-10T01:10:56.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a9e35700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a4067f50 con 0x7f50a40629b0 2023-05-10T01:10:56.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50a4063fa0 0x7f50a40622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41276/0 (socket says 172.21.15.52:41276) 2023-05-10T01:10:56.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50a40629b0 0x7f50a41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a2ffd700 1 -- 172.21.15.52:0/1095587620 learned_addr learned my addr 172.21.15.52:0/1095587620 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a3fff700 1 -- 172.21.15.52:0/1095587620 >> v1:172.21.15.172:6789/0 conn(0x7f50a4153cf0 legacy=0x7f50a40bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a27fc700 1 -- 172.21.15.52:0/1095587620 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217690942 0 0) 0x7f50a40bf940 con 0x7f50a4063fa0 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a3fff700 1 -- 172.21.15.52:0/1095587620 >> v1:172.21.15.52:6789/0 conn(0x7f50a4063fa0 legacy=0x7f50a40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a3fff700 1 -- 172.21.15.52:0/1095587620 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40a7ef0 con 0x7f50a40629b0 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.411+0000 7f50a3fff700 1 --2- 172.21.15.52:0/1095587620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a41540d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f509c009e60 tx=0x7f509c009780).ready entity=mon.0 client_cookie=b5d105298412822f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a27fc700 1 -- 172.21.15.52:0/1095587620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c00e070 con 0x7f50a40629b0 2023-05-10T01:10:56.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a27fc700 1 -- 172.21.15.52:0/1095587620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c00bc30 con 0x7f50a40629b0 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a27fc700 1 -- 172.21.15.52:0/1095587620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c012410 con 0x7f50a40629b0 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 -- 172.21.15.52:0/1095587620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 msgr2=0x7f50a41540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 --2- 172.21.15.52:0/1095587620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a41540d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f509c009e60 tx=0x7f509c009780).stop 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 -- 172.21.15.52:0/1095587620 shutdown_connections 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 --2- 172.21.15.52:0/1095587620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a41540d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 -- 172.21.15.52:0/1095587620 >> 172.21.15.52:0/1095587620 conn(0x7f50a405e810 msgr2=0x7f50a40c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 -- 172.21.15.52:0/1095587620 shutdown_connections 2023-05-10T01:10:56.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.412+0000 7f50a9e35700 1 -- 172.21.15.52:0/1095587620 wait complete. 2023-05-10T01:10:56.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.413+0000 7f50a9e35700 1 Processor -- start 2023-05-10T01:10:56.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.413+0000 7f50a9e35700 1 -- start start 2023-05-10T01:10:56.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50a4063fa0 0x7f50a40c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 0x7f50a40c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c1920 con 0x7f50a40629b0 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c2710 con 0x7f50a4153cf0 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a9e35700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a414d860 con 0x7f50a4063fa0 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60496/0 (socket says 172.21.15.52:60496) 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a37fe700 1 -- 172.21.15.52:0/2724963044 learned_addr learned my addr 172.21.15.52:0/2724963044 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a3fff700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 0x7f50a40c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.414+0000 7f50a2ffd700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50a4063fa0 0x7f50a40c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 -- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50a4063fa0 msgr2=0x7f50a40c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50a4063fa0 0x7f50a40c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 -- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 msgr2=0x7f50a40c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 0x7f50a40c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 -- 172.21.15.52:0/2724963044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c009a20 con 0x7f50a40629b0 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a3fff700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 0x7f50a40c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a37fe700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f509400c4c0 tx=0x7f5094007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094007020 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094001e90 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a40c1b00 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940073b0 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.415+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a40c20c0 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.416+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a40c2aa0 con 0x7f50a40629b0 2023-05-10T01:10:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.417+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f5094010070 con 0x7f50a40629b0 2023-05-10T01:10:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.417+0000 7f508b7fe700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 0x7f50840612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.417+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5094079c70 con 0x7f50a40629b0 2023-05-10T01:10:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.417+0000 7f50a2ffd700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 0x7f50840612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.418+0000 7f50a2ffd700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 0x7f50840612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f50a40ab5b0 tx=0x7f5098009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.421+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f509404b110 con 0x7f50a40629b0 2023-05-10T01:10:56.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.621+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f50a40a81d0 con 0x7f508405ee30 2023-05-10T01:10:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.626+0000 7f508b7fe700 1 -- 172.21.15.52:0/2724963044 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f50a40a81d0 con 0x7f508405ee30 2023-05-10T01:10:56.629 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir8 2023-05-10T01:10:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 msgr2=0x7f50840612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 0x7f50840612f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f50a40ab5b0 tx=0x7f5098009040).stop 2023-05-10T01:10:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 msgr2=0x7f50a40c0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f509400c4c0 tx=0x7f5094007e00).stop 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 shutdown_connections 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f508405ee30 0x7f50840612f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a4153cf0 0x7f50a40c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50a40629b0 0x7f50a40c0f40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 --2- 172.21.15.52:0/2724963044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50a4063fa0 0x7f50a40c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 >> 172.21.15.52:0/2724963044 conn(0x7f50a405e810 msgr2=0x7f50a40c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 shutdown_connections 2023-05-10T01:10:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.628+0000 7f50a9e35700 1 -- 172.21.15.52:0/2724963044 wait complete. 2023-05-10T01:10:56.642 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-05-10T01:10:56.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:10:56.644 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-05-10T01:10:56.648 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:10:56.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-05-10T01:10:56.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:10:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.821+0000 7f63e775d700 1 Processor -- start 2023-05-10T01:10:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.821+0000 7f63e775d700 1 -- start start 2023-05-10T01:10:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e775d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e775d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63e0153a90 0x7f63e0153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e775d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00c8820 con 0x7f63e00c5d20 2023-05-10T01:10:56.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e775d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00ca5f0 con 0x7f63e0153a90 2023-05-10T01:10:56.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e775d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c8b00 con 0x7f63e00aa200 2023-05-10T01:10:56.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e5cfa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63e0153a90 0x7f63e0153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e54f9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f63e00c5d20 0x7f63e0069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41288/0 (socket says 172.21.15.52:41288) 2023-05-10T01:10:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e54f9700 1 -- 172.21.15.52:0/2211981362 learned_addr learned my addr 172.21.15.52:0/2211981362 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e4cf8700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e5cfa700 1 -- 172.21.15.52:0/2211981362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 msgr2=0x7f63e00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e5cfa700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63dffff700 1 -- 172.21.15.52:0/2211981362 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305417767 0 0) 0x7f63e00c8820 con 0x7f63e00c5d20 2023-05-10T01:10:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e5cfa700 1 -- 172.21.15.52:0/2211981362 >> v1:172.21.15.52:6789/0 conn(0x7f63e00c5d20 legacy=0x7f63e0069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.822+0000 7f63e5cfa700 1 -- 172.21.15.52:0/2211981362 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00c8de0 con 0x7f63e0153a90 2023-05-10T01:10:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e5cfa700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e0153f00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f63d0009e60 tx=0x7f63d0009780).ready entity=mon.0 client_cookie=e342d25262f47cf3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63dffff700 1 -- 172.21.15.52:0/2211981362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000e070 con 0x7f63e0153a90 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63dffff700 1 -- 172.21.15.52:0/2211981362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000bc30 con 0x7f63e0153a90 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63dffff700 1 -- 172.21.15.52:0/2211981362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0012410 con 0x7f63e0153a90 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 -- 172.21.15.52:0/2211981362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 msgr2=0x7f63e0153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e0153f00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f63d0009e60 tx=0x7f63d0009780).stop 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 -- 172.21.15.52:0/2211981362 shutdown_connections 2023-05-10T01:10:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e0153f00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 --2- 172.21.15.52:0/2211981362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e00c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 -- 172.21.15.52:0/2211981362 >> 172.21.15.52:0/2211981362 conn(0x7f63e00cb6f0 msgr2=0x7f63e00c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 -- 172.21.15.52:0/2211981362 shutdown_connections 2023-05-10T01:10:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.823+0000 7f63e775d700 1 -- 172.21.15.52:0/2211981362 wait complete. 2023-05-10T01:10:56.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.824+0000 7f63e775d700 1 Processor -- start 2023-05-10T01:10:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.824+0000 7f63e775d700 1 -- start start 2023-05-10T01:10:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e00c5d20 0x7f63e00b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00ae8d0 con 0x7f63e0153a90 2023-05-10T01:10:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00add00 con 0x7f63e00c5d20 2023-05-10T01:10:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e775d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00adfa0 con 0x7f63e00aa200 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e5cfa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e5cfa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60514/0 (socket says 172.21.15.52:60514) 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.825+0000 7f63e5cfa700 1 -- 172.21.15.52:0/884247630 learned_addr learned my addr 172.21.15.52:0/884247630 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e54f9700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e4cf8700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e00c5d20 0x7f63e00b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 -- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 msgr2=0x7f63e015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 -- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e00c5d20 msgr2=0x7f63e00b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e00c5d20 0x7f63e00b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 -- 172.21.15.52:0/884247630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009a20 con 0x7f63e0153a90 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e5cfa700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f63d000b6c0 tx=0x7f63d0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011750 con 0x7f63e0153a90 2023-05-10T01:10:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d00118b0 con 0x7f63e0153a90 2023-05-10T01:10:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e00ae280 con 0x7f63e0153a90 2023-05-10T01:10:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011c70 con 0x7f63e0153a90 2023-05-10T01:10:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.826+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00b0810 con 0x7f63e0153a90 2023-05-10T01:10:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.827+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00ad3f0 con 0x7f63e0153a90 2023-05-10T01:10:56.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.828+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f63d001d630 con 0x7f63e0153a90 2023-05-10T01:10:56.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.828+0000 7f63dd7fa700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 0x7f63c00612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:56.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.828+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f63d007cae0 con 0x7f63e0153a90 2023-05-10T01:10:56.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.828+0000 7f63e54f9700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 0x7f63c00612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:56.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.829+0000 7f63e54f9700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 0x7f63c00612c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f63d8007fd0 tx=0x7f63d8009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:56.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:56.832+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63d004de70 con 0x7f63e0153a90 2023-05-10T01:10:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.027+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f63e00ad3f0 con 0x7f63c005ee00 2023-05-10T01:10:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.032+0000 7f63dd7fa700 1 -- 172.21.15.52:0/884247630 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f63e00ad3f0 con 0x7f63c005ee00 2023-05-10T01:10:57.035 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/dir9 2023-05-10T01:10:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 msgr2=0x7f63c00612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 0x7f63c00612c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f63d8007fd0 tx=0x7f63d8009040).stop 2023-05-10T01:10:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 msgr2=0x7f63e00c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f63d000b6c0 tx=0x7f63d0009780).stop 2023-05-10T01:10:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 shutdown_connections 2023-05-10T01:10:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63c005ee00 0x7f63c00612c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0153a90 0x7f63e00c1cc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63e00aa200 0x7f63e015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 --2- 172.21.15.52:0/884247630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e00c5d20 0x7f63e00b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 >> 172.21.15.52:0/884247630 conn(0x7f63e00cb6f0 msgr2=0x7f63e00c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 shutdown_connections 2023-05-10T01:10:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.034+0000 7f63e775d700 1 -- 172.21.15.52:0/884247630 wait complete. 2023-05-10T01:10:57.049 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-05-10T01:10:57.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-05-10T01:10:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.168+0000 7f7b34f9e700 1 Processor -- start 2023-05-10T01:10:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.168+0000 7f7b34f9e700 1 -- start start 2023-05-10T01:10:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b34f9e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b30153f80 0x7f7b300a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b34f9e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b30155770 con 0x7f7b300c5cf0 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b34f9e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3006a130 con 0x7f7b30155370 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b34f9e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30069f50 con 0x7f7b30153f80 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b30153f80 0x7f7b300a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2effd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7b300c5cf0 0x7f7b300c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41304/0 (socket says 172.21.15.52:41304) 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2effd700 1 -- 172.21.15.52:0/1510397593 learned_addr learned my addr 172.21.15.52:0/1510397593 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/1510397593 >> v1:172.21.15.172:6789/0 conn(0x7f7b30155370 legacy=0x7f7b300c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/1510397593 >> v1:172.21.15.52:6789/0 conn(0x7f7b300c5cf0 legacy=0x7f7b300c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/1510397593 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3006a410 con 0x7f7b30153f80 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2e7fc700 1 -- 172.21.15.52:0/1510397593 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262705882 0 0) 0x7f7b30155770 con 0x7f7b300c5cf0 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2f7fe700 1 --2- 172.21.15.52:0/1510397593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30153f80 0x7f7b300a9d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f7b300aa7d0 tx=0x7f7b20009060).ready entity=mon.0 client_cookie=bb439416b65360ed server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.169+0000 7f7b2e7fc700 1 -- 172.21.15.52:0/1510397593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000f510 con 0x7f7b30153f80 2023-05-10T01:10:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b2e7fc700 1 -- 172.21.15.52:0/1510397593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000f670 con 0x7f7b30153f80 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b2e7fc700 1 -- 172.21.15.52:0/1510397593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000f9f0 con 0x7f7b30153f80 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 -- 172.21.15.52:0/1510397593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30153f80 msgr2=0x7f7b300a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/1510397593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30153f80 0x7f7b300a9d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f7b300aa7d0 tx=0x7f7b20009060).stop 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 -- 172.21.15.52:0/1510397593 shutdown_connections 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/1510397593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30153f80 0x7f7b300a9d10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 -- 172.21.15.52:0/1510397593 >> 172.21.15.52:0/1510397593 conn(0x7f7b300cb5f0 msgr2=0x7f7b300c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 -- 172.21.15.52:0/1510397593 shutdown_connections 2023-05-10T01:10:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.170+0000 7f7b34f9e700 1 -- 172.21.15.52:0/1510397593 wait complete. 2023-05-10T01:10:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.171+0000 7f7b34f9e700 1 Processor -- start 2023-05-10T01:10:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.171+0000 7f7b34f9e700 1 -- start start 2023-05-10T01:10:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b30153f80 0x7f7b3014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b30155370 0x7f7b30167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b0b90 con 0x7f7b300c5cf0 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300aff80 con 0x7f7b30153f80 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b34f9e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b0260 con 0x7f7b30155370 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60524/0 (socket says 172.21.15.52:60524) 2023-05-10T01:10:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/789706467 learned_addr learned my addr 172.21.15.52:0/789706467 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2effd700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b30153f80 0x7f7b3014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2ffff700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b30155370 0x7f7b30167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b30155370 msgr2=0x7f7b30167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b30155370 0x7f7b30167ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b30153f80 msgr2=0x7f7b3014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.172+0000 7f7b2f7fe700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b30153f80 0x7f7b3014e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b2f7fe700 1 -- 172.21.15.52:0/789706467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b200092a0 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b2f7fe700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f7b20009e80 tx=0x7f7b20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20011770 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2001e070 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300b0540 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20011b20 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.173+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300afb20 con 0x7f7b300c5cf0 2023-05-10T01:10:57.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.174+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b300c1ef0 con 0x7f7b300c5cf0 2023-05-10T01:10:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.174+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f7b2000f070 con 0x7f7b300c5cf0 2023-05-10T01:10:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.174+0000 7f7b177fe700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 0x7f7b100612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.175+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7b2007b1a0 con 0x7f7b300c5cf0 2023-05-10T01:10:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.175+0000 7f7b2effd700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 0x7f7b100612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.175+0000 7f7b2effd700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 0x7f7b100612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7b3014f0b0 tx=0x7f7b24009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.179+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b2004c5c0 con 0x7f7b300c5cf0 2023-05-10T01:10:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.380+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b300c1d50 con 0x7f7b1005ee30 2023-05-10T01:10:57.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.385+0000 7f7b177fe700 1 -- 172.21.15.52:0/789706467 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7b24007110 con 0x7f7b1005ee30 2023-05-10T01:10:57.388 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-05-10T01:10:57.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 msgr2=0x7f7b100612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 0x7f7b100612f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7b3014f0b0 tx=0x7f7b24009040).stop 2023-05-10T01:10:57.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 msgr2=0x7f7b300af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f7b20009e80 tx=0x7f7b20017000).stop 2023-05-10T01:10:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 shutdown_connections 2023-05-10T01:10:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b1005ee30 0x7f7b100612f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b30155370 0x7f7b30167ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b300c5cf0 0x7f7b300af630 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 --2- 172.21.15.52:0/789706467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b30153f80 0x7f7b3014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 >> 172.21.15.52:0/789706467 conn(0x7f7b300cb5f0 msgr2=0x7f7b300c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 shutdown_connections 2023-05-10T01:10:57.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.387+0000 7f7b34f9e700 1 -- 172.21.15.52:0/789706467 wait complete. 2023-05-10T01:10:57.403 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-05-10T01:10:57.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-05-10T01:10:57.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.523+0000 7f1813fff700 1 Processor -- start 2023-05-10T01:10:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.523+0000 7f1813fff700 1 -- start start 2023-05-10T01:10:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1813fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1814153f80 0x7f18140a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1813fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814155770 con 0x7f1814155370 2023-05-10T01:10:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1813fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181406a130 con 0x7f18140c5cf0 2023-05-10T01:10:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1813fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1814069f50 con 0x7f1814153f80 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1814153f80 0x7f18140a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f18137fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1814155370 0x7f18140c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41318/0 (socket says 172.21.15.52:41318) 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1814153f80 0x7f18140a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60532/0 (socket says 172.21.15.52:60532) 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f18137fe700 1 -- 172.21.15.52:0/1432120507 learned_addr learned my addr 172.21.15.52:0/1432120507 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 -- 172.21.15.52:0/1432120507 >> v1:172.21.15.172:6789/0 conn(0x7f18140c5cf0 legacy=0x7f18140c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 -- 172.21.15.52:0/1432120507 >> v1:172.21.15.52:6789/0 conn(0x7f1814155370 legacy=0x7f18140c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 -- 172.21.15.52:0/1432120507 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181406a410 con 0x7f1814153f80 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1811ffb700 1 -- 172.21.15.52:0/1432120507 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851419059 0 0) 0x7f1814155770 con 0x7f1814155370 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1812ffd700 1 --2- 172.21.15.52:0/1432120507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1814153f80 0x7f18140a9d10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f18140aa7d0 tx=0x7f180c009060).ready entity=mon.0 client_cookie=cfe9f6fbd307be9a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1811ffb700 1 -- 172.21.15.52:0/1432120507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00f510 con 0x7f1814153f80 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1811ffb700 1 -- 172.21.15.52:0/1432120507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00f670 con 0x7f1814153f80 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.524+0000 7f1811ffb700 1 -- 172.21.15.52:0/1432120507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00f9f0 con 0x7f1814153f80 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 -- 172.21.15.52:0/1432120507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1814153f80 msgr2=0x7f18140a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 --2- 172.21.15.52:0/1432120507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1814153f80 0x7f18140a9d10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f18140aa7d0 tx=0x7f180c009060).stop 2023-05-10T01:10:57.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 -- 172.21.15.52:0/1432120507 shutdown_connections 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 --2- 172.21.15.52:0/1432120507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1814153f80 0x7f18140a9d10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 -- 172.21.15.52:0/1432120507 >> 172.21.15.52:0/1432120507 conn(0x7f18140cb5f0 msgr2=0x7f18140c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 -- 172.21.15.52:0/1432120507 shutdown_connections 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.525+0000 7f1813fff700 1 -- 172.21.15.52:0/1432120507 wait complete. 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.526+0000 7f1813fff700 1 Processor -- start 2023-05-10T01:10:57.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.526+0000 7f1813fff700 1 -- start start 2023-05-10T01:10:57.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1814153f80 0x7f1814158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 0x7f18140c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c3640 con 0x7f18140c5cf0 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814152c30 con 0x7f1814155370 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1813fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c3ec0 con 0x7f1814153f80 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60536/0 (socket says 172.21.15.52:60536) 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 -- 172.21.15.52:0/1149708701 learned_addr learned my addr 172.21.15.52:0/1149708701 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f18137fe700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 0x7f18140c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f18127fc700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1814153f80 0x7f1814158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 -- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1814153f80 msgr2=0x7f1814158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1814153f80 0x7f1814158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 -- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 msgr2=0x7f18140c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 0x7f18140c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f1812ffd700 1 -- 172.21.15.52:0/1149708701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0092a0 con 0x7f18140c5cf0 2023-05-10T01:10:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.527+0000 7f18137fe700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 0x7f18140c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:57.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f1812ffd700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f180c00fa90 tx=0x7f180c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c0117e0 con 0x7f18140c5cf0 2023-05-10T01:10:57.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c01e070 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1814168d30 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011b90 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.528+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140c3870 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.529+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18140c41a0 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.529+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f180c00f070 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.529+0000 7f180affd700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 0x7f17f80612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.529+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f180c07b130 con 0x7f18140c5cf0 2023-05-10T01:10:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.530+0000 7f18127fc700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 0x7f17f80612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.530+0000 7f18127fc700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 0x7f17f80612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1814151fc0 tx=0x7f17fc009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.534+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f180c04c550 con 0x7f18140c5cf0 2023-05-10T01:10:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.733+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18140c4000 con 0x7f17f805ee00 2023-05-10T01:10:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.738+0000 7f180affd700 1 -- 172.21.15.52:0/1149708701 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f17fc003340 con 0x7f17f805ee00 2023-05-10T01:10:57.741 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-05-10T01:10:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 msgr2=0x7f17f80612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 0x7f17f80612c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1814151fc0 tx=0x7f17fc009040).stop 2023-05-10T01:10:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 msgr2=0x7f1814168840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f180c00fa90 tx=0x7f180c017000).stop 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 shutdown_connections 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17f805ee00 0x7f17f80612c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1814155370 0x7f18140c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18140c5cf0 0x7f1814168840 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 --2- 172.21.15.52:0/1149708701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1814153f80 0x7f1814158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 >> 172.21.15.52:0/1149708701 conn(0x7f18140cb5f0 msgr2=0x7f18140c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 shutdown_connections 2023-05-10T01:10:57.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.740+0000 7f1813fff700 1 -- 172.21.15.52:0/1149708701 wait complete. 2023-05-10T01:10:57.755 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-05-10T01:10:57.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-05-10T01:10:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.874+0000 7f9abaede700 1 Processor -- start 2023-05-10T01:10:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.874+0000 7f9abaede700 1 -- start start 2023-05-10T01:10:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9abaede700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9ab40c1150 0x7f9ab40c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9abaede700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab406a130 con 0x7f9ab40c61e0 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9abaede700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab406a410 con 0x7f9ab4153f80 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9abaede700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab4069f50 con 0x7f9ab40c1150 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9aba6dd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ab40c61e0 0x7f9ab4154360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41332/0 (socket says 172.21.15.52:41332) 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9aba6dd700 1 -- 172.21.15.52:0/2653367345 learned_addr learned my addr 172.21.15.52:0/2653367345 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab96db700 1 --2- 172.21.15.52:0/2653367345 >> v2:172.21.15.172:3300/0 conn(0x7f9ab40c1150 0x7f9ab40c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735216140 0 0) 0x7f9ab406a130 con 0x7f9ab40c61e0 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa00033f0 con 0x7f9ab40c61e0 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 253955183 0 0) 0x7f9aa00033f0 con 0x7f9ab40c61e0 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 >> v2:172.21.15.172:3300/0 conn(0x7f9ab40c1150 msgr2=0x7f9ab40c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 --2- 172.21.15.52:0/2653367345 >> v2:172.21.15.172:3300/0 conn(0x7f9ab40c1150 0x7f9ab40c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 >> v1:172.21.15.172:6789/0 conn(0x7f9ab4153f80 legacy=0x7f9ab40a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab406a6f0 con 0x7f9ab40c61e0 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f9aa4001470 con 0x7f9ab40c61e0 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 >> v1:172.21.15.52:6789/0 conn(0x7f9ab40c61e0 legacy=0x7f9ab4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.875+0000 7f9ab8eda700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 0x7f9aa0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9aa0004690 0x7f9aa0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa0005000 0x7f9aa000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4069f50 con 0x7f9aa00038e0 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa000beb0 con 0x7f9aa0005000 2023-05-10T01:10:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa000c070 con 0x7f9aa0004690 2023-05-10T01:10:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 0x7f9aa0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9aba6dd700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa0005000 0x7f9aa000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab96db700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9aa0004690 0x7f9aa0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 -- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9aa0004690 msgr2=0x7f9aa0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9aa0004690 0x7f9aa0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 -- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa0005000 msgr2=0x7f9aa000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa0005000 0x7f9aa000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 -- 172.21.15.52:0/2653367345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00033f0 con 0x7f9aa00038e0 2023-05-10T01:10:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9aba6dd700 1 -- 172.21.15.52:0/2653367345 reap_dead start 2023-05-10T01:10:57.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 0x7f9aa0003d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f9aac001e60 tx=0x7f9aac007f30).ready entity=mon.0 client_cookie=ba8bcf66778e33ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac006a20 con 0x7f9aa00038e0 2023-05-10T01:10:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac006b80 con 0x7f9aa00038e0 2023-05-10T01:10:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.876+0000 7f9ab8eda700 1 -- 172.21.15.52:0/2653367345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00c6a0 con 0x7f9aa00038e0 2023-05-10T01:10:57.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 -- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 msgr2=0x7f9aa0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 0x7f9aa0003d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f9aac001e60 tx=0x7f9aac007f30).stop 2023-05-10T01:10:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 -- 172.21.15.52:0/2653367345 shutdown_connections 2023-05-10T01:10:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 --2- 172.21.15.52:0/2653367345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa00038e0 0x7f9aa0003d00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 -- 172.21.15.52:0/2653367345 >> 172.21.15.52:0/2653367345 conn(0x7f9ab40cb5f0 msgr2=0x7f9ab40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:57.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 -- 172.21.15.52:0/2653367345 shutdown_connections 2023-05-10T01:10:57.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.877+0000 7f9abaede700 1 -- 172.21.15.52:0/2653367345 wait complete. 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.878+0000 7f9abaede700 1 Processor -- start 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.878+0000 7f9abaede700 1 -- start start 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa00038e0 0x7f9ab40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ab4154d40 0x7f9ab4150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4155b10 con 0x7f9ab4155f30 2023-05-10T01:10:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab40adc90 con 0x7f9aa00038e0 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9abaede700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41568a0 con 0x7f9ab4154d40 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60558/0 (socket says 172.21.15.52:60558) 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 -- 172.21.15.52:0/3815156734 learned_addr learned my addr 172.21.15.52:0/3815156734 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa00038e0 0x7f9ab40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9ab96db700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ab4154d40 0x7f9ab4150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 -- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ab4154d40 msgr2=0x7f9ab4150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ab4154d40 0x7f9ab4150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 -- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa00038e0 msgr2=0x7f9ab40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa00038e0 0x7f9ab40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 -- 172.21.15.52:0/3815156734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4155270 con 0x7f9ab4155f30 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.879+0000 7f9aba6dd700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9ab406bdc0 tx=0x7f9aa4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.880+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4011590 con 0x7f9ab4155f30 2023-05-10T01:10:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.880+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40116f0 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.880+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab4155550 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.880+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4011a90 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.880+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab40b0a20 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.881+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab4069bb0 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.881+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f9aa401e030 con 0x7f9ab4155f30 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.881+0000 7f9ab1ffb700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 0x7f9a940612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.882+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9aa4079850 con 0x7f9ab4155f30 2023-05-10T01:10:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.882+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 0x7f9a940612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.882+0000 7f9ab9edc700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 0x7f9a940612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9aac001630 tx=0x7f9aac015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:57.886+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9aa404ac70 con 0x7f9ab4155f30 2023-05-10T01:10:58.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.084+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab4083110 con 0x7f9a9405ee30 2023-05-10T01:10:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.089+0000 7f9ab1ffb700 1 -- 172.21.15.52:0/3815156734 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9ab4083110 con 0x7f9a9405ee30 2023-05-10T01:10:58.092 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-05-10T01:10:58.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 msgr2=0x7f9a940612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 0x7f9a940612f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9aac001630 tx=0x7f9aac015000).stop 2023-05-10T01:10:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 msgr2=0x7f9ab41563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9ab406bdc0 tx=0x7f9aa4001e50).stop 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 shutdown_connections 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a9405ee30 0x7f9a940612f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ab4155f30 0x7f9ab41563b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa00038e0 0x7f9ab40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 --2- 172.21.15.52:0/3815156734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ab4154d40 0x7f9ab4150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 >> 172.21.15.52:0/3815156734 conn(0x7f9ab40cb5f0 msgr2=0x7f9ab4068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 shutdown_connections 2023-05-10T01:10:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.091+0000 7f9abaede700 1 -- 172.21.15.52:0/3815156734 wait complete. 2023-05-10T01:10:58.105 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-05-10T01:10:58.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-05-10T01:10:58.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.224+0000 7f82a295d700 1 Processor -- start 2023-05-10T01:10:58.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.224+0000 7f82a295d700 1 -- start start 2023-05-10T01:10:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f82a295d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f829c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f82a295d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0c6310 con 0x7f829c154110 2023-05-10T01:10:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f82a295d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c1550e0 con 0x7f829c0cb410 2023-05-10T01:10:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f82a295d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c6830 con 0x7f829c155570 2023-05-10T01:10:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f829bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f829c154110 0x7f829c0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41346/0 (socket says 172.21.15.52:41346) 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f829bfff700 1 -- 172.21.15.52:0/865645412 learned_addr learned my addr 172.21.15.52:0/865645412 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077707702 0 0) 0x7f828c001290 con 0x7f829c154110 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f82a0efa700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f829c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.225+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c0033f0 con 0x7f829c154110 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007312295 0 0) 0x7f827c0033f0 con 0x7f829c154110 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 msgr2=0x7f829c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f829c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 >> v1:172.21.15.172:6789/0 conn(0x7f829c0cb410 legacy=0x7f829c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0c6550 con 0x7f829c154110 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f828c001780 con 0x7f829c154110 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 >> v1:172.21.15.52:6789/0 conn(0x7f829c154110 legacy=0x7f829c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f827c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827c003e40 0x7f827c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f827c004b80 0x7f827c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c6830 con 0x7f827c004b80 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00b990 con 0x7f827c003e40 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c00bb50 con 0x7f829c155570 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f827c004b80 0x7f827c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829bfff700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f827c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f8293fff700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827c003e40 0x7f827c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 -- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 msgr2=0x7f827c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c155570 0x7f827c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 -- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827c003e40 msgr2=0x7f827c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827c003e40 0x7f827c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 -- 172.21.15.52:0/865645412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0033f0 con 0x7f827c004b80 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f82a0efa700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f827c004b80 0x7f827c005000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f829c0aa6d0 tx=0x7f829400b040).ready entity=mon.0 client_cookie=950e77e07d88ecd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294009ac0 con 0x7f827c004b80 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400f040 con 0x7f827c004b80 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.226+0000 7f829b7fe700 1 -- 172.21.15.52:0/865645412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400ec40 con 0x7f827c004b80 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 -- 172.21.15.52:0/865645412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f827c004b80 msgr2=0x7f827c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 --2- 172.21.15.52:0/865645412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f827c004b80 0x7f827c005000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f829c0aa6d0 tx=0x7f829400b040).stop 2023-05-10T01:10:58.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a0efa700 1 -- 172.21.15.52:0/865645412 reap_dead start 2023-05-10T01:10:58.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 -- 172.21.15.52:0/865645412 shutdown_connections 2023-05-10T01:10:58.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 -- 172.21.15.52:0/865645412 >> 172.21.15.52:0/865645412 conn(0x7f829c0678d0 msgr2=0x7f829c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 -- 172.21.15.52:0/865645412 shutdown_connections 2023-05-10T01:10:58.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.227+0000 7f82a295d700 1 -- 172.21.15.52:0/865645412 wait complete. 2023-05-10T01:10:58.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.228+0000 7f82a295d700 1 Processor -- start 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.228+0000 7f82a295d700 1 -- start start 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c0a9f60 0x7f829c0c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c0c14a0 0x7f829c0c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c165980 con 0x7f829c152840 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c1920 con 0x7f829c0a9f60 2023-05-10T01:10:58.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c3740 con 0x7f829c0c14a0 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60574/0 (socket says 172.21.15.52:60574) 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 -- 172.21.15.52:0/1996519079 learned_addr learned my addr 172.21.15.52:0/1996519079 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f8293fff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c0a9f60 0x7f829c0c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a0efa700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c0c14a0 0x7f829c0c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 -- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c0c14a0 msgr2=0x7f829c0c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c0c14a0 0x7f829c0c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 -- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c0a9f60 msgr2=0x7f829c0c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c0a9f60 0x7f829c0c0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 -- 172.21.15.52:0/1996519079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c164d70 con 0x7f829c152840 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f829bfff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f828c0069e0 tx=0x7f828c0078f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c006e50 con 0x7f829c152840 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00f8d0 con 0x7f829c152840 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c165050 con 0x7f829c152840 2023-05-10T01:10:58.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.229+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00fc50 con 0x7f829c152840 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.230+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c165610 con 0x7f829c152840 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.231+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f828c014450 con 0x7f829c152840 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.231+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0c1df0 con 0x7f829c152840 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.231+0000 7f8298ff9700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 0x7f82800612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.231+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f828c079df0 con 0x7f829c152840 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.231+0000 7f8293fff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 0x7f82800612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.232+0000 7f8293fff700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 0x7f82800612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8284007cc0 tx=0x7f8284009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.235+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f828c0498f0 con 0x7f829c152840 2023-05-10T01:10:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.438+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f829c0c6310 con 0x7f828005ee30 2023-05-10T01:10:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.443+0000 7f8298ff9700 1 -- 172.21.15.52:0/1996519079 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f829c0c6310 con 0x7f828005ee30 2023-05-10T01:10:58.445 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-05-10T01:10:58.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 msgr2=0x7f82800612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 0x7f82800612f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8284007cc0 tx=0x7f8284009040).stop 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 msgr2=0x7f829c0c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f828c0069e0 tx=0x7f828c0078f0).stop 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 shutdown_connections 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828005ee30 0x7f82800612f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f829c0c14a0 0x7f829c0c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c152840 0x7f829c0c3250 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 --2- 172.21.15.52:0/1996519079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c0a9f60 0x7f829c0c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 >> 172.21.15.52:0/1996519079 conn(0x7f829c0678d0 msgr2=0x7f829c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 shutdown_connections 2023-05-10T01:10:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.445+0000 7f82a295d700 1 -- 172.21.15.52:0/1996519079 wait complete. 2023-05-10T01:10:58.459 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-05-10T01:10:58.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-05-10T01:10:58.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.580+0000 7f53c359e700 1 Processor -- start 2023-05-10T01:10:58.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.580+0000 7f53c359e700 1 -- start start 2023-05-10T01:10:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53c40c1150 0x7f53c40c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c61e0 0x7f53c4154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40c6630 con 0x7f53c4153f80 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c359e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c4069f50 con 0x7f53c40c1150 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c406a9d0 con 0x7f53c40c61e0 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53c40c1150 0x7f53c40c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53c40c1150 0x7f53c40c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60584/0 (socket says 172.21.15.52:60584) 2023-05-10T01:10:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1422011183 learned_addr learned my addr 172.21.15.52:0/1422011183 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c2d9d700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c61e0 0x7f53c4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1422011183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c61e0 msgr2=0x7f53c4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c61e0 0x7f53c4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1422011183 >> v1:172.21.15.172:6789/0 conn(0x7f53c4153f80 legacy=0x7f53c40a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1422011183 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c406a130 con 0x7f53c40c1150 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c1d9b700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c1150 0x7f53c40c5cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f53ac006fd0 tx=0x7f53ac0090f0).ready entity=mon.0 client_cookie=abe7ab343d95d68d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c159a700 1 -- 172.21.15.52:0/1422011183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00b600 con 0x7f53c40c1150 2023-05-10T01:10:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c159a700 1 -- 172.21.15.52:0/1422011183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00b760 con 0x7f53c40c1150 2023-05-10T01:10:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.581+0000 7f53c159a700 1 -- 172.21.15.52:0/1422011183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00bae0 con 0x7f53c40c1150 2023-05-10T01:10:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 -- 172.21.15.52:0/1422011183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c1150 msgr2=0x7f53c40c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c1150 0x7f53c40c5cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f53ac006fd0 tx=0x7f53ac0090f0).stop 2023-05-10T01:10:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 -- 172.21.15.52:0/1422011183 shutdown_connections 2023-05-10T01:10:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c61e0 0x7f53c4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 --2- 172.21.15.52:0/1422011183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c1150 0x7f53c40c5cf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 -- 172.21.15.52:0/1422011183 >> 172.21.15.52:0/1422011183 conn(0x7f53c40cb5f0 msgr2=0x7f53c40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 -- 172.21.15.52:0/1422011183 shutdown_connections 2023-05-10T01:10:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.582+0000 7f53c359e700 1 -- 172.21.15.52:0/1422011183 wait complete. 2023-05-10T01:10:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.583+0000 7f53c359e700 1 Processor -- start 2023-05-10T01:10:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.583+0000 7f53c359e700 1 -- start start 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c1150 0x7f53c40adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 0x7f53c4167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40af7a0 con 0x7f53c40c61e0 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40af1a0 con 0x7f53c4153f80 2023-05-10T01:10:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40a1a60 con 0x7f53c40c1150 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60590/0 (socket says 172.21.15.52:60590) 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1255085466 learned_addr learned my addr 172.21.15.52:0/1255085466 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c259c700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c1150 0x7f53c40adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c2d9d700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 0x7f53c4167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c1150 msgr2=0x7f53c40adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c1150 0x7f53c40adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 msgr2=0x7f53c4167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 0x7f53c4167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 -- 172.21.15.52:0/1255085466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009370 con 0x7f53c40c61e0 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c2d9d700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 0x7f53c4167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.584+0000 7f53c1d9b700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f53ac011000 tx=0x7f53ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.585+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00b8d0 con 0x7f53c40c61e0 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.585+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00ba30 con 0x7f53c40c61e0 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.585+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40a1d40 con 0x7f53c40c61e0 2023-05-10T01:10:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.585+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac01c670 con 0x7f53c40c61e0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.585+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c40ae460 con 0x7f53c40c61e0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.586+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c4083110 con 0x7f53c40c61e0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.586+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f53ac02c070 con 0x7f53c40c61e0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.586+0000 7f53ba7fc700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 0x7f53a80612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.586+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f53ac07b8b0 con 0x7f53c40c61e0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.587+0000 7f53c259c700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 0x7f53a80612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.587+0000 7f53c259c700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 0x7f53a80612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f53bc004290 tx=0x7f53bc0014c0).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.590+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f53ac04ccd0 con 0x7f53c40c61e0 2023-05-10T01:10:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.795+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f53c4047150 con 0x7f53a805ee30 2023-05-10T01:10:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.799+0000 7f53ba7fc700 1 -- 172.21.15.52:0/1255085466 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f53c4047150 con 0x7f53a805ee30 2023-05-10T01:10:58.802 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-05-10T01:10:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 msgr2=0x7f53a80612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 0x7f53a80612f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f53bc004290 tx=0x7f53bc0014c0).stop 2023-05-10T01:10:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 msgr2=0x7f53c40a9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f53ac011000 tx=0x7f53ac017000).stop 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 shutdown_connections 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f53a805ee30 0x7f53a80612f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c4153f80 0x7f53c4167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53c40c1150 0x7f53c40adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 --2- 172.21.15.52:0/1255085466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c40c61e0 0x7f53c40a9ae0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 >> 172.21.15.52:0/1255085466 conn(0x7f53c40cb5f0 msgr2=0x7f53c414f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 shutdown_connections 2023-05-10T01:10:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.801+0000 7f53c359e700 1 -- 172.21.15.52:0/1255085466 wait complete. 2023-05-10T01:10:58.816 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-05-10T01:10:58.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-05-10T01:10:58.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.935+0000 7f0f5e83c700 1 Processor -- start 2023-05-10T01:10:58.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.935+0000 7f0f5e83c700 1 -- start start 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e83c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f580c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e83c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580c6650 con 0x7f0f580c61e0 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e83c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5806a130 con 0x7f0f58153f80 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e83c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58069f50 con 0x7f0f580c1150 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e03b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f580c61e0 0x7f0f58154360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41384/0 (socket says 172.21.15.52:41384) 2023-05-10T01:10:58.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5e03b700 1 -- 172.21.15.52:0/3905362202 learned_addr learned my addr 172.21.15.52:0/3905362202 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f580c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236097424 0 0) 0x7f0f580c6650 con 0x7f0f580c61e0 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f440033f0 con 0x7f0f580c61e0 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476164826 0 0) 0x7f0f440033f0 con 0x7f0f580c61e0 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 msgr2=0x7f0f580c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f580c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 >> v1:172.21.15.172:6789/0 conn(0x7f0f58153f80 legacy=0x7f0f580a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5806a410 con 0x7f0f580c61e0 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0f50001470 con 0x7f0f580c61e0 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 >> v1:172.21.15.52:6789/0 conn(0x7f0f580c61e0 legacy=0x7f0f58154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f44003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f44003e00 0x7f0f44004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.936+0000 7f0f5c838700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f44004b80 0x7f0f44005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58069f50 con 0x7f0f44003e00 2023-05-10T01:10:58.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4400b8e0 con 0x7f0f44004b80 2023-05-10T01:10:58.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4400baa0 con 0x7f0f580c1150 2023-05-10T01:10:58.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f44003e00 0x7f0f44004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d83a700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f44003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5e03b700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f44004b80 0x7f0f44005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 -- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 msgr2=0x7f0f44003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f580c1150 0x7f0f44003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 -- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f44004b80 msgr2=0x7f0f44005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f44004b80 0x7f0f44005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 -- 172.21.15.52:0/3905362202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440033f0 con 0x7f0f44003e00 2023-05-10T01:10:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5e03b700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f44004b80 0x7f0f44005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f44003e00 0x7f0f44004690 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0f4c009a80 tx=0x7f0f4c009060).ready entity=mon.0 client_cookie=9cd3dc8dbf202cf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c009430 con 0x7f0f44003e00 2023-05-10T01:10:58.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00e640 con 0x7f0f44003e00 2023-05-10T01:10:58.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.937+0000 7f0f5c838700 1 -- 172.21.15.52:0/3905362202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00e9c0 con 0x7f0f44003e00 2023-05-10T01:10:58.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3905362202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f44003e00 msgr2=0x7f0f44004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3905362202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f44003e00 0x7f0f44004690 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0f4c009a80 tx=0x7f0f4c009060).stop 2023-05-10T01:10:58.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e03b700 1 -- 172.21.15.52:0/3905362202 reap_dead start 2023-05-10T01:10:58.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3905362202 shutdown_connections 2023-05-10T01:10:58.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3905362202 >> 172.21.15.52:0/3905362202 conn(0x7f0f580cb5f0 msgr2=0x7f0f580c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:58.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3905362202 shutdown_connections 2023-05-10T01:10:58.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.938+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3905362202 wait complete. 2023-05-10T01:10:58.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.939+0000 7f0f5e83c700 1 Processor -- start 2023-05-10T01:10:58.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.939+0000 7f0f5e83c700 1 -- start start 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f44003e00 0x7f0f580b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f580c8ba0 0x7f0f580c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580b0bf0 con 0x7f0f580c3430 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580c4520 con 0x7f0f580c8ba0 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580c94d0 con 0x7f0f44003e00 2023-05-10T01:10:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60610/0 (socket says 172.21.15.52:60610) 2023-05-10T01:10:58.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 -- 172.21.15.52:0/3476466564 learned_addr learned my addr 172.21.15.52:0/3476466564 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:58.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d83a700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f44003e00 0x7f0f580b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e03b700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f580c8ba0 0x7f0f580c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 -- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f44003e00 msgr2=0x7f0f580b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f44003e00 0x7f0f580b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 -- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f580c8ba0 msgr2=0x7f0f580c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f580c8ba0 0x7f0f580c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 -- 172.21.15.52:0/3476466564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580c49b0 con 0x7f0f580c3430 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5d039700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0f44004610 tx=0x7f0f4c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00ed70 con 0x7f0f580c3430 2023-05-10T01:10:58.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00eed0 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580c3910 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00ea00 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.940+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f580c3ed0 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.941+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58083110 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.942+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f0f4c02c020 con 0x7f0f580c3430 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.942+0000 7f0f55ffb700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 0x7f0f380612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:58.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.942+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0f4c07b8d0 con 0x7f0f580c3430 2023-05-10T01:10:58.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.942+0000 7f0f5d83a700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 0x7f0f380612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:58.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.943+0000 7f0f5d83a700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 0x7f0f380612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0f48004290 tx=0x7f0f48007f10).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:58.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:58.946+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f4c04ccf0 con 0x7f0f580c3430 2023-05-10T01:10:59.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.146+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f580c46b0 con 0x7f0f3805ee30 2023-05-10T01:10:59.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.151+0000 7f0f55ffb700 1 -- 172.21.15.52:0/3476466564 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0f580c46b0 con 0x7f0f3805ee30 2023-05-10T01:10:59.154 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-05-10T01:10:59.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 msgr2=0x7f0f380612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 0x7f0f380612f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0f48004290 tx=0x7f0f48007f10).stop 2023-05-10T01:10:59.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 msgr2=0x7f0f581436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0f44004610 tx=0x7f0f4c01a000).stop 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 shutdown_connections 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0f3805ee30 0x7f0f380612f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f580c8ba0 0x7f0f580c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f44003e00 0x7f0f580b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 --2- 172.21.15.52:0/3476466564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f580c3430 0x7f0f581436e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 >> 172.21.15.52:0/3476466564 conn(0x7f0f580cb5f0 msgr2=0x7f0f580acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:59.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 shutdown_connections 2023-05-10T01:10:59.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.153+0000 7f0f5e83c700 1 -- 172.21.15.52:0/3476466564 wait complete. 2023-05-10T01:10:59.167 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-05-10T01:10:59.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-05-10T01:10:59.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.286+0000 7f770207d700 1 Processor -- start 2023-05-10T01:10:59.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.286+0000 7f770207d700 1 -- start start 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770207d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76fc153f80 0x7f76fc0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770207d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc155770 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770207d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc06a130 con 0x7f76fc155370 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770207d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc069f50 con 0x7f76fc153f80 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770107b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76fc153f80 0x7f76fc0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770087a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f76fc0c5cf0 0x7f76fc0c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41404/0 (socket says 172.21.15.52:41404) 2023-05-10T01:10:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770087a700 1 -- 172.21.15.52:0/3688946495 learned_addr learned my addr 172.21.15.52:0/3688946495 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:10:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770107b700 1 -- 172.21.15.52:0/3688946495 >> v1:172.21.15.172:6789/0 conn(0x7f76fc155370 legacy=0x7f76fc0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770107b700 1 -- 172.21.15.52:0/3688946495 >> v1:172.21.15.52:6789/0 conn(0x7f76fc0c5cf0 legacy=0x7f76fc0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f76fbfff700 1 -- 172.21.15.52:0/3688946495 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655373666 0 0) 0x7f76fc155770 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770107b700 1 -- 172.21.15.52:0/3688946495 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc06a410 con 0x7f76fc153f80 2023-05-10T01:10:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f770107b700 1 --2- 172.21.15.52:0/3688946495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc153f80 0x7f76fc0a9d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f76fc0aa7d0 tx=0x7f76f4009780).ready entity=mon.0 client_cookie=9d2098d699a49fde server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f76fbfff700 1 -- 172.21.15.52:0/3688946495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400e070 con 0x7f76fc153f80 2023-05-10T01:10:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f76fbfff700 1 -- 172.21.15.52:0/3688946495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400bc30 con 0x7f76fc153f80 2023-05-10T01:10:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.287+0000 7f76fbfff700 1 -- 172.21.15.52:0/3688946495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4012410 con 0x7f76fc153f80 2023-05-10T01:10:59.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 -- 172.21.15.52:0/3688946495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc153f80 msgr2=0x7f76fc0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 --2- 172.21.15.52:0/3688946495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc153f80 0x7f76fc0a9d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f76fc0aa7d0 tx=0x7f76f4009780).stop 2023-05-10T01:10:59.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 -- 172.21.15.52:0/3688946495 shutdown_connections 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 --2- 172.21.15.52:0/3688946495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc153f80 0x7f76fc0a9d10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 -- 172.21.15.52:0/3688946495 >> 172.21.15.52:0/3688946495 conn(0x7f76fc0cb5f0 msgr2=0x7f76fc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 -- 172.21.15.52:0/3688946495 shutdown_connections 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.288+0000 7f770207d700 1 -- 172.21.15.52:0/3688946495 wait complete. 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.289+0000 7f770207d700 1 Processor -- start 2023-05-10T01:10:59.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.289+0000 7f770207d700 1 -- start start 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 0x7f76fc0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76fc155370 0x7f76fc14f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1567f0 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0c27e0 con 0x7f76fc155370 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770207d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0ae030 con 0x7f76fc153f80 2023-05-10T01:10:59.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60622/0 (socket says 172.21.15.52:60622) 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 -- 172.21.15.52:0/1916183007 learned_addr learned my addr 172.21.15.52:0/1916183007 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770087a700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 0x7f76fc0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770187c700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76fc155370 0x7f76fc14f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 -- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 msgr2=0x7f76fc0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 0x7f76fc0adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 -- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76fc155370 msgr2=0x7f76fc14f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76fc155370 0x7f76fc14f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770107b700 1 -- 172.21.15.52:0/1916183007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4009a20 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.290+0000 7f770087a700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 0x7f76fc0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f770107b700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f76f400b6c0 tx=0x7f76f4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f401d630 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f401d790 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f401db10 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc157270 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.291+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc156cb0 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.292+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc083110 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.292+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f76f4027460 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.292+0000 7f76f97fa700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 0x7f76dc0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.293+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f76f407c000 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.293+0000 7f770087a700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 0x7f76dc0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.293+0000 7f770087a700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 0x7f76dc0612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f76fc153010 tx=0x7f76f0009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.297+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76f404d3c0 con 0x7f76fc0c5cf0 2023-05-10T01:10:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.499+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f76fc047150 con 0x7f76dc05ee30 2023-05-10T01:10:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.504+0000 7f76f97fa700 1 -- 172.21.15.52:0/1916183007 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f76fc047150 con 0x7f76dc05ee30 2023-05-10T01:10:59.507 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-05-10T01:10:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 msgr2=0x7f76dc0612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 0x7f76dc0612f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f76fc153010 tx=0x7f76f0009040).stop 2023-05-10T01:10:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 msgr2=0x7f76fc156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f76f400b6c0 tx=0x7f76f4009780).stop 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 shutdown_connections 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f76dc05ee30 0x7f76dc0612f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76fc155370 0x7f76fc14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76fc0c5cf0 0x7f76fc156300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 --2- 172.21.15.52:0/1916183007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76fc153f80 0x7f76fc0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 >> 172.21.15.52:0/1916183007 conn(0x7f76fc0cb5f0 msgr2=0x7f76fc0c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 shutdown_connections 2023-05-10T01:10:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.506+0000 7f770207d700 1 -- 172.21.15.52:0/1916183007 wait complete. 2023-05-10T01:10:59.520 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-05-10T01:10:59.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-05-10T01:10:59.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.639+0000 7fc17f59e700 1 Processor -- start 2023-05-10T01:10:59.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.639+0000 7fc17f59e700 1 -- start start 2023-05-10T01:10:59.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17f59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc180153f80 0x7fc1800a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c5cf0 0x7fc1800c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1800c6660 con 0x7fc1800c0140 2023-05-10T01:10:59.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17f59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc180069f50 con 0x7fc180153f80 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18006a9d0 con 0x7fc1800c5cf0 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc180153f80 0x7fc1800a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc180153f80 0x7fc1800a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60630/0 (socket says 172.21.15.52:60630) 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17e59c700 1 -- 172.21.15.52:0/989517343 learned_addr learned my addr 172.21.15.52:0/989517343 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.640+0000 7fc17dd9b700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c5cf0 0x7fc1800c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17e59c700 1 -- 172.21.15.52:0/989517343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c5cf0 msgr2=0x7fc1800c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17e59c700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c5cf0 0x7fc1800c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17e59c700 1 -- 172.21.15.52:0/989517343 >> v1:172.21.15.172:6789/0 conn(0x7fc1800c0140 legacy=0x7fc1800c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17e59c700 1 -- 172.21.15.52:0/989517343 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18006a130 con 0x7fc180153f80 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17e59c700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc1800a9d10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fc178006fd0 tx=0x7fc1780090f0).ready entity=mon.0 client_cookie=d2f54dc001b52261 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17d59a700 1 -- 172.21.15.52:0/989517343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800b600 con 0x7fc180153f80 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17d59a700 1 -- 172.21.15.52:0/989517343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800b760 con 0x7fc180153f80 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17d59a700 1 -- 172.21.15.52:0/989517343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800bae0 con 0x7fc180153f80 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 -- 172.21.15.52:0/989517343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 msgr2=0x7fc1800a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc1800a9d10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fc178006fd0 tx=0x7fc1780090f0).stop 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 -- 172.21.15.52:0/989517343 shutdown_connections 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc1800a9d10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 --2- 172.21.15.52:0/989517343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c5cf0 0x7fc1800c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.641+0000 7fc17f59e700 1 -- 172.21.15.52:0/989517343 >> 172.21.15.52:0/989517343 conn(0x7fc1800cb5f0 msgr2=0x7fc1800c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.642+0000 7fc17f59e700 1 -- 172.21.15.52:0/989517343 shutdown_connections 2023-05-10T01:10:59.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.642+0000 7fc17f59e700 1 -- 172.21.15.52:0/989517343 wait complete. 2023-05-10T01:10:59.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 Processor -- start 2023-05-10T01:10:59.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 -- start start 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c0140 0x7fc1800b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1800c5cf0 0x7fc1801503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801653b0 con 0x7fc180153f80 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180164df0 con 0x7fc1800c5cf0 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801650d0 con 0x7fc1800c0140 2023-05-10T01:10:59.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.643+0000 7fc17ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60640/0 (socket says 172.21.15.52:60640) 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 -- 172.21.15.52:0/41839185 learned_addr learned my addr 172.21.15.52:0/41839185 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17dd9b700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1800c5cf0 0x7fc1801503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17e59c700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c0140 0x7fc1800b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 -- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c0140 msgr2=0x7fc1800b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c0140 0x7fc1800b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 -- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1800c5cf0 msgr2=0x7fc1801503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1800c5cf0 0x7fc1801503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 -- 172.21.15.52:0/41839185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178009370 con 0x7fc180153f80 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17ed9d700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fc170002230 tx=0x7fc1700015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000e4a0 con 0x7fc180153f80 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000e600 con 0x7fc180153f80 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc180165710 con 0x7fc180153f80 2023-05-10T01:10:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000e980 con 0x7fc180153f80 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.644+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1801508b0 con 0x7fc180153f80 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.645+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc180083110 con 0x7fc180153f80 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.645+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fc170019030 con 0x7fc180153f80 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.646+0000 7fc1767fc700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 0x7fc1640612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.646+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc1700792e0 con 0x7fc180153f80 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.646+0000 7fc17e59c700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 0x7fc1640612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:10:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.646+0000 7fc17e59c700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 0x7fc1640612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc178009130 tx=0x7fc178017000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:10:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.650+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1700488f0 con 0x7fc180153f80 2023-05-10T01:10:59.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.852+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc180047150 con 0x7fc16405ee30 2023-05-10T01:10:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.856+0000 7fc1767fc700 1 -- 172.21.15.52:0/41839185 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc180047150 con 0x7fc16405ee30 2023-05-10T01:10:59.859 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-05-10T01:10:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 msgr2=0x7fc1640612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 0x7fc1640612f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc178009130 tx=0x7fc178017000).stop 2023-05-10T01:10:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 msgr2=0x7fc180164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:10:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fc170002230 tx=0x7fc1700015e0).stop 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 shutdown_connections 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc16405ee30 0x7fc1640612f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180153f80 0x7fc180164480 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1800c0140 0x7fc1800b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 --2- 172.21.15.52:0/41839185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1800c5cf0 0x7fc1801503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 >> 172.21.15.52:0/41839185 conn(0x7fc1800cb5f0 msgr2=0x7fc1800c0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:10:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 shutdown_connections 2023-05-10T01:10:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.858+0000 7fc17f59e700 1 -- 172.21.15.52:0/41839185 wait complete. 2023-05-10T01:10:59.873 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-05-10T01:10:59.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-05-10T01:10:59.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 Processor -- start 2023-05-10T01:10:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 -- start start 2023-05-10T01:11:00.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e2014f980 0x7f7e200c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e20152e30 0x7f7e200c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e20063680 con 0x7f7e200622a0 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2014fd60 con 0x7f7e20152e30 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.993+0000 7f7e25e0d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200c52e0 con 0x7f7e2014f980 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7e200622a0 0x7f7e20063b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41432/0 (socket says 172.21.15.52:41432) 2023-05-10T01:11:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1ffff700 1 -- 172.21.15.52:0/3406599845 learned_addr learned my addr 172.21.15.52:0/3406599845 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:11:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e2014f980 0x7f7e200c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> v2:172.21.15.172:3300/0 conn(0x7f7e20152e30 0x7f7e200c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377891774 0 0) 0x7f7e20063680 con 0x7f7e200622a0 2023-05-10T01:11:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e0c0033f0 con 0x7f7e200622a0 2023-05-10T01:11:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489582666 0 0) 0x7f7e0c0033f0 con 0x7f7e200622a0 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e2014f980 msgr2=0x7f7e200c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e2014f980 0x7f7e200c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 >> v2:172.21.15.172:3300/0 conn(0x7f7e20152e30 msgr2=0x7f7e200c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 --2- 172.21.15.52:0/3406599845 >> v2:172.21.15.172:3300/0 conn(0x7f7e20152e30 0x7f7e200c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200c5cd0 con 0x7f7e200622a0 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7e180017f0 con 0x7f7e200622a0 2023-05-10T01:11:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 >> v1:172.21.15.52:6789/0 conn(0x7f7e200622a0 legacy=0x7f7e20063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e0c0038e0 0x7f7e0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e0c005000 0x7f7e0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2014fd60 con 0x7f7e0c004690 2023-05-10T01:11:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200c52e0 con 0x7f7e0c005000 2023-05-10T01:11:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c00be20 con 0x7f7e0c0038e0 2023-05-10T01:11:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> v2:172.21.15.172:3300/0 conn(0x7f7e20152e30 0x7f7e200c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:11:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e2014f980 0x7f7e200c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1ffff700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e0c005000 0x7f7e0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.994+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e0c0038e0 0x7f7e0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 -- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e0c0038e0 msgr2=0x7f7e0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e0c0038e0 0x7f7e0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 -- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e0c005000 msgr2=0x7f7e0c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:11:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e0c005000 0x7f7e0c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 -- 172.21.15.52:0/3406599845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0033f0 con 0x7f7e0c004690 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1effd700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e0c004b10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f7e1400bac0 tx=0x7f7e14008040).ready entity=mon.0 client_cookie=e2de0bbd3434d67a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400b400 con 0x7f7e0c004690 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400d5d0 con 0x7f7e0c004690 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1e7fc700 1 -- 172.21.15.52:0/3406599845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400d950 con 0x7f7e0c004690 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e25e0d700 1 -- 172.21.15.52:0/3406599845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 msgr2=0x7f7e0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/3406599845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e0c004b10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f7e1400bac0 tx=0x7f7e14008040).stop 2023-05-10T01:11:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e1ffff700 1 -- 172.21.15.52:0/3406599845 reap_dead start 2023-05-10T01:11:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e25e0d700 1 -- 172.21.15.52:0/3406599845 shutdown_connections 2023-05-10T01:11:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e25e0d700 1 -- 172.21.15.52:0/3406599845 >> 172.21.15.52:0/3406599845 conn(0x7f7e2005e810 msgr2=0x7f7e200c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:11:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.995+0000 7f7e25e0d700 1 -- 172.21.15.52:0/3406599845 shutdown_connections 2023-05-10T01:11:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.996+0000 7f7e25e0d700 1 -- 172.21.15.52:0/3406599845 wait complete. 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.997+0000 7f7e25e0d700 1 Processor -- start 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.997+0000 7f7e25e0d700 1 -- start start 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e200c68b0 0x7f7e200c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e20164a40 0x7f7e20164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20168770 con 0x7f7e0c004690 2023-05-10T01:11:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200c7220 con 0x7f7e200c68b0 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20165700 con 0x7f7e20164a40 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60656/0 (socket says 172.21.15.52:60656) 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 -- 172.21.15.52:0/2489184180 learned_addr learned my addr 172.21.15.52:0/2489184180 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1ffff700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e20164a40 0x7f7e20164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1effd700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e200c68b0 0x7f7e200c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 -- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e20164a40 msgr2=0x7f7e20164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e20164a40 0x7f7e20164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 -- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e200c68b0 msgr2=0x7f7e200c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e200c68b0 0x7f7e200c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 -- 172.21.15.52:0/2489184180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20168120 con 0x7f7e0c004690 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e1f7fe700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7e10010960 tx=0x7f7e10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10012610 con 0x7f7e0c004690 2023-05-10T01:11:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10012770 con 0x7f7e0c004690 2023-05-10T01:11:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e20168400 con 0x7f7e0c004690 2023-05-10T01:11:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10012af0 con 0x7f7e0c004690 2023-05-10T01:11:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.998+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e201653b0 con 0x7f7e0c004690 2023-05-10T01:11:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:10:59.999+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e20168a50 con 0x7f7e0c004690 2023-05-10T01:11:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.000+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f7e10014470 con 0x7f7e0c004690 2023-05-10T01:11:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.000+0000 7f7e077fe700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 0x7f7e000612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.000+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7e10079e90 con 0x7f7e0c004690 2023-05-10T01:11:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.000+0000 7f7e1effd700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 0x7f7e000612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.001+0000 7f7e1effd700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 0x7f7e000612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7e200c7440 tx=0x7f7e14008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.004+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e1004b250 con 0x7f7e0c004690 2023-05-10T01:11:00.039 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:11:00.036+0000 7f0b8c2e9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:11:00.039 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:11:00.036+0000 7f0b8c2e9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:11:00.039 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:11:00.036+0000 7f0b8c2e9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:11:00.040 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:11:00.036+0000 7f0b8c2e9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:11:00.040 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:11:00.036+0000 7f0b8c2e9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:11:00.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.206+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e20167fa0 con 0x7f7e0005ee30 2023-05-10T01:11:00.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.210+0000 7f7e077fe700 1 -- 172.21.15.52:0/2489184180 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7e1400d8a0 con 0x7f7e0005ee30 2023-05-10T01:11:00.213 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-05-10T01:11:00.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 msgr2=0x7f7e000612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 0x7f7e000612f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7e200c7440 tx=0x7f7e14008040).stop 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 msgr2=0x7f7e200aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7e10010960 tx=0x7f7e10008040).stop 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 shutdown_connections 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7e0005ee30 0x7f7e000612f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e20164a40 0x7f7e20164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e0c004690 0x7f7e200aae40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 --2- 172.21.15.52:0/2489184180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e200c68b0 0x7f7e200c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 >> 172.21.15.52:0/2489184180 conn(0x7f7e2005e810 msgr2=0x7f7e200ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:11:00.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 shutdown_connections 2023-05-10T01:11:00.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.212+0000 7f7e25e0d700 1 -- 172.21.15.52:0/2489184180 wait complete. 2023-05-10T01:11:00.226 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-05-10T01:11:00.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-05-10T01:11:00.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.345+0000 7f621b47f700 1 Processor -- start 2023-05-10T01:11:00.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.345+0000 7f621b47f700 1 -- start start 2023-05-10T01:11:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621b47f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6214153ff0 0x7f6214068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621b47f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 0x7f62140c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621b47f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62140c9110 con 0x7f62140c60c0 2023-05-10T01:11:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621b47f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62140c8820 con 0x7f6214153ff0 2023-05-10T01:11:00.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621b47f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62140c6500 con 0x7f6214068640 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621921b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6214153ff0 0x7f6214068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f6219a1c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f62140c60c0 0x7f62140c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41450/0 (socket says 172.21.15.52:41450) 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f6219a1c700 1 -- 172.21.15.52:0/3639728435 learned_addr learned my addr 172.21.15.52:0/3639728435 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f621921b700 1 -- 172.21.15.52:0/3639728435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 msgr2=0x7f62140c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.346+0000 7f6218a1a700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 0x7f62140c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f6213fff700 1 -- 172.21.15.52:0/3639728435 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566459557 0 0) 0x7f62140c9110 con 0x7f62140c60c0 2023-05-10T01:11:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621921b700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 0x7f62140c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621921b700 1 -- 172.21.15.52:0/3639728435 >> v1:172.21.15.52:6789/0 conn(0x7f62140c60c0 legacy=0x7f62140c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621921b700 1 -- 172.21.15.52:0/3639728435 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62140c8ac0 con 0x7f6214153ff0 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f6218a1a700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 0x7f62140c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621921b700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f6214068150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f620c006fd0 tx=0x7f620c006f40).ready entity=mon.0 client_cookie=f30f04d1f1d2a628 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f6213fff700 1 -- 172.21.15.52:0/3639728435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c005880 con 0x7f6214153ff0 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f6213fff700 1 -- 172.21.15.52:0/3639728435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c0059e0 con 0x7f6214153ff0 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f6213fff700 1 -- 172.21.15.52:0/3639728435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c005d60 con 0x7f6214153ff0 2023-05-10T01:11:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 -- 172.21.15.52:0/3639728435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 msgr2=0x7f6214068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f6214068150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f620c006fd0 tx=0x7f620c006f40).stop 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 -- 172.21.15.52:0/3639728435 shutdown_connections 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f6214068150 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 --2- 172.21.15.52:0/3639728435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6214068640 0x7f62140c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 -- 172.21.15.52:0/3639728435 >> 172.21.15.52:0/3639728435 conn(0x7f62140678d0 msgr2=0x7f62140cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 -- 172.21.15.52:0/3639728435 shutdown_connections 2023-05-10T01:11:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.347+0000 7f621b47f700 1 -- 172.21.15.52:0/3639728435 wait complete. 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.348+0000 7f621b47f700 1 Processor -- start 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 -- start start 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6214068640 0x7f62140c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 0x7f62140a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62140aa520 con 0x7f6214153ff0 2023-05-10T01:11:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62140c3160 con 0x7f6214068640 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.349+0000 7f621b47f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62140c2870 con 0x7f62140c60c0 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60674/0 (socket says 172.21.15.52:60674) 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 -- 172.21.15.52:0/1162565618 learned_addr learned my addr 172.21.15.52:0/1162565618 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6218a1a700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 0x7f62140a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f621921b700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6214068640 0x7f62140c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 -- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 msgr2=0x7f62140a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 0x7f62140a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 -- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6214068640 msgr2=0x7f62140c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6214068640 0x7f62140c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 -- 172.21.15.52:0/1162565618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009250 con 0x7f6214153ff0 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6218a1a700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 0x7f62140a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f6219a1c700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f620400c7e0 tx=0x7f6204007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204005d30 con 0x7f6214153ff0 2023-05-10T01:11:00.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204005e90 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62140c2b10 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204007320 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.350+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62140aa1e0 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.351+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62140c3310 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.352+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f6204010030 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.352+0000 7f62117fa700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 0x7f61f40612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.352+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6204079cd0 con 0x7f6214153ff0 2023-05-10T01:11:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.352+0000 7f621921b700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 0x7f61f40612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:11:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.353+0000 7f621921b700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 0x7f61f40612f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f620c009fd0 tx=0x7f620c016000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:11:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.356+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62140c3310 con 0x7f6214153ff0 2023-05-10T01:11:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.375+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 9) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f6204077a50 con 0x7f6214153ff0 2023-05-10T01:11:00.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.560+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f62140c32d0 con 0x7f61f405ee30 2023-05-10T01:11:00.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.565+0000 7f62117fa700 1 -- 172.21.15.52:0/1162565618 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f62140c32d0 con 0x7f61f405ee30 2023-05-10T01:11:00.569 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-05-10T01:11:00.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 msgr2=0x7f61f40612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 0x7f61f40612f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f620c009fd0 tx=0x7f620c016000).stop 2023-05-10T01:11:00.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 msgr2=0x7f62141510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:11:00.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f620400c7e0 tx=0x7f6204007f90).stop 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 shutdown_connections 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f61f405ee30 0x7f61f40612f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6214153ff0 0x7f62141510e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6214068640 0x7f62140c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 --2- 172.21.15.52:0/1162565618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140c60c0 0x7f62140a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 >> 172.21.15.52:0/1162565618 conn(0x7f62140678d0 msgr2=0x7f62140c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:11:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 shutdown_connections 2023-05-10T01:11:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:11:00.567+0000 7f621b47f700 1 -- 172.21.15.52:0/1162565618 wait complete. 2023-05-10T01:11:00.581 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-05-10T01:11:26.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:11:26.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:11:56.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:11:56.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:12:26.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:12:26.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:12:57.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:12:57.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:13:27.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:13:27.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:13:57.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:13:57.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:14:27.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:14:27.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:14:57.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:14:57.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:15:27.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:15:27.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:15:57.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:15:57.525 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:16:27.625 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:16:27.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:16:57.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:16:57.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:17:27.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:17:27.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:17:57.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:17:57.805 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:18:27.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:18:27.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:18:57.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:18:57.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:19:28.053 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:19:28.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:19:58.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:19:58.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:20:28.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:20:28.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:20:58.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:20:58.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:21:18.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-05-10T01:21:18.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.715+0000 7fa903ce6700 1 Processor -- start 2023-05-10T01:21:18.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.715+0000 7fa903ce6700 1 -- start start 2023-05-10T01:21:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa903ce6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc14e6e0 0x7fa8fc155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa903ce6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8fc0c4d30 0x7fa8fc0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa903ce6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc14eac0 con 0x7fa8fc062790 2023-05-10T01:21:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa903ce6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc154ca0 con 0x7fa8fc0c4d30 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa903ce6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc062c20 con 0x7fa8fc14e6e0 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa902283700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa8fc062790 0x7fa8fc0635f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41462/0 (socket says 172.21.15.52:41462) 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.716+0000 7fa902283700 1 -- 172.21.15.52:0/242836037 learned_addr learned my addr 172.21.15.52:0/242836037 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200997153 0 0) 0x7fa8fc14eac0 con 0x7fa8fc062790 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e80033f0 con 0x7fa8fc062790 2023-05-10T01:21:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa901281700 1 --2- 172.21.15.52:0/242836037 >> v2:172.21.15.172:3300/0 conn(0x7fa8fc0c4d30 0x7fa8fc0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa901a82700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc14e6e0 0x7fa8fc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121094358 0 0) 0x7fa8e80033f0 con 0x7fa8fc062790 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc14e6e0 msgr2=0x7fa8fc155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc14e6e0 0x7fa8fc155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 >> v2:172.21.15.172:3300/0 conn(0x7fa8fc0c4d30 msgr2=0x7fa8fc0622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 --2- 172.21.15.52:0/242836037 >> v2:172.21.15.172:3300/0 conn(0x7fa8fc0c4d30 0x7fa8fc0622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0c6010 con 0x7fa8fc062790 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fa8ec0017f0 con 0x7fa8fc062790 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 >> v1:172.21.15.52:6789/0 conn(0x7fa8fc062790 legacy=0x7fa8fc0635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8e80038e0 0x7fa8e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8004690 0x7fa8e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8e8005000 0x7fa8e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc154ca0 con 0x7fa8e8005000 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc062c20 con 0x7fa8e8004690 2023-05-10T01:21:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e800bdd0 con 0x7fa8e80038e0 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa901a82700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc14e6e0 0x7fa8fc155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa902283700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8e8005000 0x7fa8e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa901281700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8004690 0x7fa8e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa901a82700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8e80038e0 0x7fa8e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa902283700 1 -- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8e80038e0 msgr2=0x7fa8e8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa902283700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8e80038e0 0x7fa8e8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa902283700 1 -- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8004690 msgr2=0x7fa8e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.717+0000 7fa902283700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8004690 0x7fa8e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa902283700 1 -- 172.21.15.52:0/242836037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80033f0 con 0x7fa8e8005000 2023-05-10T01:21:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa902283700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8e8005000 0x7fa8e800b8e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa8ec00c530 tx=0x7fa8ec002210).ready entity=mon.0 client_cookie=662f4dfa3e952953 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec007de0 con 0x7fa8e8005000 2023-05-10T01:21:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec00ce60 con 0x7fa8e8005000 2023-05-10T01:21:18.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa900a80700 1 -- 172.21.15.52:0/242836037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec005d30 con 0x7fa8e8005000 2023-05-10T01:21:18.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 -- 172.21.15.52:0/242836037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8e8005000 msgr2=0x7fa8e800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 --2- 172.21.15.52:0/242836037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8e8005000 0x7fa8e800b8e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa8ec00c530 tx=0x7fa8ec002210).stop 2023-05-10T01:21:18.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa902283700 1 -- 172.21.15.52:0/242836037 reap_dead start 2023-05-10T01:21:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 -- 172.21.15.52:0/242836037 shutdown_connections 2023-05-10T01:21:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 -- 172.21.15.52:0/242836037 >> 172.21.15.52:0/242836037 conn(0x7fa8fc05e810 msgr2=0x7fa8fc0c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 -- 172.21.15.52:0/242836037 shutdown_connections 2023-05-10T01:21:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.718+0000 7fa903ce6700 1 -- 172.21.15.52:0/242836037 wait complete. 2023-05-10T01:21:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 Processor -- start 2023-05-10T01:21:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 -- start start 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8005000 0x7fa8fc1695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc0a9e30 0x7fa8fc14c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc169ab0 con 0x7fa8fc14c980 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0ab300 con 0x7fa8e8005000 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.720+0000 7fa903ce6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc14cde0 con 0x7fa8fc0a9e30 2023-05-10T01:21:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60692/0 (socket says 172.21.15.52:60692) 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 -- 172.21.15.52:0/253119577 learned_addr learned my addr 172.21.15.52:0/253119577 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa901a82700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8005000 0x7fa8fc1695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa901281700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc0a9e30 0x7fa8fc14c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 -- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc0a9e30 msgr2=0x7fa8fc14c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc0a9e30 0x7fa8fc14c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 -- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8005000 msgr2=0x7fa8fc1695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8005000 0x7fa8fc1695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 -- 172.21.15.52:0/253119577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0aa6f0 con 0x7fa8fc14c980 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa902283700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa8ec00a000 tx=0x7fa8ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec007de0 con 0x7fa8fc14c980 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0017b0 con 0x7fa8fc14c980 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc0aa9d0 con 0x7fa8fc14c980 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0136a0 con 0x7fa8fc14c980 2023-05-10T01:21:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.721+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc0aaf90 con 0x7fa8fc14c980 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.722+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc06c340 con 0x7fa8fc14c980 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.723+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fa8ec01d070 con 0x7fa8fc14c980 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.723+0000 7fa8f9ffb700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 0x7fa8dc061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.723+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa8ec07ab80 con 0x7fa8fc14c980 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.723+0000 7fa901a82700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 0x7fa8dc061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.724+0000 7fa901a82700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 0x7fa8dc061300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa8fc0aeaf0 tx=0x7fa8f4008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:18.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.728+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8ec04c030 con 0x7fa8fc14c980 2023-05-10T01:21:18.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.931+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8fc0ab440 con 0x7fa8dc05ee40 2023-05-10T01:21:18.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.936+0000 7fa8f9ffb700 1 -- 172.21.15.52:0/253119577 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa8fc0ab440 con 0x7fa8dc05ee40 2023-05-10T01:21:18.940 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-05-10T01:21:18.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 msgr2=0x7fa8dc061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 0x7fa8dc061300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa8fc0aeaf0 tx=0x7fa8f4008040).stop 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 msgr2=0x7fa8fc0ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa8ec00a000 tx=0x7fa8ec015000).stop 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 shutdown_connections 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8dc05ee40 0x7fa8dc061300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc14c980 0x7fa8fc0ade00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e8005000 0x7fa8fc1695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 --2- 172.21.15.52:0/253119577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8fc0a9e30 0x7fa8fc14c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:18.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 >> 172.21.15.52:0/253119577 conn(0x7fa8fc05e810 msgr2=0x7fa8fc067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:18.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 shutdown_connections 2023-05-10T01:21:18.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:18.938+0000 7fa903ce6700 1 -- 172.21.15.52:0/253119577 wait complete. 2023-05-10T01:21:18.953 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-05-10T01:21:18.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-05-10T01:21:19.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.070+0000 7fb2d0818700 1 Processor -- start 2023-05-10T01:21:19.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.070+0000 7fb2d0818700 1 -- start start 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2d0818700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0aa200 0x7fb2cc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2d0818700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc0ca5f0 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2d0818700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc154610 con 0x7fb2cc153a90 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2d0818700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0c8820 con 0x7fb2cc0aa200 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2ca59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2cc0c5d20 0x7fb2cc069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41480/0 (socket says 172.21.15.52:41480) 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.071+0000 7fb2ca59c700 1 -- 172.21.15.52:0/462644124 learned_addr learned my addr 172.21.15.52:0/462644124 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:19.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c9d9b700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0aa200 0x7fb2cc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835280684 0 0) 0x7fb2cc0ca5f0 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b00033f0 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492249223 0 0) 0x7fb2cc154610 con 0x7fb2cc153a90 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2cc0ca5f0 con 0x7fb2cc153a90 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2619915110 0 0) 0x7fb2b00033f0 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0aa200 msgr2=0x7fb2cc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0aa200 0x7fb2cc0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 >> v1:172.21.15.172:6789/0 conn(0x7fb2cc153a90 legacy=0x7fb2cc153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0c8b00 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fb2c40017f0 con 0x7fb2cc0c5d20 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 >> v1:172.21.15.52:6789/0 conn(0x7fb2cc0c5d20 legacy=0x7fb2cc069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b0003aa0 0x7fb2b0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0004690 0x7fb2b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2b0005000 0x7fb2b000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0c8820 con 0x7fb2b0003aa0 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b000bdd0 con 0x7fb2b0004690 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b000bf90 con 0x7fb2b0005000 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c9d9b700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0aa200 0x7fb2cc0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b0003aa0 0x7fb2b0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2cad9d700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2b0005000 0x7fb2b000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2c9d9b700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0004690 0x7fb2b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 -- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2b0005000 msgr2=0x7fb2b000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2b0005000 0x7fb2b000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 -- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0004690 msgr2=0x7fb2b0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0004690 0x7fb2b0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.072+0000 7fb2ca59c700 1 -- 172.21.15.52:0/462644124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00033f0 con 0x7fb2b0003aa0 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b0003aa0 0x7fb2b0003ea0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fb2c400c5c0 tx=0x7fb2c4007f40).ready entity=mon.0 client_cookie=14dfccd88e845725 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400cdc0 con 0x7fb2b0003aa0 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4005b20 con 0x7fb2b0003aa0 2023-05-10T01:21:19.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2c959a700 1 -- 172.21.15.52:0/462644124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40070d0 con 0x7fb2b0003aa0 2023-05-10T01:21:19.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 -- 172.21.15.52:0/462644124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b0003aa0 msgr2=0x7fb2b0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 --2- 172.21.15.52:0/462644124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2b0003aa0 0x7fb2b0003ea0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fb2c400c5c0 tx=0x7fb2c4007f40).stop 2023-05-10T01:21:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2cad9d700 1 -- 172.21.15.52:0/462644124 reap_dead start 2023-05-10T01:21:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 -- 172.21.15.52:0/462644124 shutdown_connections 2023-05-10T01:21:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 -- 172.21.15.52:0/462644124 >> 172.21.15.52:0/462644124 conn(0x7fb2cc0cb6f0 msgr2=0x7fb2cc0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 -- 172.21.15.52:0/462644124 shutdown_connections 2023-05-10T01:21:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.073+0000 7fb2d0818700 1 -- 172.21.15.52:0/462644124 wait complete. 2023-05-10T01:21:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.074+0000 7fb2d0818700 1 Processor -- start 2023-05-10T01:21:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.074+0000 7fb2d0818700 1 -- start start 2023-05-10T01:21:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 0x7fb2cc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc159c60 0x7fb2cc0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0aca70 con 0x7fb2cc0ab550 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0ab9d0 con 0x7fb2b0003aa0 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2d0818700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0abcb0 con 0x7fb2cc159c60 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2cad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2cad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60712/0 (socket says 172.21.15.52:60712) 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2cad9d700 1 -- 172.21.15.52:0/4006019637 learned_addr learned my addr 172.21.15.52:0/4006019637 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 0x7fb2cc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.075+0000 7fb2c9d9b700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc159c60 0x7fb2cc0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 -- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc159c60 msgr2=0x7fb2cc0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc159c60 0x7fb2cc0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 -- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 msgr2=0x7fb2cc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 0x7fb2cc0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 -- 172.21.15.52:0/4006019637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0abf90 con 0x7fb2cc0ab550 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 0x7fb2cc0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2cad9d700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fb2cc0c7300 tx=0x7fb2bc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc014430 con 0x7fb2cc0ab550 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc014590 con 0x7fb2cc0ab550 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc0ac270 con 0x7fb2cc0ab550 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc014910 con 0x7fb2cc0ab550 2023-05-10T01:21:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.076+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc0b05f0 con 0x7fb2cc0ab550 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.077+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0ac790 con 0x7fb2cc0ab550 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.077+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb2bc014d40 con 0x7fb2cc0ab550 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.078+0000 7fb2ba7fc700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 0x7fb2a8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.078+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb2bc079850 con 0x7fb2cc0ab550 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.078+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 0x7fb2a8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.078+0000 7fb2ca59c700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 0x7fb2a8061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb2c4002250 tx=0x7fb2c4015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.082+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2bc0498f0 con 0x7fb2cc0ab550 2023-05-10T01:21:19.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.279+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2cc06c340 con 0x7fb2a805ee70 2023-05-10T01:21:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.284+0000 7fb2ba7fc700 1 -- 172.21.15.52:0/4006019637 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb2cc06c340 con 0x7fb2a805ee70 2023-05-10T01:21:19.288 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-05-10T01:21:19.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 msgr2=0x7fb2a8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 0x7fb2a8061330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb2c4002250 tx=0x7fb2c4015000).stop 2023-05-10T01:21:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 msgr2=0x7fb2cc156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fb2cc0c7300 tx=0x7fb2bc009040).stop 2023-05-10T01:21:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 shutdown_connections 2023-05-10T01:21:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb2a805ee70 0x7fb2a8061330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0ab550 0x7fb2cc156be0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2b0003aa0 0x7fb2cc0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 --2- 172.21.15.52:0/4006019637 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc159c60 0x7fb2cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 >> 172.21.15.52:0/4006019637 conn(0x7fb2cc0cb6f0 msgr2=0x7fb2cc0c13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 shutdown_connections 2023-05-10T01:21:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.286+0000 7fb2d0818700 1 -- 172.21.15.52:0/4006019637 wait complete. 2023-05-10T01:21:19.301 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-05-10T01:21:19.302 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-05-10T01:21:19.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.419+0000 7fa1d85e0700 1 Processor -- start 2023-05-10T01:21:19.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.419+0000 7fa1d85e0700 1 -- start start 2023-05-10T01:21:19.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d85e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1d00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d85e0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00c94c0 con 0x7fa1d0154080 2023-05-10T01:21:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d85e0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00cb7d0 con 0x7fa1d0068150 2023-05-10T01:21:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d85e0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c88b0 con 0x7fa1d0154460 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d637c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa1d0154080 0x7fa1d00a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41500/0 (socket says 172.21.15.52:41500) 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d637c700 1 -- 172.21.15.52:0/2177214942 learned_addr learned my addr 172.21.15.52:0/2177214942 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818791460 0 0) 0x7fa1d00c94c0 con 0x7fa1d0154080 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1d00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.420+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b80033f0 con 0x7fa1d0154080 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481905704 0 0) 0x7fa1b80033f0 con 0x7fa1d0154080 2023-05-10T01:21:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 msgr2=0x7fa1d00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1d00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 >> v1:172.21.15.172:6789/0 conn(0x7fa1d0068150 legacy=0x7fa1d00c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00c8b90 con 0x7fa1d0154080 2023-05-10T01:21:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fa1c80017f0 con 0x7fa1d0154080 2023-05-10T01:21:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 >> v1:172.21.15.52:6789/0 conn(0x7fa1d0154080 legacy=0x7fa1d00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b8003910 0x7fa1b8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c88b0 con 0x7fa1b8004690 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b800b8e0 con 0x7fa1b8003910 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b800ba50 con 0x7fa1d0154460 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d637c700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b8003910 0x7fa1b8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d6b7d700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 -- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 msgr2=0x7fa1b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 -- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b8003910 msgr2=0x7fa1b8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b8003910 0x7fa1b8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 -- 172.21.15.52:0/2177214942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80033f0 con 0x7fa1b8004690 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d6b7d700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d0154460 0x7fa1b8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1b8004b10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fa1c0009a80 tx=0x7fa1c0009060).ready entity=mon.0 client_cookie=dc1103ac51cfc796 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0009430 con 0x7fa1b8004690 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c000e5e0 con 0x7fa1b8004690 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.421+0000 7fa1d537a700 1 -- 172.21.15.52:0/2177214942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000e960 con 0x7fa1b8004690 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 -- 172.21.15.52:0/2177214942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 msgr2=0x7fa1b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/2177214942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1b8004b10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fa1c0009a80 tx=0x7fa1c0009060).stop 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d6b7d700 1 -- 172.21.15.52:0/2177214942 reap_dead start 2023-05-10T01:21:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 -- 172.21.15.52:0/2177214942 shutdown_connections 2023-05-10T01:21:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 -- 172.21.15.52:0/2177214942 >> 172.21.15.52:0/2177214942 conn(0x7fa1d0067910 msgr2=0x7fa1d00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 -- 172.21.15.52:0/2177214942 shutdown_connections 2023-05-10T01:21:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.422+0000 7fa1d85e0700 1 -- 172.21.15.52:0/2177214942 wait complete. 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.423+0000 7fa1d85e0700 1 Processor -- start 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.423+0000 7fa1d85e0700 1 -- start start 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d00c1cc0 0x7fa1d00c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d00acc30 0x7fa1d00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c2630 con 0x7fa1b8004690 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01568c0 con 0x7fa1d00c1cc0 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d85e0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d0150ea0 con 0x7fa1d00acc30 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60728/0 (socket says 172.21.15.52:60728) 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 -- 172.21.15.52:0/915025690 learned_addr learned my addr 172.21.15.52:0/915025690 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d00c1cc0 0x7fa1d00c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d6b7d700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d00acc30 0x7fa1d00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 -- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d00acc30 msgr2=0x7fa1d00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d00acc30 0x7fa1d00ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 -- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d00c1cc0 msgr2=0x7fa1d00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d00c1cc0 0x7fa1d00c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 -- 172.21.15.52:0/915025690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00ad5a0 con 0x7fa1b8004690 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.424+0000 7fa1d637c700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fa1c8007740 tx=0x7fa1c8001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800fa30 con 0x7fa1b8004690 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800fb90 con 0x7fa1b8004690 2023-05-10T01:21:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d00c2830 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8012350 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d00c2df0 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.425+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d0066720 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.426+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fa1c801b030 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.426+0000 7fa1be7fc700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 0x7fa1b0061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.426+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa1c8079a60 con 0x7fa1b8004690 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.426+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 0x7fa1b0061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.427+0000 7fa1d5b7b700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 0x7fa1b0061360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa1c0006d50 tx=0x7fa1c001a000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.430+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa1c804ada0 con 0x7fa1b8004690 2023-05-10T01:21:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.629+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1d006c340 con 0x7fa1b005eea0 2023-05-10T01:21:19.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.634+0000 7fa1be7fc700 1 -- 172.21.15.52:0/915025690 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa1d006c340 con 0x7fa1b005eea0 2023-05-10T01:21:19.638 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 msgr2=0x7fa1b0061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 0x7fa1b0061360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa1c0006d50 tx=0x7fa1c001a000).stop 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 msgr2=0x7fa1d014eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fa1c8007740 tx=0x7fa1c8001d90).stop 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 shutdown_connections 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa1b005eea0 0x7fa1b0061360 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1d00acc30 0x7fa1d00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1b8004690 0x7fa1d014eaf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 --2- 172.21.15.52:0/915025690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d00c1cc0 0x7fa1d00c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 >> 172.21.15.52:0/915025690 conn(0x7fa1d0067910 msgr2=0x7fa1d00c10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 shutdown_connections 2023-05-10T01:21:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.636+0000 7fa1d85e0700 1 -- 172.21.15.52:0/915025690 wait complete. 2023-05-10T01:21:19.651 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-05-10T01:21:19.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-05-10T01:21:19.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.768+0000 7f5d91fa1700 1 Processor -- start 2023-05-10T01:21:19.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.769+0000 7f5d91fa1700 1 -- start start 2023-05-10T01:21:19.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.769+0000 7f5d91fa1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d8c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.769+0000 7f5d91fa1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c06a130 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.769+0000 7f5d91fa1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c06a410 con 0x7f5d8c155370 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.769+0000 7f5d91fa1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c069f50 con 0x7f5d8c153f80 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d8c0c5cf0 0x7f5d8c0c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41520/0 (socket says 172.21.15.52:41520) 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8bfff700 1 -- 172.21.15.52:0/313901106 learned_addr learned my addr 172.21.15.52:0/313901106 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d8c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230993951 0 0) 0x7f5d8c06a130 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d6c0033f0 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009254479 0 0) 0x7f5d6c0033f0 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 msgr2=0x7f5d8c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d8c0a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 >> v1:172.21.15.172:6789/0 conn(0x7f5d8c155370 legacy=0x7f5d8c0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c06a6f0 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5d7c0017f0 con 0x7f5d8c0c5cf0 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 >> v1:172.21.15.52:6789/0 conn(0x7f5d8c0c5cf0 legacy=0x7f5d8c0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d6c003910 0x7f5d6c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c004b80 0x7f5d6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c069f50 con 0x7f5d6c003910 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c00b8e0 con 0x7f5d6c004b80 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c00ba50 con 0x7f5d8c153f80 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d6c003910 0x7f5d6c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d8bfff700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.770+0000 7f5d917a0700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c004b80 0x7f5d6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 -- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 msgr2=0x7f5d6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c153f80 0x7f5d6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 -- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c004b80 msgr2=0x7f5d6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c004b80 0x7f5d6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 -- 172.21.15.52:0/313901106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0033f0 con 0x7f5d6c003910 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d917a0700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c004b80 0x7f5d6c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d6c003910 0x7f5d6c003cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f5d84009a80 tx=0x7f5d84009060).ready entity=mon.0 client_cookie=86c2882effedc05c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84009430 con 0x7f5d6c003910 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400e5e0 con 0x7f5d6c003910 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d8b7fe700 1 -- 172.21.15.52:0/313901106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400e960 con 0x7f5d6c003910 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 -- 172.21.15.52:0/313901106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d6c003910 msgr2=0x7f5d6c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/313901106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d6c003910 0x7f5d6c003cf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f5d84009a80 tx=0x7f5d84009060).stop 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d917a0700 1 -- 172.21.15.52:0/313901106 reap_dead start 2023-05-10T01:21:19.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 -- 172.21.15.52:0/313901106 shutdown_connections 2023-05-10T01:21:19.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 -- 172.21.15.52:0/313901106 >> 172.21.15.52:0/313901106 conn(0x7f5d8c0cb5f0 msgr2=0x7f5d8c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 -- 172.21.15.52:0/313901106 shutdown_connections 2023-05-10T01:21:19.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.771+0000 7f5d91fa1700 1 -- 172.21.15.52:0/313901106 wait complete. 2023-05-10T01:21:19.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.772+0000 7f5d91fa1700 1 Processor -- start 2023-05-10T01:21:19.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 -- start start 2023-05-10T01:21:19.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c003910 0x7f5d8c1681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c0adf60 0x7f5d8c0ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0b08f0 con 0x7f5d8c14fb70 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1686c0 con 0x7f5d6c003910 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d91fa1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ae8b0 con 0x7f5d8c0adf60 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.773+0000 7f5d8bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60748/0 (socket says 172.21.15.52:60748) 2023-05-10T01:21:19.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 -- 172.21.15.52:0/3919794674 learned_addr learned my addr 172.21.15.52:0/3919794674 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d917a0700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c0adf60 0x7f5d8c0ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c003910 0x7f5d8c1681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 -- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c0adf60 msgr2=0x7f5d8c0ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c0adf60 0x7f5d8c0ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 -- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c003910 msgr2=0x7f5d8c1681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c003910 0x7f5d8c1681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 -- 172.21.15.52:0/3919794674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0afce0 con 0x7f5d8c14fb70 2023-05-10T01:21:19.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d8bfff700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5d7c007710 tx=0x7f5d7c001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00f9a0 con 0x7f5d8c14fb70 2023-05-10T01:21:19.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00fb00 con 0x7f5d8c14fb70 2023-05-10T01:21:19.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c0affc0 con 0x7f5d8c14fb70 2023-05-10T01:21:19.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00fe80 con 0x7f5d8c14fb70 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.774+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c0b0580 con 0x7f5d8c14fb70 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.775+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c083110 con 0x7f5d8c14fb70 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.776+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5d7c01b030 con 0x7f5d8c14fb70 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.776+0000 7f5d88ff9700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 0x7f5d70061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.776+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5d7c079840 con 0x7f5d8c14fb70 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.776+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 0x7f5d70061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:19.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.776+0000 7f5d90f9f700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 0x7f5d70061360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5d84009a80 tx=0x7f5d8401a000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:19.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.780+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d7c04ada0 con 0x7f5d8c14fb70 2023-05-10T01:21:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.979+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d8c047150 con 0x7f5d7005eea0 2023-05-10T01:21:19.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.983+0000 7f5d88ff9700 1 -- 172.21.15.52:0/3919794674 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5d8c047150 con 0x7f5d7005eea0 2023-05-10T01:21:19.987 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-05-10T01:21:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 msgr2=0x7f5d70061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 0x7f5d70061360 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5d84009a80 tx=0x7f5d8401a000).stop 2023-05-10T01:21:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 msgr2=0x7f5d8c14fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5d7c007710 tx=0x7f5d7c001d90).stop 2023-05-10T01:21:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 shutdown_connections 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d7005eea0 0x7f5d70061360 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d8c0adf60 0x7f5d8c0ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d6c003910 0x7f5d8c1681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 --2- 172.21.15.52:0/3919794674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d8c14fb70 0x7f5d8c14fff0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 >> 172.21.15.52:0/3919794674 conn(0x7f5d8c0cb5f0 msgr2=0x7f5d8c0c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 shutdown_connections 2023-05-10T01:21:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:19.985+0000 7f5d91fa1700 1 -- 172.21.15.52:0/3919794674 wait complete. 2023-05-10T01:21:20.000 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-05-10T01:21:20.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-05-10T01:21:20.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.119+0000 7fcc2e0f5700 1 Processor -- start 2023-05-10T01:21:20.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.119+0000 7fcc2e0f5700 1 -- start start 2023-05-10T01:21:20.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc2e0f5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc280c5d20 0x7fcc280aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc2e0f5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280c6100 0x7fcc28069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc2e0f5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc28154610 con 0x7fcc28153a90 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc2e0f5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280ca5f0 con 0x7fcc280c6100 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc2e0f5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280c8820 con 0x7fcc280c5d20 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc26ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280c6100 0x7fcc28069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc26ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280c6100 0x7fcc28069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60756/0 (socket says 172.21.15.52:60756) 2023-05-10T01:21:20.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc26ffd700 1 -- 172.21.15.52:0/3184734759 learned_addr learned my addr 172.21.15.52:0/3184734759 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc277fe700 1 --2- 172.21.15.52:0/3184734759 >> v2:172.21.15.172:3300/0 conn(0x7fcc280c5d20 0x7fcc280aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc26ffd700 1 -- 172.21.15.52:0/3184734759 >> v2:172.21.15.172:3300/0 conn(0x7fcc280c5d20 msgr2=0x7fcc280aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:20.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.120+0000 7fcc26ffd700 1 --2- 172.21.15.52:0/3184734759 >> v2:172.21.15.172:3300/0 conn(0x7fcc280c5d20 0x7fcc280aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc26ffd700 1 -- 172.21.15.52:0/3184734759 >> v1:172.21.15.172:6789/0 conn(0x7fcc28153a90 legacy=0x7fcc28153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:20.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc26ffd700 1 -- 172.21.15.52:0/3184734759 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280c8b00 con 0x7fcc280c6100 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc26ffd700 1 --2- 172.21.15.52:0/3184734759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc28069fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fcc2806c000 tx=0x7fcc1c0090f0).ready entity=mon.0 client_cookie=adb0801906949194 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc267fc700 1 -- 172.21.15.52:0/3184734759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00b5a0 con 0x7fcc280c6100 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc267fc700 1 -- 172.21.15.52:0/3184734759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00b700 con 0x7fcc280c6100 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc267fc700 1 -- 172.21.15.52:0/3184734759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00ba80 con 0x7fcc280c6100 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/3184734759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 msgr2=0x7fcc28069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/3184734759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc28069fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fcc2806c000 tx=0x7fcc1c0090f0).stop 2023-05-10T01:21:20.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/3184734759 shutdown_connections 2023-05-10T01:21:20.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/3184734759 >> v2:172.21.15.172:3300/0 conn(0x7fcc280c5d20 0x7fcc280aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/3184734759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc28069fe0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/3184734759 >> 172.21.15.52:0/3184734759 conn(0x7fcc280cb6f0 msgr2=0x7fcc280c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:20.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/3184734759 shutdown_connections 2023-05-10T01:21:20.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.121+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/3184734759 wait complete. 2023-05-10T01:21:20.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 Processor -- start 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 -- start start 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 0x7fcc2814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 0x7fcc280c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814e8a0 con 0x7fcc280c6100 2023-05-10T01:21:20.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280ab410 con 0x7fcc28153a90 2023-05-10T01:21:20.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc2e0f5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280ac900 con 0x7fcc280c5d20 2023-05-10T01:21:20.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60762/0 (socket says 172.21.15.52:60762) 2023-05-10T01:21:20.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.123+0000 7fcc26ffd700 1 -- 172.21.15.52:0/2938311587 learned_addr learned my addr 172.21.15.52:0/2938311587 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc27fff700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 0x7fcc280c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc277fe700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 0x7fcc2814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 -- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 msgr2=0x7fcc2814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 0x7fcc2814e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 -- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 msgr2=0x7fcc280c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 0x7fcc280c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 -- 172.21.15.52:0/2938311587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009370 con 0x7fcc280c6100 2023-05-10T01:21:20.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc27fff700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 0x7fcc280c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:20.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc277fe700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 0x7fcc2814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:20.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc26ffd700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fcc1c009130 tx=0x7fcc1c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00ba80 con 0x7fcc280c6100 2023-05-10T01:21:20.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c000d10 con 0x7fcc280c6100 2023-05-10T01:21:20.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc280aadc0 con 0x7fcc280c6100 2023-05-10T01:21:20.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c01c670 con 0x7fcc280c6100 2023-05-10T01:21:20.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.124+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc280b07b0 con 0x7fcc280c6100 2023-05-10T01:21:20.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.125+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc280aac20 con 0x7fcc280c6100 2023-05-10T01:21:20.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.125+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fcc1c02c070 con 0x7fcc280c6100 2023-05-10T01:21:20.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.126+0000 7fcc0f7fe700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 0x7fcc08061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.126+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fcc1c07bbe0 con 0x7fcc280c6100 2023-05-10T01:21:20.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.126+0000 7fcc277fe700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 0x7fcc08061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.126+0000 7fcc277fe700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 0x7fcc08061300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcc18008900 tx=0x7fcc18008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.130+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc280aac20 con 0x7fcc280c6100 2023-05-10T01:21:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.328+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc280aac20 con 0x7fcc0805ee40 2023-05-10T01:21:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.333+0000 7fcc0f7fe700 1 -- 172.21.15.52:0/2938311587 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fcc280aac20 con 0x7fcc0805ee40 2023-05-10T01:21:20.337 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-05-10T01:21:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 msgr2=0x7fcc08061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 0x7fcc08061300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcc18008900 tx=0x7fcc18008040).stop 2023-05-10T01:21:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 msgr2=0x7fcc280b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fcc1c009130 tx=0x7fcc1c015000).stop 2023-05-10T01:21:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 shutdown_connections 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc0805ee40 0x7fcc08061300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc28153a90 0x7fcc280c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc280c5d20 0x7fcc2814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 --2- 172.21.15.52:0/2938311587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280c6100 0x7fcc280b02c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 >> 172.21.15.52:0/2938311587 conn(0x7fcc280cb6f0 msgr2=0x7fcc2814f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 shutdown_connections 2023-05-10T01:21:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.335+0000 7fcc2e0f5700 1 -- 172.21.15.52:0/2938311587 wait complete. 2023-05-10T01:21:20.350 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-05-10T01:21:20.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-05-10T01:21:20.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.468+0000 7f42df366700 1 Processor -- start 2023-05-10T01:21:20.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.468+0000 7f42df366700 1 -- start start 2023-05-10T01:21:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42df366700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d8154460 0x7f42d80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42df366700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f42d8068150 0x7f42d80685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42df366700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80c94c0 con 0x7f42d8154080 2023-05-10T01:21:20.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42df366700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80cb7d0 con 0x7f42d8154460 2023-05-10T01:21:20.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42df366700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d8068a90 con 0x7f42d8068150 2023-05-10T01:21:20.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42dc901700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d8154460 0x7f42d80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.469+0000 7f42dc901700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42d8154460 0x7f42d80aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60770/0 (socket says 172.21.15.52:60770) 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 -- 172.21.15.52:0/2689858574 learned_addr learned my addr 172.21.15.52:0/2689858574 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dd903700 1 --2- 172.21.15.52:0/2689858574 >> v2:172.21.15.172:3300/0 conn(0x7f42d8068150 0x7f42d80685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 -- 172.21.15.52:0/2689858574 >> v2:172.21.15.172:3300/0 conn(0x7f42d8068150 msgr2=0x7f42d80685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 --2- 172.21.15.52:0/2689858574 >> v2:172.21.15.172:3300/0 conn(0x7f42d8068150 0x7f42d80685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 -- 172.21.15.52:0/2689858574 >> v1:172.21.15.172:6789/0 conn(0x7f42d8154080 legacy=0x7f42d80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 -- 172.21.15.52:0/2689858574 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80c88b0 con 0x7f42d8154460 2023-05-10T01:21:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42dc901700 1 --2- 172.21.15.52:0/2689858574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154460 0x7f42d80aac90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f42d805f9d0 tx=0x7f42cc0090f0).ready entity=mon.0 client_cookie=9230acbf2a7a0db5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42d7fff700 1 -- 172.21.15.52:0/2689858574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00b520 con 0x7f42d8154460 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42d7fff700 1 -- 172.21.15.52:0/2689858574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00b680 con 0x7f42d8154460 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.470+0000 7f42d7fff700 1 -- 172.21.15.52:0/2689858574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00ba00 con 0x7f42d8154460 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 -- 172.21.15.52:0/2689858574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154460 msgr2=0x7f42d80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 --2- 172.21.15.52:0/2689858574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154460 0x7f42d80aac90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f42d805f9d0 tx=0x7f42cc0090f0).stop 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 -- 172.21.15.52:0/2689858574 shutdown_connections 2023-05-10T01:21:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 --2- 172.21.15.52:0/2689858574 >> v2:172.21.15.172:3300/0 conn(0x7f42d8068150 0x7f42d80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 --2- 172.21.15.52:0/2689858574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154460 0x7f42d80aac90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 -- 172.21.15.52:0/2689858574 >> 172.21.15.52:0/2689858574 conn(0x7f42d8067910 msgr2=0x7f42d80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 -- 172.21.15.52:0/2689858574 shutdown_connections 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.471+0000 7f42df366700 1 -- 172.21.15.52:0/2689858574 wait complete. 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.472+0000 7f42df366700 1 Processor -- start 2023-05-10T01:21:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.472+0000 7f42df366700 1 -- start start 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d8068150 0x7f42d8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 0x7f42d8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8157b30 con 0x7f42d8154080 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80b07c0 con 0x7f42d8154460 2023-05-10T01:21:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42df366700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8151a00 con 0x7f42d8068150 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60776/0 (socket says 172.21.15.52:60776) 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 -- 172.21.15.52:0/4102315269 learned_addr learned my addr 172.21.15.52:0/4102315269 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dd102700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d8068150 0x7f42d8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dd903700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 0x7f42d8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 -- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d8068150 msgr2=0x7f42d8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d8068150 0x7f42d8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 -- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 msgr2=0x7f42d8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 0x7f42d8156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 -- 172.21.15.52:0/4102315269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009370 con 0x7f42d8154080 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dd903700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 0x7f42d8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.473+0000 7f42dc901700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f42cc009130 tx=0x7f42cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00be90 con 0x7f42d8154080 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00b7f0 con 0x7f42d8154080 2023-05-10T01:21:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d81539c0 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc01b660 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d80c2680 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.474+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8066720 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.475+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f42cc02b070 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.476+0000 7f42d57fa700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 0x7f42b8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.476+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f42cc07b310 con 0x7f42d8154080 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.476+0000 7f42dd102700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 0x7f42b8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.476+0000 7f42dd102700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 0x7f42b8061330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f42d8167b00 tx=0x7f42d0009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.481+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42cc04c7c0 con 0x7f42d8154080 2023-05-10T01:21:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.683+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f42d81539c0 con 0x7f42b805ee70 2023-05-10T01:21:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.688+0000 7f42d57fa700 1 -- 172.21.15.52:0/4102315269 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f42d81539c0 con 0x7f42b805ee70 2023-05-10T01:21:20.692 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-05-10T01:21:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 msgr2=0x7f42b8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 0x7f42b8061330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f42d8167b00 tx=0x7f42d0009040).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 msgr2=0x7f42d81534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f42cc009130 tx=0x7f42cc017000).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 shutdown_connections 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42b805ee70 0x7f42b8061330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d8154460 0x7f42d8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d8068150 0x7f42d8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 --2- 172.21.15.52:0/4102315269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42d8154080 0x7f42d81534d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 >> 172.21.15.52:0/4102315269 conn(0x7f42d8067910 msgr2=0x7f42d80cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 shutdown_connections 2023-05-10T01:21:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.690+0000 7f42df366700 1 -- 172.21.15.52:0/4102315269 wait complete. 2023-05-10T01:21:20.705 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-05-10T01:21:20.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-05-10T01:21:20.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.823+0000 7f651f59e700 1 Processor -- start 2023-05-10T01:21:20.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.823+0000 7f651f59e700 1 -- start start 2023-05-10T01:21:20.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651f59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6520153f80 0x7f65200a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 0x7f65200c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65200c6690 con 0x7f65200c0140 2023-05-10T01:21:20.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651f59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6520069f50 con 0x7f6520153f80 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652006a9d0 con 0x7f65200c5cf0 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6520153f80 0x7f65200a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6520153f80 0x7f65200a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60782/0 (socket says 172.21.15.52:60782) 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 -- 172.21.15.52:0/452666768 learned_addr learned my addr 172.21.15.52:0/452666768 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 -- 172.21.15.52:0/452666768 >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 msgr2=0x7f65200c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651dd9b700 1 --2- 172.21.15.52:0/452666768 >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 0x7f65200c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 --2- 172.21.15.52:0/452666768 >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 0x7f65200c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 -- 172.21.15.52:0/452666768 >> v1:172.21.15.172:6789/0 conn(0x7f65200c0140 legacy=0x7f65200c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 -- 172.21.15.52:0/452666768 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652006a130 con 0x7f6520153f80 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651dd9b700 1 --2- 172.21.15.52:0/452666768 >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 0x7f65200c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651e59c700 1 --2- 172.21.15.52:0/452666768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6520153f80 0x7f65200a9d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f65200c8230 tx=0x7f65180090f0).ready entity=mon.0 client_cookie=87d0cb2a1a538eff server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.824+0000 7f651d59a700 1 -- 172.21.15.52:0/452666768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800b5a0 con 0x7f6520153f80 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651d59a700 1 -- 172.21.15.52:0/452666768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800b700 con 0x7f6520153f80 2023-05-10T01:21:20.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651d59a700 1 -- 172.21.15.52:0/452666768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800ba80 con 0x7f6520153f80 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 -- 172.21.15.52:0/452666768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6520153f80 msgr2=0x7f65200a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 --2- 172.21.15.52:0/452666768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6520153f80 0x7f65200a9d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f65200c8230 tx=0x7f65180090f0).stop 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 -- 172.21.15.52:0/452666768 shutdown_connections 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 --2- 172.21.15.52:0/452666768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6520153f80 0x7f65200a9d10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 --2- 172.21.15.52:0/452666768 >> v2:172.21.15.172:3300/0 conn(0x7f65200c5cf0 0x7f65200c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 -- 172.21.15.52:0/452666768 >> 172.21.15.52:0/452666768 conn(0x7f65200cb5f0 msgr2=0x7f65200c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 -- 172.21.15.52:0/452666768 shutdown_connections 2023-05-10T01:21:20.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.825+0000 7f651f59e700 1 -- 172.21.15.52:0/452666768 wait complete. 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.826+0000 7f651f59e700 1 Processor -- start 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.826+0000 7f651f59e700 1 -- start start 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65200c0140 0x7f6520147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6520153f80 0x7f65200c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6520147640 con 0x7f65200c5cf0 2023-05-10T01:21:20.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200aea50 con 0x7f6520153f80 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65200ae770 con 0x7f65200c0140 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60790/0 (socket says 172.21.15.52:60790) 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65200c0140 0x7f6520147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 -- 172.21.15.52:0/555672497 learned_addr learned my addr 172.21.15.52:0/555672497 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651ed9d700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6520153f80 0x7f65200c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 -- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65200c0140 msgr2=0x7f6520147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65200c0140 0x7f6520147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 -- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6520153f80 msgr2=0x7f65200c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6520153f80 0x7f65200c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.827+0000 7f651dd9b700 1 -- 172.21.15.52:0/555672497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518009370 con 0x7f65200c5cf0 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f651dd9b700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f650800a400 tx=0x7f6508007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508016470 con 0x7f65200c5cf0 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080165d0 con 0x7f65200c5cf0 2023-05-10T01:21:20.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65200af4c0 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508016950 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.828+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65200afa80 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.829+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65200afdf0 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.829+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f650801d060 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.829+0000 7f65167fc700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 0x7f6504061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.829+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f650807aa80 con 0x7f65200c5cf0 2023-05-10T01:21:20.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.830+0000 7f651e59c700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 0x7f6504061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:20.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.830+0000 7f651e59c700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 0x7f6504061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6518009130 tx=0x7f6518015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:20.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:20.834+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f650804be20 con 0x7f65200c5cf0 2023-05-10T01:21:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.034+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6520083110 con 0x7f650405ee70 2023-05-10T01:21:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.038+0000 7f65167fc700 1 -- 172.21.15.52:0/555672497 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6520083110 con 0x7f650405ee70 2023-05-10T01:21:21.041 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-05-10T01:21:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 msgr2=0x7f6504061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 0x7f6504061330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6518009130 tx=0x7f6518015000).stop 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 msgr2=0x7f6520163970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f650800a400 tx=0x7f6508007910).stop 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 shutdown_connections 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f650405ee70 0x7f6504061330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6520153f80 0x7f65200c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65200c0140 0x7f6520147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 --2- 172.21.15.52:0/555672497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65200c5cf0 0x7f6520163970 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 >> 172.21.15.52:0/555672497 conn(0x7f65200cb5f0 msgr2=0x7f65200ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 shutdown_connections 2023-05-10T01:21:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.040+0000 7f651f59e700 1 -- 172.21.15.52:0/555672497 wait complete. 2023-05-10T01:21:21.060 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-05-10T01:21:21.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-05-10T01:21:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.178+0000 7f965ae06700 1 Processor -- start 2023-05-10T01:21:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.178+0000 7f965ae06700 1 -- start start 2023-05-10T01:21:21.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f965ae06700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f96540aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f965ae06700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540c94c0 con 0x7f9654068150 2023-05-10T01:21:21.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f965ae06700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540cb7d0 con 0x7f9654154080 2023-05-10T01:21:21.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f965ae06700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c88b0 con 0x7f9654154460 2023-05-10T01:21:21.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f96593a3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9654068150 0x7f96540c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41584/0 (socket says 172.21.15.52:41584) 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f96593a3700 1 -- 172.21.15.52:0/2091306067 learned_addr learned my addr 172.21.15.52:0/2091306067 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f9653fff700 1 --2- 172.21.15.52:0/2091306067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f96540aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499026080 0 0) 0x7f96540c94c0 con 0x7f9654068150 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.179+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96340033f0 con 0x7f9654068150 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006518184 0 0) 0x7f96540cb7d0 con 0x7f9654154080 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96540c94c0 con 0x7f9654154080 2023-05-10T01:21:21.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f9653fff700 1 -- 172.21.15.52:0/2091306067 >> v1:172.21.15.172:6789/0 conn(0x7f9654154080 legacy=0x7f96540a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f9653fff700 1 -- 172.21.15.52:0/2091306067 >> v1:172.21.15.52:6789/0 conn(0x7f9654068150 legacy=0x7f96540c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f9653fff700 1 -- 172.21.15.52:0/2091306067 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540c8b90 con 0x7f9654154460 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f9653fff700 1 --2- 172.21.15.52:0/2091306067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f96540aac90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9644009790 tx=0x7f9644009060).ready entity=mon.2 client_cookie=56d3b2ffedcc1da9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400f510 con 0x7f9654154460 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400f670 con 0x7f9654154460 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f96537fe700 1 -- 172.21.15.52:0/2091306067 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400f9f0 con 0x7f9654154460 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 -- 172.21.15.52:0/2091306067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 msgr2=0x7f96540aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 --2- 172.21.15.52:0/2091306067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f96540aac90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9644009790 tx=0x7f9644009060).stop 2023-05-10T01:21:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 -- 172.21.15.52:0/2091306067 shutdown_connections 2023-05-10T01:21:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 --2- 172.21.15.52:0/2091306067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f96540aac90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 -- 172.21.15.52:0/2091306067 >> 172.21.15.52:0/2091306067 conn(0x7f9654067910 msgr2=0x7f96540cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.180+0000 7f965ae06700 1 -- 172.21.15.52:0/2091306067 shutdown_connections 2023-05-10T01:21:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.181+0000 7f965ae06700 1 -- 172.21.15.52:0/2091306067 wait complete. 2023-05-10T01:21:21.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 Processor -- start 2023-05-10T01:21:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 -- start start 2023-05-10T01:21:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 0x7f965413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f9654154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965414d5e0 con 0x7f9654068150 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9654156c80 con 0x7f9654154080 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.182+0000 7f965ae06700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9654156f60 con 0x7f9654154460 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60802/0 (socket says 172.21.15.52:60802) 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 -- 172.21.15.52:0/2164469221 learned_addr learned my addr 172.21.15.52:0/2164469221 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9653fff700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 0x7f965413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 -- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 msgr2=0x7f9654154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f9654154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 -- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 msgr2=0x7f965413e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 0x7f965413e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 -- 172.21.15.52:0/2164469221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440092a0 con 0x7f9654068150 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9653fff700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 0x7f965413e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9658ba2700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f964c00c7c0 tx=0x7f964c002660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00a580 con 0x7f9654068150 2023-05-10T01:21:21.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00a6e0 con 0x7f9654068150 2023-05-10T01:21:21.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9654157240 con 0x7f9654068150 2023-05-10T01:21:21.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00aaa0 con 0x7f9654068150 2023-05-10T01:21:21.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.183+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9654157800 con 0x7f9654068150 2023-05-10T01:21:21.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.184+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9654066720 con 0x7f9654068150 2023-05-10T01:21:21.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.184+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f964c010070 con 0x7f9654068150 2023-05-10T01:21:21.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.185+0000 7f9650ff9700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 0x7f9638061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.185+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f964c079a40 con 0x7f9654068150 2023-05-10T01:21:21.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.185+0000 7f9653fff700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 0x7f9638061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.185+0000 7f9653fff700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 0x7f9638061330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9644009fd0 tx=0x7f9644017000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.189+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f964c04aef0 con 0x7f9654068150 2023-05-10T01:21:21.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.389+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f96540c8e70 con 0x7f963805ee70 2023-05-10T01:21:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.393+0000 7f9650ff9700 1 -- 172.21.15.52:0/2164469221 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f96540c8e70 con 0x7f963805ee70 2023-05-10T01:21:21.397 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 msgr2=0x7f9638061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 0x7f9638061330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9644009fd0 tx=0x7f9644017000).stop 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 msgr2=0x7f965414d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f964c00c7c0 tx=0x7f964c002660).stop 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 shutdown_connections 2023-05-10T01:21:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f963805ee70 0x7f9638061330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9654154460 0x7f9654154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9654068150 0x7f965414d0f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 --2- 172.21.15.52:0/2164469221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654154080 0x7f965413e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 >> 172.21.15.52:0/2164469221 conn(0x7f9654067910 msgr2=0x7f96540c11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 shutdown_connections 2023-05-10T01:21:21.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.395+0000 7f965ae06700 1 -- 172.21.15.52:0/2164469221 wait complete. 2023-05-10T01:21:21.411 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-05-10T01:21:21.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-05-10T01:21:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.528+0000 7f8cf759e700 1 Processor -- start 2023-05-10T01:21:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.528+0000 7f8cf759e700 1 -- start start 2023-05-10T01:21:21.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cf8153f80 0x7f8cf80a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf759e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf8155770 con 0x7f8cf8155370 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf806a130 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf8069f50 con 0x7f8cf8153f80 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cf8153f80 0x7f8cf80a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8cf8155370 0x7f8cf80c0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41598/0 (socket says 172.21.15.52:41598) 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf6d9d700 1 -- 172.21.15.52:0/2072338004 learned_addr learned my addr 172.21.15.52:0/2072338004 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:21.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf659c700 1 -- 172.21.15.52:0/2072338004 >> v1:172.21.15.172:6789/0 conn(0x7f8cf80c5cf0 legacy=0x7f8cf80c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf659c700 1 -- 172.21.15.52:0/2072338004 >> v1:172.21.15.52:6789/0 conn(0x7f8cf8155370 legacy=0x7f8cf80c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf559a700 1 -- 172.21.15.52:0/2072338004 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425786506 0 0) 0x7f8cf8155770 con 0x7f8cf8155370 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf659c700 1 -- 172.21.15.52:0/2072338004 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf806a410 con 0x7f8cf8153f80 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf659c700 1 --2- 172.21.15.52:0/2072338004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf8153f80 0x7f8cf80a9d10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f8cf80aa7d0 tx=0x7f8ce8009060).ready entity=mon.0 client_cookie=7d0095d36ed8521a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.529+0000 7f8cf559a700 1 -- 172.21.15.52:0/2072338004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800b580 con 0x7f8cf8153f80 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf559a700 1 -- 172.21.15.52:0/2072338004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce800b6e0 con 0x7f8cf8153f80 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf559a700 1 -- 172.21.15.52:0/2072338004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800ba60 con 0x7f8cf8153f80 2023-05-10T01:21:21.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 -- 172.21.15.52:0/2072338004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf8153f80 msgr2=0x7f8cf80a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 --2- 172.21.15.52:0/2072338004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf8153f80 0x7f8cf80a9d10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f8cf80aa7d0 tx=0x7f8ce8009060).stop 2023-05-10T01:21:21.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 -- 172.21.15.52:0/2072338004 shutdown_connections 2023-05-10T01:21:21.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 --2- 172.21.15.52:0/2072338004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf8153f80 0x7f8cf80a9d10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 -- 172.21.15.52:0/2072338004 >> 172.21.15.52:0/2072338004 conn(0x7f8cf80cb5f0 msgr2=0x7f8cf80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 -- 172.21.15.52:0/2072338004 shutdown_connections 2023-05-10T01:21:21.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.530+0000 7f8cf759e700 1 -- 172.21.15.52:0/2072338004 wait complete. 2023-05-10T01:21:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.531+0000 7f8cf759e700 1 Processor -- start 2023-05-10T01:21:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.531+0000 7f8cf759e700 1 -- start start 2023-05-10T01:21:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cf8153f80 0x7f8cf80aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cf8155370 0x7f8cf80c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80b0890 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80c1ec0 con 0x7f8cf8155370 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80c21a0 con 0x7f8cf8153f80 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60816/0 (socket says 172.21.15.52:60816) 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 -- 172.21.15.52:0/3598753375 learned_addr learned my addr 172.21.15.52:0/3598753375 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf6d9d700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cf8155370 0x7f8cf80c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf5d9b700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cf8153f80 0x7f8cf80aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 -- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cf8153f80 msgr2=0x7f8cf80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cf8153f80 0x7f8cf80aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 -- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cf8155370 msgr2=0x7f8cf80c0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cf8155370 0x7f8cf80c0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 -- 172.21.15.52:0/3598753375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80092a0 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.532+0000 7f8cf659c700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8cf8155900 tx=0x7f8ce8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.533+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800b850 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.533+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce800b9b0 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.533+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf80c2480 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.533+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce801b640 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.533+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf80b0480 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.534+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf80c1d20 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.534+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8ce800f070 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.534+0000 7f8ce67fc700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 0x7f8cd4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.534+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8ce807b8e0 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.535+0000 7f8cf5d9b700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 0x7f8cd4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.535+0000 7f8cf5d9b700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 0x7f8cd4061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8cf81514a0 tx=0x7f8cec009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.539+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8cf80c1d20 con 0x7f8cf80c5cf0 2023-05-10T01:21:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.737+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf80c2660 con 0x7f8cd405ee70 2023-05-10T01:21:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.742+0000 7f8ce67fc700 1 -- 172.21.15.52:0/3598753375 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8cf80c2660 con 0x7f8cd405ee70 2023-05-10T01:21:21.745 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-05-10T01:21:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 msgr2=0x7f8cd4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 0x7f8cd4061330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8cf81514a0 tx=0x7f8cec009040).stop 2023-05-10T01:21:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 msgr2=0x7f8cf8159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f8cf8155900 tx=0x7f8ce8017000).stop 2023-05-10T01:21:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 shutdown_connections 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8cd405ee70 0x7f8cd4061330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cf8155370 0x7f8cf80c0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf80c5cf0 0x7f8cf8159630 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 --2- 172.21.15.52:0/3598753375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cf8153f80 0x7f8cf80aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 >> 172.21.15.52:0/3598753375 conn(0x7f8cf80cb5f0 msgr2=0x7f8cf80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 shutdown_connections 2023-05-10T01:21:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.743+0000 7f8cf759e700 1 -- 172.21.15.52:0/3598753375 wait complete. 2023-05-10T01:21:21.758 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-05-10T01:21:21.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-05-10T01:21:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.875+0000 7f1c432e5700 1 Processor -- start 2023-05-10T01:21:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.875+0000 7f1c432e5700 1 -- start start 2023-05-10T01:21:21.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c432e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c3c154460 0x7f1c3c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c432e5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c3c068150 0x7f1c3c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c432e5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0c94c0 con 0x7f1c3c154080 2023-05-10T01:21:21.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c432e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c0cb7d0 con 0x7f1c3c154460 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c432e5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c068a90 con 0x7f1c3c068150 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c40880700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c3c154460 0x7f1c3c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c40880700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c3c154460 0x7f1c3c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60826/0 (socket says 172.21.15.52:60826) 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c40880700 1 -- 172.21.15.52:0/4155508271 learned_addr learned my addr 172.21.15.52:0/4155508271 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.876+0000 7f1c41882700 1 --2- 172.21.15.52:0/4155508271 >> v2:172.21.15.172:3300/0 conn(0x7f1c3c068150 0x7f1c3c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c40880700 1 -- 172.21.15.52:0/4155508271 >> v2:172.21.15.172:3300/0 conn(0x7f1c3c068150 msgr2=0x7f1c3c0685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c40880700 1 --2- 172.21.15.52:0/4155508271 >> v2:172.21.15.172:3300/0 conn(0x7f1c3c068150 0x7f1c3c0685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c40880700 1 -- 172.21.15.52:0/4155508271 >> v1:172.21.15.172:6789/0 conn(0x7f1c3c154080 legacy=0x7f1c3c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c40880700 1 -- 172.21.15.52:0/4155508271 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0c88b0 con 0x7f1c3c154460 2023-05-10T01:21:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c40880700 1 --2- 172.21.15.52:0/4155508271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154460 0x7f1c3c0aac90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f1c3c05f9d0 tx=0x7f1c300090f0).ready entity=mon.0 client_cookie=2eda81bfdb8f74dc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c3bfff700 1 -- 172.21.15.52:0/4155508271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000b600 con 0x7f1c3c154460 2023-05-10T01:21:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c3bfff700 1 -- 172.21.15.52:0/4155508271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000b760 con 0x7f1c3c154460 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c3bfff700 1 -- 172.21.15.52:0/4155508271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000bae0 con 0x7f1c3c154460 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 -- 172.21.15.52:0/4155508271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154460 msgr2=0x7f1c3c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 --2- 172.21.15.52:0/4155508271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154460 0x7f1c3c0aac90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f1c3c05f9d0 tx=0x7f1c300090f0).stop 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 -- 172.21.15.52:0/4155508271 shutdown_connections 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 --2- 172.21.15.52:0/4155508271 >> v2:172.21.15.172:3300/0 conn(0x7f1c3c068150 0x7f1c3c0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 --2- 172.21.15.52:0/4155508271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154460 0x7f1c3c0aac90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.877+0000 7f1c432e5700 1 -- 172.21.15.52:0/4155508271 >> 172.21.15.52:0/4155508271 conn(0x7f1c3c067910 msgr2=0x7f1c3c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:21.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.878+0000 7f1c432e5700 1 -- 172.21.15.52:0/4155508271 shutdown_connections 2023-05-10T01:21:21.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.878+0000 7f1c432e5700 1 -- 172.21.15.52:0/4155508271 wait complete. 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 Processor -- start 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 -- start start 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3c068150 0x7f1c3c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c3c154460 0x7f1c3c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c151e80 con 0x7f1c3c154080 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c152790 con 0x7f1c3c154460 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.879+0000 7f1c432e5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c151270 con 0x7f1c3c068150 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60832/0 (socket says 172.21.15.52:60832) 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 -- 172.21.15.52:0/2116963877 learned_addr learned my addr 172.21.15.52:0/2116963877 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 -- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3c068150 msgr2=0x7f1c3c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c41882700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c3c154460 0x7f1c3c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c41081700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3c068150 0x7f1c3c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3c068150 0x7f1c3c14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 -- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c3c154460 msgr2=0x7f1c3c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c3c154460 0x7f1c3c150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 -- 172.21.15.52:0/2116963877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30009370 con 0x7f1c3c154080 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c40880700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1c30009130 tx=0x7f1c30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000b8d0 con 0x7f1c3c154080 2023-05-10T01:21:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000ba30 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3001b660 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c151550 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.880+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c151b10 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.881+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c066720 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.882+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f1c3002b070 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.882+0000 7f1c397fa700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 0x7f1c1c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.882+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1c3007b5e0 con 0x7f1c3c154080 2023-05-10T01:21:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.882+0000 7f1c41081700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 0x7f1c1c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:21.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.883+0000 7f1c41081700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 0x7f1c1c061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1c34001680 tx=0x7f1c34009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:21.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:21.886+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c3004ca90 con 0x7f1c3c154080 2023-05-10T01:21:22.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.085+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3c151fc0 con 0x7f1c1c05ee70 2023-05-10T01:21:22.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.089+0000 7f1c397fa700 1 -- 172.21.15.52:0/2116963877 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1c3c151fc0 con 0x7f1c1c05ee70 2023-05-10T01:21:22.093 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 msgr2=0x7f1c1c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 0x7f1c1c061330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1c34001680 tx=0x7f1c34009040).stop 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 msgr2=0x7f1c3c150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f1c30009130 tx=0x7f1c30017000).stop 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 shutdown_connections 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1c1c05ee70 0x7f1c1c061330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c3c154460 0x7f1c3c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3c068150 0x7f1c3c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 --2- 172.21.15.52:0/2116963877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c3c154080 0x7f1c3c150700 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 >> 172.21.15.52:0/2116963877 conn(0x7f1c3c067910 msgr2=0x7f1c3c0c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:22.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 shutdown_connections 2023-05-10T01:21:22.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.091+0000 7f1c432e5700 1 -- 172.21.15.52:0/2116963877 wait complete. 2023-05-10T01:21:22.106 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-05-10T01:21:22.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:22.107 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-05-10T01:21:22.123 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:22.123 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:22.123 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:22.123 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:22.124 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:22.125 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:22.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-05-10T01:21:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.278+0000 7f562f596700 1 Processor -- start 2023-05-10T01:21:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.279+0000 7f562f596700 1 -- start start 2023-05-10T01:21:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.279+0000 7f562f596700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5628068860 0x7f56280aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.279+0000 7f562f596700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56280c94c0 con 0x7f5628154460 2023-05-10T01:21:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.279+0000 7f562f596700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56280cb7d0 con 0x7f5628154080 2023-05-10T01:21:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.279+0000 7f562f596700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56280c88b0 con 0x7f5628068860 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5628068860 0x7f56280aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5628068860 0x7f56280aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60842/0 (socket says 172.21.15.52:60842) 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 -- 172.21.15.52:0/3501021055 learned_addr learned my addr 172.21.15.52:0/3501021055 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562cb31700 1 --1- 172.21.15.52:0/3501021055 >> v1:172.21.15.52:6789/0 conn(0x7f5628154460 0x7f5628068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41624/0 (socket says 172.21.15.52:41624) 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 -- 172.21.15.52:0/3501021055 >> v1:172.21.15.172:6789/0 conn(0x7f5628154080 legacy=0x7f56280a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 -- 172.21.15.52:0/3501021055 >> v1:172.21.15.52:6789/0 conn(0x7f5628154460 legacy=0x7f5628068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f5627fff700 1 -- 172.21.15.52:0/3501021055 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272952441 0 0) 0x7f56280c94c0 con 0x7f5628154460 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 -- 172.21.15.52:0/3501021055 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280c8b90 con 0x7f5628068860 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f562db33700 1 --2- 172.21.15.52:0/3501021055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628068860 0x7f56280aac90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5618009f20 tx=0x7f5618009840).ready entity=mon.0 client_cookie=9eaba19b3151b7c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f5627fff700 1 -- 172.21.15.52:0/3501021055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800e070 con 0x7f5628068860 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f5627fff700 1 -- 172.21.15.52:0/3501021055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800ba80 con 0x7f5628068860 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.280+0000 7f5627fff700 1 -- 172.21.15.52:0/3501021055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800be00 con 0x7f5628068860 2023-05-10T01:21:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 -- 172.21.15.52:0/3501021055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628068860 msgr2=0x7f56280aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 --2- 172.21.15.52:0/3501021055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628068860 0x7f56280aac90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5618009f20 tx=0x7f5618009840).stop 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 -- 172.21.15.52:0/3501021055 shutdown_connections 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 --2- 172.21.15.52:0/3501021055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628068860 0x7f56280aac90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 -- 172.21.15.52:0/3501021055 >> 172.21.15.52:0/3501021055 conn(0x7f5628067910 msgr2=0x7f56280cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 -- 172.21.15.52:0/3501021055 shutdown_connections 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.281+0000 7f562f596700 1 -- 172.21.15.52:0/3501021055 wait complete. 2023-05-10T01:21:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.282+0000 7f562f596700 1 Processor -- start 2023-05-10T01:21:22.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.282+0000 7f562f596700 1 -- start start 2023-05-10T01:21:22.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5628068860 0x7f5628156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 0x7f562814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5628156e10 con 0x7f5628154080 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280af290 con 0x7f5628154460 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562f596700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56280ae680 con 0x7f5628068860 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60846/0 (socket says 172.21.15.52:60846) 2023-05-10T01:21:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 -- 172.21.15.52:0/542129796 learned_addr learned my addr 172.21.15.52:0/542129796 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562db33700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 0x7f562814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562d332700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5628068860 0x7f5628156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 -- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5628068860 msgr2=0x7f5628156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5628068860 0x7f5628156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 -- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 msgr2=0x7f562814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 0x7f562814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 -- 172.21.15.52:0/542129796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009ae0 con 0x7f5628154080 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562db33700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 0x7f562814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.283+0000 7f562cb31700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f561c00c490 tx=0x7f561c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0072e0 con 0x7f5628154080 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c007440 con 0x7f5628154080 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56280ae960 con 0x7f5628154080 2023-05-10T01:21:22.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c005930 con 0x7f5628154080 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56280aef20 con 0x7f5628154080 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.284+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56280a9c50 con 0x7f5628154080 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.285+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f561c010070 con 0x7f5628154080 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.285+0000 7f56257fa700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 0x7f5608061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.285+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f561c0792c0 con 0x7f5628154080 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.285+0000 7f562d332700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 0x7f5608061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.286+0000 7f562d332700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 0x7f5608061330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5628155c00 tx=0x7f5620009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.289+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f561c04a770 con 0x7f5628154080 2023-05-10T01:21:22.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.490+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56280c8e70 con 0x7f560805ee70 2023-05-10T01:21:22.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.492+0000 7f56257fa700 1 -- 172.21.15.52:0/542129796 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f56280c8e70 con 0x7f560805ee70 2023-05-10T01:21:22.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:22.495 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:53", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:22.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 msgr2=0x7f5608061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 0x7f5608061330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5628155c00 tx=0x7f5620009040).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 msgr2=0x7f5628156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f561c00c490 tx=0x7f561c007de0).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 shutdown_connections 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560805ee70 0x7f5608061330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154460 0x7f562814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5628068860 0x7f5628156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 --2- 172.21.15.52:0/542129796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628154080 0x7f5628156920 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 >> 172.21.15.52:0/542129796 conn(0x7f5628067910 msgr2=0x7f56280abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:22.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 shutdown_connections 2023-05-10T01:21:22.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.494+0000 7f562f596700 1 -- 172.21.15.52:0/542129796 wait complete. 2023-05-10T01:21:22.509 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:53", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:22.510 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:53', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:22.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:22.511 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-05-10T01:21:22.526 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:22.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:22.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:22.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:22.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:22.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:22.528 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:22.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-05-10T01:21:22.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.684+0000 7fe298d0a700 1 Processor -- start 2023-05-10T01:21:22.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.684+0000 7fe298d0a700 1 -- start start 2023-05-10T01:21:22.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe298d0a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe294154080 0x7fe2940aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe298d0a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe294154460 0x7fe2940a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe298d0a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2940c94c0 con 0x7fe2940aa140 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe298d0a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2940aa590 con 0x7fe294154460 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe298d0a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2940cb7d0 con 0x7fe294154080 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe294154460 0x7fe2940a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe294154460 0x7fe2940a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60854/0 (socket says 172.21.15.52:60854) 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 -- 172.21.15.52:0/4222322182 learned_addr learned my addr 172.21.15.52:0/4222322182 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe292d9d700 1 --1- 172.21.15.52:0/4222322182 >> v1:172.21.15.52:6789/0 conn(0x7fe2940aa140 0x7fe294068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41640/0 (socket says 172.21.15.52:41640) 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 -- 172.21.15.52:0/4222322182 >> v2:172.21.15.172:3300/0 conn(0x7fe294154080 msgr2=0x7fe2940aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe29259c700 1 --2- 172.21.15.52:0/4222322182 >> v2:172.21.15.172:3300/0 conn(0x7fe294154080 0x7fe2940aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe291d9b700 1 -- 172.21.15.52:0/4222322182 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064620776 0 0) 0x7fe2940c94c0 con 0x7fe2940aa140 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 --2- 172.21.15.52:0/4222322182 >> v2:172.21.15.172:3300/0 conn(0x7fe294154080 0x7fe2940aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 -- 172.21.15.52:0/4222322182 >> v1:172.21.15.52:6789/0 conn(0x7fe2940aa140 legacy=0x7fe294068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 -- 172.21.15.52:0/4222322182 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940c88b0 con 0x7fe294154460 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe28bfff700 1 --2- 172.21.15.52:0/4222322182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154460 0x7fe2940a9c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fe29406bd00 tx=0x7fe27c0090f0).ready entity=mon.0 client_cookie=7b8e2f18f9352f35 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe291d9b700 1 -- 172.21.15.52:0/4222322182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00b600 con 0x7fe294154460 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.685+0000 7fe291d9b700 1 -- 172.21.15.52:0/4222322182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00b760 con 0x7fe294154460 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe291d9b700 1 -- 172.21.15.52:0/4222322182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00bae0 con 0x7fe294154460 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 -- 172.21.15.52:0/4222322182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154460 msgr2=0x7fe2940a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 --2- 172.21.15.52:0/4222322182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154460 0x7fe2940a9c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fe29406bd00 tx=0x7fe27c0090f0).stop 2023-05-10T01:21:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 -- 172.21.15.52:0/4222322182 shutdown_connections 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 --2- 172.21.15.52:0/4222322182 >> v2:172.21.15.172:3300/0 conn(0x7fe294154080 0x7fe2940aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 --2- 172.21.15.52:0/4222322182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154460 0x7fe2940a9c50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 -- 172.21.15.52:0/4222322182 >> 172.21.15.52:0/4222322182 conn(0x7fe294067910 msgr2=0x7fe2940cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 -- 172.21.15.52:0/4222322182 shutdown_connections 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.686+0000 7fe298d0a700 1 -- 172.21.15.52:0/4222322182 wait complete. 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.687+0000 7fe298d0a700 1 Processor -- start 2023-05-10T01:21:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.687+0000 7fe298d0a700 1 -- start start 2023-05-10T01:21:22.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2940aa140 0x7fe294140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe294154460 0x7fe2940ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294157550 con 0x7fe294154080 2023-05-10T01:21:22.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940ae5b0 con 0x7fe2940aa140 2023-05-10T01:21:22.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe298d0a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940af3c0 con 0x7fe294154460 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60860/0 (socket says 172.21.15.52:60860) 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 -- 172.21.15.52:0/3070229857 learned_addr learned my addr 172.21.15.52:0/3070229857 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 -- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe294154460 msgr2=0x7fe2940ae0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe294154460 0x7fe2940ae0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 -- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2940aa140 msgr2=0x7fe294140820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T01:21:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2940aa140 0x7fe294140820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 -- 172.21.15.52:0/3070229857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009370 con 0x7fe294154080 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28bfff700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe27c009130 tx=0x7fe27c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00bae0 con 0x7fe294154080 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.688+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c000c90 con 0x7fe294154080 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.689+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2940ae7b0 con 0x7fe294154080 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.689+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c01b660 con 0x7fe294154080 2023-05-10T01:21:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.689+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2940aed70 con 0x7fe294154080 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.690+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fe27c02b070 con 0x7fe294154080 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.690+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe294066720 con 0x7fe294154080 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.690+0000 7fe28a7fc700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 0x7fe278061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.690+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe27c07b630 con 0x7fe294154080 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.691+0000 7fe29259c700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 0x7fe278061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.692+0000 7fe29259c700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 0x7fe278061330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe28400a880 tx=0x7fe284008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:22.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.694+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe27c04cae0 con 0x7fe294154080 2023-05-10T01:21:22.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.893+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe29406c340 con 0x7fe27805ee70 2023-05-10T01:21:22.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.895+0000 7fe28a7fc700 1 -- 172.21.15.52:0/3070229857 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe29406c340 con 0x7fe27805ee70 2023-05-10T01:21:22.899 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:22.899 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:53", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:22.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 msgr2=0x7fe278061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 0x7fe278061330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe28400a880 tx=0x7fe284008040).stop 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 msgr2=0x7fe2940adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe27c009130 tx=0x7fe27c017000).stop 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 shutdown_connections 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe27805ee70 0x7fe278061330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe294154460 0x7fe2940ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2940aa140 0x7fe294140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:22.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 --2- 172.21.15.52:0/3070229857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe294154080 0x7fe2940adbd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:22.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 >> 172.21.15.52:0/3070229857 conn(0x7fe294067910 msgr2=0x7fe2940c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:22.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 shutdown_connections 2023-05-10T01:21:22.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:22.897+0000 7fe298d0a700 1 -- 172.21.15.52:0/3070229857 wait complete. 2023-05-10T01:21:22.912 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:53", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:22.912 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:53', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:22.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:22.913 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-05-10T01:21:22.929 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:22.929 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:22.929 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:22.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:22.931 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:22.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-05-10T01:21:23.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.085+0000 7f1d97ed5700 1 Processor -- start 2023-05-10T01:21:23.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 -- start start 2023-05-10T01:21:23.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d900c94c0 con 0x7f1d90154080 2023-05-10T01:21:23.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d900cb7d0 con 0x7f1d90154460 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.086+0000 7f1d97ed5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d90068a90 con 0x7f1d90068150 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d95470700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d95c71700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1d90154080 0x7f1d900a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:44188/0 (socket says 172.21.15.52:44188) 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d95c71700 1 -- 172.21.15.52:0/2761571225 learned_addr learned my addr 172.21.15.52:0/2761571225 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:52272/0 (socket says 172.21.15.52:52272) 2023-05-10T01:21:23.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d95470700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:59192/0 (socket says 172.21.15.52:59192) 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d94c6f700 1 -- 172.21.15.52:0/2761571225 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887778143 0 0) 0x7f1d900c94c0 con 0x7f1d90154080 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d94c6f700 1 -- 172.21.15.52:0/2761571225 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c0033f0 con 0x7f1d90154080 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 -- 172.21.15.52:0/2761571225 >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 msgr2=0x7f1d900aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 --2- 172.21.15.52:0/2761571225 >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 -- 172.21.15.52:0/2761571225 >> v1:172.21.15.172:6789/0 conn(0x7f1d90154080 legacy=0x7f1d900a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 -- 172.21.15.52:0/2761571225 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900c88b0 con 0x7f1d90068150 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d95470700 1 --2- 172.21.15.52:0/2761571225 >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:23.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.087+0000 7f1d96472700 1 --2- 172.21.15.52:0/2761571225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1d80009e60 tx=0x7f1d80009780).ready entity=mon.2 client_cookie=9046eca3ff9ab2f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d94c6f700 1 -- 172.21.15.52:0/2761571225 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000e070 con 0x7f1d90068150 2023-05-10T01:21:23.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d94c6f700 1 -- 172.21.15.52:0/2761571225 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8000bab0 con 0x7f1d90068150 2023-05-10T01:21:23.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d94c6f700 1 -- 172.21.15.52:0/2761571225 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000be30 con 0x7f1d90068150 2023-05-10T01:21:23.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 -- 172.21.15.52:0/2761571225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 msgr2=0x7f1d900685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/2761571225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1d80009e60 tx=0x7f1d80009780).stop 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 -- 172.21.15.52:0/2761571225 shutdown_connections 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/2761571225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90068150 0x7f1d900685a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/2761571225 >> v2:172.21.15.172:3300/0 conn(0x7f1d90154460 0x7f1d900aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 -- 172.21.15.52:0/2761571225 >> 172.21.15.52:0/2761571225 conn(0x7f1d90067910 msgr2=0x7f1d900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 -- 172.21.15.52:0/2761571225 shutdown_connections 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.088+0000 7f1d97ed5700 1 -- 172.21.15.52:0/2761571225 wait complete. 2023-05-10T01:21:23.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.089+0000 7f1d97ed5700 1 Processor -- start 2023-05-10T01:21:23.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.089+0000 7f1d97ed5700 1 -- start start 2023-05-10T01:21:23.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d90154080 0x7f1d90159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90154460 0x7f1d90154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901588c0 con 0x7f1d90068150 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901596b0 con 0x7f1d90154080 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d97ed5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d90158aa0 con 0x7f1d90154460 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60870/0 (socket says 172.21.15.52:60870) 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 -- 172.21.15.52:0/4169168450 learned_addr learned my addr 172.21.15.52:0/4169168450 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95470700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d90154080 0x7f1d90159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d96472700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90154460 0x7f1d90154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 -- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90154460 msgr2=0x7f1d90154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90154460 0x7f1d90154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 -- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d90154080 msgr2=0x7f1d90159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.090+0000 7f1d95c71700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d90154080 0x7f1d90159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d95c71700 1 -- 172.21.15.52:0/4169168450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840092a0 con 0x7f1d90068150 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d95c71700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1d8800c590 tx=0x7f1d88007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880072e0 con 0x7f1d90068150 2023-05-10T01:21:23.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88007440 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d80009a20 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880057a0 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.091+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d901590e0 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.092+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d90159990 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.092+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f1d8801a060 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.092+0000 7f1d8dffb700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 0x7f1d70061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.093+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1d88078fb0 con 0x7f1d90068150 2023-05-10T01:21:23.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.093+0000 7f1d95470700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 0x7f1d70061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.093+0000 7f1d95470700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 0x7f1d70061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1d900aa0e0 tx=0x7f1d84009060).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.097+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d8804a460 con 0x7f1d90068150 2023-05-10T01:21:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.294+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d900c8b90 con 0x7f1d7005ee70 2023-05-10T01:21:23.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.296+0000 7f1d8dffb700 1 -- 172.21.15.52:0/4169168450 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1d900c8b90 con 0x7f1d7005ee70 2023-05-10T01:21:23.300 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:23.300 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 msgr2=0x7f1d70061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 0x7f1d70061330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1d900aa0e0 tx=0x7f1d84009060).stop 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 msgr2=0x7f1d9014fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1d8800c590 tx=0x7f1d88007c80).stop 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 shutdown_connections 2023-05-10T01:21:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1d7005ee70 0x7f1d70061330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d90154460 0x7f1d90154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90068150 0x7f1d9014fb10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 --2- 172.21.15.52:0/4169168450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d90154080 0x7f1d90159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 >> 172.21.15.52:0/4169168450 conn(0x7f1d90067910 msgr2=0x7f1d900c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 shutdown_connections 2023-05-10T01:21:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.298+0000 7f1d97ed5700 1 -- 172.21.15.52:0/4169168450 wait complete. 2023-05-10T01:21:23.313 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:23.314 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:54', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:23.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:23.315 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-05-10T01:21:23.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:23.332 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:23.332 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:23.332 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:23.332 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:23.332 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:23.332 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:23.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-05-10T01:21:23.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.489+0000 7f373759e700 1 Processor -- start 2023-05-10T01:21:23.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.489+0000 7f373759e700 1 -- start start 2023-05-10T01:21:23.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3738153f80 0x7f37380a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 0x7f37380c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37380c6690 con 0x7f37380c5cf0 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3738069f50 con 0x7f3738153f80 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373806a9d0 con 0x7f3738155370 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3738153f80 0x7f37380a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3738153f80 0x7f37380a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60878/0 (socket says 172.21.15.52:60878) 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 -- 172.21.15.52:0/3827845419 learned_addr learned my addr 172.21.15.52:0/3827845419 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f3736d9d700 1 --2- 172.21.15.52:0/3827845419 >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 0x7f37380c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 -- 172.21.15.52:0/3827845419 >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 msgr2=0x7f37380c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 --2- 172.21.15.52:0/3827845419 >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 0x7f37380c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 -- 172.21.15.52:0/3827845419 >> v1:172.21.15.172:6789/0 conn(0x7f37380c5cf0 legacy=0x7f37380c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 -- 172.21.15.52:0/3827845419 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738155770 con 0x7f3738153f80 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f3736d9d700 1 --2- 172.21.15.52:0/3827845419 >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 0x7f37380c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373659c700 1 --2- 172.21.15.52:0/3827845419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738153f80 0x7f37380a9d10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f37380c1b40 tx=0x7f37300090f0).ready entity=mon.0 client_cookie=2f69a0ddc1da8c75 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373559a700 1 -- 172.21.15.52:0/3827845419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b5a0 con 0x7f3738153f80 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373559a700 1 -- 172.21.15.52:0/3827845419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000b700 con 0x7f3738153f80 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.490+0000 7f373559a700 1 -- 172.21.15.52:0/3827845419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000ba80 con 0x7f3738153f80 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 -- 172.21.15.52:0/3827845419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738153f80 msgr2=0x7f37380a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 --2- 172.21.15.52:0/3827845419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738153f80 0x7f37380a9d10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f37380c1b40 tx=0x7f37300090f0).stop 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 -- 172.21.15.52:0/3827845419 shutdown_connections 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 --2- 172.21.15.52:0/3827845419 >> v2:172.21.15.172:3300/0 conn(0x7f3738155370 0x7f37380c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 --2- 172.21.15.52:0/3827845419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738153f80 0x7f37380a9d10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 -- 172.21.15.52:0/3827845419 >> 172.21.15.52:0/3827845419 conn(0x7f37380cb5f0 msgr2=0x7f37380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:23.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 -- 172.21.15.52:0/3827845419 shutdown_connections 2023-05-10T01:21:23.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.491+0000 7f373759e700 1 -- 172.21.15.52:0/3827845419 wait complete. 2023-05-10T01:21:23.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.492+0000 7f373759e700 1 Processor -- start 2023-05-10T01:21:23.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.492+0000 7f373759e700 1 -- start start 2023-05-10T01:21:23.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 0x7f3738150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3738153f80 0x7f3738151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738152880 con 0x7f3738155370 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738168540 con 0x7f37380c5cf0 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37380c3f00 con 0x7f3738153f80 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60888/0 (socket says 172.21.15.52:60888) 2023-05-10T01:21:23.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 -- 172.21.15.52:0/2126842939 learned_addr learned my addr 172.21.15.52:0/2126842939 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3735d9b700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3738153f80 0x7f3738151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373659c700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 0x7f3738150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 -- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3738153f80 msgr2=0x7f3738151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3738153f80 0x7f3738151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 -- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 msgr2=0x7f3738150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 0x7f3738150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 -- 172.21.15.52:0/2126842939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009370 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f373659c700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 0x7f3738150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.493+0000 7f3736d9d700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f372800c880 tx=0x7f3728008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.494+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728010580 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.494+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37280106e0 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.494+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37380c41e0 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.494+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728010a60 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.494+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37380c47a0 con 0x7f3738155370 2023-05-10T01:21:23.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.495+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37381686e0 con 0x7f3738155370 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.495+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f372801b460 con 0x7f3738155370 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.495+0000 7f372e7fc700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 0x7f371c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.496+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f3728079e00 con 0x7f3738155370 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.496+0000 7f373659c700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 0x7f371c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.496+0000 7f373659c700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 0x7f371c061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3730009130 tx=0x7f3730015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.500+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37381686e0 con 0x7f3738155370 2023-05-10T01:21:23.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.699+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37381686e0 con 0x7f371c05ee70 2023-05-10T01:21:23.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.701+0000 7f372e7fc700 1 -- 172.21.15.52:0/2126842939 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f37381686e0 con 0x7f371c05ee70 2023-05-10T01:21:23.704 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:23.704 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:23.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.702+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 msgr2=0x7f371c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.702+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 0x7f371c061330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3730009130 tx=0x7f3730015000).stop 2023-05-10T01:21:23.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.702+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 msgr2=0x7f3738152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.702+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f372800c880 tx=0x7f3728008040).stop 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 shutdown_connections 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f371c05ee70 0x7f371c061330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3738155370 0x7f3738152390 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380c5cf0 0x7f3738150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 --2- 172.21.15.52:0/2126842939 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3738153f80 0x7f3738151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 >> 172.21.15.52:0/2126842939 conn(0x7f37380cb5f0 msgr2=0x7f37380ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:23.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 shutdown_connections 2023-05-10T01:21:23.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.703+0000 7f373759e700 1 -- 172.21.15.52:0/2126842939 wait complete. 2023-05-10T01:21:23.719 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:23.719 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:54', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:23.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:23.720 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-05-10T01:21:23.736 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:23.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:23.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:23.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:23.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:23.738 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:23.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-05-10T01:21:23.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.892+0000 7fd6458fc700 1 Processor -- start 2023-05-10T01:21:23.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.892+0000 7fd6458fc700 1 -- start start 2023-05-10T01:21:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd6458fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400cb410 0x7fd6401544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd6458fc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6400c6310 con 0x7fd640155570 2023-05-10T01:21:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd6458fc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6401550e0 con 0x7fd640154110 2023-05-10T01:21:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd6458fc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400c6830 con 0x7fd6400cb410 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd63e7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400cb410 0x7fd6401544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.893+0000 7fd63f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd640155570 0x7fd640068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41680/0 (socket says 172.21.15.52:41680) 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63f7fe700 1 -- 172.21.15.52:0/3573208779 learned_addr learned my addr 172.21.15.52:0/3573208779 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63e7fc700 1 -- 172.21.15.52:0/3573208779 >> v1:172.21.15.172:6789/0 conn(0x7fd640154110 legacy=0x7fd6400c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63e7fc700 1 -- 172.21.15.52:0/3573208779 >> v1:172.21.15.52:6789/0 conn(0x7fd640155570 legacy=0x7fd640068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63dffb700 1 -- 172.21.15.52:0/3573208779 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894218896 0 0) 0x7fd630001490 con 0x7fd640155570 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63e7fc700 1 -- 172.21.15.52:0/3573208779 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400c6550 con 0x7fd6400cb410 2023-05-10T01:21:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63e7fc700 1 --2- 172.21.15.52:0/3573208779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cb410 0x7fd6401544f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fd634009760 tx=0x7fd634009060).ready entity=mon.0 client_cookie=1c5c197853a86513 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63dffb700 1 -- 172.21.15.52:0/3573208779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400b580 con 0x7fd6400cb410 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63dffb700 1 -- 172.21.15.52:0/3573208779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63400b6e0 con 0x7fd6400cb410 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.894+0000 7fd63dffb700 1 -- 172.21.15.52:0/3573208779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400ba60 con 0x7fd6400cb410 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 -- 172.21.15.52:0/3573208779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cb410 msgr2=0x7fd6401544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 --2- 172.21.15.52:0/3573208779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cb410 0x7fd6401544f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fd634009760 tx=0x7fd634009060).stop 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 -- 172.21.15.52:0/3573208779 shutdown_connections 2023-05-10T01:21:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 --2- 172.21.15.52:0/3573208779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cb410 0x7fd6401544f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 -- 172.21.15.52:0/3573208779 >> 172.21.15.52:0/3573208779 conn(0x7fd6400678d0 msgr2=0x7fd6400cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 -- 172.21.15.52:0/3573208779 shutdown_connections 2023-05-10T01:21:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.895+0000 7fd6458fc700 1 -- 172.21.15.52:0/3573208779 wait complete. 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.896+0000 7fd6458fc700 1 Processor -- start 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.896+0000 7fd6458fc700 1 -- start start 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd640154110 0x7fd6400a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd640155570 0x7fd640068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd640068a60 con 0x7fd6400a1fd0 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd640166740 con 0x7fd640154110 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd6458fc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd640165b30 con 0x7fd640155570 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60902/0 (socket says 172.21.15.52:60902) 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 -- 172.21.15.52:0/1463668389 learned_addr learned my addr 172.21.15.52:0/1463668389 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63effd700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd640154110 0x7fd6400a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63e7fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd640155570 0x7fd640068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 -- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd640155570 msgr2=0x7fd640068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd640155570 0x7fd640068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 -- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd640154110 msgr2=0x7fd6400a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd640154110 0x7fd6400a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 -- 172.21.15.52:0/1463668389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340092a0 con 0x7fd6400a1fd0 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd63f7fe700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd63000c760 tx=0x7fd630001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.897+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630005d30 con 0x7fd6400a1fd0 2023-05-10T01:21:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.898+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630005e90 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.898+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd640165e10 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.898+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630007300 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.898+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6401663d0 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.898+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd640066720 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.899+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fd630010070 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.899+0000 7fd626ffd700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 0x7fd620061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.899+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd6300794b0 con 0x7fd6400a1fd0 2023-05-10T01:21:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.899+0000 7fd63effd700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 0x7fd620061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.900+0000 7fd63effd700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 0x7fd620061330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd638007fd0 tx=0x7fd638007d70).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:23.903+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd63004a850 con 0x7fd6400a1fd0 2023-05-10T01:21:24.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.099+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6400c6310 con 0x7fd62005ee70 2023-05-10T01:21:24.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.101+0000 7fd626ffd700 1 -- 172.21.15.52:0/1463668389 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd6400c6310 con 0x7fd62005ee70 2023-05-10T01:21:24.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:24.105 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 msgr2=0x7fd620061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 0x7fd620061330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd638007fd0 tx=0x7fd638007d70).stop 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 msgr2=0x7fd640068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd63000c760 tx=0x7fd630001520).stop 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 shutdown_connections 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd62005ee70 0x7fd620061330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400a1fd0 0x7fd640068570 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd640154110 0x7fd6400a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 --2- 172.21.15.52:0/1463668389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd640155570 0x7fd640068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 >> 172.21.15.52:0/1463668389 conn(0x7fd6400678d0 msgr2=0x7fd6400ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:24.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 shutdown_connections 2023-05-10T01:21:24.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.103+0000 7fd6458fc700 1 -- 172.21.15.52:0/1463668389 wait complete. 2023-05-10T01:21:24.118 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:54", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.118 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:54', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:24.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:24.119 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-05-10T01:21:24.134 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:24.135 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:24.136 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:24.136 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:24.136 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:24.136 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:24.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-05-10T01:21:24.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.290+0000 7f58319f4700 1 Processor -- start 2023-05-10T01:21:24.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.290+0000 7f58319f4700 1 -- start start 2023-05-10T01:21:24.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f58319f4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154080 0x7f582c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f58319f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f582c068150 0x7f582c068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f58319f4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0c94c0 con 0x7f582c154460 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f58319f4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0cb7d0 con 0x7f582c068150 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f58319f4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c068a60 con 0x7f582c154080 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f582b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f582c068150 0x7f582c068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f582a7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f582c154460 0x7f582c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41692/0 (socket says 172.21.15.52:41692) 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.291+0000 7f582a7fc700 1 -- 172.21.15.52:0/2155668618 learned_addr learned my addr 172.21.15.52:0/2155668618 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582affd700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154080 0x7f582c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582b7fe700 1 -- 172.21.15.52:0/2155668618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154080 msgr2=0x7f582c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:24.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582b7fe700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154080 0x7f582c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582b7fe700 1 -- 172.21.15.52:0/2155668618 >> v1:172.21.15.52:6789/0 conn(0x7f582c154460 legacy=0x7f582c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582b7fe700 1 -- 172.21.15.52:0/2155668618 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0c88b0 con 0x7f582c068150 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f5829ffb700 1 -- 172.21.15.52:0/2155668618 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250223407 0 0) 0x7f582c0c94c0 con 0x7f582c154460 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f582b7fe700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c068570 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f581c009e60 tx=0x7f581c009780).ready entity=mon.0 client_cookie=9d12b79cfb60d70b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f5829ffb700 1 -- 172.21.15.52:0/2155668618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00e070 con 0x7f582c068150 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f5829ffb700 1 -- 172.21.15.52:0/2155668618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00bc30 con 0x7f582c068150 2023-05-10T01:21:24.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f5829ffb700 1 -- 172.21.15.52:0/2155668618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c012410 con 0x7f582c068150 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 -- 172.21.15.52:0/2155668618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 msgr2=0x7f582c068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c068570 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f581c009e60 tx=0x7f581c009780).stop 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 -- 172.21.15.52:0/2155668618 shutdown_connections 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c068570 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 --2- 172.21.15.52:0/2155668618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154080 0x7f582c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.292+0000 7f58319f4700 1 -- 172.21.15.52:0/2155668618 >> 172.21.15.52:0/2155668618 conn(0x7f582c067910 msgr2=0x7f582c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:24.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.293+0000 7f58319f4700 1 -- 172.21.15.52:0/2155668618 shutdown_connections 2023-05-10T01:21:24.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.293+0000 7f58319f4700 1 -- 172.21.15.52:0/2155668618 wait complete. 2023-05-10T01:21:24.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.294+0000 7f58319f4700 1 Processor -- start 2023-05-10T01:21:24.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.294+0000 7f58319f4700 1 -- start start 2023-05-10T01:21:24.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.294+0000 7f58319f4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.294+0000 7f58319f4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f582c154080 0x7f582c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.294+0000 7f58319f4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154460 0x7f582c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f58319f4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1507a0 con 0x7f582c068150 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f58319f4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c151c20 con 0x7f582c154080 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f58319f4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c151660 con 0x7f582c154460 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60912/0 (socket says 172.21.15.52:60912) 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 -- 172.21.15.52:0/4020147845 learned_addr learned my addr 172.21.15.52:0/4020147845 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582a7fc700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f582c154080 0x7f582c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 -- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154460 msgr2=0x7f582c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154460 0x7f582c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 -- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f582c154080 msgr2=0x7f582c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f582c154080 0x7f582c0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 -- 172.21.15.52:0/4020147845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009a20 con 0x7f582c068150 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f582affd700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f582400d890 tx=0x7f5824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240125f0 con 0x7f582c068150 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824012750 con 0x7f582c068150 2023-05-10T01:21:24.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c151940 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824012ad0 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.295+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c1527c0 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.296+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c066720 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.297+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5824013480 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.297+0000 7f5822ffd700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 0x7f5810061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.297+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5824079be0 con 0x7f582c068150 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.297+0000 7f582a7fc700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 0x7f5810061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.298+0000 7f582a7fc700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 0x7f5810061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f582c0c51d0 tx=0x7f5814009040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.301+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f582404b030 con 0x7f582c068150 2023-05-10T01:21:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.496+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f582c06bd30 con 0x7f581005ee70 2023-05-10T01:21:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.498+0000 7f5822ffd700 1 -- 172.21.15.52:0/4020147845 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f582c06bd30 con 0x7f581005ee70 2023-05-10T01:21:24.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:24.502 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:55", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 msgr2=0x7f5810061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 0x7f5810061330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f582c0c51d0 tx=0x7f5814009040).stop 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 msgr2=0x7f582c0c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f582400d890 tx=0x7f5824008040).stop 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 shutdown_connections 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f581005ee70 0x7f5810061330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f582c154460 0x7f582c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f582c068150 0x7f582c0c30e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 --2- 172.21.15.52:0/4020147845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f582c154080 0x7f582c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 >> 172.21.15.52:0/4020147845 conn(0x7f582c067910 msgr2=0x7f582c0c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 shutdown_connections 2023-05-10T01:21:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.500+0000 7f58319f4700 1 -- 172.21.15.52:0/4020147845 wait complete. 2023-05-10T01:21:24.515 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:55", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.516 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:55', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:24.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:24.516 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-05-10T01:21:24.532 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:24.533 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:24.534 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:24.534 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:24.534 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:24.534 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:24.534 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:24.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-05-10T01:21:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.688+0000 7fafb9fe5700 1 Processor -- start 2023-05-10T01:21:24.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.688+0000 7fafb9fe5700 1 -- start start 2023-05-10T01:21:24.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb9fe5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafb4150ba0 0x7fafb4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb9fe5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 0x7fafb4068440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb9fe5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb4064e80 con 0x7fafb4150f80 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb9fe5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb4068930 con 0x7fafb4150ba0 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb9fe5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb4065a00 con 0x7fafb40a6e80 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafb4150ba0 0x7fafb4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafb4150ba0 0x7fafb4067f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60920/0 (socket says 172.21.15.52:60920) 2023-05-10T01:21:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.689+0000 7fafb37fe700 1 -- 172.21.15.52:0/1805728739 learned_addr learned my addr 172.21.15.52:0/1805728739 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb3fff700 1 --2- 172.21.15.52:0/1805728739 >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 0x7fafb4068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb37fe700 1 -- 172.21.15.52:0/1805728739 >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 msgr2=0x7fafb4068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb37fe700 1 --2- 172.21.15.52:0/1805728739 >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 0x7fafb4068440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb37fe700 1 -- 172.21.15.52:0/1805728739 >> v1:172.21.15.172:6789/0 conn(0x7fafb4150f80 legacy=0x7fafb40a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb37fe700 1 -- 172.21.15.52:0/1805728739 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40635a0 con 0x7fafb4150ba0 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb3fff700 1 --2- 172.21.15.52:0/1805728739 >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 0x7fafb4068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:24.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb37fe700 1 --2- 172.21.15.52:0/1805728739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb4067f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fafb40c78f0 tx=0x7fafa40090f0).ready entity=mon.0 client_cookie=3afe7d3f47a872ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb27fc700 1 -- 172.21.15.52:0/1805728739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400b5a0 con 0x7fafb4150ba0 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb27fc700 1 -- 172.21.15.52:0/1805728739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400b700 con 0x7fafb4150ba0 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb27fc700 1 -- 172.21.15.52:0/1805728739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400ba80 con 0x7fafb4150ba0 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb9fe5700 1 -- 172.21.15.52:0/1805728739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 msgr2=0x7fafb4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/1805728739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb4067f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fafb40c78f0 tx=0x7fafa40090f0).stop 2023-05-10T01:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.690+0000 7fafb9fe5700 1 -- 172.21.15.52:0/1805728739 shutdown_connections 2023-05-10T01:21:24.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.691+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/1805728739 >> v2:172.21.15.172:3300/0 conn(0x7fafb40a6e80 0x7fafb4068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.691+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/1805728739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb4067f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.691+0000 7fafb9fe5700 1 -- 172.21.15.52:0/1805728739 >> 172.21.15.52:0/1805728739 conn(0x7fafb40c8410 msgr2=0x7fafb40c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:24.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.691+0000 7fafb9fe5700 1 -- 172.21.15.52:0/1805728739 shutdown_connections 2023-05-10T01:21:24.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.691+0000 7fafb9fe5700 1 -- 172.21.15.52:0/1805728739 wait complete. 2023-05-10T01:21:24.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.692+0000 7fafb9fe5700 1 Processor -- start 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.692+0000 7fafb9fe5700 1 -- start start 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb40a6e80 0x7fafb40c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafb4150f80 0x7fafb41469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40a7920 con 0x7fafb4150ba0 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40a7bf0 con 0x7fafb40a6e80 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40a7ed0 con 0x7fafb4150f80 2023-05-10T01:21:24.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60928/0 (socket says 172.21.15.52:60928) 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 -- 172.21.15.52:0/2255827533 learned_addr learned my addr 172.21.15.52:0/2255827533 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb37fe700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb40a6e80 0x7fafb40c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb3fff700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafb4150f80 0x7fafb41469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 -- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafb4150f80 msgr2=0x7fafb41469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafb4150f80 0x7fafb41469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 -- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb40a6e80 msgr2=0x7fafb40c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb40a6e80 0x7fafb40c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 -- 172.21.15.52:0/2255827533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009370 con 0x7fafb4150ba0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb2ffd700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fafa800b460 tx=0x7fafa8006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8012410 con 0x7fafb4150ba0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8012590 con 0x7fafb4150ba0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb40a81b0 con 0x7fafb4150ba0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8012950 con 0x7fafb4150ba0 2023-05-10T01:21:24.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.693+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb40a8770 con 0x7fafb4150ba0 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.694+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb40a8990 con 0x7fafb4150ba0 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.695+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fafa800f030 con 0x7fafb4150ba0 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.695+0000 7faf9b7fe700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 0x7faf94061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.695+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fafa80799d0 con 0x7fafb4150ba0 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.695+0000 7fafb37fe700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 0x7faf94061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:24.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.696+0000 7fafb37fe700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 0x7faf94061330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fafa4009130 tx=0x7fafa4015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:24.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.699+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafa804ae80 con 0x7fafb4150ba0 2023-05-10T01:21:24.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.896+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafb406c340 con 0x7faf9405ee70 2023-05-10T01:21:24.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.898+0000 7faf9b7fe700 1 -- 172.21.15.52:0/2255827533 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fafb406c340 con 0x7faf9405ee70 2023-05-10T01:21:24.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:24.901 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:55", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 msgr2=0x7faf94061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 0x7faf94061330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fafa4009130 tx=0x7fafa4015000).stop 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 msgr2=0x7fafb40a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fafa800b460 tx=0x7fafa8006f20).stop 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 shutdown_connections 2023-05-10T01:21:24.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf9405ee70 0x7faf94061330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafb4150f80 0x7fafb41469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb40a6e80 0x7fafb40c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 --2- 172.21.15.52:0/2255827533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafb4150ba0 0x7fafb40a7430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 >> 172.21.15.52:0/2255827533 conn(0x7fafb40c8410 msgr2=0x7fafb4066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 shutdown_connections 2023-05-10T01:21:24.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:24.900+0000 7fafb9fe5700 1 -- 172.21.15.52:0/2255827533 wait complete. 2023-05-10T01:21:24.915 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:55", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:24.915 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:55', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:24.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:24.916 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-05-10T01:21:24.930 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:24.932 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:24.932 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:24.932 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:24.932 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:24.933 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:24.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-05-10T01:21:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 Processor -- start 2023-05-10T01:21:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 -- start start 2023-05-10T01:21:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c154080 0x7f1e2c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e2c068150 0x7f1e2c068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c0c94c0 con 0x7f1e2c154460 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0cb7d0 con 0x7f1e2c068150 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.089+0000 7f1e31aab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c068a60 con 0x7f1e2c154080 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e2c068150 0x7f1e2c068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e2c068150 0x7f1e2c068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60936/0 (socket says 172.21.15.52:60936) 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e2c154460 0x7f1e2c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41722/0 (socket says 172.21.15.52:41722) 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 -- 172.21.15.52:0/37096688 learned_addr learned my addr 172.21.15.52:0/37096688 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2b7fe700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c154080 0x7f1e2c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 -- 172.21.15.52:0/37096688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c154080 msgr2=0x7f1e2c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c154080 0x7f1e2c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 -- 172.21.15.52:0/37096688 >> v1:172.21.15.52:6789/0 conn(0x7f1e2c154460 legacy=0x7f1e2c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2a7fc700 1 -- 172.21.15.52:0/37096688 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213492758 0 0) 0x7f1e2c0c94c0 con 0x7f1e2c154460 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 -- 172.21.15.52:0/37096688 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0c88b0 con 0x7f1e2c068150 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2bfff700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c068150 0x7f1e2c068570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1e1c009f20 tx=0x7f1e1c009840).ready entity=mon.0 client_cookie=fc1122652191b689 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2a7fc700 1 -- 172.21.15.52:0/37096688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00e070 con 0x7f1e2c068150 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2a7fc700 1 -- 172.21.15.52:0/37096688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00ba80 con 0x7f1e2c068150 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.090+0000 7f1e2a7fc700 1 -- 172.21.15.52:0/37096688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00be00 con 0x7f1e2c068150 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 -- 172.21.15.52:0/37096688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c068150 msgr2=0x7f1e2c068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c068150 0x7f1e2c068570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1e1c009f20 tx=0x7f1e1c009840).stop 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 -- 172.21.15.52:0/37096688 shutdown_connections 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c068150 0x7f1e2c068570 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 --2- 172.21.15.52:0/37096688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c154080 0x7f1e2c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 -- 172.21.15.52:0/37096688 >> 172.21.15.52:0/37096688 conn(0x7f1e2c067910 msgr2=0x7f1e2c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:25.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 -- 172.21.15.52:0/37096688 shutdown_connections 2023-05-10T01:21:25.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.091+0000 7f1e31aab700 1 -- 172.21.15.52:0/37096688 wait complete. 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.092+0000 7f1e31aab700 1 Processor -- start 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.092+0000 7f1e31aab700 1 -- start start 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c068150 0x7f1e2c0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 0x7f1e2c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0c4c30 con 0x7f1e2c154460 2023-05-10T01:21:25.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0c4020 con 0x7f1e2c154080 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e31aab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0c4300 con 0x7f1e2c068150 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60942/0 (socket says 172.21.15.52:60942) 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 -- 172.21.15.52:0/714157299 learned_addr learned my addr 172.21.15.52:0/714157299 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2b7fe700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c068150 0x7f1e2c0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 -- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c068150 msgr2=0x7f1e2c0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2affd700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 0x7f1e2c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c068150 0x7f1e2c0c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 -- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 msgr2=0x7f1e2c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 0x7f1e2c0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 -- 172.21.15.52:0/714157299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009ae0 con 0x7f1e2c154460 2023-05-10T01:21:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2affd700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 0x7f1e2c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e2bfff700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f1e1c009540 tx=0x7f1e1c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.093+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c0092e0 con 0x7f1e2c154460 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.094+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c01e470 con 0x7f1e2c154460 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.094+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c0c45e0 con 0x7f1e2c154460 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.094+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c01e7f0 con 0x7f1e2c154460 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.094+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c0c55b0 con 0x7f1e2c154460 2023-05-10T01:21:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.094+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c0c91a0 con 0x7f1e2c154460 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.095+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f1e1c025030 con 0x7f1e2c154460 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.096+0000 7f1e237fe700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 0x7f1e10061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.096+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1e1c07b930 con 0x7f1e2c154460 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.096+0000 7f1e2b7fe700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 0x7f1e10061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.096+0000 7f1e2b7fe700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 0x7f1e10061300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1e24006fd0 tx=0x7f1e24008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.099+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e1c04cf10 con 0x7f1e2c154460 2023-05-10T01:21:25.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.294+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e2c06c340 con 0x7f1e1005ee40 2023-05-10T01:21:25.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.296+0000 7f1e237fe700 1 -- 172.21.15.52:0/714157299 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1e2c06c340 con 0x7f1e1005ee40 2023-05-10T01:21:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:25.300 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:56", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:25.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 msgr2=0x7f1e10061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 0x7f1e10061300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1e24006fd0 tx=0x7f1e24008040).stop 2023-05-10T01:21:25.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 msgr2=0x7f1e2c14f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f1e1c009540 tx=0x7f1e1c009840).stop 2023-05-10T01:21:25.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 shutdown_connections 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e1005ee40 0x7f1e10061300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e2c154460 0x7f1e2c14f4e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c068150 0x7f1e2c0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 --2- 172.21.15.52:0/714157299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c154080 0x7f1e2c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.297+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 >> 172.21.15.52:0/714157299 conn(0x7f1e2c067910 msgr2=0x7f1e2c0abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.298+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 shutdown_connections 2023-05-10T01:21:25.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.298+0000 7f1e31aab700 1 -- 172.21.15.52:0/714157299 wait complete. 2023-05-10T01:21:25.313 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:56", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:25.313 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:56', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:25.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:25.314 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-05-10T01:21:25.329 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:25.330 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:25.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:25.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:25.331 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:25.331 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:25.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-05-10T01:21:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.486+0000 7f01a2854700 1 Processor -- start 2023-05-10T01:21:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.486+0000 7f01a2854700 1 -- start start 2023-05-10T01:21:25.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a2854700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f019c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a2854700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f019c068150 0x7f019c0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a2854700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c0c94c0 con 0x7f019c154080 2023-05-10T01:21:25.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a2854700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c0cb7d0 con 0x7f019c068150 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a2854700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c068ab0 con 0x7f019c154460 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f019bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f019c154080 0x7f019c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41732/0 (socket says 172.21.15.52:41732) 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f019bfff700 1 -- 172.21.15.52:0/794606026 learned_addr learned my addr 172.21.15.52:0/794606026 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f019b7fe700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f019c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> v2:172.21.15.172:3300/0 conn(0x7f019c068150 0x7f019c0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055309246 0 0) 0x7f019c0c94c0 con 0x7f019c154080 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.487+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01880033f0 con 0x7f019c154080 2023-05-10T01:21:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 783527252 0 0) 0x7f01880033f0 con 0x7f019c154080 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 msgr2=0x7f019c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f019c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 >> v2:172.21.15.172:3300/0 conn(0x7f019c068150 msgr2=0x7f019c0685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 --2- 172.21.15.52:0/794606026 >> v2:172.21.15.172:3300/0 conn(0x7f019c068150 0x7f019c0685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c0c88b0 con 0x7f019c154080 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f018c001470 con 0x7f019c154080 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019b7fe700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f019c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> v2:172.21.15.172:3300/0 conn(0x7f019c068150 0x7f019c0685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 >> v1:172.21.15.52:6789/0 conn(0x7f019c154080 legacy=0x7f019c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f01880038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188003dd0 0x7f0188004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f0188005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0cb7d0 con 0x7f0188004b80 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c068ab0 con 0x7f0188003dd0 2023-05-10T01:21:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018800b8e0 con 0x7f019c154460 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f0188005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019b7fe700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188003dd0 0x7f0188004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f019bfff700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f01880038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 -- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 msgr2=0x7f01880038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c154460 0x7f01880038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 -- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188003dd0 msgr2=0x7f0188004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0188003dd0 0x7f0188004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 -- 172.21.15.52:0/794606026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900092a0 con 0x7f0188004b80 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.488+0000 7f01a0df1700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f0188005000 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f019400e3c0 tx=0x7f019400b040).ready entity=mon.0 client_cookie=bacd35c201d69ce1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194009c50 con 0x7f0188004b80 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019400f040 con 0x7f0188004b80 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f019affd700 1 -- 172.21.15.52:0/794606026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400ee80 con 0x7f0188004b80 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 -- 172.21.15.52:0/794606026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 msgr2=0x7f0188005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 --2- 172.21.15.52:0/794606026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f0188005000 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f019400e3c0 tx=0x7f019400b040).stop 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a0df1700 1 -- 172.21.15.52:0/794606026 reap_dead start 2023-05-10T01:21:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 -- 172.21.15.52:0/794606026 shutdown_connections 2023-05-10T01:21:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 -- 172.21.15.52:0/794606026 >> 172.21.15.52:0/794606026 conn(0x7f019c067910 msgr2=0x7f019c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 -- 172.21.15.52:0/794606026 shutdown_connections 2023-05-10T01:21:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.489+0000 7f01a2854700 1 -- 172.21.15.52:0/794606026 wait complete. 2023-05-10T01:21:25.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.490+0000 7f01a2854700 1 Processor -- start 2023-05-10T01:21:25.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.490+0000 7f01a2854700 1 -- start start 2023-05-10T01:21:25.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f019c0af930 0x7f019c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c155c90 0x7f019c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1503d0 con 0x7f0188004b80 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c151230 con 0x7f019c0af930 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a2854700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c156600 con 0x7f019c155c90 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f019bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f019bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60960/0 (socket says 172.21.15.52:60960) 2023-05-10T01:21:25.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f019bfff700 1 -- 172.21.15.52:0/1680694383 learned_addr learned my addr 172.21.15.52:0/1680694383 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f019b7fe700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f019c0af930 0x7f019c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.491+0000 7f01a0df1700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c155c90 0x7f019c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 -- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c155c90 msgr2=0x7f019c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c155c90 0x7f019c156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 -- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f019c0af930 msgr2=0x7f019c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f019c0af930 0x7f019c0afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 -- 172.21.15.52:0/1680694383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c153210 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f019bfff700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f018c004a10 tx=0x7f018c001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00f870 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00f9d0 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00fd70 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c150000 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.492+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c150900 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.493+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c066720 con 0x7f0188004b80 2023-05-10T01:21:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.493+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f018c015620 con 0x7f0188004b80 2023-05-10T01:21:25.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.493+0000 7f0183fff700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 0x7f017c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.494+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f018c07a210 con 0x7f0188004b80 2023-05-10T01:21:25.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.494+0000 7f019b7fe700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 0x7f017c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.494+0000 7f019b7fe700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 0x7f017c061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f019c156a60 tx=0x7f0190009060).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.498+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f018c04b660 con 0x7f0188004b80 2023-05-10T01:21:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.699+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f019c06c340 con 0x7f017c05ee70 2023-05-10T01:21:25.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.701+0000 7f0183fff700 1 -- 172.21.15.52:0/1680694383 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f019c06c340 con 0x7f017c05ee70 2023-05-10T01:21:25.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:25.705 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:56", "first": "2023-05-10T01:12:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-05-10T01:21:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 msgr2=0x7f017c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 0x7f017c061330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f019c156a60 tx=0x7f0190009060).stop 2023-05-10T01:21:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 msgr2=0x7f019c14fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f018c004a10 tx=0x7f018c001e90).stop 2023-05-10T01:21:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 shutdown_connections 2023-05-10T01:21:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f017c05ee70 0x7f017c061330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f019c155c90 0x7f019c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0188004b80 0x7f019c14fb10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 --2- 172.21.15.52:0/1680694383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f019c0af930 0x7f019c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 >> 172.21.15.52:0/1680694383 conn(0x7f019c067910 msgr2=0x7f019c0c0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 shutdown_connections 2023-05-10T01:21:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.703+0000 7f01a2854700 1 -- 172.21.15.52:0/1680694383 wait complete. 2023-05-10T01:21:25.718 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:56", "first": "2023-05-10T01:12:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-05-10T01:21:25.719 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:56', 'first': '2023-05-10T01:12:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 10, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:25.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:25.720 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-05-10T01:21:25.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:25.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:25.737 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:25.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:25.739 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_11_00_UTC', 'scheduled-2023-05-10-01_12_00_UTC', 'scheduled-2023-05-10-01_13_00_UTC', 'scheduled-2023-05-10-01_14_00_UTC', 'scheduled-2023-05-10-01_15_00_UTC', 'scheduled-2023-05-10-01_16_00_UTC', 'scheduled-2023-05-10-01_17_00_UTC', 'scheduled-2023-05-10-01_18_00_UTC', 'scheduled-2023-05-10-01_19_00_UTC', 'scheduled-2023-05-10-01_20_00_UTC', 'scheduled-2023-05-10-01_21_00_UTC'] 2023-05-10T01:21:25.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-05-10T01:21:25.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.893+0000 7f8c168ef700 1 Processor -- start 2023-05-10T01:21:25.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.893+0000 7f8c168ef700 1 -- start start 2023-05-10T01:21:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c168ef700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 0x7f8c101544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c168ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c100cb410 0x7f8c100c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c168ef700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c101550e0 con 0x7f8c10155570 2023-05-10T01:21:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c168ef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c100c6830 con 0x7f8c100cb410 2023-05-10T01:21:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c168ef700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c100c6550 con 0x7f8c10154110 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c0f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c100cb410 0x7f8c100c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c0f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c100cb410 0x7f8c100c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60968/0 (socket says 172.21.15.52:60968) 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c0f7fe700 1 -- 172.21.15.52:0/2247907475 learned_addr learned my addr 172.21.15.52:0/2247907475 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.894+0000 7f8c0ffff700 1 --2- 172.21.15.52:0/2247907475 >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 0x7f8c101544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0f7fe700 1 -- 172.21.15.52:0/2247907475 >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 msgr2=0x7f8c101544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0f7fe700 1 --2- 172.21.15.52:0/2247907475 >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 0x7f8c101544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0f7fe700 1 -- 172.21.15.52:0/2247907475 >> v1:172.21.15.172:6789/0 conn(0x7f8c10155570 legacy=0x7f8c10068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0f7fe700 1 -- 172.21.15.52:0/2247907475 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10154a90 con 0x7f8c100cb410 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0ffff700 1 --2- 172.21.15.52:0/2247907475 >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 0x7f8c101544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0f7fe700 1 --2- 172.21.15.52:0/2247907475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100c5c00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f8c1006bfb0 tx=0x7f8c040090f0).ready entity=mon.0 client_cookie=9c67a81240fa78d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0effd700 1 -- 172.21.15.52:0/2247907475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400b5a0 con 0x7f8c100cb410 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0effd700 1 -- 172.21.15.52:0/2247907475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400b700 con 0x7f8c100cb410 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c0effd700 1 -- 172.21.15.52:0/2247907475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400ba80 con 0x7f8c100cb410 2023-05-10T01:21:25.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 -- 172.21.15.52:0/2247907475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 msgr2=0x7f8c100c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 --2- 172.21.15.52:0/2247907475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100c5c00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f8c1006bfb0 tx=0x7f8c040090f0).stop 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 -- 172.21.15.52:0/2247907475 shutdown_connections 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 --2- 172.21.15.52:0/2247907475 >> v2:172.21.15.172:3300/0 conn(0x7f8c10154110 0x7f8c101544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 --2- 172.21.15.52:0/2247907475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100c5c00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 -- 172.21.15.52:0/2247907475 >> 172.21.15.52:0/2247907475 conn(0x7f8c100678d0 msgr2=0x7f8c100cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 -- 172.21.15.52:0/2247907475 shutdown_connections 2023-05-10T01:21:25.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.895+0000 7f8c168ef700 1 -- 172.21.15.52:0/2247907475 wait complete. 2023-05-10T01:21:25.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.896+0000 7f8c168ef700 1 Processor -- start 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 -- start start 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c10154110 0x7f8c100ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 0x7f8c1013f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c4700 con 0x7f8c100cb410 2023-05-10T01:21:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100accb0 con 0x7f8c10155570 2023-05-10T01:21:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c168ef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c1cc0 con 0x7f8c10154110 2023-05-10T01:21:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c0ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.897+0000 7f8c0ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60974/0 (socket says 172.21.15.52:60974) 2023-05-10T01:21:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 -- 172.21.15.52:0/907110605 learned_addr learned my addr 172.21.15.52:0/907110605 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0f7fe700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c10154110 0x7f8c100ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c14e8c700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 0x7f8c1013f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 -- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c10154110 msgr2=0x7f8c100ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c10154110 0x7f8c100ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 -- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 msgr2=0x7f8c1013f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 0x7f8c1013f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 -- 172.21.15.52:0/907110605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009370 con 0x7f8c100cb410 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c14e8c700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 0x7f8c1013f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c0ffff700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f8c0000c880 tx=0x7f8c00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00010580 con 0x7f8c100cb410 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c000106e0 con 0x7f8c100cb410 2023-05-10T01:21:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c100c1fa0 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00010a60 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.898+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c100c2280 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.899+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c100c4550 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.899+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8c0001a410 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.900+0000 7f8bf7fff700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 0x7f8bf0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.900+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8c000797c0 con 0x7f8c100cb410 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.900+0000 7f8c0f7fe700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 0x7f8bf0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.900+0000 7f8c0f7fe700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 0x7f8bf0061330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8c04009130 tx=0x7f8c04015000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:25.904+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c0004ac10 con 0x7f8c100cb410 2023-05-10T01:21:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.099+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c100c49e0 con 0x7f8bf005ee70 2023-05-10T01:21:26.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.101+0000 7f8bf7fff700 1 -- 172.21.15.52:0/907110605 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f8c100c49e0 con 0x7f8bf005ee70 2023-05-10T01:21:26.104 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:26.104 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:57", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 msgr2=0x7f8bf0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 0x7f8bf0061330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8c04009130 tx=0x7f8c04015000).stop 2023-05-10T01:21:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 msgr2=0x7f8c100ad360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f8c0000c880 tx=0x7f8c00008040).stop 2023-05-10T01:21:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 shutdown_connections 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8bf005ee70 0x7f8bf0061330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c10155570 0x7f8c1013f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c100cb410 0x7f8c100ad360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 --2- 172.21.15.52:0/907110605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c10154110 0x7f8c100ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 >> 172.21.15.52:0/907110605 conn(0x7f8c100678d0 msgr2=0x7f8c10152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 shutdown_connections 2023-05-10T01:21:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.102+0000 7f8c168ef700 1 -- 172.21.15.52:0/907110605 wait complete. 2023-05-10T01:21:26.117 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:10:57", "first": "2023-05-10T01:11:00", "last": "2023-05-10T01:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-05-10T01:21:26.118 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:10:57', 'first': '2023-05-10T01:11:00', 'last': '2023-05-10T01:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-05-10T01:21:26.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-05-10T01:21:26.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.237+0000 7f0608e58700 1 Processor -- start 2023-05-10T01:21:26.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.237+0000 7f0608e58700 1 -- start start 2023-05-10T01:21:26.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.238+0000 7f0608e58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0604153cf0 0x7f0604063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.238+0000 7f0608e58700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06040622a0 0x7f0604062730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.238+0000 7f0608e58700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040bf940 con 0x7f06041540d0 2023-05-10T01:21:26.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.238+0000 7f0608e58700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0604067f50 con 0x7f06040622a0 2023-05-10T01:21:26.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.238+0000 7f0608e58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0604062c20 con 0x7f0604153cf0 2023-05-10T01:21:26.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06040622a0 0x7f0604062730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0601d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06041540d0 0x7f06040bf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41766/0 (socket says 172.21.15.52:41766) 2023-05-10T01:21:26.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0601d9b700 1 -- 172.21.15.52:0/3179529099 learned_addr learned my addr 172.21.15.52:0/3179529099 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:26.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06040622a0 0x7f0604062730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60984/0 (socket says 172.21.15.52:60984) 2023-05-10T01:21:26.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f060259c700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0604153cf0 0x7f0604063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 -- 172.21.15.52:0/3179529099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0604153cf0 msgr2=0x7f0604063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:26.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0604153cf0 0x7f0604063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 -- 172.21.15.52:0/3179529099 >> v1:172.21.15.52:6789/0 conn(0x7f06041540d0 legacy=0x7f06040bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 -- 172.21.15.52:0/3179529099 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040a7c80 con 0x7f06040622a0 2023-05-10T01:21:26.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f060159a700 1 -- 172.21.15.52:0/3179529099 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606621069 0 0) 0x7f06040bf940 con 0x7f06041540d0 2023-05-10T01:21:26.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f0602d9d700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06040622a0 0x7f0604062730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f05fc009e60 tx=0x7f05fc009780).ready entity=mon.0 client_cookie=b985b0c38a1bee80 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:26.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f060159a700 1 -- 172.21.15.52:0/3179529099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00e070 con 0x7f06040622a0 2023-05-10T01:21:26.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f060159a700 1 -- 172.21.15.52:0/3179529099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00bc30 con 0x7f06040622a0 2023-05-10T01:21:26.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.239+0000 7f060159a700 1 -- 172.21.15.52:0/3179529099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc012410 con 0x7f06040622a0 2023-05-10T01:21:26.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 -- 172.21.15.52:0/3179529099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06040622a0 msgr2=0x7f0604062730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06040622a0 0x7f0604062730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f05fc009e60 tx=0x7f05fc009780).stop 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 -- 172.21.15.52:0/3179529099 shutdown_connections 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06040622a0 0x7f0604062730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 --2- 172.21.15.52:0/3179529099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0604153cf0 0x7f0604063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 -- 172.21.15.52:0/3179529099 >> 172.21.15.52:0/3179529099 conn(0x7f060405e810 msgr2=0x7f06040c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 -- 172.21.15.52:0/3179529099 shutdown_connections 2023-05-10T01:21:26.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.240+0000 7f0608e58700 1 -- 172.21.15.52:0/3179529099 wait complete. 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.241+0000 7f0608e58700 1 Processor -- start 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.241+0000 7f0608e58700 1 -- start start 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 0x7f0604152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604153cf0 0x7f060414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060414f2f0 con 0x7f06041540d0 2023-05-10T01:21:26.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060414e9e0 con 0x7f0604153cf0 2023-05-10T01:21:26.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060414eca0 con 0x7f06040622a0 2023-05-10T01:21:26.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60990/0 (socket says 172.21.15.52:60990) 2023-05-10T01:21:26.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 -- 172.21.15.52:0/453365653 learned_addr learned my addr 172.21.15.52:0/453365653 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0601d9b700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604153cf0 0x7f060414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f060259c700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 0x7f0604152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 -- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 msgr2=0x7f0604152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 0x7f0604152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 -- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604153cf0 msgr2=0x7f060414cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604153cf0 0x7f060414cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 -- 172.21.15.52:0/453365653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc009a20 con 0x7f06041540d0 2023-05-10T01:21:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f060259c700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 0x7f0604152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0602d9d700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f05fc00b6c0 tx=0x7f05fc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc012410 con 0x7f06041540d0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00b6f0 con 0x7f06041540d0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060414ef80 con 0x7f06041540d0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.242+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc011e10 con 0x7f06041540d0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.243+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0604153350 con 0x7f06041540d0 2023-05-10T01:21:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.243+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060406c340 con 0x7f06041540d0 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.244+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f05fc01d630 con 0x7f06041540d0 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.244+0000 7f05f27fc700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 0x7f05e0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.244+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f05fc07c200 con 0x7f06041540d0 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.244+0000 7f060259c700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 0x7f05e0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.245+0000 7f060259c700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 0x7f05e0061330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f05f4008900 tx=0x7f05f4008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.248+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f05fc04d6b0 con 0x7f06041540d0 2023-05-10T01:21:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.447+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0604064800 con 0x7f05e005ee70 2023-05-10T01:21:26.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.451+0000 7f05f27fc700 1 -- 172.21.15.52:0/453365653 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f0604064800 con 0x7f05e005ee70 2023-05-10T01:21:26.455 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-05-10T01:21:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 msgr2=0x7f05e0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 0x7f05e0061330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f05f4008900 tx=0x7f05f4008040).stop 2023-05-10T01:21:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 msgr2=0x7f06040a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f05fc00b6c0 tx=0x7f05fc009780).stop 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 shutdown_connections 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f05e005ee70 0x7f05e0061330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06041540d0 0x7f06040a60f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06040622a0 0x7f0604152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 --2- 172.21.15.52:0/453365653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604153cf0 0x7f060414cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.453+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 >> 172.21.15.52:0/453365653 conn(0x7f060405e810 msgr2=0x7f0604068240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.454+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 shutdown_connections 2023-05-10T01:21:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:26.454+0000 7f0608e58700 1 -- 172.21.15.52:0/453365653 wait complete. 2023-05-10T01:21:26.469 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-05-10T01:21:26.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.469 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-05-10T01:21:26.485 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:26.485 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:26.487 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:26.487 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:26.487 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:26.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.488 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:26.547 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:26.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.548 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:26.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:26.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.610 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:26.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:26.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.671 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:26.731 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:26.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.732 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:26.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:26.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.793 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:26.855 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:26.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.856 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:26.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:26.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.917 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:26.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:26.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:26.979 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:27.037 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:27.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.038 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:27.098 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:27.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.099 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:27.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.159 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-05-10T01:21:27.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-05-10T01:21:27.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.374+0000 7fb4c70ac700 1 Processor -- start 2023-05-10T01:21:27.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.374+0000 7fb4c70ac700 1 -- start start 2023-05-10T01:21:27.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.375+0000 7fb4c70ac700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.375+0000 7fb4c70ac700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.375+0000 7fb4c70ac700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c00a7c80 con 0x7fb4c00622a0 2023-05-10T01:21:27.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.375+0000 7fb4c70ac700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c0067f50 con 0x7fb4c01540d0 2023-05-10T01:21:27.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.375+0000 7fb4c70ac700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00a7ef0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:59322/0 (socket says 172.21.15.52:59322) 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:52398/0 (socket says 172.21.15.52:52398) 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bffff700 1 -- 172.21.15.52:0/4070103922 learned_addr learned my addr 172.21.15.52:0/4070103922 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c5649700 1 --1- 172.21.15.52:0/4070103922 >> v1:172.21.15.172:6789/0 conn(0x7fb4c00622a0 0x7fb4c0157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:44318/0 (socket says 172.21.15.52:44318) 2023-05-10T01:21:27.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 -- 172.21.15.52:0/4070103922 >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 msgr2=0x7fb4c00bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 --2- 172.21.15.52:0/4070103922 >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 -- 172.21.15.52:0/4070103922 >> v1:172.21.15.172:6789/0 conn(0x7fb4c00622a0 legacy=0x7fb4c0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 -- 172.21.15.52:0/4070103922 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00a81d0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bffff700 1 --2- 172.21.15.52:0/4070103922 >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4c4e48700 1 --2- 172.21.15.52:0/4070103922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb4b4009760 tx=0x7fb4b4009060).ready entity=mon.2 client_cookie=a0516b3001674ac server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bf7fe700 1 -- 172.21.15.52:0/4070103922 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400f510 con 0x7fb4c0153cf0 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.376+0000 7fb4bf7fe700 1 -- 172.21.15.52:0/4070103922 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400f670 con 0x7fb4c0153cf0 2023-05-10T01:21:27.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4bf7fe700 1 -- 172.21.15.52:0/4070103922 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400f9f0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 -- 172.21.15.52:0/4070103922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 msgr2=0x7fb4c0063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/4070103922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb4b4009760 tx=0x7fb4b4009060).stop 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 -- 172.21.15.52:0/4070103922 shutdown_connections 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/4070103922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c0153cf0 0x7fb4c0063fa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/4070103922 >> v2:172.21.15.172:3300/0 conn(0x7fb4c01540d0 0x7fb4c00bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 -- 172.21.15.52:0/4070103922 >> 172.21.15.52:0/4070103922 conn(0x7fb4c005e810 msgr2=0x7fb4c00c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 -- 172.21.15.52:0/4070103922 shutdown_connections 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.377+0000 7fb4c70ac700 1 -- 172.21.15.52:0/4070103922 wait complete. 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.378+0000 7fb4c70ac700 1 Processor -- start 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.378+0000 7fb4c70ac700 1 -- start start 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4c00622a0 0x7fb4c00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c01540d0 0x7fb4c00c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00c16c0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c014faa0 con 0x7fb4c00622a0 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c70ac700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c00c18c0 con 0x7fb4c01540d0 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32768/0 (socket says 172.21.15.52:32768) 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 -- 172.21.15.52:0/559190221 learned_addr learned my addr 172.21.15.52:0/559190221 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c4e48700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4c00622a0 0x7fb4c00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4c5649700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c01540d0 0x7fb4c00c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 -- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c01540d0 msgr2=0x7fb4c00c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c01540d0 0x7fb4c00c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 -- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4c00622a0 msgr2=0x7fb4c00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4c00622a0 0x7fb4c00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.379+0000 7fb4bffff700 1 -- 172.21.15.52:0/559190221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac009370 con 0x7fb4c0153cf0 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4bffff700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb4ac009fd0 tx=0x7fb4ac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac012600 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac012760 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b40092a0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac012ae0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.380+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c0167ca0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.381+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c006c340 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.381+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb4ac022070 con 0x7fb4c0153cf0 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.381+0000 7fb4bcff9700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 0x7fb4a8061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.381+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb4ac079fe0 con 0x7fb4c0153cf0 2023-05-10T01:21:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.382+0000 7fb4c4e48700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 0x7fb4a8061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.382+0000 7fb4c4e48700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 0x7fb4a8061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb4b4009fd0 tx=0x7fb4b4017000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.386+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4ac04b490 con 0x7fb4c0153cf0 2023-05-10T01:21:27.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.583+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c0064800 con 0x7fb4a805ee70 2023-05-10T01:21:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.587+0000 7fb4bcff9700 1 -- 172.21.15.52:0/559190221 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fb4c0064800 con 0x7fb4a805ee70 2023-05-10T01:21:27.591 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 msgr2=0x7fb4a8061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 0x7fb4a8061330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb4b4009fd0 tx=0x7fb4b4017000).stop 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 msgr2=0x7fb4c00c0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fb4ac009fd0 tx=0x7fb4ac0090f0).stop 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 shutdown_connections 2023-05-10T01:21:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb4a805ee70 0x7fb4a8061330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4c01540d0 0x7fb4c00c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4c00622a0 0x7fb4c00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 --2- 172.21.15.52:0/559190221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0153cf0 0x7fb4c00c0ce0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 >> 172.21.15.52:0/559190221 conn(0x7fb4c005e810 msgr2=0x7fb4c0152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 shutdown_connections 2023-05-10T01:21:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:27.589+0000 7fb4c70ac700 1 -- 172.21.15.52:0/559190221 wait complete. 2023-05-10T01:21:27.604 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-05-10T01:21:27.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.605 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-05-10T01:21:27.620 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:27.622 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:27.622 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:27.622 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:27.622 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:27.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.623 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:27.682 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:27.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.683 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:27.742 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:27.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.743 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:27.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:27.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.805 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:27.864 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:27.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.865 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:27.924 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:27.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.925 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:27.984 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:27.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:27.985 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:28.045 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:28.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.046 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:28.105 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:28.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.106 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:28.165 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:28.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.167 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:28.226 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:28.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.227 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:28.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.287 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-05-10T01:21:28.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:21:28.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-05-10T01:21:28.386 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:21:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.503+0000 7feb3b59e700 1 Processor -- start 2023-05-10T01:21:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.503+0000 7feb3b59e700 1 -- start start 2023-05-10T01:21:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 0x7feb3c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb3c0c6090 0x7feb3c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c0bfcb0 con 0x7feb3c157700 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c06a990 con 0x7feb3c0c6090 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0aa400 con 0x7feb3c0c1150 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb3c0c6090 0x7feb3c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb3c0c6090 0x7feb3c15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32778/0 (socket says 172.21.15.52:32778) 2023-05-10T01:21:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 -- 172.21.15.52:0/3488867168 learned_addr learned my addr 172.21.15.52:0/3488867168 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 -- 172.21.15.52:0/3488867168 >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 msgr2=0x7feb3c0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb39d9b700 1 --2- 172.21.15.52:0/3488867168 >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 0x7feb3c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 --2- 172.21.15.52:0/3488867168 >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 0x7feb3c0c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 -- 172.21.15.52:0/3488867168 >> v1:172.21.15.172:6789/0 conn(0x7feb3c157700 legacy=0x7feb3c0a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 -- 172.21.15.52:0/3488867168 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c06a130 con 0x7feb3c0c6090 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb39d9b700 1 --2- 172.21.15.52:0/3488867168 >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 0x7feb3c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3ad9d700 1 --2- 172.21.15.52:0/3488867168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c0c6090 0x7feb3c15de50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7feb3c06bde0 tx=0x7feb2c009840).ready entity=mon.0 client_cookie=59c7445aeb95b5fe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3959a700 1 -- 172.21.15.52:0/3488867168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00e070 con 0x7feb3c0c6090 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3959a700 1 -- 172.21.15.52:0/3488867168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00ba10 con 0x7feb3c0c6090 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.504+0000 7feb3959a700 1 -- 172.21.15.52:0/3488867168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00bd90 con 0x7feb3c0c6090 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 -- 172.21.15.52:0/3488867168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c0c6090 msgr2=0x7feb3c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 --2- 172.21.15.52:0/3488867168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c0c6090 0x7feb3c15de50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7feb3c06bde0 tx=0x7feb2c009840).stop 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 -- 172.21.15.52:0/3488867168 shutdown_connections 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 --2- 172.21.15.52:0/3488867168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c0c6090 0x7feb3c15de50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 --2- 172.21.15.52:0/3488867168 >> v2:172.21.15.172:3300/0 conn(0x7feb3c0c1150 0x7feb3c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 -- 172.21.15.52:0/3488867168 >> 172.21.15.52:0/3488867168 conn(0x7feb3c0cb5f0 msgr2=0x7feb3c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:28.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 -- 172.21.15.52:0/3488867168 shutdown_connections 2023-05-10T01:21:28.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.505+0000 7feb3b59e700 1 -- 172.21.15.52:0/3488867168 wait complete. 2023-05-10T01:21:28.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.506+0000 7feb3b59e700 1 Processor -- start 2023-05-10T01:21:28.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.506+0000 7feb3b59e700 1 -- start start 2023-05-10T01:21:28.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c0c1150 0x7feb3c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 0x7feb3c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c2d60 con 0x7feb3c157700 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0c35a0 con 0x7feb3c0c1150 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0ae8c0 con 0x7feb3c0c6090 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32784/0 (socket says 172.21.15.52:32784) 2023-05-10T01:21:28.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 -- 172.21.15.52:0/1036435662 learned_addr learned my addr 172.21.15.52:0/1036435662 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3a59c700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c0c1150 0x7feb3c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb39d9b700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 0x7feb3c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 -- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 msgr2=0x7feb3c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 0x7feb3c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 -- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c0c1150 msgr2=0x7feb3c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c0c1150 0x7feb3c0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 -- 172.21.15.52:0/1036435662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009ae0 con 0x7feb3c157700 2023-05-10T01:21:28.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb39d9b700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 0x7feb3c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb3ad9d700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7feb3c083e20 tx=0x7feb2c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.507+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0092e0 con 0x7feb3c157700 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.508+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c01d410 con 0x7feb3c157700 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.508+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c0aeba0 con 0x7feb3c157700 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.508+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c01d7b0 con 0x7feb3c157700 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.508+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c0af160 con 0x7feb3c157700 2023-05-10T01:21:28.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.508+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c083110 con 0x7feb3c157700 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.509+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7feb2c01b040 con 0x7feb3c157700 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.509+0000 7feb327fc700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 0x7feb20061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.509+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7feb2c07b940 con 0x7feb3c157700 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.509+0000 7feb3a59c700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 0x7feb20061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.510+0000 7feb3a59c700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 0x7feb20061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7feb3400b9b0 tx=0x7feb34008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.513+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb2c04cdf0 con 0x7feb3c157700 2023-05-10T01:21:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.725+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3c083110 con 0x7feb2005ee70 2023-05-10T01:21:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.729+0000 7feb327fc700 1 -- 172.21.15.52:0/1036435662 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7feb3c083110 con 0x7feb2005ee70 2023-05-10T01:21:28.734 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-05-10T01:21:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 msgr2=0x7feb20061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 0x7feb20061330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7feb3400b9b0 tx=0x7feb34008040).stop 2023-05-10T01:21:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 msgr2=0x7feb3c0ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7feb3c083e20 tx=0x7feb2c009840).stop 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 shutdown_connections 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb2005ee70 0x7feb20061330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb3c157700 0x7feb3c0ac7b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c0c1150 0x7feb3c0c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 --2- 172.21.15.52:0/1036435662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb3c0c6090 0x7feb3c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.731+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 >> 172.21.15.52:0/1036435662 conn(0x7feb3c0cb5f0 msgr2=0x7feb3c14e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.732+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 shutdown_connections 2023-05-10T01:21:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:28.732+0000 7feb3b59e700 1 -- 172.21.15.52:0/1036435662 wait complete. 2023-05-10T01:21:28.747 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-05-10T01:21:28.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.748 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-05-10T01:21:28.764 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:28.764 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:28.764 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:28.764 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:28.764 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:28.766 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:28.766 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:28.766 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:28.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.768 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:28.831 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:28.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.832 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:28.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:28.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.899 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:28.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:28.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:28.958 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:29.032 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:29.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.033 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:29.093 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:29.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.094 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:29.153 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:29.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.154 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:29.213 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:29.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.214 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:29.273 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:29.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.274 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:29.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:29.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.335 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:29.394 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:29.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.395 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:29.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.456 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-05-10T01:21:29.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-05-10T01:21:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.672+0000 7f5a92ff7700 1 Processor -- start 2023-05-10T01:21:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.672+0000 7f5a92ff7700 1 -- start start 2023-05-10T01:21:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a92ff7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a92ff7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a92ff7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0c6660 con 0x7f5a8c0c0140 2023-05-10T01:21:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a92ff7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c069f50 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a92ff7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c06a9d0 con 0x7f5a8c153f80 2023-05-10T01:21:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a91ff5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.673+0000 7f5a917f4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a91ff5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:52424/0 (socket says 172.21.15.52:52424) 2023-05-10T01:21:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a91ff5700 1 -- 172.21.15.52:0/3181825096 learned_addr learned my addr 172.21.15.52:0/3181825096 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:59346/0 (socket says 172.21.15.52:59346) 2023-05-10T01:21:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 -- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 msgr2=0x7f5a8c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 --2- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 -- 172.21.15.52:0/3181825096 >> v1:172.21.15.172:6789/0 conn(0x7f5a8c0c0140 legacy=0x7f5a8c0c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 -- 172.21.15.52:0/3181825096 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c06a130 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.674+0000 7f5a917f4700 1 --2- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f5a7c009760 tx=0x7f5a7c009060).ready entity=mon.1 client_cookie=e0ecae63a1ab0c1d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.675+0000 7f5a90ff3700 1 -- 172.21.15.52:0/3181825096 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00f510 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.675+0000 7f5a90ff3700 1 -- 172.21.15.52:0/3181825096 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c00f670 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.675+0000 7f5a90ff3700 1 -- 172.21.15.52:0/3181825096 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00f9f0 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 msgr2=0x7f5a8c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f5a7c009760 tx=0x7f5a7c009060).stop 2023-05-10T01:21:29.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3181825096 shutdown_connections 2023-05-10T01:21:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3181825096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c6170 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3181825096 >> 172.21.15.52:0/3181825096 conn(0x7f5a8c0cb5f0 msgr2=0x7f5a8c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:29.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.676+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3181825096 shutdown_connections 2023-05-10T01:21:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.677+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3181825096 wait complete. 2023-05-10T01:21:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.678+0000 7f5a92ff7700 1 Processor -- start 2023-05-10T01:21:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.678+0000 7f5a92ff7700 1 -- start start 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1674c0 con 0x7f5a8c0c0140 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0adfc0 con 0x7f5a8c0c5cf0 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a92ff7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1682b0 con 0x7f5a8c153f80 2023-05-10T01:21:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a91ff5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a91ff5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32794/0 (socket says 172.21.15.52:32794) 2023-05-10T01:21:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a91ff5700 1 -- 172.21.15.52:0/3836436496 learned_addr learned my addr 172.21.15.52:0/3836436496 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a917f4700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.679+0000 7f5a927f6700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 -- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 msgr2=0x7f5a8c0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 -- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 msgr2=0x7f5a8c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 -- 172.21.15.52:0/3836436496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0092a0 con 0x7f5a8c0c0140 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a91ff5700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f5a8800e900 tx=0x7f5a880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88012600 con 0x7f5a8c0c0140 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88012760 con 0x7f5a8c0c0140 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88012ae0 con 0x7f5a8c0c0140 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.680+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c1676a0 con 0x7f5a8c0c0140 2023-05-10T01:21:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.681+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c167c60 con 0x7f5a8c0c0140 2023-05-10T01:21:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.682+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c083110 con 0x7f5a8c0c0140 2023-05-10T01:21:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.683+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5a88022070 con 0x7f5a8c0c0140 2023-05-10T01:21:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.683+0000 7f5a79ffb700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 0x7f5a6c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.683+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f5a8807a150 con 0x7f5a8c0c0140 2023-05-10T01:21:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.683+0000 7f5a917f4700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 0x7f5a6c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.684+0000 7f5a917f4700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 0x7f5a6c061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5a7c009760 tx=0x7f5a7c017000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.690+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a8804b3f0 con 0x7f5a8c0c0140 2023-05-10T01:21:29.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.908+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a8c047180 con 0x7f5a6c05ee70 2023-05-10T01:21:29.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.913+0000 7f5a79ffb700 1 -- 172.21.15.52:0/3836436496 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5a8c047180 con 0x7f5a6c05ee70 2023-05-10T01:21:29.920 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-05-10T01:21:29.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 msgr2=0x7f5a6c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 0x7f5a6c061330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5a7c009760 tx=0x7f5a7c017000).stop 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 msgr2=0x7f5a8c0adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f5a8800e900 tx=0x7f5a880090f0).stop 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 shutdown_connections 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a6c05ee70 0x7f5a6c061330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a8c153f80 0x7f5a8c0af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a8c0c0140 0x7f5a8c0adad0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 --2- 172.21.15.52:0/3836436496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a8c0c5cf0 0x7f5a8c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:29.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 >> 172.21.15.52:0/3836436496 conn(0x7f5a8c0cb5f0 msgr2=0x7f5a8c0c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:29.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 shutdown_connections 2023-05-10T01:21:29.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:29.917+0000 7f5a92ff7700 1 -- 172.21.15.52:0/3836436496 wait complete. 2023-05-10T01:21:29.935 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-05-10T01:21:29.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.936 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-05-10T01:21:29.952 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:29.952 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:29.953 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:29.953 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:29.953 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:29.953 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:29.955 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:29.955 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:29.955 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:29.955 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:29.956 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:29.956 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:29.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:29.957 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:30.024 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:30.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.025 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:30.085 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:30.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.086 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:30.153 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:30.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.154 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:30.215 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:30.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.215 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:30.276 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:30.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.277 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:30.337 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:30.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.337 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:30.397 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:30.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.398 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:30.458 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:30.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.459 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:30.519 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:30.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.520 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:30.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:30.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.581 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:30.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:30.644 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-05-10T01:21:30.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-05-10T01:21:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.877+0000 7f4519e5f700 1 Processor -- start 2023-05-10T01:21:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.877+0000 7f4519e5f700 1 -- start start 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 0x7f45140aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 0x7f4514069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4514153a90 0x7f4514153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140c8820 con 0x7f4514153a90 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140c8b00 con 0x7f45140c6100 2023-05-10T01:21:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4519e5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c8de0 con 0x7f45140c5d20 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4514153a90 0x7f4514153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4514153a90 0x7f4514153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32806/0 (socket says 172.21.15.52:32806) 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 -- 172.21.15.52:0/1226960514 learned_addr learned my addr 172.21.15.52:0/1226960514 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f45137fe700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 0x7f45140aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4512ffd700 1 --2- 172.21.15.52:0/1226960514 >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 0x7f4514069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 -- 172.21.15.52:0/1226960514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 msgr2=0x7f45140aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 0x7f45140aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 -- 172.21.15.52:0/1226960514 >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 msgr2=0x7f4514069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 --2- 172.21.15.52:0/1226960514 >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 0x7f4514069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4513fff700 1 -- 172.21.15.52:0/1226960514 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140c90c0 con 0x7f4514153a90 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f45137fe700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 0x7f45140aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.878+0000 7f4512ffd700 1 --2- 172.21.15.52:0/1226960514 >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 0x7f4514069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4513fff700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4514153a90 0x7f4514153f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4514083f20 tx=0x7f450c009840).ready entity=mon.0 client_cookie=1ee0983bdad316ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f45127fc700 1 -- 172.21.15.52:0/1226960514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00e070 con 0x7f4514153a90 2023-05-10T01:21:30.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f45127fc700 1 -- 172.21.15.52:0/1226960514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00ba50 con 0x7f4514153a90 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f45127fc700 1 -- 172.21.15.52:0/1226960514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00bdd0 con 0x7f4514153a90 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 -- 172.21.15.52:0/1226960514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4514153a90 msgr2=0x7f4514153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4514153a90 0x7f4514153f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4514083f20 tx=0x7f450c009840).stop 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 -- 172.21.15.52:0/1226960514 shutdown_connections 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4514153a90 0x7f4514153f20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 --2- 172.21.15.52:0/1226960514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45140c5d20 0x7f45140aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 --2- 172.21.15.52:0/1226960514 >> v2:172.21.15.172:3300/0 conn(0x7f45140c6100 0x7f4514069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 -- 172.21.15.52:0/1226960514 >> 172.21.15.52:0/1226960514 conn(0x7f45140cb6f0 msgr2=0x7f45140c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 -- 172.21.15.52:0/1226960514 shutdown_connections 2023-05-10T01:21:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.879+0000 7f4519e5f700 1 -- 172.21.15.52:0/1226960514 wait complete. 2023-05-10T01:21:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 Processor -- start 2023-05-10T01:21:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 -- start start 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 0x7f4514164220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4514153a90 0x7f45141518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514151450 con 0x7f45140c6100 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514153160 con 0x7f45140c5d20 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4519e5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514150560 con 0x7f4514153a90 2023-05-10T01:21:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4512ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4512ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32810/0 (socket says 172.21.15.52:32810) 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.881+0000 7f4512ffd700 1 -- 172.21.15.52:0/359647133 learned_addr learned my addr 172.21.15.52:0/359647133 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4513fff700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4514153a90 0x7f45141518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f45137fe700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 0x7f4514164220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 -- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4514153a90 msgr2=0x7f45141518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4514153a90 0x7f45141518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 -- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 msgr2=0x7f4514164220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 0x7f4514164220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 -- 172.21.15.52:0/359647133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009ae0 con 0x7f45140c6100 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f45137fe700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 0x7f4514164220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4512ffd700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f450800c880 tx=0x7f4508008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508010580 con 0x7f45140c6100 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080106e0 con 0x7f45140c6100 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514150840 con 0x7f45140c6100 2023-05-10T01:21:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508010a60 con 0x7f45140c6100 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.882+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514150e00 con 0x7f45140c6100 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.883+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4514151600 con 0x7f45140c6100 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.883+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f450801b460 con 0x7f45140c6100 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.884+0000 7f44fb7fe700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 0x7f44f4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.884+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f4508079ff0 con 0x7f45140c6100 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.884+0000 7f45137fe700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 0x7f44f4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.884+0000 7f45137fe700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 0x7f44f4061330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4504006fd0 tx=0x7f4504008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:30.888+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4514151600 con 0x7f45140c6100 2023-05-10T01:21:31.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.087+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f451406c340 con 0x7f44f405ee70 2023-05-10T01:21:31.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.091+0000 7f44fb7fe700 1 -- 172.21.15.52:0/359647133 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f451406c340 con 0x7f44f405ee70 2023-05-10T01:21:31.094 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-05-10T01:21:31.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 msgr2=0x7f44f4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 0x7f44f4061330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4504006fd0 tx=0x7f4504008040).stop 2023-05-10T01:21:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 msgr2=0x7f451414ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f450800c880 tx=0x7f4508008040).stop 2023-05-10T01:21:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 shutdown_connections 2023-05-10T01:21:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f44f405ee70 0x7f44f4061330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4514153a90 0x7f45141518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45140c5d20 0x7f4514164220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 --2- 172.21.15.52:0/359647133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45140c6100 0x7f451414ee00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 >> 172.21.15.52:0/359647133 conn(0x7f45140cb6f0 msgr2=0x7f45140aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 shutdown_connections 2023-05-10T01:21:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:31.093+0000 7f4519e5f700 1 -- 172.21.15.52:0/359647133 wait complete. 2023-05-10T01:21:31.108 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-05-10T01:21:31.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.109 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-05-10T01:21:31.126 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:31.126 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:31.126 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:31.127 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:31.128 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:31.128 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:31.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.129 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:31.189 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:31.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.190 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:31.250 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:31.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.251 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:31.311 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:31.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.312 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:31.373 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:31.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.374 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:31.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:31.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.437 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:31.497 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:31.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.498 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:31.557 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:31.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.558 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:31.617 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:31.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.618 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:31.679 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:31.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.679 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:31.747 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:31.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.749 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:31.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:31.811 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-05-10T01:21:31.875 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-05-10T01:21:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.037+0000 7f917b59e700 1 Processor -- start 2023-05-10T01:21:32.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.037+0000 7f917b59e700 1 -- start start 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f917c14c6f0 0x7f917c066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c064570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f917c064a60 0x7f917c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c067330 con 0x7f917c064a60 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c068150 con 0x7f917c14c6f0 2023-05-10T01:21:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c064ef0 con 0x7f917c152e80 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f917c064a60 0x7f917c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f917c064a60 0x7f917c1559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32818/0 (socket says 172.21.15.52:32818) 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 -- 172.21.15.52:0/2105180829 learned_addr learned my addr 172.21.15.52:0/2105180829 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f9179d9b700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917a59c700 1 --2- 172.21.15.52:0/2105180829 >> v2:172.21.15.172:3300/0 conn(0x7f917c14c6f0 0x7f917c066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 -- 172.21.15.52:0/2105180829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 msgr2=0x7f917c064570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c064570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 -- 172.21.15.52:0/2105180829 >> v2:172.21.15.172:3300/0 conn(0x7f917c14c6f0 msgr2=0x7f917c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 --2- 172.21.15.52:0/2105180829 >> v2:172.21.15.172:3300/0 conn(0x7f917c14c6f0 0x7f917c066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 -- 172.21.15.52:0/2105180829 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c153300 con 0x7f917c064a60 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.038+0000 7f917ad9d700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c064a60 0x7f917c1559b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f917c05fc40 tx=0x7f9174009840).ready entity=mon.0 client_cookie=fe92cc7a3515a22d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917959a700 1 -- 172.21.15.52:0/2105180829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400e070 con 0x7f917c064a60 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917959a700 1 -- 172.21.15.52:0/2105180829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400b970 con 0x7f917c064a60 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917959a700 1 -- 172.21.15.52:0/2105180829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400bcf0 con 0x7f917c064a60 2023-05-10T01:21:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 -- 172.21.15.52:0/2105180829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c064a60 msgr2=0x7f917c1559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c064a60 0x7f917c1559b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f917c05fc40 tx=0x7f9174009840).stop 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 -- 172.21.15.52:0/2105180829 shutdown_connections 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c064a60 0x7f917c1559b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 --2- 172.21.15.52:0/2105180829 >> v2:172.21.15.172:3300/0 conn(0x7f917c14c6f0 0x7f917c066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 --2- 172.21.15.52:0/2105180829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c064570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 -- 172.21.15.52:0/2105180829 >> 172.21.15.52:0/2105180829 conn(0x7f917c0c7a70 msgr2=0x7f917c0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 -- 172.21.15.52:0/2105180829 shutdown_connections 2023-05-10T01:21:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.039+0000 7f917b59e700 1 -- 172.21.15.52:0/2105180829 wait complete. 2023-05-10T01:21:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.040+0000 7f917b59e700 1 Processor -- start 2023-05-10T01:21:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.040+0000 7f917b59e700 1 -- start start 2023-05-10T01:21:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f917c064a60 0x7f917c133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c0370 con 0x7f917c14c6f0 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c133b80 con 0x7f917c064a60 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c161f60 con 0x7f917c152e80 2023-05-10T01:21:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f9179d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f9179d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32824/0 (socket says 172.21.15.52:32824) 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f9179d9b700 1 -- 172.21.15.52:0/2140778440 learned_addr learned my addr 172.21.15.52:0/2140778440 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917a59c700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f917c064a60 0x7f917c133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.041+0000 7f917ad9d700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 -- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 msgr2=0x7f917c162f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c162f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 -- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f917c064a60 msgr2=0x7f917c133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f917c064a60 0x7f917c133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 -- 172.21.15.52:0/2140778440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174009ae0 con 0x7f917c14c6f0 2023-05-10T01:21:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f9179d9b700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f917000e980 tx=0x7f9170009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012600 con 0x7f917c14c6f0 2023-05-10T01:21:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170012760 con 0x7f917c14c6f0 2023-05-10T01:21:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c0bea20 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170012ae0 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.042+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c0befe0 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.043+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c0bde10 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.043+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f9170022070 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.043+0000 7f916a7fc700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 0x7f9158061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.044+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f917007a2c0 con 0x7f917c14c6f0 2023-05-10T01:21:32.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.044+0000 7f917a59c700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 0x7f9158061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:32.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.044+0000 7f917a59c700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 0x7f9158061330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f917c0c6490 tx=0x7f916c009060).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:32.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.048+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f917004b480 con 0x7f917c14c6f0 2023-05-10T01:21:32.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.264+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f917c0a68a0 con 0x7f915805ee70 2023-05-10T01:21:32.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.267+0000 7f916a7fc700 1 -- 172.21.15.52:0/2140778440 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f917c0a68a0 con 0x7f915805ee70 2023-05-10T01:21:32.271 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-05-10T01:21:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 msgr2=0x7f9158061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 0x7f9158061330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f917c0c6490 tx=0x7f916c009060).stop 2023-05-10T01:21:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 msgr2=0x7f917c151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f917000e980 tx=0x7f9170009060).stop 2023-05-10T01:21:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 shutdown_connections 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f915805ee70 0x7f9158061330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f917c152e80 0x7f917c162f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f917c064a60 0x7f917c133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 --2- 172.21.15.52:0/2140778440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c14c6f0 0x7f917c151a50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 >> 172.21.15.52:0/2140778440 conn(0x7f917c0c7a70 msgr2=0x7f917c0c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 shutdown_connections 2023-05-10T01:21:32.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:32.269+0000 7f917b59e700 1 -- 172.21.15.52:0/2140778440 wait complete. 2023-05-10T01:21:32.284 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-05-10T01:21:32.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.285 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-05-10T01:21:32.301 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:32.302 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:32.303 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:32.303 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:32.303 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:32.303 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:32.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.304 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:32.364 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:32.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.365 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:32.425 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:32.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.426 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:32.487 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:32.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.488 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:32.548 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:32.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.549 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:32.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:32.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.610 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:32.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:32.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.671 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:32.735 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:32.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.737 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:32.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:32.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.805 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:32.867 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:32.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.868 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:32.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:32.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:32.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:32.992 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-05-10T01:21:33.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-05-10T01:21:33.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.218+0000 7f41f4950700 1 Processor -- start 2023-05-10T01:21:33.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.218+0000 7f41f4950700 1 -- start start 2023-05-10T01:21:33.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41f4950700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41f014fe80 0x7f41f00c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41f4950700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41f00c3120 0x7f41f00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41f4950700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00c3a80 con 0x7f41f014faa0 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41f4950700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00c1740 con 0x7f41f014fe80 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41f4950700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00c1a20 con 0x7f41f00c3120 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41ee59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41f014fe80 0x7f41f00c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41ee59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41f014fe80 0x7f41f00c27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32832/0 (socket says 172.21.15.52:32832) 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41ee59c700 1 -- 172.21.15.52:0/317013928 learned_addr learned my addr 172.21.15.52:0/317013928 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.219+0000 7f41ef59e700 1 --2- 172.21.15.52:0/317013928 >> v2:172.21.15.172:3300/0 conn(0x7f41f00c3120 0x7f41f00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41ee59c700 1 -- 172.21.15.52:0/317013928 >> v2:172.21.15.172:3300/0 conn(0x7f41f00c3120 msgr2=0x7f41f00c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41ee59c700 1 --2- 172.21.15.52:0/317013928 >> v2:172.21.15.172:3300/0 conn(0x7f41f00c3120 0x7f41f00c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41ee59c700 1 -- 172.21.15.52:0/317013928 >> v1:172.21.15.172:6789/0 conn(0x7f41f014faa0 legacy=0x7f41f00c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41ee59c700 1 -- 172.21.15.52:0/317013928 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00c1d00 con 0x7f41f014fe80 2023-05-10T01:21:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41ee59c700 1 --2- 172.21.15.52:0/317013928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00c27e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f41f00a9590 tx=0x7f41e40090f0).ready entity=mon.0 client_cookie=53813a0ac40fc46f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41edd9b700 1 -- 172.21.15.52:0/317013928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4010620 con 0x7f41f014fe80 2023-05-10T01:21:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41edd9b700 1 -- 172.21.15.52:0/317013928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4010780 con 0x7f41f014fe80 2023-05-10T01:21:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.220+0000 7f41edd9b700 1 -- 172.21.15.52:0/317013928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4010b00 con 0x7f41f014fe80 2023-05-10T01:21:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 -- 172.21.15.52:0/317013928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 msgr2=0x7f41f00c27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 --2- 172.21.15.52:0/317013928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00c27e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f41f00a9590 tx=0x7f41e40090f0).stop 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 -- 172.21.15.52:0/317013928 shutdown_connections 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 --2- 172.21.15.52:0/317013928 >> v2:172.21.15.172:3300/0 conn(0x7f41f00c3120 0x7f41f00c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 --2- 172.21.15.52:0/317013928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00c27e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 -- 172.21.15.52:0/317013928 >> 172.21.15.52:0/317013928 conn(0x7f41f0066e40 msgr2=0x7f41f0067250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 -- 172.21.15.52:0/317013928 shutdown_connections 2023-05-10T01:21:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.221+0000 7f41f4950700 1 -- 172.21.15.52:0/317013928 wait complete. 2023-05-10T01:21:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.223+0000 7f41f4950700 1 Processor -- start 2023-05-10T01:21:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.223+0000 7f41f4950700 1 -- start start 2023-05-10T01:21:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f00c3120 0x7f41f00a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 0x7f41f00aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00aab60 con 0x7f41f014fe80 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00be8b0 con 0x7f41f00c3120 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41f4950700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00bf430 con 0x7f41f014faa0 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.224+0000 7f41ef59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ef59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32838/0 (socket says 172.21.15.52:32838) 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ef59e700 1 -- 172.21.15.52:0/2540471005 learned_addr learned my addr 172.21.15.52:0/2540471005 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41eed9d700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f00c3120 0x7f41f00a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 0x7f41f00aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 -- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f00c3120 msgr2=0x7f41f00a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f00c3120 0x7f41f00a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 -- 172.21.15.52:0/2540471005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 msgr2=0x7f41f00aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 -- 172.21.15.52:0/2540471005 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009370 con 0x7f41f014faa0 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ef59e700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41ee59c700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 0x7f41f00aa180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f41e4015000 tx=0x7f41e4018000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.225+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4006a40 con 0x7f41f014faa0 2023-05-10T01:21:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.226+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e40108f0 con 0x7f41f014faa0 2023-05-10T01:21:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.226+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00beb00 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.226+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40196a0 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.226+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00bf0c0 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.227+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f0047150 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.227+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f41e402b070 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.228+0000 7f41d6ffd700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 0x7f41d0061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.228+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f41e407b3d0 con 0x7f41f014faa0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.228+0000 7f41eed9d700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 0x7f41d0061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.229+0000 7f41eed9d700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 0x7f41d0061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f41e0003900 tx=0x7f41e0007d40).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.233+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41e404c4a0 con 0x7f41f014faa0 2023-05-10T01:21:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.432+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f41f00bc660 con 0x7f41d005ee70 2023-05-10T01:21:33.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.436+0000 7f41d6ffd700 1 -- 172.21.15.52:0/2540471005 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f41f00bc660 con 0x7f41d005ee70 2023-05-10T01:21:33.440 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 msgr2=0x7f41d0061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 0x7f41d0061330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f41e0003900 tx=0x7f41e0007d40).stop 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 msgr2=0x7f41f00aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 0x7f41f00aa180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f41e4015000 tx=0x7f41e4018000).stop 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 shutdown_connections 2023-05-10T01:21:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f41d005ee70 0x7f41d0061330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f014fe80 0x7f41f00aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f00c3120 0x7f41f00a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 --2- 172.21.15.52:0/2540471005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41f014faa0 0x7f41f00aa180 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 >> 172.21.15.52:0/2540471005 conn(0x7f41f0066e40 msgr2=0x7f41f0068890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 shutdown_connections 2023-05-10T01:21:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:33.438+0000 7f41f4950700 1 -- 172.21.15.52:0/2540471005 wait complete. 2023-05-10T01:21:33.453 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-05-10T01:21:33.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.455 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-05-10T01:21:33.471 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:33.471 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:33.472 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:33.473 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:33.473 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:33.473 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:33.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.474 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:33.535 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:33.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.535 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:33.599 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:33.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.599 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:33.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:33.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.663 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:33.728 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:33.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.729 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:33.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:33.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.790 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:33.851 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:33.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.852 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:33.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:33.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.915 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:33.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:33.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:33.977 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:34.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:34.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.039 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:34.105 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:34.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.106 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:34.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.167 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-05-10T01:21:34.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-05-10T01:21:34.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.383+0000 7faa223b8700 1 Processor -- start 2023-05-10T01:21:34.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.383+0000 7faa223b8700 1 -- start start 2023-05-10T01:21:34.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa223b8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 0x7faa1c064f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa223b8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa1c065470 0x7faa1c154700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa223b8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c067620 con 0x7faa1c14e6d0 2023-05-10T01:21:34.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa223b8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c068ec0 con 0x7faa1c065470 2023-05-10T01:21:34.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa223b8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0658c0 con 0x7faa1c068a40 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa20955700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa1c065470 0x7faa1c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa1bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faa1c14e6d0 0x7faa1c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:44398/0 (socket says 172.21.15.52:44398) 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa1bfff700 1 -- 172.21.15.52:0/2793640805 learned_addr learned my addr 172.21.15.52:0/2793640805 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.384+0000 7faa13fff700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 0x7faa1c064f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa20955700 1 -- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 msgr2=0x7faa1c064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa20955700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 0x7faa1c064f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa20955700 1 -- 172.21.15.52:0/2793640805 >> v1:172.21.15.172:6789/0 conn(0x7faa1c14e6d0 legacy=0x7faa1c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa1b7fe700 1 -- 172.21.15.52:0/2793640805 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046178703 0 0) 0x7faa0c001110 con 0x7faa1c14e6d0 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa20955700 1 -- 172.21.15.52:0/2793640805 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c062420 con 0x7faa1c065470 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa13fff700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 0x7faa1c064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa20955700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c065470 0x7faa1c154700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faa14009e60 tx=0x7faa14009780).ready entity=mon.1 client_cookie=6dbe4eb59b4b59c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa1b7fe700 1 -- 172.21.15.52:0/2793640805 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400e070 con 0x7faa1c065470 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa1b7fe700 1 -- 172.21.15.52:0/2793640805 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400bb60 con 0x7faa1c065470 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa1b7fe700 1 -- 172.21.15.52:0/2793640805 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14012410 con 0x7faa1c065470 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 -- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c065470 msgr2=0x7faa1c154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c065470 0x7faa1c154700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faa14009e60 tx=0x7faa14009780).stop 2023-05-10T01:21:34.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 -- 172.21.15.52:0/2793640805 shutdown_connections 2023-05-10T01:21:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c065470 0x7faa1c154700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 --2- 172.21.15.52:0/2793640805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c068a40 0x7faa1c064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 -- 172.21.15.52:0/2793640805 >> 172.21.15.52:0/2793640805 conn(0x7faa1c0c4420 msgr2=0x7faa1c0c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 -- 172.21.15.52:0/2793640805 shutdown_connections 2023-05-10T01:21:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.385+0000 7faa223b8700 1 -- 172.21.15.52:0/2793640805 wait complete. 2023-05-10T01:21:34.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.386+0000 7faa223b8700 1 Processor -- start 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.386+0000 7faa223b8700 1 -- start start 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 0x7faa1c0aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 0x7faa1c163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0ab9c0 con 0x7faa1c068a40 2023-05-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0abca0 con 0x7faa1c14e6d0 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa223b8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0abf80 con 0x7faa1c065470 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa13fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa13fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32852/0 (socket says 172.21.15.52:32852) 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa13fff700 1 -- 172.21.15.52:0/103092847 learned_addr learned my addr 172.21.15.52:0/103092847 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa1bfff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 0x7faa1c0aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.387+0000 7faa20955700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 0x7faa1c163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 -- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 msgr2=0x7faa1c0aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 0x7faa1c0aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 -- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 msgr2=0x7faa1c163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 0x7faa1c163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 -- 172.21.15.52:0/103092847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040092a0 con 0x7faa1c068a40 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa1bfff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 0x7faa1c0aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa20955700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 0x7faa1c163cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:34.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa13fff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7faa0400ea20 tx=0x7faa04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400ee60 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400c850 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa14009a20 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400cbd0 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.388+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c0ab5d0 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.389+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c06c340 con 0x7faa1c068a40 2023-05-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.389+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7faa04022070 con 0x7faa1c068a40 2023-05-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.390+0000 7faa18ff9700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 0x7faa00061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.390+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7034+0+0 (secure 0 0 0) 0x7faa0407a360 con 0x7faa1c068a40 2023-05-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.390+0000 7faa1bfff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 0x7faa00061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.390+0000 7faa1bfff700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 0x7faa00061330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faa0c001d80 tx=0x7faa0c007a10).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.394+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa0404b5d0 con 0x7faa1c068a40 2023-05-10T01:21:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.617+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faa1c062700 con 0x7faa0005ee70 2023-05-10T01:21:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.621+0000 7faa18ff9700 1 -- 172.21.15.52:0/103092847 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7faa1c062700 con 0x7faa0005ee70 2023-05-10T01:21:34.625 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 msgr2=0x7faa00061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 0x7faa00061330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faa0c001d80 tx=0x7faa0c007a10).stop 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 msgr2=0x7faa1c0ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7faa0400ea20 tx=0x7faa04009060).stop 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 shutdown_connections 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0005ee70 0x7faa00061330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa1c14e6d0 0x7faa1c163cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa1c065470 0x7faa1c0aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 --2- 172.21.15.52:0/103092847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa1c068a40 0x7faa1c0ab0e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 >> 172.21.15.52:0/103092847 conn(0x7faa1c0c4420 msgr2=0x7faa1c0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 shutdown_connections 2023-05-10T01:21:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:34.623+0000 7faa223b8700 1 -- 172.21.15.52:0/103092847 wait complete. 2023-05-10T01:21:34.638 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-05-10T01:21:34.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.640 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-05-10T01:21:34.658 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:34.658 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:34.658 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:34.658 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:34.658 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:34.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:34.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.662 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:34.739 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:34.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.740 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:34.819 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:34.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.820 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:34.882 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:34.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.883 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:34.942 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:34.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:34.943 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:35.003 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:35.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.004 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:35.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:35.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.068 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:35.127 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:35.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.127 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:35.190 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:35.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.191 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:35.253 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:35.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.254 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:35.314 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:35.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.315 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:35.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.376 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-05-10T01:21:35.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-05-10T01:21:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.613+0000 7fb93ae27700 1 Processor -- start 2023-05-10T01:21:35.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.613+0000 7fb93ae27700 1 -- start start 2023-05-10T01:21:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb93ae27700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9340bc280 0x7fb934150370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb93ae27700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340bc760 con 0x7fb93414ff90 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb93ae27700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340bca40 con 0x7fb9340bd800 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb93ae27700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93406a500 con 0x7fb9340bc280 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb938bc3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb93414ff90 0x7fb934069df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41874/0 (socket says 172.21.15.52:41874) 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb938bc3700 1 -- 172.21.15.52:0/719994928 learned_addr learned my addr 172.21.15.52:0/719994928 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb933fff700 1 --2- 172.21.15.52:0/719994928 >> v2:172.21.15.172:3300/0 conn(0x7fb9340bc280 0x7fb934150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572452472 0 0) 0x7fb9340bc760 con 0x7fb93414ff90 2023-05-10T01:21:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9180033f0 con 0x7fb93414ff90 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588952857 0 0) 0x7fb9340bca40 con 0x7fb9340bd800 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.614+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9340bc760 con 0x7fb9340bd800 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb933fff700 1 -- 172.21.15.52:0/719994928 >> v1:172.21.15.172:6789/0 conn(0x7fb9340bd800 legacy=0x7fb934153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb933fff700 1 -- 172.21.15.52:0/719994928 >> v1:172.21.15.52:6789/0 conn(0x7fb93414ff90 legacy=0x7fb934069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb933fff700 1 -- 172.21.15.52:0/719994928 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340bcd20 con 0x7fb9340bc280 2023-05-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb933fff700 1 --2- 172.21.15.52:0/719994928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb934150370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb920009790 tx=0x7fb920009060).ready entity=mon.1 client_cookie=5c4c3d6fb17b77a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000d4a0 con 0x7fb9340bc280 2023-05-10T01:21:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000d600 con 0x7fb9340bc280 2023-05-10T01:21:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb9337fe700 1 -- 172.21.15.52:0/719994928 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000d980 con 0x7fb9340bc280 2023-05-10T01:21:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb93ae27700 1 -- 172.21.15.52:0/719994928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 msgr2=0x7fb934150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb93ae27700 1 --2- 172.21.15.52:0/719994928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb934150370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb920009790 tx=0x7fb920009060).stop 2023-05-10T01:21:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb93ae27700 1 -- 172.21.15.52:0/719994928 shutdown_connections 2023-05-10T01:21:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb93ae27700 1 --2- 172.21.15.52:0/719994928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb934150370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.615+0000 7fb93ae27700 1 -- 172.21.15.52:0/719994928 >> 172.21.15.52:0/719994928 conn(0x7fb9340c4610 msgr2=0x7fb934066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.616+0000 7fb93ae27700 1 -- 172.21.15.52:0/719994928 shutdown_connections 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.616+0000 7fb93ae27700 1 -- 172.21.15.52:0/719994928 wait complete. 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.617+0000 7fb93ae27700 1 Processor -- start 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.617+0000 7fb93ae27700 1 -- start start 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb93413a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb93414ff90 0x7fb9340c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340c0f50 con 0x7fb9340bd800 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340bf9d0 con 0x7fb9340bc280 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb93ae27700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93413a8d0 con 0x7fb93414ff90 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb938bc3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb93413a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32866/0 (socket says 172.21.15.52:32866) 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 -- 172.21.15.52:0/3805777265 learned_addr learned my addr 172.21.15.52:0/3805777265 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb9393c4700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb93414ff90 0x7fb9340c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 -- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb93414ff90 msgr2=0x7fb9340c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb93414ff90 0x7fb9340c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 -- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 msgr2=0x7fb93413a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb93413a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb933fff700 1 -- 172.21.15.52:0/3805777265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200092a0 con 0x7fb9340bd800 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.618+0000 7fb938bc3700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb93413a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb933fff700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb920009d80 tx=0x7fb920016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000dcf0 con 0x7fb9340bd800 2023-05-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000de50 con 0x7fb9340bd800 2023-05-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92001d430 con 0x7fb9340bd800 2023-05-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9340bedc0 con 0x7fb9340bd800 2023-05-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.619+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9340bf380 con 0x7fb9340bd800 2023-05-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.620+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93406c340 con 0x7fb9340bd800 2023-05-10T01:21:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.620+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fb92000f070 con 0x7fb9340bd800 2023-05-10T01:21:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.621+0000 7fb930ff9700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 0x7fb91c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.621+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7590+0+0 (secure 0 0 0) 0x7fb92007b730 con 0x7fb9340bd800 2023-05-10T01:21:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.621+0000 7fb938bc3700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 0x7fb91c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.622+0000 7fb938bc3700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 0x7fb91c061300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb928005750 tx=0x7fb928007c80).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.625+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb92004c6f0 con 0x7fb9340bd800 2023-05-10T01:21:35.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.835+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9340bc060 con 0x7fb91c05ee40 2023-05-10T01:21:35.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.839+0000 7fb930ff9700 1 -- 172.21.15.52:0/3805777265 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fb9340bc060 con 0x7fb91c05ee40 2023-05-10T01:21:35.843 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-05-10T01:21:35.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 msgr2=0x7fb91c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 0x7fb91c061300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb928005750 tx=0x7fb928007c80).stop 2023-05-10T01:21:35.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 msgr2=0x7fb9340c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:35.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb920009d80 tx=0x7fb920016000).stop 2023-05-10T01:21:35.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 shutdown_connections 2023-05-10T01:21:35.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb91c05ee40 0x7fb91c061300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb93414ff90 0x7fb9340c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9340bc280 0x7fb93413a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 --2- 172.21.15.52:0/3805777265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9340bd800 0x7fb9340c0570 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:35.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.842+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 >> 172.21.15.52:0/3805777265 conn(0x7fb9340c4610 msgr2=0x7fb934148c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.843+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 shutdown_connections 2023-05-10T01:21:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:35.843+0000 7fb93ae27700 1 -- 172.21.15.52:0/3805777265 wait complete. 2023-05-10T01:21:35.866 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-05-10T01:21:35.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.867 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-05-10T01:21:35.887 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:35.887 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:35.888 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:35.888 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:35.888 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:35.888 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:35.889 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:35.890 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:35.890 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:35.891 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:35.891 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:35.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.893 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:35.951 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:35.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:35.951 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:36.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:36.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.013 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:36.074 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:36.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.075 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:36.135 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:36.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.136 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:36.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:36.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.197 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:36.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:36.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.261 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:36.322 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:36.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.322 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:36.386 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:36.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.388 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:36.446 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:36.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.447 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:36.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.529 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-05-10T01:21:36.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-05-10T01:21:36.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.765+0000 7fde82716700 1 Processor -- start 2023-05-10T01:21:36.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 -- start start 2023-05-10T01:21:36.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde7c0c5d20 0x7fde7c0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fde7c0c6100 0x7fde7c069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c154610 con 0x7fde7c153a90 2023-05-10T01:21:36.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0ca5f0 con 0x7fde7c0c5d20 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde82716700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0c8820 con 0x7fde7c0c6100 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.766+0000 7fde7bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde7c0c5d20 0x7fde7c0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde7c0c5d20 0x7fde7c0aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32872/0 (socket says 172.21.15.52:32872) 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 -- 172.21.15.52:0/3044177597 learned_addr learned my addr 172.21.15.52:0/3044177597 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7b7fe700 1 --2- 172.21.15.52:0/3044177597 >> v2:172.21.15.172:3300/0 conn(0x7fde7c0c6100 0x7fde7c069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 -- 172.21.15.52:0/3044177597 >> v2:172.21.15.172:3300/0 conn(0x7fde7c0c6100 msgr2=0x7fde7c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 --2- 172.21.15.52:0/3044177597 >> v2:172.21.15.172:3300/0 conn(0x7fde7c0c6100 0x7fde7c069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 -- 172.21.15.52:0/3044177597 >> v1:172.21.15.172:6789/0 conn(0x7fde7c153a90 legacy=0x7fde7c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 -- 172.21.15.52:0/3044177597 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0c8b00 con 0x7fde7c0c5d20 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7bfff700 1 --2- 172.21.15.52:0/3044177597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0aa200 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fde7c0c6780 tx=0x7fde6c0090f0).ready entity=mon.0 client_cookie=ba68c51b7f28d8d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7affd700 1 -- 172.21.15.52:0/3044177597 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00b520 con 0x7fde7c0c5d20 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7affd700 1 -- 172.21.15.52:0/3044177597 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00b680 con 0x7fde7c0c5d20 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.767+0000 7fde7affd700 1 -- 172.21.15.52:0/3044177597 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00ba00 con 0x7fde7c0c5d20 2023-05-10T01:21:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 -- 172.21.15.52:0/3044177597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c5d20 msgr2=0x7fde7c0aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 --2- 172.21.15.52:0/3044177597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0aa200 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fde7c0c6780 tx=0x7fde6c0090f0).stop 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 -- 172.21.15.52:0/3044177597 shutdown_connections 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 --2- 172.21.15.52:0/3044177597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0aa200 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 --2- 172.21.15.52:0/3044177597 >> v2:172.21.15.172:3300/0 conn(0x7fde7c0c6100 0x7fde7c069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 -- 172.21.15.52:0/3044177597 >> 172.21.15.52:0/3044177597 conn(0x7fde7c0cb6f0 msgr2=0x7fde7c0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 -- 172.21.15.52:0/3044177597 shutdown_connections 2023-05-10T01:21:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.768+0000 7fde82716700 1 -- 172.21.15.52:0/3044177597 wait complete. 2023-05-10T01:21:36.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.769+0000 7fde82716700 1 Processor -- start 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.769+0000 7fde82716700 1 -- start start 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde7c153a90 0x7fde7c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c157b10 con 0x7fde7c0c6100 2023-05-10T01:21:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c156c20 con 0x7fde7c0c5d20 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c156f00 con 0x7fde7c153a90 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32880/0 (socket says 172.21.15.52:32880) 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 -- 172.21.15.52:0/3625872545 learned_addr learned my addr 172.21.15.52:0/3625872545 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7bfff700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde80cb3700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde7c153a90 0x7fde7c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 -- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde7c153a90 msgr2=0x7fde7c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde7c153a90 0x7fde7c0aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 -- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7c0c5d20 msgr2=0x7fde7c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 -- 172.21.15.52:0/3625872545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009370 con 0x7fde7c0c6100 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde7b7fe700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fde7000e930 tx=0x7fde70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000c670 con 0x7fde7c0c6100 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000c7d0 con 0x7fde7c0c6100 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c1571e0 con 0x7fde7c0c6100 2023-05-10T01:21:36.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000cb50 con 0x7fde7c0c6100 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.770+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c1577a0 con 0x7fde7c0c6100 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.771+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c066720 con 0x7fde7c0c6100 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.772+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fde70022070 con 0x7fde7c0c6100 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.772+0000 7fde63fff700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 0x7fde5c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.772+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fde7007a300 con 0x7fde7c0c6100 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.772+0000 7fde7bfff700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 0x7fde5c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:36.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.773+0000 7fde7bfff700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 0x7fde5c061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fde6c009130 tx=0x7fde6c017000).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:36.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.776+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde7004b4c0 con 0x7fde7c0c6100 2023-05-10T01:21:36.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.974+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde7c0c8de0 con 0x7fde5c05ee70 2023-05-10T01:21:36.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.978+0000 7fde63fff700 1 -- 172.21.15.52:0/3625872545 <== mgr.4796 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fde7c0c8de0 con 0x7fde5c05ee70 2023-05-10T01:21:36.984 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-05-10T01:21:36.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 msgr2=0x7fde5c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 0x7fde5c061330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fde6c009130 tx=0x7fde6c017000).stop 2023-05-10T01:21:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 msgr2=0x7fde7c14afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fde7000e930 tx=0x7fde70009060).stop 2023-05-10T01:21:36.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 shutdown_connections 2023-05-10T01:21:36.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ee70 0x7fde5c061330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde7c153a90 0x7fde7c0aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7c0c5d20 0x7fde7c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 --2- 172.21.15.52:0/3625872545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c6100 0x7fde7c14afc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:36.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.979+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 >> 172.21.15.52:0/3625872545 conn(0x7fde7c0cb6f0 msgr2=0x7fde7c0a9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:36.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.980+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 shutdown_connections 2023-05-10T01:21:36.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:36.980+0000 7fde82716700 1 -- 172.21.15.52:0/3625872545 wait complete. 2023-05-10T01:21:36.995 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-05-10T01:21:36.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:36.996 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-05-10T01:21:37.013 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:37.013 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:37.013 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:37.013 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:37.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:37.015 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:37.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_11_00_UTC 2023-05-10T01:21:37.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.016 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_11_00_UTC) 2023-05-10T01:21:37.076 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_12_00_UTC 2023-05-10T01:21:37.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.077 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_12_00_UTC) 2023-05-10T01:21:37.137 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_13_00_UTC 2023-05-10T01:21:37.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.138 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_13_00_UTC) 2023-05-10T01:21:37.199 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_14_00_UTC 2023-05-10T01:21:37.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.200 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_14_00_UTC) 2023-05-10T01:21:37.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_15_00_UTC 2023-05-10T01:21:37.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.261 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_15_00_UTC) 2023-05-10T01:21:37.321 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_16_00_UTC 2023-05-10T01:21:37.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.322 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_16_00_UTC) 2023-05-10T01:21:37.382 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_17_00_UTC 2023-05-10T01:21:37.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.383 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_17_00_UTC) 2023-05-10T01:21:37.443 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_18_00_UTC 2023-05-10T01:21:37.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.444 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_18_00_UTC) 2023-05-10T01:21:37.530 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_19_00_UTC 2023-05-10T01:21:37.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.532 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_19_00_UTC) 2023-05-10T01:21:37.554 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_20_00_UTC 2023-05-10T01:21:37.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.555 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_20_00_UTC) 2023-05-10T01:21:37.624 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_21_00_UTC 2023-05-10T01:21:37.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.625 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-05-10-01_21_00_UTC) 2023-05-10T01:21:37.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:37.687 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-05-10T01:21:37.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:21:37.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.903+0000 7f692be50700 1 Processor -- start 2023-05-10T01:21:37.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.903+0000 7f692be50700 1 -- start start 2023-05-10T01:21:37.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692be50700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6924154080 0x7f69240aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692be50700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6924154460 0x7f69240a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692be50700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240c94c0 con 0x7f69240aa140 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692be50700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240aa590 con 0x7f6924154460 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692be50700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240cb7d0 con 0x7f6924154080 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f69293eb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6924154460 0x7f69240a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692a3ed700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f69240aa140 0x7f6924068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41906/0 (socket says 172.21.15.52:41906) 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f692a3ed700 1 -- 172.21.15.52:0/3606430185 learned_addr learned my addr 172.21.15.52:0/3606430185 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.904+0000 7f6929bec700 1 --2- 172.21.15.52:0/3606430185 >> v2:172.21.15.172:3300/0 conn(0x7f6924154080 0x7f69240aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f69293eb700 1 -- 172.21.15.52:0/3606430185 >> v2:172.21.15.172:3300/0 conn(0x7f6924154080 msgr2=0x7f69240aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f69293eb700 1 --2- 172.21.15.52:0/3606430185 >> v2:172.21.15.172:3300/0 conn(0x7f6924154080 0x7f69240aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f69293eb700 1 -- 172.21.15.52:0/3606430185 >> v1:172.21.15.52:6789/0 conn(0x7f69240aa140 legacy=0x7f6924068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f69293eb700 1 -- 172.21.15.52:0/3606430185 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240c88b0 con 0x7f6924154460 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f6928bea700 1 -- 172.21.15.52:0/3606430185 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532529432 0 0) 0x7f69240c94c0 con 0x7f69240aa140 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f69293eb700 1 --2- 172.21.15.52:0/3606430185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154460 0x7f69240a9c50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f692406bd00 tx=0x7f6918009060).ready entity=mon.0 client_cookie=b3ad64f92acd6078 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:37.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f6928bea700 1 -- 172.21.15.52:0/3606430185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800f510 con 0x7f6924154460 2023-05-10T01:21:37.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f6928bea700 1 -- 172.21.15.52:0/3606430185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800f670 con 0x7f6924154460 2023-05-10T01:21:37.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f6928bea700 1 -- 172.21.15.52:0/3606430185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800f9f0 con 0x7f6924154460 2023-05-10T01:21:37.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 -- 172.21.15.52:0/3606430185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154460 msgr2=0x7f69240a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:37.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 --2- 172.21.15.52:0/3606430185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154460 0x7f69240a9c50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f692406bd00 tx=0x7f6918009060).stop 2023-05-10T01:21:37.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 -- 172.21.15.52:0/3606430185 shutdown_connections 2023-05-10T01:21:37.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 --2- 172.21.15.52:0/3606430185 >> v2:172.21.15.172:3300/0 conn(0x7f6924154080 0x7f69240aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:37.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 --2- 172.21.15.52:0/3606430185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154460 0x7f69240a9c50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.905+0000 7f692be50700 1 -- 172.21.15.52:0/3606430185 >> 172.21.15.52:0/3606430185 conn(0x7f6924067910 msgr2=0x7f69240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.906+0000 7f692be50700 1 -- 172.21.15.52:0/3606430185 shutdown_connections 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.906+0000 7f692be50700 1 -- 172.21.15.52:0/3606430185 wait complete. 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 Processor -- start 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 -- start start 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f69240aa140 0x7f692413e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6924154460 0x7f69240c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c0560 con 0x7f6924154080 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692413edc0 con 0x7f6924154460 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.907+0000 7f692be50700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c4a80 con 0x7f69240aa140 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32892/0 (socket says 172.21.15.52:32892) 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 -- 172.21.15.52:0/713702831 learned_addr learned my addr 172.21.15.52:0/713702831 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f692a3ed700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6924154460 0x7f69240c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f6929bec700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f69240aa140 0x7f692413e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 -- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f69240aa140 msgr2=0x7f692413e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f69240aa140 0x7f692413e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 -- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6924154460 msgr2=0x7f69240c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:37.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6924154460 0x7f69240c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:37.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 -- 172.21.15.52:0/713702831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180092a0 con 0x7f6924154080 2023-05-10T01:21:37.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f69293eb700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f6918009dd0 tx=0x7f6918017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:37.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800f9f0 con 0x7f6924154080 2023-05-10T01:21:37.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918000c90 con 0x7f6924154080 2023-05-10T01:21:37.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240c4d60 con 0x7f6924154080 2023-05-10T01:21:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691801b690 con 0x7f6924154080 2023-05-10T01:21:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.908+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240adbd0 con 0x7f6924154080 2023-05-10T01:21:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.909+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924066720 con 0x7f6924154080 2023-05-10T01:21:37.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.910+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 10) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f691800f070 con 0x7f6924154080 2023-05-10T01:21:37.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.910+0000 7f6921ffb700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 0x7f6904061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:37.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.910+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f691807b520 con 0x7f6924154080 2023-05-10T01:21:37.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.910+0000 7f6929bec700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 0x7f6904061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:37.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.911+0000 7f6929bec700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 0x7f6904061330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f691c009bc0 tx=0x7f691c008040).ready entity=mgr.4796 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:37.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:37.914+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f691804c7b0 con 0x7f6924154080 2023-05-10T01:21:38.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.145+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f692406c340 con 0x7f6924154080 2023-05-10T01:21:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.709+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f6918079060 con 0x7f6924154080 2023-05-10T01:21:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.710+0000 7f6921ffb700 1 -- 172.21.15.52:0/713702831 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f69180424b0 con 0x7f6924154080 2023-05-10T01:21:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.712+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 msgr2=0x7f6904061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.712+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 0x7f6904061330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f691c009bc0 tx=0x7f691c008040).stop 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.712+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 msgr2=0x7f69240bfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.712+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f6918009dd0 tx=0x7f6918017000).stop 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 shutdown_connections 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f690405ee70 0x7f6904061330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6924154460 0x7f69240c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f69240aa140 0x7f692413e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 --2- 172.21.15.52:0/713702831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6924154080 0x7f69240bfb80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 >> 172.21.15.52:0/713702831 conn(0x7f6924067910 msgr2=0x7f69240c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 shutdown_connections 2023-05-10T01:21:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:38.713+0000 7f692be50700 1 -- 172.21.15.52:0/713702831 wait complete. 2023-05-10T01:21:38.734 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:21:38.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:21:38.774 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:21:38.801 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:21:38.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:21:38.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:21:38.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:21:38.861 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:38.857+0000 7f1115dd4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:21:38.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:21:38.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:21:38.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:21:38.873 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:38.870+0000 7f96ac8ec680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:21:38.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:38.931 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:38.929+0000 7f1115dd4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:21:38.945 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:38.941+0000 7f96ac8ec680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:21:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 Processor -- start 2023-05-10T01:21:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 -- start start 2023-05-10T01:21:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f245c151d80 0x7f245c156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f245c155ae0 0x7f245c155f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0bbb40 con 0x7f245c152160 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c156460 con 0x7f245c151d80 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.045+0000 7f2462580700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0662d0 con 0x7f245c155ae0 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f245c151d80 0x7f245c156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f245c152160 0x7f245c065bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41962/0 (socket says 172.21.15.52:41962) 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245b7fe700 1 -- 172.21.15.52:0/1691087891 learned_addr learned my addr 172.21.15.52:0/1691087891 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f2460b1d700 1 --2- 172.21.15.52:0/1691087891 >> v2:172.21.15.172:3300/0 conn(0x7f245c155ae0 0x7f245c155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245affd700 1 -- 172.21.15.52:0/1691087891 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668399706 0 0) 0x7f245c0bbb40 con 0x7f245c152160 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245affd700 1 -- 172.21.15.52:0/1691087891 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24480033f0 con 0x7f245c152160 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 -- 172.21.15.52:0/1691087891 >> v2:172.21.15.172:3300/0 conn(0x7f245c155ae0 msgr2=0x7f245c155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 --2- 172.21.15.52:0/1691087891 >> v2:172.21.15.172:3300/0 conn(0x7f245c155ae0 0x7f245c155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 -- 172.21.15.52:0/1691087891 >> v1:172.21.15.52:6789/0 conn(0x7f245c152160 legacy=0x7f245c065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 -- 172.21.15.52:0/1691087891 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0c2940 con 0x7f245c151d80 2023-05-10T01:21:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245bfff700 1 --2- 172.21.15.52:0/1691087891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c151d80 0x7f245c156690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f245c0c3210 tx=0x7f244c009060).ready entity=mon.0 client_cookie=c87d2b2b0148d992 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245affd700 1 -- 172.21.15.52:0/1691087891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00d4a0 con 0x7f245c151d80 2023-05-10T01:21:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245affd700 1 -- 172.21.15.52:0/1691087891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00d600 con 0x7f245c151d80 2023-05-10T01:21:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.046+0000 7f245affd700 1 -- 172.21.15.52:0/1691087891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00d980 con 0x7f245c151d80 2023-05-10T01:21:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 -- 172.21.15.52:0/1691087891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c151d80 msgr2=0x7f245c156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 --2- 172.21.15.52:0/1691087891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c151d80 0x7f245c156690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f245c0c3210 tx=0x7f244c009060).stop 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 -- 172.21.15.52:0/1691087891 shutdown_connections 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 --2- 172.21.15.52:0/1691087891 >> v2:172.21.15.172:3300/0 conn(0x7f245c155ae0 0x7f245c155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 --2- 172.21.15.52:0/1691087891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c151d80 0x7f245c156690 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 -- 172.21.15.52:0/1691087891 >> 172.21.15.52:0/1691087891 conn(0x7f245c0c7340 msgr2=0x7f245c0c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 -- 172.21.15.52:0/1691087891 shutdown_connections 2023-05-10T01:21:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.047+0000 7f2462580700 1 -- 172.21.15.52:0/1691087891 wait complete. 2023-05-10T01:21:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.048+0000 7f2462580700 1 Processor -- start 2023-05-10T01:21:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.048+0000 7f2462580700 1 -- start start 2023-05-10T01:21:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 0x7f245c0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f245c155ae0 0x7f245c146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0684f0 con 0x7f245c152160 2023-05-10T01:21:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0ab1c0 con 0x7f245c151d80 2023-05-10T01:21:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2462580700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0a4ec0 con 0x7f245c155ae0 2023-05-10T01:21:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32952/0 (socket says 172.21.15.52:32952) 2023-05-10T01:21:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 -- 172.21.15.52:0/3959330799 learned_addr learned my addr 172.21.15.52:0/3959330799 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245bfff700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 0x7f245c0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f2460b1d700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f245c155ae0 0x7f245c146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f245c155ae0 msgr2=0x7f245c146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f245c155ae0 0x7f245c146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 msgr2=0x7f245c0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 0x7f245c0a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 -- 172.21.15.52:0/3959330799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0092a0 con 0x7f245c152160 2023-05-10T01:21:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245bfff700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 0x7f245c0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.049+0000 7f245b7fe700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f245000c4c0 tx=0x7f2450007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.050+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000ce70 con 0x7f245c152160 2023-05-10T01:21:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.050+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500072e0 con 0x7f245c152160 2023-05-10T01:21:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.050+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0a51a0 con 0x7f245c152160 2023-05-10T01:21:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.050+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500057a0 con 0x7f245c152160 2023-05-10T01:21:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.050+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c0a5760 con 0x7f245c152160 2023-05-10T01:21:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.051+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c0aaf90 con 0x7f245c152160 2023-05-10T01:21:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.051+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2450010070 con 0x7f245c152160 2023-05-10T01:21:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.051+0000 7f2443fff700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 0x7f243c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.051+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f2450079590 con 0x7f245c152160 2023-05-10T01:21:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.052+0000 7f245bfff700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 msgr2=0x7f243c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.052+0000 7f245bfff700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 0x7f243c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.056+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f245004a730 con 0x7f245c152160 2023-05-10T01:21:39.207 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:39.204+0000 7f1115dd4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:21:39.249 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:39.246+0000 7f96ac8ec680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:21:39.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.253+0000 7f245bfff700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 msgr2=0x7f243c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:39.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.253+0000 7f245bfff700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 0x7f243c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:39.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.288+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f245c0c2c20 con 0x7f245c152160 2023-05-10T01:21:39.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.288+0000 7f2443fff700 1 -- 172.21.15.52:0/3959330799 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f245004dd50 con 0x7f245c152160 2023-05-10T01:21:39.292 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:39.292 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:21:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 msgr2=0x7f243c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 0x7f243c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 msgr2=0x7f245c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f245000c4c0 tx=0x7f2450007c50).stop 2023-05-10T01:21:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 shutdown_connections 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f243c05ee20 0x7f243c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f245c155ae0 0x7f245c146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245c151d80 0x7f245c0a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 --2- 172.21.15.52:0/3959330799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f245c152160 0x7f245c069f50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 >> 172.21.15.52:0/3959330799 conn(0x7f245c0c7340 msgr2=0x7f245c0a8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 shutdown_connections 2023-05-10T01:21:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.290+0000 7f2462580700 1 -- 172.21.15.52:0/3959330799 wait complete. 2023-05-10T01:21:39.296 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:21:39.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 Processor -- start 2023-05-10T01:21:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 -- start start 2023-05-10T01:21:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154540 0x7f8a6c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0c0650 con 0x7f8a6c154160 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c06a010 con 0x7f8a6c069b80 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.461+0000 7f8a71d5b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0bfd20 con 0x7f8a6c154540 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32992/0 (socket says 172.21.15.52:32992) 2023-05-10T01:21:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8a6c154160 0x7f8a6c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42004/0 (socket says 172.21.15.52:42004) 2023-05-10T01:21:39.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 -- 172.21.15.52:0/2576446707 learned_addr learned my addr 172.21.15.52:0/2576446707 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:39.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6affd700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154540 0x7f8a6c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 -- 172.21.15.52:0/2576446707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154540 msgr2=0x7f8a6c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154540 0x7f8a6c069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 -- 172.21.15.52:0/2576446707 >> v1:172.21.15.52:6789/0 conn(0x7f8a6c154160 legacy=0x7f8a6c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6a7fc700 1 -- 172.21.15.52:0/2576446707 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167795282 0 0) 0x7f8a6c0c0650 con 0x7f8a6c154160 2023-05-10T01:21:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 -- 172.21.15.52:0/2576446707 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0c0000 con 0x7f8a6c069b80 2023-05-10T01:21:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6bfff700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f8a64009f20 tx=0x7f8a64009840).ready entity=mon.0 client_cookie=c342e0b5aa552dbe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6a7fc700 1 -- 172.21.15.52:0/2576446707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400e070 con 0x7f8a6c069b80 2023-05-10T01:21:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6a7fc700 1 -- 172.21.15.52:0/2576446707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400b9d0 con 0x7f8a6c069b80 2023-05-10T01:21:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.462+0000 7f8a6a7fc700 1 -- 172.21.15.52:0/2576446707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400bd50 con 0x7f8a6c069b80 2023-05-10T01:21:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 -- 172.21.15.52:0/2576446707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 msgr2=0x7f8a6c0c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f8a64009f20 tx=0x7f8a64009840).stop 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 -- 172.21.15.52:0/2576446707 shutdown_connections 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c0c0ae0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/2576446707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154540 0x7f8a6c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 -- 172.21.15.52:0/2576446707 >> 172.21.15.52:0/2576446707 conn(0x7f8a6c0cb6f0 msgr2=0x7f8a6c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 -- 172.21.15.52:0/2576446707 shutdown_connections 2023-05-10T01:21:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.463+0000 7f8a71d5b700 1 -- 172.21.15.52:0/2576446707 wait complete. 2023-05-10T01:21:39.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.464+0000 7f8a71d5b700 1 Processor -- start 2023-05-10T01:21:39.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.464+0000 7f8a71d5b700 1 -- start start 2023-05-10T01:21:39.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154160 0x7f8a6c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a6c154540 0x7f8a6c068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c153570 con 0x7f8a6c069b80 2023-05-10T01:21:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c150dc0 con 0x7f8a6c154540 2023-05-10T01:21:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a71d5b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c148770 con 0x7f8a6c154160 2023-05-10T01:21:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32994/0 (socket says 172.21.15.52:32994) 2023-05-10T01:21:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 -- 172.21.15.52:0/1395556694 learned_addr learned my addr 172.21.15.52:0/1395556694 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6affd700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154160 0x7f8a6c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6bfff700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a6c154540 0x7f8a6c068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 -- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154160 msgr2=0x7f8a6c0c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154160 0x7f8a6c0c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 -- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a6c154540 msgr2=0x7f8a6c068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a6c154540 0x7f8a6c068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.465+0000 7f8a6b7fe700 1 -- 172.21.15.52:0/1395556694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009ae0 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a6b7fe700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f8a5c00c560 tx=0x7f8a5c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0072e0 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c007440 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c0c42f0 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0058f0 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.466+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c150a50 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c0666b0 con 0x7f8a6c069b80 2023-05-10T01:21:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f8a5c010070 con 0x7f8a6c069b80 2023-05-10T01:21:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a537fe700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 0x7f8a4c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a6affd700 1 -- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 msgr2=0x7f8a4c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f8a5c079540 con 0x7f8a6c069b80 2023-05-10T01:21:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.467+0000 7f8a6affd700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 0x7f8a4c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.472+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a5c04a6e0 con 0x7f8a6c069b80 2023-05-10T01:21:39.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.652+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a6c06c340 con 0x7f8a6c069b80 2023-05-10T01:21:39.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.653+0000 7f8a537fe700 1 -- 172.21.15.52:0/1395556694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18277 (secure 0 0 0) 0x7f8a5c04dd00 con 0x7f8a6c069b80 2023-05-10T01:21:39.657 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:39.657 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":49,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:39.483702+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":219,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:6832/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3349551008":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3297537909":"2023-05-11T01:10:52.178304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":7,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":16,"length":2},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":26,"length":2},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":36,"length":2},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":46,"length":2},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":56,"length":2},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":66,"length":2},{"begin":69,"length":2},{"begin":72,"length":2},{"begin":76,"length":2},{"begin":79,"length":2},{"begin":82,"length":2},{"begin":86,"length":2},{"begin":89,"length":2},{"begin":92,"length":2},{"begin":96,"length":2},{"begin":99,"length":2},{"begin":102,"length":2},{"begin":105,"length":3},{"begin":109,"length":2},{"begin":154,"length":66}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":219,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:39.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 msgr2=0x7f8a4c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:39.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 0x7f8a4c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 msgr2=0x7f8a6c148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f8a5c00c560 tx=0x7f8a5c007c90).stop 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 shutdown_connections 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8a4c05ee20 0x7f8a4c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a6c154540 0x7f8a6c068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a6c069b80 0x7f8a6c148280 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 --2- 172.21.15.52:0/1395556694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a6c154160 0x7f8a6c0c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 >> 172.21.15.52:0/1395556694 conn(0x7f8a6c0cb6f0 msgr2=0x7f8a6c0ab640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:39.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 shutdown_connections 2023-05-10T01:21:39.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.655+0000 7f8a71d5b700 1 -- 172.21.15.52:0/1395556694 wait complete. 2023-05-10T01:21:39.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:10:38.160449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:10:38.948072+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 219, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:21:39.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:21:39.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.792+0000 7f361e915700 1 Processor -- start 2023-05-10T01:21:39.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.792+0000 7f361e915700 1 -- start start 2023-05-10T01:21:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361e915700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 0x7f36180aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361e915700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361e915700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180c94c0 con 0x7f3618154460 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361e915700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180cb7d0 con 0x7f3618154080 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361e915700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618068a90 con 0x7f3618068150 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f3617fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 0x7f36180aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361ceb2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f3617fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 0x7f36180aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:59558/0 (socket says 172.21.15.52:59558) 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f3617fff700 1 -- 172.21.15.52:0/426427854 learned_addr learned my addr 172.21.15.52:0/426427854 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.793+0000 7f361ceb2700 1 --2- 172.21.15.52:0/426427854 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:52642/0 (socket says 172.21.15.52:52642) 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f361ceb2700 1 -- 172.21.15.52:0/426427854 >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 msgr2=0x7f36180aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f361ceb2700 1 --2- 172.21.15.52:0/426427854 >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 0x7f36180aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f361ceb2700 1 -- 172.21.15.52:0/426427854 >> v1:172.21.15.172:6789/0 conn(0x7f3618154460 legacy=0x7f36180a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f361ceb2700 1 -- 172.21.15.52:0/426427854 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36180c88b0 con 0x7f3618068150 2023-05-10T01:21:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f3616ffd700 1 -- 172.21.15.52:0/426427854 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802475244 0 0) 0x7f36180c94c0 con 0x7f3618154460 2023-05-10T01:21:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f361ceb2700 1 --2- 172.21.15.52:0/426427854 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3610009e60 tx=0x7f3610009780).ready entity=mon.2 client_cookie=599c01aebbf66c1a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f3616ffd700 1 -- 172.21.15.52:0/426427854 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000e070 con 0x7f3618068150 2023-05-10T01:21:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f3616ffd700 1 -- 172.21.15.52:0/426427854 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361000bb60 con 0x7f3618068150 2023-05-10T01:21:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.794+0000 7f3616ffd700 1 -- 172.21.15.52:0/426427854 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610012410 con 0x7f3618068150 2023-05-10T01:21:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 -- 172.21.15.52:0/426427854 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 msgr2=0x7f36180685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 --2- 172.21.15.52:0/426427854 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3610009e60 tx=0x7f3610009780).stop 2023-05-10T01:21:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 -- 172.21.15.52:0/426427854 shutdown_connections 2023-05-10T01:21:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 --2- 172.21.15.52:0/426427854 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f36180685a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 --2- 172.21.15.52:0/426427854 >> v2:172.21.15.172:3300/0 conn(0x7f3618154080 0x7f36180aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 -- 172.21.15.52:0/426427854 >> 172.21.15.52:0/426427854 conn(0x7f3618067910 msgr2=0x7f36180cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 -- 172.21.15.52:0/426427854 shutdown_connections 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.795+0000 7f361e915700 1 -- 172.21.15.52:0/426427854 wait complete. 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.796+0000 7f361e915700 1 Processor -- start 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.796+0000 7f361e915700 1 -- start start 2023-05-10T01:21:39.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f361814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3618154460 0x7f361815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618156f40 con 0x7f3618154080 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618156330 con 0x7f3618154460 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361e915700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618156610 con 0x7f3618068150 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f3617fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f361814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33010/0 (socket says 172.21.15.52:33010) 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 -- 172.21.15.52:0/3180368856 learned_addr learned my addr 172.21.15.52:0/3180368856 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f361ceb2700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3618154460 0x7f361815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 msgr2=0x7f361814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f361814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3618154460 msgr2=0x7f361815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3618154460 0x7f361815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.797+0000 7f36177fe700 1 -- 172.21.15.52:0/3180368856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610009a20 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f36177fe700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f360c00c410 tx=0x7f360c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c007020 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36181568f0 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c0071a0 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c007560 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.798+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618150160 con 0x7f3618154080 2023-05-10T01:21:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.799+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618066720 con 0x7f3618154080 2023-05-10T01:21:39.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.799+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f360c010070 con 0x7f3618154080 2023-05-10T01:21:39.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.800+0000 7f35fffff700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 0x7f35f80612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:39.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.800+0000 7f3617fff700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 msgr2=0x7f35f80612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:39.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.800+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f360c079120 con 0x7f3618154080 2023-05-10T01:21:39.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.800+0000 7f3617fff700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 0x7f35f80612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:39.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:39.804+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f360c0478f0 con 0x7f3618154080 2023-05-10T01:21:39.819 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:39.816+0000 7f1115dd4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:21:39.891 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:39.888+0000 7f1115dd4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:21:39.937 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:39.933+0000 7f96ac8ec680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:21:40.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.001+0000 7f3617fff700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 msgr2=0x7f35f80612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:40.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.001+0000 7f3617fff700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 0x7f35f80612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:40.006 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:40.003+0000 7f96ac8ec680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:21:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.045+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f36180c8b90 con 0x7f3618154080 2023-05-10T01:21:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.045+0000 7f35fffff700 1 -- 172.21.15.52:0/3180368856 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7f360c04a370 con 0x7f3618154080 2023-05-10T01:21:40.049 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:21:40.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 msgr2=0x7f35f80612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:40.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 0x7f35f80612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 msgr2=0x7f36181559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f360c00c410 tx=0x7f360c007e00).stop 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 shutdown_connections 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f35f805edf0 0x7f35f80612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3618154460 0x7f361815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3618068150 0x7f361814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 --2- 172.21.15.52:0/3180368856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3618154080 0x7f36181559c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.047+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 >> 172.21.15.52:0/3180368856 conn(0x7f3618067910 msgr2=0x7f36180c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.048+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 shutdown_connections 2023-05-10T01:21:40.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.048+0000 7f361e915700 1 -- 172.21.15.52:0/3180368856 wait complete. 2023-05-10T01:21:40.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:21:40.076 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.073+0000 7f1115dd4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:21:40.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.183+0000 7fb87157a700 1 Processor -- start 2023-05-10T01:21:40.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.183+0000 7fb87157a700 1 -- start start 2023-05-10T01:21:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb87157a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb87157a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb86c0a4f80 0x7fb86c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb87157a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c068740 con 0x7fb86c157a20 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb87157a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c0bdea0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb87157a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c158370 con 0x7fb86c0bd5d0 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb86bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb870d79700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb86c0a4f80 0x7fb86c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb86b7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb86c157a20 0x7fb86c0a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:44588/0 (socket says 172.21.15.52:44588) 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb86b7fe700 1 -- 172.21.15.52:0/1107854178 learned_addr learned my addr 172.21.15.52:0/1107854178 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.184+0000 7fb86bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:52670/0 (socket says 172.21.15.52:52670) 2023-05-10T01:21:40.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb870d79700 1 -- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 msgr2=0x7fb86c0bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb870d79700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb870d79700 1 -- 172.21.15.52:0/1107854178 >> v1:172.21.15.172:6789/0 conn(0x7fb86c157a20 legacy=0x7fb86c0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb86affd700 1 -- 172.21.15.52:0/1107854178 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108405898 0 0) 0x7fb86c068740 con 0x7fb86c157a20 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb870d79700 1 -- 172.21.15.52:0/1107854178 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c067b30 con 0x7fb86c0a4f80 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb86bfff700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb870d79700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c0a4f80 0x7fb86c157e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb864009e90 tx=0x7fb864009780).ready entity=mon.1 client_cookie=7588e66d877e64f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb86affd700 1 -- 172.21.15.52:0/1107854178 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400e070 con 0x7fb86c0a4f80 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb86affd700 1 -- 172.21.15.52:0/1107854178 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400bb20 con 0x7fb86c0a4f80 2023-05-10T01:21:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb86affd700 1 -- 172.21.15.52:0/1107854178 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400bea0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 -- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c0a4f80 msgr2=0x7fb86c157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c0a4f80 0x7fb86c157e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb864009e90 tx=0x7fb864009780).stop 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 -- 172.21.15.52:0/1107854178 shutdown_connections 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c0a4f80 0x7fb86c157e80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 --2- 172.21.15.52:0/1107854178 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0bd5d0 0x7fb86c0bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.185+0000 7fb87157a700 1 -- 172.21.15.52:0/1107854178 >> 172.21.15.52:0/1107854178 conn(0x7fb86c0c7a70 msgr2=0x7fb86c0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.186+0000 7fb87157a700 1 -- 172.21.15.52:0/1107854178 shutdown_connections 2023-05-10T01:21:40.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.186+0000 7fb87157a700 1 -- 172.21.15.52:0/1107854178 wait complete. 2023-05-10T01:21:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.187+0000 7fb87157a700 1 Processor -- start 2023-05-10T01:21:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.187+0000 7fb87157a700 1 -- start start 2023-05-10T01:21:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.187+0000 7fb87157a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 0x7fb86c0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c157a20 0x7fb86c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0a98e0 con 0x7fb86c0bd5d0 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0ab910 con 0x7fb86c157a20 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0ac290 con 0x7fb86c0a4f80 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 0x7fb86c0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33042/0 (socket says 172.21.15.52:33042) 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86b7fe700 1 -- 172.21.15.52:0/1291911233 learned_addr learned my addr 172.21.15.52:0/1291911233 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb870d79700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c157a20 0x7fb86c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 -- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c157a20 msgr2=0x7fb86c0c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c157a20 0x7fb86c0c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 -- 172.21.15.52:0/1291911233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 msgr2=0x7fb86c1369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 -- 172.21.15.52:0/1291911233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0092a0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86b7fe700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb86bfff700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 0x7fb86c0abda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb85c00e980 tx=0x7fb85c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012600 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c012760 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb864009a20 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012ae0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.188+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c0aafe0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.189+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c047150 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.190+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb85c022070 con 0x7fb86c0a4f80 2023-05-10T01:21:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.190+0000 7fb853fff700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 0x7fb84c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.190+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7fb85c07a170 con 0x7fb86c0a4f80 2023-05-10T01:21:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.190+0000 7fb86b7fe700 1 -- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 msgr2=0x7fb84c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.190+0000 7fb86b7fe700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 0x7fb84c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.194+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb85c04b3c0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.205 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:40.202+0000 7f96ac8ec680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:21:40.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.369+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb86c067e10 con 0x7fb86c0a4f80 2023-05-10T01:21:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.370+0000 7fb853fff700 1 -- 172.21.15.52:0/1291911233 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb85c0160a0 con 0x7fb86c0a4f80 2023-05-10T01:21:40.375 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:21:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 msgr2=0x7fb84c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 0x7fb84c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 msgr2=0x7fb86c0abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 0x7fb86c0abda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb85c00e980 tx=0x7fb85c009060).stop 2023-05-10T01:21:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 shutdown_connections 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb84c05ee20 0x7fb84c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86c157a20 0x7fb86c0c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86c0a4f80 0x7fb86c0abda0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 --2- 172.21.15.52:0/1291911233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86c0bd5d0 0x7fb86c1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 >> 172.21.15.52:0/1291911233 conn(0x7fb86c0c7a70 msgr2=0x7fb86c0bce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 shutdown_connections 2023-05-10T01:21:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.373+0000 7fb87157a700 1 -- 172.21.15.52:0/1291911233 wait complete. 2023-05-10T01:21:40.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:21:40.491 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.489+0000 7f1115dd4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:21:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.516+0000 7f89c1cf0700 1 Processor -- start 2023-05-10T01:21:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.516+0000 7f89c1cf0700 1 -- start start 2023-05-10T01:21:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c1cf0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c1cf0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc068740 con 0x7f89bc0bd5d0 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c1cf0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc067b30 con 0x7f89bc158130 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c1cf0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89bc0bdea0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c14ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c0cee700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89bc0bd5d0 0x7f89bc157a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42064/0 (socket says 172.21.15.52:42064) 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c14ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33050/0 (socket says 172.21.15.52:33050) 2023-05-10T01:21:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c0cee700 1 -- 172.21.15.52:0/2602017546 learned_addr learned my addr 172.21.15.52:0/2602017546 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c14ef700 1 -- 172.21.15.52:0/2602017546 >> v1:172.21.15.172:6789/0 conn(0x7f89bc158130 legacy=0x7f89bc0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c14ef700 1 -- 172.21.15.52:0/2602017546 >> v1:172.21.15.52:6789/0 conn(0x7f89bc0bd5d0 legacy=0x7f89bc157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89bb7fe700 1 -- 172.21.15.52:0/2602017546 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431539821 0 0) 0x7f89bc068740 con 0x7f89bc0bd5d0 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.517+0000 7f89c14ef700 1 -- 172.21.15.52:0/2602017546 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc067e10 con 0x7f89bc0a4f80 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c14ef700 1 --2- 172.21.15.52:0/2602017546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f89b4009e60 tx=0x7f89b4009780).ready entity=mon.0 client_cookie=f05fca8880582da8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89bb7fe700 1 -- 172.21.15.52:0/2602017546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400e070 con 0x7f89bc0a4f80 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89bb7fe700 1 -- 172.21.15.52:0/2602017546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b400bc30 con 0x7f89bc0a4f80 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89bb7fe700 1 -- 172.21.15.52:0/2602017546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4012410 con 0x7f89bc0a4f80 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 -- 172.21.15.52:0/2602017546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 msgr2=0x7f89bc0bd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/2602017546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f89b4009e60 tx=0x7f89b4009780).stop 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 -- 172.21.15.52:0/2602017546 shutdown_connections 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/2602017546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc0bd9b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 -- 172.21.15.52:0/2602017546 >> 172.21.15.52:0/2602017546 conn(0x7f89bc0c7a70 msgr2=0x7f89bc0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 -- 172.21.15.52:0/2602017546 shutdown_connections 2023-05-10T01:21:40.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.518+0000 7f89c1cf0700 1 -- 172.21.15.52:0/2602017546 wait complete. 2023-05-10T01:21:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 Processor -- start 2023-05-10T01:21:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 -- start start 2023-05-10T01:21:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89bc0bd5d0 0x7f89bc156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89bc158130 0x7f89bc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc156f30 con 0x7f89bc0a4f80 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc137630 con 0x7f89bc0bd5d0 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.520+0000 7f89c1cf0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc137910 con 0x7f89bc158130 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33052/0 (socket says 172.21.15.52:33052) 2023-05-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 -- 172.21.15.52:0/4060464554 learned_addr learned my addr 172.21.15.52:0/4060464554 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89bbfff700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89bc0bd5d0 0x7f89bc156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c14ef700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89bc158130 0x7f89bc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 -- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89bc158130 msgr2=0x7f89bc156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89bc158130 0x7f89bc156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 -- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89bc0bd5d0 msgr2=0x7f89bc156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89bc0bd5d0 0x7f89bc156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 -- 172.21.15.52:0/4060464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009a20 con 0x7f89bc0a4f80 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c0cee700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f89ac00c4c0 tx=0x7f89ac007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00ce30 con 0x7f89bc0a4f80 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac0072e0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc0a7000 con 0x7f89bc0a4f80 2023-05-10T01:21:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0057a0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.521+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc0a75c0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.522+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8994005120 con 0x7f89bc0a4f80 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.523+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f89ac010070 con 0x7f89bc0a4f80 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.523+0000 7f89b8ff9700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 0x7f89a00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.523+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f89ac079530 con 0x7f89bc0a4f80 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.523+0000 7f89bbfff700 1 -- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 msgr2=0x7f89a00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.523+0000 7f89bbfff700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 0x7f89a00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:40.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.527+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89ac04a6d0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.596 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.593+0000 7f1115dd4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:21:40.657 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:40.654+0000 7f96ac8ec680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:21:40.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.701+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8994005d70 con 0x7f89bc0a4f80 2023-05-10T01:21:40.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.702+0000 7f89b8ff9700 1 -- 172.21.15.52:0/4060464554 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89ac04dcf0 con 0x7f89bc0a4f80 2023-05-10T01:21:40.706 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:21:40.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 msgr2=0x7f89a00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:40.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 0x7f89a00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 msgr2=0x7f89bc1360a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f89ac00c4c0 tx=0x7f89ac007c10).stop 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 shutdown_connections 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f89a005ee20 0x7f89a00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89bc158130 0x7f89bc156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc0a4f80 0x7f89bc1360a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 --2- 172.21.15.52:0/4060464554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89bc0bd5d0 0x7f89bc156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 >> 172.21.15.52:0/4060464554 conn(0x7f89bc0c7a70 msgr2=0x7f89bc064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 shutdown_connections 2023-05-10T01:21:40.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.704+0000 7f89c1cf0700 1 -- 172.21.15.52:0/4060464554 wait complete. 2023-05-10T01:21:40.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:21:40.750 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.747+0000 7f1115dd4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:21:40.770 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:40.767+0000 7f96ac8ec680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:21:40.824 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.822+0000 7f1115dd4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:21:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.841+0000 7f64b2d0f700 1 Processor -- start 2023-05-10T01:21:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.841+0000 7f64b2d0f700 1 -- start start 2023-05-10T01:21:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64b2d0f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64ac154f60 0x7f64ac155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64b2d0f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac151c60 con 0x7f64ac0692a0 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64b2d0f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac151330 con 0x7f64ac0bdab0 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64b2d0f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac1520f0 con 0x7f64ac154f60 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64b0aab700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64ac154f60 0x7f64ac155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64abfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f64ac0692a0 0x7f64ac0bd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42076/0 (socket says 172.21.15.52:42076) 2023-05-10T01:21:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.842+0000 7f64abfff700 1 -- 172.21.15.52:0/1588160121 learned_addr learned my addr 172.21.15.52:0/1588160121 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64b0aab700 1 -- 172.21.15.52:0/1588160121 >> v1:172.21.15.172:6789/0 conn(0x7f64ac0bdab0 legacy=0x7f64ac064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64ab7fe700 1 -- 172.21.15.52:0/1588160121 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944104594 0 0) 0x7f64ac151330 con 0x7f64ac0bdab0 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64b0aab700 1 -- 172.21.15.52:0/1588160121 >> v1:172.21.15.52:6789/0 conn(0x7f64ac0692a0 legacy=0x7f64ac0bd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64b0aab700 1 -- 172.21.15.52:0/1588160121 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac151610 con 0x7f64ac154f60 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64b0aab700 1 --2- 172.21.15.52:0/1588160121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac154f60 0x7f64ac155340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f64a0009760 tx=0x7f64a0009060).ready entity=mon.0 client_cookie=2dff3ebc68e34a78 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64ab7fe700 1 -- 172.21.15.52:0/1588160121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f510 con 0x7f64ac154f60 2023-05-10T01:21:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64ab7fe700 1 -- 172.21.15.52:0/1588160121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000f670 con 0x7f64ac154f60 2023-05-10T01:21:40.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.843+0000 7f64ab7fe700 1 -- 172.21.15.52:0/1588160121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f9f0 con 0x7f64ac154f60 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 -- 172.21.15.52:0/1588160121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac154f60 msgr2=0x7f64ac155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/1588160121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac154f60 0x7f64ac155340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f64a0009760 tx=0x7f64a0009060).stop 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 -- 172.21.15.52:0/1588160121 shutdown_connections 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/1588160121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac154f60 0x7f64ac155340 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 -- 172.21.15.52:0/1588160121 >> 172.21.15.52:0/1588160121 conn(0x7f64ac0c8460 msgr2=0x7f64ac0c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 -- 172.21.15.52:0/1588160121 shutdown_connections 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.844+0000 7f64b2d0f700 1 -- 172.21.15.52:0/1588160121 wait complete. 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.845+0000 7f64b2d0f700 1 Processor -- start 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.845+0000 7f64b2d0f700 1 -- start start 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64ac0bdab0 0x7f64ac0a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac154f60 0x7f64ac066e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0aac40 con 0x7f64ac0692a0 2023-05-10T01:21:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0beca0 con 0x7f64ac154f60 2023-05-10T01:21:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b2d0f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0bef80 con 0x7f64ac0bdab0 2023-05-10T01:21:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33064/0 (socket says 172.21.15.52:33064) 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 -- 172.21.15.52:0/2892732306 learned_addr learned my addr 172.21.15.52:0/2892732306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b12ac700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac154f60 0x7f64ac066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64abfff700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64ac0bdab0 0x7f64ac0a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 -- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64ac0bdab0 msgr2=0x7f64ac0a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64ac0bdab0 0x7f64ac0a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 -- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac154f60 msgr2=0x7f64ac066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac154f60 0x7f64ac066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.846+0000 7f64b0aab700 1 -- 172.21.15.52:0/2892732306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00092a0 con 0x7f64ac0692a0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64b0aab700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f64a0009eb0 tx=0x7f64a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f7e0 con 0x7f64ac0692a0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000f940 con 0x7f64ac0692a0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0bf260 con 0x7f64ac0692a0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a001b640 con 0x7f64ac0692a0 2023-05-10T01:21:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.847+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0bf820 con 0x7f64ac0692a0 2023-05-10T01:21:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac151030 con 0x7f64ac0692a0 2023-05-10T01:21:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f64a000f070 con 0x7f64ac0692a0 2023-05-10T01:21:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64a8ff9700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 0x7f64940612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f64a007b580 con 0x7f64ac0692a0 2023-05-10T01:21:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64abfff700 1 -- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 msgr2=0x7f64940612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.848+0000 7f64abfff700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 0x7f64940612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:40.853+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64a004c720 con 0x7f64ac0692a0 2023-05-10T01:21:40.892 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:40.889+0000 7f1115dd4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:21:40.942 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:40.938+0000 7f96ac8ec680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:21:41.019 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:41.016+0000 7f96ac8ec680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:21:41.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.038+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64ac06c340 con 0x7f64ac0692a0 2023-05-10T01:21:41.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.038+0000 7f64a8ff9700 1 -- 172.21.15.52:0/2892732306 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64a004fd40 con 0x7f64ac0692a0 2023-05-10T01:21:41.042 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:21:41.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 msgr2=0x7f64940612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 0x7f64940612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 msgr2=0x7f64ac14ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f64a0009eb0 tx=0x7f64a0017000).stop 2023-05-10T01:21:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 shutdown_connections 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f649405ee20 0x7f64940612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac154f60 0x7f64ac066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64ac0692a0 0x7f64ac14ba60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 --2- 172.21.15.52:0/2892732306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64ac0bdab0 0x7f64ac0a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 >> 172.21.15.52:0/2892732306 conn(0x7f64ac0c8460 msgr2=0x7f64ac0c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 shutdown_connections 2023-05-10T01:21:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.040+0000 7f64b2d0f700 1 -- 172.21.15.52:0/2892732306 wait complete. 2023-05-10T01:21:41.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:41.092 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:41.089+0000 7f96ac8ec680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:21:41.148 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:41.145+0000 7f1115dd4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:21:41.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.170+0000 7fa898902700 1 Processor -- start 2023-05-10T01:21:41.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.170+0000 7fa898902700 1 -- start start 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa898902700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa894150cd0 0x7fa894064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa898902700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8941510b0 0x7fa894155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa898902700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940653e0 con 0x7fa8940bd4d0 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa898902700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940bda40 con 0x7fa8941510b0 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa898902700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940bdd20 con 0x7fa894150cd0 2023-05-10T01:21:41.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa891d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8941510b0 0x7fa894155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.171+0000 7fa892d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa8940bd4d0 0x7fa8940696e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42088/0 (socket says 172.21.15.52:42088) 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8941510b0 0x7fa894155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33072/0 (socket says 172.21.15.52:33072) 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa892d9d700 1 -- 172.21.15.52:0/2701700814 learned_addr learned my addr 172.21.15.52:0/2701700814 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa89259c700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa894150cd0 0x7fa894064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 -- 172.21.15.52:0/2701700814 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa894150cd0 msgr2=0x7fa894064ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa894150cd0 0x7fa894064ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 -- 172.21.15.52:0/2701700814 >> v1:172.21.15.52:6789/0 conn(0x7fa8940bd4d0 legacy=0x7fa8940696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa89159a700 1 -- 172.21.15.52:0/2701700814 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926461663 0 0) 0x7fa8940653e0 con 0x7fa8940bd4d0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 -- 172.21.15.52:0/2701700814 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940be000 con 0x7fa8941510b0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa891d9b700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8941510b0 0x7fa894155380 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fa87c009760 tx=0x7fa87c009060).ready entity=mon.0 client_cookie=c4f6c567365c1f4c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa89159a700 1 -- 172.21.15.52:0/2701700814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00f510 con 0x7fa8941510b0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa89159a700 1 -- 172.21.15.52:0/2701700814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00f670 con 0x7fa8941510b0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.172+0000 7fa89159a700 1 -- 172.21.15.52:0/2701700814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00f9f0 con 0x7fa8941510b0 2023-05-10T01:21:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 -- 172.21.15.52:0/2701700814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8941510b0 msgr2=0x7fa894155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8941510b0 0x7fa894155380 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fa87c009760 tx=0x7fa87c009060).stop 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 -- 172.21.15.52:0/2701700814 shutdown_connections 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa894150cd0 0x7fa894064ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 --2- 172.21.15.52:0/2701700814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8941510b0 0x7fa894155380 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 -- 172.21.15.52:0/2701700814 >> 172.21.15.52:0/2701700814 conn(0x7fa894063620 msgr2=0x7fa8940c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 -- 172.21.15.52:0/2701700814 shutdown_connections 2023-05-10T01:21:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.173+0000 7fa898902700 1 -- 172.21.15.52:0/2701700814 wait complete. 2023-05-10T01:21:41.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.174+0000 7fa898902700 1 Processor -- start 2023-05-10T01:21:41.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.174+0000 7fa898902700 1 -- start start 2023-05-10T01:21:41.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8940bd4d0 0x7fa89414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8941510b0 0x7fa8941446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89414e700 con 0x7fa894150cd0 2023-05-10T01:21:41.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894144f30 con 0x7fa8940bd4d0 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa898902700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894145210 con 0x7fa8941510b0 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33078/0 (socket says 172.21.15.52:33078) 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 -- 172.21.15.52:0/3657108188 learned_addr learned my addr 172.21.15.52:0/3657108188 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa89259c700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8940bd4d0 0x7fa89414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa892d9d700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8941510b0 0x7fa8941446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8941510b0 msgr2=0x7fa8941446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8941510b0 0x7fa8941446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8940bd4d0 msgr2=0x7fa89414dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8940bd4d0 0x7fa89414dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 -- 172.21.15.52:0/3657108188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0092a0 con 0x7fa894150cd0 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa891d9b700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa894064720 tx=0x7fa87c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00fe80 con 0x7fa894150cd0 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.175+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00f7e0 con 0x7fa894150cd0 2023-05-10T01:21:41.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.176+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8941454f0 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.176+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c01c650 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.176+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89413cf70 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.176+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89406c340 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.177+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fa87c02c070 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.177+0000 7fa88a7fc700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 0x7fa8780612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.177+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7fa87c07b9d0 con 0x7fa894150cd0 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.177+0000 7fa89259c700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 msgr2=0x7fa8780612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:41.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.177+0000 7fa89259c700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 0x7fa8780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:41.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.181+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa87c04cbb0 con 0x7fa894150cd0 2023-05-10T01:21:41.330 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:41.328+0000 7f1115dd4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:21:41.367 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:41.363+0000 7f96ac8ec680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:21:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.378+0000 7fa89259c700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 msgr2=0x7fa8780612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.378+0000 7fa89259c700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 0x7fa8780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:41.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.401+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8940691a0 con 0x7fa894150cd0 2023-05-10T01:21:41.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.401+0000 7fa88a7fc700 1 -- 172.21.15.52:0/3657108188 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fa87c02a090 con 0x7fa894150cd0 2023-05-10T01:21:41.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:41.406 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:21:41.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 msgr2=0x7fa8780612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:41.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 0x7fa8780612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 msgr2=0x7fa89413ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa894064720 tx=0x7fa87c017000).stop 2023-05-10T01:21:41.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 shutdown_connections 2023-05-10T01:21:41.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa87805edf0 0x7fa8780612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8941510b0 0x7fa8941446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8940bd4d0 0x7fa89414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 --2- 172.21.15.52:0/3657108188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa894150cd0 0x7fa89413ca80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 >> 172.21.15.52:0/3657108188 conn(0x7fa894063620 msgr2=0x7fa8940695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 shutdown_connections 2023-05-10T01:21:41.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.403+0000 7fa898902700 1 -- 172.21.15.52:0/3657108188 wait complete. 2023-05-10T01:21:41.410 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:21:41.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:41.559 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:41.556+0000 7f96ac8ec680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:21:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.576+0000 7f2ec6520700 1 Processor -- start 2023-05-10T01:21:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 -- start start 2023-05-10T01:21:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec0068c60 0x7f2ec0154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ec0064ff0 0x7f2ec00654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec0067550 con 0x7f2ec0153ea0 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0065990 con 0x7f2ec0068c60 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ec6520700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00bc9a0 con 0x7f2ec0064ff0 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.577+0000 7f2ebf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec0068c60 0x7f2ec0154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec0068c60 0x7f2ec0154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33088/0 (socket says 172.21.15.52:33088) 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/1852366066 learned_addr learned my addr 172.21.15.52:0/1852366066 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2ec0153ea0 0x7f2ec0066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42102/0 (socket says 172.21.15.52:42102) 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ec4abd700 1 --2- 172.21.15.52:0/1852366066 >> v2:172.21.15.172:3300/0 conn(0x7f2ec0064ff0 0x7f2ec00654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/1852366066 >> v2:172.21.15.172:3300/0 conn(0x7f2ec0064ff0 msgr2=0x7f2ec00654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 --2- 172.21.15.52:0/1852366066 >> v2:172.21.15.172:3300/0 conn(0x7f2ec0064ff0 0x7f2ec00654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/1852366066 >> v1:172.21.15.52:6789/0 conn(0x7f2ec0153ea0 legacy=0x7f2ec0066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/1852366066 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00bcc80 con 0x7f2ec0068c60 2023-05-10T01:21:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebf7fe700 1 --2- 172.21.15.52:0/1852366066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0068c60 0x7f2ec0154280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2ec0064df0 tx=0x7f2ea80090f0).ready entity=mon.0 client_cookie=50866cd4108d4a7a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebeffd700 1 -- 172.21.15.52:0/1852366066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800b600 con 0x7f2ec0068c60 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebeffd700 1 -- 172.21.15.52:0/1852366066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800b760 con 0x7f2ec0068c60 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.578+0000 7f2ebeffd700 1 -- 172.21.15.52:0/1852366066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800bae0 con 0x7f2ec0068c60 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 -- 172.21.15.52:0/1852366066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0068c60 msgr2=0x7f2ec0154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 --2- 172.21.15.52:0/1852366066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0068c60 0x7f2ec0154280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2ec0064df0 tx=0x7f2ea80090f0).stop 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 -- 172.21.15.52:0/1852366066 shutdown_connections 2023-05-10T01:21:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 --2- 172.21.15.52:0/1852366066 >> v2:172.21.15.172:3300/0 conn(0x7f2ec0064ff0 0x7f2ec00654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 --2- 172.21.15.52:0/1852366066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0068c60 0x7f2ec0154280 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 -- 172.21.15.52:0/1852366066 >> 172.21.15.52:0/1852366066 conn(0x7f2ec00c4420 msgr2=0x7f2ec00c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 -- 172.21.15.52:0/1852366066 shutdown_connections 2023-05-10T01:21:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.579+0000 7f2ec6520700 1 -- 172.21.15.52:0/1852366066 wait complete. 2023-05-10T01:21:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.580+0000 7f2ec6520700 1 Processor -- start 2023-05-10T01:21:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.580+0000 7f2ec6520700 1 -- start start 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0064ff0 0x7f2ec00abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ec0159400 0x7f2ec0159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00ac040 con 0x7f2ec0153ea0 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0157fc0 con 0x7f2ec0064ff0 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec6520700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0165710 con 0x7f2ec0159400 2023-05-10T01:21:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33094/0 (socket says 172.21.15.52:33094) 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/3269701984 learned_addr learned my addr 172.21.15.52:0/3269701984 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebffff700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0064ff0 0x7f2ec00abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ec4abd700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ec0159400 0x7f2ec0159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ec0159400 msgr2=0x7f2ec0159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ec0159400 0x7f2ec0159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0064ff0 msgr2=0x7f2ec00abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0064ff0 0x7f2ec00abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 -- 172.21.15.52:0/3269701984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009370 con 0x7f2ec0153ea0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.581+0000 7f2ebf7fe700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f2ea8009130 tx=0x7f2ea8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800b8d0 con 0x7f2ec0153ea0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800ba30 con 0x7f2ec0153ea0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0152e40 con 0x7f2ec0153ea0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea801c670 con 0x7f2ec0153ea0 2023-05-10T01:21:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec0164de0 con 0x7f2ec0153ea0 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.582+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec00aa9b0 con 0x7f2ec0153ea0 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.583+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2ea802c070 con 0x7f2ec0153ea0 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.584+0000 7f2eb7fff700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 0x7f2ea40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.584+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f2ea807ba30 con 0x7f2ec0153ea0 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.584+0000 7f2ebffff700 1 -- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 msgr2=0x7f2ea40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.584+0000 7f2ebffff700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 0x7f2ea40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.588+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ec00aa9b0 con 0x7f2ec0153ea0 2023-05-10T01:21:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.764+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ec006c340 con 0x7f2ec0153ea0 2023-05-10T01:21:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.765+0000 7f2eb7fff700 1 -- 172.21.15.52:0/3269701984 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18543 (secure 0 0 0) 0x7f2ea802a090 con 0x7f2ec0153ea0 2023-05-10T01:21:41.769 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:41.769 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":50,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:40.480060+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":219,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:6832/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3349551008":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3297537909":"2023-05-11T01:10:52.178304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":7,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":16,"length":1},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":26,"length":1},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":36,"length":1},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":46,"length":1},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":56,"length":1},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":66,"length":1},{"begin":69,"length":2},{"begin":72,"length":2},{"begin":76,"length":1},{"begin":79,"length":2},{"begin":82,"length":2},{"begin":86,"length":1},{"begin":89,"length":2},{"begin":92,"length":1},{"begin":96,"length":1},{"begin":99,"length":2},{"begin":102,"length":1},{"begin":105,"length":2},{"begin":109,"length":2},{"begin":154,"length":53}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.766+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 msgr2=0x7f2ea40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.766+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 0x7f2ea40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.766+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 msgr2=0x7f2ec0157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.766+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f2ea8009130 tx=0x7f2ea8017000).stop 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 shutdown_connections 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2ea405ee20 0x7f2ea40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ec0159400 0x7f2ec0159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0064ff0 0x7f2ec00abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 --2- 172.21.15.52:0/3269701984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec0153ea0 0x7f2ec0157ad0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 >> 172.21.15.52:0/3269701984 conn(0x7f2ec00c4420 msgr2=0x7f2ec00a4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 shutdown_connections 2023-05-10T01:21:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.767+0000 7f2ec6520700 1 -- 172.21.15.52:0/3269701984 wait complete. 2023-05-10T01:21:41.782 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:21:41.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.897+0000 7f1a1f59e700 1 Processor -- start 2023-05-10T01:21:41.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.897+0000 7f1a1f59e700 1 -- start start 2023-05-10T01:21:41.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a200c7370 0x7f1a20154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1f59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a200c7750 0x7f1a200acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a20158960 con 0x7f1a200ad030 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1f59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a20155330 con 0x7f1a200c7750 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a20157d50 con 0x7f1a200c7370 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a200c7750 0x7f1a200acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a200c7750 0x7f1a200acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33116/0 (socket says 172.21.15.52:33116) 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 -- 172.21.15.52:0/869463547 learned_addr learned my addr 172.21.15.52:0/869463547 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1e59c700 1 --2- 172.21.15.52:0/869463547 >> v2:172.21.15.172:3300/0 conn(0x7f1a200c7370 0x7f1a20154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 -- 172.21.15.52:0/869463547 >> v2:172.21.15.172:3300/0 conn(0x7f1a200c7370 msgr2=0x7f1a20154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 --2- 172.21.15.52:0/869463547 >> v2:172.21.15.172:3300/0 conn(0x7f1a200c7370 0x7f1a20154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 -- 172.21.15.52:0/869463547 >> v1:172.21.15.172:6789/0 conn(0x7f1a200ad030 legacy=0x7f1a2014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.898+0000 7f1a1dd9b700 1 -- 172.21.15.52:0/869463547 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20158030 con 0x7f1a200c7750 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1dd9b700 1 --2- 172.21.15.52:0/869463547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a200acb40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1a20083b90 tx=0x7f1a140090f0).ready entity=mon.0 client_cookie=68309ed3ff561866 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1d59a700 1 -- 172.21.15.52:0/869463547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400b520 con 0x7f1a200c7750 2023-05-10T01:21:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1d59a700 1 -- 172.21.15.52:0/869463547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1400b680 con 0x7f1a200c7750 2023-05-10T01:21:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1d59a700 1 -- 172.21.15.52:0/869463547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400ba00 con 0x7f1a200c7750 2023-05-10T01:21:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 -- 172.21.15.52:0/869463547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 msgr2=0x7f1a200acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/869463547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a200acb40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1a20083b90 tx=0x7f1a140090f0).stop 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 -- 172.21.15.52:0/869463547 shutdown_connections 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/869463547 >> v2:172.21.15.172:3300/0 conn(0x7f1a200c7370 0x7f1a20154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/869463547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a200acb40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 -- 172.21.15.52:0/869463547 >> 172.21.15.52:0/869463547 conn(0x7f1a20068320 msgr2=0x7f1a20068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 -- 172.21.15.52:0/869463547 shutdown_connections 2023-05-10T01:21:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.899+0000 7f1a1f59e700 1 -- 172.21.15.52:0/869463547 wait complete. 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.900+0000 7f1a1f59e700 1 Processor -- start 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 -- start start 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a200ad030 0x7f1a200adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a200c7370 0x7f1a200c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c49f0 con 0x7f1a200c7750 2023-05-10T01:21:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200ae160 con 0x7f1a200c7370 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c1fc0 con 0x7f1a200ad030 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33126/0 (socket says 172.21.15.52:33126) 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1ed9d700 1 -- 172.21.15.52:0/25164643 learned_addr learned my addr 172.21.15.52:0/25164643 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1dd9b700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a200c7370 0x7f1a200c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.901+0000 7f1a1e59c700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a200ad030 0x7f1a200adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a200ad030 msgr2=0x7f1a200adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a200ad030 0x7f1a200adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a200c7370 msgr2=0x7f1a200c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a200c7370 0x7f1a200c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 -- 172.21.15.52:0/25164643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14009370 con 0x7f1a200c7750 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1ed9d700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1a18002230 tx=0x7f1a180015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800e4a0 con 0x7f1a200c7750 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1800e600 con 0x7f1a200c7750 2023-05-10T01:21:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a200c22a0 con 0x7f1a200c7750 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800e980 con 0x7f1a200c7750 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.902+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200c2860 con 0x7f1a200c7750 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.903+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200c8960 con 0x7f1a200c7750 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.904+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f1a18019030 con 0x7f1a200c7750 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.904+0000 7f1a0e7fc700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 0x7f19fc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:41.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.904+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f1a18079760 con 0x7f1a200c7750 2023-05-10T01:21:41.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.904+0000 7f1a1e59c700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 msgr2=0x7f19fc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:41.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.904+0000 7f1a1e59c700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 0x7f19fc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:41.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:41.908+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a1804aa30 con 0x7f1a200c7750 2023-05-10T01:21:41.982 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:41.979+0000 7f1115dd4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:21:42.052 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.045+0000 7f1115dd4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:21:42.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.105+0000 7f1a1e59c700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 msgr2=0x7f19fc0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.105+0000 7f1a1e59c700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 0x7f19fc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:42.121 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.118+0000 7f1115dd4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:21:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.125+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a200c8960 con 0x7f1a200c7750 2023-05-10T01:21:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.126+0000 7f1a0e7fc700 1 -- 172.21.15.52:0/25164643 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f1a200c8960 con 0x7f1a200c7750 2023-05-10T01:21:42.130 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:42.130 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:21:42.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 msgr2=0x7f19fc0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:42.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 0x7f19fc0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 msgr2=0x7f1a2014e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1a18002230 tx=0x7f1a180015e0).stop 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 shutdown_connections 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f19fc05ee20 0x7f19fc0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200c7750 0x7f1a2014e980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a200ad030 0x7f1a200adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 --2- 172.21.15.52:0/25164643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a200c7370 0x7f1a200c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 >> 172.21.15.52:0/25164643 conn(0x7f1a20068320 msgr2=0x7f1a20150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 shutdown_connections 2023-05-10T01:21:42.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.128+0000 7f1a1f59e700 1 -- 172.21.15.52:0/25164643 wait complete. 2023-05-10T01:21:42.134 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:21:42.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:42.251 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.248+0000 7f96ac8ec680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:21:42.262 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.259+0000 7f1115dd4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:21:42.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.261+0000 7fc441154700 1 Processor -- start 2023-05-10T01:21:42.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.261+0000 7fc441154700 1 -- start start 2023-05-10T01:21:42.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc441154700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc43c154540 0x7fc43c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc441154700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c0c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc441154700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0c0650 con 0x7fc43c154160 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc441154700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c069ff0 con 0x7fc43c154540 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc441154700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0bfd20 con 0x7fc43c069b80 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc43c154540 0x7fc43c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc43c154540 0x7fc43c069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33134/0 (socket says 172.21.15.52:33134) 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 -- 172.21.15.52:0/3723689915 learned_addr learned my addr 172.21.15.52:0/3723689915 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43b59e700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c0c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 -- 172.21.15.52:0/3723689915 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 msgr2=0x7fc43c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c0c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 -- 172.21.15.52:0/3723689915 >> v1:172.21.15.172:6789/0 conn(0x7fc43c154160 legacy=0x7fc43c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 -- 172.21.15.52:0/3723689915 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0c0000 con 0x7fc43c154540 2023-05-10T01:21:42.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43b59e700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c0c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc43a59c700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c069690 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fc42c006fd0 tx=0x7fc42c0090f0).ready entity=mon.0 client_cookie=ddc8a2a9473f357b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc439d9b700 1 -- 172.21.15.52:0/3723689915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00b600 con 0x7fc43c154540 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc439d9b700 1 -- 172.21.15.52:0/3723689915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00b760 con 0x7fc43c154540 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.262+0000 7fc439d9b700 1 -- 172.21.15.52:0/3723689915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00bae0 con 0x7fc43c154540 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 -- 172.21.15.52:0/3723689915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 msgr2=0x7fc43c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c069690 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fc42c006fd0 tx=0x7fc42c0090f0).stop 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 -- 172.21.15.52:0/3723689915 shutdown_connections 2023-05-10T01:21:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c0c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 --2- 172.21.15.52:0/3723689915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c069690 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 -- 172.21.15.52:0/3723689915 >> 172.21.15.52:0/3723689915 conn(0x7fc43c0cb740 msgr2=0x7fc43c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 -- 172.21.15.52:0/3723689915 shutdown_connections 2023-05-10T01:21:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.263+0000 7fc441154700 1 -- 172.21.15.52:0/3723689915 wait complete. 2023-05-10T01:21:42.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.264+0000 7fc441154700 1 Processor -- start 2023-05-10T01:21:42.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.264+0000 7fc441154700 1 -- start start 2023-05-10T01:21:42.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43c154160 0x7fc43c0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c3270 con 0x7fc43c154540 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c14a250 con 0x7fc43c154160 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc441154700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c21d0 con 0x7fc43c069b80 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33142/0 (socket says 172.21.15.52:33142) 2023-05-10T01:21:42.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 -- 172.21.15.52:0/4199510808 learned_addr learned my addr 172.21.15.52:0/4199510808 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 msgr2=0x7fc43c14a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c14a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43c154160 msgr2=0x7fc43c0aedd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43c154160 0x7fc43c0aedd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 -- 172.21.15.52:0/4199510808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009370 con 0x7fc43c154540 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.265+0000 7fc43b59e700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fc434009fc0 tx=0x7fc4340099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.266+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400dce0 con 0x7fc43c154540 2023-05-10T01:21:42.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.266+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400f040 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.266+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c0c24b0 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.266+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434013600 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.266+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c0c2d50 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.267+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c0666b0 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.267+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc4340139b0 con 0x7fc43c154540 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.267+0000 7fc432ffd700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 0x7fc4200612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.268+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7fc43407a760 con 0x7fc43c154540 2023-05-10T01:21:42.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.268+0000 7fc43ad9d700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 msgr2=0x7fc4200612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.268+0000 7fc43ad9d700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 0x7fc4200612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:42.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.272+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43404b8a0 con 0x7fc43c154540 2023-05-10T01:21:42.325 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.321+0000 7f96ac8ec680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:21:42.331 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.329+0000 7f1115dd4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:21:42.402 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.399+0000 7f96ac8ec680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:21:42.442 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.440+0000 7f1115dd4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:21:42.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.469+0000 7fc43ad9d700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 msgr2=0x7fc4200612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.469+0000 7fc43ad9d700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 0x7fc4200612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.487+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc43c06c340 con 0x7fc43c154540 2023-05-10T01:21:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.488+0000 7fc432ffd700 1 -- 172.21.15.52:0/4199510808 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fc43404eec0 con 0x7fc43c154540 2023-05-10T01:21:42.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:42.492 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:10:39.978430+0000","modified":"2023-05-10T01:10:42.985724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4935":{"gid":4935,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1729070625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1729070625},{"type":"v1","addr":"172.21.15.52:6835","nonce":1729070625}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-05-10T01:21:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 msgr2=0x7fc4200612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 0x7fc4200612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 msgr2=0x7fc43c14c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fc434009fc0 tx=0x7fc4340099b0).stop 2023-05-10T01:21:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 shutdown_connections 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc42005ee20 0x7fc4200612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc43c154540 0x7fc43c14c7b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43c069b80 0x7fc43c14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 --2- 172.21.15.52:0/4199510808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43c154160 0x7fc43c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 >> 172.21.15.52:0/4199510808 conn(0x7fc43c0cb740 msgr2=0x7fc43c0ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 shutdown_connections 2023-05-10T01:21:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.490+0000 7fc441154700 1 -- 172.21.15.52:0/4199510808 wait complete. 2023-05-10T01:21:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 15 2023-05-10T01:21:42.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:42.547 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.544+0000 7f1115dd4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:21:42.556 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.553+0000 7f96ac8ec680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:21:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.620+0000 7ff4debeb700 1 Processor -- start 2023-05-10T01:21:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.620+0000 7ff4debeb700 1 -- start start 2023-05-10T01:21:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4d8154160 0x7ff4d80c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 0x7ff4d80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 0x7ff4d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80c0650 con 0x7ff4d8154160 2023-05-10T01:21:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d806a010 con 0x7ff4d8154540 2023-05-10T01:21:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4debeb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80bfd20 con 0x7ff4d8069690 2023-05-10T01:21:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4dc987700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4d8154160 0x7ff4d80c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4dc987700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4d8154160 0x7ff4d80c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33148/0 (socket says 172.21.15.52:33148) 2023-05-10T01:21:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4dc987700 1 -- 172.21.15.52:0/2968198500 learned_addr learned my addr 172.21.15.52:0/2968198500 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4dd188700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 0x7ff4d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.621+0000 7ff4d7fff700 1 --2- 172.21.15.52:0/2968198500 >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 0x7ff4d80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 -- 172.21.15.52:0/2968198500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 msgr2=0x7ff4d8069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 0x7ff4d8069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 -- 172.21.15.52:0/2968198500 >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 msgr2=0x7ff4d80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 --2- 172.21.15.52:0/2968198500 >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 0x7ff4d80c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 -- 172.21.15.52:0/2968198500 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d80c0000 con 0x7ff4d8154160 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dd188700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 0x7ff4d8069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4d7fff700 1 --2- 172.21.15.52:0/2968198500 >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 0x7ff4d80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4dc987700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8154160 0x7ff4d80c5c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff4d80844d0 tx=0x7ff4cc0090f0).ready entity=mon.0 client_cookie=c8e171d46e6e0378 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4d77fe700 1 -- 172.21.15.52:0/2968198500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00b600 con 0x7ff4d8154160 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4d77fe700 1 -- 172.21.15.52:0/2968198500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00b760 con 0x7ff4d8154160 2023-05-10T01:21:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4d77fe700 1 -- 172.21.15.52:0/2968198500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00bb00 con 0x7ff4d8154160 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 -- 172.21.15.52:0/2968198500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8154160 msgr2=0x7ff4d80c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8154160 0x7ff4d80c5c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff4d80844d0 tx=0x7ff4cc0090f0).stop 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 -- 172.21.15.52:0/2968198500 shutdown_connections 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8069690 0x7ff4d8069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 --2- 172.21.15.52:0/2968198500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8154160 0x7ff4d80c5c60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 --2- 172.21.15.52:0/2968198500 >> v2:172.21.15.172:3300/0 conn(0x7ff4d8154540 0x7ff4d80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.622+0000 7ff4debeb700 1 -- 172.21.15.52:0/2968198500 >> 172.21.15.52:0/2968198500 conn(0x7ff4d80cb6f0 msgr2=0x7ff4d80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.623+0000 7ff4debeb700 1 -- 172.21.15.52:0/2968198500 shutdown_connections 2023-05-10T01:21:42.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.623+0000 7ff4debeb700 1 -- 172.21.15.52:0/2968198500 wait complete. 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.624+0000 7ff4debeb700 1 Processor -- start 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.624+0000 7ff4debeb700 1 -- start start 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4d8154160 0x7ff4d80c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8154540 0x7ff4d80c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81514f0 con 0x7ff4d8069690 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80c3600 con 0x7ff4d8154160 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80c38e0 con 0x7ff4d8154540 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33154/0 (socket says 172.21.15.52:33154) 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 -- 172.21.15.52:0/3478184329 learned_addr learned my addr 172.21.15.52:0/3478184329 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4d7fff700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4d8154160 0x7ff4d80c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dd188700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8154540 0x7ff4d80c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8154540 msgr2=0x7ff4d80c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8154540 0x7ff4d80c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4d8154160 msgr2=0x7ff4d80c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4d8154160 0x7ff4d80c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 -- 172.21.15.52:0/3478184329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009370 con 0x7ff4d8069690 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4dc987700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff4d8083050 tx=0x7ff4cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc006d90 con 0x7ff4d8069690 2023-05-10T01:21:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00bec0 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d80c3bc0 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc002f30 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.625+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81646e0 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d80ca480 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff4cc00f070 con 0x7ff4d8069690 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4d4ff9700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 0x7ff4c00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7114+0+0 (secure 0 0 0) 0x7ff4cc07bb60 con 0x7ff4d8069690 2023-05-10T01:21:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4d7fff700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 msgr2=0x7ff4c00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.627+0000 7ff4d7fff700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 0x7ff4c00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:42.638 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.629+0000 7f96ac8ec680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:21:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.631+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4cc04cdb0 con 0x7ff4d8069690 2023-05-10T01:21:42.769 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.766+0000 7f96ac8ec680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:21:42.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.827+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d8151980 con 0x7ff4d8069690 2023-05-10T01:21:42.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.828+0000 7ff4d7fff700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 msgr2=0x7ff4c00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.828+0000 7ff4d4ff9700 1 -- 172.21.15.52:0/3478184329 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18543 (secure 0 0 0) 0x7ff4d8151980 con 0x7ff4d8069690 2023-05-10T01:21:42.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.828+0000 7ff4d7fff700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 0x7ff4c00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:42.832 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:42.832 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":50,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:40.480060+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:10:38.160449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-10T01:10:38.948072+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":219,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:6832/116173":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3349551008":"2023-05-11T01:10:52.178304+0000","172.21.15.172:0/3297537909":"2023-05-11T01:10:52.178304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":7,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":16,"length":1},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":26,"length":1},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":36,"length":1},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":46,"length":1},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":56,"length":1},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":66,"length":1},{"begin":69,"length":2},{"begin":72,"length":2},{"begin":76,"length":1},{"begin":79,"length":2},{"begin":82,"length":2},{"begin":86,"length":1},{"begin":89,"length":2},{"begin":92,"length":1},{"begin":96,"length":1},{"begin":99,"length":2},{"begin":102,"length":1},{"begin":105,"length":2},{"begin":109,"length":2},{"begin":154,"length":53}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:42.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.829+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 msgr2=0x7ff4c00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:42.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.829+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 0x7ff4c00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.829+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 msgr2=0x7ff4d814d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.829+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff4d8083050 tx=0x7ff4cc017000).stop 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 shutdown_connections 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff4c005ee20 0x7ff4c00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4d8154540 0x7ff4d80c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4d8069690 0x7ff4d814d950 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 --2- 172.21.15.52:0/3478184329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4d8154160 0x7ff4d80c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 >> 172.21.15.52:0/3478184329 conn(0x7ff4d80cb6f0 msgr2=0x7ff4d80c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 shutdown_connections 2023-05-10T01:21:42.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.830+0000 7ff4debeb700 1 -- 172.21.15.52:0/3478184329 wait complete. 2023-05-10T01:21:42.838 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.835+0000 7f1115dd4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:21:42.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:21:42.883 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:42.880+0000 7f96ac8ec680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:21:42.906 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:42.903+0000 7f1115dd4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:21:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.965+0000 7fc4e84be700 1 Processor -- start 2023-05-10T01:21:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.965+0000 7fc4e84be700 1 -- start start 2023-05-10T01:21:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e84be700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0153ea0 0x7fc4e0154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e84be700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4e0064ff0 0x7fc4e0065480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e84be700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e0067550 con 0x7fc4e0068c60 2023-05-10T01:21:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e84be700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e0065970 con 0x7fc4e0064ff0 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e84be700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00bc9a0 con 0x7fc4e0153ea0 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4e0064ff0 0x7fc4e0065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4e0064ff0 0x7fc4e0065480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33164/0 (socket says 172.21.15.52:33164) 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 -- 172.21.15.52:0/4177432224 learned_addr learned my addr 172.21.15.52:0/4177432224 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e625a700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0153ea0 0x7fc4e0154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 -- 172.21.15.52:0/4177432224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0153ea0 msgr2=0x7fc4e0154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0153ea0 0x7fc4e0154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 -- 172.21.15.52:0/4177432224 >> v1:172.21.15.172:6789/0 conn(0x7fc4e0068c60 legacy=0x7fc4e0066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 -- 172.21.15.52:0/4177432224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00bcc80 con 0x7fc4e0064ff0 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e6a5b700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0064ff0 0x7fc4e0065480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fc4d8009f20 tx=0x7fc4d8009840).ready entity=mon.0 client_cookie=2da3fa099a59d55c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e5258700 1 -- 172.21.15.52:0/4177432224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800e070 con 0x7fc4e0064ff0 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e5258700 1 -- 172.21.15.52:0/4177432224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d800ba80 con 0x7fc4e0064ff0 2023-05-10T01:21:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.966+0000 7fc4e5258700 1 -- 172.21.15.52:0/4177432224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800be00 con 0x7fc4e0064ff0 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 -- 172.21.15.52:0/4177432224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0064ff0 msgr2=0x7fc4e0065480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0064ff0 0x7fc4e0065480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fc4d8009f20 tx=0x7fc4d8009840).stop 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 -- 172.21.15.52:0/4177432224 shutdown_connections 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0153ea0 0x7fc4e0154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 --2- 172.21.15.52:0/4177432224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0064ff0 0x7fc4e0065480 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 -- 172.21.15.52:0/4177432224 >> 172.21.15.52:0/4177432224 conn(0x7fc4e00c4420 msgr2=0x7fc4e00c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:42.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 -- 172.21.15.52:0/4177432224 shutdown_connections 2023-05-10T01:21:42.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.967+0000 7fc4e84be700 1 -- 172.21.15.52:0/4177432224 wait complete. 2023-05-10T01:21:42.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.968+0000 7fc4e84be700 1 Processor -- start 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.968+0000 7fc4e84be700 1 -- start start 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0064ff0 0x7fc4e01465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0146ae0 0x7fc4e00ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00c3450 con 0x7fc4e0153ea0 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00abfa0 con 0x7fc4e0146ae0 2023-05-10T01:21:42.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e84be700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00ac280 con 0x7fc4e0064ff0 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e5a59700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e5a59700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33170/0 (socket says 172.21.15.52:33170) 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e5a59700 1 -- 172.21.15.52:0/1562688233 learned_addr learned my addr 172.21.15.52:0/1562688233 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e6a5b700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0146ae0 0x7fc4e00ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.969+0000 7fc4e625a700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0064ff0 0x7fc4e01465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0064ff0 msgr2=0x7fc4e01465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0064ff0 0x7fc4e01465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0146ae0 msgr2=0x7fc4e00ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0146ae0 0x7fc4e00ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 -- 172.21.15.52:0/1562688233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8009ae0 con 0x7fc4e0153ea0 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e5a59700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fc4d000c440 tx=0x7fc4d0007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0007020 con 0x7fc4e0153ea0 2023-05-10T01:21:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0001e90 con 0x7fc4e0153ea0 2023-05-10T01:21:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00beba0 con 0x7fc4e0153ea0 2023-05-10T01:21:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00073b0 con 0x7fc4e0153ea0 2023-05-10T01:21:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.970+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e00c1080 con 0x7fc4e0153ea0 2023-05-10T01:21:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.971+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00bea00 con 0x7fc4e0153ea0 2023-05-10T01:21:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.972+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 11) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc4d0010070 con 0x7fc4e0153ea0 2023-05-10T01:21:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.972+0000 7fc4ce7fc700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.973+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6730+0+0 (secure 0 0 0) 0x7fc4d0079890 con 0x7fc4e0153ea0 2023-05-10T01:21:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.973+0000 7fc4e625a700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 msgr2=0x7fc4c00612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.973+0000 7fc4e625a700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:21:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:42.976+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4d004ab20 con 0x7fc4e0153ea0 2023-05-10T01:21:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.174+0000 7fc4e625a700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 msgr2=0x7fc4c00612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.174+0000 7fc4e625a700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:21:43.190 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:43.184+0000 7f96ac8ec680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:21:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.195+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc4e0067550 con 0x7fc4e0153ea0 2023-05-10T01:21:43.261 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:21:43.258+0000 7f96ac8ec680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:21:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.575+0000 7fc4e625a700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 msgr2=0x7fc4c00612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:21:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.575+0000 7fc4e625a700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:21:43.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.720+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fc4d0077480 con 0x7fc4e0153ea0 2023-05-10T01:21:43.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.721+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 msgr2=0x7fc4c00612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:21:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.721+0000 7fc4ce7fc700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:43.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1095db9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1095db9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1098dbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1095db9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1098dbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1095db9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1098dbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1095db9700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1098dbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:21:43.777+0000 7f1098dbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:21:43.785 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:21:43.782+0000 7f44139dc700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:21:43.785 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:21:43.782+0000 7f44139dc700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:21:43.786 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:21:43.782+0000 7f44139dc700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:21:43.800 INFO:tasks.ceph.mds.c.smithi052.stderr: -5> 2023-05-10T01:21:43.782+0000 7f44139dc700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:21:43.801 INFO:tasks.ceph.mds.c.smithi052.stderr: -3> 2023-05-10T01:21:43.782+0000 7f44139dc700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:21:43.801 INFO:tasks.ceph.mds.c.smithi052.stderr: -1> 2023-05-10T01:21:43.782+0000 7f44139dc700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:21:43.821 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:21:43.925 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:21:43.922+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:21:43.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.924+0000 7fc4ce7fc700 1 -- 172.21.15.52:0/1562688233 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc4d0077000 con 0x7fc4e0153ea0 2023-05-10T01:21:43.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 msgr2=0x7fc4e00ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fc4d000c440 tx=0x7fc4d0007d70).stop 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 shutdown_connections 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc4c005edf0 0x7fc4c00612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0146ae0 0x7fc4e00ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4e0064ff0 0x7fc4e01465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 --2- 172.21.15.52:0/1562688233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0153ea0 0x7fc4e00ab430 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:43.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 >> 172.21.15.52:0/1562688233 conn(0x7fc4e00c4420 msgr2=0x7fc4e00a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:43.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 shutdown_connections 2023-05-10T01:21:43.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:43.926+0000 7fc4e84be700 1 -- 172.21.15.52:0/1562688233 wait complete. 2023-05-10T01:21:43.931 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:21:43.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:21:44.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.101+0000 7f7baabc6700 1 Processor -- start 2023-05-10T01:21:44.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.101+0000 7f7baabc6700 1 -- start start 2023-05-10T01:21:44.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7baabc6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ba40cb410 0x7f7ba41544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7baabc6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7baabc6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40c6310 con 0x7f7ba4154110 2023-05-10T01:21:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7baabc6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba40c6830 con 0x7f7ba40cb410 2023-05-10T01:21:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7baabc6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba41550e0 con 0x7f7ba4155570 2023-05-10T01:21:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ba40cb410 0x7f7ba41544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:44.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ba40cb410 0x7f7ba41544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33206/0 (socket says 172.21.15.52:33206) 2023-05-10T01:21:44.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 -- 172.21.15.52:0/2965934832 learned_addr learned my addr 172.21.15.52:0/2965934832 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba9163700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 -- 172.21.15.52:0/2965934832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 msgr2=0x7f7ba4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 -- 172.21.15.52:0/2965934832 >> v1:172.21.15.52:6789/0 conn(0x7f7ba4154110 legacy=0x7f7ba40c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba3fff700 1 -- 172.21.15.52:0/2965934832 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40c6550 con 0x7f7ba40cb410 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.102+0000 7f7ba9163700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:44.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7ba3fff700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba41544f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7b94009f20 tx=0x7f7b94009840).ready entity=mon.0 client_cookie=661b0e955c4a270c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7ba37fe700 1 -- 172.21.15.52:0/2965934832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400e070 con 0x7f7ba40cb410 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7ba37fe700 1 -- 172.21.15.52:0/2965934832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400ba80 con 0x7f7ba40cb410 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7ba37fe700 1 -- 172.21.15.52:0/2965934832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400be00 con 0x7f7ba40cb410 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 -- 172.21.15.52:0/2965934832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 msgr2=0x7f7ba41544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba41544f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7b94009f20 tx=0x7f7b94009840).stop 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 -- 172.21.15.52:0/2965934832 shutdown_connections 2023-05-10T01:21:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:44.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 --2- 172.21.15.52:0/2965934832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba41544f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:44.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 -- 172.21.15.52:0/2965934832 >> 172.21.15.52:0/2965934832 conn(0x7f7ba40678d0 msgr2=0x7f7ba40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:44.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 -- 172.21.15.52:0/2965934832 shutdown_connections 2023-05-10T01:21:44.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.103+0000 7f7baabc6700 1 -- 172.21.15.52:0/2965934832 wait complete. 2023-05-10T01:21:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.104+0000 7f7baabc6700 1 Processor -- start 2023-05-10T01:21:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 -- start start 2023-05-10T01:21:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba4154110 0x7f7ba40c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c4d50 con 0x7f7ba40cb410 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c21b0 con 0x7f7ba4154110 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7baabc6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c3000 con 0x7f7ba4155570 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7ba8962700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7ba8962700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33208/0 (socket says 172.21.15.52:33208) 2023-05-10T01:21:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.105+0000 7f7ba8962700 1 -- 172.21.15.52:0/1994425244 learned_addr learned my addr 172.21.15.52:0/1994425244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 -- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 msgr2=0x7f7ba4145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 -- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba4154110 msgr2=0x7f7ba40c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba4154110 0x7f7ba40c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 -- 172.21.15.52:0/1994425244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009ae0 con 0x7f7ba40cb410 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba8962700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f7b9c00c4c0 tx=0x7f7b9c007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:44.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c013450 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0135b0 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba40c23f0 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c013930 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.106+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba40c29b0 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.107+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba4066720 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.107+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 12) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f7b9c010070 con 0x7f7ba40cb410 2023-05-10T01:21:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.108+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f7b9c079590 con 0x7f7ba40cb410 2023-05-10T01:21:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.112+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b9c04a920 con 0x7f7ba40cb410 2023-05-10T01:21:44.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.333+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ba40c6310 con 0x7f7ba40cb410 2023-05-10T01:21:44.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.724+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f7b9c077280 con 0x7f7ba40cb410 2023-05-10T01:21:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.724+0000 7f7ba0ff9700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 0x7f7b88067900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:44.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.727+0000 7f7ba3fff700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 0x7f7b88067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.728+0000 7f7ba3fff700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 0x7f7b88067900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7ba40c1600 tx=0x7f7ba4155220).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.925+0000 7f7ba0ff9700 1 -- 172.21.15.52:0/1994425244 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b9c0737a0 con 0x7f7ba40cb410 2023-05-10T01:21:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 msgr2=0x7f7b88067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 0x7f7b88067900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7ba40c1600 tx=0x7f7ba4155220).stop 2023-05-10T01:21:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 msgr2=0x7f7ba40c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f7b9c00c4c0 tx=0x7f7b9c007d80).stop 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 shutdown_connections 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b880301b0 0x7f7b88067900 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ba4155570 0x7f7ba4145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba40cb410 0x7f7ba40c4860 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 --2- 172.21.15.52:0/1994425244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba4154110 0x7f7ba40c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 >> 172.21.15.52:0/1994425244 conn(0x7f7ba40678d0 msgr2=0x7f7ba40ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 shutdown_connections 2023-05-10T01:21:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:44.928+0000 7f7baabc6700 1 -- 172.21.15.52:0/1994425244 wait complete. 2023-05-10T01:21:44.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:21:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.070+0000 7fbee2ed9700 1 Processor -- start 2023-05-10T01:21:45.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.070+0000 7fbee2ed9700 1 -- start start 2023-05-10T01:21:45.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee2ed9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee2ed9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbedc155570 0x7fbedc068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee2ed9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0c6310 con 0x7fbedc154110 2023-05-10T01:21:45.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee2ed9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0c6830 con 0x7fbedc155570 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee2ed9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc1550e0 con 0x7fbedc0cb410 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee0c75700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbedc154110 0x7fbedc0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42248/0 (socket says 172.21.15.52:42248) 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee0c75700 1 -- 172.21.15.52:0/3893923742 learned_addr learned my addr 172.21.15.52:0/3893923742 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.071+0000 7fbee1476700 1 --2- 172.21.15.52:0/3893923742 >> v2:172.21.15.52:3300/0 conn(0x7fbedc155570 0x7fbedc068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedb7fe700 1 -- 172.21.15.52:0/3893923742 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112856459 0 0) 0x7fbed4001610 con 0x7fbedc154110 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedbfff700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedb7fe700 1 -- 172.21.15.52:0/3893923742 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec80033f0 con 0x7fbedc154110 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee1476700 1 -- 172.21.15.52:0/3893923742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 msgr2=0x7fbedc1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee1476700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee1476700 1 -- 172.21.15.52:0/3893923742 >> v1:172.21.15.52:6789/0 conn(0x7fbedc154110 legacy=0x7fbedc0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee1476700 1 -- 172.21.15.52:0/3893923742 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0c6550 con 0x7fbedc155570 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee1476700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc155570 0x7fbedc068150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fbecc009790 tx=0x7fbecc009060).ready entity=mon.0 client_cookie=57444179273fc8a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedb7fe700 1 -- 172.21.15.52:0/3893923742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00f510 con 0x7fbedc155570 2023-05-10T01:21:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedb7fe700 1 -- 172.21.15.52:0/3893923742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00f670 con 0x7fbedc155570 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbedb7fe700 1 -- 172.21.15.52:0/3893923742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00f9f0 con 0x7fbedc155570 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 -- 172.21.15.52:0/3893923742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc155570 msgr2=0x7fbedc068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc155570 0x7fbedc068150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fbecc009790 tx=0x7fbecc009060).stop 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 -- 172.21.15.52:0/3893923742 shutdown_connections 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc155570 0x7fbedc068150 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/3893923742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.072+0000 7fbee2ed9700 1 -- 172.21.15.52:0/3893923742 >> 172.21.15.52:0/3893923742 conn(0x7fbedc0678d0 msgr2=0x7fbedc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.073+0000 7fbee2ed9700 1 -- 172.21.15.52:0/3893923742 shutdown_connections 2023-05-10T01:21:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.073+0000 7fbee2ed9700 1 -- 172.21.15.52:0/3893923742 wait complete. 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.074+0000 7fbee2ed9700 1 Processor -- start 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.074+0000 7fbee2ed9700 1 -- start start 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.074+0000 7fbee2ed9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbedc155570 0x7fbedc0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc14d2d0 con 0x7fbedc154110 2023-05-10T01:21:45.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ab3e0 con 0x7fbedc155570 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ab6c0 con 0x7fbedc0cb410 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33240/0 (socket says 172.21.15.52:33240) 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 -- 172.21.15.52:0/2979767111 learned_addr learned my addr 172.21.15.52:0/2979767111 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee0c75700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee1476700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbedc155570 0x7fbedc0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 -- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 msgr2=0x7fbedc0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc0aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 -- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbedc155570 msgr2=0x7fbedc0ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbedc155570 0x7fbedc0ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 -- 172.21.15.52:0/2979767111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0092a0 con 0x7fbedc154110 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbedbfff700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbed000d890 tx=0x7fbed0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed00125f0 con 0x7fbedc154110 2023-05-10T01:21:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed0012750 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0ab9a0 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0012ad0 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.075+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc14e0e0 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.076+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc14df40 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.077+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fbed0013480 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.077+0000 7fbed8ff9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 0x7fbebc0611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.077+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6816+0+0 (secure 0 0 0) 0x7fbed0079b40 con 0x7fbedc154110 2023-05-10T01:21:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.077+0000 7fbee0c75700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 0x7fbebc0611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:45.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.078+0000 7fbee0c75700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 0x7fbebc0611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbed4000f80 tx=0x7fbed4009040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:45.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.081+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbedc14df40 con 0x7fbedc154110 2023-05-10T01:21:45.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.257+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbedc066720 con 0x7fbedc154110 2023-05-10T01:21:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.927+0000 7fbed8ff9700 1 -- 172.21.15.52:0/2979767111 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbed004ae70 con 0x7fbedc154110 2023-05-10T01:21:45.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 msgr2=0x7fbebc0611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 0x7fbebc0611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbed4000f80 tx=0x7fbed4009040).stop 2023-05-10T01:21:45.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 msgr2=0x7fbedc150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:45.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbed000d890 tx=0x7fbed0008040).stop 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 shutdown_connections 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbebc05ed20 0x7fbebc0611e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbedc155570 0x7fbedc0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbedc0cb410 0x7fbedc0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 --2- 172.21.15.52:0/2979767111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbedc154110 0x7fbedc150260 secure :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0x7fbed000d890 tx=0x7fbed0008040).stop 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 >> 172.21.15.52:0/2979767111 conn(0x7fbedc0678d0 msgr2=0x7fbedc0c02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 shutdown_connections 2023-05-10T01:21:45.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:45.931+0000 7fbee2ed9700 1 -- 172.21.15.52:0/2979767111 wait complete. 2023-05-10T01:21:45.937 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:21:45.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:21:46.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 Processor -- start 2023-05-10T01:21:46.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 -- start start 2023-05-10T01:21:46.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 0x7fecb0063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fecb00622a0 0x7fecb00626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb00bf940 con 0x7fecb01540d0 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb0067f50 con 0x7fecb00622a0 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.084+0000 7fecb55aa700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00a7c80 con 0x7fecb0153cf0 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fecb00622a0 0x7fecb00626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecae7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fecb01540d0 0x7fecb00bf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42264/0 (socket says 172.21.15.52:42264) 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecae7fc700 1 -- 172.21.15.52:0/689782953 learned_addr learned my addr 172.21.15.52:0/689782953 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaeffd700 1 --2- 172.21.15.52:0/689782953 >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 0x7fecb0063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 -- 172.21.15.52:0/689782953 >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 msgr2=0x7fecb0063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 --2- 172.21.15.52:0/689782953 >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 0x7fecb0063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecadffb700 1 -- 172.21.15.52:0/689782953 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665307319 0 0) 0x7fecb00bf940 con 0x7fecb01540d0 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 -- 172.21.15.52:0/689782953 >> v1:172.21.15.52:6789/0 conn(0x7fecb01540d0 legacy=0x7fecb00bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 -- 172.21.15.52:0/689782953 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0062bd0 con 0x7fecb00622a0 2023-05-10T01:21:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaeffd700 1 --2- 172.21.15.52:0/689782953 >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 0x7fecb0063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecaf7fe700 1 --2- 172.21.15.52:0/689782953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb00622a0 0x7fecb00626e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fecb005ec80 tx=0x7feca0006f90).ready entity=mon.0 client_cookie=122946b2df1c5d06 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecadffb700 1 -- 172.21.15.52:0/689782953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00058d0 con 0x7fecb00622a0 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecadffb700 1 -- 172.21.15.52:0/689782953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0005a30 con 0x7fecb00622a0 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.085+0000 7fecadffb700 1 -- 172.21.15.52:0/689782953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0005db0 con 0x7fecb00622a0 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 -- 172.21.15.52:0/689782953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb00622a0 msgr2=0x7fecb00626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 --2- 172.21.15.52:0/689782953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb00622a0 0x7fecb00626e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fecb005ec80 tx=0x7feca0006f90).stop 2023-05-10T01:21:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 -- 172.21.15.52:0/689782953 shutdown_connections 2023-05-10T01:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 --2- 172.21.15.52:0/689782953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb00622a0 0x7fecb00626e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 --2- 172.21.15.52:0/689782953 >> v2:172.21.15.172:3300/0 conn(0x7fecb0153cf0 0x7fecb0063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 -- 172.21.15.52:0/689782953 >> 172.21.15.52:0/689782953 conn(0x7fecb005e810 msgr2=0x7fecb00c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 -- 172.21.15.52:0/689782953 shutdown_connections 2023-05-10T01:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.086+0000 7fecb55aa700 1 -- 172.21.15.52:0/689782953 wait complete. 2023-05-10T01:21:46.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.087+0000 7fecb55aa700 1 Processor -- start 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.087+0000 7fecb55aa700 1 -- start start 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecb00622a0 0x7fecb014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 0x7fecb0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb015a670 con 0x7fecb01540d0 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00bfb20 con 0x7fecb0153cf0 2023-05-10T01:21:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00c06a0 con 0x7fecb00622a0 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33256/0 (socket says 172.21.15.52:33256) 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 -- 172.21.15.52:0/1483054659 learned_addr learned my addr 172.21.15.52:0/1483054659 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecae7fc700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 0x7fecb0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaeffd700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecb00622a0 0x7fecb014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 -- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecb00622a0 msgr2=0x7fecb014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecb00622a0 0x7fecb014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 -- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 msgr2=0x7fecb0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 0x7fecb0159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 -- 172.21.15.52:0/1483054659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009290 con 0x7fecb01540d0 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecae7fc700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 0x7fecb0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecaf7fe700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feca0009e70 tx=0x7feca0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000b880 con 0x7fecb01540d0 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000b9e0 con 0x7fecb01540d0 2023-05-10T01:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb014dc50 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.088+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000bd60 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.089+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb00c0050 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.089+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb00a7ad0 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.090+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feca0023030 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.090+0000 7feca6ffd700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 0x7fec94061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.090+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feca007a960 con 0x7fecb01540d0 2023-05-10T01:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.091+0000 7fecaeffd700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 0x7fec94061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.091+0000 7fecaeffd700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 0x7fec94061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7feca800aa70 tx=0x7feca8008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.094+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feca004beb0 con 0x7fecb01540d0 2023-05-10T01:21:46.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.267+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fecb00c07e0 con 0x7fecb01540d0 2023-05-10T01:21:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.935+0000 7feca6ffd700 1 -- 172.21.15.52:0/1483054659 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7feca0021020 con 0x7fecb01540d0 2023-05-10T01:21:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.939+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 msgr2=0x7fec94061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.939+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 0x7fec94061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7feca800aa70 tx=0x7feca8008040).stop 2023-05-10T01:21:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.939+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 msgr2=0x7fecb015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.939+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feca0009e70 tx=0x7feca0016000).stop 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 shutdown_connections 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec9405ed90 0x7fec94061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb01540d0 0x7fecb015a180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecb00622a0 0x7fecb014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 --2- 172.21.15.52:0/1483054659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecb0153cf0 0x7fecb0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:46.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 >> 172.21.15.52:0/1483054659 conn(0x7fecb005e810 msgr2=0x7fecb00c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 shutdown_connections 2023-05-10T01:21:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:46.940+0000 7fecb55aa700 1 -- 172.21.15.52:0/1483054659 wait complete. 2023-05-10T01:21:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:21:46.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:21:47.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.081+0000 7f5492ab8700 1 Processor -- start 2023-05-10T01:21:47.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.081+0000 7f5492ab8700 1 -- start start 2023-05-10T01:21:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5492ab8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f548c14e200 0x7f548c14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5492ab8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f548c157bd0 0x7f548c158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5492ab8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c158570 con 0x7f548c068b90 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5492ab8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c06a460 con 0x7f548c14e200 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5492ab8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c137660 con 0x7f548c157bd0 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f548c14e200 0x7f548c14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f548c14e200 0x7f548c14e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33260/0 (socket says 172.21.15.52:33260) 2023-05-10T01:21:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 -- 172.21.15.52:0/2791808862 learned_addr learned my addr 172.21.15.52:0/2791808862 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5491055700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f548c068b90 0x7f548c068fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42280/0 (socket says 172.21.15.52:42280) 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 -- 172.21.15.52:0/2791808862 >> v2:172.21.15.172:3300/0 conn(0x7f548c157bd0 msgr2=0x7f548c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 --2- 172.21.15.52:0/2791808862 >> v2:172.21.15.172:3300/0 conn(0x7f548c157bd0 0x7f548c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 -- 172.21.15.52:0/2791808862 >> v1:172.21.15.52:6789/0 conn(0x7f548c068b90 legacy=0x7f548c068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 -- 172.21.15.52:0/2791808862 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0697e0 con 0x7f548c14e200 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f548b7fe700 1 -- 172.21.15.52:0/2791808862 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712888634 0 0) 0x7f5474001110 con 0x7f548c068b90 2023-05-10T01:21:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f5490854700 1 --2- 172.21.15.52:0/2791808862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c14e200 0x7f548c14e5e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f548c0bdb40 tx=0x7f54840090f0).ready entity=mon.0 client_cookie=d07e02a2bfc99278 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f548b7fe700 1 -- 172.21.15.52:0/2791808862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400b600 con 0x7f548c14e200 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f548b7fe700 1 -- 172.21.15.52:0/2791808862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400b760 con 0x7f548c14e200 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.082+0000 7f548b7fe700 1 -- 172.21.15.52:0/2791808862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400bb00 con 0x7f548c14e200 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 -- 172.21.15.52:0/2791808862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c14e200 msgr2=0x7f548c14e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 --2- 172.21.15.52:0/2791808862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c14e200 0x7f548c14e5e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f548c0bdb40 tx=0x7f54840090f0).stop 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 -- 172.21.15.52:0/2791808862 shutdown_connections 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 --2- 172.21.15.52:0/2791808862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c14e200 0x7f548c14e5e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 --2- 172.21.15.52:0/2791808862 >> v2:172.21.15.172:3300/0 conn(0x7f548c157bd0 0x7f548c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:47.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 -- 172.21.15.52:0/2791808862 >> 172.21.15.52:0/2791808862 conn(0x7f548c0c45f0 msgr2=0x7f548c066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:47.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 -- 172.21.15.52:0/2791808862 shutdown_connections 2023-05-10T01:21:47.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.083+0000 7f5492ab8700 1 -- 172.21.15.52:0/2791808862 wait complete. 2023-05-10T01:21:47.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.084+0000 7f5492ab8700 1 Processor -- start 2023-05-10T01:21:47.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.084+0000 7f5492ab8700 1 -- start start 2023-05-10T01:21:47.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f548c068b90 0x7f548c169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f548c14e200 0x7f548c0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c16c890 con 0x7f548c157bd0 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0a9c70 con 0x7f548c14e200 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5492ab8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c16bc10 con 0x7f548c068b90 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5491055700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5491055700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33270/0 (socket says 172.21.15.52:33270) 2023-05-10T01:21:47.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5491055700 1 -- 172.21.15.52:0/3563712673 learned_addr learned my addr 172.21.15.52:0/3563712673 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5490854700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f548c068b90 0x7f548c169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f548bfff700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f548c14e200 0x7f548c0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.085+0000 7f5491055700 1 -- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f548c068b90 msgr2=0x7f548c169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5491055700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f548c068b90 0x7f548c169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5491055700 1 -- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f548c14e200 msgr2=0x7f548c0a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5491055700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f548c14e200 0x7f548c0a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5491055700 1 -- 172.21.15.52:0/3563712673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009370 con 0x7f548c157bd0 2023-05-10T01:21:47.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5491055700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f547400c490 tx=0x7f5474007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400ce70 con 0x7f548c157bd0 2023-05-10T01:21:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54740072e0 con 0x7f548c157bd0 2023-05-10T01:21:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740056e0 con 0x7f548c157bd0 2023-05-10T01:21:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c16bef0 con 0x7f548c157bd0 2023-05-10T01:21:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.086+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c16c4b0 con 0x7f548c157bd0 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.087+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c16c9d0 con 0x7f548c157bd0 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.087+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5474010070 con 0x7f548c157bd0 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.087+0000 7f5488ff9700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 0x7f5470061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.088+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5474078e10 con 0x7f548c157bd0 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.088+0000 7f5490854700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 0x7f5470061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.088+0000 7f5490854700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 0x7f5470061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f548400b3c0 tx=0x7f5484017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.092+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f548c16c9d0 con 0x7f548c157bd0 2023-05-10T01:21:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.265+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f548c158570 con 0x7f548c157bd0 2023-05-10T01:21:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.268+0000 7f5488ff9700 1 -- 172.21.15.52:0/3563712673 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v4) v1 ==== 120+0+0 (secure 0 0 0) 0x7f548c158570 con 0x7f548c157bd0 2023-05-10T01:21:47.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 msgr2=0x7f5470061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 0x7f5470061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f548400b3c0 tx=0x7f5484017000).stop 2023-05-10T01:21:47.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 msgr2=0x7f548c1356d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f547400c490 tx=0x7f5474007d90).stop 2023-05-10T01:21:47.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 shutdown_connections 2023-05-10T01:21:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f547005ed90 0x7f5470061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f548c157bd0 0x7f548c1356d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f548c068b90 0x7f548c169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 --2- 172.21.15.52:0/3563712673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f548c14e200 0x7f548c0a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 >> 172.21.15.52:0/3563712673 conn(0x7f548c0c45f0 msgr2=0x7f548c1518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 shutdown_connections 2023-05-10T01:21:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.270+0000 7f5492ab8700 1 -- 172.21.15.52:0/3563712673 wait complete. 2023-05-10T01:21:47.286 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:21:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.401+0000 7f55da3c6700 1 Processor -- start 2023-05-10T01:21:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.401+0000 7f55da3c6700 1 -- start start 2023-05-10T01:21:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55da3c6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55d4154080 0x7f55d40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55da3c6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 0x7f55d40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55da3c6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40c94c0 con 0x7f55d40aa140 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55da3c6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d40aa5b0 con 0x7f55d4154080 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55da3c6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40cb7d0 con 0x7f55d4154460 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55d4154080 0x7f55d40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55d4154080 0x7f55d40aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33274/0 (socket says 172.21.15.52:33274) 2023-05-10T01:21:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 -- 172.21.15.52:0/1933658485 learned_addr learned my addr 172.21.15.52:0/1933658485 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d37fe700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 0x7f55d40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 -- 172.21.15.52:0/1933658485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 msgr2=0x7f55d40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 0x7f55d40a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 -- 172.21.15.52:0/1933658485 >> v1:172.21.15.172:6789/0 conn(0x7f55d40aa140 legacy=0x7f55d4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 -- 172.21.15.52:0/1933658485 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40c88b0 con 0x7f55d4154080 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d37fe700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 0x7f55d40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d3fff700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d4154080 0x7f55d40aac90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f55bc006fd0 tx=0x7f55bc0090f0).ready entity=mon.0 client_cookie=bb7ebd438d7f0d86 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d2ffd700 1 -- 172.21.15.52:0/1933658485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00b600 con 0x7f55d4154080 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d2ffd700 1 -- 172.21.15.52:0/1933658485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00b760 con 0x7f55d4154080 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.402+0000 7f55d2ffd700 1 -- 172.21.15.52:0/1933658485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00bae0 con 0x7f55d4154080 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 -- 172.21.15.52:0/1933658485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d4154080 msgr2=0x7f55d40aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d4154080 0x7f55d40aac90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f55bc006fd0 tx=0x7f55bc0090f0).stop 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 -- 172.21.15.52:0/1933658485 shutdown_connections 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d4154080 0x7f55d40aac90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 --2- 172.21.15.52:0/1933658485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154460 0x7f55d40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 -- 172.21.15.52:0/1933658485 >> 172.21.15.52:0/1933658485 conn(0x7f55d4067910 msgr2=0x7f55d40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 -- 172.21.15.52:0/1933658485 shutdown_connections 2023-05-10T01:21:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.403+0000 7f55da3c6700 1 -- 172.21.15.52:0/1933658485 wait complete. 2023-05-10T01:21:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.404+0000 7f55da3c6700 1 Processor -- start 2023-05-10T01:21:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.404+0000 7f55da3c6700 1 -- start start 2023-05-10T01:21:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154080 0x7f55d414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55d4154460 0x7f55d414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4150430 con 0x7f55d40aa140 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d413c3f0 con 0x7f55d4154460 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55da3c6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4156810 con 0x7f55d4154080 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33278/0 (socket says 172.21.15.52:33278) 2023-05-10T01:21:47.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 -- 172.21.15.52:0/626229528 learned_addr learned my addr 172.21.15.52:0/626229528 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d37fe700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154080 0x7f55d414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d8963700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55d4154460 0x7f55d414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 -- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154080 msgr2=0x7f55d414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154080 0x7f55d414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 -- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55d4154460 msgr2=0x7f55d414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55d4154460 0x7f55d414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.405+0000 7f55d3fff700 1 -- 172.21.15.52:0/626229528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009370 con 0x7f55d40aa140 2023-05-10T01:21:47.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55d3fff700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f55d406bb20 tx=0x7f55bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00b8d0 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00ba30 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d4156af0 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc01c670 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.406+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d41570b0 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.407+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d4066720 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.407+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f55bc00f070 con 0x7f55d40aa140 2023-05-10T01:21:47.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.407+0000 7f55cbfff700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 0x7f55b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.407+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f55bc07b080 con 0x7f55d40aa140 2023-05-10T01:21:47.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.408+0000 7f55d37fe700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 0x7f55b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.408+0000 7f55d37fe700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 0x7f55b8061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f55d413f800 tx=0x7f55c4008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.411+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55bc04c790 con 0x7f55d40aa140 2023-05-10T01:21:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.584+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f55d413fb30 con 0x7f55d40aa140 2023-05-10T01:21:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.587+0000 7f55cbfff700 1 -- 172.21.15.52:0/626229528 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55bc0200a0 con 0x7f55d40aa140 2023-05-10T01:21:47.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 msgr2=0x7f55b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 0x7f55b8061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f55d413f800 tx=0x7f55c4008040).stop 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 msgr2=0x7f55d413bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f55d406bb20 tx=0x7f55bc017000).stop 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 shutdown_connections 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f55b805ed90 0x7f55b8061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55d4154460 0x7f55d414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55d40aa140 0x7f55d413bf00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 --2- 172.21.15.52:0/626229528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55d4154080 0x7f55d414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 >> 172.21.15.52:0/626229528 conn(0x7f55d4067910 msgr2=0x7f55d4153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 shutdown_connections 2023-05-10T01:21:47.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.589+0000 7f55da3c6700 1 -- 172.21.15.52:0/626229528 wait complete. 2023-05-10T01:21:47.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-05-10T01:21:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.717+0000 7f07bb28f700 1 Processor -- start 2023-05-10T01:21:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.717+0000 7f07bb28f700 1 -- start start 2023-05-10T01:21:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07bb28f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f07b4154540 0x7f07b4069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07bb28f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07b4069b80 0x7f07b40c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07bb28f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40c0650 con 0x7f07b4154160 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07bb28f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4069fb0 con 0x7f07b4069b80 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07bb28f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b40bfd20 con 0x7f07b4154540 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07b4069b80 0x7f07b40c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07b4069b80 0x7f07b40c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33288/0 (socket says 172.21.15.52:33288) 2023-05-10T01:21:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 -- 172.21.15.52:0/301866242 learned_addr learned my addr 172.21.15.52:0/301866242 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b882a700 1 --2- 172.21.15.52:0/301866242 >> v2:172.21.15.172:3300/0 conn(0x7f07b4154540 0x7f07b4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 -- 172.21.15.52:0/301866242 >> v2:172.21.15.172:3300/0 conn(0x7f07b4154540 msgr2=0x7f07b4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 --2- 172.21.15.52:0/301866242 >> v2:172.21.15.172:3300/0 conn(0x7f07b4154540 0x7f07b4069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 -- 172.21.15.52:0/301866242 >> v1:172.21.15.172:6789/0 conn(0x7f07b4154160 legacy=0x7f07b40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.718+0000 7f07b982c700 1 -- 172.21.15.52:0/301866242 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40c0000 con 0x7f07b4069b80 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07b982c700 1 --2- 172.21.15.52:0/301866242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40c0ae0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f07b406a780 tx=0x7f07a4009840).ready entity=mon.0 client_cookie=6c218352e7e52627 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07b3fff700 1 -- 172.21.15.52:0/301866242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e070 con 0x7f07b4069b80 2023-05-10T01:21:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07b3fff700 1 -- 172.21.15.52:0/301866242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400ba50 con 0x7f07b4069b80 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07b3fff700 1 -- 172.21.15.52:0/301866242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400bdd0 con 0x7f07b4069b80 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 -- 172.21.15.52:0/301866242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 msgr2=0x7f07b40c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 --2- 172.21.15.52:0/301866242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40c0ae0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f07b406a780 tx=0x7f07a4009840).stop 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 -- 172.21.15.52:0/301866242 shutdown_connections 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 --2- 172.21.15.52:0/301866242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40c0ae0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 --2- 172.21.15.52:0/301866242 >> v2:172.21.15.172:3300/0 conn(0x7f07b4154540 0x7f07b4069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 -- 172.21.15.52:0/301866242 >> 172.21.15.52:0/301866242 conn(0x7f07b40cb740 msgr2=0x7f07b40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 -- 172.21.15.52:0/301866242 shutdown_connections 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.719+0000 7f07bb28f700 1 -- 172.21.15.52:0/301866242 wait complete. 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.720+0000 7f07bb28f700 1 Processor -- start 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.720+0000 7f07bb28f700 1 -- start start 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07b4154160 0x7f07b4151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 0x7f07b4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4156c40 con 0x7f07b4069b80 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40aef30 con 0x7f07b4154540 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07bb28f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40af210 con 0x7f07b4154160 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.721+0000 7f07b902b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33292/0 (socket says 172.21.15.52:33292) 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 -- 172.21.15.52:0/575927765 learned_addr learned my addr 172.21.15.52:0/575927765 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b982c700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 0x7f07b4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b882a700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07b4154160 0x7f07b4151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 -- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07b4154160 msgr2=0x7f07b4151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07b4154160 0x7f07b4151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 -- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 msgr2=0x7f07b4158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 0x7f07b4158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 -- 172.21.15.52:0/575927765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009ae0 con 0x7f07b4069b80 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b982c700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 0x7f07b4158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b902b700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f07ac00c440 tx=0x7f07ac007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00f470 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac00f5d0 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b40af4f0 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00f970 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.722+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40aeb20 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.723+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40666b0 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.723+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f07ac019030 con 0x7f07b4069b80 2023-05-10T01:21:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.724+0000 7f07b17fa700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 0x7f0794061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.724+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f07ac078db0 con 0x7f07b4069b80 2023-05-10T01:21:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.724+0000 7f07b882a700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 0x7f0794061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.725+0000 7f07b882a700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 0x7f0794061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f07a8006fd0 tx=0x7f07a8008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:47.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.728+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07ac0488f0 con 0x7f07b4069b80 2023-05-10T01:21:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:47.971+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f07b406c340 con 0x7f07b4069b80 2023-05-10T01:21:48.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.938+0000 7f07b17fa700 1 -- 172.21.15.52:0/575927765 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v424) v1 ==== 158+0+0 (secure 0 0 0) 0x7f07ac017030 con 0x7f07b4069b80 2023-05-10T01:21:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 msgr2=0x7f0794061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 0x7f0794061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f07a8006fd0 tx=0x7f07a8008040).stop 2023-05-10T01:21:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 msgr2=0x7f07b40ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f07ac00c440 tx=0x7f07ac007dc0).stop 2023-05-10T01:21:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 shutdown_connections 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f079405ed60 0x7f0794061220 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07b4154540 0x7f07b4158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07b4069b80 0x7f07b40ae630 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 --2- 172.21.15.52:0/575927765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07b4154160 0x7f07b4151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 >> 172.21.15.52:0/575927765 conn(0x7f07b40cb740 msgr2=0x7f07b4153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 shutdown_connections 2023-05-10T01:21:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:48.941+0000 7f07bb28f700 1 -- 172.21.15.52:0/575927765 wait complete. 2023-05-10T01:21:48.960 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-05-10T01:21:48.960 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-05-10T01:21:48.961 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:21:48.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-05-10T01:21:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.081+0000 7fc6af046700 1 Processor -- start 2023-05-10T01:21:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.081+0000 7fc6af046700 1 -- start start 2023-05-10T01:21:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6af046700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc6a80629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6af046700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a8063040 con 0x7fc6a8153e30 2023-05-10T01:21:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6af046700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80c80d0 con 0x7fc6a8153a50 2023-05-10T01:21:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6af046700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c7ec0 con 0x7fc6a80694e0 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6ae845700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc6a8153e30 0x7fc6a81542c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42320/0 (socket says 172.21.15.52:42320) 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6ae845700 1 -- 172.21.15.52:0/4168331797 learned_addr learned my addr 172.21.15.52:0/4168331797 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6ad843700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc6a80629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.082+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788205940 0 0) 0x7fc6a8063040 con 0x7fc6a8153e30 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6940033f0 con 0x7fc6a8153e30 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 261084750 0 0) 0x7fc6940033f0 con 0x7fc6a8153e30 2023-05-10T01:21:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 msgr2=0x7fc6a80629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc6a80629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 >> v1:172.21.15.172:6789/0 conn(0x7fc6a8153a50 legacy=0x7fc6a8064030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80c83b0 con 0x7fc6a8153e30 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fc6980017f0 con 0x7fc6a8153e30 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 >> v1:172.21.15.52:6789/0 conn(0x7fc6a8153e30 legacy=0x7fc6a81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc694003910 0x7fc694003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc694004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc694005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c7ec0 con 0x7fc694004690 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69400b910 con 0x7fc694003910 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69400bad0 con 0x7fc6a80694e0 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc694004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ae044700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc694003910 0x7fc694003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ae845700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc694005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 -- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 msgr2=0x7fc694005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80694e0 0x7fc694005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 -- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc694003910 msgr2=0x7fc694003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc694003910 0x7fc694003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 -- 172.21.15.52:0/4168331797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940033f0 con 0x7fc694004690 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ae044700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc694003910 0x7fc694003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:49.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.083+0000 7fc6ad843700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc694004b10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc69c009a80 tx=0x7fc69c009060).ready entity=mon.0 client_cookie=ac40aeda642f188a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c009430 con 0x7fc694004690 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00e640 con 0x7fc694004690 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6ad042700 1 -- 172.21.15.52:0/4168331797 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00e9c0 con 0x7fc694004690 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 -- 172.21.15.52:0/4168331797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 msgr2=0x7fc694004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 --2- 172.21.15.52:0/4168331797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc694004b10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc69c009a80 tx=0x7fc69c009060).stop 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6ae845700 1 -- 172.21.15.52:0/4168331797 reap_dead start 2023-05-10T01:21:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 -- 172.21.15.52:0/4168331797 shutdown_connections 2023-05-10T01:21:49.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 -- 172.21.15.52:0/4168331797 >> 172.21.15.52:0/4168331797 conn(0x7fc6a805e810 msgr2=0x7fc6a80622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:49.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 -- 172.21.15.52:0/4168331797 shutdown_connections 2023-05-10T01:21:49.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.084+0000 7fc6af046700 1 -- 172.21.15.52:0/4168331797 wait complete. 2023-05-10T01:21:49.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.085+0000 7fc6af046700 1 Processor -- start 2023-05-10T01:21:49.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.085+0000 7fc6af046700 1 -- start start 2023-05-10T01:21:49.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80a4d60 0x7fc6a81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 0x7fc6a80a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80a5250 con 0x7fc694004690 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80a8fe0 con 0x7fc6a8157ce0 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6af046700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80a92c0 con 0x7fc6a80a4d60 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33312/0 (socket says 172.21.15.52:33312) 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 -- 172.21.15.52:0/525174323 learned_addr learned my addr 172.21.15.52:0/525174323 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae845700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 0x7fc6a80a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ad843700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80a4d60 0x7fc6a81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 -- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80a4d60 msgr2=0x7fc6a81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80a4d60 0x7fc6a81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 -- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 msgr2=0x7fc6a80a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 0x7fc6a80a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae044700 1 -- 172.21.15.52:0/525174323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80a95a0 con 0x7fc694004690 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.086+0000 7fc6ae845700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 0x7fc6a80a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6ae044700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc6a000e510 tx=0x7fc6a0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0010450 con 0x7fc694004690 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a00105b0 con 0x7fc694004690 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a80a5530 con 0x7fc694004690 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0010930 con 0x7fc694004690 2023-05-10T01:21:49.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.087+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a80bf6c0 con 0x7fc694004690 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.088+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a80a9910 con 0x7fc694004690 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.088+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc6a0010d20 con 0x7fc694004690 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.088+0000 7fc6a67fc700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 0x7fc688061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.088+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc6a0079c10 con 0x7fc694004690 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.089+0000 7fc6ad843700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 0x7fc688061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.089+0000 7fc6ad843700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 0x7fc688061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc6a8153490 tx=0x7fc69c01a000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.092+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6a004b270 con 0x7fc694004690 2023-05-10T01:21:49.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.335+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fc6a8047150 con 0x7fc694004690 2023-05-10T01:21:49.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.943+0000 7fc6a67fc700 1 -- 172.21.15.52:0/525174323 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v425) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc6a004e890 con 0x7fc694004690 2023-05-10T01:21:49.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 msgr2=0x7fc688061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 0x7fc688061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc6a8153490 tx=0x7fc69c01a000).stop 2023-05-10T01:21:49.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 msgr2=0x7fc6a80a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc6a000e510 tx=0x7fc6a0009040).stop 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 shutdown_connections 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fc68805ed90 0x7fc688061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a8157ce0 0x7fc6a80a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc694004690 0x7fc6a80a4870 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 --2- 172.21.15.52:0/525174323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6a80a4d60 0x7fc6a81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 >> 172.21.15.52:0/525174323 conn(0x7fc6a805e810 msgr2=0x7fc6a814f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:49.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 shutdown_connections 2023-05-10T01:21:49.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:49.945+0000 7fc6af046700 1 -- 172.21.15.52:0/525174323 wait complete. 2023-05-10T01:21:49.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:21:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.086+0000 7f8dc93f2700 1 Processor -- start 2023-05-10T01:21:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.086+0000 7f8dc93f2700 1 -- start start 2023-05-10T01:21:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc93f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc93f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8dc4155370 0x7f8dc40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc93f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc40c6660 con 0x7f8dc40c5cf0 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc93f2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc4069f50 con 0x7f8dc4155370 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc93f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc406a9d0 con 0x7f8dc4153f80 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc8bf1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8dc4155370 0x7f8dc40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dbbfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8dc40c5cf0 0x7f8dc40c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42338/0 (socket says 172.21.15.52:42338) 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dbbfff700 1 -- 172.21.15.52:0/3530695271 learned_addr learned my addr 172.21.15.52:0/3530695271 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:50.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3530695271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 msgr2=0x7f8dc40a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc8bf1700 1 --2- 172.21.15.52:0/3530695271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3530695271 >> v1:172.21.15.52:6789/0 conn(0x7f8dc40c5cf0 legacy=0x7f8dc40c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3530695271 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc406a130 con 0x7f8dc4155370 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.087+0000 7f8dc37fe700 1 -- 172.21.15.52:0/3530695271 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490221343 0 0) 0x7f8dc40c6660 con 0x7f8dc40c5cf0 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc8bf1700 1 --2- 172.21.15.52:0/3530695271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc40c6170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8dbc009e60 tx=0x7f8dbc009780).ready entity=mon.0 client_cookie=734f4c52e8fd8fd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc37fe700 1 -- 172.21.15.52:0/3530695271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00e070 con 0x7f8dc4155370 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc37fe700 1 -- 172.21.15.52:0/3530695271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00bc30 con 0x7f8dc4155370 2023-05-10T01:21:50.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc37fe700 1 -- 172.21.15.52:0/3530695271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc012410 con 0x7f8dc4155370 2023-05-10T01:21:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3530695271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 msgr2=0x7f8dc40c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3530695271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc40c6170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8dbc009e60 tx=0x7f8dbc009780).stop 2023-05-10T01:21:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3530695271 shutdown_connections 2023-05-10T01:21:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3530695271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc40c6170 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3530695271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3530695271 >> 172.21.15.52:0/3530695271 conn(0x7f8dc40cb5f0 msgr2=0x7f8dc40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3530695271 shutdown_connections 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.088+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3530695271 wait complete. 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 Processor -- start 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 -- start start 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc40c5cf0 0x7f8dc414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc414f0f0 con 0x7f8dc4155370 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc414f6b0 con 0x7f8dc40c5cf0 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc93f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40accc0 con 0x7f8dc4153f80 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc8bf1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc8bf1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33330/0 (socket says 172.21.15.52:33330) 2023-05-10T01:21:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.090+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3183333820 learned_addr learned my addr 172.21.15.52:0/3183333820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dbbfff700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc3fff700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc40c5cf0 0x7f8dc414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 msgr2=0x7f8dc40ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc40c5cf0 msgr2=0x7f8dc414b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc40c5cf0 0x7f8dc414b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 -- 172.21.15.52:0/3183333820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009a20 con 0x7f8dc4155370 2023-05-10T01:21:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc8bf1700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8dc40668b0 tx=0x7f8dc40aa790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc01c660 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc01c7c0 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc40acfa0 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc01cb80 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.091+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc414b5f0 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.092+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc4083110 con 0x7f8dc4155370 2023-05-10T01:21:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.092+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8dbc027460 con 0x7f8dc4155370 2023-05-10T01:21:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.093+0000 7f8dc0ff9700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 0x7f8da8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.093+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8dbc07bd50 con 0x7f8dc4155370 2023-05-10T01:21:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.093+0000 7f8dc3fff700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 0x7f8da8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.093+0000 7f8dc3fff700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 0x7f8da8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8db400b910 tx=0x7f8db4008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.097+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8dbc04d240 con 0x7f8dc4155370 2023-05-10T01:21:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.271+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8dc414f820 con 0x7f8dc4155370 2023-05-10T01:21:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.274+0000 7f8dc0ff9700 1 -- 172.21.15.52:0/3183333820 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8dbc050860 con 0x7f8dc4155370 2023-05-10T01:21:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 msgr2=0x7f8da8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 0x7f8da8061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8db400b910 tx=0x7f8db4008040).stop 2023-05-10T01:21:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 msgr2=0x7f8dc414cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8dc40668b0 tx=0x7f8dc40aa790).stop 2023-05-10T01:21:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 shutdown_connections 2023-05-10T01:21:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8da805ed90 0x7f8da8061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc4155370 0x7f8dc414cc30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc40c5cf0 0x7f8dc414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 --2- 172.21.15.52:0/3183333820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc4153f80 0x7f8dc40ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 >> 172.21.15.52:0/3183333820 conn(0x7f8dc40cb5f0 msgr2=0x7f8dc414e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 shutdown_connections 2023-05-10T01:21:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.276+0000 7f8dc93f2700 1 -- 172.21.15.52:0/3183333820 wait complete. 2023-05-10T01:21:50.291 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:21:50.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:21:50.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:21:50.352 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:21:50.353 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:21:50.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.472+0000 7f80990f7700 1 Processor -- start 2023-05-10T01:21:50.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.472+0000 7f80990f7700 1 -- start start 2023-05-10T01:21:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 0x7f80940c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8094154540 0x7f80940c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 0x7f8094069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940c0650 con 0x7f8094154540 2023-05-10T01:21:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809406a010 con 0x7f8094154160 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f80990f7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80940bfd20 con 0x7f8094069690 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8094154540 0x7f80940c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8094154540 0x7f80940c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33334/0 (socket says 172.21.15.52:33334) 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 -- 172.21.15.52:0/363497574 learned_addr learned my addr 172.21.15.52:0/363497574 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809359e700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 0x7f8094069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f8092d9d700 1 --2- 172.21.15.52:0/363497574 >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 0x7f80940c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 -- 172.21.15.52:0/363497574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 msgr2=0x7f8094069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 0x7f8094069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 -- 172.21.15.52:0/363497574 >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 msgr2=0x7f80940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 --2- 172.21.15.52:0/363497574 >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 0x7f80940c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 -- 172.21.15.52:0/363497574 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940c0000 con 0x7f8094154540 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809359e700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 0x7f8094069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f8092d9d700 1 --2- 172.21.15.52:0/363497574 >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 0x7f80940c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f809259c700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094154540 0x7f80940c6150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8094083020 tx=0x7f80880090f0).ready entity=mon.0 client_cookie=6c18e9effeedf8b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f8091d9b700 1 -- 172.21.15.52:0/363497574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800b600 con 0x7f8094154540 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f8091d9b700 1 -- 172.21.15.52:0/363497574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800b760 con 0x7f8094154540 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.473+0000 7f8091d9b700 1 -- 172.21.15.52:0/363497574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800bb00 con 0x7f8094154540 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 -- 172.21.15.52:0/363497574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094154540 msgr2=0x7f80940c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094154540 0x7f80940c6150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8094083020 tx=0x7f80880090f0).stop 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 -- 172.21.15.52:0/363497574 shutdown_connections 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094069690 0x7f8094069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 --2- 172.21.15.52:0/363497574 >> v2:172.21.15.172:3300/0 conn(0x7f8094154160 0x7f80940c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 --2- 172.21.15.52:0/363497574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094154540 0x7f80940c6150 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 -- 172.21.15.52:0/363497574 >> 172.21.15.52:0/363497574 conn(0x7f80940cb6f0 msgr2=0x7f80940c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 -- 172.21.15.52:0/363497574 shutdown_connections 2023-05-10T01:21:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.474+0000 7f80990f7700 1 -- 172.21.15.52:0/363497574 wait complete. 2023-05-10T01:21:50.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.475+0000 7f80990f7700 1 Processor -- start 2023-05-10T01:21:50.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.475+0000 7f80990f7700 1 -- start start 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094154160 0x7f80940c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094154540 0x7f8094155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c4f10 con 0x7f8094069690 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094154af0 con 0x7f8094154540 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f80990f7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809414e190 con 0x7f8094154160 2023-05-10T01:21:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33338/0 (socket says 172.21.15.52:33338) 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f809259c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094154160 0x7f80940c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 -- 172.21.15.52:0/2020585461 learned_addr learned my addr 172.21.15.52:0/2020585461 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f809359e700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094154540 0x7f8094155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 -- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094154160 msgr2=0x7f80940c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094154160 0x7f80940c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 -- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094154540 msgr2=0x7f8094155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.476+0000 7f8092d9d700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094154540 0x7f8094155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f8092d9d700 1 -- 172.21.15.52:0/2020585461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088009370 con 0x7f8094069690 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f8092d9d700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f808400c880 tx=0x7f8084008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084010580 con 0x7f8094069690 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80840106e0 con 0x7f8094069690 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80940c4c30 con 0x7f8094069690 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084010a60 con 0x7f8094069690 2023-05-10T01:21:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.477+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8094155070 con 0x7f8094069690 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.478+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80941553e0 con 0x7f8094069690 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.478+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f808401b460 con 0x7f8094069690 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.478+0000 7f807affd700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 0x7f8074061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.479+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8084079a00 con 0x7f8094069690 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.479+0000 7f809259c700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 0x7f8074061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.479+0000 7f809259c700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 0x7f8074061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8094154920 tx=0x7f8088017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.483+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f808404b000 con 0x7f8094069690 2023-05-10T01:21:50.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.696+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8094154950 con 0x7f8094069690 2023-05-10T01:21:50.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.697+0000 7f807affd700 1 -- 172.21.15.52:0/2020585461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8094154950 con 0x7f8094069690 2023-05-10T01:21:50.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:50.701 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2160451228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2160451228},{"type":"v1","addr":"172.21.15.52:6834","nonce":2160451228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3361414193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3361414193},{"type":"v1","addr":"172.21.15.172:6836","nonce":3361414193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/807909750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":807909750},{"type":"v1","addr":"172.21.15.172:6837","nonce":807909750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2340548422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2340548422},{"type":"v1","addr":"172.21.15.52:6835","nonce":2340548422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-05-10T01:21:50.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 msgr2=0x7f8074061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 0x7f8074061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8094154920 tx=0x7f8088017000).stop 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 msgr2=0x7f809414dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f808400c880 tx=0x7f8084008040).stop 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 shutdown_connections 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f807405ed90 0x7f8074061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094154540 0x7f8094155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8094069690 0x7f809414dca0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 --2- 172.21.15.52:0/2020585461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8094154160 0x7f80940c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 >> 172.21.15.52:0/2020585461 conn(0x7f80940cb6f0 msgr2=0x7f80940ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:50.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 shutdown_connections 2023-05-10T01:21:50.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.699+0000 7f80990f7700 1 -- 172.21.15.52:0/2020585461 wait complete. 2023-05-10T01:21:50.704 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2023-05-10T01:21:50.715 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:21:50.715 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:21:50.715 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:21:50.715 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:21:50.716 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:21:50.716 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:21:50.716 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:21:50.716 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:21:50.717 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:21:50.717 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:21:50.717 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:21:50.717 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:21:50.717 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:21:50.718 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:21:50.718 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:21:50.718 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:21:50.724 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:21:50.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:21:50.725 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:21:50.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:21:50.728 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:21:50.728 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:21:50.729 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:21:50.729 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:21:50.767 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:21:50.768 DEBUG:teuthology.parallel:result is None 2023-05-10T01:21:50.769 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:21:50.770 DEBUG:teuthology.parallel:result is None 2023-05-10T01:21:50.773 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:21:50.773 DEBUG:teuthology.parallel:result is None 2023-05-10T01:21:50.774 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:21:50.775 DEBUG:teuthology.parallel:result is None 2023-05-10T01:21:50.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:21:50.841 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:21:50.841 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:21:50.855 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:21:50.856 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:21:50.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.896+0000 7f17c95a7700 1 Processor -- start 2023-05-10T01:21:50.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.896+0000 7f17c95a7700 1 -- start start 2023-05-10T01:21:50.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c95a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17c4154160 0x7f17c40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c95a7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17c4154540 0x7f17c40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c95a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40c0650 con 0x7f17c4069690 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c95a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40c1af0 con 0x7f17c4154160 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c95a7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40bfd20 con 0x7f17c4154540 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17c4154160 0x7f17c40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f17c4069690 0x7f17c4157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42388/0 (socket says 172.21.15.52:42388) 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c37fe700 1 -- 172.21.15.52:0/1398893975 learned_addr learned my addr 172.21.15.52:0/1398893975 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 -- 172.21.15.52:0/1398893975 >> v2:172.21.15.172:3300/0 conn(0x7f17c4154540 msgr2=0x7f17c40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c27fc700 1 --2- 172.21.15.52:0/1398893975 >> v2:172.21.15.172:3300/0 conn(0x7f17c4154540 0x7f17c40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 --2- 172.21.15.52:0/1398893975 >> v2:172.21.15.172:3300/0 conn(0x7f17c4154540 0x7f17c40c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 -- 172.21.15.52:0/1398893975 >> v1:172.21.15.52:6789/0 conn(0x7f17c4069690 legacy=0x7f17c4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c1ffb700 1 -- 172.21.15.52:0/1398893975 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536427270 0 0) 0x7f17c40c0650 con 0x7f17c4069690 2023-05-10T01:21:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 -- 172.21.15.52:0/1398893975 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40c0000 con 0x7f17c4154160 2023-05-10T01:21:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.897+0000 7f17c2ffd700 1 --2- 172.21.15.52:0/1398893975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154160 0x7f17c40c5c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f17c40844d0 tx=0x7f17b4009060).ready entity=mon.0 client_cookie=4c7dcea7fd1f099f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c1ffb700 1 -- 172.21.15.52:0/1398893975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40090d0 con 0x7f17c4154160 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c1ffb700 1 -- 172.21.15.52:0/1398893975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400b580 con 0x7f17c4154160 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c1ffb700 1 -- 172.21.15.52:0/1398893975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400b900 con 0x7f17c4154160 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 -- 172.21.15.52:0/1398893975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154160 msgr2=0x7f17c40c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 --2- 172.21.15.52:0/1398893975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154160 0x7f17c40c5c60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f17c40844d0 tx=0x7f17b4009060).stop 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 -- 172.21.15.52:0/1398893975 shutdown_connections 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 --2- 172.21.15.52:0/1398893975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154160 0x7f17c40c5c60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 --2- 172.21.15.52:0/1398893975 >> v2:172.21.15.172:3300/0 conn(0x7f17c4154540 0x7f17c40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 -- 172.21.15.52:0/1398893975 >> 172.21.15.52:0/1398893975 conn(0x7f17c40cb6f0 msgr2=0x7f17c40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 -- 172.21.15.52:0/1398893975 shutdown_connections 2023-05-10T01:21:50.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.898+0000 7f17c95a7700 1 -- 172.21.15.52:0/1398893975 wait complete. 2023-05-10T01:21:50.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.899+0000 7f17c95a7700 1 Processor -- start 2023-05-10T01:21:50.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.899+0000 7f17c95a7700 1 -- start start 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c4069690 0x7f17c41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17c4154160 0x7f17c40c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c9860 con 0x7f17c4154540 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c413e0f0 con 0x7f17c4069690 2023-05-10T01:21:50.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c95a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c413e3d0 con 0x7f17c4154160 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33380/0 (socket says 172.21.15.52:33380) 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 -- 172.21.15.52:0/3647228211 learned_addr learned my addr 172.21.15.52:0/3647228211 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c27fc700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17c4154160 0x7f17c40c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c2ffd700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c4069690 0x7f17c41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 -- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17c4154160 msgr2=0x7f17c40c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17c4154160 0x7f17c40c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 -- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c4069690 msgr2=0x7f17c41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.900+0000 7f17c37fe700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c4069690 0x7f17c41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17c37fe700 1 -- 172.21.15.52:0/3647228211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40092a0 con 0x7f17c4154540 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17c37fe700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f17bc00c7c0 tx=0x7f17bc007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005d30 con 0x7f17c4154540 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc007110 con 0x7f17c4154540 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4155790 con 0x7f17c4154540 2023-05-10T01:21:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0074d0 con 0x7f17c4154540 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.901+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c41580d0 con 0x7f17c4154540 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.902+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c40666b0 con 0x7f17c4154540 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.902+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17bc010030 con 0x7f17c4154540 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.902+0000 7f17aaffd700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 0x7f17a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.902+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f17bc079990 con 0x7f17c4154540 2023-05-10T01:21:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.903+0000 7f17c2ffd700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 0x7f17a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.903+0000 7f17c2ffd700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 0x7f17a4061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f17b400b340 tx=0x7f17b4017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:50.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:50.907+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17bc04aff0 con 0x7f17c4154540 2023-05-10T01:21:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.093+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f17c406c340 con 0x7f17c4154540 2023-05-10T01:21:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.949+0000 7f17aaffd700 1 -- 172.21.15.52:0/3647228211 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f17bc04e610 con 0x7f17c4154540 2023-05-10T01:21:51.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 msgr2=0x7f17a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:51.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 0x7f17a4061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f17b400b340 tx=0x7f17b4017000).stop 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 msgr2=0x7f17c40c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f17bc00c7c0 tx=0x7f17bc007f30).stop 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 shutdown_connections 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17a405ed90 0x7f17a4061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17c4154540 0x7f17c40c9370 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c4069690 0x7f17c41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:51.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 --2- 172.21.15.52:0/3647228211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17c4154160 0x7f17c40c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:51.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.952+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 >> 172.21.15.52:0/3647228211 conn(0x7f17c40cb6f0 msgr2=0x7f17c40abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:51.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.953+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 shutdown_connections 2023-05-10T01:21:51.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:51.953+0000 7f17c95a7700 1 -- 172.21.15.52:0/3647228211 wait complete. 2023-05-10T01:21:51.958 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:21:51.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.090+0000 7f080d69b700 1 Processor -- start 2023-05-10T01:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.090+0000 7f080d69b700 1 -- start start 2023-05-10T01:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f080d69b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0808154030 0x7f0808069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f080d69b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f0808062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f080d69b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0808062950 con 0x7f08080bf4e0 2023-05-10T01:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f080d69b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0808154410 con 0x7f0808154030 2023-05-10T01:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f080d69b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0808069fa0 con 0x7f0808063e20 2023-05-10T01:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f0806ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0808154030 0x7f0808069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f0806ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0808154030 0x7f0808069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33388/0 (socket says 172.21.15.52:33388) 2023-05-10T01:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.091+0000 7f0806ffd700 1 -- 172.21.15.52:0/1624922910 learned_addr learned my addr 172.21.15.52:0/1624922910 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f08077fe700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f0808062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0806ffd700 1 -- 172.21.15.52:0/1624922910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 msgr2=0x7f0808062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0806ffd700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f0808062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0806ffd700 1 -- 172.21.15.52:0/1624922910 >> v1:172.21.15.172:6789/0 conn(0x7f08080bf4e0 legacy=0x7f0808063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0806ffd700 1 -- 172.21.15.52:0/1624922910 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808062340 con 0x7f0808154030 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0806ffd700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f0808069ab0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f0800009f20 tx=0x7f0800009840).ready entity=mon.0 client_cookie=f499bfd2e19e3907 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0805ffb700 1 -- 172.21.15.52:0/1624922910 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000e070 con 0x7f0808154030 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0805ffb700 1 -- 172.21.15.52:0/1624922910 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000ba80 con 0x7f0808154030 2023-05-10T01:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f0805ffb700 1 -- 172.21.15.52:0/1624922910 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000be00 con 0x7f0808154030 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f080d69b700 1 -- 172.21.15.52:0/1624922910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 msgr2=0x7f0808069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.092+0000 7f080d69b700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f0808069ab0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f0800009f20 tx=0x7f0800009840).stop 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 -- 172.21.15.52:0/1624922910 shutdown_connections 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f0808062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 --2- 172.21.15.52:0/1624922910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f0808069ab0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 -- 172.21.15.52:0/1624922910 >> 172.21.15.52:0/1624922910 conn(0x7f08080c8a90 msgr2=0x7f08080c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 -- 172.21.15.52:0/1624922910 shutdown_connections 2023-05-10T01:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.093+0000 7f080d69b700 1 -- 172.21.15.52:0/1624922910 wait complete. 2023-05-10T01:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.094+0000 7f080d69b700 1 Processor -- start 2023-05-10T01:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.094+0000 7f080d69b700 1 -- start start 2023-05-10T01:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f08080ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 0x7f08080c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080aea40 con 0x7f0808154030 2023-05-10T01:21:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08080ac6e0 con 0x7f08080bf4e0 2023-05-10T01:21:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080ac9c0 con 0x7f0808063e20 2023-05-10T01:21:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33398/0 (socket says 172.21.15.52:33398) 2023-05-10T01:21:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 -- 172.21.15.52:0/947964439 learned_addr learned my addr 172.21.15.52:0/947964439 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f0806ffd700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f08080ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08067fc700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 0x7f08080c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 -- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 msgr2=0x7f08080ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f08080ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 -- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 msgr2=0x7f08080c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 0x7f08080c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 -- 172.21.15.52:0/947964439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009ae0 con 0x7f0808154030 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f0806ffd700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f08080ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08067fc700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 0x7f08080c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f08077fe700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f07f8006980 tx=0x7f07f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8011590 con 0x7f0808154030 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80116f0 con 0x7f0808154030 2023-05-10T01:21:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08080acca0 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8011a70 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.095+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08080ad260 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.096+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08080c2e60 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.097+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f07f8012420 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.097+0000 7f07feffd700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 0x7f07ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.097+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f07f8079410 con 0x7f0808154030 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.097+0000 7f0806ffd700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 0x7f07ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.098+0000 7f0806ffd700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 0x7f07ec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f080000ba50 tx=0x7f0800009840).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.101+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07f804abb0 con 0x7f0808154030 2023-05-10T01:21:52.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.339+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08080ad480 con 0x7f0808154030 2023-05-10T01:21:52.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.339+0000 7f07feffd700 1 -- 172.21.15.52:0/947964439 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f07f8011e60 con 0x7f0808154030 2023-05-10T01:21:52.343 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:52.343 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:21:52.343 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:21:52.345 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.346 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.346 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:21:52.346 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:21:52.346 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.346 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.348 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.349 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.350 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.351 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.351 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.352 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:21:52.353 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.354 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.355 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.356 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:21:52.357 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.358 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.359 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:21:52.360 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:21:52.361 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.362 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:21:52.363 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.364 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:21:52.365 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:21:52.366 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:21:52.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:21:52.370 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:21:52.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:52.371 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:21:52.371 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:21:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 msgr2=0x7f07ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 0x7f07ec061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f080000ba50 tx=0x7f0800009840).stop 2023-05-10T01:21:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 msgr2=0x7f08080ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f07f8006980 tx=0x7f07f8008040).stop 2023-05-10T01:21:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 shutdown_connections 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07ec05ed90 0x7f07ec061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808154030 0x7f08080ad780 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0808063e20 0x7f08080ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 --2- 172.21.15.52:0/947964439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08080bf4e0 0x7f08080c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 >> 172.21.15.52:0/947964439 conn(0x7f08080c8a90 msgr2=0x7f08080c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 shutdown_connections 2023-05-10T01:21:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.341+0000 7f080d69b700 1 -- 172.21.15.52:0/947964439 wait complete. 2023-05-10T01:21:52.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:52.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.488+0000 7f1ced830700 1 Processor -- start 2023-05-10T01:21:52.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.488+0000 7f1ced830700 1 -- start start 2023-05-10T01:21:52.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ced830700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ced830700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80bdc20 con 0x7f1ce813b540 2023-05-10T01:21:52.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ced830700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80c4e30 con 0x7f1ce8063e20 2023-05-10T01:21:52.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ced830700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c53f0 con 0x7f1ce813b920 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ce6ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ce813b540 0x7f1ce8063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42418/0 (socket says 172.21.15.52:42418) 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ce6ffd700 1 -- 172.21.15.52:0/3868089457 learned_addr learned my addr 172.21.15.52:0/3868089457 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ce77fe700 1 --2- 172.21.15.52:0/3868089457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.489+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983254404 0 0) 0x7f1ce80bdc20 con 0x7f1ce813b540 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd40033f0 con 0x7f1ce813b540 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467976671 0 0) 0x7f1ce80c4e30 con 0x7f1ce8063e20 2023-05-10T01:21:52.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce80bdc20 con 0x7f1ce8063e20 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce77fe700 1 -- 172.21.15.52:0/3868089457 >> v1:172.21.15.172:6789/0 conn(0x7f1ce8063e20 legacy=0x7f1ce80be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521374990 0 0) 0x7f1cd40033f0 con 0x7f1ce813b540 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce77fe700 1 -- 172.21.15.52:0/3868089457 >> v1:172.21.15.52:6789/0 conn(0x7f1ce813b540 legacy=0x7f1ce8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce77fe700 1 -- 172.21.15.52:0/3868089457 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80c5110 con 0x7f1ce813b920 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce77fe700 1 --2- 172.21.15.52:0/3868089457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80c31e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1ce0009e90 tx=0x7f1ce0009780).ready entity=mon.2 client_cookie=ec89c7d36118c267 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000e070 con 0x7f1ce813b920 2023-05-10T01:21:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000b7a0 con 0x7f1ce813b920 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.490+0000 7f1ce5ffb700 1 -- 172.21.15.52:0/3868089457 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8001470 con 0x7f1ce813b920 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 -- 172.21.15.52:0/3868089457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 msgr2=0x7f1ce80c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 --2- 172.21.15.52:0/3868089457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80c31e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1ce0009e90 tx=0x7f1ce0009780).stop 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 -- 172.21.15.52:0/3868089457 shutdown_connections 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 --2- 172.21.15.52:0/3868089457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80c31e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 -- 172.21.15.52:0/3868089457 >> 172.21.15.52:0/3868089457 conn(0x7f1ce80c8a90 msgr2=0x7f1ce80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 -- 172.21.15.52:0/3868089457 shutdown_connections 2023-05-10T01:21:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.491+0000 7f1ced830700 1 -- 172.21.15.52:0/3868089457 wait complete. 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.492+0000 7f1ced830700 1 Processor -- start 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.492+0000 7f1ced830700 1 -- start start 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce813b540 0x7f1ce80ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8151df0 con 0x7f1ce8063e20 2023-05-10T01:21:52.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80adc30 con 0x7f1ce813b540 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ced830700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c6490 con 0x7f1ce813b920 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33408/0 (socket says 172.21.15.52:33408) 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 -- 172.21.15.52:0/266368680 learned_addr learned my addr 172.21.15.52:0/266368680 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce77fe700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce67fc700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce813b540 0x7f1ce80ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 -- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 msgr2=0x7f1ce80ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 -- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce813b540 msgr2=0x7f1ce80ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce813b540 0x7f1ce80ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 -- 172.21.15.52:0/266368680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009a20 con 0x7f1ce8063e20 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.493+0000 7f1ce6ffd700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f1cd800c800 tx=0x7f1cd8001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.494+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8007170 con 0x7f1ce8063e20 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.494+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80072d0 con 0x7f1ce8063e20 2023-05-10T01:21:52.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.494+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce80c5880 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.494+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80048c0 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.494+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80c5ec0 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.495+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80c6240 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.495+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1cd8010070 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.496+0000 7f1cceffd700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.496+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f1cd8079bc0 con 0x7f1ce8063e20 2023-05-10T01:21:52.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.496+0000 7f1ce67fc700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.496+0000 7f1ce67fc700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 0x7f1cc8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1ce8069b00 tx=0x7f1cdc009040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.499+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cd804b440 con 0x7f1ce8063e20 2023-05-10T01:21:52.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.672+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce806c340 con 0x7f1ce8063e20 2023-05-10T01:21:52.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.673+0000 7f1cceffd700 1 -- 172.21.15.52:0/266368680 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+14167 (secure 0 0 0) 0x7f1cd804ea60 con 0x7f1ce8063e20 2023-05-10T01:21:52.676 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:52.677 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":59,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:51.944708+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 msgr2=0x7f1cc8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 0x7f1cc8061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1ce8069b00 tx=0x7f1cdc009040).stop 2023-05-10T01:21:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 msgr2=0x7f1ce8151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f1cd800c800 tx=0x7f1cd8001b50).stop 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 shutdown_connections 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1cc805ed90 0x7f1cc8061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce813b920 0x7f1ce80ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce8063e20 0x7f1ce8151900 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 --2- 172.21.15.52:0/266368680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce813b540 0x7f1ce80ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 >> 172.21.15.52:0/266368680 conn(0x7f1ce80c8a90 msgr2=0x7f1ce8139d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:52.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 shutdown_connections 2023-05-10T01:21:52.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.674+0000 7f1ced830700 1 -- 172.21.15.52:0/266368680 wait complete. 2023-05-10T01:21:52.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:21:52.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:21:52.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.809+0000 7f5634744700 1 Processor -- start 2023-05-10T01:21:52.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.809+0000 7f5634744700 1 -- start start 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.810+0000 7f5634744700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.810+0000 7f5634744700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f562c153a90 0x7f562c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.810+0000 7f5634744700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562c0c8820 con 0x7f562c0c6100 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.810+0000 7f5634744700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c0ca5f0 con 0x7f562c153a90 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.810+0000 7f5634744700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0c8b00 con 0x7f562c0c5d20 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f562c153a90 0x7f562c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f562c153a90 0x7f562c153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33418/0 (socket says 172.21.15.52:33418) 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 -- 172.21.15.52:0/261113321 learned_addr learned my addr 172.21.15.52:0/261113321 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f56324e0700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 -- 172.21.15.52:0/261113321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 msgr2=0x7f562c0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c0aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 -- 172.21.15.52:0/261113321 >> v1:172.21.15.172:6789/0 conn(0x7f562c0c6100 legacy=0x7f562c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 -- 172.21.15.52:0/261113321 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0c8de0 con 0x7f562c153a90 2023-05-10T01:21:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f5632ce1700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c153a90 0x7f562c153f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f5628009f20 tx=0x7f5628009840).ready entity=mon.0 client_cookie=23390c51dfcbeb7c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f56314de700 1 -- 172.21.15.52:0/261113321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800e070 con 0x7f562c153a90 2023-05-10T01:21:52.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f56314de700 1 -- 172.21.15.52:0/261113321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562800b9d0 con 0x7f562c153a90 2023-05-10T01:21:52.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.811+0000 7f56314de700 1 -- 172.21.15.52:0/261113321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800bd50 con 0x7f562c153a90 2023-05-10T01:21:52.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 -- 172.21.15.52:0/261113321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c153a90 msgr2=0x7f562c153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c153a90 0x7f562c153f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f5628009f20 tx=0x7f5628009840).stop 2023-05-10T01:21:52.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 -- 172.21.15.52:0/261113321 shutdown_connections 2023-05-10T01:21:52.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 --2- 172.21.15.52:0/261113321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c153a90 0x7f562c153f20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 -- 172.21.15.52:0/261113321 >> 172.21.15.52:0/261113321 conn(0x7f562c0cb6f0 msgr2=0x7f562c0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:52.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 -- 172.21.15.52:0/261113321 shutdown_connections 2023-05-10T01:21:52.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.812+0000 7f5634744700 1 -- 172.21.15.52:0/261113321 wait complete. 2023-05-10T01:21:52.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.813+0000 7f5634744700 1 Processor -- start 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.813+0000 7f5634744700 1 -- start start 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c1674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f562c153a90 0x7f562c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c1679d0 con 0x7f562c0c6100 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c167c60 con 0x7f562c153a90 2023-05-10T01:21:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c167f40 con 0x7f562c0c5d20 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f56324e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c1674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33424/0 (socket says 172.21.15.52:33424) 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f56324e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c1674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:53058/0 (socket says 172.21.15.52:53058) 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 -- 172.21.15.52:0/3146376272 learned_addr learned my addr 172.21.15.52:0/3146376272 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5632ce1700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f562c153a90 0x7f562c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 -- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 msgr2=0x7f562c1674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c1674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 -- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f562c153a90 msgr2=0x7f562c154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f562c153a90 0x7f562c154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 -- 172.21.15.52:0/3146376272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009ae0 con 0x7f562c0c6100 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5631cdf700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f561c00c4c0 tx=0x7f561c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c00ce10 con 0x7f562c0c6100 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c007020 con 0x7f562c0c6100 2023-05-10T01:21:52.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c168220 con 0x7f562c0c6100 2023-05-10T01:21:52.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.814+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0073c0 con 0x7f562c0c6100 2023-05-10T01:21:52.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.815+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c164f60 con 0x7f562c0c6100 2023-05-10T01:21:52.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.815+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c066720 con 0x7f562c0c6100 2023-05-10T01:21:52.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.816+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f561c010070 con 0x7f562c0c6100 2023-05-10T01:21:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.816+0000 7f561a7fc700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 0x7f560c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.816+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f561c078a50 con 0x7f562c0c6100 2023-05-10T01:21:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.816+0000 7f56324e0700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 0x7f560c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.817+0000 7f56324e0700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 0x7f560c061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5624009b90 tx=0x7f5624009060).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.820+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f561c0478f0 con 0x7f562c0c6100 2023-05-10T01:21:52.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.994+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f562c06c340 con 0x7f562c0c6100 2023-05-10T01:21:52.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.995+0000 7f561a7fc700 1 -- 172.21.15.52:0/3146376272 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v59) v1 ==== 110+0+10 (secure 0 0 0) 0x7f561c04a250 con 0x7f562c0c6100 2023-05-10T01:21:52.999 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:21:53.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 msgr2=0x7f560c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 0x7f560c061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5624009b90 tx=0x7f5624009060).stop 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 msgr2=0x7f562c164a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f561c00c4c0 tx=0x7f561c007dd0).stop 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 shutdown_connections 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f560c05ed90 0x7f560c061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f562c153a90 0x7f562c154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f562c0c5d20 0x7f562c1674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 --2- 172.21.15.52:0/3146376272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f562c0c6100 0x7f562c164a70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 >> 172.21.15.52:0/3146376272 conn(0x7f562c0cb6f0 msgr2=0x7f562c0abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 shutdown_connections 2023-05-10T01:21:53.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:52.997+0000 7f5634744700 1 -- 172.21.15.52:0/3146376272 wait complete. 2023-05-10T01:21:53.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:21:53.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 Processor -- start 2023-05-10T01:21:53.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 -- start start 2023-05-10T01:21:53.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c5d20 0x7f41140aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41140c6100 0x7f4114069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4114153a90 0x7f4114153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41140c8820 con 0x7f4114153a90 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41140c8b00 con 0x7f41140c6100 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.128+0000 7f4119b8a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c8de0 con 0x7f41140c5d20 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4114153a90 0x7f4114153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4114153a90 0x7f4114153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33434/0 (socket says 172.21.15.52:33434) 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 -- 172.21.15.52:0/1482210544 learned_addr learned my addr 172.21.15.52:0/1482210544 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:53.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f41137fe700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c5d20 0x7f41140aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4112ffd700 1 --2- 172.21.15.52:0/1482210544 >> v2:172.21.15.172:3300/0 conn(0x7f41140c6100 0x7f4114069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 -- 172.21.15.52:0/1482210544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c5d20 msgr2=0x7f41140aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c5d20 0x7f41140aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 -- 172.21.15.52:0/1482210544 >> v2:172.21.15.172:3300/0 conn(0x7f41140c6100 msgr2=0x7f4114069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 --2- 172.21.15.52:0/1482210544 >> v2:172.21.15.172:3300/0 conn(0x7f41140c6100 0x7f4114069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 -- 172.21.15.52:0/1482210544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140c90c0 con 0x7f4114153a90 2023-05-10T01:21:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f4113fff700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f4114153f20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f4114083f20 tx=0x7f410c009840).ready entity=mon.0 client_cookie=8583840564950cf0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f41127fc700 1 -- 172.21.15.52:0/1482210544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00e070 con 0x7f4114153a90 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f41127fc700 1 -- 172.21.15.52:0/1482210544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c00ba50 con 0x7f4114153a90 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.129+0000 7f41127fc700 1 -- 172.21.15.52:0/1482210544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00bdd0 con 0x7f4114153a90 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 -- 172.21.15.52:0/1482210544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 msgr2=0x7f4114153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f4114153f20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f4114083f20 tx=0x7f410c009840).stop 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 -- 172.21.15.52:0/1482210544 shutdown_connections 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f4114153f20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 --2- 172.21.15.52:0/1482210544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c5d20 0x7f41140aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 --2- 172.21.15.52:0/1482210544 >> v2:172.21.15.172:3300/0 conn(0x7f41140c6100 0x7f4114069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 -- 172.21.15.52:0/1482210544 >> 172.21.15.52:0/1482210544 conn(0x7f41140cb6f0 msgr2=0x7f41140c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 -- 172.21.15.52:0/1482210544 shutdown_connections 2023-05-10T01:21:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.130+0000 7f4119b8a700 1 -- 172.21.15.52:0/1482210544 wait complete. 2023-05-10T01:21:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.131+0000 7f4119b8a700 1 Processor -- start 2023-05-10T01:21:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.131+0000 7f4119b8a700 1 -- start start 2023-05-10T01:21:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41140c5d20 0x7f4114146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 0x7f4114062560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411414e650 con 0x7f4114153a90 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411414d9d0 con 0x7f41140c5d20 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411414dcb0 con 0x7f41140c6100 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33440/0 (socket says 172.21.15.52:33440) 2023-05-10T01:21:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 -- 172.21.15.52:0/2943680865 learned_addr learned my addr 172.21.15.52:0/2943680865 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f41137fe700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41140c5d20 0x7f4114146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4112ffd700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 0x7f4114062560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 -- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 msgr2=0x7f4114062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 0x7f4114062560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 -- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41140c5d20 msgr2=0x7f4114146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41140c5d20 0x7f4114146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 -- 172.21.15.52:0/2943680865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c009ae0 con 0x7f4114153a90 2023-05-10T01:21:53.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4112ffd700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 0x7f4114062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4113fff700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4114083c40 tx=0x7f41140c7050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0092e0 con 0x7f4114153a90 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c007610 con 0x7f4114153a90 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411414df90 con 0x7f4114153a90 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.132+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0079b0 con 0x7f4114153a90 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.133+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411414d340 con 0x7f4114153a90 2023-05-10T01:21:53.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.133+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411414d530 con 0x7f4114153a90 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.134+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f410c026030 con 0x7f4114153a90 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.134+0000 7f40fb7fe700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 0x7f40f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.134+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f410c07b680 con 0x7f4114153a90 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.134+0000 7f41137fe700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 0x7f40f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.135+0000 7f41137fe700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 0x7f40f4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f410400bb10 tx=0x7f4104008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.138+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f411414d530 con 0x7f4114153a90 2023-05-10T01:21:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.313+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f411414d530 con 0x7f4114153a90 2023-05-10T01:21:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.314+0000 7f40fb7fe700 1 -- 172.21.15.52:0/2943680865 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f411414d530 con 0x7f4114153a90 2023-05-10T01:21:53.318 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:21:53.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 msgr2=0x7f40f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 0x7f40f4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f410400bb10 tx=0x7f4104008040).stop 2023-05-10T01:21:53.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 msgr2=0x7f41140642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4114083c40 tx=0x7f41140c7050).stop 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 shutdown_connections 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f40f405ed90 0x7f40f4061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114153a90 0x7f41140642d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41140c5d20 0x7f4114146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 --2- 172.21.15.52:0/2943680865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41140c6100 0x7f4114062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.315+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 >> 172.21.15.52:0/2943680865 conn(0x7f41140cb6f0 msgr2=0x7f41140697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.316+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 shutdown_connections 2023-05-10T01:21:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.316+0000 7f4119b8a700 1 -- 172.21.15.52:0/2943680865 wait complete. 2023-05-10T01:21:53.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:21:53.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.446+0000 7f3166cee700 1 Processor -- start 2023-05-10T01:21:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.446+0000 7f3166cee700 1 -- start start 2023-05-10T01:21:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3166cee700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 0x7f316014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3166cee700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3160066e40 0x7f3160157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3166cee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600683c0 con 0x7f31600672a0 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3166cee700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3160137460 con 0x7f3160066e40 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3166cee700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600c3510 con 0x7f316014e1f0 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f316528b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f31600672a0 0x7f3160154480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42462/0 (socket says 172.21.15.52:42462) 2023-05-10T01:21:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f316528b700 1 -- 172.21.15.52:0/666047195 learned_addr learned my addr 172.21.15.52:0/666047195 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 --2- 172.21.15.52:0/666047195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 0x7f316014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f315ffff700 1 --2- 172.21.15.52:0/666047195 >> v2:172.21.15.172:3300/0 conn(0x7f3160066e40 0x7f3160157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f315f7fe700 1 -- 172.21.15.52:0/666047195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895946266 0 0) 0x7f31600683c0 con 0x7f31600672a0 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f315f7fe700 1 -- 172.21.15.52:0/666047195 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31400033f0 con 0x7f31600672a0 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 -- 172.21.15.52:0/666047195 >> v2:172.21.15.172:3300/0 conn(0x7f3160066e40 msgr2=0x7f3160157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 --2- 172.21.15.52:0/666047195 >> v2:172.21.15.172:3300/0 conn(0x7f3160066e40 0x7f3160157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 -- 172.21.15.52:0/666047195 >> v1:172.21.15.52:6789/0 conn(0x7f31600672a0 legacy=0x7f3160154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 -- 172.21.15.52:0/666047195 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600be050 con 0x7f316014e1f0 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.447+0000 7f3164a8a700 1 --2- 172.21.15.52:0/666047195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 0x7f316014e5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3148009760 tx=0x7f3148009060).ready entity=mon.2 client_cookie=65751cdb41a0189e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f315f7fe700 1 -- 172.21.15.52:0/666047195 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800d4a0 con 0x7f316014e1f0 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f315f7fe700 1 -- 172.21.15.52:0/666047195 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800d600 con 0x7f316014e1f0 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f315f7fe700 1 -- 172.21.15.52:0/666047195 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800d980 con 0x7f316014e1f0 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 -- 172.21.15.52:0/666047195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 msgr2=0x7f316014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 --2- 172.21.15.52:0/666047195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 0x7f316014e5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3148009760 tx=0x7f3148009060).stop 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 -- 172.21.15.52:0/666047195 shutdown_connections 2023-05-10T01:21:53.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 --2- 172.21.15.52:0/666047195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f316014e1f0 0x7f316014e5d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 --2- 172.21.15.52:0/666047195 >> v2:172.21.15.172:3300/0 conn(0x7f3160066e40 0x7f3160157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 -- 172.21.15.52:0/666047195 >> 172.21.15.52:0/666047195 conn(0x7f31600c7bb0 msgr2=0x7f31600c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 -- 172.21.15.52:0/666047195 shutdown_connections 2023-05-10T01:21:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.448+0000 7f3166cee700 1 -- 172.21.15.52:0/666047195 wait complete. 2023-05-10T01:21:53.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.449+0000 7f3166cee700 1 Processor -- start 2023-05-10T01:21:53.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.449+0000 7f3166cee700 1 -- start start 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 0x7f3160136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316014e1f0 0x7f3160156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160157190 con 0x7f31600672a0 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160137030 con 0x7f316014e1f0 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3166cee700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160167790 con 0x7f3160066e40 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f315ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f315ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33452/0 (socket says 172.21.15.52:33452) 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f315ffff700 1 -- 172.21.15.52:0/1855130558 learned_addr learned my addr 172.21.15.52:0/1855130558 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f3164a8a700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 0x7f3160136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.450+0000 7f316528b700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316014e1f0 0x7f3160156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 -- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 msgr2=0x7f3160136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 0x7f3160136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 -- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316014e1f0 msgr2=0x7f3160156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316014e1f0 0x7f3160156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 -- 172.21.15.52:0/1855130558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480092a0 con 0x7f31600672a0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f3164a8a700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 0x7f3160136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315ffff700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f315000e8d0 tx=0x7f3150009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000c640 con 0x7f31600672a0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000c7a0 con 0x7f31600672a0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160167a70 con 0x7f31600672a0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000cb20 con 0x7f31600672a0 2023-05-10T01:21:53.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.451+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31601680b0 con 0x7f31600672a0 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.452+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316006c340 con 0x7f31600672a0 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.452+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3150022070 con 0x7f31600672a0 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.453+0000 7f315cff9700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.453+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f3150079b30 con 0x7f31600672a0 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.453+0000 7f3164a8a700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.453+0000 7f3164a8a700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 0x7f3144061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3148009760 tx=0x7f3148016000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.457+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f315004b330 con 0x7f31600672a0 2023-05-10T01:21:53.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.634+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f31600c43d0 con 0x7f31600672a0 2023-05-10T01:21:53.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.635+0000 7f315cff9700 1 -- 172.21.15.52:0/1855130558 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+143 (secure 0 0 0) 0x7f315004e950 con 0x7f31600672a0 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:21:53.639 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:21:53.640 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:21:53.640 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:21:53.640 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:21:53.640 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:21:53.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.636+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 msgr2=0x7f3144061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.636+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 0x7f3144061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3148009760 tx=0x7f3148016000).stop 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.636+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 msgr2=0x7f31601567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.636+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f315000e8d0 tx=0x7f3150009060).stop 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 shutdown_connections 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f314405ed90 0x7f3144061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316014e1f0 0x7f3160156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3160066e40 0x7f3160136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 --2- 172.21.15.52:0/1855130558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31600672a0 0x7f31601567b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 >> 172.21.15.52:0/1855130558 conn(0x7f31600c7bb0 msgr2=0x7f3160154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 shutdown_connections 2023-05-10T01:21:53.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.637+0000 7f3166cee700 1 -- 172.21.15.52:0/1855130558 wait complete. 2023-05-10T01:21:53.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:21:53.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:21:53.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.772+0000 7f8b361a0700 1 Processor -- start 2023-05-10T01:21:53.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.772+0000 7f8b361a0700 1 -- start start 2023-05-10T01:21:53.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b361a0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b30154460 0x7f8b300aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b361a0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30068150 0x7f8b300685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b361a0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b300c94c0 con 0x7f8b30154080 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b361a0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b300cb7d0 con 0x7f8b30154460 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b361a0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30068a90 con 0x7f8b30068150 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b30154460 0x7f8b300aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b30154460 0x7f8b300aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33460/0 (socket says 172.21.15.52:33460) 2023-05-10T01:21:53.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8b30154080 0x7f8b300a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42474/0 (socket says 172.21.15.52:42474) 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 -- 172.21.15.52:0/2111660941 learned_addr learned my addr 172.21.15.52:0/2111660941 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2ffff700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30068150 0x7f8b300685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 -- 172.21.15.52:0/2111660941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30068150 msgr2=0x7f8b300685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30068150 0x7f8b300685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 -- 172.21.15.52:0/2111660941 >> v1:172.21.15.52:6789/0 conn(0x7f8b30154080 legacy=0x7f8b300a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 -- 172.21.15.52:0/2111660941 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300c88b0 con 0x7f8b30154460 2023-05-10T01:21:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2e7fc700 1 -- 172.21.15.52:0/2111660941 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687494814 0 0) 0x7f8b300c94c0 con 0x7f8b30154080 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2effd700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30154460 0x7f8b300aac90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8b20006fd0 tx=0x7f8b200090f0).ready entity=mon.0 client_cookie=72b11d48c9308ffe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2e7fc700 1 -- 172.21.15.52:0/2111660941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000b600 con 0x7f8b30154460 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2e7fc700 1 -- 172.21.15.52:0/2111660941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000b760 con 0x7f8b30154460 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.773+0000 7f8b2e7fc700 1 -- 172.21.15.52:0/2111660941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000bae0 con 0x7f8b30154460 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 -- 172.21.15.52:0/2111660941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30154460 msgr2=0x7f8b300aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30154460 0x7f8b300aac90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8b20006fd0 tx=0x7f8b200090f0).stop 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 -- 172.21.15.52:0/2111660941 shutdown_connections 2023-05-10T01:21:53.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30068150 0x7f8b300685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 --2- 172.21.15.52:0/2111660941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30154460 0x7f8b300aac90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 -- 172.21.15.52:0/2111660941 >> 172.21.15.52:0/2111660941 conn(0x7f8b30067910 msgr2=0x7f8b300cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 -- 172.21.15.52:0/2111660941 shutdown_connections 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.774+0000 7f8b361a0700 1 -- 172.21.15.52:0/2111660941 wait complete. 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.775+0000 7f8b361a0700 1 Processor -- start 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.775+0000 7f8b361a0700 1 -- start start 2023-05-10T01:21:53.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 0x7f8b3014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30154460 0x7f8b30154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300c4b90 con 0x7f8b30068150 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30151d60 con 0x7f8b30154080 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b361a0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300c48b0 con 0x7f8b30154460 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33464/0 (socket says 172.21.15.52:33464) 2023-05-10T01:21:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 -- 172.21.15.52:0/862718907 learned_addr learned my addr 172.21.15.52:0/862718907 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2ffff700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30154460 0x7f8b30154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2effd700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 0x7f8b3014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 -- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30154460 msgr2=0x7f8b30154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30154460 0x7f8b30154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 -- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 msgr2=0x7f8b3014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 0x7f8b3014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.776+0000 7f8b2f7fe700 1 -- 172.21.15.52:0/862718907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009370 con 0x7f8b30068150 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b2effd700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 0x7f8b3014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b2f7fe700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8b1800c560 tx=0x7f8b18007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180072e0 con 0x7f8b30068150 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18007440 con 0x7f8b30068150 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b30152000 con 0x7f8b30068150 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180058f0 con 0x7f8b30068150 2023-05-10T01:21:53.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.777+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b301525c0 con 0x7f8b30068150 2023-05-10T01:21:53.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.778+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30066720 con 0x7f8b30068150 2023-05-10T01:21:53.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.778+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8b1801a060 con 0x7f8b30068150 2023-05-10T01:21:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.778+0000 7f8b277fe700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 0x7f8b14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.779+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5505+0+0 (secure 0 0 0) 0x7f8b18079070 con 0x7f8b30068150 2023-05-10T01:21:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.779+0000 7f8b2effd700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 0x7f8b14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.779+0000 7f8b2effd700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 0x7f8b14061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8b20009130 tx=0x7f8b20017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.783+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b1804a870 con 0x7f8b30068150 2023-05-10T01:21:53.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:53.958+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8b3006bd30 con 0x7f8b30068150 2023-05-10T01:21:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.961+0000 7f8b277fe700 1 -- 172.21.15.52:0/862718907 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8b18018070 con 0x7f8b30068150 2023-05-10T01:21:54.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.965+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 msgr2=0x7f8b14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.965+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 0x7f8b14061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8b20009130 tx=0x7f8b20017000).stop 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.965+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 msgr2=0x7f8b30150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f8b1800c560 tx=0x7f8b18007c90).stop 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 shutdown_connections 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b1405ed90 0x7f8b14061250 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7f8b20009130 tx=0x7f8b20017000).stop 2023-05-10T01:21:54.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b30154460 0x7f8b30154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:54.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b30068150 0x7f8b30150290 secure :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0x7f8b1800c560 tx=0x7f8b18007c90).stop 2023-05-10T01:21:54.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 --2- 172.21.15.52:0/862718907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b30154080 0x7f8b3014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:54.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 >> 172.21.15.52:0/862718907 conn(0x7f8b30067910 msgr2=0x7f8b3014f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:54.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 shutdown_connections 2023-05-10T01:21:54.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:54.966+0000 7f8b361a0700 1 -- 172.21.15.52:0/862718907 wait complete. 2023-05-10T01:21:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:21:54.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:21:55.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.115+0000 7f42c6f7e700 1 Processor -- start 2023-05-10T01:21:55.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.115+0000 7f42c6f7e700 1 -- start start 2023-05-10T01:21:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c6f7e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42c0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c6f7e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f42c00bc880 0x7f42c00bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c6f7e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c0155730 con 0x7f42c00c2690 2023-05-10T01:21:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c6f7e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c00bd1f0 con 0x7f42c00bc880 2023-05-10T01:21:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c6f7e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0154b20 con 0x7f42c0150a80 2023-05-10T01:21:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c551b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f42c00c2690 0x7f42c00c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42490/0 (socket says 172.21.15.52:42490) 2023-05-10T01:21:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c551b700 1 -- 172.21.15.52:0/3999716873 learned_addr learned my addr 172.21.15.52:0/3999716873 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> v2:172.21.15.172:3300/0 conn(0x7f42c00bc880 0x7f42c00bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42c0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304854621 0 0) 0x7f42c0155730 con 0x7f42c00c2690 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.116+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a00033f0 con 0x7f42c00c2690 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155074305 0 0) 0x7f42a00033f0 con 0x7f42c00c2690 2023-05-10T01:21:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 msgr2=0x7f42c0150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42c0150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 >> v2:172.21.15.172:3300/0 conn(0x7f42c00bc880 msgr2=0x7f42c00bcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 --2- 172.21.15.52:0/3999716873 >> v2:172.21.15.172:3300/0 conn(0x7f42c00bc880 0x7f42c00bcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0154e00 con 0x7f42c00c2690 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f42b0001470 con 0x7f42c00c2690 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42c0150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> v2:172.21.15.172:3300/0 conn(0x7f42c00bc880 0x7f42c00bcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:55.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 >> v1:172.21.15.52:6789/0 conn(0x7f42c00c2690 legacy=0x7f42c00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42a00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42a0004b80 0x7f42a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00bd1f0 con 0x7f42a0003dd0 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0154b20 con 0x7f42a0004b80 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a000b8e0 con 0x7f42c0150a80 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42c551b700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42a0004b80 0x7f42a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42a00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 -- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 msgr2=0x7f42a00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c0150a80 0x7f42a00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 -- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42a0004b80 msgr2=0x7f42a0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42a0004b80 0x7f42a0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 -- 172.21.15.52:0/3999716873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009a20 con 0x7f42a0003dd0 2023-05-10T01:21:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42c551b700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42a0004b80 0x7f42a0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bffff700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42a0004690 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f42c0062fb0 tx=0x7f42a8009060).ready entity=mon.0 client_cookie=9b4830f9d3f08117 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.117+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a80095c0 con 0x7f42a0003dd0 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800e710 con 0x7f42a0003dd0 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42bf7fe700 1 -- 172.21.15.52:0/3999716873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a800ea90 con 0x7f42a0003dd0 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 -- 172.21.15.52:0/3999716873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 msgr2=0x7f42a0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/3999716873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42a0004690 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f42c0062fb0 tx=0x7f42a8009060).stop 2023-05-10T01:21:55.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c551b700 1 -- 172.21.15.52:0/3999716873 reap_dead start 2023-05-10T01:21:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 -- 172.21.15.52:0/3999716873 shutdown_connections 2023-05-10T01:21:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 -- 172.21.15.52:0/3999716873 >> 172.21.15.52:0/3999716873 conn(0x7f42c00c3d80 msgr2=0x7f42c00c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 -- 172.21.15.52:0/3999716873 shutdown_connections 2023-05-10T01:21:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.118+0000 7f42c6f7e700 1 -- 172.21.15.52:0/3999716873 wait complete. 2023-05-10T01:21:55.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.119+0000 7f42c6f7e700 1 Processor -- start 2023-05-10T01:21:55.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.119+0000 7f42c6f7e700 1 -- start start 2023-05-10T01:21:55.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42c00a97c0 0x7f42c013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c013d4b0 0x7f42c013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c013de20 con 0x7f42a0003dd0 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00a9f30 con 0x7f42c00a97c0 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c6f7e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00aa210 con 0x7f42c013d4b0 2023-05-10T01:21:55.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c4d1a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c4d1a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33482/0 (socket says 172.21.15.52:33482) 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c4d1a700 1 -- 172.21.15.52:0/2149341552 learned_addr learned my addr 172.21.15.52:0/2149341552 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42bffff700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42c00a97c0 0x7f42c013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.120+0000 7f42c551b700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c013d4b0 0x7f42c013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 -- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c013d4b0 msgr2=0x7f42c013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c013d4b0 0x7f42c013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 -- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42c00a97c0 msgr2=0x7f42c013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42c00a97c0 0x7f42c013c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 -- 172.21.15.52:0/2149341552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00aa4f0 con 0x7f42a0003dd0 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c4d1a700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f42b8011580 tx=0x7f42b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800e030 con 0x7f42a0003dd0 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8014560 con 0x7f42a0003dd0 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c00aa7d0 con 0x7f42a0003dd0 2023-05-10T01:21:55.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011ee0 con 0x7f42a0003dd0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.121+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c00a9c40 con 0x7f42a0003dd0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.122+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c00aae20 con 0x7f42a0003dd0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.122+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f42b8014b70 con 0x7f42a0003dd0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.123+0000 7f42bcff9700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 0x7f42a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.123+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5875+0+0 (secure 0 0 0) 0x7f42b800f070 con 0x7f42a0003dd0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.123+0000 7f42bffff700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 0x7f42a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.123+0000 7f42bffff700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 0x7f42a4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f42c00c4ef0 tx=0x7f42a8019000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:55.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.127+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42b804bfd0 con 0x7f42a0003dd0 2023-05-10T01:21:55.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.299+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42c006c340 con 0x7f42a0003dd0 2023-05-10T01:21:55.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.964+0000 7f42bcff9700 1 -- 172.21.15.52:0/2149341552 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f42b804f5f0 con 0x7f42a0003dd0 2023-05-10T01:21:55.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.971+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 msgr2=0x7f42a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.971+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 0x7f42a4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f42c00c4ef0 tx=0x7f42a8019000).stop 2023-05-10T01:21:55.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.971+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 msgr2=0x7f42c01408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:55.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.971+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f42b8011580 tx=0x7f42b800b040).stop 2023-05-10T01:21:55.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 shutdown_connections 2023-05-10T01:21:55.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f42a405ed90 0x7f42a4061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42c013d4b0 0x7f42c013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42a0003dd0 0x7f42c01408b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 --2- 172.21.15.52:0/2149341552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42c00a97c0 0x7f42c013c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:55.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.974+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 >> 172.21.15.52:0/2149341552 conn(0x7f42c00c3d80 msgr2=0x7f42c00c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:55.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.981+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 shutdown_connections 2023-05-10T01:21:55.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:55.981+0000 7f42c6f7e700 1 -- 172.21.15.52:0/2149341552 wait complete. 2023-05-10T01:21:55.999 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:21:56.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:21:56.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.132+0000 7fe9638b3700 1 Processor -- start 2023-05-10T01:21:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.132+0000 7fe9638b3700 1 -- start start 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe9638b3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe9638b3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe9638b3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c0c3120 con 0x7fe95c14ff30 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe9638b3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c154b40 con 0x7fe95c154300 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe9638b3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c150a70 con 0x7fe95c1546e0 2023-05-10T01:21:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe96164f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe961e50700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe95c14ff30 0x7fe95c150360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:45048/0 (socket says 172.21.15.52:45048) 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe961e50700 1 -- 172.21.15.52:0/3558152929 learned_addr learned my addr 172.21.15.52:0/3558152929 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:53126/0 (socket says 172.21.15.52:53126) 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe96164f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:60046/0 (socket says 172.21.15.52:60046) 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 -- 172.21.15.52:0/3558152929 >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 msgr2=0x7fe95c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 --2- 172.21.15.52:0/3558152929 >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 -- 172.21.15.52:0/3558152929 >> v1:172.21.15.172:6789/0 conn(0x7fe95c14ff30 legacy=0x7fe95c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe95bfff700 1 -- 172.21.15.52:0/3558152929 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675086764 0 0) 0x7fe95c0c3120 con 0x7fe95c14ff30 2023-05-10T01:21:56.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.133+0000 7fe960e4e700 1 -- 172.21.15.52:0/3558152929 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c068530 con 0x7fe95c1546e0 2023-05-10T01:21:56.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe96164f700 1 --2- 172.21.15.52:0/3558152929 >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:56.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe960e4e700 1 --2- 172.21.15.52:0/3558152929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe950009760 tx=0x7fe950009060).ready entity=mon.2 client_cookie=39b2e69eb9bac572 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe95bfff700 1 -- 172.21.15.52:0/3558152929 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000f510 con 0x7fe95c1546e0 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe95bfff700 1 -- 172.21.15.52:0/3558152929 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000f670 con 0x7fe95c1546e0 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe95bfff700 1 -- 172.21.15.52:0/3558152929 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000f9f0 con 0x7fe95c1546e0 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 -- 172.21.15.52:0/3558152929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 msgr2=0x7fe95c063d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 --2- 172.21.15.52:0/3558152929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe950009760 tx=0x7fe950009060).stop 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 -- 172.21.15.52:0/3558152929 shutdown_connections 2023-05-10T01:21:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 --2- 172.21.15.52:0/3558152929 >> v2:172.21.15.172:3300/0 conn(0x7fe95c154300 0x7fe95c06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 --2- 172.21.15.52:0/3558152929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c1546e0 0x7fe95c063d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 -- 172.21.15.52:0/3558152929 >> 172.21.15.52:0/3558152929 conn(0x7fe95c0c3d80 msgr2=0x7fe95c0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:56.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 -- 172.21.15.52:0/3558152929 shutdown_connections 2023-05-10T01:21:56.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.134+0000 7fe9638b3700 1 -- 172.21.15.52:0/3558152929 wait complete. 2023-05-10T01:21:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.136+0000 7fe9638b3700 1 Processor -- start 2023-05-10T01:21:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.136+0000 7fe9638b3700 1 -- start start 2023-05-10T01:21:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.136+0000 7fe9638b3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c14ff30 0x7fe95c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.136+0000 7fe9638b3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c154300 0x7fe95c1440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.136+0000 7fe9638b3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9638b3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c152ee0 con 0x7fe95c1546e0 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9638b3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c165cd0 con 0x7fe95c154300 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9638b3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1656a0 con 0x7fe95c14ff30 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33500/0 (socket says 172.21.15.52:33500) 2023-05-10T01:21:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 -- 172.21.15.52:0/577635144 learned_addr learned my addr 172.21.15.52:0/577635144 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe96164f700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c14ff30 0x7fe95c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe960e4e700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c154300 0x7fe95c1440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 -- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c14ff30 msgr2=0x7fe95c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c14ff30 0x7fe95c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 -- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c154300 msgr2=0x7fe95c1440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c154300 0x7fe95c1440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 -- 172.21.15.52:0/577635144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95400ab30 con 0x7fe95c1546e0 2023-05-10T01:21:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe961e50700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fe94c00c490 tx=0x7fe94c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00ce00 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0072e0 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9500092a0 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c007660 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.137+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c151db0 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.138+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c165e40 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.139+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe94c010070 con 0x7fe95c1546e0 2023-05-10T01:21:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.139+0000 7fe9597fa700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 0x7fe93c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.139+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6257+0+0 (secure 0 0 0) 0x7fe94c0790e0 con 0x7fe95c1546e0 2023-05-10T01:21:56.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.139+0000 7fe96164f700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 0x7fe93c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.140+0000 7fe96164f700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 0x7fe93c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe95c0c7920 tx=0x7fe95400a890).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.144+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe94c04a5f0 con 0x7fe95c1546e0 2023-05-10T01:21:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.364+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe95c06c340 con 0x7fe95c1546e0 2023-05-10T01:21:56.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.371+0000 7fe9597fa700 1 -- 172.21.15.52:0/577635144 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe94c04dc10 con 0x7fe95c1546e0 2023-05-10T01:21:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.376+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 msgr2=0x7fe93c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.376+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 0x7fe93c061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe95c0c7920 tx=0x7fe95400a890).stop 2023-05-10T01:21:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.376+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 msgr2=0x7fe95c0bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.376+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fe94c00c490 tx=0x7fe94c007c10).stop 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 shutdown_connections 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe93c05ed90 0x7fe93c061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe95c1546e0 0x7fe95c0bf210 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c14ff30 0x7fe95c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 --2- 172.21.15.52:0/577635144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c154300 0x7fe95c1440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 >> 172.21.15.52:0/577635144 conn(0x7fe95c0c3d80 msgr2=0x7fe95c0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 shutdown_connections 2023-05-10T01:21:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.379+0000 7fe9638b3700 1 -- 172.21.15.52:0/577635144 wait complete. 2023-05-10T01:21:56.394 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 7 and data pool 8 2023-05-10T01:21:56.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:56.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.519+0000 7fecc1255700 1 Processor -- start 2023-05-10T01:21:56.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.519+0000 7fecc1255700 1 -- start start 2023-05-10T01:21:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecc1255700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 0x7fecbc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecc1255700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fecbc069da0 0x7fecbc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecc1255700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc0c0650 con 0x7fecbc154540 2023-05-10T01:21:56.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecc1255700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecbc0c1af0 con 0x7fecbc069da0 2023-05-10T01:21:56.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecc1255700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0bfd20 con 0x7fecbc154160 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecba59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fecbc154540 0x7fecbc069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42522/0 (socket says 172.21.15.52:42522) 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecba59c700 1 -- 172.21.15.52:0/2632200071 learned_addr learned my addr 172.21.15.52:0/2632200071 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecbad9d700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 0x7fecbc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecbb59e700 1 --2- 172.21.15.52:0/2632200071 >> v2:172.21.15.172:3300/0 conn(0x7fecbc069da0 0x7fecbc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecb9d9b700 1 -- 172.21.15.52:0/2632200071 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436263266 0 0) 0x7fecbc0c0650 con 0x7fecbc154540 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.520+0000 7fecb9d9b700 1 -- 172.21.15.52:0/2632200071 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec9c0033f0 con 0x7fecbc154540 2023-05-10T01:21:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbb59e700 1 -- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 msgr2=0x7fecbc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbb59e700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 0x7fecbc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbb59e700 1 -- 172.21.15.52:0/2632200071 >> v1:172.21.15.52:6789/0 conn(0x7fecbc154540 legacy=0x7fecbc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbb59e700 1 -- 172.21.15.52:0/2632200071 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0c0000 con 0x7fecbc069da0 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbad9d700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 0x7fecbc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecbb59e700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc069da0 0x7fecbc0c6150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fecac009760 tx=0x7fecac009060).ready entity=mon.1 client_cookie=7a12a180d20977c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecb9d9b700 1 -- 172.21.15.52:0/2632200071 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0090d0 con 0x7fecbc069da0 2023-05-10T01:21:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecb9d9b700 1 -- 172.21.15.52:0/2632200071 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00d4a0 con 0x7fecbc069da0 2023-05-10T01:21:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecb9d9b700 1 -- 172.21.15.52:0/2632200071 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00d820 con 0x7fecbc069da0 2023-05-10T01:21:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 -- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc069da0 msgr2=0x7fecbc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc069da0 0x7fecbc0c6150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fecac009760 tx=0x7fecac009060).stop 2023-05-10T01:21:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 -- 172.21.15.52:0/2632200071 shutdown_connections 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc069da0 0x7fecbc0c6150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 --2- 172.21.15.52:0/2632200071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc154160 0x7fecbc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 -- 172.21.15.52:0/2632200071 >> 172.21.15.52:0/2632200071 conn(0x7fecbc0cb6f0 msgr2=0x7fecbc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 -- 172.21.15.52:0/2632200071 shutdown_connections 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.521+0000 7fecc1255700 1 -- 172.21.15.52:0/2632200071 wait complete. 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 Processor -- start 2023-05-10T01:21:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 -- start start 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc069da0 0x7fecbc146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc154540 0x7fecbc14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.523+0000 7fecc1255700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c2cb0 con 0x7fecbc154160 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecc1255700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c20a0 con 0x7fecbc154540 2023-05-10T01:21:56.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecc1255700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c2380 con 0x7fecbc069da0 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33510/0 (socket says 172.21.15.52:33510) 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 -- 172.21.15.52:0/421148189 learned_addr learned my addr 172.21.15.52:0/421148189 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecbb59e700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc154540 0x7fecbc14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecbad9d700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc069da0 0x7fecbc146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 -- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc069da0 msgr2=0x7fecbc146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc069da0 0x7fecbc146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 -- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc154540 msgr2=0x7fecbc14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc154540 0x7fecbc14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 -- 172.21.15.52:0/421148189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009a20 con 0x7fecbc154160 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecba59c700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fecbc06aaf0 tx=0x7feca4007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40070d0 con 0x7fecbc154160 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4007230 con 0x7fecbc154160 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40075d0 con 0x7fecbc154160 2023-05-10T01:21:56.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac0092a0 con 0x7fecbc154160 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.524+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc0c2940 con 0x7fecbc154160 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.525+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc0666b0 con 0x7fecbc154160 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.526+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feca4010070 con 0x7fecbc154160 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.526+0000 7fecb2ffd700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 0x7feca0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.526+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6357+0+0 (secure 0 0 0) 0x7feca4079000 con 0x7fecbc154160 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.526+0000 7fecbad9d700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 0x7feca0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.527+0000 7fecbad9d700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 0x7feca0061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fecb4009fd0 tx=0x7fecb400b040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.530+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feca404a4b0 con 0x7fecbc154160 2023-05-10T01:21:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.707+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecbc06c340 con 0x7fecbc154160 2023-05-10T01:21:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.708+0000 7fecb2ffd700 1 -- 172.21.15.52:0/421148189 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17396 (secure 0 0 0) 0x7feca404dad0 con 0x7fecbc154160 2023-05-10T01:21:56.712 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:56.712 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:56.366677+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:56.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 msgr2=0x7feca0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 0x7feca0061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fecb4009fd0 tx=0x7fecb400b040).stop 2023-05-10T01:21:56.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 msgr2=0x7fecbc0c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fecbc06aaf0 tx=0x7feca4007bf0).stop 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 shutdown_connections 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feca005ed90 0x7feca0061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecbc154540 0x7fecbc14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecbc069da0 0x7fecbc146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 --2- 172.21.15.52:0/421148189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecbc154160 0x7fecbc0c3140 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 >> 172.21.15.52:0/421148189 conn(0x7fecbc0cb6f0 msgr2=0x7fecbc0c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:56.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.709+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 shutdown_connections 2023-05-10T01:21:56.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.710+0000 7fecc1255700 1 -- 172.21.15.52:0/421148189 wait complete. 2023-05-10T01:21:56.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:56.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.838+0000 7fe329c5e700 1 Processor -- start 2023-05-10T01:21:56.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.838+0000 7fe329c5e700 1 -- start start 2023-05-10T01:21:56.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.839+0000 7fe329c5e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe324069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.839+0000 7fe329c5e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240c0650 con 0x7fe324069b80 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.839+0000 7fe329c5e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32406a010 con 0x7fe324154160 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.839+0000 7fe329c5e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240bfd20 con 0x7fe324154540 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe323fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe324069b80 0x7fe3240c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42534/0 (socket says 172.21.15.52:42534) 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe323fff700 1 -- 172.21.15.52:0/2953559296 learned_addr learned my addr 172.21.15.52:0/2953559296 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe322ffd700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe324069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189360559 0 0) 0x7fe3240c0650 con 0x7fe324069b80 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3100033f0 con 0x7fe324069b80 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571232322 0 0) 0x7fe3100033f0 con 0x7fe324069b80 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 msgr2=0x7fe324069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe324069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 >> v1:172.21.15.172:6789/0 conn(0x7fe324154160 legacy=0x7fe3240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240c0000 con 0x7fe324069b80 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fe31c0017f0 con 0x7fe324069b80 2023-05-10T01:21:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 >> v1:172.21.15.52:6789/0 conn(0x7fe324069b80 legacy=0x7fe3240c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe310003910 0x7fe310003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe310004690 0x7fe310004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe310005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240bfd20 con 0x7fe310004690 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31000b8e0 con 0x7fe310003910 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31000ba50 con 0x7fe324154540 2023-05-10T01:21:56.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe322ffd700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe310004690 0x7fe310004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe3237fe700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe310003910 0x7fe310003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.840+0000 7fe323fff700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe310005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 -- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 msgr2=0x7fe310005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe310005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 -- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe310003910 msgr2=0x7fe310003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe310003910 0x7fe310003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 -- 172.21.15.52:0/2953559296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100033f0 con 0x7fe310004690 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe323fff700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324154540 0x7fe310005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe322ffd700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe310004690 0x7fe310004b10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe324154920 tx=0x7fe318009060).ready entity=mon.0 client_cookie=26bb10a86b99b53c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318009e90 con 0x7fe310004690 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318009430 con 0x7fe310004690 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe3227fc700 1 -- 172.21.15.52:0/2953559296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800e7f0 con 0x7fe310004690 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe329c5e700 1 -- 172.21.15.52:0/2953559296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe310004690 msgr2=0x7fe310004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe329c5e700 1 --2- 172.21.15.52:0/2953559296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe310004690 0x7fe310004b10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe324154920 tx=0x7fe318009060).stop 2023-05-10T01:21:56.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe323fff700 1 -- 172.21.15.52:0/2953559296 reap_dead start 2023-05-10T01:21:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe329c5e700 1 -- 172.21.15.52:0/2953559296 shutdown_connections 2023-05-10T01:21:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe329c5e700 1 -- 172.21.15.52:0/2953559296 >> 172.21.15.52:0/2953559296 conn(0x7fe3240cb740 msgr2=0x7fe3240c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.841+0000 7fe329c5e700 1 -- 172.21.15.52:0/2953559296 shutdown_connections 2023-05-10T01:21:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.842+0000 7fe329c5e700 1 -- 172.21.15.52:0/2953559296 wait complete. 2023-05-10T01:21:56.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 Processor -- start 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 -- start start 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe310004690 0x7fe3240ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 0x7fe3241676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324164d10 con 0x7fe324167b90 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240ad360 con 0x7fe3240acee0 2023-05-10T01:21:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.843+0000 7fe329c5e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe324164100 con 0x7fe310004690 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33532/0 (socket says 172.21.15.52:33532) 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 -- 172.21.15.52:0/3073849974 learned_addr learned my addr 172.21.15.52:0/3073849974 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe322ffd700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 0x7fe3241676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe3237fe700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe310004690 0x7fe3240ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 -- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe310004690 msgr2=0x7fe3240ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe310004690 0x7fe3240ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 -- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 msgr2=0x7fe3241676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 0x7fe3241676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 -- 172.21.15.52:0/3073849974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3241643e0 con 0x7fe324167b90 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe322ffd700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 0x7fe3241676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe323fff700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fe32406a780 tx=0x7fe31c001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00e5c0 con 0x7fe324167b90 2023-05-10T01:21:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00e720 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3241646c0 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00eae0 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.844+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240c4a30 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.845+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240c1ec0 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.846+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe31c014430 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.846+0000 7fe30b7fe700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 0x7fe304061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.846+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fe31c079b50 con 0x7fe324167b90 2023-05-10T01:21:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.846+0000 7fe3237fe700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 0x7fe304061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:56.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.847+0000 7fe3237fe700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 0x7fe304061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe314000c00 tx=0x7fe314007bb0).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:56.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:56.850+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe31c0498f0 con 0x7fe324167b90 2023-05-10T01:21:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.027+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3240666b0 con 0x7fe324167b90 2023-05-10T01:21:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.028+0000 7fe30b7fe700 1 -- 172.21.15.52:0/3073849974 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17396 (secure 0 0 0) 0x7fe3240c1ec0 con 0x7fe324167b90 2023-05-10T01:21:57.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:57.032 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:56.366677+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:21:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 msgr2=0x7fe304061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 0x7fe304061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe314000c00 tx=0x7fe314007bb0).stop 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 msgr2=0x7fe3240c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fe32406a780 tx=0x7fe31c001280).stop 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 shutdown_connections 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe30405ed90 0x7fe304061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324167b90 0x7fe3240c8b50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe310004690 0x7fe3240ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 --2- 172.21.15.52:0/3073849974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240acee0 0x7fe3241676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 >> 172.21.15.52:0/3073849974 conn(0x7fe3240cb740 msgr2=0x7fe3240ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 shutdown_connections 2023-05-10T01:21:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.030+0000 7fe329c5e700 1 -- 172.21.15.52:0/3073849974 wait complete. 2023-05-10T01:21:57.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:21:57.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.163+0000 7ff76a4c3700 1 Processor -- start 2023-05-10T01:21:57.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.163+0000 7ff76a4c3700 1 -- start start 2023-05-10T01:21:57.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff76a4c3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff764153f80 0x7ff7640a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff76a4c3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff764155370 0x7ff7640c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff76a4c3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640c6690 con 0x7ff7640c5cf0 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff76a4c3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff764069f50 con 0x7ff764155370 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff76a4c3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76406a9d0 con 0x7ff764153f80 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff764155370 0x7ff7640c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff764155370 0x7ff7640c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33540/0 (socket says 172.21.15.52:33540) 2023-05-10T01:21:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 -- 172.21.15.52:0/3233242172 learned_addr learned my addr 172.21.15.52:0/3233242172 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff7694c1700 1 --2- 172.21.15.52:0/3233242172 >> v2:172.21.15.172:3300/0 conn(0x7ff764153f80 0x7ff7640a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 -- 172.21.15.52:0/3233242172 >> v2:172.21.15.172:3300/0 conn(0x7ff764153f80 msgr2=0x7ff7640a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 --2- 172.21.15.52:0/3233242172 >> v2:172.21.15.172:3300/0 conn(0x7ff764153f80 0x7ff7640a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 -- 172.21.15.52:0/3233242172 >> v1:172.21.15.172:6789/0 conn(0x7ff7640c5cf0 legacy=0x7ff7640c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 -- 172.21.15.52:0/3233242172 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764155770 con 0x7ff764155370 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff769cc2700 1 --2- 172.21.15.52:0/3233242172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764155370 0x7ff7640c61a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff7640caa30 tx=0x7ff75c009840).ready entity=mon.0 client_cookie=9524c9c76fe5ceb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff753fff700 1 -- 172.21.15.52:0/3233242172 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00e070 con 0x7ff764155370 2023-05-10T01:21:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff753fff700 1 -- 172.21.15.52:0/3233242172 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00ba50 con 0x7ff764155370 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.164+0000 7ff753fff700 1 -- 172.21.15.52:0/3233242172 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00bdd0 con 0x7ff764155370 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3233242172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764155370 msgr2=0x7ff7640c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3233242172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764155370 0x7ff7640c61a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7ff7640caa30 tx=0x7ff75c009840).stop 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3233242172 shutdown_connections 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3233242172 >> v2:172.21.15.172:3300/0 conn(0x7ff764153f80 0x7ff7640a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3233242172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764155370 0x7ff7640c61a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3233242172 >> 172.21.15.52:0/3233242172 conn(0x7ff7640cb5f0 msgr2=0x7ff7640c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3233242172 shutdown_connections 2023-05-10T01:21:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.165+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3233242172 wait complete. 2023-05-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.166+0000 7ff76a4c3700 1 Processor -- start 2023-05-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.166+0000 7ff76a4c3700 1 -- start start 2023-05-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7640c5cf0 0x7ff7640ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff764155370 0x7ff764151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640aeed0 con 0x7ff764153f80 2023-05-10T01:21:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640afcf0 con 0x7ff764155370 2023-05-10T01:21:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff76a4c3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640af0e0 con 0x7ff7640c5cf0 2023-05-10T01:21:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33542/0 (socket says 172.21.15.52:33542) 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 -- 172.21.15.52:0/3810815415 learned_addr learned my addr 172.21.15.52:0/3810815415 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff769cc2700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff764155370 0x7ff764151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff7694c1700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7640c5cf0 0x7ff7640ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 -- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7640c5cf0 msgr2=0x7ff7640ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7640c5cf0 0x7ff7640ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 -- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff764155370 msgr2=0x7ff764151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff764155370 0x7ff764151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 -- 172.21.15.52:0/3810815415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009ae0 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.167+0000 7ff768cc0700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7ff75400c440 tx=0x7ff754007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.168+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754007020 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.168+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754007180 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.168+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7640af3c0 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.168+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754007520 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.168+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7640af980 con 0x7ff764153f80 2023-05-10T01:21:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.169+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764083110 con 0x7ff764153f80 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.169+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff754010070 con 0x7ff764153f80 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.169+0000 7ff7517fa700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 0x7ff744061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.169+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6357+0+0 (secure 0 0 0) 0x7ff754078b10 con 0x7ff764153f80 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.170+0000 7ff7694c1700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 0x7ff744061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.170+0000 7ff7694c1700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 0x7ff744061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff76000bba0 tx=0x7ff760008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.173+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7540478f0 con 0x7ff764153f80 2023-05-10T01:21:57.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:57.396+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff7640c6690 con 0x7ff764153f80 2023-05-10T01:21:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.378+0000 7ff7517fa700 1 -- 172.21.15.52:0/3810815415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff7640c6690 con 0x7ff764153f80 2023-05-10T01:21:58.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 msgr2=0x7ff744061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 0x7ff744061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff76000bba0 tx=0x7ff760008040).stop 2023-05-10T01:21:58.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 msgr2=0x7ff764163680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7ff75400c440 tx=0x7ff754007e00).stop 2023-05-10T01:21:58.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 shutdown_connections 2023-05-10T01:21:58.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff74405ed90 0x7ff744061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff764155370 0x7ff764151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7640c5cf0 0x7ff7640ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 --2- 172.21.15.52:0/3810815415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff764153f80 0x7ff764163680 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 >> 172.21.15.52:0/3810815415 conn(0x7ff7640cb5f0 msgr2=0x7ff7640ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:58.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 shutdown_connections 2023-05-10T01:21:58.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.380+0000 7ff76a4c3700 1 -- 172.21.15.52:0/3810815415 wait complete. 2023-05-10T01:21:58.398 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:21:58.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:21:58.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:21:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.521+0000 7f2cb344c700 1 Processor -- start 2023-05-10T01:21:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.522+0000 7f2cb344c700 1 -- start start 2023-05-10T01:21:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb344c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cac1510f0 0x7f2cac0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb344c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0622a0 con 0x7f2cac154a00 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb344c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac154f70 con 0x7f2cac150d10 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb344c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac155250 con 0x7f2cac1510f0 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cac1510f0 0x7f2cac0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cac1510f0 0x7f2cac0c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33552/0 (socket says 172.21.15.52:33552) 2023-05-10T01:21:58.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb19e9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2cac154a00 0x7f2cac0a6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42570/0 (socket says 172.21.15.52:42570) 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 -- 172.21.15.52:0/731392555 learned_addr learned my addr 172.21.15.52:0/731392555 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 -- 172.21.15.52:0/731392555 >> v1:172.21.15.172:6789/0 conn(0x7f2cac150d10 legacy=0x7f2cac0682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 -- 172.21.15.52:0/731392555 >> v1:172.21.15.52:6789/0 conn(0x7f2cac154a00 legacy=0x7f2cac0a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 -- 172.21.15.52:0/731392555 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac155530 con 0x7f2cac1510f0 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cb09e7700 1 --2- 172.21.15.52:0/731392555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac1510f0 0x7f2cac0c2900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f2ca0006fd0 tx=0x7f2ca00090f0).ready entity=mon.0 client_cookie=473466b065b35028 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cabfff700 1 -- 172.21.15.52:0/731392555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000b600 con 0x7f2cac1510f0 2023-05-10T01:21:58.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cabfff700 1 -- 172.21.15.52:0/731392555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000b760 con 0x7f2cac1510f0 2023-05-10T01:21:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.523+0000 7f2cabfff700 1 -- 172.21.15.52:0/731392555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000bb00 con 0x7f2cac1510f0 2023-05-10T01:21:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 -- 172.21.15.52:0/731392555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac1510f0 msgr2=0x7f2cac0c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 --2- 172.21.15.52:0/731392555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac1510f0 0x7f2cac0c2900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f2ca0006fd0 tx=0x7f2ca00090f0).stop 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 -- 172.21.15.52:0/731392555 shutdown_connections 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 --2- 172.21.15.52:0/731392555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac1510f0 0x7f2cac0c2900 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 -- 172.21.15.52:0/731392555 >> 172.21.15.52:0/731392555 conn(0x7f2cac0c8410 msgr2=0x7f2cac0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 -- 172.21.15.52:0/731392555 shutdown_connections 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.524+0000 7f2cb344c700 1 -- 172.21.15.52:0/731392555 wait complete. 2023-05-10T01:21:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.525+0000 7f2cb344c700 1 Processor -- start 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.525+0000 7f2cb344c700 1 -- start start 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 0x7f2cac0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 0x7f2cac0ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac162e70 con 0x7f2cac154a00 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0abe00 con 0x7f2cac150d10 2023-05-10T01:21:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb344c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac163060 con 0x7f2cac1510f0 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33560/0 (socket says 172.21.15.52:33560) 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 -- 172.21.15.52:0/2896857457 learned_addr learned my addr 172.21.15.52:0/2896857457 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb11e8700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 0x7f2cac0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb09e7700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 0x7f2cac0ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 -- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 msgr2=0x7f2cac0ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 0x7f2cac0ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 -- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 msgr2=0x7f2cac0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 0x7f2cac0ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb19e9700 1 -- 172.21.15.52:0/2896857457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009370 con 0x7f2cac154a00 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb11e8700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 0x7f2cac0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.526+0000 7f2cb09e7700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 0x7f2cac0ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2cb19e9700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f2c9c00c7c0 tx=0x7f2c9c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c005c70 con 0x7f2cac154a00 2023-05-10T01:21:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c005dd0 con 0x7f2cac154a00 2023-05-10T01:21:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac163340 con 0x7f2cac154a00 2023-05-10T01:21:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c007320 con 0x7f2cac154a00 2023-05-10T01:21:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.527+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac163b40 con 0x7f2cac154a00 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.528+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac163860 con 0x7f2cac154a00 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.528+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2c9c010030 con 0x7f2cac154a00 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.528+0000 7f2ca97fa700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 0x7f2c8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.528+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f2c9c079a20 con 0x7f2cac154a00 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.529+0000 7f2cb11e8700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 0x7f2c8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.529+0000 7f2cb11e8700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 0x7f2c8c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2ca4006fd0 tx=0x7f2ca4008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.532+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2cac163860 con 0x7f2cac154a00 2023-05-10T01:21:58.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:58.747+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2cac163d90 con 0x7f2cac154a00 2023-05-10T01:21:59.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.379+0000 7f2ca97fa700 1 -- 172.21.15.52:0/2896857457 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2c9c04aed0 con 0x7f2cac154a00 2023-05-10T01:21:59.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.381+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 msgr2=0x7f2c8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.381+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 0x7f2c8c061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2ca4006fd0 tx=0x7f2ca4008040).stop 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 msgr2=0x7f2cac0c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f2c9c00c7c0 tx=0x7f2c9c001510).stop 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 shutdown_connections 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2c8c05ed90 0x7f2c8c061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac154a00 0x7f2cac0c2e50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cac150d10 0x7f2cac0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 --2- 172.21.15.52:0/2896857457 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cac1510f0 0x7f2cac0ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 >> 172.21.15.52:0/2896857457 conn(0x7f2cac0c8410 msgr2=0x7f2cac0c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:59.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 shutdown_connections 2023-05-10T01:21:59.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.382+0000 7f2cb344c700 1 -- 172.21.15.52:0/2896857457 wait complete. 2023-05-10T01:21:59.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:21:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.563+0000 7f1ec3fff700 1 Processor -- start 2023-05-10T01:21:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.563+0000 7f1ec3fff700 1 -- start start 2023-05-10T01:21:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 0x7f1ec4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ec40c7750 0x7f1ec40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec3fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec4158960 con 0x7f1ec40ad030 2023-05-10T01:21:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec3fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec4155330 con 0x7f1ec40c7750 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec4157d50 con 0x7f1ec40c7370 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ec40c7750 0x7f1ec40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ec40c7750 0x7f1ec40acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33566/0 (socket says 172.21.15.52:33566) 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec27fc700 1 -- 172.21.15.52:0/319437855 learned_addr learned my addr 172.21.15.52:0/319437855 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.564+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 0x7f1ec4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec27fc700 1 -- 172.21.15.52:0/319437855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 msgr2=0x7f1ec4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec27fc700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 0x7f1ec4154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec27fc700 1 -- 172.21.15.52:0/319437855 >> v1:172.21.15.172:6789/0 conn(0x7f1ec40ad030 legacy=0x7f1ec414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec27fc700 1 -- 172.21.15.52:0/319437855 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec4158030 con 0x7f1ec40c7750 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 0x7f1ec4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec27fc700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7750 0x7f1ec40acb40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f1eb8006fd0 tx=0x7f1eb80090f0).ready entity=mon.0 client_cookie=de2a719a706a5a89 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec1ffb700 1 -- 172.21.15.52:0/319437855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800b600 con 0x7f1ec40c7750 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec1ffb700 1 -- 172.21.15.52:0/319437855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800b760 con 0x7f1ec40c7750 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec1ffb700 1 -- 172.21.15.52:0/319437855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800bae0 con 0x7f1ec40c7750 2023-05-10T01:21:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 -- 172.21.15.52:0/319437855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7750 msgr2=0x7f1ec40acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7750 0x7f1ec40acb40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f1eb8006fd0 tx=0x7f1eb80090f0).stop 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 -- 172.21.15.52:0/319437855 shutdown_connections 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7370 0x7f1ec4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/319437855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7750 0x7f1ec40acb40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 -- 172.21.15.52:0/319437855 >> 172.21.15.52:0/319437855 conn(0x7f1ec4068320 msgr2=0x7f1ec4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 -- 172.21.15.52:0/319437855 shutdown_connections 2023-05-10T01:21:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.565+0000 7f1ec3fff700 1 -- 172.21.15.52:0/319437855 wait complete. 2023-05-10T01:21:59.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.567+0000 7f1ec3fff700 1 Processor -- start 2023-05-10T01:21:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.567+0000 7f1ec3fff700 1 -- start start 2023-05-10T01:21:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 0x7f1ec4169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 0x7f1ec40abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec4169800 con 0x7f1ec40c7370 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40b0720 con 0x7f1ec40ad030 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec40c8db0 con 0x7f1ec40c7750 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33572/0 (socket says 172.21.15.52:33572) 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 -- 172.21.15.52:0/159939791 learned_addr learned my addr 172.21.15.52:0/159939791 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 0x7f1ec4169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec37fe700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 0x7f1ec40abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 -- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 msgr2=0x7f1ec40abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 0x7f1ec40abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 -- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 msgr2=0x7f1ec4169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 0x7f1ec4169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 -- 172.21.15.52:0/159939791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8009370 con 0x7f1ec40c7370 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 0x7f1ec4169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec37fe700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 0x7f1ec40abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:21:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec27fc700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1eb8011000 tx=0x7f1eb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800bae0 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8000c90 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec40c9090 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb801c670 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec40c9650 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.569+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec4047150 con 0x7f1ec40c7370 2023-05-10T01:21:59.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.570+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1eb800f070 con 0x7f1ec40c7370 2023-05-10T01:21:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.570+0000 7f1eaaffd700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 0x7f1ea4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.570+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f1eb807c300 con 0x7f1ec40c7370 2023-05-10T01:21:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.570+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 0x7f1ea4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.571+0000 7f1ec2ffd700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 0x7f1ea4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1ebc00d640 tx=0x7f1ebc007670).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.575+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1eb804d830 con 0x7f1ec40c7370 2023-05-10T01:21:59.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.792+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ec4158310 con 0x7f1ec40c7370 2023-05-10T01:21:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.792+0000 7f1eaaffd700 1 -- 172.21.15.52:0/159939791 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f1eb8050e50 con 0x7f1ec40c7370 2023-05-10T01:21:59.795 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:21:59.795 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:21:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 msgr2=0x7f1ea4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 0x7f1ea4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1ebc00d640 tx=0x7f1ebc007670).stop 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 msgr2=0x7f1ec4146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1eb8011000 tx=0x7f1eb8017000).stop 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 shutdown_connections 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ea405ed90 0x7f1ea4061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ec40c7750 0x7f1ec40abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ec40ad030 0x7f1ec4169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 --2- 172.21.15.52:0/159939791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec40c7370 0x7f1ec4146470 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 >> 172.21.15.52:0/159939791 conn(0x7f1ec4068320 msgr2=0x7f1ec4069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 shutdown_connections 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.793+0000 7f1ec3fff700 1 -- 172.21.15.52:0/159939791 wait complete. 2023-05-10T01:21:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:21:59.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:21:59.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.922+0000 7f7afd362700 1 Processor -- start 2023-05-10T01:21:59.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.922+0000 7f7afd362700 1 -- start start 2023-05-10T01:21:59.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7afd362700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7afd362700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7af8069b80 0x7f7af80c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7afd362700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af80c0650 con 0x7f7af8154160 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7afd362700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af806a010 con 0x7f7af8069b80 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7afd362700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80bfd20 con 0x7f7af8154540 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7af77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7af8069b80 0x7f7af80c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:53216/0 (socket says 172.21.15.52:53216) 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.923+0000 7f7af67fc700 1 -- 172.21.15.52:0/1533497280 learned_addr learned my addr 172.21.15.52:0/1533497280 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af67fc700 1 -- 172.21.15.52:0/1533497280 >> v2:172.21.15.172:3300/0 conn(0x7f7af8069b80 msgr2=0x7f7af80c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af67fc700 1 --2- 172.21.15.52:0/1533497280 >> v2:172.21.15.172:3300/0 conn(0x7f7af8069b80 0x7f7af80c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af67fc700 1 -- 172.21.15.52:0/1533497280 >> v1:172.21.15.172:6789/0 conn(0x7f7af8154160 legacy=0x7f7af80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af67fc700 1 -- 172.21.15.52:0/1533497280 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80c0000 con 0x7f7af8154540 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af67fc700 1 --2- 172.21.15.52:0/1533497280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7ae0006fd0 tx=0x7f7ae00090f0).ready entity=mon.2 client_cookie=b4bd344510733187 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af5ffb700 1 -- 172.21.15.52:0/1533497280 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000b580 con 0x7f7af8154540 2023-05-10T01:21:59.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af5ffb700 1 -- 172.21.15.52:0/1533497280 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae000b6e0 con 0x7f7af8154540 2023-05-10T01:21:59.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.924+0000 7f7af5ffb700 1 -- 172.21.15.52:0/1533497280 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000ba80 con 0x7f7af8154540 2023-05-10T01:21:59.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 -- 172.21.15.52:0/1533497280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 msgr2=0x7f7af8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 --2- 172.21.15.52:0/1533497280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7ae0006fd0 tx=0x7f7ae00090f0).stop 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 -- 172.21.15.52:0/1533497280 shutdown_connections 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 --2- 172.21.15.52:0/1533497280 >> v2:172.21.15.172:3300/0 conn(0x7f7af8069b80 0x7f7af80c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 --2- 172.21.15.52:0/1533497280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154540 0x7f7af8069690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 -- 172.21.15.52:0/1533497280 >> 172.21.15.52:0/1533497280 conn(0x7f7af80cb6f0 msgr2=0x7f7af80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:21:59.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 -- 172.21.15.52:0/1533497280 shutdown_connections 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.925+0000 7f7afd362700 1 -- 172.21.15.52:0/1533497280 wait complete. 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.926+0000 7f7afd362700 1 Processor -- start 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.926+0000 7f7afd362700 1 -- start start 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af8069b80 0x7f7af8141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154160 0x7f7af80a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81511d0 con 0x7f7af8154540 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80a23b0 con 0x7f7af8069b80 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7afd362700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81513b0 con 0x7f7af8154160 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33588/0 (socket says 172.21.15.52:33588) 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 -- 172.21.15.52:0/1109686185 learned_addr learned my addr 172.21.15.52:0/1109686185 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:21:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af67fc700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154160 0x7f7af80a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af6ffd700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af8069b80 0x7f7af8141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 -- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154160 msgr2=0x7f7af80a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154160 0x7f7af80a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 -- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af8069b80 msgr2=0x7f7af8141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af8069b80 0x7f7af8141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 -- 172.21.15.52:0/1109686185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009370 con 0x7f7af8154540 2023-05-10T01:21:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.927+0000 7f7af77fe700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f7ae8009e90 tx=0x7f7ae800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800caa0 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800f040 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8151690 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800ce10 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af8151cd0 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.928+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af80666b0 con 0x7f7af8154540 2023-05-10T01:21:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.929+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ae8013610 con 0x7f7af8154540 2023-05-10T01:21:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.929+0000 7f7aeeffd700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 0x7f7adc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:21:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.929+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f7ae807a6b0 con 0x7f7af8154540 2023-05-10T01:21:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.929+0000 7f7af6ffd700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 0x7f7adc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:21:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.930+0000 7f7af6ffd700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 0x7f7adc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7af0003900 tx=0x7f7af0007d40).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:21:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:21:59.933+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ae804ba50 con 0x7f7af8154540 2023-05-10T01:22:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.107+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7af8151e60 con 0x7f7af8154540 2023-05-10T01:22:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.108+0000 7f7aeeffd700 1 -- 172.21.15.52:0/1109686185 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17383 (secure 0 0 0) 0x7f7ae804f070 con 0x7f7af8154540 2023-05-10T01:22:00.111 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:00.111 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":63,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:21:57.368637+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:22:00.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 msgr2=0x7f7adc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 0x7f7adc061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7af0003900 tx=0x7f7af0007d40).stop 2023-05-10T01:22:00.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 msgr2=0x7f7af80a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f7ae8009e90 tx=0x7f7ae800b040).stop 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 shutdown_connections 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7adc05ed90 0x7f7adc061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af8154540 0x7f7af80a1ec0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7af8069b80 0x7f7af8141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 --2- 172.21.15.52:0/1109686185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7af8154160 0x7f7af80a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 >> 172.21.15.52:0/1109686185 conn(0x7f7af80cb6f0 msgr2=0x7f7af80abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 shutdown_connections 2023-05-10T01:22:00.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.110+0000 7f7afd362700 1 -- 172.21.15.52:0/1109686185 wait complete. 2023-05-10T01:22:00.125 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:22:00.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:22:00.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.239+0000 7f8516ce6700 1 Processor -- start 2023-05-10T01:22:00.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.239+0000 7f8516ce6700 1 -- start start 2023-05-10T01:22:00.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8516ce6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8510154160 0x7f85100c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8516ce6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100c0650 con 0x7f8510069da0 2023-05-10T01:22:00.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8516ce6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100bfd20 con 0x7f8510154540 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8516ce6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100c0000 con 0x7f8510154160 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8515283700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8510069da0 0x7f85100c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42610/0 (socket says 172.21.15.52:42610) 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8515283700 1 -- 172.21.15.52:0/2068920074 learned_addr learned my addr 172.21.15.52:0/2068920074 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f8514a82700 1 --2- 172.21.15.52:0/2068920074 >> v2:172.21.15.172:3300/0 conn(0x7f8510154160 0x7f85100c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940572891 0 0) 0x7f85100c0650 con 0x7f8510069da0 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.240+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84fc0033f0 con 0x7f8510069da0 2023-05-10T01:22:00.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 364297998 0 0) 0x7f84fc0033f0 con 0x7f8510069da0 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8514a82700 1 -- 172.21.15.52:0/2068920074 >> v1:172.21.15.172:6789/0 conn(0x7f8510154540 legacy=0x7f8510069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8514a82700 1 -- 172.21.15.52:0/2068920074 >> v1:172.21.15.52:6789/0 conn(0x7f8510069da0 legacy=0x7f85100c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8514a82700 1 -- 172.21.15.52:0/2068920074 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100c02e0 con 0x7f8510154160 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8514a82700 1 --2- 172.21.15.52:0/2068920074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c5c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8508009e60 tx=0x7f8508009780).ready entity=mon.1 client_cookie=6b9f5f2d29c740a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800e070 con 0x7f8510154160 2023-05-10T01:22:00.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850800b850 con 0x7f8510154160 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f850f7fe700 1 -- 172.21.15.52:0/2068920074 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500001470 con 0x7f8510154160 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8516ce6700 1 -- 172.21.15.52:0/2068920074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 msgr2=0x7f85100c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8516ce6700 1 --2- 172.21.15.52:0/2068920074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c5c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8508009e60 tx=0x7f8508009780).stop 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8516ce6700 1 -- 172.21.15.52:0/2068920074 shutdown_connections 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.241+0000 7f8516ce6700 1 --2- 172.21.15.52:0/2068920074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c5c60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.242+0000 7f8516ce6700 1 -- 172.21.15.52:0/2068920074 >> 172.21.15.52:0/2068920074 conn(0x7f85100cb740 msgr2=0x7f85100c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.242+0000 7f8516ce6700 1 -- 172.21.15.52:0/2068920074 shutdown_connections 2023-05-10T01:22:00.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.242+0000 7f8516ce6700 1 -- 172.21.15.52:0/2068920074 wait complete. 2023-05-10T01:22:00.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.243+0000 7f8516ce6700 1 Processor -- start 2023-05-10T01:22:00.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.243+0000 7f8516ce6700 1 -- start start 2023-05-10T01:22:00.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.243+0000 7f8516ce6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8510069da0 0x7f85100aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.243+0000 7f8516ce6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510168450 con 0x7f8510154540 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510167b20 con 0x7f8510154160 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8510167e00 con 0x7f8510069da0 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33602/0 (socket says 172.21.15.52:33602) 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 -- 172.21.15.52:0/1715589131 learned_addr learned my addr 172.21.15.52:0/1715589131 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:00.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f850ffff700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 -- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8510069da0 msgr2=0x7f85100aa2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8510069da0 0x7f85100aa2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 -- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 msgr2=0x7f85100c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 -- 172.21.15.52:0/1715589131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508009a20 con 0x7f8510154540 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f850ffff700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:00.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8515283700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f850000c7a0 tx=0x7f8500001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500007170 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85000072d0 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85101680e0 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000048c0 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.244+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85100c49f0 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.245+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8510167c60 con 0x7f8510154540 2023-05-10T01:22:00.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.246+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8500010070 con 0x7f8510154540 2023-05-10T01:22:00.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.246+0000 7f850cff9700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 0x7f84f0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.246+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f8500079770 con 0x7f8510154540 2023-05-10T01:22:00.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.247+0000 7f8514a82700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 0x7f84f0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.248+0000 7f8514a82700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 0x7f84f0061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8508009480 tx=0x7f8508009780).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.250+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8510167c60 con 0x7f8510154540 2023-05-10T01:22:00.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.421+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8510168590 con 0x7f84f005ed60 2023-05-10T01:22:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.433+0000 7f850cff9700 1 -- 172.21.15.52:0/1715589131 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357531 (secure 0 0 0) 0x7f8508000fd0 con 0x7f84f005ed60 2023-05-10T01:22:00.439 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 msgr2=0x7f84f0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 0x7f84f0061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8508009480 tx=0x7f8508009780).stop 2023-05-10T01:22:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 msgr2=0x7f85100c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f850000c7a0 tx=0x7f8500001b50).stop 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 shutdown_connections 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f84f005ed60 0x7f84f0061220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510154540 0x7f85100c2790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8510069da0 0x7f85100aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 --2- 172.21.15.52:0/1715589131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510154160 0x7f85100c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 >> 172.21.15.52:0/1715589131 conn(0x7f85100cb740 msgr2=0x7f85100ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 shutdown_connections 2023-05-10T01:22:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.436+0000 7f8516ce6700 1 -- 172.21.15.52:0/1715589131 wait complete. 2023-05-10T01:22:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:22:00.450 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:21:59.733413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138164,"kb_used_data":5748,"kb_used_omap":0,"kb_used_meta":132352,"kb_avail":754836556,"statfs":{"total":773094113280,"available":772952633344,"internally_reserved":0,"allocated":5885952,"data_stored":2858603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135528448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14669473,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.193368"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396349+0000","last_change":"2023-05-10T01:21:56.393474+0000","last_active":"2023-05-10T01:21:56.396349+0000","last_peered":"2023-05-10T01:21:56.396349+0000","last_clean":"2023-05-10T01:21:56.396349+0000","last_became_active":"2023-05-10T01:21:56.393150+0000","last_became_peered":"2023-05-10T01:21:56.393150+0000","last_unstale":"2023-05-10T01:21:56.396349+0000","last_undegraded":"2023-05-10T01:21:56.396349+0000","last_fullsized":"2023-05-10T01:21:56.396349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372259+0000","last_change":"2023-05-10T01:21:55.995244+0000","last_active":"2023-05-10T01:21:56.372259+0000","last_peered":"2023-05-10T01:21:56.372259+0000","last_clean":"2023-05-10T01:21:56.372259+0000","last_became_active":"2023-05-10T01:21:55.994967+0000","last_became_peered":"2023-05-10T01:21:55.994967+0000","last_unstale":"2023-05-10T01:21:56.372259+0000","last_undegraded":"2023-05-10T01:21:56.372259+0000","last_fullsized":"2023-05-10T01:21:56.372259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393590+0000","last_change":"2023-05-10T01:21:56.387460+0000","last_active":"2023-05-10T01:21:56.393590+0000","last_peered":"2023-05-10T01:21:56.393590+0000","last_clean":"2023-05-10T01:21:56.393590+0000","last_became_active":"2023-05-10T01:21:56.387168+0000","last_became_peered":"2023-05-10T01:21:56.387168+0000","last_unstale":"2023-05-10T01:21:56.393590+0000","last_undegraded":"2023-05-10T01:21:56.393590+0000","last_fullsized":"2023-05-10T01:21:56.393590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375395+0000","last_change":"2023-05-10T01:21:55.981476+0000","last_active":"2023-05-10T01:21:56.375395+0000","last_peered":"2023-05-10T01:21:56.375395+0000","last_clean":"2023-05-10T01:21:56.375395+0000","last_became_active":"2023-05-10T01:21:55.981022+0000","last_became_peered":"2023-05-10T01:21:55.981022+0000","last_unstale":"2023-05-10T01:21:56.375395+0000","last_undegraded":"2023-05-10T01:21:56.375395+0000","last_fullsized":"2023-05-10T01:21:56.375395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396467+0000","last_change":"2023-05-10T01:21:56.393248+0000","last_active":"2023-05-10T01:21:56.396467+0000","last_peered":"2023-05-10T01:21:56.396467+0000","last_clean":"2023-05-10T01:21:56.396467+0000","last_became_active":"2023-05-10T01:21:56.392940+0000","last_became_peered":"2023-05-10T01:21:56.392940+0000","last_unstale":"2023-05-10T01:21:56.396467+0000","last_undegraded":"2023-05-10T01:21:56.396467+0000","last_fullsized":"2023-05-10T01:21:56.396467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394545+0000","last_change":"2023-05-10T01:21:55.989682+0000","last_active":"2023-05-10T01:21:56.394545+0000","last_peered":"2023-05-10T01:21:56.394545+0000","last_clean":"2023-05-10T01:21:56.394545+0000","last_became_active":"2023-05-10T01:21:55.989221+0000","last_became_peered":"2023-05-10T01:21:55.989221+0000","last_unstale":"2023-05-10T01:21:56.394545+0000","last_undegraded":"2023-05-10T01:21:56.394545+0000","last_fullsized":"2023-05-10T01:21:56.394545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398309+0000","last_change":"2023-05-10T01:21:56.396249+0000","last_active":"2023-05-10T01:21:56.398309+0000","last_peered":"2023-05-10T01:21:56.398309+0000","last_clean":"2023-05-10T01:21:56.398309+0000","last_became_active":"2023-05-10T01:21:56.395946+0000","last_became_peered":"2023-05-10T01:21:56.395946+0000","last_unstale":"2023-05-10T01:21:56.398309+0000","last_undegraded":"2023-05-10T01:21:56.398309+0000","last_fullsized":"2023-05-10T01:21:56.398309+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383417+0000","last_change":"2023-05-10T01:21:55.989419+0000","last_active":"2023-05-10T01:21:56.383417+0000","last_peered":"2023-05-10T01:21:56.383417+0000","last_clean":"2023-05-10T01:21:56.383417+0000","last_became_active":"2023-05-10T01:21:55.989168+0000","last_became_peered":"2023-05-10T01:21:55.989168+0000","last_unstale":"2023-05-10T01:21:56.383417+0000","last_undegraded":"2023-05-10T01:21:56.383417+0000","last_fullsized":"2023-05-10T01:21:56.383417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394435+0000","last_change":"2023-05-10T01:21:55.987682+0000","last_active":"2023-05-10T01:21:56.394435+0000","last_peered":"2023-05-10T01:21:56.394435+0000","last_clean":"2023-05-10T01:21:56.394435+0000","last_became_active":"2023-05-10T01:21:55.987380+0000","last_became_peered":"2023-05-10T01:21:55.987380+0000","last_unstale":"2023-05-10T01:21:56.394435+0000","last_undegraded":"2023-05-10T01:21:56.394435+0000","last_fullsized":"2023-05-10T01:21:56.394435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396200+0000","last_change":"2023-05-10T01:21:56.392983+0000","last_active":"2023-05-10T01:21:56.396200+0000","last_peered":"2023-05-10T01:21:56.396200+0000","last_clean":"2023-05-10T01:21:56.396200+0000","last_became_active":"2023-05-10T01:21:56.392726+0000","last_became_peered":"2023-05-10T01:21:56.392726+0000","last_unstale":"2023-05-10T01:21:56.396200+0000","last_undegraded":"2023-05-10T01:21:56.396200+0000","last_fullsized":"2023-05-10T01:21:56.396200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384785+0000","last_change":"2023-05-10T01:21:56.381538+0000","last_active":"2023-05-10T01:21:56.384785+0000","last_peered":"2023-05-10T01:21:56.384785+0000","last_clean":"2023-05-10T01:21:56.384785+0000","last_became_active":"2023-05-10T01:21:56.381059+0000","last_became_peered":"2023-05-10T01:21:56.381059+0000","last_unstale":"2023-05-10T01:21:56.384785+0000","last_undegraded":"2023-05-10T01:21:56.384785+0000","last_fullsized":"2023-05-10T01:21:56.384785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373368+0000","last_change":"2023-05-10T01:21:55.992753+0000","last_active":"2023-05-10T01:21:56.373368+0000","last_peered":"2023-05-10T01:21:56.373368+0000","last_clean":"2023-05-10T01:21:56.373368+0000","last_became_active":"2023-05-10T01:21:55.989112+0000","last_became_peered":"2023-05-10T01:21:55.989112+0000","last_unstale":"2023-05-10T01:21:56.373368+0000","last_undegraded":"2023-05-10T01:21:56.373368+0000","last_fullsized":"2023-05-10T01:21:56.373368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.389535+0000","last_change":"2023-05-10T01:21:56.385875+0000","last_active":"2023-05-10T01:21:56.389535+0000","last_peered":"2023-05-10T01:21:56.389535+0000","last_clean":"2023-05-10T01:21:56.389535+0000","last_became_active":"2023-05-10T01:21:56.385559+0000","last_became_peered":"2023-05-10T01:21:56.385559+0000","last_unstale":"2023-05-10T01:21:56.389535+0000","last_undegraded":"2023-05-10T01:21:56.389535+0000","last_fullsized":"2023-05-10T01:21:56.389535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374945+0000","last_change":"2023-05-10T01:21:55.995994+0000","last_active":"2023-05-10T01:21:56.374945+0000","last_peered":"2023-05-10T01:21:56.374945+0000","last_clean":"2023-05-10T01:21:56.374945+0000","last_became_active":"2023-05-10T01:21:55.995612+0000","last_became_peered":"2023-05-10T01:21:55.995612+0000","last_unstale":"2023-05-10T01:21:56.374945+0000","last_undegraded":"2023-05-10T01:21:56.374945+0000","last_fullsized":"2023-05-10T01:21:56.374945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397620+0000","last_change":"2023-05-10T01:21:56.393150+0000","last_active":"2023-05-10T01:21:56.397620+0000","last_peered":"2023-05-10T01:21:56.397620+0000","last_clean":"2023-05-10T01:21:56.397620+0000","last_became_active":"2023-05-10T01:21:56.392864+0000","last_became_peered":"2023-05-10T01:21:56.392864+0000","last_unstale":"2023-05-10T01:21:56.397620+0000","last_undegraded":"2023-05-10T01:21:56.397620+0000","last_fullsized":"2023-05-10T01:21:56.397620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374362+0000","last_change":"2023-05-10T01:21:55.989756+0000","last_active":"2023-05-10T01:21:56.374362+0000","last_peered":"2023-05-10T01:21:56.374362+0000","last_clean":"2023-05-10T01:21:56.374362+0000","last_became_active":"2023-05-10T01:21:55.989216+0000","last_became_peered":"2023-05-10T01:21:55.989216+0000","last_unstale":"2023-05-10T01:21:56.374362+0000","last_undegraded":"2023-05-10T01:21:56.374362+0000","last_fullsized":"2023-05-10T01:21:56.374362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385955+0000","last_change":"2023-05-10T01:21:56.379300+0000","last_active":"2023-05-10T01:21:56.385955+0000","last_peered":"2023-05-10T01:21:56.385955+0000","last_clean":"2023-05-10T01:21:56.385955+0000","last_became_active":"2023-05-10T01:21:56.378969+0000","last_became_peered":"2023-05-10T01:21:56.378969+0000","last_unstale":"2023-05-10T01:21:56.385955+0000","last_undegraded":"2023-05-10T01:21:56.385955+0000","last_fullsized":"2023-05-10T01:21:56.385955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376325+0000","last_change":"2023-05-10T01:21:55.996558+0000","last_active":"2023-05-10T01:21:56.376325+0000","last_peered":"2023-05-10T01:21:56.376325+0000","last_clean":"2023-05-10T01:21:56.376325+0000","last_became_active":"2023-05-10T01:21:55.996094+0000","last_became_peered":"2023-05-10T01:21:55.996094+0000","last_unstale":"2023-05-10T01:21:56.376325+0000","last_undegraded":"2023-05-10T01:21:56.376325+0000","last_fullsized":"2023-05-10T01:21:56.376325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393472+0000","last_change":"2023-05-10T01:21:56.389655+0000","last_active":"2023-05-10T01:21:56.393472+0000","last_peered":"2023-05-10T01:21:56.393472+0000","last_clean":"2023-05-10T01:21:56.393472+0000","last_became_active":"2023-05-10T01:21:56.389185+0000","last_became_peered":"2023-05-10T01:21:56.389185+0000","last_unstale":"2023-05-10T01:21:56.393472+0000","last_undegraded":"2023-05-10T01:21:56.393472+0000","last_fullsized":"2023-05-10T01:21:56.393472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397557+0000","last_change":"2023-05-10T01:21:55.990841+0000","last_active":"2023-05-10T01:21:56.397557+0000","last_peered":"2023-05-10T01:21:56.397557+0000","last_clean":"2023-05-10T01:21:56.397557+0000","last_became_active":"2023-05-10T01:21:55.990576+0000","last_became_peered":"2023-05-10T01:21:55.990576+0000","last_unstale":"2023-05-10T01:21:56.397557+0000","last_undegraded":"2023-05-10T01:21:56.397557+0000","last_fullsized":"2023-05-10T01:21:56.397557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393891+0000","last_change":"2023-05-10T01:21:56.387347+0000","last_active":"2023-05-10T01:21:56.393891+0000","last_peered":"2023-05-10T01:21:56.393891+0000","last_clean":"2023-05-10T01:21:56.393891+0000","last_became_active":"2023-05-10T01:21:56.386716+0000","last_became_peered":"2023-05-10T01:21:56.386716+0000","last_unstale":"2023-05-10T01:21:56.393891+0000","last_undegraded":"2023-05-10T01:21:56.393891+0000","last_fullsized":"2023-05-10T01:21:56.393891+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376282+0000","last_change":"2023-05-10T01:21:55.996347+0000","last_active":"2023-05-10T01:21:56.376282+0000","last_peered":"2023-05-10T01:21:56.376282+0000","last_clean":"2023-05-10T01:21:56.376282+0000","last_became_active":"2023-05-10T01:21:55.996084+0000","last_became_peered":"2023-05-10T01:21:55.996084+0000","last_unstale":"2023-05-10T01:21:56.376282+0000","last_undegraded":"2023-05-10T01:21:56.376282+0000","last_fullsized":"2023-05-10T01:21:56.376282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373429+0000","last_change":"2023-05-10T01:21:55.984869+0000","last_active":"2023-05-10T01:21:56.373429+0000","last_peered":"2023-05-10T01:21:56.373429+0000","last_clean":"2023-05-10T01:21:56.373429+0000","last_became_active":"2023-05-10T01:21:55.984587+0000","last_became_peered":"2023-05-10T01:21:55.984587+0000","last_unstale":"2023-05-10T01:21:56.373429+0000","last_undegraded":"2023-05-10T01:21:56.373429+0000","last_fullsized":"2023-05-10T01:21:56.373429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394933+0000","last_change":"2023-05-10T01:21:56.385313+0000","last_active":"2023-05-10T01:21:56.394933+0000","last_peered":"2023-05-10T01:21:56.394933+0000","last_clean":"2023-05-10T01:21:56.394933+0000","last_became_active":"2023-05-10T01:21:56.382048+0000","last_became_peered":"2023-05-10T01:21:56.382048+0000","last_unstale":"2023-05-10T01:21:56.394933+0000","last_undegraded":"2023-05-10T01:21:56.394933+0000","last_fullsized":"2023-05-10T01:21:56.394933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394431+0000","last_change":"2023-05-10T01:21:56.389754+0000","last_active":"2023-05-10T01:21:56.394431+0000","last_peered":"2023-05-10T01:21:56.394431+0000","last_clean":"2023-05-10T01:21:56.394431+0000","last_became_active":"2023-05-10T01:21:56.389230+0000","last_became_peered":"2023-05-10T01:21:56.389230+0000","last_unstale":"2023-05-10T01:21:56.394431+0000","last_undegraded":"2023-05-10T01:21:56.394431+0000","last_fullsized":"2023-05-10T01:21:56.394431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375951+0000","last_change":"2023-05-10T01:21:55.977210+0000","last_active":"2023-05-10T01:21:56.375951+0000","last_peered":"2023-05-10T01:21:56.375951+0000","last_clean":"2023-05-10T01:21:56.375951+0000","last_became_active":"2023-05-10T01:21:55.976395+0000","last_became_peered":"2023-05-10T01:21:55.976395+0000","last_unstale":"2023-05-10T01:21:56.375951+0000","last_undegraded":"2023-05-10T01:21:56.375951+0000","last_fullsized":"2023-05-10T01:21:56.375951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398378+0000","last_change":"2023-05-10T01:21:56.396010+0000","last_active":"2023-05-10T01:21:56.398378+0000","last_peered":"2023-05-10T01:21:56.398378+0000","last_clean":"2023-05-10T01:21:56.398378+0000","last_became_active":"2023-05-10T01:21:56.395742+0000","last_became_peered":"2023-05-10T01:21:56.395742+0000","last_unstale":"2023-05-10T01:21:56.398378+0000","last_undegraded":"2023-05-10T01:21:56.398378+0000","last_fullsized":"2023-05-10T01:21:56.398378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377562+0000","last_change":"2023-05-10T01:21:55.985998+0000","last_active":"2023-05-10T01:21:56.377562+0000","last_peered":"2023-05-10T01:21:56.377562+0000","last_clean":"2023-05-10T01:21:56.377562+0000","last_became_active":"2023-05-10T01:21:55.985747+0000","last_became_peered":"2023-05-10T01:21:55.985747+0000","last_unstale":"2023-05-10T01:21:56.377562+0000","last_undegraded":"2023-05-10T01:21:56.377562+0000","last_fullsized":"2023-05-10T01:21:56.377562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398490+0000","last_change":"2023-05-10T01:21:56.395020+0000","last_active":"2023-05-10T01:21:56.398490+0000","last_peered":"2023-05-10T01:21:56.398490+0000","last_clean":"2023-05-10T01:21:56.398490+0000","last_became_active":"2023-05-10T01:21:56.394720+0000","last_became_peered":"2023-05-10T01:21:56.394720+0000","last_unstale":"2023-05-10T01:21:56.398490+0000","last_undegraded":"2023-05-10T01:21:56.398490+0000","last_fullsized":"2023-05-10T01:21:56.398490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396357+0000","last_change":"2023-05-10T01:21:55.983679+0000","last_active":"2023-05-10T01:21:56.396357+0000","last_peered":"2023-05-10T01:21:56.396357+0000","last_clean":"2023-05-10T01:21:56.396357+0000","last_became_active":"2023-05-10T01:21:55.983331+0000","last_became_peered":"2023-05-10T01:21:55.983331+0000","last_unstale":"2023-05-10T01:21:56.396357+0000","last_undegraded":"2023-05-10T01:21:56.396357+0000","last_fullsized":"2023-05-10T01:21:56.396357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387810+0000","last_change":"2023-05-10T01:21:56.382093+0000","last_active":"2023-05-10T01:21:56.387810+0000","last_peered":"2023-05-10T01:21:56.387810+0000","last_clean":"2023-05-10T01:21:56.387810+0000","last_became_active":"2023-05-10T01:21:56.381808+0000","last_became_peered":"2023-05-10T01:21:56.381808+0000","last_unstale":"2023-05-10T01:21:56.387810+0000","last_undegraded":"2023-05-10T01:21:56.387810+0000","last_fullsized":"2023-05-10T01:21:56.387810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376180+0000","last_change":"2023-05-10T01:21:55.985464+0000","last_active":"2023-05-10T01:21:56.376180+0000","last_peered":"2023-05-10T01:21:56.376180+0000","last_clean":"2023-05-10T01:21:56.376180+0000","last_became_active":"2023-05-10T01:21:55.984713+0000","last_became_peered":"2023-05-10T01:21:55.984713+0000","last_unstale":"2023-05-10T01:21:56.376180+0000","last_undegraded":"2023-05-10T01:21:56.376180+0000","last_fullsized":"2023-05-10T01:21:56.376180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390050+0000","last_change":"2023-05-10T01:21:56.388436+0000","last_active":"2023-05-10T01:21:56.390050+0000","last_peered":"2023-05-10T01:21:56.390050+0000","last_clean":"2023-05-10T01:21:56.390050+0000","last_became_active":"2023-05-10T01:21:56.387905+0000","last_became_peered":"2023-05-10T01:21:56.387905+0000","last_unstale":"2023-05-10T01:21:56.390050+0000","last_undegraded":"2023-05-10T01:21:56.390050+0000","last_fullsized":"2023-05-10T01:21:56.390050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390425+0000","last_change":"2023-05-10T01:21:56.384117+0000","last_active":"2023-05-10T01:21:56.390425+0000","last_peered":"2023-05-10T01:21:56.390425+0000","last_clean":"2023-05-10T01:21:56.390425+0000","last_became_active":"2023-05-10T01:21:56.383746+0000","last_became_peered":"2023-05-10T01:21:56.383746+0000","last_unstale":"2023-05-10T01:21:56.390425+0000","last_undegraded":"2023-05-10T01:21:56.390425+0000","last_fullsized":"2023-05-10T01:21:56.390425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390861+0000","last_change":"2023-05-10T01:21:56.384951+0000","last_active":"2023-05-10T01:21:56.390861+0000","last_peered":"2023-05-10T01:21:56.390861+0000","last_clean":"2023-05-10T01:21:56.390861+0000","last_became_active":"2023-05-10T01:21:56.384677+0000","last_became_peered":"2023-05-10T01:21:56.384677+0000","last_unstale":"2023-05-10T01:21:56.390861+0000","last_undegraded":"2023-05-10T01:21:56.390861+0000","last_fullsized":"2023-05-10T01:21:56.390861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383820+0000","last_change":"2023-05-10T01:21:56.381131+0000","last_active":"2023-05-10T01:21:56.383820+0000","last_peered":"2023-05-10T01:21:56.383820+0000","last_clean":"2023-05-10T01:21:56.383820+0000","last_became_active":"2023-05-10T01:21:56.380922+0000","last_became_peered":"2023-05-10T01:21:56.380922+0000","last_unstale":"2023-05-10T01:21:56.383820+0000","last_undegraded":"2023-05-10T01:21:56.383820+0000","last_fullsized":"2023-05-10T01:21:56.383820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375476+0000","last_change":"2023-05-10T01:21:55.981305+0000","last_active":"2023-05-10T01:21:56.375476+0000","last_peered":"2023-05-10T01:21:56.375476+0000","last_clean":"2023-05-10T01:21:56.375476+0000","last_became_active":"2023-05-10T01:21:55.980073+0000","last_became_peered":"2023-05-10T01:21:55.980073+0000","last_unstale":"2023-05-10T01:21:56.375476+0000","last_undegraded":"2023-05-10T01:21:56.375476+0000","last_fullsized":"2023-05-10T01:21:56.375476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372965+0000","last_change":"2023-05-10T01:21:55.990808+0000","last_active":"2023-05-10T01:21:56.372965+0000","last_peered":"2023-05-10T01:21:56.372965+0000","last_clean":"2023-05-10T01:21:56.372965+0000","last_became_active":"2023-05-10T01:21:55.990499+0000","last_became_peered":"2023-05-10T01:21:55.990499+0000","last_unstale":"2023-05-10T01:21:56.372965+0000","last_undegraded":"2023-05-10T01:21:56.372965+0000","last_fullsized":"2023-05-10T01:21:56.372965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393912+0000","last_change":"2023-05-10T01:21:56.391042+0000","last_active":"2023-05-10T01:21:56.393912+0000","last_peered":"2023-05-10T01:21:56.393912+0000","last_clean":"2023-05-10T01:21:56.393912+0000","last_became_active":"2023-05-10T01:21:56.389952+0000","last_became_peered":"2023-05-10T01:21:56.389952+0000","last_unstale":"2023-05-10T01:21:56.393912+0000","last_undegraded":"2023-05-10T01:21:56.393912+0000","last_fullsized":"2023-05-10T01:21:56.393912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375539+0000","last_change":"2023-05-10T01:21:55.983291+0000","last_active":"2023-05-10T01:21:56.375539+0000","last_peered":"2023-05-10T01:21:56.375539+0000","last_clean":"2023-05-10T01:21:56.375539+0000","last_became_active":"2023-05-10T01:21:55.983015+0000","last_became_peered":"2023-05-10T01:21:55.983015+0000","last_unstale":"2023-05-10T01:21:56.375539+0000","last_undegraded":"2023-05-10T01:21:56.375539+0000","last_fullsized":"2023-05-10T01:21:56.375539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373208+0000","last_change":"2023-05-10T01:21:55.983553+0000","last_active":"2023-05-10T01:21:56.373208+0000","last_peered":"2023-05-10T01:21:56.373208+0000","last_clean":"2023-05-10T01:21:56.373208+0000","last_became_active":"2023-05-10T01:21:55.983243+0000","last_became_peered":"2023-05-10T01:21:55.983243+0000","last_unstale":"2023-05-10T01:21:56.373208+0000","last_undegraded":"2023-05-10T01:21:56.373208+0000","last_fullsized":"2023-05-10T01:21:56.373208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395257+0000","last_change":"2023-05-10T01:21:56.390161+0000","last_active":"2023-05-10T01:21:56.395257+0000","last_peered":"2023-05-10T01:21:56.395257+0000","last_clean":"2023-05-10T01:21:56.395257+0000","last_became_active":"2023-05-10T01:21:56.389337+0000","last_became_peered":"2023-05-10T01:21:56.389337+0000","last_unstale":"2023-05-10T01:21:56.395257+0000","last_undegraded":"2023-05-10T01:21:56.395257+0000","last_fullsized":"2023-05-10T01:21:56.395257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393462+0000","last_change":"2023-05-10T01:21:56.383749+0000","last_active":"2023-05-10T01:21:56.393462+0000","last_peered":"2023-05-10T01:21:56.393462+0000","last_clean":"2023-05-10T01:21:56.393462+0000","last_became_active":"2023-05-10T01:21:56.382989+0000","last_became_peered":"2023-05-10T01:21:56.382989+0000","last_unstale":"2023-05-10T01:21:56.393462+0000","last_undegraded":"2023-05-10T01:21:56.393462+0000","last_fullsized":"2023-05-10T01:21:56.393462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386928+0000","last_change":"2023-05-10T01:21:55.988303+0000","last_active":"2023-05-10T01:21:56.386928+0000","last_peered":"2023-05-10T01:21:56.386928+0000","last_clean":"2023-05-10T01:21:56.386928+0000","last_became_active":"2023-05-10T01:21:55.987986+0000","last_became_peered":"2023-05-10T01:21:55.987986+0000","last_unstale":"2023-05-10T01:21:56.386928+0000","last_undegraded":"2023-05-10T01:21:56.386928+0000","last_fullsized":"2023-05-10T01:21:56.386928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395972+0000","last_change":"2023-05-10T01:21:55.979791+0000","last_active":"2023-05-10T01:21:56.395972+0000","last_peered":"2023-05-10T01:21:56.395972+0000","last_clean":"2023-05-10T01:21:56.395972+0000","last_became_active":"2023-05-10T01:21:55.978489+0000","last_became_peered":"2023-05-10T01:21:55.978489+0000","last_unstale":"2023-05-10T01:21:56.395972+0000","last_undegraded":"2023-05-10T01:21:56.395972+0000","last_fullsized":"2023-05-10T01:21:56.395972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390030+0000","last_change":"2023-05-10T01:21:56.386816+0000","last_active":"2023-05-10T01:21:56.390030+0000","last_peered":"2023-05-10T01:21:56.390030+0000","last_clean":"2023-05-10T01:21:56.390030+0000","last_became_active":"2023-05-10T01:21:56.386546+0000","last_became_peered":"2023-05-10T01:21:56.386546+0000","last_unstale":"2023-05-10T01:21:56.390030+0000","last_undegraded":"2023-05-10T01:21:56.390030+0000","last_fullsized":"2023-05-10T01:21:56.390030+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373089+0000","last_change":"2023-05-10T01:21:55.988218+0000","last_active":"2023-05-10T01:21:56.373089+0000","last_peered":"2023-05-10T01:21:56.373089+0000","last_clean":"2023-05-10T01:21:56.373089+0000","last_became_active":"2023-05-10T01:21:55.987936+0000","last_became_peered":"2023-05-10T01:21:55.987936+0000","last_unstale":"2023-05-10T01:21:56.373089+0000","last_undegraded":"2023-05-10T01:21:56.373089+0000","last_fullsized":"2023-05-10T01:21:56.373089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396213+0000","last_change":"2023-05-10T01:21:56.393981+0000","last_active":"2023-05-10T01:21:56.396213+0000","last_peered":"2023-05-10T01:21:56.396213+0000","last_clean":"2023-05-10T01:21:56.396213+0000","last_became_active":"2023-05-10T01:21:56.393672+0000","last_became_peered":"2023-05-10T01:21:56.393672+0000","last_unstale":"2023-05-10T01:21:56.396213+0000","last_undegraded":"2023-05-10T01:21:56.396213+0000","last_fullsized":"2023-05-10T01:21:56.396213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374941+0000","last_change":"2023-05-10T01:21:55.982605+0000","last_active":"2023-05-10T01:21:56.374941+0000","last_peered":"2023-05-10T01:21:56.374941+0000","last_clean":"2023-05-10T01:21:56.374941+0000","last_became_active":"2023-05-10T01:21:55.981073+0000","last_became_peered":"2023-05-10T01:21:55.981073+0000","last_unstale":"2023-05-10T01:21:56.374941+0000","last_undegraded":"2023-05-10T01:21:56.374941+0000","last_fullsized":"2023-05-10T01:21:56.374941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375642+0000","last_change":"2023-05-10T01:21:55.978009+0000","last_active":"2023-05-10T01:21:56.375642+0000","last_peered":"2023-05-10T01:21:56.375642+0000","last_clean":"2023-05-10T01:21:56.375642+0000","last_became_active":"2023-05-10T01:21:55.977745+0000","last_became_peered":"2023-05-10T01:21:55.977745+0000","last_unstale":"2023-05-10T01:21:56.375642+0000","last_undegraded":"2023-05-10T01:21:56.375642+0000","last_fullsized":"2023-05-10T01:21:56.375642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390033+0000","last_change":"2023-05-10T01:21:56.387952+0000","last_active":"2023-05-10T01:21:56.390033+0000","last_peered":"2023-05-10T01:21:56.390033+0000","last_clean":"2023-05-10T01:21:56.390033+0000","last_became_active":"2023-05-10T01:21:56.387673+0000","last_became_peered":"2023-05-10T01:21:56.387673+0000","last_unstale":"2023-05-10T01:21:56.390033+0000","last_undegraded":"2023-05-10T01:21:56.390033+0000","last_fullsized":"2023-05-10T01:21:56.390033+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373474+0000","last_change":"2023-05-10T01:21:55.989894+0000","last_active":"2023-05-10T01:21:56.373474+0000","last_peered":"2023-05-10T01:21:56.373474+0000","last_clean":"2023-05-10T01:21:56.373474+0000","last_became_active":"2023-05-10T01:21:55.989151+0000","last_became_peered":"2023-05-10T01:21:55.989151+0000","last_unstale":"2023-05-10T01:21:56.373474+0000","last_undegraded":"2023-05-10T01:21:56.373474+0000","last_fullsized":"2023-05-10T01:21:56.373474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401225+0000","last_change":"2023-05-10T01:21:56.397647+0000","last_active":"2023-05-10T01:21:56.401225+0000","last_peered":"2023-05-10T01:21:56.401225+0000","last_clean":"2023-05-10T01:21:56.401225+0000","last_became_active":"2023-05-10T01:21:56.397366+0000","last_became_peered":"2023-05-10T01:21:56.397366+0000","last_unstale":"2023-05-10T01:21:56.401225+0000","last_undegraded":"2023-05-10T01:21:56.401225+0000","last_fullsized":"2023-05-10T01:21:56.401225+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394756+0000","last_change":"2023-05-10T01:21:56.387217+0000","last_active":"2023-05-10T01:21:56.394756+0000","last_peered":"2023-05-10T01:21:56.394756+0000","last_clean":"2023-05-10T01:21:56.394756+0000","last_became_active":"2023-05-10T01:21:56.386938+0000","last_became_peered":"2023-05-10T01:21:56.386938+0000","last_unstale":"2023-05-10T01:21:56.394756+0000","last_undegraded":"2023-05-10T01:21:56.394756+0000","last_fullsized":"2023-05-10T01:21:56.394756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377710+0000","last_change":"2023-05-10T01:21:55.986297+0000","last_active":"2023-05-10T01:21:56.377710+0000","last_peered":"2023-05-10T01:21:56.377710+0000","last_clean":"2023-05-10T01:21:56.377710+0000","last_became_active":"2023-05-10T01:21:55.985992+0000","last_became_peered":"2023-05-10T01:21:55.985992+0000","last_unstale":"2023-05-10T01:21:56.377710+0000","last_undegraded":"2023-05-10T01:21:56.377710+0000","last_fullsized":"2023-05-10T01:21:56.377710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398235+0000","last_change":"2023-05-10T01:21:56.394951+0000","last_active":"2023-05-10T01:21:56.398235+0000","last_peered":"2023-05-10T01:21:56.398235+0000","last_clean":"2023-05-10T01:21:56.398235+0000","last_became_active":"2023-05-10T01:21:56.394686+0000","last_became_peered":"2023-05-10T01:21:56.394686+0000","last_unstale":"2023-05-10T01:21:56.398235+0000","last_undegraded":"2023-05-10T01:21:56.398235+0000","last_fullsized":"2023-05-10T01:21:56.398235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393450+0000","last_change":"2023-05-10T01:21:56.389449+0000","last_active":"2023-05-10T01:21:56.393450+0000","last_peered":"2023-05-10T01:21:56.393450+0000","last_clean":"2023-05-10T01:21:56.393450+0000","last_became_active":"2023-05-10T01:21:56.388600+0000","last_became_peered":"2023-05-10T01:21:56.388600+0000","last_unstale":"2023-05-10T01:21:56.393450+0000","last_undegraded":"2023-05-10T01:21:56.393450+0000","last_fullsized":"2023-05-10T01:21:56.393450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394810+0000","last_change":"2023-05-10T01:21:55.986935+0000","last_active":"2023-05-10T01:21:56.394810+0000","last_peered":"2023-05-10T01:21:56.394810+0000","last_clean":"2023-05-10T01:21:56.394810+0000","last_became_active":"2023-05-10T01:21:55.986618+0000","last_became_peered":"2023-05-10T01:21:55.986618+0000","last_unstale":"2023-05-10T01:21:56.394810+0000","last_undegraded":"2023-05-10T01:21:56.394810+0000","last_fullsized":"2023-05-10T01:21:56.394810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395310+0000","last_change":"2023-05-10T01:21:56.385256+0000","last_active":"2023-05-10T01:21:56.395310+0000","last_peered":"2023-05-10T01:21:56.395310+0000","last_clean":"2023-05-10T01:21:56.395310+0000","last_became_active":"2023-05-10T01:21:56.384982+0000","last_became_peered":"2023-05-10T01:21:56.384982+0000","last_unstale":"2023-05-10T01:21:56.395310+0000","last_undegraded":"2023-05-10T01:21:56.395310+0000","last_fullsized":"2023-05-10T01:21:56.395310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387897+0000","last_change":"2023-05-10T01:21:55.988593+0000","last_active":"2023-05-10T01:21:56.387897+0000","last_peered":"2023-05-10T01:21:56.387897+0000","last_clean":"2023-05-10T01:21:56.387897+0000","last_became_active":"2023-05-10T01:21:55.986001+0000","last_became_peered":"2023-05-10T01:21:55.986001+0000","last_unstale":"2023-05-10T01:21:56.387897+0000","last_undegraded":"2023-05-10T01:21:56.387897+0000","last_fullsized":"2023-05-10T01:21:56.387897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390764+0000","last_change":"2023-05-10T01:21:56.384859+0000","last_active":"2023-05-10T01:21:56.390764+0000","last_peered":"2023-05-10T01:21:56.390764+0000","last_clean":"2023-05-10T01:21:56.390764+0000","last_became_active":"2023-05-10T01:21:56.384456+0000","last_became_peered":"2023-05-10T01:21:56.384456+0000","last_unstale":"2023-05-10T01:21:56.390764+0000","last_undegraded":"2023-05-10T01:21:56.390764+0000","last_fullsized":"2023-05-10T01:21:56.390764+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394649+0000","last_change":"2023-05-10T01:21:56.388984+0000","last_active":"2023-05-10T01:21:56.394649+0000","last_peered":"2023-05-10T01:21:56.394649+0000","last_clean":"2023-05-10T01:21:56.394649+0000","last_became_active":"2023-05-10T01:21:56.388706+0000","last_became_peered":"2023-05-10T01:21:56.388706+0000","last_unstale":"2023-05-10T01:21:56.394649+0000","last_undegraded":"2023-05-10T01:21:56.394649+0000","last_fullsized":"2023-05-10T01:21:56.394649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395277+0000","last_change":"2023-05-10T01:21:56.390549+0000","last_active":"2023-05-10T01:21:56.395277+0000","last_peered":"2023-05-10T01:21:56.395277+0000","last_clean":"2023-05-10T01:21:56.395277+0000","last_became_active":"2023-05-10T01:21:56.389725+0000","last_became_peered":"2023-05-10T01:21:56.389725+0000","last_unstale":"2023-05-10T01:21:56.395277+0000","last_undegraded":"2023-05-10T01:21:56.395277+0000","last_fullsized":"2023-05-10T01:21:56.395277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397441+0000","last_change":"2023-05-10T01:21:55.985996+0000","last_active":"2023-05-10T01:21:56.397441+0000","last_peered":"2023-05-10T01:21:56.397441+0000","last_clean":"2023-05-10T01:21:56.397441+0000","last_became_active":"2023-05-10T01:21:55.985693+0000","last_became_peered":"2023-05-10T01:21:55.985693+0000","last_unstale":"2023-05-10T01:21:56.397441+0000","last_undegraded":"2023-05-10T01:21:56.397441+0000","last_fullsized":"2023-05-10T01:21:56.397441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390084+0000","last_change":"2023-05-10T01:21:56.387575+0000","last_active":"2023-05-10T01:21:56.390084+0000","last_peered":"2023-05-10T01:21:56.390084+0000","last_clean":"2023-05-10T01:21:56.390084+0000","last_became_active":"2023-05-10T01:21:56.387380+0000","last_became_peered":"2023-05-10T01:21:56.387380+0000","last_unstale":"2023-05-10T01:21:56.390084+0000","last_undegraded":"2023-05-10T01:21:56.390084+0000","last_fullsized":"2023-05-10T01:21:56.390084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384279+0000","last_change":"2023-05-10T01:21:55.994254+0000","last_active":"2023-05-10T01:21:56.384279+0000","last_peered":"2023-05-10T01:21:56.384279+0000","last_clean":"2023-05-10T01:21:56.384279+0000","last_became_active":"2023-05-10T01:21:55.993796+0000","last_became_peered":"2023-05-10T01:21:55.993796+0000","last_unstale":"2023-05-10T01:21:56.384279+0000","last_undegraded":"2023-05-10T01:21:56.384279+0000","last_fullsized":"2023-05-10T01:21:56.384279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395063+0000","last_change":"2023-05-10T01:21:56.385556+0000","last_active":"2023-05-10T01:21:56.395063+0000","last_peered":"2023-05-10T01:21:56.395063+0000","last_clean":"2023-05-10T01:21:56.395063+0000","last_became_active":"2023-05-10T01:21:56.381923+0000","last_became_peered":"2023-05-10T01:21:56.381923+0000","last_unstale":"2023-05-10T01:21:56.395063+0000","last_undegraded":"2023-05-10T01:21:56.395063+0000","last_fullsized":"2023-05-10T01:21:56.395063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391717+0000","last_change":"2023-05-10T01:21:56.389256+0000","last_active":"2023-05-10T01:21:56.391717+0000","last_peered":"2023-05-10T01:21:56.391717+0000","last_clean":"2023-05-10T01:21:56.391717+0000","last_became_active":"2023-05-10T01:21:56.388978+0000","last_became_peered":"2023-05-10T01:21:56.388978+0000","last_unstale":"2023-05-10T01:21:56.391717+0000","last_undegraded":"2023-05-10T01:21:56.391717+0000","last_fullsized":"2023-05-10T01:21:56.391717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396433+0000","last_change":"2023-05-10T01:21:56.392425+0000","last_active":"2023-05-10T01:21:56.396433+0000","last_peered":"2023-05-10T01:21:56.396433+0000","last_clean":"2023-05-10T01:21:56.396433+0000","last_became_active":"2023-05-10T01:21:56.388917+0000","last_became_peered":"2023-05-10T01:21:56.388917+0000","last_unstale":"2023-05-10T01:21:56.396433+0000","last_undegraded":"2023-05-10T01:21:56.396433+0000","last_fullsized":"2023-05-10T01:21:56.396433+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395333+0000","last_change":"2023-05-10T01:21:56.390584+0000","last_active":"2023-05-10T01:21:56.395333+0000","last_peered":"2023-05-10T01:21:56.395333+0000","last_clean":"2023-05-10T01:21:56.395333+0000","last_became_active":"2023-05-10T01:21:56.390323+0000","last_became_peered":"2023-05-10T01:21:56.390323+0000","last_unstale":"2023-05-10T01:21:56.395333+0000","last_undegraded":"2023-05-10T01:21:56.395333+0000","last_fullsized":"2023-05-10T01:21:56.395333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396396+0000","last_change":"2023-05-10T01:21:55.984806+0000","last_active":"2023-05-10T01:21:56.396396+0000","last_peered":"2023-05-10T01:21:56.396396+0000","last_clean":"2023-05-10T01:21:56.396396+0000","last_became_active":"2023-05-10T01:21:55.984490+0000","last_became_peered":"2023-05-10T01:21:55.984490+0000","last_unstale":"2023-05-10T01:21:56.396396+0000","last_undegraded":"2023-05-10T01:21:56.396396+0000","last_fullsized":"2023-05-10T01:21:56.396396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375615+0000","last_change":"2023-05-10T01:21:55.987039+0000","last_active":"2023-05-10T01:21:56.375615+0000","last_peered":"2023-05-10T01:21:56.375615+0000","last_clean":"2023-05-10T01:21:56.375615+0000","last_became_active":"2023-05-10T01:21:55.986716+0000","last_became_peered":"2023-05-10T01:21:55.986716+0000","last_unstale":"2023-05-10T01:21:56.375615+0000","last_undegraded":"2023-05-10T01:21:56.375615+0000","last_fullsized":"2023-05-10T01:21:56.375615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398666+0000","last_change":"2023-05-10T01:21:56.395474+0000","last_active":"2023-05-10T01:21:56.398666+0000","last_peered":"2023-05-10T01:21:56.398666+0000","last_clean":"2023-05-10T01:21:56.398666+0000","last_became_active":"2023-05-10T01:21:56.395187+0000","last_became_peered":"2023-05-10T01:21:56.395187+0000","last_unstale":"2023-05-10T01:21:56.398666+0000","last_undegraded":"2023-05-10T01:21:56.398666+0000","last_fullsized":"2023-05-10T01:21:56.398666+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375565+0000","last_change":"2023-05-10T01:21:55.995788+0000","last_active":"2023-05-10T01:21:56.375565+0000","last_peered":"2023-05-10T01:21:56.375565+0000","last_clean":"2023-05-10T01:21:56.375565+0000","last_became_active":"2023-05-10T01:21:55.995511+0000","last_became_peered":"2023-05-10T01:21:55.995511+0000","last_unstale":"2023-05-10T01:21:56.375565+0000","last_undegraded":"2023-05-10T01:21:56.375565+0000","last_fullsized":"2023-05-10T01:21:56.375565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386948+0000","last_change":"2023-05-10T01:21:56.381977+0000","last_active":"2023-05-10T01:21:56.386948+0000","last_peered":"2023-05-10T01:21:56.386948+0000","last_clean":"2023-05-10T01:21:56.386948+0000","last_became_active":"2023-05-10T01:21:56.381674+0000","last_became_peered":"2023-05-10T01:21:56.381674+0000","last_unstale":"2023-05-10T01:21:56.386948+0000","last_undegraded":"2023-05-10T01:21:56.386948+0000","last_fullsized":"2023-05-10T01:21:56.386948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398685+0000","last_change":"2023-05-10T01:21:56.396855+0000","last_active":"2023-05-10T01:21:56.398685+0000","last_peered":"2023-05-10T01:21:56.398685+0000","last_clean":"2023-05-10T01:21:56.398685+0000","last_became_active":"2023-05-10T01:21:56.396558+0000","last_became_peered":"2023-05-10T01:21:56.396558+0000","last_unstale":"2023-05-10T01:21:56.398685+0000","last_undegraded":"2023-05-10T01:21:56.398685+0000","last_fullsized":"2023-05-10T01:21:56.398685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376271+0000","last_change":"2023-05-10T01:21:55.978862+0000","last_active":"2023-05-10T01:21:56.376271+0000","last_peered":"2023-05-10T01:21:56.376271+0000","last_clean":"2023-05-10T01:21:56.376271+0000","last_became_active":"2023-05-10T01:21:55.978571+0000","last_became_peered":"2023-05-10T01:21:55.978571+0000","last_unstale":"2023-05-10T01:21:56.376271+0000","last_undegraded":"2023-05-10T01:21:56.376271+0000","last_fullsized":"2023-05-10T01:21:56.376271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370802+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:21:56.370802+0000","last_peered":"2023-05-10T01:21:56.370802+0000","last_clean":"2023-05-10T01:21:56.370802+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:21:56.370802+0000","last_undegraded":"2023-05-10T01:21:56.370802+0000","last_fullsized":"2023-05-10T01:21:56.370802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394411+0000","last_change":"2023-05-10T01:21:56.386063+0000","last_active":"2023-05-10T01:21:56.394411+0000","last_peered":"2023-05-10T01:21:56.394411+0000","last_clean":"2023-05-10T01:21:56.394411+0000","last_became_active":"2023-05-10T01:21:56.385793+0000","last_became_peered":"2023-05-10T01:21:56.385793+0000","last_unstale":"2023-05-10T01:21:56.394411+0000","last_undegraded":"2023-05-10T01:21:56.394411+0000","last_fullsized":"2023-05-10T01:21:56.394411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372423+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:21:56.372423+0000","last_peered":"2023-05-10T01:21:56.372423+0000","last_clean":"2023-05-10T01:21:56.372423+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:21:56.372423+0000","last_undegraded":"2023-05-10T01:21:56.372423+0000","last_fullsized":"2023-05-10T01:21:56.372423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397071+0000","last_change":"2023-05-10T01:21:56.394425+0000","last_active":"2023-05-10T01:21:56.397071+0000","last_peered":"2023-05-10T01:21:56.397071+0000","last_clean":"2023-05-10T01:21:56.397071+0000","last_became_active":"2023-05-10T01:21:56.394093+0000","last_became_peered":"2023-05-10T01:21:56.394093+0000","last_unstale":"2023-05-10T01:21:56.397071+0000","last_undegraded":"2023-05-10T01:21:56.397071+0000","last_fullsized":"2023-05-10T01:21:56.397071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374092+0000","last_change":"2023-05-10T01:21:55.986090+0000","last_active":"2023-05-10T01:21:56.374092+0000","last_peered":"2023-05-10T01:21:56.374092+0000","last_clean":"2023-05-10T01:21:56.374092+0000","last_became_active":"2023-05-10T01:21:55.985835+0000","last_became_peered":"2023-05-10T01:21:55.985835+0000","last_unstale":"2023-05-10T01:21:56.374092+0000","last_undegraded":"2023-05-10T01:21:56.374092+0000","last_fullsized":"2023-05-10T01:21:56.374092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.875933+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:21:50.875933+0000","last_peered":"2023-05-10T01:21:50.875933+0000","last_clean":"2023-05-10T01:21:50.875933+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:21:50.875933+0000","last_undegraded":"2023-05-10T01:21:50.875933+0000","last_fullsized":"2023-05-10T01:21:50.875933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374173+0000","last_change":"2023-05-10T01:21:55.993109+0000","last_active":"2023-05-10T01:21:56.374173+0000","last_peered":"2023-05-10T01:21:56.374173+0000","last_clean":"2023-05-10T01:21:56.374173+0000","last_became_active":"2023-05-10T01:21:55.992808+0000","last_became_peered":"2023-05-10T01:21:55.992808+0000","last_unstale":"2023-05-10T01:21:56.374173+0000","last_undegraded":"2023-05-10T01:21:56.374173+0000","last_fullsized":"2023-05-10T01:21:56.374173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372296+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:21:56.372296+0000","last_peered":"2023-05-10T01:21:56.372296+0000","last_clean":"2023-05-10T01:21:56.372296+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:21:56.372296+0000","last_undegraded":"2023-05-10T01:21:56.372296+0000","last_fullsized":"2023-05-10T01:21:56.372296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864066+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:21:52.864066+0000","last_peered":"2023-05-10T01:21:52.864066+0000","last_clean":"2023-05-10T01:21:52.864066+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:21:52.864066+0000","last_undegraded":"2023-05-10T01:21:52.864066+0000","last_fullsized":"2023-05-10T01:21:52.864066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395900+0000","last_change":"2023-05-10T01:21:56.388692+0000","last_active":"2023-05-10T01:21:56.395900+0000","last_peered":"2023-05-10T01:21:56.395900+0000","last_clean":"2023-05-10T01:21:56.395900+0000","last_became_active":"2023-05-10T01:21:56.388418+0000","last_became_peered":"2023-05-10T01:21:56.388418+0000","last_unstale":"2023-05-10T01:21:56.395900+0000","last_undegraded":"2023-05-10T01:21:56.395900+0000","last_fullsized":"2023-05-10T01:21:56.395900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390004+0000","last_change":"2023-05-10T01:21:56.386770+0000","last_active":"2023-05-10T01:21:56.390004+0000","last_peered":"2023-05-10T01:21:56.390004+0000","last_clean":"2023-05-10T01:21:56.390004+0000","last_became_active":"2023-05-10T01:21:56.386485+0000","last_became_peered":"2023-05-10T01:21:56.386485+0000","last_unstale":"2023-05-10T01:21:56.390004+0000","last_undegraded":"2023-05-10T01:21:56.390004+0000","last_fullsized":"2023-05-10T01:21:56.390004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378139+0000","last_change":"2023-05-10T01:21:55.986362+0000","last_active":"2023-05-10T01:21:56.378139+0000","last_peered":"2023-05-10T01:21:56.378139+0000","last_clean":"2023-05-10T01:21:56.378139+0000","last_became_active":"2023-05-10T01:21:55.985579+0000","last_became_peered":"2023-05-10T01:21:55.985579+0000","last_unstale":"2023-05-10T01:21:56.378139+0000","last_undegraded":"2023-05-10T01:21:56.378139+0000","last_fullsized":"2023-05-10T01:21:56.378139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.388353+0000","last_change":"2023-05-10T01:21:56.384106+0000","last_active":"2023-05-10T01:21:56.388353+0000","last_peered":"2023-05-10T01:21:56.388353+0000","last_clean":"2023-05-10T01:21:56.388353+0000","last_became_active":"2023-05-10T01:21:56.383829+0000","last_became_peered":"2023-05-10T01:21:56.383829+0000","last_unstale":"2023-05-10T01:21:56.388353+0000","last_undegraded":"2023-05-10T01:21:56.388353+0000","last_fullsized":"2023-05-10T01:21:56.388353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376460+0000","last_change":"2023-05-10T01:21:55.987209+0000","last_active":"2023-05-10T01:21:56.376460+0000","last_peered":"2023-05-10T01:21:56.376460+0000","last_clean":"2023-05-10T01:21:56.376460+0000","last_became_active":"2023-05-10T01:21:55.986888+0000","last_became_peered":"2023-05-10T01:21:55.986888+0000","last_unstale":"2023-05-10T01:21:56.376460+0000","last_undegraded":"2023-05-10T01:21:56.376460+0000","last_fullsized":"2023-05-10T01:21:56.376460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370808+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:21:56.370808+0000","last_peered":"2023-05-10T01:21:56.370808+0000","last_clean":"2023-05-10T01:21:56.370808+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:21:56.370808+0000","last_undegraded":"2023-05-10T01:21:56.370808+0000","last_fullsized":"2023-05-10T01:21:56.370808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394272+0000","last_change":"2023-05-10T01:21:56.387160+0000","last_active":"2023-05-10T01:21:56.394272+0000","last_peered":"2023-05-10T01:21:56.394272+0000","last_clean":"2023-05-10T01:21:56.394272+0000","last_became_active":"2023-05-10T01:21:56.386884+0000","last_became_peered":"2023-05-10T01:21:56.386884+0000","last_unstale":"2023-05-10T01:21:56.394272+0000","last_undegraded":"2023-05-10T01:21:56.394272+0000","last_fullsized":"2023-05-10T01:21:56.394272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375961+0000","last_change":"2023-05-10T01:21:55.983841+0000","last_active":"2023-05-10T01:21:56.375961+0000","last_peered":"2023-05-10T01:21:56.375961+0000","last_clean":"2023-05-10T01:21:56.375961+0000","last_became_active":"2023-05-10T01:21:55.983556+0000","last_became_peered":"2023-05-10T01:21:55.983556+0000","last_unstale":"2023-05-10T01:21:56.375961+0000","last_undegraded":"2023-05-10T01:21:56.375961+0000","last_fullsized":"2023-05-10T01:21:56.375961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.874982+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:21:50.874982+0000","last_peered":"2023-05-10T01:21:50.874982+0000","last_clean":"2023-05-10T01:21:50.874982+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:21:50.874982+0000","last_undegraded":"2023-05-10T01:21:50.874982+0000","last_fullsized":"2023-05-10T01:21:50.874982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":80,"acting":80,"num_store_stats":5},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16116,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355724,"statfs":{"total":96636764160,"available":96620261376,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.79000000000000004,"15min":0.89900000000000002},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.60599999999999998},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.89800000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.94899999999999995},"last":1.0740000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.59199999999999997},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.93300000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.92200000000000004},"last":1.0920000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.85899999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.871},"last":0.499}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.052},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":0.76400000000000001,"5min":0.79200000000000004,"15min":0.88200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15476,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356364,"statfs":{"total":96636764160,"available":96620916736,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.86199999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65800000000000003,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.75700000000000001,"15min":1.1160000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":1.159},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":1.321},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.85599999999999998},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15656,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94356184,"statfs":{"total":96636764160,"available":96620732416,"internally_reserved":0,"allocated":753664,"data_stored":367522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.68999999999999995,"15min":0.77800000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.55500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.46899999999999997},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47399999999999998,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.64300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":1.117},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":1.05},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":1.3839999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":1.319},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.079},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.65400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.88200000000000001,"15min":1.0960000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.501,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.96899999999999997,"15min":1.3600000000000001},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15408,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356432,"statfs":{"total":96636764160,"available":96620986368,"internally_reserved":0,"allocated":761856,"data_stored":367558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.52900000000000003,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.28599999999999998,"15min":0.254},"max":{"1min":0.63,"5min":0.64200000000000002,"15min":0.80300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.436,"15min":0.47399999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":3.8370000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.84099999999999997},"last":0.309}]},{"osd":3,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.85799999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.374},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.375},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.432},"max":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":1.224},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":1.002,"15min":1.1559999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16500,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94355340,"statfs":{"total":96636764160,"available":96619868160,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.25,"5min":0.248,"15min":0.217},"max":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.67100000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.371,"5min":0.32500000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.432}]},{"osd":1,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41099999999999998},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.40799999999999997},"min":{"1min":0.33600000000000002,"5min":0.27000000000000002,"15min":0.22},"max":{"1min":0.58799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":0.68899999999999995,"5min":0.75,"15min":0.75},"last":0.33900000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.93100000000000005},"last":1.012},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.3320000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.876},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":1.091},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.056},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23856,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94347984,"statfs":{"total":96636764160,"available":96612335616,"internally_reserved":0,"allocated":761856,"data_stored":368098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.23999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28799999999999998,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.69899999999999995,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.45700000000000002},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":4,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":0.92200000000000004,"15min":1.0349999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.0589999999999999},"last":0.622}]},{"osd":5,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.41199999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.628,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15976,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355864,"statfs":{"total":96636764160,"available":96620404736,"internally_reserved":0,"allocated":753664,"data_stored":367986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.72799999999999998,"5min":0.753,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69999999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.337}]},{"osd":1,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.92100000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.35399999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.80400000000000005,"15min":0.85999999999999999},"last":1.3839999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.73899999999999999,"15min":0.83599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.84899999999999998,"15min":0.89200000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.621,"5min":0.67900000000000005,"15min":0.88200000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47999999999999998,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.67300000000000004,"5min":0.82599999999999996,"15min":0.89400000000000002},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50600000000000001,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.81100000000000005,"15min":0.92700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.371},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0589999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19176,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352664,"statfs":{"total":96636764160,"available":96617127936,"internally_reserved":0,"allocated":753664,"data_stored":368324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.56100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.66500000000000004,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.307},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.76500000000000001},"last":0.378}]},{"osd":6,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":1.1120000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:22:00.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:22:00.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 Processor -- start 2023-05-10T01:22:00.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 -- start start 2023-05-10T01:22:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f18068c60 0x7f5f18154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f18064ff0 0x7f5f180654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f18067550 con 0x7f5f18153ea0 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f18065990 con 0x7f5f18064ff0 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.604+0000 7f5f1d49e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180bc9a0 con 0x7f5f18068c60 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f16ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5f18153ea0 0x7f5f18066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42622/0 (socket says 172.21.15.52:42622) 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f16ffd700 1 -- 172.21.15.52:0/545096454 learned_addr learned my addr 172.21.15.52:0/545096454 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:00.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f18068c60 0x7f5f18154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f177fe700 1 --2- 172.21.15.52:0/545096454 >> v2:172.21.15.172:3300/0 conn(0x7f5f18064ff0 0x7f5f180654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345249529 0 0) 0x7f5f10001110 con 0x7f5f18153ea0 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f040033f0 con 0x7f5f18153ea0 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009705306 0 0) 0x7f5f040033f0 con 0x7f5f18153ea0 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f18068c60 msgr2=0x7f5f18154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f18068c60 0x7f5f18154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 >> v2:172.21.15.172:3300/0 conn(0x7f5f18064ff0 msgr2=0x7f5f180654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 --2- 172.21.15.52:0/545096454 >> v2:172.21.15.172:3300/0 conn(0x7f5f18064ff0 0x7f5f180654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180bcc80 con 0x7f5f18153ea0 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5f10001600 con 0x7f5f18153ea0 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f18068c60 0x7f5f18154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 >> v1:172.21.15.52:6789/0 conn(0x7f5f18153ea0 legacy=0x7f5f18066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f040038e0 0x7f5f04003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f040041b0 0x7f5f04004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f04004cb0 0x7f5f04005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18065990 con 0x7f5f040041b0 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180bc9a0 con 0x7f5f04004cb0 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0400bbf0 con 0x7f5f040038e0 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f040041b0 0x7f5f04004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f16ffd700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f040038e0 0x7f5f04003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.605+0000 7f5f177fe700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f04004cb0 0x7f5f04005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 -- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f040038e0 msgr2=0x7f5f04003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f040038e0 0x7f5f04003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 -- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f04004cb0 msgr2=0x7f5f04005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f04004cb0 0x7f5f04005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 -- 172.21.15.52:0/545096454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0092a0 con 0x7f5f040041b0 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f167fc700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f040041b0 0x7f5f04004690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5f0c006d80 tx=0x7f5f0c009060).ready entity=mon.0 client_cookie=a9cdc3186052a9f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0095c0 con 0x7f5f040041b0 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00e710 con 0x7f5f040041b0 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f15ffb700 1 -- 172.21.15.52:0/545096454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00ea90 con 0x7f5f040041b0 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 -- 172.21.15.52:0/545096454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f040041b0 msgr2=0x7f5f04004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/545096454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f040041b0 0x7f5f04004690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5f0c006d80 tx=0x7f5f0c009060).stop 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f177fe700 1 -- 172.21.15.52:0/545096454 reap_dead start 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 -- 172.21.15.52:0/545096454 shutdown_connections 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 -- 172.21.15.52:0/545096454 >> 172.21.15.52:0/545096454 conn(0x7f5f180c4420 msgr2=0x7f5f180c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 -- 172.21.15.52:0/545096454 shutdown_connections 2023-05-10T01:22:00.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.606+0000 7f5f1d49e700 1 -- 172.21.15.52:0/545096454 wait complete. 2023-05-10T01:22:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 Processor -- start 2023-05-10T01:22:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 -- start start 2023-05-10T01:22:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 0x7f5f1813c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f1814ccf0 0x7f5f180a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180a8f10 con 0x7f5f180a9aa0 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180a91f0 con 0x7f5f040041b0 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.608+0000 7f5f1d49e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180a94d0 con 0x7f5f1814ccf0 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33622/0 (socket says 172.21.15.52:33622) 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 -- 172.21.15.52:0/4142863019 learned_addr learned my addr 172.21.15.52:0/4142863019 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f167fc700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f1814ccf0 0x7f5f180a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f16ffd700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 0x7f5f1813c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 -- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f1814ccf0 msgr2=0x7f5f180a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f1814ccf0 0x7f5f180a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 -- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 msgr2=0x7f5f1813c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 0x7f5f1813c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 -- 172.21.15.52:0/4142863019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180aa9b0 con 0x7f5f180a9aa0 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f16ffd700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 0x7f5f1813c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f177fe700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f5f18064df0 tx=0x7f5f0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800e040 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800f040 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f180aac90 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800fe20 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.609+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f180a8b20 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.610+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1806c340 con 0x7f5f180a9aa0 2023-05-10T01:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.611+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5f08015660 con 0x7f5f180a9aa0 2023-05-10T01:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.611+0000 7f5efeffd700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 0x7f5ef8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.611+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f5f0807a910 con 0x7f5f180a9aa0 2023-05-10T01:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.611+0000 7f5f16ffd700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 0x7f5ef8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.612+0000 7f5f16ffd700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 0x7f5ef8061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5f10004710 tx=0x7f5f10009040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.615+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f0804bdc0 con 0x7f5f180a9aa0 2023-05-10T01:22:00.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.784+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f180bcf60 con 0x7f5ef805ed90 2023-05-10T01:22:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.794+0000 7f5efeffd700 1 -- 172.21.15.52:0/4142863019 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357531 (secure 0 0 0) 0x7f5f180bcf60 con 0x7f5ef805ed90 2023-05-10T01:22:00.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:00.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 msgr2=0x7f5ef8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 0x7f5ef8061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5f10004710 tx=0x7f5f10009040).stop 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 msgr2=0x7f5f18151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f5f18064df0 tx=0x7f5f0800b040).stop 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 shutdown_connections 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ef805ed90 0x7f5ef8061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f180a9aa0 0x7f5f18151960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f040041b0 0x7f5f1813c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 --2- 172.21.15.52:0/4142863019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f1814ccf0 0x7f5f180a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 >> 172.21.15.52:0/4142863019 conn(0x7f5f180c4420 msgr2=0x7f5f180a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 shutdown_connections 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.797+0000 7f5f1d49e700 1 -- 172.21.15.52:0/4142863019 wait complete. 2023-05-10T01:22:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:22:00.812 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:21:59.733413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138164,"kb_used_data":5748,"kb_used_omap":0,"kb_used_meta":132352,"kb_avail":754836556,"statfs":{"total":773094113280,"available":772952633344,"internally_reserved":0,"allocated":5885952,"data_stored":2858603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135528448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14669473,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.193368"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396349+0000","last_change":"2023-05-10T01:21:56.393474+0000","last_active":"2023-05-10T01:21:56.396349+0000","last_peered":"2023-05-10T01:21:56.396349+0000","last_clean":"2023-05-10T01:21:56.396349+0000","last_became_active":"2023-05-10T01:21:56.393150+0000","last_became_peered":"2023-05-10T01:21:56.393150+0000","last_unstale":"2023-05-10T01:21:56.396349+0000","last_undegraded":"2023-05-10T01:21:56.396349+0000","last_fullsized":"2023-05-10T01:21:56.396349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372259+0000","last_change":"2023-05-10T01:21:55.995244+0000","last_active":"2023-05-10T01:21:56.372259+0000","last_peered":"2023-05-10T01:21:56.372259+0000","last_clean":"2023-05-10T01:21:56.372259+0000","last_became_active":"2023-05-10T01:21:55.994967+0000","last_became_peered":"2023-05-10T01:21:55.994967+0000","last_unstale":"2023-05-10T01:21:56.372259+0000","last_undegraded":"2023-05-10T01:21:56.372259+0000","last_fullsized":"2023-05-10T01:21:56.372259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393590+0000","last_change":"2023-05-10T01:21:56.387460+0000","last_active":"2023-05-10T01:21:56.393590+0000","last_peered":"2023-05-10T01:21:56.393590+0000","last_clean":"2023-05-10T01:21:56.393590+0000","last_became_active":"2023-05-10T01:21:56.387168+0000","last_became_peered":"2023-05-10T01:21:56.387168+0000","last_unstale":"2023-05-10T01:21:56.393590+0000","last_undegraded":"2023-05-10T01:21:56.393590+0000","last_fullsized":"2023-05-10T01:21:56.393590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375395+0000","last_change":"2023-05-10T01:21:55.981476+0000","last_active":"2023-05-10T01:21:56.375395+0000","last_peered":"2023-05-10T01:21:56.375395+0000","last_clean":"2023-05-10T01:21:56.375395+0000","last_became_active":"2023-05-10T01:21:55.981022+0000","last_became_peered":"2023-05-10T01:21:55.981022+0000","last_unstale":"2023-05-10T01:21:56.375395+0000","last_undegraded":"2023-05-10T01:21:56.375395+0000","last_fullsized":"2023-05-10T01:21:56.375395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396467+0000","last_change":"2023-05-10T01:21:56.393248+0000","last_active":"2023-05-10T01:21:56.396467+0000","last_peered":"2023-05-10T01:21:56.396467+0000","last_clean":"2023-05-10T01:21:56.396467+0000","last_became_active":"2023-05-10T01:21:56.392940+0000","last_became_peered":"2023-05-10T01:21:56.392940+0000","last_unstale":"2023-05-10T01:21:56.396467+0000","last_undegraded":"2023-05-10T01:21:56.396467+0000","last_fullsized":"2023-05-10T01:21:56.396467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394545+0000","last_change":"2023-05-10T01:21:55.989682+0000","last_active":"2023-05-10T01:21:56.394545+0000","last_peered":"2023-05-10T01:21:56.394545+0000","last_clean":"2023-05-10T01:21:56.394545+0000","last_became_active":"2023-05-10T01:21:55.989221+0000","last_became_peered":"2023-05-10T01:21:55.989221+0000","last_unstale":"2023-05-10T01:21:56.394545+0000","last_undegraded":"2023-05-10T01:21:56.394545+0000","last_fullsized":"2023-05-10T01:21:56.394545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398309+0000","last_change":"2023-05-10T01:21:56.396249+0000","last_active":"2023-05-10T01:21:56.398309+0000","last_peered":"2023-05-10T01:21:56.398309+0000","last_clean":"2023-05-10T01:21:56.398309+0000","last_became_active":"2023-05-10T01:21:56.395946+0000","last_became_peered":"2023-05-10T01:21:56.395946+0000","last_unstale":"2023-05-10T01:21:56.398309+0000","last_undegraded":"2023-05-10T01:21:56.398309+0000","last_fullsized":"2023-05-10T01:21:56.398309+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383417+0000","last_change":"2023-05-10T01:21:55.989419+0000","last_active":"2023-05-10T01:21:56.383417+0000","last_peered":"2023-05-10T01:21:56.383417+0000","last_clean":"2023-05-10T01:21:56.383417+0000","last_became_active":"2023-05-10T01:21:55.989168+0000","last_became_peered":"2023-05-10T01:21:55.989168+0000","last_unstale":"2023-05-10T01:21:56.383417+0000","last_undegraded":"2023-05-10T01:21:56.383417+0000","last_fullsized":"2023-05-10T01:21:56.383417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394435+0000","last_change":"2023-05-10T01:21:55.987682+0000","last_active":"2023-05-10T01:21:56.394435+0000","last_peered":"2023-05-10T01:21:56.394435+0000","last_clean":"2023-05-10T01:21:56.394435+0000","last_became_active":"2023-05-10T01:21:55.987380+0000","last_became_peered":"2023-05-10T01:21:55.987380+0000","last_unstale":"2023-05-10T01:21:56.394435+0000","last_undegraded":"2023-05-10T01:21:56.394435+0000","last_fullsized":"2023-05-10T01:21:56.394435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396200+0000","last_change":"2023-05-10T01:21:56.392983+0000","last_active":"2023-05-10T01:21:56.396200+0000","last_peered":"2023-05-10T01:21:56.396200+0000","last_clean":"2023-05-10T01:21:56.396200+0000","last_became_active":"2023-05-10T01:21:56.392726+0000","last_became_peered":"2023-05-10T01:21:56.392726+0000","last_unstale":"2023-05-10T01:21:56.396200+0000","last_undegraded":"2023-05-10T01:21:56.396200+0000","last_fullsized":"2023-05-10T01:21:56.396200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384785+0000","last_change":"2023-05-10T01:21:56.381538+0000","last_active":"2023-05-10T01:21:56.384785+0000","last_peered":"2023-05-10T01:21:56.384785+0000","last_clean":"2023-05-10T01:21:56.384785+0000","last_became_active":"2023-05-10T01:21:56.381059+0000","last_became_peered":"2023-05-10T01:21:56.381059+0000","last_unstale":"2023-05-10T01:21:56.384785+0000","last_undegraded":"2023-05-10T01:21:56.384785+0000","last_fullsized":"2023-05-10T01:21:56.384785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373368+0000","last_change":"2023-05-10T01:21:55.992753+0000","last_active":"2023-05-10T01:21:56.373368+0000","last_peered":"2023-05-10T01:21:56.373368+0000","last_clean":"2023-05-10T01:21:56.373368+0000","last_became_active":"2023-05-10T01:21:55.989112+0000","last_became_peered":"2023-05-10T01:21:55.989112+0000","last_unstale":"2023-05-10T01:21:56.373368+0000","last_undegraded":"2023-05-10T01:21:56.373368+0000","last_fullsized":"2023-05-10T01:21:56.373368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.389535+0000","last_change":"2023-05-10T01:21:56.385875+0000","last_active":"2023-05-10T01:21:56.389535+0000","last_peered":"2023-05-10T01:21:56.389535+0000","last_clean":"2023-05-10T01:21:56.389535+0000","last_became_active":"2023-05-10T01:21:56.385559+0000","last_became_peered":"2023-05-10T01:21:56.385559+0000","last_unstale":"2023-05-10T01:21:56.389535+0000","last_undegraded":"2023-05-10T01:21:56.389535+0000","last_fullsized":"2023-05-10T01:21:56.389535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374945+0000","last_change":"2023-05-10T01:21:55.995994+0000","last_active":"2023-05-10T01:21:56.374945+0000","last_peered":"2023-05-10T01:21:56.374945+0000","last_clean":"2023-05-10T01:21:56.374945+0000","last_became_active":"2023-05-10T01:21:55.995612+0000","last_became_peered":"2023-05-10T01:21:55.995612+0000","last_unstale":"2023-05-10T01:21:56.374945+0000","last_undegraded":"2023-05-10T01:21:56.374945+0000","last_fullsized":"2023-05-10T01:21:56.374945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397620+0000","last_change":"2023-05-10T01:21:56.393150+0000","last_active":"2023-05-10T01:21:56.397620+0000","last_peered":"2023-05-10T01:21:56.397620+0000","last_clean":"2023-05-10T01:21:56.397620+0000","last_became_active":"2023-05-10T01:21:56.392864+0000","last_became_peered":"2023-05-10T01:21:56.392864+0000","last_unstale":"2023-05-10T01:21:56.397620+0000","last_undegraded":"2023-05-10T01:21:56.397620+0000","last_fullsized":"2023-05-10T01:21:56.397620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374362+0000","last_change":"2023-05-10T01:21:55.989756+0000","last_active":"2023-05-10T01:21:56.374362+0000","last_peered":"2023-05-10T01:21:56.374362+0000","last_clean":"2023-05-10T01:21:56.374362+0000","last_became_active":"2023-05-10T01:21:55.989216+0000","last_became_peered":"2023-05-10T01:21:55.989216+0000","last_unstale":"2023-05-10T01:21:56.374362+0000","last_undegraded":"2023-05-10T01:21:56.374362+0000","last_fullsized":"2023-05-10T01:21:56.374362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385955+0000","last_change":"2023-05-10T01:21:56.379300+0000","last_active":"2023-05-10T01:21:56.385955+0000","last_peered":"2023-05-10T01:21:56.385955+0000","last_clean":"2023-05-10T01:21:56.385955+0000","last_became_active":"2023-05-10T01:21:56.378969+0000","last_became_peered":"2023-05-10T01:21:56.378969+0000","last_unstale":"2023-05-10T01:21:56.385955+0000","last_undegraded":"2023-05-10T01:21:56.385955+0000","last_fullsized":"2023-05-10T01:21:56.385955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376325+0000","last_change":"2023-05-10T01:21:55.996558+0000","last_active":"2023-05-10T01:21:56.376325+0000","last_peered":"2023-05-10T01:21:56.376325+0000","last_clean":"2023-05-10T01:21:56.376325+0000","last_became_active":"2023-05-10T01:21:55.996094+0000","last_became_peered":"2023-05-10T01:21:55.996094+0000","last_unstale":"2023-05-10T01:21:56.376325+0000","last_undegraded":"2023-05-10T01:21:56.376325+0000","last_fullsized":"2023-05-10T01:21:56.376325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393472+0000","last_change":"2023-05-10T01:21:56.389655+0000","last_active":"2023-05-10T01:21:56.393472+0000","last_peered":"2023-05-10T01:21:56.393472+0000","last_clean":"2023-05-10T01:21:56.393472+0000","last_became_active":"2023-05-10T01:21:56.389185+0000","last_became_peered":"2023-05-10T01:21:56.389185+0000","last_unstale":"2023-05-10T01:21:56.393472+0000","last_undegraded":"2023-05-10T01:21:56.393472+0000","last_fullsized":"2023-05-10T01:21:56.393472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397557+0000","last_change":"2023-05-10T01:21:55.990841+0000","last_active":"2023-05-10T01:21:56.397557+0000","last_peered":"2023-05-10T01:21:56.397557+0000","last_clean":"2023-05-10T01:21:56.397557+0000","last_became_active":"2023-05-10T01:21:55.990576+0000","last_became_peered":"2023-05-10T01:21:55.990576+0000","last_unstale":"2023-05-10T01:21:56.397557+0000","last_undegraded":"2023-05-10T01:21:56.397557+0000","last_fullsized":"2023-05-10T01:21:56.397557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393891+0000","last_change":"2023-05-10T01:21:56.387347+0000","last_active":"2023-05-10T01:21:56.393891+0000","last_peered":"2023-05-10T01:21:56.393891+0000","last_clean":"2023-05-10T01:21:56.393891+0000","last_became_active":"2023-05-10T01:21:56.386716+0000","last_became_peered":"2023-05-10T01:21:56.386716+0000","last_unstale":"2023-05-10T01:21:56.393891+0000","last_undegraded":"2023-05-10T01:21:56.393891+0000","last_fullsized":"2023-05-10T01:21:56.393891+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376282+0000","last_change":"2023-05-10T01:21:55.996347+0000","last_active":"2023-05-10T01:21:56.376282+0000","last_peered":"2023-05-10T01:21:56.376282+0000","last_clean":"2023-05-10T01:21:56.376282+0000","last_became_active":"2023-05-10T01:21:55.996084+0000","last_became_peered":"2023-05-10T01:21:55.996084+0000","last_unstale":"2023-05-10T01:21:56.376282+0000","last_undegraded":"2023-05-10T01:21:56.376282+0000","last_fullsized":"2023-05-10T01:21:56.376282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373429+0000","last_change":"2023-05-10T01:21:55.984869+0000","last_active":"2023-05-10T01:21:56.373429+0000","last_peered":"2023-05-10T01:21:56.373429+0000","last_clean":"2023-05-10T01:21:56.373429+0000","last_became_active":"2023-05-10T01:21:55.984587+0000","last_became_peered":"2023-05-10T01:21:55.984587+0000","last_unstale":"2023-05-10T01:21:56.373429+0000","last_undegraded":"2023-05-10T01:21:56.373429+0000","last_fullsized":"2023-05-10T01:21:56.373429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394933+0000","last_change":"2023-05-10T01:21:56.385313+0000","last_active":"2023-05-10T01:21:56.394933+0000","last_peered":"2023-05-10T01:21:56.394933+0000","last_clean":"2023-05-10T01:21:56.394933+0000","last_became_active":"2023-05-10T01:21:56.382048+0000","last_became_peered":"2023-05-10T01:21:56.382048+0000","last_unstale":"2023-05-10T01:21:56.394933+0000","last_undegraded":"2023-05-10T01:21:56.394933+0000","last_fullsized":"2023-05-10T01:21:56.394933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394431+0000","last_change":"2023-05-10T01:21:56.389754+0000","last_active":"2023-05-10T01:21:56.394431+0000","last_peered":"2023-05-10T01:21:56.394431+0000","last_clean":"2023-05-10T01:21:56.394431+0000","last_became_active":"2023-05-10T01:21:56.389230+0000","last_became_peered":"2023-05-10T01:21:56.389230+0000","last_unstale":"2023-05-10T01:21:56.394431+0000","last_undegraded":"2023-05-10T01:21:56.394431+0000","last_fullsized":"2023-05-10T01:21:56.394431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375951+0000","last_change":"2023-05-10T01:21:55.977210+0000","last_active":"2023-05-10T01:21:56.375951+0000","last_peered":"2023-05-10T01:21:56.375951+0000","last_clean":"2023-05-10T01:21:56.375951+0000","last_became_active":"2023-05-10T01:21:55.976395+0000","last_became_peered":"2023-05-10T01:21:55.976395+0000","last_unstale":"2023-05-10T01:21:56.375951+0000","last_undegraded":"2023-05-10T01:21:56.375951+0000","last_fullsized":"2023-05-10T01:21:56.375951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398378+0000","last_change":"2023-05-10T01:21:56.396010+0000","last_active":"2023-05-10T01:21:56.398378+0000","last_peered":"2023-05-10T01:21:56.398378+0000","last_clean":"2023-05-10T01:21:56.398378+0000","last_became_active":"2023-05-10T01:21:56.395742+0000","last_became_peered":"2023-05-10T01:21:56.395742+0000","last_unstale":"2023-05-10T01:21:56.398378+0000","last_undegraded":"2023-05-10T01:21:56.398378+0000","last_fullsized":"2023-05-10T01:21:56.398378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377562+0000","last_change":"2023-05-10T01:21:55.985998+0000","last_active":"2023-05-10T01:21:56.377562+0000","last_peered":"2023-05-10T01:21:56.377562+0000","last_clean":"2023-05-10T01:21:56.377562+0000","last_became_active":"2023-05-10T01:21:55.985747+0000","last_became_peered":"2023-05-10T01:21:55.985747+0000","last_unstale":"2023-05-10T01:21:56.377562+0000","last_undegraded":"2023-05-10T01:21:56.377562+0000","last_fullsized":"2023-05-10T01:21:56.377562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398490+0000","last_change":"2023-05-10T01:21:56.395020+0000","last_active":"2023-05-10T01:21:56.398490+0000","last_peered":"2023-05-10T01:21:56.398490+0000","last_clean":"2023-05-10T01:21:56.398490+0000","last_became_active":"2023-05-10T01:21:56.394720+0000","last_became_peered":"2023-05-10T01:21:56.394720+0000","last_unstale":"2023-05-10T01:21:56.398490+0000","last_undegraded":"2023-05-10T01:21:56.398490+0000","last_fullsized":"2023-05-10T01:21:56.398490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396357+0000","last_change":"2023-05-10T01:21:55.983679+0000","last_active":"2023-05-10T01:21:56.396357+0000","last_peered":"2023-05-10T01:21:56.396357+0000","last_clean":"2023-05-10T01:21:56.396357+0000","last_became_active":"2023-05-10T01:21:55.983331+0000","last_became_peered":"2023-05-10T01:21:55.983331+0000","last_unstale":"2023-05-10T01:21:56.396357+0000","last_undegraded":"2023-05-10T01:21:56.396357+0000","last_fullsized":"2023-05-10T01:21:56.396357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387810+0000","last_change":"2023-05-10T01:21:56.382093+0000","last_active":"2023-05-10T01:21:56.387810+0000","last_peered":"2023-05-10T01:21:56.387810+0000","last_clean":"2023-05-10T01:21:56.387810+0000","last_became_active":"2023-05-10T01:21:56.381808+0000","last_became_peered":"2023-05-10T01:21:56.381808+0000","last_unstale":"2023-05-10T01:21:56.387810+0000","last_undegraded":"2023-05-10T01:21:56.387810+0000","last_fullsized":"2023-05-10T01:21:56.387810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376180+0000","last_change":"2023-05-10T01:21:55.985464+0000","last_active":"2023-05-10T01:21:56.376180+0000","last_peered":"2023-05-10T01:21:56.376180+0000","last_clean":"2023-05-10T01:21:56.376180+0000","last_became_active":"2023-05-10T01:21:55.984713+0000","last_became_peered":"2023-05-10T01:21:55.984713+0000","last_unstale":"2023-05-10T01:21:56.376180+0000","last_undegraded":"2023-05-10T01:21:56.376180+0000","last_fullsized":"2023-05-10T01:21:56.376180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390050+0000","last_change":"2023-05-10T01:21:56.388436+0000","last_active":"2023-05-10T01:21:56.390050+0000","last_peered":"2023-05-10T01:21:56.390050+0000","last_clean":"2023-05-10T01:21:56.390050+0000","last_became_active":"2023-05-10T01:21:56.387905+0000","last_became_peered":"2023-05-10T01:21:56.387905+0000","last_unstale":"2023-05-10T01:21:56.390050+0000","last_undegraded":"2023-05-10T01:21:56.390050+0000","last_fullsized":"2023-05-10T01:21:56.390050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390425+0000","last_change":"2023-05-10T01:21:56.384117+0000","last_active":"2023-05-10T01:21:56.390425+0000","last_peered":"2023-05-10T01:21:56.390425+0000","last_clean":"2023-05-10T01:21:56.390425+0000","last_became_active":"2023-05-10T01:21:56.383746+0000","last_became_peered":"2023-05-10T01:21:56.383746+0000","last_unstale":"2023-05-10T01:21:56.390425+0000","last_undegraded":"2023-05-10T01:21:56.390425+0000","last_fullsized":"2023-05-10T01:21:56.390425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390861+0000","last_change":"2023-05-10T01:21:56.384951+0000","last_active":"2023-05-10T01:21:56.390861+0000","last_peered":"2023-05-10T01:21:56.390861+0000","last_clean":"2023-05-10T01:21:56.390861+0000","last_became_active":"2023-05-10T01:21:56.384677+0000","last_became_peered":"2023-05-10T01:21:56.384677+0000","last_unstale":"2023-05-10T01:21:56.390861+0000","last_undegraded":"2023-05-10T01:21:56.390861+0000","last_fullsized":"2023-05-10T01:21:56.390861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383820+0000","last_change":"2023-05-10T01:21:56.381131+0000","last_active":"2023-05-10T01:21:56.383820+0000","last_peered":"2023-05-10T01:21:56.383820+0000","last_clean":"2023-05-10T01:21:56.383820+0000","last_became_active":"2023-05-10T01:21:56.380922+0000","last_became_peered":"2023-05-10T01:21:56.380922+0000","last_unstale":"2023-05-10T01:21:56.383820+0000","last_undegraded":"2023-05-10T01:21:56.383820+0000","last_fullsized":"2023-05-10T01:21:56.383820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375476+0000","last_change":"2023-05-10T01:21:55.981305+0000","last_active":"2023-05-10T01:21:56.375476+0000","last_peered":"2023-05-10T01:21:56.375476+0000","last_clean":"2023-05-10T01:21:56.375476+0000","last_became_active":"2023-05-10T01:21:55.980073+0000","last_became_peered":"2023-05-10T01:21:55.980073+0000","last_unstale":"2023-05-10T01:21:56.375476+0000","last_undegraded":"2023-05-10T01:21:56.375476+0000","last_fullsized":"2023-05-10T01:21:56.375476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372965+0000","last_change":"2023-05-10T01:21:55.990808+0000","last_active":"2023-05-10T01:21:56.372965+0000","last_peered":"2023-05-10T01:21:56.372965+0000","last_clean":"2023-05-10T01:21:56.372965+0000","last_became_active":"2023-05-10T01:21:55.990499+0000","last_became_peered":"2023-05-10T01:21:55.990499+0000","last_unstale":"2023-05-10T01:21:56.372965+0000","last_undegraded":"2023-05-10T01:21:56.372965+0000","last_fullsized":"2023-05-10T01:21:56.372965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393912+0000","last_change":"2023-05-10T01:21:56.391042+0000","last_active":"2023-05-10T01:21:56.393912+0000","last_peered":"2023-05-10T01:21:56.393912+0000","last_clean":"2023-05-10T01:21:56.393912+0000","last_became_active":"2023-05-10T01:21:56.389952+0000","last_became_peered":"2023-05-10T01:21:56.389952+0000","last_unstale":"2023-05-10T01:21:56.393912+0000","last_undegraded":"2023-05-10T01:21:56.393912+0000","last_fullsized":"2023-05-10T01:21:56.393912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375539+0000","last_change":"2023-05-10T01:21:55.983291+0000","last_active":"2023-05-10T01:21:56.375539+0000","last_peered":"2023-05-10T01:21:56.375539+0000","last_clean":"2023-05-10T01:21:56.375539+0000","last_became_active":"2023-05-10T01:21:55.983015+0000","last_became_peered":"2023-05-10T01:21:55.983015+0000","last_unstale":"2023-05-10T01:21:56.375539+0000","last_undegraded":"2023-05-10T01:21:56.375539+0000","last_fullsized":"2023-05-10T01:21:56.375539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373208+0000","last_change":"2023-05-10T01:21:55.983553+0000","last_active":"2023-05-10T01:21:56.373208+0000","last_peered":"2023-05-10T01:21:56.373208+0000","last_clean":"2023-05-10T01:21:56.373208+0000","last_became_active":"2023-05-10T01:21:55.983243+0000","last_became_peered":"2023-05-10T01:21:55.983243+0000","last_unstale":"2023-05-10T01:21:56.373208+0000","last_undegraded":"2023-05-10T01:21:56.373208+0000","last_fullsized":"2023-05-10T01:21:56.373208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395257+0000","last_change":"2023-05-10T01:21:56.390161+0000","last_active":"2023-05-10T01:21:56.395257+0000","last_peered":"2023-05-10T01:21:56.395257+0000","last_clean":"2023-05-10T01:21:56.395257+0000","last_became_active":"2023-05-10T01:21:56.389337+0000","last_became_peered":"2023-05-10T01:21:56.389337+0000","last_unstale":"2023-05-10T01:21:56.395257+0000","last_undegraded":"2023-05-10T01:21:56.395257+0000","last_fullsized":"2023-05-10T01:21:56.395257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393462+0000","last_change":"2023-05-10T01:21:56.383749+0000","last_active":"2023-05-10T01:21:56.393462+0000","last_peered":"2023-05-10T01:21:56.393462+0000","last_clean":"2023-05-10T01:21:56.393462+0000","last_became_active":"2023-05-10T01:21:56.382989+0000","last_became_peered":"2023-05-10T01:21:56.382989+0000","last_unstale":"2023-05-10T01:21:56.393462+0000","last_undegraded":"2023-05-10T01:21:56.393462+0000","last_fullsized":"2023-05-10T01:21:56.393462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386928+0000","last_change":"2023-05-10T01:21:55.988303+0000","last_active":"2023-05-10T01:21:56.386928+0000","last_peered":"2023-05-10T01:21:56.386928+0000","last_clean":"2023-05-10T01:21:56.386928+0000","last_became_active":"2023-05-10T01:21:55.987986+0000","last_became_peered":"2023-05-10T01:21:55.987986+0000","last_unstale":"2023-05-10T01:21:56.386928+0000","last_undegraded":"2023-05-10T01:21:56.386928+0000","last_fullsized":"2023-05-10T01:21:56.386928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395972+0000","last_change":"2023-05-10T01:21:55.979791+0000","last_active":"2023-05-10T01:21:56.395972+0000","last_peered":"2023-05-10T01:21:56.395972+0000","last_clean":"2023-05-10T01:21:56.395972+0000","last_became_active":"2023-05-10T01:21:55.978489+0000","last_became_peered":"2023-05-10T01:21:55.978489+0000","last_unstale":"2023-05-10T01:21:56.395972+0000","last_undegraded":"2023-05-10T01:21:56.395972+0000","last_fullsized":"2023-05-10T01:21:56.395972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390030+0000","last_change":"2023-05-10T01:21:56.386816+0000","last_active":"2023-05-10T01:21:56.390030+0000","last_peered":"2023-05-10T01:21:56.390030+0000","last_clean":"2023-05-10T01:21:56.390030+0000","last_became_active":"2023-05-10T01:21:56.386546+0000","last_became_peered":"2023-05-10T01:21:56.386546+0000","last_unstale":"2023-05-10T01:21:56.390030+0000","last_undegraded":"2023-05-10T01:21:56.390030+0000","last_fullsized":"2023-05-10T01:21:56.390030+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373089+0000","last_change":"2023-05-10T01:21:55.988218+0000","last_active":"2023-05-10T01:21:56.373089+0000","last_peered":"2023-05-10T01:21:56.373089+0000","last_clean":"2023-05-10T01:21:56.373089+0000","last_became_active":"2023-05-10T01:21:55.987936+0000","last_became_peered":"2023-05-10T01:21:55.987936+0000","last_unstale":"2023-05-10T01:21:56.373089+0000","last_undegraded":"2023-05-10T01:21:56.373089+0000","last_fullsized":"2023-05-10T01:21:56.373089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396213+0000","last_change":"2023-05-10T01:21:56.393981+0000","last_active":"2023-05-10T01:21:56.396213+0000","last_peered":"2023-05-10T01:21:56.396213+0000","last_clean":"2023-05-10T01:21:56.396213+0000","last_became_active":"2023-05-10T01:21:56.393672+0000","last_became_peered":"2023-05-10T01:21:56.393672+0000","last_unstale":"2023-05-10T01:21:56.396213+0000","last_undegraded":"2023-05-10T01:21:56.396213+0000","last_fullsized":"2023-05-10T01:21:56.396213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374941+0000","last_change":"2023-05-10T01:21:55.982605+0000","last_active":"2023-05-10T01:21:56.374941+0000","last_peered":"2023-05-10T01:21:56.374941+0000","last_clean":"2023-05-10T01:21:56.374941+0000","last_became_active":"2023-05-10T01:21:55.981073+0000","last_became_peered":"2023-05-10T01:21:55.981073+0000","last_unstale":"2023-05-10T01:21:56.374941+0000","last_undegraded":"2023-05-10T01:21:56.374941+0000","last_fullsized":"2023-05-10T01:21:56.374941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375642+0000","last_change":"2023-05-10T01:21:55.978009+0000","last_active":"2023-05-10T01:21:56.375642+0000","last_peered":"2023-05-10T01:21:56.375642+0000","last_clean":"2023-05-10T01:21:56.375642+0000","last_became_active":"2023-05-10T01:21:55.977745+0000","last_became_peered":"2023-05-10T01:21:55.977745+0000","last_unstale":"2023-05-10T01:21:56.375642+0000","last_undegraded":"2023-05-10T01:21:56.375642+0000","last_fullsized":"2023-05-10T01:21:56.375642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390033+0000","last_change":"2023-05-10T01:21:56.387952+0000","last_active":"2023-05-10T01:21:56.390033+0000","last_peered":"2023-05-10T01:21:56.390033+0000","last_clean":"2023-05-10T01:21:56.390033+0000","last_became_active":"2023-05-10T01:21:56.387673+0000","last_became_peered":"2023-05-10T01:21:56.387673+0000","last_unstale":"2023-05-10T01:21:56.390033+0000","last_undegraded":"2023-05-10T01:21:56.390033+0000","last_fullsized":"2023-05-10T01:21:56.390033+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373474+0000","last_change":"2023-05-10T01:21:55.989894+0000","last_active":"2023-05-10T01:21:56.373474+0000","last_peered":"2023-05-10T01:21:56.373474+0000","last_clean":"2023-05-10T01:21:56.373474+0000","last_became_active":"2023-05-10T01:21:55.989151+0000","last_became_peered":"2023-05-10T01:21:55.989151+0000","last_unstale":"2023-05-10T01:21:56.373474+0000","last_undegraded":"2023-05-10T01:21:56.373474+0000","last_fullsized":"2023-05-10T01:21:56.373474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401225+0000","last_change":"2023-05-10T01:21:56.397647+0000","last_active":"2023-05-10T01:21:56.401225+0000","last_peered":"2023-05-10T01:21:56.401225+0000","last_clean":"2023-05-10T01:21:56.401225+0000","last_became_active":"2023-05-10T01:21:56.397366+0000","last_became_peered":"2023-05-10T01:21:56.397366+0000","last_unstale":"2023-05-10T01:21:56.401225+0000","last_undegraded":"2023-05-10T01:21:56.401225+0000","last_fullsized":"2023-05-10T01:21:56.401225+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394756+0000","last_change":"2023-05-10T01:21:56.387217+0000","last_active":"2023-05-10T01:21:56.394756+0000","last_peered":"2023-05-10T01:21:56.394756+0000","last_clean":"2023-05-10T01:21:56.394756+0000","last_became_active":"2023-05-10T01:21:56.386938+0000","last_became_peered":"2023-05-10T01:21:56.386938+0000","last_unstale":"2023-05-10T01:21:56.394756+0000","last_undegraded":"2023-05-10T01:21:56.394756+0000","last_fullsized":"2023-05-10T01:21:56.394756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377710+0000","last_change":"2023-05-10T01:21:55.986297+0000","last_active":"2023-05-10T01:21:56.377710+0000","last_peered":"2023-05-10T01:21:56.377710+0000","last_clean":"2023-05-10T01:21:56.377710+0000","last_became_active":"2023-05-10T01:21:55.985992+0000","last_became_peered":"2023-05-10T01:21:55.985992+0000","last_unstale":"2023-05-10T01:21:56.377710+0000","last_undegraded":"2023-05-10T01:21:56.377710+0000","last_fullsized":"2023-05-10T01:21:56.377710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398235+0000","last_change":"2023-05-10T01:21:56.394951+0000","last_active":"2023-05-10T01:21:56.398235+0000","last_peered":"2023-05-10T01:21:56.398235+0000","last_clean":"2023-05-10T01:21:56.398235+0000","last_became_active":"2023-05-10T01:21:56.394686+0000","last_became_peered":"2023-05-10T01:21:56.394686+0000","last_unstale":"2023-05-10T01:21:56.398235+0000","last_undegraded":"2023-05-10T01:21:56.398235+0000","last_fullsized":"2023-05-10T01:21:56.398235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393450+0000","last_change":"2023-05-10T01:21:56.389449+0000","last_active":"2023-05-10T01:21:56.393450+0000","last_peered":"2023-05-10T01:21:56.393450+0000","last_clean":"2023-05-10T01:21:56.393450+0000","last_became_active":"2023-05-10T01:21:56.388600+0000","last_became_peered":"2023-05-10T01:21:56.388600+0000","last_unstale":"2023-05-10T01:21:56.393450+0000","last_undegraded":"2023-05-10T01:21:56.393450+0000","last_fullsized":"2023-05-10T01:21:56.393450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394810+0000","last_change":"2023-05-10T01:21:55.986935+0000","last_active":"2023-05-10T01:21:56.394810+0000","last_peered":"2023-05-10T01:21:56.394810+0000","last_clean":"2023-05-10T01:21:56.394810+0000","last_became_active":"2023-05-10T01:21:55.986618+0000","last_became_peered":"2023-05-10T01:21:55.986618+0000","last_unstale":"2023-05-10T01:21:56.394810+0000","last_undegraded":"2023-05-10T01:21:56.394810+0000","last_fullsized":"2023-05-10T01:21:56.394810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395310+0000","last_change":"2023-05-10T01:21:56.385256+0000","last_active":"2023-05-10T01:21:56.395310+0000","last_peered":"2023-05-10T01:21:56.395310+0000","last_clean":"2023-05-10T01:21:56.395310+0000","last_became_active":"2023-05-10T01:21:56.384982+0000","last_became_peered":"2023-05-10T01:21:56.384982+0000","last_unstale":"2023-05-10T01:21:56.395310+0000","last_undegraded":"2023-05-10T01:21:56.395310+0000","last_fullsized":"2023-05-10T01:21:56.395310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387897+0000","last_change":"2023-05-10T01:21:55.988593+0000","last_active":"2023-05-10T01:21:56.387897+0000","last_peered":"2023-05-10T01:21:56.387897+0000","last_clean":"2023-05-10T01:21:56.387897+0000","last_became_active":"2023-05-10T01:21:55.986001+0000","last_became_peered":"2023-05-10T01:21:55.986001+0000","last_unstale":"2023-05-10T01:21:56.387897+0000","last_undegraded":"2023-05-10T01:21:56.387897+0000","last_fullsized":"2023-05-10T01:21:56.387897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390764+0000","last_change":"2023-05-10T01:21:56.384859+0000","last_active":"2023-05-10T01:21:56.390764+0000","last_peered":"2023-05-10T01:21:56.390764+0000","last_clean":"2023-05-10T01:21:56.390764+0000","last_became_active":"2023-05-10T01:21:56.384456+0000","last_became_peered":"2023-05-10T01:21:56.384456+0000","last_unstale":"2023-05-10T01:21:56.390764+0000","last_undegraded":"2023-05-10T01:21:56.390764+0000","last_fullsized":"2023-05-10T01:21:56.390764+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394649+0000","last_change":"2023-05-10T01:21:56.388984+0000","last_active":"2023-05-10T01:21:56.394649+0000","last_peered":"2023-05-10T01:21:56.394649+0000","last_clean":"2023-05-10T01:21:56.394649+0000","last_became_active":"2023-05-10T01:21:56.388706+0000","last_became_peered":"2023-05-10T01:21:56.388706+0000","last_unstale":"2023-05-10T01:21:56.394649+0000","last_undegraded":"2023-05-10T01:21:56.394649+0000","last_fullsized":"2023-05-10T01:21:56.394649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395277+0000","last_change":"2023-05-10T01:21:56.390549+0000","last_active":"2023-05-10T01:21:56.395277+0000","last_peered":"2023-05-10T01:21:56.395277+0000","last_clean":"2023-05-10T01:21:56.395277+0000","last_became_active":"2023-05-10T01:21:56.389725+0000","last_became_peered":"2023-05-10T01:21:56.389725+0000","last_unstale":"2023-05-10T01:21:56.395277+0000","last_undegraded":"2023-05-10T01:21:56.395277+0000","last_fullsized":"2023-05-10T01:21:56.395277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397441+0000","last_change":"2023-05-10T01:21:55.985996+0000","last_active":"2023-05-10T01:21:56.397441+0000","last_peered":"2023-05-10T01:21:56.397441+0000","last_clean":"2023-05-10T01:21:56.397441+0000","last_became_active":"2023-05-10T01:21:55.985693+0000","last_became_peered":"2023-05-10T01:21:55.985693+0000","last_unstale":"2023-05-10T01:21:56.397441+0000","last_undegraded":"2023-05-10T01:21:56.397441+0000","last_fullsized":"2023-05-10T01:21:56.397441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390084+0000","last_change":"2023-05-10T01:21:56.387575+0000","last_active":"2023-05-10T01:21:56.390084+0000","last_peered":"2023-05-10T01:21:56.390084+0000","last_clean":"2023-05-10T01:21:56.390084+0000","last_became_active":"2023-05-10T01:21:56.387380+0000","last_became_peered":"2023-05-10T01:21:56.387380+0000","last_unstale":"2023-05-10T01:21:56.390084+0000","last_undegraded":"2023-05-10T01:21:56.390084+0000","last_fullsized":"2023-05-10T01:21:56.390084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384279+0000","last_change":"2023-05-10T01:21:55.994254+0000","last_active":"2023-05-10T01:21:56.384279+0000","last_peered":"2023-05-10T01:21:56.384279+0000","last_clean":"2023-05-10T01:21:56.384279+0000","last_became_active":"2023-05-10T01:21:55.993796+0000","last_became_peered":"2023-05-10T01:21:55.993796+0000","last_unstale":"2023-05-10T01:21:56.384279+0000","last_undegraded":"2023-05-10T01:21:56.384279+0000","last_fullsized":"2023-05-10T01:21:56.384279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395063+0000","last_change":"2023-05-10T01:21:56.385556+0000","last_active":"2023-05-10T01:21:56.395063+0000","last_peered":"2023-05-10T01:21:56.395063+0000","last_clean":"2023-05-10T01:21:56.395063+0000","last_became_active":"2023-05-10T01:21:56.381923+0000","last_became_peered":"2023-05-10T01:21:56.381923+0000","last_unstale":"2023-05-10T01:21:56.395063+0000","last_undegraded":"2023-05-10T01:21:56.395063+0000","last_fullsized":"2023-05-10T01:21:56.395063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391717+0000","last_change":"2023-05-10T01:21:56.389256+0000","last_active":"2023-05-10T01:21:56.391717+0000","last_peered":"2023-05-10T01:21:56.391717+0000","last_clean":"2023-05-10T01:21:56.391717+0000","last_became_active":"2023-05-10T01:21:56.388978+0000","last_became_peered":"2023-05-10T01:21:56.388978+0000","last_unstale":"2023-05-10T01:21:56.391717+0000","last_undegraded":"2023-05-10T01:21:56.391717+0000","last_fullsized":"2023-05-10T01:21:56.391717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396433+0000","last_change":"2023-05-10T01:21:56.392425+0000","last_active":"2023-05-10T01:21:56.396433+0000","last_peered":"2023-05-10T01:21:56.396433+0000","last_clean":"2023-05-10T01:21:56.396433+0000","last_became_active":"2023-05-10T01:21:56.388917+0000","last_became_peered":"2023-05-10T01:21:56.388917+0000","last_unstale":"2023-05-10T01:21:56.396433+0000","last_undegraded":"2023-05-10T01:21:56.396433+0000","last_fullsized":"2023-05-10T01:21:56.396433+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395333+0000","last_change":"2023-05-10T01:21:56.390584+0000","last_active":"2023-05-10T01:21:56.395333+0000","last_peered":"2023-05-10T01:21:56.395333+0000","last_clean":"2023-05-10T01:21:56.395333+0000","last_became_active":"2023-05-10T01:21:56.390323+0000","last_became_peered":"2023-05-10T01:21:56.390323+0000","last_unstale":"2023-05-10T01:21:56.395333+0000","last_undegraded":"2023-05-10T01:21:56.395333+0000","last_fullsized":"2023-05-10T01:21:56.395333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396396+0000","last_change":"2023-05-10T01:21:55.984806+0000","last_active":"2023-05-10T01:21:56.396396+0000","last_peered":"2023-05-10T01:21:56.396396+0000","last_clean":"2023-05-10T01:21:56.396396+0000","last_became_active":"2023-05-10T01:21:55.984490+0000","last_became_peered":"2023-05-10T01:21:55.984490+0000","last_unstale":"2023-05-10T01:21:56.396396+0000","last_undegraded":"2023-05-10T01:21:56.396396+0000","last_fullsized":"2023-05-10T01:21:56.396396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375615+0000","last_change":"2023-05-10T01:21:55.987039+0000","last_active":"2023-05-10T01:21:56.375615+0000","last_peered":"2023-05-10T01:21:56.375615+0000","last_clean":"2023-05-10T01:21:56.375615+0000","last_became_active":"2023-05-10T01:21:55.986716+0000","last_became_peered":"2023-05-10T01:21:55.986716+0000","last_unstale":"2023-05-10T01:21:56.375615+0000","last_undegraded":"2023-05-10T01:21:56.375615+0000","last_fullsized":"2023-05-10T01:21:56.375615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398666+0000","last_change":"2023-05-10T01:21:56.395474+0000","last_active":"2023-05-10T01:21:56.398666+0000","last_peered":"2023-05-10T01:21:56.398666+0000","last_clean":"2023-05-10T01:21:56.398666+0000","last_became_active":"2023-05-10T01:21:56.395187+0000","last_became_peered":"2023-05-10T01:21:56.395187+0000","last_unstale":"2023-05-10T01:21:56.398666+0000","last_undegraded":"2023-05-10T01:21:56.398666+0000","last_fullsized":"2023-05-10T01:21:56.398666+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375565+0000","last_change":"2023-05-10T01:21:55.995788+0000","last_active":"2023-05-10T01:21:56.375565+0000","last_peered":"2023-05-10T01:21:56.375565+0000","last_clean":"2023-05-10T01:21:56.375565+0000","last_became_active":"2023-05-10T01:21:55.995511+0000","last_became_peered":"2023-05-10T01:21:55.995511+0000","last_unstale":"2023-05-10T01:21:56.375565+0000","last_undegraded":"2023-05-10T01:21:56.375565+0000","last_fullsized":"2023-05-10T01:21:56.375565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386948+0000","last_change":"2023-05-10T01:21:56.381977+0000","last_active":"2023-05-10T01:21:56.386948+0000","last_peered":"2023-05-10T01:21:56.386948+0000","last_clean":"2023-05-10T01:21:56.386948+0000","last_became_active":"2023-05-10T01:21:56.381674+0000","last_became_peered":"2023-05-10T01:21:56.381674+0000","last_unstale":"2023-05-10T01:21:56.386948+0000","last_undegraded":"2023-05-10T01:21:56.386948+0000","last_fullsized":"2023-05-10T01:21:56.386948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398685+0000","last_change":"2023-05-10T01:21:56.396855+0000","last_active":"2023-05-10T01:21:56.398685+0000","last_peered":"2023-05-10T01:21:56.398685+0000","last_clean":"2023-05-10T01:21:56.398685+0000","last_became_active":"2023-05-10T01:21:56.396558+0000","last_became_peered":"2023-05-10T01:21:56.396558+0000","last_unstale":"2023-05-10T01:21:56.398685+0000","last_undegraded":"2023-05-10T01:21:56.398685+0000","last_fullsized":"2023-05-10T01:21:56.398685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376271+0000","last_change":"2023-05-10T01:21:55.978862+0000","last_active":"2023-05-10T01:21:56.376271+0000","last_peered":"2023-05-10T01:21:56.376271+0000","last_clean":"2023-05-10T01:21:56.376271+0000","last_became_active":"2023-05-10T01:21:55.978571+0000","last_became_peered":"2023-05-10T01:21:55.978571+0000","last_unstale":"2023-05-10T01:21:56.376271+0000","last_undegraded":"2023-05-10T01:21:56.376271+0000","last_fullsized":"2023-05-10T01:21:56.376271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370802+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:21:56.370802+0000","last_peered":"2023-05-10T01:21:56.370802+0000","last_clean":"2023-05-10T01:21:56.370802+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:21:56.370802+0000","last_undegraded":"2023-05-10T01:21:56.370802+0000","last_fullsized":"2023-05-10T01:21:56.370802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394411+0000","last_change":"2023-05-10T01:21:56.386063+0000","last_active":"2023-05-10T01:21:56.394411+0000","last_peered":"2023-05-10T01:21:56.394411+0000","last_clean":"2023-05-10T01:21:56.394411+0000","last_became_active":"2023-05-10T01:21:56.385793+0000","last_became_peered":"2023-05-10T01:21:56.385793+0000","last_unstale":"2023-05-10T01:21:56.394411+0000","last_undegraded":"2023-05-10T01:21:56.394411+0000","last_fullsized":"2023-05-10T01:21:56.394411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372423+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:21:56.372423+0000","last_peered":"2023-05-10T01:21:56.372423+0000","last_clean":"2023-05-10T01:21:56.372423+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:21:56.372423+0000","last_undegraded":"2023-05-10T01:21:56.372423+0000","last_fullsized":"2023-05-10T01:21:56.372423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397071+0000","last_change":"2023-05-10T01:21:56.394425+0000","last_active":"2023-05-10T01:21:56.397071+0000","last_peered":"2023-05-10T01:21:56.397071+0000","last_clean":"2023-05-10T01:21:56.397071+0000","last_became_active":"2023-05-10T01:21:56.394093+0000","last_became_peered":"2023-05-10T01:21:56.394093+0000","last_unstale":"2023-05-10T01:21:56.397071+0000","last_undegraded":"2023-05-10T01:21:56.397071+0000","last_fullsized":"2023-05-10T01:21:56.397071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374092+0000","last_change":"2023-05-10T01:21:55.986090+0000","last_active":"2023-05-10T01:21:56.374092+0000","last_peered":"2023-05-10T01:21:56.374092+0000","last_clean":"2023-05-10T01:21:56.374092+0000","last_became_active":"2023-05-10T01:21:55.985835+0000","last_became_peered":"2023-05-10T01:21:55.985835+0000","last_unstale":"2023-05-10T01:21:56.374092+0000","last_undegraded":"2023-05-10T01:21:56.374092+0000","last_fullsized":"2023-05-10T01:21:56.374092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.875933+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:21:50.875933+0000","last_peered":"2023-05-10T01:21:50.875933+0000","last_clean":"2023-05-10T01:21:50.875933+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:21:50.875933+0000","last_undegraded":"2023-05-10T01:21:50.875933+0000","last_fullsized":"2023-05-10T01:21:50.875933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374173+0000","last_change":"2023-05-10T01:21:55.993109+0000","last_active":"2023-05-10T01:21:56.374173+0000","last_peered":"2023-05-10T01:21:56.374173+0000","last_clean":"2023-05-10T01:21:56.374173+0000","last_became_active":"2023-05-10T01:21:55.992808+0000","last_became_peered":"2023-05-10T01:21:55.992808+0000","last_unstale":"2023-05-10T01:21:56.374173+0000","last_undegraded":"2023-05-10T01:21:56.374173+0000","last_fullsized":"2023-05-10T01:21:56.374173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372296+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:21:56.372296+0000","last_peered":"2023-05-10T01:21:56.372296+0000","last_clean":"2023-05-10T01:21:56.372296+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:21:56.372296+0000","last_undegraded":"2023-05-10T01:21:56.372296+0000","last_fullsized":"2023-05-10T01:21:56.372296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864066+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:21:52.864066+0000","last_peered":"2023-05-10T01:21:52.864066+0000","last_clean":"2023-05-10T01:21:52.864066+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:21:52.864066+0000","last_undegraded":"2023-05-10T01:21:52.864066+0000","last_fullsized":"2023-05-10T01:21:52.864066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395900+0000","last_change":"2023-05-10T01:21:56.388692+0000","last_active":"2023-05-10T01:21:56.395900+0000","last_peered":"2023-05-10T01:21:56.395900+0000","last_clean":"2023-05-10T01:21:56.395900+0000","last_became_active":"2023-05-10T01:21:56.388418+0000","last_became_peered":"2023-05-10T01:21:56.388418+0000","last_unstale":"2023-05-10T01:21:56.395900+0000","last_undegraded":"2023-05-10T01:21:56.395900+0000","last_fullsized":"2023-05-10T01:21:56.395900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390004+0000","last_change":"2023-05-10T01:21:56.386770+0000","last_active":"2023-05-10T01:21:56.390004+0000","last_peered":"2023-05-10T01:21:56.390004+0000","last_clean":"2023-05-10T01:21:56.390004+0000","last_became_active":"2023-05-10T01:21:56.386485+0000","last_became_peered":"2023-05-10T01:21:56.386485+0000","last_unstale":"2023-05-10T01:21:56.390004+0000","last_undegraded":"2023-05-10T01:21:56.390004+0000","last_fullsized":"2023-05-10T01:21:56.390004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378139+0000","last_change":"2023-05-10T01:21:55.986362+0000","last_active":"2023-05-10T01:21:56.378139+0000","last_peered":"2023-05-10T01:21:56.378139+0000","last_clean":"2023-05-10T01:21:56.378139+0000","last_became_active":"2023-05-10T01:21:55.985579+0000","last_became_peered":"2023-05-10T01:21:55.985579+0000","last_unstale":"2023-05-10T01:21:56.378139+0000","last_undegraded":"2023-05-10T01:21:56.378139+0000","last_fullsized":"2023-05-10T01:21:56.378139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.388353+0000","last_change":"2023-05-10T01:21:56.384106+0000","last_active":"2023-05-10T01:21:56.388353+0000","last_peered":"2023-05-10T01:21:56.388353+0000","last_clean":"2023-05-10T01:21:56.388353+0000","last_became_active":"2023-05-10T01:21:56.383829+0000","last_became_peered":"2023-05-10T01:21:56.383829+0000","last_unstale":"2023-05-10T01:21:56.388353+0000","last_undegraded":"2023-05-10T01:21:56.388353+0000","last_fullsized":"2023-05-10T01:21:56.388353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376460+0000","last_change":"2023-05-10T01:21:55.987209+0000","last_active":"2023-05-10T01:21:56.376460+0000","last_peered":"2023-05-10T01:21:56.376460+0000","last_clean":"2023-05-10T01:21:56.376460+0000","last_became_active":"2023-05-10T01:21:55.986888+0000","last_became_peered":"2023-05-10T01:21:55.986888+0000","last_unstale":"2023-05-10T01:21:56.376460+0000","last_undegraded":"2023-05-10T01:21:56.376460+0000","last_fullsized":"2023-05-10T01:21:56.376460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370808+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:21:56.370808+0000","last_peered":"2023-05-10T01:21:56.370808+0000","last_clean":"2023-05-10T01:21:56.370808+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:21:56.370808+0000","last_undegraded":"2023-05-10T01:21:56.370808+0000","last_fullsized":"2023-05-10T01:21:56.370808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394272+0000","last_change":"2023-05-10T01:21:56.387160+0000","last_active":"2023-05-10T01:21:56.394272+0000","last_peered":"2023-05-10T01:21:56.394272+0000","last_clean":"2023-05-10T01:21:56.394272+0000","last_became_active":"2023-05-10T01:21:56.386884+0000","last_became_peered":"2023-05-10T01:21:56.386884+0000","last_unstale":"2023-05-10T01:21:56.394272+0000","last_undegraded":"2023-05-10T01:21:56.394272+0000","last_fullsized":"2023-05-10T01:21:56.394272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375961+0000","last_change":"2023-05-10T01:21:55.983841+0000","last_active":"2023-05-10T01:21:56.375961+0000","last_peered":"2023-05-10T01:21:56.375961+0000","last_clean":"2023-05-10T01:21:56.375961+0000","last_became_active":"2023-05-10T01:21:55.983556+0000","last_became_peered":"2023-05-10T01:21:55.983556+0000","last_unstale":"2023-05-10T01:21:56.375961+0000","last_undegraded":"2023-05-10T01:21:56.375961+0000","last_fullsized":"2023-05-10T01:21:56.375961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.874982+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:21:50.874982+0000","last_peered":"2023-05-10T01:21:50.874982+0000","last_clean":"2023-05-10T01:21:50.874982+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:21:50.874982+0000","last_undegraded":"2023-05-10T01:21:50.874982+0000","last_fullsized":"2023-05-10T01:21:50.874982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":80,"acting":80,"num_store_stats":5},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16116,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355724,"statfs":{"total":96636764160,"available":96620261376,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.79000000000000004,"15min":0.89900000000000002},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.60599999999999998},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.89800000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.94899999999999995},"last":1.0740000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.59199999999999997},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.93300000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.92200000000000004},"last":1.0920000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.85899999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.871},"last":0.499}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.052},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":0.76400000000000001,"5min":0.79200000000000004,"15min":0.88200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15476,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356364,"statfs":{"total":96636764160,"available":96620916736,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.86199999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65800000000000003,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.75700000000000001,"15min":1.1160000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":1.159},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":1.321},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.85599999999999998},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15656,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94356184,"statfs":{"total":96636764160,"available":96620732416,"internally_reserved":0,"allocated":753664,"data_stored":367522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.68999999999999995,"15min":0.77800000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.55500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.46899999999999997},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47399999999999998,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.64300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":1.117},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":1.05},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":1.3839999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":1.319},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.079},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.65400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.88200000000000001,"15min":1.0960000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.501,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.96899999999999997,"15min":1.3600000000000001},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15408,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356432,"statfs":{"total":96636764160,"available":96620986368,"internally_reserved":0,"allocated":761856,"data_stored":367558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.52900000000000003,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.28599999999999998,"15min":0.254},"max":{"1min":0.63,"5min":0.64200000000000002,"15min":0.80300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.436,"15min":0.47399999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":3.8370000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.84099999999999997},"last":0.309}]},{"osd":3,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.85799999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.374},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.375},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.432},"max":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":1.224},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":1.002,"15min":1.1559999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16500,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94355340,"statfs":{"total":96636764160,"available":96619868160,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.25,"5min":0.248,"15min":0.217},"max":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.67100000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.371,"5min":0.32500000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.432}]},{"osd":1,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41099999999999998},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.40799999999999997},"min":{"1min":0.33600000000000002,"5min":0.27000000000000002,"15min":0.22},"max":{"1min":0.58799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":0.68899999999999995,"5min":0.75,"15min":0.75},"last":0.33900000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.93100000000000005},"last":1.012},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.3320000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.876},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":1.091},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.056},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23856,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94347984,"statfs":{"total":96636764160,"available":96612335616,"internally_reserved":0,"allocated":761856,"data_stored":368098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.23999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28799999999999998,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.69899999999999995,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.45700000000000002},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":4,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":0.92200000000000004,"15min":1.0349999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.0589999999999999},"last":0.622}]},{"osd":5,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.41199999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.628,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15976,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355864,"statfs":{"total":96636764160,"available":96620404736,"internally_reserved":0,"allocated":753664,"data_stored":367986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.72799999999999998,"5min":0.753,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69999999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.337}]},{"osd":1,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.92100000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.35399999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.80400000000000005,"15min":0.85999999999999999},"last":1.3839999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.73899999999999999,"15min":0.83599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.84899999999999998,"15min":0.89200000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.621,"5min":0.67900000000000005,"15min":0.88200000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47999999999999998,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.67300000000000004,"5min":0.82599999999999996,"15min":0.89400000000000002},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50600000000000001,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.81100000000000005,"15min":0.92700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.371},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0589999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19176,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352664,"statfs":{"total":96636764160,"available":96617127936,"internally_reserved":0,"allocated":753664,"data_stored":368324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.56100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.66500000000000004,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.307},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.76500000000000001},"last":0.378}]},{"osd":6,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":1.1120000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:22:00.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:22:00.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.966+0000 7f88c6262700 1 Processor -- start 2023-05-10T01:22:00.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.966+0000 7f88c6262700 1 -- start start 2023-05-10T01:22:00.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88c6262700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88c0154540 0x7f88c0069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88c6262700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c00c0650 con 0x7f88c0069b80 2023-05-10T01:22:00.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88c6262700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c0069fb0 con 0x7f88c0154160 2023-05-10T01:22:00.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88c6262700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00bfd20 con 0x7f88c0154540 2023-05-10T01:22:00.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88bffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f88c0069b80 0x7f88c00c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42646/0 (socket says 172.21.15.52:42646) 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88bffff700 1 -- 172.21.15.52:0/1411582218 learned_addr learned my addr 172.21.15.52:0/1411582218 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88beffd700 1 --2- 172.21.15.52:0/1411582218 >> v2:172.21.15.172:3300/0 conn(0x7f88c0154540 0x7f88c0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070042208 0 0) 0x7f88c00c0650 con 0x7f88c0069b80 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac0033f0 con 0x7f88c0069b80 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702041207 0 0) 0x7f88c0069fb0 con 0x7f88c0154160 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c00c0650 con 0x7f88c0154160 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88beffd700 1 -- 172.21.15.52:0/1411582218 >> v1:172.21.15.172:6789/0 conn(0x7f88c0154160 legacy=0x7f88c00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88beffd700 1 -- 172.21.15.52:0/1411582218 >> v1:172.21.15.52:6789/0 conn(0x7f88c0069b80 legacy=0x7f88c00c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.967+0000 7f88beffd700 1 -- 172.21.15.52:0/1411582218 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c0000 con 0x7f88c0154540 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88beffd700 1 --2- 172.21.15.52:0/1411582218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0154540 0x7f88c0069690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f88b4009760 tx=0x7f88b4009060).ready entity=mon.1 client_cookie=2e658e6a613c5d2d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4009120 con 0x7f88c0154540 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400d4a0 con 0x7f88c0154540 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88be7fc700 1 -- 172.21.15.52:0/1411582218 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400d820 con 0x7f88c0154540 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 -- 172.21.15.52:0/1411582218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0154540 msgr2=0x7f88c0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 --2- 172.21.15.52:0/1411582218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0154540 0x7f88c0069690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f88b4009760 tx=0x7f88b4009060).stop 2023-05-10T01:22:00.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 -- 172.21.15.52:0/1411582218 shutdown_connections 2023-05-10T01:22:00.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 --2- 172.21.15.52:0/1411582218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0154540 0x7f88c0069690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 -- 172.21.15.52:0/1411582218 >> 172.21.15.52:0/1411582218 conn(0x7f88c00cb6f0 msgr2=0x7f88c00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:00.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 -- 172.21.15.52:0/1411582218 shutdown_connections 2023-05-10T01:22:00.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.968+0000 7f88c6262700 1 -- 172.21.15.52:0/1411582218 wait complete. 2023-05-10T01:22:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 Processor -- start 2023-05-10T01:22:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 -- start start 2023-05-10T01:22:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0069b80 0x7f88c01676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88c0154160 0x7f88c0150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01539b0 con 0x7f88c0154540 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0151050 con 0x7f88c0069b80 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.970+0000 7f88c6262700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00ae660 con 0x7f88c0154160 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33636/0 (socket says 172.21.15.52:33636) 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 -- 172.21.15.52:0/2368755421 learned_addr learned my addr 172.21.15.52:0/2368755421 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bf7fe700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0069b80 0x7f88c01676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88beffd700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88c0154160 0x7f88c0150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 -- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88c0154160 msgr2=0x7f88c0150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88c0154160 0x7f88c0150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 -- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0069b80 msgr2=0x7f88c01676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0069b80 0x7f88c01676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 -- 172.21.15.52:0/2368755421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40092a0 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88bffff700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f88b8001560 tx=0x7f88b8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005d30 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8005e90 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c01536d0 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007340 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.971+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c00ae2f0 con 0x7f88c0154540 2023-05-10T01:22:00.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.972+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c00666b0 con 0x7f88c0154540 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.973+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f88b8010030 con 0x7f88c0154540 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.973+0000 7f88a77fe700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 0x7f88a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.973+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f88b8079a10 con 0x7f88c0154540 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.973+0000 7f88bf7fe700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 0x7f88a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.973+0000 7f88bf7fe700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 0x7f88a0061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f88b0007fd0 tx=0x7f88b0007bd0).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:00.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:00.977+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88b804ae60 con 0x7f88c0154540 2023-05-10T01:22:01.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.149+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c006c340 con 0x7f88a005ed90 2023-05-10T01:22:01.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.159+0000 7f88a77fe700 1 -- 172.21.15.52:0/2368755421 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357531 (secure 0 0 0) 0x7f88c006c340 con 0x7f88a005ed90 2023-05-10T01:22:01.166 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 msgr2=0x7f88a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 0x7f88a0061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f88b0007fd0 tx=0x7f88b0007bd0).stop 2023-05-10T01:22:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 msgr2=0x7f88c0150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f88b8001560 tx=0x7f88b8001650).stop 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 shutdown_connections 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f88a005ed90 0x7f88a0061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0154540 0x7f88c0150b60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c0069b80 0x7f88c01676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 --2- 172.21.15.52:0/2368755421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88c0154160 0x7f88c0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 >> 172.21.15.52:0/2368755421 conn(0x7f88c00cb6f0 msgr2=0x7f88c00a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 shutdown_connections 2023-05-10T01:22:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.163+0000 7f88c6262700 1 -- 172.21.15.52:0/2368755421 wait complete. 2023-05-10T01:22:01.170 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:22:01.177 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:21:59.733413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138164,"kb_used_data":5748,"kb_used_omap":0,"kb_used_meta":132352,"kb_avail":754836556,"statfs":{"total":773094113280,"available":772952633344,"internally_reserved":0,"allocated":5885952,"data_stored":2858603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135528448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14669473,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-715,"num_write_kb":-15223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.193368"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396349+0000","last_change":"2023-05-10T01:21:56.393474+0000","last_active":"2023-05-10T01:21:56.396349+0000","last_peered":"2023-05-10T01:21:56.396349+0000","last_clean":"2023-05-10T01:21:56.396349+0000","last_became_active":"2023-05-10T01:21:56.393150+0000","last_became_peered":"2023-05-10T01:21:56.393150+0000","last_unstale":"2023-05-10T01:21:56.396349+0000","last_undegraded":"2023-05-10T01:21:56.396349+0000","last_fullsized":"2023-05-10T01:21:56.396349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372259+0000","last_change":"2023-05-10T01:21:55.995244+0000","last_active":"2023-05-10T01:21:56.372259+0000","last_peered":"2023-05-10T01:21:56.372259+0000","last_clean":"2023-05-10T01:21:56.372259+0000","last_became_active":"2023-05-10T01:21:55.994967+0000","last_became_peered":"2023-05-10T01:21:55.994967+0000","last_unstale":"2023-05-10T01:21:56.372259+0000","last_undegraded":"2023-05-10T01:21:56.372259+0000","last_fullsized":"2023-05-10T01:21:56.372259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393590+0000","last_change":"2023-05-10T01:21:56.387460+0000","last_active":"2023-05-10T01:21:56.393590+0000","last_peered":"2023-05-10T01:21:56.393590+0000","last_clean":"2023-05-10T01:21:56.393590+0000","last_became_active":"2023-05-10T01:21:56.387168+0000","last_became_peered":"2023-05-10T01:21:56.387168+0000","last_unstale":"2023-05-10T01:21:56.393590+0000","last_undegraded":"2023-05-10T01:21:56.393590+0000","last_fullsized":"2023-05-10T01:21:56.393590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375395+0000","last_change":"2023-05-10T01:21:55.981476+0000","last_active":"2023-05-10T01:21:56.375395+0000","last_peered":"2023-05-10T01:21:56.375395+0000","last_clean":"2023-05-10T01:21:56.375395+0000","last_became_active":"2023-05-10T01:21:55.981022+0000","last_became_peered":"2023-05-10T01:21:55.981022+0000","last_unstale":"2023-05-10T01:21:56.375395+0000","last_undegraded":"2023-05-10T01:21:56.375395+0000","last_fullsized":"2023-05-10T01:21:56.375395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396467+0000","last_change":"2023-05-10T01:21:56.393248+0000","last_active":"2023-05-10T01:21:56.396467+0000","last_peered":"2023-05-10T01:21:56.396467+0000","last_clean":"2023-05-10T01:21:56.396467+0000","last_became_active":"2023-05-10T01:21:56.392940+0000","last_became_peered":"2023-05-10T01:21:56.392940+0000","last_unstale":"2023-05-10T01:21:56.396467+0000","last_undegraded":"2023-05-10T01:21:56.396467+0000","last_fullsized":"2023-05-10T01:21:56.396467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394545+0000","last_change":"2023-05-10T01:21:55.989682+0000","last_active":"2023-05-10T01:21:56.394545+0000","last_peered":"2023-05-10T01:21:56.394545+0000","last_clean":"2023-05-10T01:21:56.394545+0000","last_became_active":"2023-05-10T01:21:55.989221+0000","last_became_peered":"2023-05-10T01:21:55.989221+0000","last_unstale":"2023-05-10T01:21:56.394545+0000","last_undegraded":"2023-05-10T01:21:56.394545+0000","last_fullsized":"2023-05-10T01:21:56.394545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398309+0000","last_change":"2023-05-10T01:21:56.396249+0000","last_active":"2023-05-10T01:21:56.398309+0000","last_peered":"2023-05-10T01:21:56.398309+0000","last_clean":"2023-05-10T01:21:56.398309+0000","last_became_active":"2023-05-10T01:21:56.395946+0000","last_became_peered":"2023-05-10T01:21:56.395946+0000","last_unstale":"2023-05-10T01:21:56.398309+0000","last_undegraded":"2023-05-10T01:21:56.398309+0000","last_fullsized":"2023-05-10T01:21:56.398309+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383417+0000","last_change":"2023-05-10T01:21:55.989419+0000","last_active":"2023-05-10T01:21:56.383417+0000","last_peered":"2023-05-10T01:21:56.383417+0000","last_clean":"2023-05-10T01:21:56.383417+0000","last_became_active":"2023-05-10T01:21:55.989168+0000","last_became_peered":"2023-05-10T01:21:55.989168+0000","last_unstale":"2023-05-10T01:21:56.383417+0000","last_undegraded":"2023-05-10T01:21:56.383417+0000","last_fullsized":"2023-05-10T01:21:56.383417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394435+0000","last_change":"2023-05-10T01:21:55.987682+0000","last_active":"2023-05-10T01:21:56.394435+0000","last_peered":"2023-05-10T01:21:56.394435+0000","last_clean":"2023-05-10T01:21:56.394435+0000","last_became_active":"2023-05-10T01:21:55.987380+0000","last_became_peered":"2023-05-10T01:21:55.987380+0000","last_unstale":"2023-05-10T01:21:56.394435+0000","last_undegraded":"2023-05-10T01:21:56.394435+0000","last_fullsized":"2023-05-10T01:21:56.394435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396200+0000","last_change":"2023-05-10T01:21:56.392983+0000","last_active":"2023-05-10T01:21:56.396200+0000","last_peered":"2023-05-10T01:21:56.396200+0000","last_clean":"2023-05-10T01:21:56.396200+0000","last_became_active":"2023-05-10T01:21:56.392726+0000","last_became_peered":"2023-05-10T01:21:56.392726+0000","last_unstale":"2023-05-10T01:21:56.396200+0000","last_undegraded":"2023-05-10T01:21:56.396200+0000","last_fullsized":"2023-05-10T01:21:56.396200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384785+0000","last_change":"2023-05-10T01:21:56.381538+0000","last_active":"2023-05-10T01:21:56.384785+0000","last_peered":"2023-05-10T01:21:56.384785+0000","last_clean":"2023-05-10T01:21:56.384785+0000","last_became_active":"2023-05-10T01:21:56.381059+0000","last_became_peered":"2023-05-10T01:21:56.381059+0000","last_unstale":"2023-05-10T01:21:56.384785+0000","last_undegraded":"2023-05-10T01:21:56.384785+0000","last_fullsized":"2023-05-10T01:21:56.384785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373368+0000","last_change":"2023-05-10T01:21:55.992753+0000","last_active":"2023-05-10T01:21:56.373368+0000","last_peered":"2023-05-10T01:21:56.373368+0000","last_clean":"2023-05-10T01:21:56.373368+0000","last_became_active":"2023-05-10T01:21:55.989112+0000","last_became_peered":"2023-05-10T01:21:55.989112+0000","last_unstale":"2023-05-10T01:21:56.373368+0000","last_undegraded":"2023-05-10T01:21:56.373368+0000","last_fullsized":"2023-05-10T01:21:56.373368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.389535+0000","last_change":"2023-05-10T01:21:56.385875+0000","last_active":"2023-05-10T01:21:56.389535+0000","last_peered":"2023-05-10T01:21:56.389535+0000","last_clean":"2023-05-10T01:21:56.389535+0000","last_became_active":"2023-05-10T01:21:56.385559+0000","last_became_peered":"2023-05-10T01:21:56.385559+0000","last_unstale":"2023-05-10T01:21:56.389535+0000","last_undegraded":"2023-05-10T01:21:56.389535+0000","last_fullsized":"2023-05-10T01:21:56.389535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374945+0000","last_change":"2023-05-10T01:21:55.995994+0000","last_active":"2023-05-10T01:21:56.374945+0000","last_peered":"2023-05-10T01:21:56.374945+0000","last_clean":"2023-05-10T01:21:56.374945+0000","last_became_active":"2023-05-10T01:21:55.995612+0000","last_became_peered":"2023-05-10T01:21:55.995612+0000","last_unstale":"2023-05-10T01:21:56.374945+0000","last_undegraded":"2023-05-10T01:21:56.374945+0000","last_fullsized":"2023-05-10T01:21:56.374945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397620+0000","last_change":"2023-05-10T01:21:56.393150+0000","last_active":"2023-05-10T01:21:56.397620+0000","last_peered":"2023-05-10T01:21:56.397620+0000","last_clean":"2023-05-10T01:21:56.397620+0000","last_became_active":"2023-05-10T01:21:56.392864+0000","last_became_peered":"2023-05-10T01:21:56.392864+0000","last_unstale":"2023-05-10T01:21:56.397620+0000","last_undegraded":"2023-05-10T01:21:56.397620+0000","last_fullsized":"2023-05-10T01:21:56.397620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374362+0000","last_change":"2023-05-10T01:21:55.989756+0000","last_active":"2023-05-10T01:21:56.374362+0000","last_peered":"2023-05-10T01:21:56.374362+0000","last_clean":"2023-05-10T01:21:56.374362+0000","last_became_active":"2023-05-10T01:21:55.989216+0000","last_became_peered":"2023-05-10T01:21:55.989216+0000","last_unstale":"2023-05-10T01:21:56.374362+0000","last_undegraded":"2023-05-10T01:21:56.374362+0000","last_fullsized":"2023-05-10T01:21:56.374362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385955+0000","last_change":"2023-05-10T01:21:56.379300+0000","last_active":"2023-05-10T01:21:56.385955+0000","last_peered":"2023-05-10T01:21:56.385955+0000","last_clean":"2023-05-10T01:21:56.385955+0000","last_became_active":"2023-05-10T01:21:56.378969+0000","last_became_peered":"2023-05-10T01:21:56.378969+0000","last_unstale":"2023-05-10T01:21:56.385955+0000","last_undegraded":"2023-05-10T01:21:56.385955+0000","last_fullsized":"2023-05-10T01:21:56.385955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376325+0000","last_change":"2023-05-10T01:21:55.996558+0000","last_active":"2023-05-10T01:21:56.376325+0000","last_peered":"2023-05-10T01:21:56.376325+0000","last_clean":"2023-05-10T01:21:56.376325+0000","last_became_active":"2023-05-10T01:21:55.996094+0000","last_became_peered":"2023-05-10T01:21:55.996094+0000","last_unstale":"2023-05-10T01:21:56.376325+0000","last_undegraded":"2023-05-10T01:21:56.376325+0000","last_fullsized":"2023-05-10T01:21:56.376325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393472+0000","last_change":"2023-05-10T01:21:56.389655+0000","last_active":"2023-05-10T01:21:56.393472+0000","last_peered":"2023-05-10T01:21:56.393472+0000","last_clean":"2023-05-10T01:21:56.393472+0000","last_became_active":"2023-05-10T01:21:56.389185+0000","last_became_peered":"2023-05-10T01:21:56.389185+0000","last_unstale":"2023-05-10T01:21:56.393472+0000","last_undegraded":"2023-05-10T01:21:56.393472+0000","last_fullsized":"2023-05-10T01:21:56.393472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397557+0000","last_change":"2023-05-10T01:21:55.990841+0000","last_active":"2023-05-10T01:21:56.397557+0000","last_peered":"2023-05-10T01:21:56.397557+0000","last_clean":"2023-05-10T01:21:56.397557+0000","last_became_active":"2023-05-10T01:21:55.990576+0000","last_became_peered":"2023-05-10T01:21:55.990576+0000","last_unstale":"2023-05-10T01:21:56.397557+0000","last_undegraded":"2023-05-10T01:21:56.397557+0000","last_fullsized":"2023-05-10T01:21:56.397557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393891+0000","last_change":"2023-05-10T01:21:56.387347+0000","last_active":"2023-05-10T01:21:56.393891+0000","last_peered":"2023-05-10T01:21:56.393891+0000","last_clean":"2023-05-10T01:21:56.393891+0000","last_became_active":"2023-05-10T01:21:56.386716+0000","last_became_peered":"2023-05-10T01:21:56.386716+0000","last_unstale":"2023-05-10T01:21:56.393891+0000","last_undegraded":"2023-05-10T01:21:56.393891+0000","last_fullsized":"2023-05-10T01:21:56.393891+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376282+0000","last_change":"2023-05-10T01:21:55.996347+0000","last_active":"2023-05-10T01:21:56.376282+0000","last_peered":"2023-05-10T01:21:56.376282+0000","last_clean":"2023-05-10T01:21:56.376282+0000","last_became_active":"2023-05-10T01:21:55.996084+0000","last_became_peered":"2023-05-10T01:21:55.996084+0000","last_unstale":"2023-05-10T01:21:56.376282+0000","last_undegraded":"2023-05-10T01:21:56.376282+0000","last_fullsized":"2023-05-10T01:21:56.376282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373429+0000","last_change":"2023-05-10T01:21:55.984869+0000","last_active":"2023-05-10T01:21:56.373429+0000","last_peered":"2023-05-10T01:21:56.373429+0000","last_clean":"2023-05-10T01:21:56.373429+0000","last_became_active":"2023-05-10T01:21:55.984587+0000","last_became_peered":"2023-05-10T01:21:55.984587+0000","last_unstale":"2023-05-10T01:21:56.373429+0000","last_undegraded":"2023-05-10T01:21:56.373429+0000","last_fullsized":"2023-05-10T01:21:56.373429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394933+0000","last_change":"2023-05-10T01:21:56.385313+0000","last_active":"2023-05-10T01:21:56.394933+0000","last_peered":"2023-05-10T01:21:56.394933+0000","last_clean":"2023-05-10T01:21:56.394933+0000","last_became_active":"2023-05-10T01:21:56.382048+0000","last_became_peered":"2023-05-10T01:21:56.382048+0000","last_unstale":"2023-05-10T01:21:56.394933+0000","last_undegraded":"2023-05-10T01:21:56.394933+0000","last_fullsized":"2023-05-10T01:21:56.394933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394431+0000","last_change":"2023-05-10T01:21:56.389754+0000","last_active":"2023-05-10T01:21:56.394431+0000","last_peered":"2023-05-10T01:21:56.394431+0000","last_clean":"2023-05-10T01:21:56.394431+0000","last_became_active":"2023-05-10T01:21:56.389230+0000","last_became_peered":"2023-05-10T01:21:56.389230+0000","last_unstale":"2023-05-10T01:21:56.394431+0000","last_undegraded":"2023-05-10T01:21:56.394431+0000","last_fullsized":"2023-05-10T01:21:56.394431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375951+0000","last_change":"2023-05-10T01:21:55.977210+0000","last_active":"2023-05-10T01:21:56.375951+0000","last_peered":"2023-05-10T01:21:56.375951+0000","last_clean":"2023-05-10T01:21:56.375951+0000","last_became_active":"2023-05-10T01:21:55.976395+0000","last_became_peered":"2023-05-10T01:21:55.976395+0000","last_unstale":"2023-05-10T01:21:56.375951+0000","last_undegraded":"2023-05-10T01:21:56.375951+0000","last_fullsized":"2023-05-10T01:21:56.375951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398378+0000","last_change":"2023-05-10T01:21:56.396010+0000","last_active":"2023-05-10T01:21:56.398378+0000","last_peered":"2023-05-10T01:21:56.398378+0000","last_clean":"2023-05-10T01:21:56.398378+0000","last_became_active":"2023-05-10T01:21:56.395742+0000","last_became_peered":"2023-05-10T01:21:56.395742+0000","last_unstale":"2023-05-10T01:21:56.398378+0000","last_undegraded":"2023-05-10T01:21:56.398378+0000","last_fullsized":"2023-05-10T01:21:56.398378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377562+0000","last_change":"2023-05-10T01:21:55.985998+0000","last_active":"2023-05-10T01:21:56.377562+0000","last_peered":"2023-05-10T01:21:56.377562+0000","last_clean":"2023-05-10T01:21:56.377562+0000","last_became_active":"2023-05-10T01:21:55.985747+0000","last_became_peered":"2023-05-10T01:21:55.985747+0000","last_unstale":"2023-05-10T01:21:56.377562+0000","last_undegraded":"2023-05-10T01:21:56.377562+0000","last_fullsized":"2023-05-10T01:21:56.377562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398490+0000","last_change":"2023-05-10T01:21:56.395020+0000","last_active":"2023-05-10T01:21:56.398490+0000","last_peered":"2023-05-10T01:21:56.398490+0000","last_clean":"2023-05-10T01:21:56.398490+0000","last_became_active":"2023-05-10T01:21:56.394720+0000","last_became_peered":"2023-05-10T01:21:56.394720+0000","last_unstale":"2023-05-10T01:21:56.398490+0000","last_undegraded":"2023-05-10T01:21:56.398490+0000","last_fullsized":"2023-05-10T01:21:56.398490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396357+0000","last_change":"2023-05-10T01:21:55.983679+0000","last_active":"2023-05-10T01:21:56.396357+0000","last_peered":"2023-05-10T01:21:56.396357+0000","last_clean":"2023-05-10T01:21:56.396357+0000","last_became_active":"2023-05-10T01:21:55.983331+0000","last_became_peered":"2023-05-10T01:21:55.983331+0000","last_unstale":"2023-05-10T01:21:56.396357+0000","last_undegraded":"2023-05-10T01:21:56.396357+0000","last_fullsized":"2023-05-10T01:21:56.396357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387810+0000","last_change":"2023-05-10T01:21:56.382093+0000","last_active":"2023-05-10T01:21:56.387810+0000","last_peered":"2023-05-10T01:21:56.387810+0000","last_clean":"2023-05-10T01:21:56.387810+0000","last_became_active":"2023-05-10T01:21:56.381808+0000","last_became_peered":"2023-05-10T01:21:56.381808+0000","last_unstale":"2023-05-10T01:21:56.387810+0000","last_undegraded":"2023-05-10T01:21:56.387810+0000","last_fullsized":"2023-05-10T01:21:56.387810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376180+0000","last_change":"2023-05-10T01:21:55.985464+0000","last_active":"2023-05-10T01:21:56.376180+0000","last_peered":"2023-05-10T01:21:56.376180+0000","last_clean":"2023-05-10T01:21:56.376180+0000","last_became_active":"2023-05-10T01:21:55.984713+0000","last_became_peered":"2023-05-10T01:21:55.984713+0000","last_unstale":"2023-05-10T01:21:56.376180+0000","last_undegraded":"2023-05-10T01:21:56.376180+0000","last_fullsized":"2023-05-10T01:21:56.376180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390050+0000","last_change":"2023-05-10T01:21:56.388436+0000","last_active":"2023-05-10T01:21:56.390050+0000","last_peered":"2023-05-10T01:21:56.390050+0000","last_clean":"2023-05-10T01:21:56.390050+0000","last_became_active":"2023-05-10T01:21:56.387905+0000","last_became_peered":"2023-05-10T01:21:56.387905+0000","last_unstale":"2023-05-10T01:21:56.390050+0000","last_undegraded":"2023-05-10T01:21:56.390050+0000","last_fullsized":"2023-05-10T01:21:56.390050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390425+0000","last_change":"2023-05-10T01:21:56.384117+0000","last_active":"2023-05-10T01:21:56.390425+0000","last_peered":"2023-05-10T01:21:56.390425+0000","last_clean":"2023-05-10T01:21:56.390425+0000","last_became_active":"2023-05-10T01:21:56.383746+0000","last_became_peered":"2023-05-10T01:21:56.383746+0000","last_unstale":"2023-05-10T01:21:56.390425+0000","last_undegraded":"2023-05-10T01:21:56.390425+0000","last_fullsized":"2023-05-10T01:21:56.390425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390861+0000","last_change":"2023-05-10T01:21:56.384951+0000","last_active":"2023-05-10T01:21:56.390861+0000","last_peered":"2023-05-10T01:21:56.390861+0000","last_clean":"2023-05-10T01:21:56.390861+0000","last_became_active":"2023-05-10T01:21:56.384677+0000","last_became_peered":"2023-05-10T01:21:56.384677+0000","last_unstale":"2023-05-10T01:21:56.390861+0000","last_undegraded":"2023-05-10T01:21:56.390861+0000","last_fullsized":"2023-05-10T01:21:56.390861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383820+0000","last_change":"2023-05-10T01:21:56.381131+0000","last_active":"2023-05-10T01:21:56.383820+0000","last_peered":"2023-05-10T01:21:56.383820+0000","last_clean":"2023-05-10T01:21:56.383820+0000","last_became_active":"2023-05-10T01:21:56.380922+0000","last_became_peered":"2023-05-10T01:21:56.380922+0000","last_unstale":"2023-05-10T01:21:56.383820+0000","last_undegraded":"2023-05-10T01:21:56.383820+0000","last_fullsized":"2023-05-10T01:21:56.383820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375476+0000","last_change":"2023-05-10T01:21:55.981305+0000","last_active":"2023-05-10T01:21:56.375476+0000","last_peered":"2023-05-10T01:21:56.375476+0000","last_clean":"2023-05-10T01:21:56.375476+0000","last_became_active":"2023-05-10T01:21:55.980073+0000","last_became_peered":"2023-05-10T01:21:55.980073+0000","last_unstale":"2023-05-10T01:21:56.375476+0000","last_undegraded":"2023-05-10T01:21:56.375476+0000","last_fullsized":"2023-05-10T01:21:56.375476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372965+0000","last_change":"2023-05-10T01:21:55.990808+0000","last_active":"2023-05-10T01:21:56.372965+0000","last_peered":"2023-05-10T01:21:56.372965+0000","last_clean":"2023-05-10T01:21:56.372965+0000","last_became_active":"2023-05-10T01:21:55.990499+0000","last_became_peered":"2023-05-10T01:21:55.990499+0000","last_unstale":"2023-05-10T01:21:56.372965+0000","last_undegraded":"2023-05-10T01:21:56.372965+0000","last_fullsized":"2023-05-10T01:21:56.372965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393912+0000","last_change":"2023-05-10T01:21:56.391042+0000","last_active":"2023-05-10T01:21:56.393912+0000","last_peered":"2023-05-10T01:21:56.393912+0000","last_clean":"2023-05-10T01:21:56.393912+0000","last_became_active":"2023-05-10T01:21:56.389952+0000","last_became_peered":"2023-05-10T01:21:56.389952+0000","last_unstale":"2023-05-10T01:21:56.393912+0000","last_undegraded":"2023-05-10T01:21:56.393912+0000","last_fullsized":"2023-05-10T01:21:56.393912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375539+0000","last_change":"2023-05-10T01:21:55.983291+0000","last_active":"2023-05-10T01:21:56.375539+0000","last_peered":"2023-05-10T01:21:56.375539+0000","last_clean":"2023-05-10T01:21:56.375539+0000","last_became_active":"2023-05-10T01:21:55.983015+0000","last_became_peered":"2023-05-10T01:21:55.983015+0000","last_unstale":"2023-05-10T01:21:56.375539+0000","last_undegraded":"2023-05-10T01:21:56.375539+0000","last_fullsized":"2023-05-10T01:21:56.375539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373208+0000","last_change":"2023-05-10T01:21:55.983553+0000","last_active":"2023-05-10T01:21:56.373208+0000","last_peered":"2023-05-10T01:21:56.373208+0000","last_clean":"2023-05-10T01:21:56.373208+0000","last_became_active":"2023-05-10T01:21:55.983243+0000","last_became_peered":"2023-05-10T01:21:55.983243+0000","last_unstale":"2023-05-10T01:21:56.373208+0000","last_undegraded":"2023-05-10T01:21:56.373208+0000","last_fullsized":"2023-05-10T01:21:56.373208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395257+0000","last_change":"2023-05-10T01:21:56.390161+0000","last_active":"2023-05-10T01:21:56.395257+0000","last_peered":"2023-05-10T01:21:56.395257+0000","last_clean":"2023-05-10T01:21:56.395257+0000","last_became_active":"2023-05-10T01:21:56.389337+0000","last_became_peered":"2023-05-10T01:21:56.389337+0000","last_unstale":"2023-05-10T01:21:56.395257+0000","last_undegraded":"2023-05-10T01:21:56.395257+0000","last_fullsized":"2023-05-10T01:21:56.395257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393462+0000","last_change":"2023-05-10T01:21:56.383749+0000","last_active":"2023-05-10T01:21:56.393462+0000","last_peered":"2023-05-10T01:21:56.393462+0000","last_clean":"2023-05-10T01:21:56.393462+0000","last_became_active":"2023-05-10T01:21:56.382989+0000","last_became_peered":"2023-05-10T01:21:56.382989+0000","last_unstale":"2023-05-10T01:21:56.393462+0000","last_undegraded":"2023-05-10T01:21:56.393462+0000","last_fullsized":"2023-05-10T01:21:56.393462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386928+0000","last_change":"2023-05-10T01:21:55.988303+0000","last_active":"2023-05-10T01:21:56.386928+0000","last_peered":"2023-05-10T01:21:56.386928+0000","last_clean":"2023-05-10T01:21:56.386928+0000","last_became_active":"2023-05-10T01:21:55.987986+0000","last_became_peered":"2023-05-10T01:21:55.987986+0000","last_unstale":"2023-05-10T01:21:56.386928+0000","last_undegraded":"2023-05-10T01:21:56.386928+0000","last_fullsized":"2023-05-10T01:21:56.386928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395972+0000","last_change":"2023-05-10T01:21:55.979791+0000","last_active":"2023-05-10T01:21:56.395972+0000","last_peered":"2023-05-10T01:21:56.395972+0000","last_clean":"2023-05-10T01:21:56.395972+0000","last_became_active":"2023-05-10T01:21:55.978489+0000","last_became_peered":"2023-05-10T01:21:55.978489+0000","last_unstale":"2023-05-10T01:21:56.395972+0000","last_undegraded":"2023-05-10T01:21:56.395972+0000","last_fullsized":"2023-05-10T01:21:56.395972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390030+0000","last_change":"2023-05-10T01:21:56.386816+0000","last_active":"2023-05-10T01:21:56.390030+0000","last_peered":"2023-05-10T01:21:56.390030+0000","last_clean":"2023-05-10T01:21:56.390030+0000","last_became_active":"2023-05-10T01:21:56.386546+0000","last_became_peered":"2023-05-10T01:21:56.386546+0000","last_unstale":"2023-05-10T01:21:56.390030+0000","last_undegraded":"2023-05-10T01:21:56.390030+0000","last_fullsized":"2023-05-10T01:21:56.390030+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373089+0000","last_change":"2023-05-10T01:21:55.988218+0000","last_active":"2023-05-10T01:21:56.373089+0000","last_peered":"2023-05-10T01:21:56.373089+0000","last_clean":"2023-05-10T01:21:56.373089+0000","last_became_active":"2023-05-10T01:21:55.987936+0000","last_became_peered":"2023-05-10T01:21:55.987936+0000","last_unstale":"2023-05-10T01:21:56.373089+0000","last_undegraded":"2023-05-10T01:21:56.373089+0000","last_fullsized":"2023-05-10T01:21:56.373089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396213+0000","last_change":"2023-05-10T01:21:56.393981+0000","last_active":"2023-05-10T01:21:56.396213+0000","last_peered":"2023-05-10T01:21:56.396213+0000","last_clean":"2023-05-10T01:21:56.396213+0000","last_became_active":"2023-05-10T01:21:56.393672+0000","last_became_peered":"2023-05-10T01:21:56.393672+0000","last_unstale":"2023-05-10T01:21:56.396213+0000","last_undegraded":"2023-05-10T01:21:56.396213+0000","last_fullsized":"2023-05-10T01:21:56.396213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374941+0000","last_change":"2023-05-10T01:21:55.982605+0000","last_active":"2023-05-10T01:21:56.374941+0000","last_peered":"2023-05-10T01:21:56.374941+0000","last_clean":"2023-05-10T01:21:56.374941+0000","last_became_active":"2023-05-10T01:21:55.981073+0000","last_became_peered":"2023-05-10T01:21:55.981073+0000","last_unstale":"2023-05-10T01:21:56.374941+0000","last_undegraded":"2023-05-10T01:21:56.374941+0000","last_fullsized":"2023-05-10T01:21:56.374941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375642+0000","last_change":"2023-05-10T01:21:55.978009+0000","last_active":"2023-05-10T01:21:56.375642+0000","last_peered":"2023-05-10T01:21:56.375642+0000","last_clean":"2023-05-10T01:21:56.375642+0000","last_became_active":"2023-05-10T01:21:55.977745+0000","last_became_peered":"2023-05-10T01:21:55.977745+0000","last_unstale":"2023-05-10T01:21:56.375642+0000","last_undegraded":"2023-05-10T01:21:56.375642+0000","last_fullsized":"2023-05-10T01:21:56.375642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390033+0000","last_change":"2023-05-10T01:21:56.387952+0000","last_active":"2023-05-10T01:21:56.390033+0000","last_peered":"2023-05-10T01:21:56.390033+0000","last_clean":"2023-05-10T01:21:56.390033+0000","last_became_active":"2023-05-10T01:21:56.387673+0000","last_became_peered":"2023-05-10T01:21:56.387673+0000","last_unstale":"2023-05-10T01:21:56.390033+0000","last_undegraded":"2023-05-10T01:21:56.390033+0000","last_fullsized":"2023-05-10T01:21:56.390033+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373474+0000","last_change":"2023-05-10T01:21:55.989894+0000","last_active":"2023-05-10T01:21:56.373474+0000","last_peered":"2023-05-10T01:21:56.373474+0000","last_clean":"2023-05-10T01:21:56.373474+0000","last_became_active":"2023-05-10T01:21:55.989151+0000","last_became_peered":"2023-05-10T01:21:55.989151+0000","last_unstale":"2023-05-10T01:21:56.373474+0000","last_undegraded":"2023-05-10T01:21:56.373474+0000","last_fullsized":"2023-05-10T01:21:56.373474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401225+0000","last_change":"2023-05-10T01:21:56.397647+0000","last_active":"2023-05-10T01:21:56.401225+0000","last_peered":"2023-05-10T01:21:56.401225+0000","last_clean":"2023-05-10T01:21:56.401225+0000","last_became_active":"2023-05-10T01:21:56.397366+0000","last_became_peered":"2023-05-10T01:21:56.397366+0000","last_unstale":"2023-05-10T01:21:56.401225+0000","last_undegraded":"2023-05-10T01:21:56.401225+0000","last_fullsized":"2023-05-10T01:21:56.401225+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394756+0000","last_change":"2023-05-10T01:21:56.387217+0000","last_active":"2023-05-10T01:21:56.394756+0000","last_peered":"2023-05-10T01:21:56.394756+0000","last_clean":"2023-05-10T01:21:56.394756+0000","last_became_active":"2023-05-10T01:21:56.386938+0000","last_became_peered":"2023-05-10T01:21:56.386938+0000","last_unstale":"2023-05-10T01:21:56.394756+0000","last_undegraded":"2023-05-10T01:21:56.394756+0000","last_fullsized":"2023-05-10T01:21:56.394756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377710+0000","last_change":"2023-05-10T01:21:55.986297+0000","last_active":"2023-05-10T01:21:56.377710+0000","last_peered":"2023-05-10T01:21:56.377710+0000","last_clean":"2023-05-10T01:21:56.377710+0000","last_became_active":"2023-05-10T01:21:55.985992+0000","last_became_peered":"2023-05-10T01:21:55.985992+0000","last_unstale":"2023-05-10T01:21:56.377710+0000","last_undegraded":"2023-05-10T01:21:56.377710+0000","last_fullsized":"2023-05-10T01:21:56.377710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398235+0000","last_change":"2023-05-10T01:21:56.394951+0000","last_active":"2023-05-10T01:21:56.398235+0000","last_peered":"2023-05-10T01:21:56.398235+0000","last_clean":"2023-05-10T01:21:56.398235+0000","last_became_active":"2023-05-10T01:21:56.394686+0000","last_became_peered":"2023-05-10T01:21:56.394686+0000","last_unstale":"2023-05-10T01:21:56.398235+0000","last_undegraded":"2023-05-10T01:21:56.398235+0000","last_fullsized":"2023-05-10T01:21:56.398235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393450+0000","last_change":"2023-05-10T01:21:56.389449+0000","last_active":"2023-05-10T01:21:56.393450+0000","last_peered":"2023-05-10T01:21:56.393450+0000","last_clean":"2023-05-10T01:21:56.393450+0000","last_became_active":"2023-05-10T01:21:56.388600+0000","last_became_peered":"2023-05-10T01:21:56.388600+0000","last_unstale":"2023-05-10T01:21:56.393450+0000","last_undegraded":"2023-05-10T01:21:56.393450+0000","last_fullsized":"2023-05-10T01:21:56.393450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394810+0000","last_change":"2023-05-10T01:21:55.986935+0000","last_active":"2023-05-10T01:21:56.394810+0000","last_peered":"2023-05-10T01:21:56.394810+0000","last_clean":"2023-05-10T01:21:56.394810+0000","last_became_active":"2023-05-10T01:21:55.986618+0000","last_became_peered":"2023-05-10T01:21:55.986618+0000","last_unstale":"2023-05-10T01:21:56.394810+0000","last_undegraded":"2023-05-10T01:21:56.394810+0000","last_fullsized":"2023-05-10T01:21:56.394810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395310+0000","last_change":"2023-05-10T01:21:56.385256+0000","last_active":"2023-05-10T01:21:56.395310+0000","last_peered":"2023-05-10T01:21:56.395310+0000","last_clean":"2023-05-10T01:21:56.395310+0000","last_became_active":"2023-05-10T01:21:56.384982+0000","last_became_peered":"2023-05-10T01:21:56.384982+0000","last_unstale":"2023-05-10T01:21:56.395310+0000","last_undegraded":"2023-05-10T01:21:56.395310+0000","last_fullsized":"2023-05-10T01:21:56.395310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387897+0000","last_change":"2023-05-10T01:21:55.988593+0000","last_active":"2023-05-10T01:21:56.387897+0000","last_peered":"2023-05-10T01:21:56.387897+0000","last_clean":"2023-05-10T01:21:56.387897+0000","last_became_active":"2023-05-10T01:21:55.986001+0000","last_became_peered":"2023-05-10T01:21:55.986001+0000","last_unstale":"2023-05-10T01:21:56.387897+0000","last_undegraded":"2023-05-10T01:21:56.387897+0000","last_fullsized":"2023-05-10T01:21:56.387897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390764+0000","last_change":"2023-05-10T01:21:56.384859+0000","last_active":"2023-05-10T01:21:56.390764+0000","last_peered":"2023-05-10T01:21:56.390764+0000","last_clean":"2023-05-10T01:21:56.390764+0000","last_became_active":"2023-05-10T01:21:56.384456+0000","last_became_peered":"2023-05-10T01:21:56.384456+0000","last_unstale":"2023-05-10T01:21:56.390764+0000","last_undegraded":"2023-05-10T01:21:56.390764+0000","last_fullsized":"2023-05-10T01:21:56.390764+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394649+0000","last_change":"2023-05-10T01:21:56.388984+0000","last_active":"2023-05-10T01:21:56.394649+0000","last_peered":"2023-05-10T01:21:56.394649+0000","last_clean":"2023-05-10T01:21:56.394649+0000","last_became_active":"2023-05-10T01:21:56.388706+0000","last_became_peered":"2023-05-10T01:21:56.388706+0000","last_unstale":"2023-05-10T01:21:56.394649+0000","last_undegraded":"2023-05-10T01:21:56.394649+0000","last_fullsized":"2023-05-10T01:21:56.394649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395277+0000","last_change":"2023-05-10T01:21:56.390549+0000","last_active":"2023-05-10T01:21:56.395277+0000","last_peered":"2023-05-10T01:21:56.395277+0000","last_clean":"2023-05-10T01:21:56.395277+0000","last_became_active":"2023-05-10T01:21:56.389725+0000","last_became_peered":"2023-05-10T01:21:56.389725+0000","last_unstale":"2023-05-10T01:21:56.395277+0000","last_undegraded":"2023-05-10T01:21:56.395277+0000","last_fullsized":"2023-05-10T01:21:56.395277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397441+0000","last_change":"2023-05-10T01:21:55.985996+0000","last_active":"2023-05-10T01:21:56.397441+0000","last_peered":"2023-05-10T01:21:56.397441+0000","last_clean":"2023-05-10T01:21:56.397441+0000","last_became_active":"2023-05-10T01:21:55.985693+0000","last_became_peered":"2023-05-10T01:21:55.985693+0000","last_unstale":"2023-05-10T01:21:56.397441+0000","last_undegraded":"2023-05-10T01:21:56.397441+0000","last_fullsized":"2023-05-10T01:21:56.397441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390084+0000","last_change":"2023-05-10T01:21:56.387575+0000","last_active":"2023-05-10T01:21:56.390084+0000","last_peered":"2023-05-10T01:21:56.390084+0000","last_clean":"2023-05-10T01:21:56.390084+0000","last_became_active":"2023-05-10T01:21:56.387380+0000","last_became_peered":"2023-05-10T01:21:56.387380+0000","last_unstale":"2023-05-10T01:21:56.390084+0000","last_undegraded":"2023-05-10T01:21:56.390084+0000","last_fullsized":"2023-05-10T01:21:56.390084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384279+0000","last_change":"2023-05-10T01:21:55.994254+0000","last_active":"2023-05-10T01:21:56.384279+0000","last_peered":"2023-05-10T01:21:56.384279+0000","last_clean":"2023-05-10T01:21:56.384279+0000","last_became_active":"2023-05-10T01:21:55.993796+0000","last_became_peered":"2023-05-10T01:21:55.993796+0000","last_unstale":"2023-05-10T01:21:56.384279+0000","last_undegraded":"2023-05-10T01:21:56.384279+0000","last_fullsized":"2023-05-10T01:21:56.384279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395063+0000","last_change":"2023-05-10T01:21:56.385556+0000","last_active":"2023-05-10T01:21:56.395063+0000","last_peered":"2023-05-10T01:21:56.395063+0000","last_clean":"2023-05-10T01:21:56.395063+0000","last_became_active":"2023-05-10T01:21:56.381923+0000","last_became_peered":"2023-05-10T01:21:56.381923+0000","last_unstale":"2023-05-10T01:21:56.395063+0000","last_undegraded":"2023-05-10T01:21:56.395063+0000","last_fullsized":"2023-05-10T01:21:56.395063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391717+0000","last_change":"2023-05-10T01:21:56.389256+0000","last_active":"2023-05-10T01:21:56.391717+0000","last_peered":"2023-05-10T01:21:56.391717+0000","last_clean":"2023-05-10T01:21:56.391717+0000","last_became_active":"2023-05-10T01:21:56.388978+0000","last_became_peered":"2023-05-10T01:21:56.388978+0000","last_unstale":"2023-05-10T01:21:56.391717+0000","last_undegraded":"2023-05-10T01:21:56.391717+0000","last_fullsized":"2023-05-10T01:21:56.391717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396433+0000","last_change":"2023-05-10T01:21:56.392425+0000","last_active":"2023-05-10T01:21:56.396433+0000","last_peered":"2023-05-10T01:21:56.396433+0000","last_clean":"2023-05-10T01:21:56.396433+0000","last_became_active":"2023-05-10T01:21:56.388917+0000","last_became_peered":"2023-05-10T01:21:56.388917+0000","last_unstale":"2023-05-10T01:21:56.396433+0000","last_undegraded":"2023-05-10T01:21:56.396433+0000","last_fullsized":"2023-05-10T01:21:56.396433+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395333+0000","last_change":"2023-05-10T01:21:56.390584+0000","last_active":"2023-05-10T01:21:56.395333+0000","last_peered":"2023-05-10T01:21:56.395333+0000","last_clean":"2023-05-10T01:21:56.395333+0000","last_became_active":"2023-05-10T01:21:56.390323+0000","last_became_peered":"2023-05-10T01:21:56.390323+0000","last_unstale":"2023-05-10T01:21:56.395333+0000","last_undegraded":"2023-05-10T01:21:56.395333+0000","last_fullsized":"2023-05-10T01:21:56.395333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396396+0000","last_change":"2023-05-10T01:21:55.984806+0000","last_active":"2023-05-10T01:21:56.396396+0000","last_peered":"2023-05-10T01:21:56.396396+0000","last_clean":"2023-05-10T01:21:56.396396+0000","last_became_active":"2023-05-10T01:21:55.984490+0000","last_became_peered":"2023-05-10T01:21:55.984490+0000","last_unstale":"2023-05-10T01:21:56.396396+0000","last_undegraded":"2023-05-10T01:21:56.396396+0000","last_fullsized":"2023-05-10T01:21:56.396396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375615+0000","last_change":"2023-05-10T01:21:55.987039+0000","last_active":"2023-05-10T01:21:56.375615+0000","last_peered":"2023-05-10T01:21:56.375615+0000","last_clean":"2023-05-10T01:21:56.375615+0000","last_became_active":"2023-05-10T01:21:55.986716+0000","last_became_peered":"2023-05-10T01:21:55.986716+0000","last_unstale":"2023-05-10T01:21:56.375615+0000","last_undegraded":"2023-05-10T01:21:56.375615+0000","last_fullsized":"2023-05-10T01:21:56.375615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398666+0000","last_change":"2023-05-10T01:21:56.395474+0000","last_active":"2023-05-10T01:21:56.398666+0000","last_peered":"2023-05-10T01:21:56.398666+0000","last_clean":"2023-05-10T01:21:56.398666+0000","last_became_active":"2023-05-10T01:21:56.395187+0000","last_became_peered":"2023-05-10T01:21:56.395187+0000","last_unstale":"2023-05-10T01:21:56.398666+0000","last_undegraded":"2023-05-10T01:21:56.398666+0000","last_fullsized":"2023-05-10T01:21:56.398666+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375565+0000","last_change":"2023-05-10T01:21:55.995788+0000","last_active":"2023-05-10T01:21:56.375565+0000","last_peered":"2023-05-10T01:21:56.375565+0000","last_clean":"2023-05-10T01:21:56.375565+0000","last_became_active":"2023-05-10T01:21:55.995511+0000","last_became_peered":"2023-05-10T01:21:55.995511+0000","last_unstale":"2023-05-10T01:21:56.375565+0000","last_undegraded":"2023-05-10T01:21:56.375565+0000","last_fullsized":"2023-05-10T01:21:56.375565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386948+0000","last_change":"2023-05-10T01:21:56.381977+0000","last_active":"2023-05-10T01:21:56.386948+0000","last_peered":"2023-05-10T01:21:56.386948+0000","last_clean":"2023-05-10T01:21:56.386948+0000","last_became_active":"2023-05-10T01:21:56.381674+0000","last_became_peered":"2023-05-10T01:21:56.381674+0000","last_unstale":"2023-05-10T01:21:56.386948+0000","last_undegraded":"2023-05-10T01:21:56.386948+0000","last_fullsized":"2023-05-10T01:21:56.386948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398685+0000","last_change":"2023-05-10T01:21:56.396855+0000","last_active":"2023-05-10T01:21:56.398685+0000","last_peered":"2023-05-10T01:21:56.398685+0000","last_clean":"2023-05-10T01:21:56.398685+0000","last_became_active":"2023-05-10T01:21:56.396558+0000","last_became_peered":"2023-05-10T01:21:56.396558+0000","last_unstale":"2023-05-10T01:21:56.398685+0000","last_undegraded":"2023-05-10T01:21:56.398685+0000","last_fullsized":"2023-05-10T01:21:56.398685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376271+0000","last_change":"2023-05-10T01:21:55.978862+0000","last_active":"2023-05-10T01:21:56.376271+0000","last_peered":"2023-05-10T01:21:56.376271+0000","last_clean":"2023-05-10T01:21:56.376271+0000","last_became_active":"2023-05-10T01:21:55.978571+0000","last_became_peered":"2023-05-10T01:21:55.978571+0000","last_unstale":"2023-05-10T01:21:56.376271+0000","last_undegraded":"2023-05-10T01:21:56.376271+0000","last_fullsized":"2023-05-10T01:21:56.376271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370802+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:21:56.370802+0000","last_peered":"2023-05-10T01:21:56.370802+0000","last_clean":"2023-05-10T01:21:56.370802+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:21:56.370802+0000","last_undegraded":"2023-05-10T01:21:56.370802+0000","last_fullsized":"2023-05-10T01:21:56.370802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394411+0000","last_change":"2023-05-10T01:21:56.386063+0000","last_active":"2023-05-10T01:21:56.394411+0000","last_peered":"2023-05-10T01:21:56.394411+0000","last_clean":"2023-05-10T01:21:56.394411+0000","last_became_active":"2023-05-10T01:21:56.385793+0000","last_became_peered":"2023-05-10T01:21:56.385793+0000","last_unstale":"2023-05-10T01:21:56.394411+0000","last_undegraded":"2023-05-10T01:21:56.394411+0000","last_fullsized":"2023-05-10T01:21:56.394411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372423+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:21:56.372423+0000","last_peered":"2023-05-10T01:21:56.372423+0000","last_clean":"2023-05-10T01:21:56.372423+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:21:56.372423+0000","last_undegraded":"2023-05-10T01:21:56.372423+0000","last_fullsized":"2023-05-10T01:21:56.372423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397071+0000","last_change":"2023-05-10T01:21:56.394425+0000","last_active":"2023-05-10T01:21:56.397071+0000","last_peered":"2023-05-10T01:21:56.397071+0000","last_clean":"2023-05-10T01:21:56.397071+0000","last_became_active":"2023-05-10T01:21:56.394093+0000","last_became_peered":"2023-05-10T01:21:56.394093+0000","last_unstale":"2023-05-10T01:21:56.397071+0000","last_undegraded":"2023-05-10T01:21:56.397071+0000","last_fullsized":"2023-05-10T01:21:56.397071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374092+0000","last_change":"2023-05-10T01:21:55.986090+0000","last_active":"2023-05-10T01:21:56.374092+0000","last_peered":"2023-05-10T01:21:56.374092+0000","last_clean":"2023-05-10T01:21:56.374092+0000","last_became_active":"2023-05-10T01:21:55.985835+0000","last_became_peered":"2023-05-10T01:21:55.985835+0000","last_unstale":"2023-05-10T01:21:56.374092+0000","last_undegraded":"2023-05-10T01:21:56.374092+0000","last_fullsized":"2023-05-10T01:21:56.374092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.875933+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:21:50.875933+0000","last_peered":"2023-05-10T01:21:50.875933+0000","last_clean":"2023-05-10T01:21:50.875933+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:21:50.875933+0000","last_undegraded":"2023-05-10T01:21:50.875933+0000","last_fullsized":"2023-05-10T01:21:50.875933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:55.960990+0000","last_change":"2023-05-10T01:21:55.960990+0000","last_active":"2023-05-10T01:21:55.960990+0000","last_peered":"2023-05-10T01:21:55.960990+0000","last_clean":"2023-05-10T01:21:55.960990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:55.960990+0000","last_undegraded":"2023-05-10T01:21:55.960990+0000","last_fullsized":"2023-05-10T01:21:55.960990+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374173+0000","last_change":"2023-05-10T01:21:55.993109+0000","last_active":"2023-05-10T01:21:56.374173+0000","last_peered":"2023-05-10T01:21:56.374173+0000","last_clean":"2023-05-10T01:21:56.374173+0000","last_became_active":"2023-05-10T01:21:55.992808+0000","last_became_peered":"2023-05-10T01:21:55.992808+0000","last_unstale":"2023-05-10T01:21:56.374173+0000","last_undegraded":"2023-05-10T01:21:56.374173+0000","last_fullsized":"2023-05-10T01:21:56.374173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372296+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:21:56.372296+0000","last_peered":"2023-05-10T01:21:56.372296+0000","last_clean":"2023-05-10T01:21:56.372296+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:21:56.372296+0000","last_undegraded":"2023-05-10T01:21:56.372296+0000","last_fullsized":"2023-05-10T01:21:56.372296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864066+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:21:52.864066+0000","last_peered":"2023-05-10T01:21:52.864066+0000","last_clean":"2023-05-10T01:21:52.864066+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:21:52.864066+0000","last_undegraded":"2023-05-10T01:21:52.864066+0000","last_fullsized":"2023-05-10T01:21:52.864066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395900+0000","last_change":"2023-05-10T01:21:56.388692+0000","last_active":"2023-05-10T01:21:56.395900+0000","last_peered":"2023-05-10T01:21:56.395900+0000","last_clean":"2023-05-10T01:21:56.395900+0000","last_became_active":"2023-05-10T01:21:56.388418+0000","last_became_peered":"2023-05-10T01:21:56.388418+0000","last_unstale":"2023-05-10T01:21:56.395900+0000","last_undegraded":"2023-05-10T01:21:56.395900+0000","last_fullsized":"2023-05-10T01:21:56.395900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:21:54.955795+0000","last_change":"2023-05-10T01:21:54.955795+0000","last_active":"2023-05-10T01:21:54.955795+0000","last_peered":"2023-05-10T01:21:54.955795+0000","last_clean":"2023-05-10T01:21:54.955795+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:21:54.955795+0000","last_undegraded":"2023-05-10T01:21:54.955795+0000","last_fullsized":"2023-05-10T01:21:54.955795+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390004+0000","last_change":"2023-05-10T01:21:56.386770+0000","last_active":"2023-05-10T01:21:56.390004+0000","last_peered":"2023-05-10T01:21:56.390004+0000","last_clean":"2023-05-10T01:21:56.390004+0000","last_became_active":"2023-05-10T01:21:56.386485+0000","last_became_peered":"2023-05-10T01:21:56.386485+0000","last_unstale":"2023-05-10T01:21:56.390004+0000","last_undegraded":"2023-05-10T01:21:56.390004+0000","last_fullsized":"2023-05-10T01:21:56.390004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378139+0000","last_change":"2023-05-10T01:21:55.986362+0000","last_active":"2023-05-10T01:21:56.378139+0000","last_peered":"2023-05-10T01:21:56.378139+0000","last_clean":"2023-05-10T01:21:56.378139+0000","last_became_active":"2023-05-10T01:21:55.985579+0000","last_became_peered":"2023-05-10T01:21:55.985579+0000","last_unstale":"2023-05-10T01:21:56.378139+0000","last_undegraded":"2023-05-10T01:21:56.378139+0000","last_fullsized":"2023-05-10T01:21:56.378139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:52.864001+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:21:52.864001+0000","last_peered":"2023-05-10T01:21:52.864001+0000","last_clean":"2023-05-10T01:21:52.864001+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:21:52.864001+0000","last_undegraded":"2023-05-10T01:21:52.864001+0000","last_fullsized":"2023-05-10T01:21:52.864001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.388353+0000","last_change":"2023-05-10T01:21:56.384106+0000","last_active":"2023-05-10T01:21:56.388353+0000","last_peered":"2023-05-10T01:21:56.388353+0000","last_clean":"2023-05-10T01:21:56.388353+0000","last_became_active":"2023-05-10T01:21:56.383829+0000","last_became_peered":"2023-05-10T01:21:56.383829+0000","last_unstale":"2023-05-10T01:21:56.388353+0000","last_undegraded":"2023-05-10T01:21:56.388353+0000","last_fullsized":"2023-05-10T01:21:56.388353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376460+0000","last_change":"2023-05-10T01:21:55.987209+0000","last_active":"2023-05-10T01:21:56.376460+0000","last_peered":"2023-05-10T01:21:56.376460+0000","last_clean":"2023-05-10T01:21:56.376460+0000","last_became_active":"2023-05-10T01:21:55.986888+0000","last_became_peered":"2023-05-10T01:21:55.986888+0000","last_unstale":"2023-05-10T01:21:56.376460+0000","last_undegraded":"2023-05-10T01:21:56.376460+0000","last_fullsized":"2023-05-10T01:21:56.376460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370808+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:21:56.370808+0000","last_peered":"2023-05-10T01:21:56.370808+0000","last_clean":"2023-05-10T01:21:56.370808+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:21:56.370808+0000","last_undegraded":"2023-05-10T01:21:56.370808+0000","last_fullsized":"2023-05-10T01:21:56.370808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394272+0000","last_change":"2023-05-10T01:21:56.387160+0000","last_active":"2023-05-10T01:21:56.394272+0000","last_peered":"2023-05-10T01:21:56.394272+0000","last_clean":"2023-05-10T01:21:56.394272+0000","last_became_active":"2023-05-10T01:21:56.386884+0000","last_became_peered":"2023-05-10T01:21:56.386884+0000","last_unstale":"2023-05-10T01:21:56.394272+0000","last_undegraded":"2023-05-10T01:21:56.394272+0000","last_fullsized":"2023-05-10T01:21:56.394272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375961+0000","last_change":"2023-05-10T01:21:55.983841+0000","last_active":"2023-05-10T01:21:56.375961+0000","last_peered":"2023-05-10T01:21:56.375961+0000","last_clean":"2023-05-10T01:21:56.375961+0000","last_became_active":"2023-05-10T01:21:55.983556+0000","last_became_peered":"2023-05-10T01:21:55.983556+0000","last_unstale":"2023-05-10T01:21:56.375961+0000","last_undegraded":"2023-05-10T01:21:56.375961+0000","last_fullsized":"2023-05-10T01:21:56.375961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-05-10T01:21:50.874982+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:21:50.874982+0000","last_peered":"2023-05-10T01:21:50.874982+0000","last_clean":"2023-05-10T01:21:50.874982+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:21:50.874982+0000","last_undegraded":"2023-05-10T01:21:50.874982+0000","last_fullsized":"2023-05-10T01:21:50.874982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":1592,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":80,"acting":80,"num_store_stats":5},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16116,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355724,"statfs":{"total":96636764160,"available":96620261376,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.79000000000000004,"15min":0.89900000000000002},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.60599999999999998},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.89800000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.94899999999999995},"last":1.0740000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.59199999999999997},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.93300000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.92200000000000004},"last":1.0920000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.85899999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.871},"last":0.499}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.052},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":0.76400000000000001,"5min":0.79200000000000004,"15min":0.88200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15476,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94356364,"statfs":{"total":96636764160,"available":96620916736,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.86199999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65800000000000003,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.75700000000000001,"15min":1.1160000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":1.159},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":1.321},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.85599999999999998},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15656,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94356184,"statfs":{"total":96636764160,"available":96620732416,"internally_reserved":0,"allocated":753664,"data_stored":367522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.68999999999999995,"15min":0.77800000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.55500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.46899999999999997},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47399999999999998,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.64300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":1.117},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":1.05},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":1.3839999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":1.319},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.079},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.65400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.88200000000000001,"15min":1.0960000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.501,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.96899999999999997,"15min":1.3600000000000001},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15408,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356432,"statfs":{"total":96636764160,"available":96620986368,"internally_reserved":0,"allocated":761856,"data_stored":367558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.52900000000000003,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.28599999999999998,"15min":0.254},"max":{"1min":0.63,"5min":0.64200000000000002,"15min":0.80300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.436,"15min":0.47399999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":3.8370000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.84099999999999997},"last":0.309}]},{"osd":3,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.85799999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.374},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.375},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.432},"max":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":1.224},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":1.002,"15min":1.1559999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16500,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94355340,"statfs":{"total":96636764160,"available":96619868160,"internally_reserved":0,"allocated":700416,"data_stored":339705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.25,"5min":0.248,"15min":0.217},"max":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.67100000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.371,"5min":0.32500000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.432}]},{"osd":1,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41099999999999998},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.40799999999999997},"min":{"1min":0.33600000000000002,"5min":0.27000000000000002,"15min":0.22},"max":{"1min":0.58799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":0.68899999999999995,"5min":0.75,"15min":0.75},"last":0.33900000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.93100000000000005},"last":1.012},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.3320000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.876},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":1.091},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.056},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23856,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94347984,"statfs":{"total":96636764160,"available":96612335616,"internally_reserved":0,"allocated":761856,"data_stored":368098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.23999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28799999999999998,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.69899999999999995,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.45700000000000002},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":4,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":0.92200000000000004,"15min":1.0349999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.0589999999999999},"last":0.622}]},{"osd":5,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.41199999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.628,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15976,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355864,"statfs":{"total":96636764160,"available":96620404736,"internally_reserved":0,"allocated":753664,"data_stored":367986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.72799999999999998,"5min":0.753,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69999999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.337}]},{"osd":1,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.92100000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.35399999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.80400000000000005,"15min":0.85999999999999999},"last":1.3839999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.73899999999999999,"15min":0.83599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.84899999999999998,"15min":0.89200000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.621,"5min":0.67900000000000005,"15min":0.88200000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47999999999999998,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.67300000000000004,"5min":0.82599999999999996,"15min":0.89400000000000002},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50600000000000001,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.81100000000000005,"15min":0.92700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.371},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0589999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19176,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352664,"statfs":{"total":96636764160,"available":96617127936,"internally_reserved":0,"allocated":753664,"data_stored":368324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.56100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.66500000000000004,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.307},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.76500000000000001},"last":0.378}]},{"osd":6,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":1.1120000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:22:01.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-05-10T01:22:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-05-10T01:22:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-05-10T01:22:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-05-10T01:22:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-05-10T01:22:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-05-10T01:22:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-05-10T01:22:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-05-10T01:22:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-05-10T01:22:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-05-10T01:22:01.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-05-10T01:22:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-05-10T01:22:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-05-10T01:22:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-05-10T01:22:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-05-10T01:22:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-05-10T01:22:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-05-10T01:22:01.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-05-10T01:22:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-05-10T01:22:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-05-10T01:22:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-05-10T01:22:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-05-10T01:22:01.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-05-10T01:22:01.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-05-10T01:22:01.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-05-10T01:22:01.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-05-10T01:22:01.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-05-10T01:22:01.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-05-10T01:22:01.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-05-10T01:22:01.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-05-10T01:22:01.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-05-10T01:22:01.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-05-10T01:22:01.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-05-10T01:22:01.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-05-10T01:22:01.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-05-10T01:22:01.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-05-10T01:22:01.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-05-10T01:22:01.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-05-10T01:22:01.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-05-10T01:22:01.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:55.960990+0000', 'last_change': '2023-05-10T01:21:55.960990+0000', 'last_active': '2023-05-10T01:21:55.960990+0000', 'last_peered': '2023-05-10T01:21:55.960990+0000', 'last_clean': '2023-05-10T01:21:55.960990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:55.960990+0000', 'last_undegraded': '2023-05-10T01:21:55.960990+0000', 'last_fullsized': '2023-05-10T01:21:55.960990+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:55.960990+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-05-10T01:22:01.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:21:54.955795+0000', 'last_change': '2023-05-10T01:21:54.955795+0000', 'last_active': '2023-05-10T01:21:54.955795+0000', 'last_peered': '2023-05-10T01:21:54.955795+0000', 'last_clean': '2023-05-10T01:21:54.955795+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:21:54.955795+0000', 'last_undegraded': '2023-05-10T01:21:54.955795+0000', 'last_fullsized': '2023-05-10T01:21:54.955795+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'last_clean_scrub_stamp': '2023-05-10T01:21:54.955795+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:22:01.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:22:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.329+0000 7f94214e9700 1 Processor -- start 2023-05-10T01:22:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.329+0000 7f94214e9700 1 -- start start 2023-05-10T01:22:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f94214e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f941c0bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f94214e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f941c0c3ae0 0x7f941c063860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f94214e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0c5f10 con 0x7f941c138350 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f94214e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0c5640 con 0x7f941c0c3ae0 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f94214e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0bf730 con 0x7f941c138730 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f941affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f941c138350 0x7f941c0c33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42656/0 (socket says 172.21.15.52:42656) 2023-05-10T01:22:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f941affd700 1 -- 172.21.15.52:0/536614732 learned_addr learned my addr 172.21.15.52:0/536614732 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f941a7fc700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f941c0bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641801635 0 0) 0x7f941c0c5f10 con 0x7f941c138350 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f941b7fe700 1 --2- 172.21.15.52:0/536614732 >> v2:172.21.15.172:3300/0 conn(0x7f941c0c3ae0 0x7f941c063860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.330+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94080033f0 con 0x7f941c138350 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857076926 0 0) 0x7f94080033f0 con 0x7f941c138350 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 msgr2=0x7f941c0bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f941c0bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 >> v2:172.21.15.172:3300/0 conn(0x7f941c0c3ae0 msgr2=0x7f941c063860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 --2- 172.21.15.52:0/536614732 >> v2:172.21.15.172:3300/0 conn(0x7f941c0c3ae0 0x7f941c063860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c58c0 con 0x7f941c138350 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f94140017f0 con 0x7f941c138350 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 >> v1:172.21.15.52:6789/0 conn(0x7f941c138350 legacy=0x7f941c0c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f94080038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f9408004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9408004b80 0x7f9408005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c5640 con 0x7f9408003e10 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0bf730 con 0x7f9408004b80 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940800b8e0 con 0x7f941c138730 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f9408004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941b7fe700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9408004b80 0x7f9408005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941affd700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f94080038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 -- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 msgr2=0x7f94080038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c138730 0x7f94080038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 -- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9408004b80 msgr2=0x7f9408005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9408004b80 0x7f9408005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 -- 172.21.15.52:0/536614732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080033f0 con 0x7f9408003e10 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f941a7fc700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f9408004690 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f9410009a80 tx=0x7f9410009060).ready entity=mon.0 client_cookie=616296fa99c3800c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410009430 con 0x7f9408003e10 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000e640 con 0x7f9408003e10 2023-05-10T01:22:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.331+0000 7f9419ffb700 1 -- 172.21.15.52:0/536614732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000e9c0 con 0x7f9408003e10 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 -- 172.21.15.52:0/536614732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 msgr2=0x7f9408004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 --2- 172.21.15.52:0/536614732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f9408004690 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f9410009a80 tx=0x7f9410009060).stop 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f941b7fe700 1 -- 172.21.15.52:0/536614732 reap_dead start 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 -- 172.21.15.52:0/536614732 shutdown_connections 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 -- 172.21.15.52:0/536614732 >> 172.21.15.52:0/536614732 conn(0x7f941c05dd40 msgr2=0x7f941c05e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 -- 172.21.15.52:0/536614732 shutdown_connections 2023-05-10T01:22:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.332+0000 7f94214e9700 1 -- 172.21.15.52:0/536614732 wait complete. 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.333+0000 7f94214e9700 1 Processor -- start 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.333+0000 7f94214e9700 1 -- start start 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c0c08e0 0x7f941c137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 0x7f941c1624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c79b0 con 0x7f9408003e10 2023-05-10T01:22:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7c30 con 0x7f941c0c08e0 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f94214e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c1980 con 0x7f941c162050 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33654/0 (socket says 172.21.15.52:33654) 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 -- 172.21.15.52:0/4201016529 learned_addr learned my addr 172.21.15.52:0/4201016529 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941b7fe700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 0x7f941c1624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941a7fc700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c0c08e0 0x7f941c137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 -- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 msgr2=0x7f941c1624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 0x7f941c1624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 -- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c0c08e0 msgr2=0x7f941c137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c0c08e0 0x7f941c137480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941affd700 1 -- 172.21.15.52:0/4201016529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c10e0 con 0x7f9408003e10 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.334+0000 7f941b7fe700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 0x7f941c1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f941affd700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9414007750 tx=0x7f9414001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400fa00 con 0x7f9408003e10 2023-05-10T01:22:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400fb60 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0c13c0 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414015410 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.335+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c1629c0 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.336+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c06c340 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.336+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9414015780 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.336+0000 7f9402ffd700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 0x7f93fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.336+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f941407a4d0 con 0x7f9408003e10 2023-05-10T01:22:01.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.337+0000 7f941a7fc700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 0x7f93fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.337+0000 7f941a7fc700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 0x7f93fc061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f941c1460b0 tx=0x7f941001a000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.341+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f941404b810 con 0x7f9408003e10 2023-05-10T01:22:01.495 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:22:01.491+0000 7fb6614b1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:22:01.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.582+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f941c0c5ba0 con 0x7f9408003e10 2023-05-10T01:22:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.582+0000 7f9402ffd700 1 -- 172.21.15.52:0/4201016529 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1026 (secure 0 0 0) 0x7f941404ee30 con 0x7f9408003e10 2023-05-10T01:22:01.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:01.586 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":746,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"unknown","count":40}],"num_pgs":137,"num_pools":4,"num_objects":11,"data_bytes":1592,"bytes_used":141479936,"bytes_avail":772952633344,"bytes_total":773094113280,"unknown_pgs_ratio":0.29197078943252563},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5739}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-05-10T01:11:54.255695+0000","services":{}},"progress_events":{}} 2023-05-10T01:22:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 msgr2=0x7f93fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 0x7f93fc061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f941c1460b0 tx=0x7f941001a000).stop 2023-05-10T01:22:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 msgr2=0x7f941c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9414007750 tx=0x7f9414001d90).stop 2023-05-10T01:22:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 shutdown_connections 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f93fc05ed90 0x7f93fc061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c162050 0x7f941c1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9408003e10 0x7f941c1519b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 --2- 172.21.15.52:0/4201016529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c0c08e0 0x7f941c137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 >> 172.21.15.52:0/4201016529 conn(0x7f941c05dd40 msgr2=0x7f941c1393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 shutdown_connections 2023-05-10T01:22:01.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.584+0000 7f94214e9700 1 -- 172.21.15.52:0/4201016529 wait complete. 2023-05-10T01:22:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:22:01.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:22:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.712+0000 7fdaeda16700 1 Processor -- start 2023-05-10T01:22:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.712+0000 7fdaeda16700 1 -- start start 2023-05-10T01:22:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdaeda16700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdae8152530 0x7fdae8156460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdaeda16700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 0x7fdae80bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdaeda16700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80c3090 con 0x7fdae8152910 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdaeda16700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae8152d10 con 0x7fdae8152530 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdaeda16700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80622a0 con 0x7fdae80bd9f0 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdae6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdae8152530 0x7fdae8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdae6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdae8152530 0x7fdae8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33662/0 (socket says 172.21.15.52:33662) 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdae6ffd700 1 -- 172.21.15.52:0/3508997472 learned_addr learned my addr 172.21.15.52:0/3508997472 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.713+0000 7fdae77fe700 1 --2- 172.21.15.52:0/3508997472 >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 0x7fdae80bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae6ffd700 1 -- 172.21.15.52:0/3508997472 >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 msgr2=0x7fdae80bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae6ffd700 1 --2- 172.21.15.52:0/3508997472 >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 0x7fdae80bde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae6ffd700 1 -- 172.21.15.52:0/3508997472 >> v1:172.21.15.172:6789/0 conn(0x7fdae8152910 legacy=0x7fdae80c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae6ffd700 1 -- 172.21.15.52:0/3508997472 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80c32c0 con 0x7fdae8152530 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae77fe700 1 --2- 172.21.15.52:0/3508997472 >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 0x7fdae80bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae6ffd700 1 --2- 172.21.15.52:0/3508997472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae8152530 0x7fdae8156460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fdae80c3ef0 tx=0x7fdae00090f0).ready entity=mon.0 client_cookie=947c1710ebaec1c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae5ffb700 1 -- 172.21.15.52:0/3508997472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000b5a0 con 0x7fdae8152530 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae5ffb700 1 -- 172.21.15.52:0/3508997472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000b700 con 0x7fdae8152530 2023-05-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdae5ffb700 1 -- 172.21.15.52:0/3508997472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ba80 con 0x7fdae8152530 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 -- 172.21.15.52:0/3508997472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae8152530 msgr2=0x7fdae8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 --2- 172.21.15.52:0/3508997472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae8152530 0x7fdae8156460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fdae80c3ef0 tx=0x7fdae00090f0).stop 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 -- 172.21.15.52:0/3508997472 shutdown_connections 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 --2- 172.21.15.52:0/3508997472 >> v2:172.21.15.172:3300/0 conn(0x7fdae80bd9f0 0x7fdae80bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 --2- 172.21.15.52:0/3508997472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae8152530 0x7fdae8156460 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 -- 172.21.15.52:0/3508997472 >> 172.21.15.52:0/3508997472 conn(0x7fdae80c8a90 msgr2=0x7fdae80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 -- 172.21.15.52:0/3508997472 shutdown_connections 2023-05-10T01:22:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.714+0000 7fdaeda16700 1 -- 172.21.15.52:0/3508997472 wait complete. 2023-05-10T01:22:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 Processor -- start 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 -- start start 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdae8152530 0x7fdae8151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae8152910 0x7fdae8167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8067f50 con 0x7fdae80bd9f0 2023-05-10T01:22:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8068510 con 0x7fdae8152910 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdaeda16700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8132a80 con 0x7fdae8152530 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdae6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.716+0000 7fdae6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33666/0 (socket says 172.21.15.52:33666) 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 -- 172.21.15.52:0/1320977684 learned_addr learned my addr 172.21.15.52:0/1320977684 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae67fc700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdae8152530 0x7fdae8151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae77fe700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae8152910 0x7fdae8167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 -- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdae8152530 msgr2=0x7fdae8151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdae8152530 0x7fdae8151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 -- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae8152910 msgr2=0x7fdae8167930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae8152910 0x7fdae8167930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 -- 172.21.15.52:0/1320977684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009370 con 0x7fdae80bd9f0 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdae6ffd700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fdae0009130 tx=0x7fdae0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ba80 con 0x7fdae80bd9f0 2023-05-10T01:22:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0000d10 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae001c670 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae8132d60 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.717+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80ac580 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.718+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae806c340 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.718+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdae000f070 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.719+0000 7fdadeffd700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.719+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fdae007b3f0 con 0x7fdae80bd9f0 2023-05-10T01:22:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.719+0000 7fdae67fc700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.719+0000 7fdae67fc700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 0x7fdacc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdae80c0fc0 tx=0x7fdad0009040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.723+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdae004c8a0 con 0x7fdae80bd9f0 2023-05-10T01:22:01.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.891+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdae80ac7a0 con 0x7fdacc05ed90 2023-05-10T01:22:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.902+0000 7fdadeffd700 1 -- 172.21.15.52:0/1320977684 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361281 (secure 0 0 0) 0x7fdad0003340 con 0x7fdacc05ed90 2023-05-10T01:22:01.908 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:01.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 msgr2=0x7fdacc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 0x7fdacc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdae80c0fc0 tx=0x7fdad0009040).stop 2023-05-10T01:22:01.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 msgr2=0x7fdae80abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fdae0009130 tx=0x7fdae0015000).stop 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 shutdown_connections 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdacc05ed90 0x7fdacc061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae8152910 0x7fdae8167930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae80bd9f0 0x7fdae80abc70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 --2- 172.21.15.52:0/1320977684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdae8152530 0x7fdae8151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 >> 172.21.15.52:0/1320977684 conn(0x7fdae80c8a90 msgr2=0x7fdae80c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 shutdown_connections 2023-05-10T01:22:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:01.905+0000 7fdaeda16700 1 -- 172.21.15.52:0/1320977684 wait complete. 2023-05-10T01:22:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:22:01.920 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-10T01:22:01.733917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":214,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138912,"kb_used_data":5920,"kb_used_omap":0,"kb_used_meta":132928,"kb_avail":754835808,"statfs":{"total":773094113280,"available":772951867392,"internally_reserved":0,"allocated":6062080,"data_stored":2944068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136118272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14668759,"num_objects":-16,"num_object_clones":0,"num_object_copies":-32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-692,"num_write_kb":-15215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.193872"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396349+0000","last_change":"2023-05-10T01:21:56.393474+0000","last_active":"2023-05-10T01:21:56.396349+0000","last_peered":"2023-05-10T01:21:56.396349+0000","last_clean":"2023-05-10T01:21:56.396349+0000","last_became_active":"2023-05-10T01:21:56.393150+0000","last_became_peered":"2023-05-10T01:21:56.393150+0000","last_unstale":"2023-05-10T01:21:56.396349+0000","last_undegraded":"2023-05-10T01:21:56.396349+0000","last_fullsized":"2023-05-10T01:21:56.396349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392197+0000","last_change":"2023-05-10T01:21:55.984077+0000","last_active":"2023-05-10T01:21:56.392197+0000","last_peered":"2023-05-10T01:21:56.392197+0000","last_clean":"2023-05-10T01:21:56.392197+0000","last_became_active":"2023-05-10T01:21:55.983518+0000","last_became_peered":"2023-05-10T01:21:55.983518+0000","last_unstale":"2023-05-10T01:21:56.392197+0000","last_undegraded":"2023-05-10T01:21:56.392197+0000","last_fullsized":"2023-05-10T01:21:56.392197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396287+0000","last_change":"2023-05-10T01:21:56.394558+0000","last_active":"2023-05-10T01:21:56.396287+0000","last_peered":"2023-05-10T01:21:56.396287+0000","last_clean":"2023-05-10T01:21:56.396287+0000","last_became_active":"2023-05-10T01:21:56.394269+0000","last_became_peered":"2023-05-10T01:21:56.394269+0000","last_unstale":"2023-05-10T01:21:56.396287+0000","last_undegraded":"2023-05-10T01:21:56.396287+0000","last_fullsized":"2023-05-10T01:21:56.396287+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372259+0000","last_change":"2023-05-10T01:21:55.995244+0000","last_active":"2023-05-10T01:21:56.372259+0000","last_peered":"2023-05-10T01:21:56.372259+0000","last_clean":"2023-05-10T01:21:56.372259+0000","last_became_active":"2023-05-10T01:21:55.994967+0000","last_became_peered":"2023-05-10T01:21:55.994967+0000","last_unstale":"2023-05-10T01:21:56.372259+0000","last_undegraded":"2023-05-10T01:21:56.372259+0000","last_fullsized":"2023-05-10T01:21:56.372259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393590+0000","last_change":"2023-05-10T01:21:56.387460+0000","last_active":"2023-05-10T01:21:56.393590+0000","last_peered":"2023-05-10T01:21:56.393590+0000","last_clean":"2023-05-10T01:21:56.393590+0000","last_became_active":"2023-05-10T01:21:56.387168+0000","last_became_peered":"2023-05-10T01:21:56.387168+0000","last_unstale":"2023-05-10T01:21:56.393590+0000","last_undegraded":"2023-05-10T01:21:56.393590+0000","last_fullsized":"2023-05-10T01:21:56.393590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375395+0000","last_change":"2023-05-10T01:21:55.981476+0000","last_active":"2023-05-10T01:21:56.375395+0000","last_peered":"2023-05-10T01:21:56.375395+0000","last_clean":"2023-05-10T01:21:56.375395+0000","last_became_active":"2023-05-10T01:21:55.981022+0000","last_became_peered":"2023-05-10T01:21:55.981022+0000","last_unstale":"2023-05-10T01:21:56.375395+0000","last_undegraded":"2023-05-10T01:21:56.375395+0000","last_fullsized":"2023-05-10T01:21:56.375395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396467+0000","last_change":"2023-05-10T01:21:56.393248+0000","last_active":"2023-05-10T01:21:56.396467+0000","last_peered":"2023-05-10T01:21:56.396467+0000","last_clean":"2023-05-10T01:21:56.396467+0000","last_became_active":"2023-05-10T01:21:56.392940+0000","last_became_peered":"2023-05-10T01:21:56.392940+0000","last_unstale":"2023-05-10T01:21:56.396467+0000","last_undegraded":"2023-05-10T01:21:56.396467+0000","last_fullsized":"2023-05-10T01:21:56.396467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394545+0000","last_change":"2023-05-10T01:21:55.989682+0000","last_active":"2023-05-10T01:21:56.394545+0000","last_peered":"2023-05-10T01:21:56.394545+0000","last_clean":"2023-05-10T01:21:56.394545+0000","last_became_active":"2023-05-10T01:21:55.989221+0000","last_became_peered":"2023-05-10T01:21:55.989221+0000","last_unstale":"2023-05-10T01:21:56.394545+0000","last_undegraded":"2023-05-10T01:21:56.394545+0000","last_fullsized":"2023-05-10T01:21:56.394545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398309+0000","last_change":"2023-05-10T01:21:56.396249+0000","last_active":"2023-05-10T01:21:56.398309+0000","last_peered":"2023-05-10T01:21:56.398309+0000","last_clean":"2023-05-10T01:21:56.398309+0000","last_became_active":"2023-05-10T01:21:56.395946+0000","last_became_peered":"2023-05-10T01:21:56.395946+0000","last_unstale":"2023-05-10T01:21:56.398309+0000","last_undegraded":"2023-05-10T01:21:56.398309+0000","last_fullsized":"2023-05-10T01:21:56.398309+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383417+0000","last_change":"2023-05-10T01:21:55.989419+0000","last_active":"2023-05-10T01:21:56.383417+0000","last_peered":"2023-05-10T01:21:56.383417+0000","last_clean":"2023-05-10T01:21:56.383417+0000","last_became_active":"2023-05-10T01:21:55.989168+0000","last_became_peered":"2023-05-10T01:21:55.989168+0000","last_unstale":"2023-05-10T01:21:56.383417+0000","last_undegraded":"2023-05-10T01:21:56.383417+0000","last_fullsized":"2023-05-10T01:21:56.383417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394522+0000","last_change":"2023-05-10T01:21:56.388422+0000","last_active":"2023-05-10T01:21:56.394522+0000","last_peered":"2023-05-10T01:21:56.394522+0000","last_clean":"2023-05-10T01:21:56.394522+0000","last_became_active":"2023-05-10T01:21:56.388135+0000","last_became_peered":"2023-05-10T01:21:56.388135+0000","last_unstale":"2023-05-10T01:21:56.394522+0000","last_undegraded":"2023-05-10T01:21:56.394522+0000","last_fullsized":"2023-05-10T01:21:56.394522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394435+0000","last_change":"2023-05-10T01:21:55.987682+0000","last_active":"2023-05-10T01:21:56.394435+0000","last_peered":"2023-05-10T01:21:56.394435+0000","last_clean":"2023-05-10T01:21:56.394435+0000","last_became_active":"2023-05-10T01:21:55.987380+0000","last_became_peered":"2023-05-10T01:21:55.987380+0000","last_unstale":"2023-05-10T01:21:56.394435+0000","last_undegraded":"2023-05-10T01:21:56.394435+0000","last_fullsized":"2023-05-10T01:21:56.394435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396200+0000","last_change":"2023-05-10T01:21:56.392983+0000","last_active":"2023-05-10T01:21:56.396200+0000","last_peered":"2023-05-10T01:21:56.396200+0000","last_clean":"2023-05-10T01:21:56.396200+0000","last_became_active":"2023-05-10T01:21:56.392726+0000","last_became_peered":"2023-05-10T01:21:56.392726+0000","last_unstale":"2023-05-10T01:21:56.396200+0000","last_undegraded":"2023-05-10T01:21:56.396200+0000","last_fullsized":"2023-05-10T01:21:56.396200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379375+0000","last_change":"2023-05-10T01:21:55.985886+0000","last_active":"2023-05-10T01:21:56.379375+0000","last_peered":"2023-05-10T01:21:56.379375+0000","last_clean":"2023-05-10T01:21:56.379375+0000","last_became_active":"2023-05-10T01:21:55.985571+0000","last_became_peered":"2023-05-10T01:21:55.985571+0000","last_unstale":"2023-05-10T01:21:56.379375+0000","last_undegraded":"2023-05-10T01:21:56.379375+0000","last_fullsized":"2023-05-10T01:21:56.379375+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384785+0000","last_change":"2023-05-10T01:21:56.381538+0000","last_active":"2023-05-10T01:21:56.384785+0000","last_peered":"2023-05-10T01:21:56.384785+0000","last_clean":"2023-05-10T01:21:56.384785+0000","last_became_active":"2023-05-10T01:21:56.381059+0000","last_became_peered":"2023-05-10T01:21:56.381059+0000","last_unstale":"2023-05-10T01:21:56.384785+0000","last_undegraded":"2023-05-10T01:21:56.384785+0000","last_fullsized":"2023-05-10T01:21:56.384785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373368+0000","last_change":"2023-05-10T01:21:55.992753+0000","last_active":"2023-05-10T01:21:56.373368+0000","last_peered":"2023-05-10T01:21:56.373368+0000","last_clean":"2023-05-10T01:21:56.373368+0000","last_became_active":"2023-05-10T01:21:55.989112+0000","last_became_peered":"2023-05-10T01:21:55.989112+0000","last_unstale":"2023-05-10T01:21:56.373368+0000","last_undegraded":"2023-05-10T01:21:56.373368+0000","last_fullsized":"2023-05-10T01:21:56.373368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.389535+0000","last_change":"2023-05-10T01:21:56.385875+0000","last_active":"2023-05-10T01:21:56.389535+0000","last_peered":"2023-05-10T01:21:56.389535+0000","last_clean":"2023-05-10T01:21:56.389535+0000","last_became_active":"2023-05-10T01:21:56.385559+0000","last_became_peered":"2023-05-10T01:21:56.385559+0000","last_unstale":"2023-05-10T01:21:56.389535+0000","last_undegraded":"2023-05-10T01:21:56.389535+0000","last_fullsized":"2023-05-10T01:21:56.389535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374945+0000","last_change":"2023-05-10T01:21:55.995994+0000","last_active":"2023-05-10T01:21:56.374945+0000","last_peered":"2023-05-10T01:21:56.374945+0000","last_clean":"2023-05-10T01:21:56.374945+0000","last_became_active":"2023-05-10T01:21:55.995612+0000","last_became_peered":"2023-05-10T01:21:55.995612+0000","last_unstale":"2023-05-10T01:21:56.374945+0000","last_undegraded":"2023-05-10T01:21:56.374945+0000","last_fullsized":"2023-05-10T01:21:56.374945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397620+0000","last_change":"2023-05-10T01:21:56.393150+0000","last_active":"2023-05-10T01:21:56.397620+0000","last_peered":"2023-05-10T01:21:56.397620+0000","last_clean":"2023-05-10T01:21:56.397620+0000","last_became_active":"2023-05-10T01:21:56.392864+0000","last_became_peered":"2023-05-10T01:21:56.392864+0000","last_unstale":"2023-05-10T01:21:56.397620+0000","last_undegraded":"2023-05-10T01:21:56.397620+0000","last_fullsized":"2023-05-10T01:21:56.397620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374362+0000","last_change":"2023-05-10T01:21:55.989756+0000","last_active":"2023-05-10T01:21:56.374362+0000","last_peered":"2023-05-10T01:21:56.374362+0000","last_clean":"2023-05-10T01:21:56.374362+0000","last_became_active":"2023-05-10T01:21:55.989216+0000","last_became_peered":"2023-05-10T01:21:55.989216+0000","last_unstale":"2023-05-10T01:21:56.374362+0000","last_undegraded":"2023-05-10T01:21:56.374362+0000","last_fullsized":"2023-05-10T01:21:56.374362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385955+0000","last_change":"2023-05-10T01:21:56.379300+0000","last_active":"2023-05-10T01:21:56.385955+0000","last_peered":"2023-05-10T01:21:56.385955+0000","last_clean":"2023-05-10T01:21:56.385955+0000","last_became_active":"2023-05-10T01:21:56.378969+0000","last_became_peered":"2023-05-10T01:21:56.378969+0000","last_unstale":"2023-05-10T01:21:56.385955+0000","last_undegraded":"2023-05-10T01:21:56.385955+0000","last_fullsized":"2023-05-10T01:21:56.385955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376325+0000","last_change":"2023-05-10T01:21:55.996558+0000","last_active":"2023-05-10T01:21:56.376325+0000","last_peered":"2023-05-10T01:21:56.376325+0000","last_clean":"2023-05-10T01:21:56.376325+0000","last_became_active":"2023-05-10T01:21:55.996094+0000","last_became_peered":"2023-05-10T01:21:55.996094+0000","last_unstale":"2023-05-10T01:21:56.376325+0000","last_undegraded":"2023-05-10T01:21:56.376325+0000","last_fullsized":"2023-05-10T01:21:56.376325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393472+0000","last_change":"2023-05-10T01:21:56.389655+0000","last_active":"2023-05-10T01:21:56.393472+0000","last_peered":"2023-05-10T01:21:56.393472+0000","last_clean":"2023-05-10T01:21:56.393472+0000","last_became_active":"2023-05-10T01:21:56.389185+0000","last_became_peered":"2023-05-10T01:21:56.389185+0000","last_unstale":"2023-05-10T01:21:56.393472+0000","last_undegraded":"2023-05-10T01:21:56.393472+0000","last_fullsized":"2023-05-10T01:21:56.393472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397557+0000","last_change":"2023-05-10T01:21:55.990841+0000","last_active":"2023-05-10T01:21:56.397557+0000","last_peered":"2023-05-10T01:21:56.397557+0000","last_clean":"2023-05-10T01:21:56.397557+0000","last_became_active":"2023-05-10T01:21:55.990576+0000","last_became_peered":"2023-05-10T01:21:55.990576+0000","last_unstale":"2023-05-10T01:21:56.397557+0000","last_undegraded":"2023-05-10T01:21:56.397557+0000","last_fullsized":"2023-05-10T01:21:56.397557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392743+0000","last_change":"2023-05-10T01:21:56.388127+0000","last_active":"2023-05-10T01:21:56.392743+0000","last_peered":"2023-05-10T01:21:56.392743+0000","last_clean":"2023-05-10T01:21:56.392743+0000","last_became_active":"2023-05-10T01:21:56.387864+0000","last_became_peered":"2023-05-10T01:21:56.387864+0000","last_unstale":"2023-05-10T01:21:56.392743+0000","last_undegraded":"2023-05-10T01:21:56.392743+0000","last_fullsized":"2023-05-10T01:21:56.392743+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397736+0000","last_change":"2023-05-10T01:21:55.988691+0000","last_active":"2023-05-10T01:21:56.397736+0000","last_peered":"2023-05-10T01:21:56.397736+0000","last_clean":"2023-05-10T01:21:56.397736+0000","last_became_active":"2023-05-10T01:21:55.988337+0000","last_became_peered":"2023-05-10T01:21:55.988337+0000","last_unstale":"2023-05-10T01:21:56.397736+0000","last_undegraded":"2023-05-10T01:21:56.397736+0000","last_fullsized":"2023-05-10T01:21:56.397736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393891+0000","last_change":"2023-05-10T01:21:56.387347+0000","last_active":"2023-05-10T01:21:56.393891+0000","last_peered":"2023-05-10T01:21:56.393891+0000","last_clean":"2023-05-10T01:21:56.393891+0000","last_became_active":"2023-05-10T01:21:56.386716+0000","last_became_peered":"2023-05-10T01:21:56.386716+0000","last_unstale":"2023-05-10T01:21:56.393891+0000","last_undegraded":"2023-05-10T01:21:56.393891+0000","last_fullsized":"2023-05-10T01:21:56.393891+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376282+0000","last_change":"2023-05-10T01:21:55.996347+0000","last_active":"2023-05-10T01:21:56.376282+0000","last_peered":"2023-05-10T01:21:56.376282+0000","last_clean":"2023-05-10T01:21:56.376282+0000","last_became_active":"2023-05-10T01:21:55.996084+0000","last_became_peered":"2023-05-10T01:21:55.996084+0000","last_unstale":"2023-05-10T01:21:56.376282+0000","last_undegraded":"2023-05-10T01:21:56.376282+0000","last_fullsized":"2023-05-10T01:21:56.376282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396251+0000","last_change":"2023-05-10T01:21:56.393820+0000","last_active":"2023-05-10T01:21:56.396251+0000","last_peered":"2023-05-10T01:21:56.396251+0000","last_clean":"2023-05-10T01:21:56.396251+0000","last_became_active":"2023-05-10T01:21:56.393487+0000","last_became_peered":"2023-05-10T01:21:56.393487+0000","last_unstale":"2023-05-10T01:21:56.396251+0000","last_undegraded":"2023-05-10T01:21:56.396251+0000","last_fullsized":"2023-05-10T01:21:56.396251+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373429+0000","last_change":"2023-05-10T01:21:55.984869+0000","last_active":"2023-05-10T01:21:56.373429+0000","last_peered":"2023-05-10T01:21:56.373429+0000","last_clean":"2023-05-10T01:21:56.373429+0000","last_became_active":"2023-05-10T01:21:55.984587+0000","last_became_peered":"2023-05-10T01:21:55.984587+0000","last_unstale":"2023-05-10T01:21:56.373429+0000","last_undegraded":"2023-05-10T01:21:56.373429+0000","last_fullsized":"2023-05-10T01:21:56.373429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394933+0000","last_change":"2023-05-10T01:21:56.385313+0000","last_active":"2023-05-10T01:21:56.394933+0000","last_peered":"2023-05-10T01:21:56.394933+0000","last_clean":"2023-05-10T01:21:56.394933+0000","last_became_active":"2023-05-10T01:21:56.382048+0000","last_became_peered":"2023-05-10T01:21:56.382048+0000","last_unstale":"2023-05-10T01:21:56.394933+0000","last_undegraded":"2023-05-10T01:21:56.394933+0000","last_fullsized":"2023-05-10T01:21:56.394933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391542+0000","last_change":"2023-05-10T01:21:55.988731+0000","last_active":"2023-05-10T01:21:56.391542+0000","last_peered":"2023-05-10T01:21:56.391542+0000","last_clean":"2023-05-10T01:21:56.391542+0000","last_became_active":"2023-05-10T01:21:55.988305+0000","last_became_peered":"2023-05-10T01:21:55.988305+0000","last_unstale":"2023-05-10T01:21:56.391542+0000","last_undegraded":"2023-05-10T01:21:56.391542+0000","last_fullsized":"2023-05-10T01:21:56.391542+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394431+0000","last_change":"2023-05-10T01:21:56.389754+0000","last_active":"2023-05-10T01:21:56.394431+0000","last_peered":"2023-05-10T01:21:56.394431+0000","last_clean":"2023-05-10T01:21:56.394431+0000","last_became_active":"2023-05-10T01:21:56.389230+0000","last_became_peered":"2023-05-10T01:21:56.389230+0000","last_unstale":"2023-05-10T01:21:56.394431+0000","last_undegraded":"2023-05-10T01:21:56.394431+0000","last_fullsized":"2023-05-10T01:21:56.394431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375951+0000","last_change":"2023-05-10T01:21:55.977210+0000","last_active":"2023-05-10T01:21:56.375951+0000","last_peered":"2023-05-10T01:21:56.375951+0000","last_clean":"2023-05-10T01:21:56.375951+0000","last_became_active":"2023-05-10T01:21:55.976395+0000","last_became_peered":"2023-05-10T01:21:55.976395+0000","last_unstale":"2023-05-10T01:21:56.375951+0000","last_undegraded":"2023-05-10T01:21:56.375951+0000","last_fullsized":"2023-05-10T01:21:56.375951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398378+0000","last_change":"2023-05-10T01:21:56.396010+0000","last_active":"2023-05-10T01:21:56.398378+0000","last_peered":"2023-05-10T01:21:56.398378+0000","last_clean":"2023-05-10T01:21:56.398378+0000","last_became_active":"2023-05-10T01:21:56.395742+0000","last_became_peered":"2023-05-10T01:21:56.395742+0000","last_unstale":"2023-05-10T01:21:56.398378+0000","last_undegraded":"2023-05-10T01:21:56.398378+0000","last_fullsized":"2023-05-10T01:21:56.398378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377562+0000","last_change":"2023-05-10T01:21:55.985998+0000","last_active":"2023-05-10T01:21:56.377562+0000","last_peered":"2023-05-10T01:21:56.377562+0000","last_clean":"2023-05-10T01:21:56.377562+0000","last_became_active":"2023-05-10T01:21:55.985747+0000","last_became_peered":"2023-05-10T01:21:55.985747+0000","last_unstale":"2023-05-10T01:21:56.377562+0000","last_undegraded":"2023-05-10T01:21:56.377562+0000","last_fullsized":"2023-05-10T01:21:56.377562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401233+0000","last_change":"2023-05-10T01:21:56.396956+0000","last_active":"2023-05-10T01:21:56.401233+0000","last_peered":"2023-05-10T01:21:56.401233+0000","last_clean":"2023-05-10T01:21:56.401233+0000","last_became_active":"2023-05-10T01:21:56.396693+0000","last_became_peered":"2023-05-10T01:21:56.396693+0000","last_unstale":"2023-05-10T01:21:56.401233+0000","last_undegraded":"2023-05-10T01:21:56.401233+0000","last_fullsized":"2023-05-10T01:21:56.401233+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394027+0000","last_change":"2023-05-10T01:21:55.993591+0000","last_active":"2023-05-10T01:21:56.394027+0000","last_peered":"2023-05-10T01:21:56.394027+0000","last_clean":"2023-05-10T01:21:56.394027+0000","last_became_active":"2023-05-10T01:21:55.993336+0000","last_became_peered":"2023-05-10T01:21:55.993336+0000","last_unstale":"2023-05-10T01:21:56.394027+0000","last_undegraded":"2023-05-10T01:21:56.394027+0000","last_fullsized":"2023-05-10T01:21:56.394027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398490+0000","last_change":"2023-05-10T01:21:56.395020+0000","last_active":"2023-05-10T01:21:56.398490+0000","last_peered":"2023-05-10T01:21:56.398490+0000","last_clean":"2023-05-10T01:21:56.398490+0000","last_became_active":"2023-05-10T01:21:56.394720+0000","last_became_peered":"2023-05-10T01:21:56.394720+0000","last_unstale":"2023-05-10T01:21:56.398490+0000","last_undegraded":"2023-05-10T01:21:56.398490+0000","last_fullsized":"2023-05-10T01:21:56.398490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390284+0000","last_change":"2023-05-10T01:21:55.989997+0000","last_active":"2023-05-10T01:21:56.390284+0000","last_peered":"2023-05-10T01:21:56.390284+0000","last_clean":"2023-05-10T01:21:56.390284+0000","last_became_active":"2023-05-10T01:21:55.989659+0000","last_became_peered":"2023-05-10T01:21:55.989659+0000","last_unstale":"2023-05-10T01:21:56.390284+0000","last_undegraded":"2023-05-10T01:21:56.390284+0000","last_fullsized":"2023-05-10T01:21:56.390284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391715+0000","last_change":"2023-05-10T01:21:56.386757+0000","last_active":"2023-05-10T01:21:56.391715+0000","last_peered":"2023-05-10T01:21:56.391715+0000","last_clean":"2023-05-10T01:21:56.391715+0000","last_became_active":"2023-05-10T01:21:56.386481+0000","last_became_peered":"2023-05-10T01:21:56.386481+0000","last_unstale":"2023-05-10T01:21:56.391715+0000","last_undegraded":"2023-05-10T01:21:56.391715+0000","last_fullsized":"2023-05-10T01:21:56.391715+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396357+0000","last_change":"2023-05-10T01:21:55.983679+0000","last_active":"2023-05-10T01:21:56.396357+0000","last_peered":"2023-05-10T01:21:56.396357+0000","last_clean":"2023-05-10T01:21:56.396357+0000","last_became_active":"2023-05-10T01:21:55.983331+0000","last_became_peered":"2023-05-10T01:21:55.983331+0000","last_unstale":"2023-05-10T01:21:56.396357+0000","last_undegraded":"2023-05-10T01:21:56.396357+0000","last_fullsized":"2023-05-10T01:21:56.396357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387810+0000","last_change":"2023-05-10T01:21:56.382093+0000","last_active":"2023-05-10T01:21:56.387810+0000","last_peered":"2023-05-10T01:21:56.387810+0000","last_clean":"2023-05-10T01:21:56.387810+0000","last_became_active":"2023-05-10T01:21:56.381808+0000","last_became_peered":"2023-05-10T01:21:56.381808+0000","last_unstale":"2023-05-10T01:21:56.387810+0000","last_undegraded":"2023-05-10T01:21:56.387810+0000","last_fullsized":"2023-05-10T01:21:56.387810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376180+0000","last_change":"2023-05-10T01:21:55.985464+0000","last_active":"2023-05-10T01:21:56.376180+0000","last_peered":"2023-05-10T01:21:56.376180+0000","last_clean":"2023-05-10T01:21:56.376180+0000","last_became_active":"2023-05-10T01:21:55.984713+0000","last_became_peered":"2023-05-10T01:21:55.984713+0000","last_unstale":"2023-05-10T01:21:56.376180+0000","last_undegraded":"2023-05-10T01:21:56.376180+0000","last_fullsized":"2023-05-10T01:21:56.376180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390050+0000","last_change":"2023-05-10T01:21:56.388436+0000","last_active":"2023-05-10T01:21:56.390050+0000","last_peered":"2023-05-10T01:21:56.390050+0000","last_clean":"2023-05-10T01:21:56.390050+0000","last_became_active":"2023-05-10T01:21:56.387905+0000","last_became_peered":"2023-05-10T01:21:56.387905+0000","last_unstale":"2023-05-10T01:21:56.390050+0000","last_undegraded":"2023-05-10T01:21:56.390050+0000","last_fullsized":"2023-05-10T01:21:56.390050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.381068+0000","last_change":"2023-05-10T01:21:55.982476+0000","last_active":"2023-05-10T01:21:56.381068+0000","last_peered":"2023-05-10T01:21:56.381068+0000","last_clean":"2023-05-10T01:21:56.381068+0000","last_became_active":"2023-05-10T01:21:55.981967+0000","last_became_peered":"2023-05-10T01:21:55.981967+0000","last_unstale":"2023-05-10T01:21:56.381068+0000","last_undegraded":"2023-05-10T01:21:56.381068+0000","last_fullsized":"2023-05-10T01:21:56.381068+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390425+0000","last_change":"2023-05-10T01:21:56.384117+0000","last_active":"2023-05-10T01:21:56.390425+0000","last_peered":"2023-05-10T01:21:56.390425+0000","last_clean":"2023-05-10T01:21:56.390425+0000","last_became_active":"2023-05-10T01:21:56.383746+0000","last_became_peered":"2023-05-10T01:21:56.383746+0000","last_unstale":"2023-05-10T01:21:56.390425+0000","last_undegraded":"2023-05-10T01:21:56.390425+0000","last_fullsized":"2023-05-10T01:21:56.390425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378052+0000","last_change":"2023-05-10T01:21:55.981940+0000","last_active":"2023-05-10T01:21:56.378052+0000","last_peered":"2023-05-10T01:21:56.378052+0000","last_clean":"2023-05-10T01:21:56.378052+0000","last_became_active":"2023-05-10T01:21:55.981594+0000","last_became_peered":"2023-05-10T01:21:55.981594+0000","last_unstale":"2023-05-10T01:21:56.378052+0000","last_undegraded":"2023-05-10T01:21:56.378052+0000","last_fullsized":"2023-05-10T01:21:56.378052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390861+0000","last_change":"2023-05-10T01:21:56.384951+0000","last_active":"2023-05-10T01:21:56.390861+0000","last_peered":"2023-05-10T01:21:56.390861+0000","last_clean":"2023-05-10T01:21:56.390861+0000","last_became_active":"2023-05-10T01:21:56.384677+0000","last_became_peered":"2023-05-10T01:21:56.384677+0000","last_unstale":"2023-05-10T01:21:56.390861+0000","last_undegraded":"2023-05-10T01:21:56.390861+0000","last_fullsized":"2023-05-10T01:21:56.390861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384944+0000","last_change":"2023-05-10T01:21:55.986675+0000","last_active":"2023-05-10T01:21:56.384944+0000","last_peered":"2023-05-10T01:21:56.384944+0000","last_clean":"2023-05-10T01:21:56.384944+0000","last_became_active":"2023-05-10T01:21:55.986356+0000","last_became_peered":"2023-05-10T01:21:55.986356+0000","last_unstale":"2023-05-10T01:21:56.384944+0000","last_undegraded":"2023-05-10T01:21:56.384944+0000","last_fullsized":"2023-05-10T01:21:56.384944+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394680+0000","last_change":"2023-05-10T01:21:56.387696+0000","last_active":"2023-05-10T01:21:56.394680+0000","last_peered":"2023-05-10T01:21:56.394680+0000","last_clean":"2023-05-10T01:21:56.394680+0000","last_became_active":"2023-05-10T01:21:56.387266+0000","last_became_peered":"2023-05-10T01:21:56.387266+0000","last_unstale":"2023-05-10T01:21:56.394680+0000","last_undegraded":"2023-05-10T01:21:56.394680+0000","last_fullsized":"2023-05-10T01:21:56.394680+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393043+0000","last_change":"2023-05-10T01:21:55.988036+0000","last_active":"2023-05-10T01:21:56.393043+0000","last_peered":"2023-05-10T01:21:56.393043+0000","last_clean":"2023-05-10T01:21:56.393043+0000","last_became_active":"2023-05-10T01:21:55.987731+0000","last_became_peered":"2023-05-10T01:21:55.987731+0000","last_unstale":"2023-05-10T01:21:56.393043+0000","last_undegraded":"2023-05-10T01:21:56.393043+0000","last_fullsized":"2023-05-10T01:21:56.393043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383820+0000","last_change":"2023-05-10T01:21:56.381131+0000","last_active":"2023-05-10T01:21:56.383820+0000","last_peered":"2023-05-10T01:21:56.383820+0000","last_clean":"2023-05-10T01:21:56.383820+0000","last_became_active":"2023-05-10T01:21:56.380922+0000","last_became_peered":"2023-05-10T01:21:56.380922+0000","last_unstale":"2023-05-10T01:21:56.383820+0000","last_undegraded":"2023-05-10T01:21:56.383820+0000","last_fullsized":"2023-05-10T01:21:56.383820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375476+0000","last_change":"2023-05-10T01:21:55.981305+0000","last_active":"2023-05-10T01:21:56.375476+0000","last_peered":"2023-05-10T01:21:56.375476+0000","last_clean":"2023-05-10T01:21:56.375476+0000","last_became_active":"2023-05-10T01:21:55.980073+0000","last_became_peered":"2023-05-10T01:21:55.980073+0000","last_unstale":"2023-05-10T01:21:56.375476+0000","last_undegraded":"2023-05-10T01:21:56.375476+0000","last_fullsized":"2023-05-10T01:21:56.375476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391889+0000","last_change":"2023-05-10T01:21:56.388494+0000","last_active":"2023-05-10T01:21:56.391889+0000","last_peered":"2023-05-10T01:21:56.391889+0000","last_clean":"2023-05-10T01:21:56.391889+0000","last_became_active":"2023-05-10T01:21:56.388105+0000","last_became_peered":"2023-05-10T01:21:56.388105+0000","last_unstale":"2023-05-10T01:21:56.391889+0000","last_undegraded":"2023-05-10T01:21:56.391889+0000","last_fullsized":"2023-05-10T01:21:56.391889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372965+0000","last_change":"2023-05-10T01:21:55.990808+0000","last_active":"2023-05-10T01:21:56.372965+0000","last_peered":"2023-05-10T01:21:56.372965+0000","last_clean":"2023-05-10T01:21:56.372965+0000","last_became_active":"2023-05-10T01:21:55.990499+0000","last_became_peered":"2023-05-10T01:21:55.990499+0000","last_unstale":"2023-05-10T01:21:56.372965+0000","last_undegraded":"2023-05-10T01:21:56.372965+0000","last_fullsized":"2023-05-10T01:21:56.372965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392208+0000","last_change":"2023-05-10T01:21:56.389444+0000","last_active":"2023-05-10T01:21:56.392208+0000","last_peered":"2023-05-10T01:21:56.392208+0000","last_clean":"2023-05-10T01:21:56.392208+0000","last_became_active":"2023-05-10T01:21:56.389170+0000","last_became_peered":"2023-05-10T01:21:56.389170+0000","last_unstale":"2023-05-10T01:21:56.392208+0000","last_undegraded":"2023-05-10T01:21:56.392208+0000","last_fullsized":"2023-05-10T01:21:56.392208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384494+0000","last_change":"2023-05-10T01:21:55.986616+0000","last_active":"2023-05-10T01:21:56.384494+0000","last_peered":"2023-05-10T01:21:56.384494+0000","last_clean":"2023-05-10T01:21:56.384494+0000","last_became_active":"2023-05-10T01:21:55.986336+0000","last_became_peered":"2023-05-10T01:21:55.986336+0000","last_unstale":"2023-05-10T01:21:56.384494+0000","last_undegraded":"2023-05-10T01:21:56.384494+0000","last_fullsized":"2023-05-10T01:21:56.384494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393912+0000","last_change":"2023-05-10T01:21:56.391042+0000","last_active":"2023-05-10T01:21:56.393912+0000","last_peered":"2023-05-10T01:21:56.393912+0000","last_clean":"2023-05-10T01:21:56.393912+0000","last_became_active":"2023-05-10T01:21:56.389952+0000","last_became_peered":"2023-05-10T01:21:56.389952+0000","last_unstale":"2023-05-10T01:21:56.393912+0000","last_undegraded":"2023-05-10T01:21:56.393912+0000","last_fullsized":"2023-05-10T01:21:56.393912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375539+0000","last_change":"2023-05-10T01:21:55.983291+0000","last_active":"2023-05-10T01:21:56.375539+0000","last_peered":"2023-05-10T01:21:56.375539+0000","last_clean":"2023-05-10T01:21:56.375539+0000","last_became_active":"2023-05-10T01:21:55.983015+0000","last_became_peered":"2023-05-10T01:21:55.983015+0000","last_unstale":"2023-05-10T01:21:56.375539+0000","last_undegraded":"2023-05-10T01:21:56.375539+0000","last_fullsized":"2023-05-10T01:21:56.375539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393915+0000","last_change":"2023-05-10T01:21:56.391109+0000","last_active":"2023-05-10T01:21:56.393915+0000","last_peered":"2023-05-10T01:21:56.393915+0000","last_clean":"2023-05-10T01:21:56.393915+0000","last_became_active":"2023-05-10T01:21:56.390826+0000","last_became_peered":"2023-05-10T01:21:56.390826+0000","last_unstale":"2023-05-10T01:21:56.393915+0000","last_undegraded":"2023-05-10T01:21:56.393915+0000","last_fullsized":"2023-05-10T01:21:56.393915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373208+0000","last_change":"2023-05-10T01:21:55.983553+0000","last_active":"2023-05-10T01:21:56.373208+0000","last_peered":"2023-05-10T01:21:56.373208+0000","last_clean":"2023-05-10T01:21:56.373208+0000","last_became_active":"2023-05-10T01:21:55.983243+0000","last_became_peered":"2023-05-10T01:21:55.983243+0000","last_unstale":"2023-05-10T01:21:56.373208+0000","last_undegraded":"2023-05-10T01:21:56.373208+0000","last_fullsized":"2023-05-10T01:21:56.373208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395257+0000","last_change":"2023-05-10T01:21:56.390161+0000","last_active":"2023-05-10T01:21:56.395257+0000","last_peered":"2023-05-10T01:21:56.395257+0000","last_clean":"2023-05-10T01:21:56.395257+0000","last_became_active":"2023-05-10T01:21:56.389337+0000","last_became_peered":"2023-05-10T01:21:56.389337+0000","last_unstale":"2023-05-10T01:21:56.395257+0000","last_undegraded":"2023-05-10T01:21:56.395257+0000","last_fullsized":"2023-05-10T01:21:56.395257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387352+0000","last_change":"2023-05-10T01:21:55.974943+0000","last_active":"2023-05-10T01:21:56.387352+0000","last_peered":"2023-05-10T01:21:56.387352+0000","last_clean":"2023-05-10T01:21:56.387352+0000","last_became_active":"2023-05-10T01:21:55.974038+0000","last_became_peered":"2023-05-10T01:21:55.974038+0000","last_unstale":"2023-05-10T01:21:56.387352+0000","last_undegraded":"2023-05-10T01:21:56.387352+0000","last_fullsized":"2023-05-10T01:21:56.387352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394227+0000","last_change":"2023-05-10T01:21:56.392110+0000","last_active":"2023-05-10T01:21:56.394227+0000","last_peered":"2023-05-10T01:21:56.394227+0000","last_clean":"2023-05-10T01:21:56.394227+0000","last_became_active":"2023-05-10T01:21:56.391610+0000","last_became_peered":"2023-05-10T01:21:56.391610+0000","last_unstale":"2023-05-10T01:21:56.394227+0000","last_undegraded":"2023-05-10T01:21:56.394227+0000","last_fullsized":"2023-05-10T01:21:56.394227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394405+0000","last_change":"2023-05-10T01:21:55.976254+0000","last_active":"2023-05-10T01:21:56.394405+0000","last_peered":"2023-05-10T01:21:56.394405+0000","last_clean":"2023-05-10T01:21:56.394405+0000","last_became_active":"2023-05-10T01:21:55.975943+0000","last_became_peered":"2023-05-10T01:21:55.975943+0000","last_unstale":"2023-05-10T01:21:56.394405+0000","last_undegraded":"2023-05-10T01:21:56.394405+0000","last_fullsized":"2023-05-10T01:21:56.394405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393462+0000","last_change":"2023-05-10T01:21:56.383749+0000","last_active":"2023-05-10T01:21:56.393462+0000","last_peered":"2023-05-10T01:21:56.393462+0000","last_clean":"2023-05-10T01:21:56.393462+0000","last_became_active":"2023-05-10T01:21:56.382989+0000","last_became_peered":"2023-05-10T01:21:56.382989+0000","last_unstale":"2023-05-10T01:21:56.393462+0000","last_undegraded":"2023-05-10T01:21:56.393462+0000","last_fullsized":"2023-05-10T01:21:56.393462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386928+0000","last_change":"2023-05-10T01:21:55.988303+0000","last_active":"2023-05-10T01:21:56.386928+0000","last_peered":"2023-05-10T01:21:56.386928+0000","last_clean":"2023-05-10T01:21:56.386928+0000","last_became_active":"2023-05-10T01:21:55.987986+0000","last_became_peered":"2023-05-10T01:21:55.987986+0000","last_unstale":"2023-05-10T01:21:56.386928+0000","last_undegraded":"2023-05-10T01:21:56.386928+0000","last_fullsized":"2023-05-10T01:21:56.386928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391871+0000","last_change":"2023-05-10T01:21:56.388636+0000","last_active":"2023-05-10T01:21:56.391871+0000","last_peered":"2023-05-10T01:21:56.391871+0000","last_clean":"2023-05-10T01:21:56.391871+0000","last_became_active":"2023-05-10T01:21:56.388107+0000","last_became_peered":"2023-05-10T01:21:56.388107+0000","last_unstale":"2023-05-10T01:21:56.391871+0000","last_undegraded":"2023-05-10T01:21:56.391871+0000","last_fullsized":"2023-05-10T01:21:56.391871+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395972+0000","last_change":"2023-05-10T01:21:55.979791+0000","last_active":"2023-05-10T01:21:56.395972+0000","last_peered":"2023-05-10T01:21:56.395972+0000","last_clean":"2023-05-10T01:21:56.395972+0000","last_became_active":"2023-05-10T01:21:55.978489+0000","last_became_peered":"2023-05-10T01:21:55.978489+0000","last_unstale":"2023-05-10T01:21:56.395972+0000","last_undegraded":"2023-05-10T01:21:56.395972+0000","last_fullsized":"2023-05-10T01:21:56.395972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390030+0000","last_change":"2023-05-10T01:21:56.386816+0000","last_active":"2023-05-10T01:21:56.390030+0000","last_peered":"2023-05-10T01:21:56.390030+0000","last_clean":"2023-05-10T01:21:56.390030+0000","last_became_active":"2023-05-10T01:21:56.386546+0000","last_became_peered":"2023-05-10T01:21:56.386546+0000","last_unstale":"2023-05-10T01:21:56.390030+0000","last_undegraded":"2023-05-10T01:21:56.390030+0000","last_fullsized":"2023-05-10T01:21:56.390030+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373089+0000","last_change":"2023-05-10T01:21:55.988218+0000","last_active":"2023-05-10T01:21:56.373089+0000","last_peered":"2023-05-10T01:21:56.373089+0000","last_clean":"2023-05-10T01:21:56.373089+0000","last_became_active":"2023-05-10T01:21:55.987936+0000","last_became_peered":"2023-05-10T01:21:55.987936+0000","last_unstale":"2023-05-10T01:21:56.373089+0000","last_undegraded":"2023-05-10T01:21:56.373089+0000","last_fullsized":"2023-05-10T01:21:56.373089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396213+0000","last_change":"2023-05-10T01:21:56.393981+0000","last_active":"2023-05-10T01:21:56.396213+0000","last_peered":"2023-05-10T01:21:56.396213+0000","last_clean":"2023-05-10T01:21:56.396213+0000","last_became_active":"2023-05-10T01:21:56.393672+0000","last_became_peered":"2023-05-10T01:21:56.393672+0000","last_unstale":"2023-05-10T01:21:56.396213+0000","last_undegraded":"2023-05-10T01:21:56.396213+0000","last_fullsized":"2023-05-10T01:21:56.396213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374941+0000","last_change":"2023-05-10T01:21:55.982605+0000","last_active":"2023-05-10T01:21:56.374941+0000","last_peered":"2023-05-10T01:21:56.374941+0000","last_clean":"2023-05-10T01:21:56.374941+0000","last_became_active":"2023-05-10T01:21:55.981073+0000","last_became_peered":"2023-05-10T01:21:55.981073+0000","last_unstale":"2023-05-10T01:21:56.374941+0000","last_undegraded":"2023-05-10T01:21:56.374941+0000","last_fullsized":"2023-05-10T01:21:56.374941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393378+0000","last_change":"2023-05-10T01:21:56.389293+0000","last_active":"2023-05-10T01:21:56.393378+0000","last_peered":"2023-05-10T01:21:56.393378+0000","last_clean":"2023-05-10T01:21:56.393378+0000","last_became_active":"2023-05-10T01:21:56.388996+0000","last_became_peered":"2023-05-10T01:21:56.388996+0000","last_unstale":"2023-05-10T01:21:56.393378+0000","last_undegraded":"2023-05-10T01:21:56.393378+0000","last_fullsized":"2023-05-10T01:21:56.393378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375642+0000","last_change":"2023-05-10T01:21:55.978009+0000","last_active":"2023-05-10T01:21:56.375642+0000","last_peered":"2023-05-10T01:21:56.375642+0000","last_clean":"2023-05-10T01:21:56.375642+0000","last_became_active":"2023-05-10T01:21:55.977745+0000","last_became_peered":"2023-05-10T01:21:55.977745+0000","last_unstale":"2023-05-10T01:21:56.375642+0000","last_undegraded":"2023-05-10T01:21:56.375642+0000","last_fullsized":"2023-05-10T01:21:56.375642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390033+0000","last_change":"2023-05-10T01:21:56.387952+0000","last_active":"2023-05-10T01:21:56.390033+0000","last_peered":"2023-05-10T01:21:56.390033+0000","last_clean":"2023-05-10T01:21:56.390033+0000","last_became_active":"2023-05-10T01:21:56.387673+0000","last_became_peered":"2023-05-10T01:21:56.387673+0000","last_unstale":"2023-05-10T01:21:56.390033+0000","last_undegraded":"2023-05-10T01:21:56.390033+0000","last_fullsized":"2023-05-10T01:21:56.390033+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384944+0000","last_change":"2023-05-10T01:21:55.982311+0000","last_active":"2023-05-10T01:21:56.384944+0000","last_peered":"2023-05-10T01:21:56.384944+0000","last_clean":"2023-05-10T01:21:56.384944+0000","last_became_active":"2023-05-10T01:21:55.981700+0000","last_became_peered":"2023-05-10T01:21:55.981700+0000","last_unstale":"2023-05-10T01:21:56.384944+0000","last_undegraded":"2023-05-10T01:21:56.384944+0000","last_fullsized":"2023-05-10T01:21:56.384944+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393179+0000","last_change":"2023-05-10T01:21:56.388591+0000","last_active":"2023-05-10T01:21:56.393179+0000","last_peered":"2023-05-10T01:21:56.393179+0000","last_clean":"2023-05-10T01:21:56.393179+0000","last_became_active":"2023-05-10T01:21:56.388330+0000","last_became_peered":"2023-05-10T01:21:56.388330+0000","last_unstale":"2023-05-10T01:21:56.393179+0000","last_undegraded":"2023-05-10T01:21:56.393179+0000","last_fullsized":"2023-05-10T01:21:56.393179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373474+0000","last_change":"2023-05-10T01:21:55.989894+0000","last_active":"2023-05-10T01:21:56.373474+0000","last_peered":"2023-05-10T01:21:56.373474+0000","last_clean":"2023-05-10T01:21:56.373474+0000","last_became_active":"2023-05-10T01:21:55.989151+0000","last_became_peered":"2023-05-10T01:21:55.989151+0000","last_unstale":"2023-05-10T01:21:56.373474+0000","last_undegraded":"2023-05-10T01:21:56.373474+0000","last_fullsized":"2023-05-10T01:21:56.373474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401225+0000","last_change":"2023-05-10T01:21:56.397647+0000","last_active":"2023-05-10T01:21:56.401225+0000","last_peered":"2023-05-10T01:21:56.401225+0000","last_clean":"2023-05-10T01:21:56.401225+0000","last_became_active":"2023-05-10T01:21:56.397366+0000","last_became_peered":"2023-05-10T01:21:56.397366+0000","last_unstale":"2023-05-10T01:21:56.401225+0000","last_undegraded":"2023-05-10T01:21:56.401225+0000","last_fullsized":"2023-05-10T01:21:56.401225+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378852+0000","last_change":"2023-05-10T01:21:55.982590+0000","last_active":"2023-05-10T01:21:56.378852+0000","last_peered":"2023-05-10T01:21:56.378852+0000","last_clean":"2023-05-10T01:21:56.378852+0000","last_became_active":"2023-05-10T01:21:55.982253+0000","last_became_peered":"2023-05-10T01:21:55.982253+0000","last_unstale":"2023-05-10T01:21:56.378852+0000","last_undegraded":"2023-05-10T01:21:56.378852+0000","last_fullsized":"2023-05-10T01:21:56.378852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394756+0000","last_change":"2023-05-10T01:21:56.387217+0000","last_active":"2023-05-10T01:21:56.394756+0000","last_peered":"2023-05-10T01:21:56.394756+0000","last_clean":"2023-05-10T01:21:56.394756+0000","last_became_active":"2023-05-10T01:21:56.386938+0000","last_became_peered":"2023-05-10T01:21:56.386938+0000","last_unstale":"2023-05-10T01:21:56.394756+0000","last_undegraded":"2023-05-10T01:21:56.394756+0000","last_fullsized":"2023-05-10T01:21:56.394756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377710+0000","last_change":"2023-05-10T01:21:55.986297+0000","last_active":"2023-05-10T01:21:56.377710+0000","last_peered":"2023-05-10T01:21:56.377710+0000","last_clean":"2023-05-10T01:21:56.377710+0000","last_became_active":"2023-05-10T01:21:55.985992+0000","last_became_peered":"2023-05-10T01:21:55.985992+0000","last_unstale":"2023-05-10T01:21:56.377710+0000","last_undegraded":"2023-05-10T01:21:56.377710+0000","last_fullsized":"2023-05-10T01:21:56.377710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398235+0000","last_change":"2023-05-10T01:21:56.394951+0000","last_active":"2023-05-10T01:21:56.398235+0000","last_peered":"2023-05-10T01:21:56.398235+0000","last_clean":"2023-05-10T01:21:56.398235+0000","last_became_active":"2023-05-10T01:21:56.394686+0000","last_became_peered":"2023-05-10T01:21:56.394686+0000","last_unstale":"2023-05-10T01:21:56.398235+0000","last_undegraded":"2023-05-10T01:21:56.398235+0000","last_fullsized":"2023-05-10T01:21:56.398235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396915+0000","last_change":"2023-05-10T01:21:55.984800+0000","last_active":"2023-05-10T01:21:56.396915+0000","last_peered":"2023-05-10T01:21:56.396915+0000","last_clean":"2023-05-10T01:21:56.396915+0000","last_became_active":"2023-05-10T01:21:55.984524+0000","last_became_peered":"2023-05-10T01:21:55.984524+0000","last_unstale":"2023-05-10T01:21:56.396915+0000","last_undegraded":"2023-05-10T01:21:56.396915+0000","last_fullsized":"2023-05-10T01:21:56.396915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393450+0000","last_change":"2023-05-10T01:21:56.389449+0000","last_active":"2023-05-10T01:21:56.393450+0000","last_peered":"2023-05-10T01:21:56.393450+0000","last_clean":"2023-05-10T01:21:56.393450+0000","last_became_active":"2023-05-10T01:21:56.388600+0000","last_became_peered":"2023-05-10T01:21:56.388600+0000","last_unstale":"2023-05-10T01:21:56.393450+0000","last_undegraded":"2023-05-10T01:21:56.393450+0000","last_fullsized":"2023-05-10T01:21:56.393450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394810+0000","last_change":"2023-05-10T01:21:55.986935+0000","last_active":"2023-05-10T01:21:56.394810+0000","last_peered":"2023-05-10T01:21:56.394810+0000","last_clean":"2023-05-10T01:21:56.394810+0000","last_became_active":"2023-05-10T01:21:55.986618+0000","last_became_peered":"2023-05-10T01:21:55.986618+0000","last_unstale":"2023-05-10T01:21:56.394810+0000","last_undegraded":"2023-05-10T01:21:56.394810+0000","last_fullsized":"2023-05-10T01:21:56.394810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395310+0000","last_change":"2023-05-10T01:21:56.385256+0000","last_active":"2023-05-10T01:21:56.395310+0000","last_peered":"2023-05-10T01:21:56.395310+0000","last_clean":"2023-05-10T01:21:56.395310+0000","last_became_active":"2023-05-10T01:21:56.384982+0000","last_became_peered":"2023-05-10T01:21:56.384982+0000","last_unstale":"2023-05-10T01:21:56.395310+0000","last_undegraded":"2023-05-10T01:21:56.395310+0000","last_fullsized":"2023-05-10T01:21:56.395310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387897+0000","last_change":"2023-05-10T01:21:55.988593+0000","last_active":"2023-05-10T01:21:56.387897+0000","last_peered":"2023-05-10T01:21:56.387897+0000","last_clean":"2023-05-10T01:21:56.387897+0000","last_became_active":"2023-05-10T01:21:55.986001+0000","last_became_peered":"2023-05-10T01:21:55.986001+0000","last_unstale":"2023-05-10T01:21:56.387897+0000","last_undegraded":"2023-05-10T01:21:56.387897+0000","last_fullsized":"2023-05-10T01:21:56.387897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390764+0000","last_change":"2023-05-10T01:21:56.384859+0000","last_active":"2023-05-10T01:21:56.390764+0000","last_peered":"2023-05-10T01:21:56.390764+0000","last_clean":"2023-05-10T01:21:56.390764+0000","last_became_active":"2023-05-10T01:21:56.384456+0000","last_became_peered":"2023-05-10T01:21:56.384456+0000","last_unstale":"2023-05-10T01:21:56.390764+0000","last_undegraded":"2023-05-10T01:21:56.390764+0000","last_fullsized":"2023-05-10T01:21:56.390764+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384127+0000","last_change":"2023-05-10T01:21:55.989343+0000","last_active":"2023-05-10T01:21:56.384127+0000","last_peered":"2023-05-10T01:21:56.384127+0000","last_clean":"2023-05-10T01:21:56.384127+0000","last_became_active":"2023-05-10T01:21:55.989107+0000","last_became_peered":"2023-05-10T01:21:55.989107+0000","last_unstale":"2023-05-10T01:21:56.384127+0000","last_undegraded":"2023-05-10T01:21:56.384127+0000","last_fullsized":"2023-05-10T01:21:56.384127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394649+0000","last_change":"2023-05-10T01:21:56.388984+0000","last_active":"2023-05-10T01:21:56.394649+0000","last_peered":"2023-05-10T01:21:56.394649+0000","last_clean":"2023-05-10T01:21:56.394649+0000","last_became_active":"2023-05-10T01:21:56.388706+0000","last_became_peered":"2023-05-10T01:21:56.388706+0000","last_unstale":"2023-05-10T01:21:56.394649+0000","last_undegraded":"2023-05-10T01:21:56.394649+0000","last_fullsized":"2023-05-10T01:21:56.394649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378918+0000","last_change":"2023-05-10T01:21:55.979920+0000","last_active":"2023-05-10T01:21:56.378918+0000","last_peered":"2023-05-10T01:21:56.378918+0000","last_clean":"2023-05-10T01:21:56.378918+0000","last_became_active":"2023-05-10T01:21:55.979642+0000","last_became_peered":"2023-05-10T01:21:55.979642+0000","last_unstale":"2023-05-10T01:21:56.378918+0000","last_undegraded":"2023-05-10T01:21:56.378918+0000","last_fullsized":"2023-05-10T01:21:56.378918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395277+0000","last_change":"2023-05-10T01:21:56.390549+0000","last_active":"2023-05-10T01:21:56.395277+0000","last_peered":"2023-05-10T01:21:56.395277+0000","last_clean":"2023-05-10T01:21:56.395277+0000","last_became_active":"2023-05-10T01:21:56.389725+0000","last_became_peered":"2023-05-10T01:21:56.389725+0000","last_unstale":"2023-05-10T01:21:56.395277+0000","last_undegraded":"2023-05-10T01:21:56.395277+0000","last_fullsized":"2023-05-10T01:21:56.395277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397441+0000","last_change":"2023-05-10T01:21:55.985996+0000","last_active":"2023-05-10T01:21:56.397441+0000","last_peered":"2023-05-10T01:21:56.397441+0000","last_clean":"2023-05-10T01:21:56.397441+0000","last_became_active":"2023-05-10T01:21:55.985693+0000","last_became_peered":"2023-05-10T01:21:55.985693+0000","last_unstale":"2023-05-10T01:21:56.397441+0000","last_undegraded":"2023-05-10T01:21:56.397441+0000","last_fullsized":"2023-05-10T01:21:56.397441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390084+0000","last_change":"2023-05-10T01:21:56.387575+0000","last_active":"2023-05-10T01:21:56.390084+0000","last_peered":"2023-05-10T01:21:56.390084+0000","last_clean":"2023-05-10T01:21:56.390084+0000","last_became_active":"2023-05-10T01:21:56.387380+0000","last_became_peered":"2023-05-10T01:21:56.387380+0000","last_unstale":"2023-05-10T01:21:56.390084+0000","last_undegraded":"2023-05-10T01:21:56.390084+0000","last_fullsized":"2023-05-10T01:21:56.390084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384279+0000","last_change":"2023-05-10T01:21:55.994254+0000","last_active":"2023-05-10T01:21:56.384279+0000","last_peered":"2023-05-10T01:21:56.384279+0000","last_clean":"2023-05-10T01:21:56.384279+0000","last_became_active":"2023-05-10T01:21:55.993796+0000","last_became_peered":"2023-05-10T01:21:55.993796+0000","last_unstale":"2023-05-10T01:21:56.384279+0000","last_undegraded":"2023-05-10T01:21:56.384279+0000","last_fullsized":"2023-05-10T01:21:56.384279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395063+0000","last_change":"2023-05-10T01:21:56.385556+0000","last_active":"2023-05-10T01:21:56.395063+0000","last_peered":"2023-05-10T01:21:56.395063+0000","last_clean":"2023-05-10T01:21:56.395063+0000","last_became_active":"2023-05-10T01:21:56.381923+0000","last_became_peered":"2023-05-10T01:21:56.381923+0000","last_unstale":"2023-05-10T01:21:56.395063+0000","last_undegraded":"2023-05-10T01:21:56.395063+0000","last_fullsized":"2023-05-10T01:21:56.395063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396818+0000","last_change":"2023-05-10T01:21:55.981924+0000","last_active":"2023-05-10T01:21:56.396818+0000","last_peered":"2023-05-10T01:21:56.396818+0000","last_clean":"2023-05-10T01:21:56.396818+0000","last_became_active":"2023-05-10T01:21:55.981638+0000","last_became_peered":"2023-05-10T01:21:55.981638+0000","last_unstale":"2023-05-10T01:21:56.396818+0000","last_undegraded":"2023-05-10T01:21:56.396818+0000","last_fullsized":"2023-05-10T01:21:56.396818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391717+0000","last_change":"2023-05-10T01:21:56.389256+0000","last_active":"2023-05-10T01:21:56.391717+0000","last_peered":"2023-05-10T01:21:56.391717+0000","last_clean":"2023-05-10T01:21:56.391717+0000","last_became_active":"2023-05-10T01:21:56.388978+0000","last_became_peered":"2023-05-10T01:21:56.388978+0000","last_unstale":"2023-05-10T01:21:56.391717+0000","last_undegraded":"2023-05-10T01:21:56.391717+0000","last_fullsized":"2023-05-10T01:21:56.391717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384290+0000","last_change":"2023-05-10T01:21:55.982209+0000","last_active":"2023-05-10T01:21:56.384290+0000","last_peered":"2023-05-10T01:21:56.384290+0000","last_clean":"2023-05-10T01:21:56.384290+0000","last_became_active":"2023-05-10T01:21:55.981922+0000","last_became_peered":"2023-05-10T01:21:55.981922+0000","last_unstale":"2023-05-10T01:21:56.384290+0000","last_undegraded":"2023-05-10T01:21:56.384290+0000","last_fullsized":"2023-05-10T01:21:56.384290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396433+0000","last_change":"2023-05-10T01:21:56.392425+0000","last_active":"2023-05-10T01:21:56.396433+0000","last_peered":"2023-05-10T01:21:56.396433+0000","last_clean":"2023-05-10T01:21:56.396433+0000","last_became_active":"2023-05-10T01:21:56.388917+0000","last_became_peered":"2023-05-10T01:21:56.388917+0000","last_unstale":"2023-05-10T01:21:56.396433+0000","last_undegraded":"2023-05-10T01:21:56.396433+0000","last_fullsized":"2023-05-10T01:21:56.396433+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384283+0000","last_change":"2023-05-10T01:21:55.983687+0000","last_active":"2023-05-10T01:21:56.384283+0000","last_peered":"2023-05-10T01:21:56.384283+0000","last_clean":"2023-05-10T01:21:56.384283+0000","last_became_active":"2023-05-10T01:21:55.983496+0000","last_became_peered":"2023-05-10T01:21:55.983496+0000","last_unstale":"2023-05-10T01:21:56.384283+0000","last_undegraded":"2023-05-10T01:21:56.384283+0000","last_fullsized":"2023-05-10T01:21:56.384283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395333+0000","last_change":"2023-05-10T01:21:56.390584+0000","last_active":"2023-05-10T01:21:56.395333+0000","last_peered":"2023-05-10T01:21:56.395333+0000","last_clean":"2023-05-10T01:21:56.395333+0000","last_became_active":"2023-05-10T01:21:56.390323+0000","last_became_peered":"2023-05-10T01:21:56.390323+0000","last_unstale":"2023-05-10T01:21:56.395333+0000","last_undegraded":"2023-05-10T01:21:56.395333+0000","last_fullsized":"2023-05-10T01:21:56.395333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396396+0000","last_change":"2023-05-10T01:21:55.984806+0000","last_active":"2023-05-10T01:21:56.396396+0000","last_peered":"2023-05-10T01:21:56.396396+0000","last_clean":"2023-05-10T01:21:56.396396+0000","last_became_active":"2023-05-10T01:21:55.984490+0000","last_became_peered":"2023-05-10T01:21:55.984490+0000","last_unstale":"2023-05-10T01:21:56.396396+0000","last_undegraded":"2023-05-10T01:21:56.396396+0000","last_fullsized":"2023-05-10T01:21:56.396396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398704+0000","last_change":"2023-05-10T01:21:56.394803+0000","last_active":"2023-05-10T01:21:56.398704+0000","last_peered":"2023-05-10T01:21:56.398704+0000","last_clean":"2023-05-10T01:21:56.398704+0000","last_became_active":"2023-05-10T01:21:56.394534+0000","last_became_peered":"2023-05-10T01:21:56.394534+0000","last_unstale":"2023-05-10T01:21:56.398704+0000","last_undegraded":"2023-05-10T01:21:56.398704+0000","last_fullsized":"2023-05-10T01:21:56.398704+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375615+0000","last_change":"2023-05-10T01:21:55.987039+0000","last_active":"2023-05-10T01:21:56.375615+0000","last_peered":"2023-05-10T01:21:56.375615+0000","last_clean":"2023-05-10T01:21:56.375615+0000","last_became_active":"2023-05-10T01:21:55.986716+0000","last_became_peered":"2023-05-10T01:21:55.986716+0000","last_unstale":"2023-05-10T01:21:56.375615+0000","last_undegraded":"2023-05-10T01:21:56.375615+0000","last_fullsized":"2023-05-10T01:21:56.375615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398666+0000","last_change":"2023-05-10T01:21:56.395474+0000","last_active":"2023-05-10T01:21:56.398666+0000","last_peered":"2023-05-10T01:21:56.398666+0000","last_clean":"2023-05-10T01:21:56.398666+0000","last_became_active":"2023-05-10T01:21:56.395187+0000","last_became_peered":"2023-05-10T01:21:56.395187+0000","last_unstale":"2023-05-10T01:21:56.398666+0000","last_undegraded":"2023-05-10T01:21:56.398666+0000","last_fullsized":"2023-05-10T01:21:56.398666+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375565+0000","last_change":"2023-05-10T01:21:55.995788+0000","last_active":"2023-05-10T01:21:56.375565+0000","last_peered":"2023-05-10T01:21:56.375565+0000","last_clean":"2023-05-10T01:21:56.375565+0000","last_became_active":"2023-05-10T01:21:55.995511+0000","last_became_peered":"2023-05-10T01:21:55.995511+0000","last_unstale":"2023-05-10T01:21:56.375565+0000","last_undegraded":"2023-05-10T01:21:56.375565+0000","last_fullsized":"2023-05-10T01:21:56.375565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386948+0000","last_change":"2023-05-10T01:21:56.381977+0000","last_active":"2023-05-10T01:21:56.386948+0000","last_peered":"2023-05-10T01:21:56.386948+0000","last_clean":"2023-05-10T01:21:56.386948+0000","last_became_active":"2023-05-10T01:21:56.381674+0000","last_became_peered":"2023-05-10T01:21:56.381674+0000","last_unstale":"2023-05-10T01:21:56.386948+0000","last_undegraded":"2023-05-10T01:21:56.386948+0000","last_fullsized":"2023-05-10T01:21:56.386948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387454+0000","last_change":"2023-05-10T01:21:55.977748+0000","last_active":"2023-05-10T01:21:56.387454+0000","last_peered":"2023-05-10T01:21:56.387454+0000","last_clean":"2023-05-10T01:21:56.387454+0000","last_became_active":"2023-05-10T01:21:55.977444+0000","last_became_peered":"2023-05-10T01:21:55.977444+0000","last_unstale":"2023-05-10T01:21:56.387454+0000","last_undegraded":"2023-05-10T01:21:56.387454+0000","last_fullsized":"2023-05-10T01:21:56.387454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398685+0000","last_change":"2023-05-10T01:21:56.396855+0000","last_active":"2023-05-10T01:21:56.398685+0000","last_peered":"2023-05-10T01:21:56.398685+0000","last_clean":"2023-05-10T01:21:56.398685+0000","last_became_active":"2023-05-10T01:21:56.396558+0000","last_became_peered":"2023-05-10T01:21:56.396558+0000","last_unstale":"2023-05-10T01:21:56.398685+0000","last_undegraded":"2023-05-10T01:21:56.398685+0000","last_fullsized":"2023-05-10T01:21:56.398685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376271+0000","last_change":"2023-05-10T01:21:55.978862+0000","last_active":"2023-05-10T01:21:56.376271+0000","last_peered":"2023-05-10T01:21:56.376271+0000","last_clean":"2023-05-10T01:21:56.376271+0000","last_became_active":"2023-05-10T01:21:55.978571+0000","last_became_peered":"2023-05-10T01:21:55.978571+0000","last_unstale":"2023-05-10T01:21:56.376271+0000","last_undegraded":"2023-05-10T01:21:56.376271+0000","last_fullsized":"2023-05-10T01:21:56.376271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370802+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:21:56.370802+0000","last_peered":"2023-05-10T01:21:56.370802+0000","last_clean":"2023-05-10T01:21:56.370802+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:21:56.370802+0000","last_undegraded":"2023-05-10T01:21:56.370802+0000","last_fullsized":"2023-05-10T01:21:56.370802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394411+0000","last_change":"2023-05-10T01:21:56.386063+0000","last_active":"2023-05-10T01:21:56.394411+0000","last_peered":"2023-05-10T01:21:56.394411+0000","last_clean":"2023-05-10T01:21:56.394411+0000","last_became_active":"2023-05-10T01:21:56.385793+0000","last_became_peered":"2023-05-10T01:21:56.385793+0000","last_unstale":"2023-05-10T01:21:56.394411+0000","last_undegraded":"2023-05-10T01:21:56.394411+0000","last_fullsized":"2023-05-10T01:21:56.394411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396031+0000","last_change":"2023-05-10T01:21:55.989340+0000","last_active":"2023-05-10T01:21:56.396031+0000","last_peered":"2023-05-10T01:21:56.396031+0000","last_clean":"2023-05-10T01:21:56.396031+0000","last_became_active":"2023-05-10T01:21:55.989048+0000","last_became_peered":"2023-05-10T01:21:55.989048+0000","last_unstale":"2023-05-10T01:21:56.396031+0000","last_undegraded":"2023-05-10T01:21:56.396031+0000","last_fullsized":"2023-05-10T01:21:56.396031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372423+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:21:56.372423+0000","last_peered":"2023-05-10T01:21:56.372423+0000","last_clean":"2023-05-10T01:21:56.372423+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:21:56.372423+0000","last_undegraded":"2023-05-10T01:21:56.372423+0000","last_fullsized":"2023-05-10T01:21:56.372423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397071+0000","last_change":"2023-05-10T01:21:56.394425+0000","last_active":"2023-05-10T01:21:56.397071+0000","last_peered":"2023-05-10T01:21:56.397071+0000","last_clean":"2023-05-10T01:21:56.397071+0000","last_became_active":"2023-05-10T01:21:56.394093+0000","last_became_peered":"2023-05-10T01:21:56.394093+0000","last_unstale":"2023-05-10T01:21:56.397071+0000","last_undegraded":"2023-05-10T01:21:56.397071+0000","last_fullsized":"2023-05-10T01:21:56.397071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374092+0000","last_change":"2023-05-10T01:21:55.986090+0000","last_active":"2023-05-10T01:21:56.374092+0000","last_peered":"2023-05-10T01:21:56.374092+0000","last_clean":"2023-05-10T01:21:56.374092+0000","last_became_active":"2023-05-10T01:21:55.985835+0000","last_became_peered":"2023-05-10T01:21:55.985835+0000","last_unstale":"2023-05-10T01:21:56.374092+0000","last_undegraded":"2023-05-10T01:21:56.374092+0000","last_fullsized":"2023-05-10T01:21:56.374092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387545+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:21:56.387545+0000","last_peered":"2023-05-10T01:21:56.387545+0000","last_clean":"2023-05-10T01:21:56.387545+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:21:56.387545+0000","last_undegraded":"2023-05-10T01:21:56.387545+0000","last_fullsized":"2023-05-10T01:21:56.387545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393508+0000","last_change":"2023-05-10T01:21:56.392671+0000","last_active":"2023-05-10T01:21:56.393508+0000","last_peered":"2023-05-10T01:21:56.393508+0000","last_clean":"2023-05-10T01:21:56.393508+0000","last_became_active":"2023-05-10T01:21:56.392444+0000","last_became_peered":"2023-05-10T01:21:56.392444+0000","last_unstale":"2023-05-10T01:21:56.393508+0000","last_undegraded":"2023-05-10T01:21:56.393508+0000","last_fullsized":"2023-05-10T01:21:56.393508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374173+0000","last_change":"2023-05-10T01:21:55.993109+0000","last_active":"2023-05-10T01:21:56.374173+0000","last_peered":"2023-05-10T01:21:56.374173+0000","last_clean":"2023-05-10T01:21:56.374173+0000","last_became_active":"2023-05-10T01:21:55.992808+0000","last_became_peered":"2023-05-10T01:21:55.992808+0000","last_unstale":"2023-05-10T01:21:56.374173+0000","last_undegraded":"2023-05-10T01:21:56.374173+0000","last_fullsized":"2023-05-10T01:21:56.374173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372296+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:21:56.372296+0000","last_peered":"2023-05-10T01:21:56.372296+0000","last_clean":"2023-05-10T01:21:56.372296+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:21:56.372296+0000","last_undegraded":"2023-05-10T01:21:56.372296+0000","last_fullsized":"2023-05-10T01:21:56.372296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379073+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:21:56.379073+0000","last_peered":"2023-05-10T01:21:56.379073+0000","last_clean":"2023-05-10T01:21:56.379073+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:21:56.379073+0000","last_undegraded":"2023-05-10T01:21:56.379073+0000","last_fullsized":"2023-05-10T01:21:56.379073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395900+0000","last_change":"2023-05-10T01:21:56.388692+0000","last_active":"2023-05-10T01:21:56.395900+0000","last_peered":"2023-05-10T01:21:56.395900+0000","last_clean":"2023-05-10T01:21:56.395900+0000","last_became_active":"2023-05-10T01:21:56.388418+0000","last_became_peered":"2023-05-10T01:21:56.388418+0000","last_unstale":"2023-05-10T01:21:56.395900+0000","last_undegraded":"2023-05-10T01:21:56.395900+0000","last_fullsized":"2023-05-10T01:21:56.395900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379945+0000","last_change":"2023-05-10T01:21:55.981413+0000","last_active":"2023-05-10T01:21:56.379945+0000","last_peered":"2023-05-10T01:21:56.379945+0000","last_clean":"2023-05-10T01:21:56.379945+0000","last_became_active":"2023-05-10T01:21:55.981160+0000","last_became_peered":"2023-05-10T01:21:55.981160+0000","last_unstale":"2023-05-10T01:21:56.379945+0000","last_undegraded":"2023-05-10T01:21:56.379945+0000","last_fullsized":"2023-05-10T01:21:56.379945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379161+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:21:56.379161+0000","last_peered":"2023-05-10T01:21:56.379161+0000","last_clean":"2023-05-10T01:21:56.379161+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:21:56.379161+0000","last_undegraded":"2023-05-10T01:21:56.379161+0000","last_fullsized":"2023-05-10T01:21:56.379161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390004+0000","last_change":"2023-05-10T01:21:56.386770+0000","last_active":"2023-05-10T01:21:56.390004+0000","last_peered":"2023-05-10T01:21:56.390004+0000","last_clean":"2023-05-10T01:21:56.390004+0000","last_became_active":"2023-05-10T01:21:56.386485+0000","last_became_peered":"2023-05-10T01:21:56.386485+0000","last_unstale":"2023-05-10T01:21:56.390004+0000","last_undegraded":"2023-05-10T01:21:56.390004+0000","last_fullsized":"2023-05-10T01:21:56.390004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378139+0000","last_change":"2023-05-10T01:21:55.986362+0000","last_active":"2023-05-10T01:21:56.378139+0000","last_peered":"2023-05-10T01:21:56.378139+0000","last_clean":"2023-05-10T01:21:56.378139+0000","last_became_active":"2023-05-10T01:21:55.985579+0000","last_became_peered":"2023-05-10T01:21:55.985579+0000","last_unstale":"2023-05-10T01:21:56.378139+0000","last_undegraded":"2023-05-10T01:21:56.378139+0000","last_fullsized":"2023-05-10T01:21:56.378139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.380000+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:21:56.380000+0000","last_peered":"2023-05-10T01:21:56.380000+0000","last_clean":"2023-05-10T01:21:56.380000+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:21:56.380000+0000","last_undegraded":"2023-05-10T01:21:56.380000+0000","last_fullsized":"2023-05-10T01:21:56.380000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.388353+0000","last_change":"2023-05-10T01:21:56.384106+0000","last_active":"2023-05-10T01:21:56.388353+0000","last_peered":"2023-05-10T01:21:56.388353+0000","last_clean":"2023-05-10T01:21:56.388353+0000","last_became_active":"2023-05-10T01:21:56.383829+0000","last_became_peered":"2023-05-10T01:21:56.383829+0000","last_unstale":"2023-05-10T01:21:56.388353+0000","last_undegraded":"2023-05-10T01:21:56.388353+0000","last_fullsized":"2023-05-10T01:21:56.388353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376460+0000","last_change":"2023-05-10T01:21:55.987209+0000","last_active":"2023-05-10T01:21:56.376460+0000","last_peered":"2023-05-10T01:21:56.376460+0000","last_clean":"2023-05-10T01:21:56.376460+0000","last_became_active":"2023-05-10T01:21:55.986888+0000","last_became_peered":"2023-05-10T01:21:55.986888+0000","last_unstale":"2023-05-10T01:21:56.376460+0000","last_undegraded":"2023-05-10T01:21:56.376460+0000","last_fullsized":"2023-05-10T01:21:56.376460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370808+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:21:56.370808+0000","last_peered":"2023-05-10T01:21:56.370808+0000","last_clean":"2023-05-10T01:21:56.370808+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:21:56.370808+0000","last_undegraded":"2023-05-10T01:21:56.370808+0000","last_fullsized":"2023-05-10T01:21:56.370808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394272+0000","last_change":"2023-05-10T01:21:56.387160+0000","last_active":"2023-05-10T01:21:56.394272+0000","last_peered":"2023-05-10T01:21:56.394272+0000","last_clean":"2023-05-10T01:21:56.394272+0000","last_became_active":"2023-05-10T01:21:56.386884+0000","last_became_peered":"2023-05-10T01:21:56.386884+0000","last_unstale":"2023-05-10T01:21:56.394272+0000","last_undegraded":"2023-05-10T01:21:56.394272+0000","last_fullsized":"2023-05-10T01:21:56.394272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375961+0000","last_change":"2023-05-10T01:21:55.983841+0000","last_active":"2023-05-10T01:21:56.375961+0000","last_peered":"2023-05-10T01:21:56.375961+0000","last_clean":"2023-05-10T01:21:56.375961+0000","last_became_active":"2023-05-10T01:21:55.983556+0000","last_became_peered":"2023-05-10T01:21:55.983556+0000","last_unstale":"2023-05-10T01:21:56.375961+0000","last_undegraded":"2023-05-10T01:21:56.375961+0000","last_fullsized":"2023-05-10T01:21:56.375961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385256+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:21:56.385256+0000","last_peered":"2023-05-10T01:21:56.385256+0000","last_clean":"2023-05-10T01:21:56.385256+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:21:56.385256+0000","last_undegraded":"2023-05-10T01:21:56.385256+0000","last_fullsized":"2023-05-10T01:21:56.385256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16368,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355472,"statfs":{"total":96636764160,"available":96620003328,"internally_reserved":0,"allocated":761856,"data_stored":368110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.79000000000000004,"15min":0.89900000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.60599999999999998},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.89800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.94899999999999995},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.59199999999999997},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.93300000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.92200000000000004},"last":0.82199999999999995}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.85899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.871},"last":0.755}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.78000000000000003},"last":0.432},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.68600000000000005}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.052},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.623}]},{"osd":6,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":0.76400000000000001,"5min":0.79200000000000004,"15min":0.88200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15720,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94356120,"statfs":{"total":96636764160,"available":96620666880,"internally_reserved":0,"allocated":753664,"data_stored":367502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.86199999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65800000000000003,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.75700000000000001,"15min":1.1160000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":1.159},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.621},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":1.321},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.85599999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15656,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94356184,"statfs":{"total":96636764160,"available":96620732416,"internally_reserved":0,"allocated":753664,"data_stored":367522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.68999999999999995,"15min":0.77800000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.55500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.46899999999999997},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47399999999999998,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.64300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":1.117},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":1.05},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":1.3839999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":1.319},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.079},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.65400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.88200000000000001,"15min":1.0960000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.501,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.96899999999999997,"15min":1.3600000000000001},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15408,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356432,"statfs":{"total":96636764160,"available":96620986368,"internally_reserved":0,"allocated":761856,"data_stored":367558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.52900000000000003,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.28599999999999998,"15min":0.254},"max":{"1min":0.63,"5min":0.64200000000000002,"15min":0.80300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.436,"15min":0.47399999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":3.8370000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.84099999999999997},"last":0.309}]},{"osd":3,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.85799999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.374},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.375},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.432},"max":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":1.224},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":1.002,"15min":1.1559999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16752,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94355088,"statfs":{"total":96636764160,"available":96619610112,"internally_reserved":0,"allocated":761856,"data_stored":368968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.25,"5min":0.248,"15min":0.217},"max":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.67100000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.371,"5min":0.32500000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41099999999999998},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.317}]},{"osd":3,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.40799999999999997},"min":{"1min":0.33600000000000002,"5min":0.27000000000000002,"15min":0.22},"max":{"1min":0.58799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":0.68899999999999995,"5min":0.75,"15min":0.75},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.93100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.3320000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":1.091},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.056},"last":0.55900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23856,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94347984,"statfs":{"total":96636764160,"available":96612335616,"internally_reserved":0,"allocated":761856,"data_stored":368098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.23999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28799999999999998,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.69899999999999995,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.45700000000000002},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":4,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":0.92200000000000004,"15min":1.0349999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.0589999999999999},"last":0.622}]},{"osd":5,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.41199999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.628,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15976,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355864,"statfs":{"total":96636764160,"available":96620404736,"internally_reserved":0,"allocated":753664,"data_stored":367986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.72799999999999998,"5min":0.753,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69999999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.337}]},{"osd":1,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.92100000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.35399999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.80400000000000005,"15min":0.85999999999999999},"last":1.3839999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.73899999999999999,"15min":0.83599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.84899999999999998,"15min":0.89200000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.621,"5min":0.67900000000000005,"15min":0.88200000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47999999999999998,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.67300000000000004,"5min":0.82599999999999996,"15min":0.89400000000000002},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50600000000000001,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.81100000000000005,"15min":0.92700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.371},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0589999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19176,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352664,"statfs":{"total":96636764160,"available":96617127936,"internally_reserved":0,"allocated":753664,"data_stored":368324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.56100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.66500000000000004,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.307},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.76500000000000001},"last":0.378}]},{"osd":6,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":1.1120000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:22:04.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:22:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.057+0000 7fa773ae8700 1 Processor -- start 2023-05-10T01:22:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.058+0000 7fa773ae8700 1 -- start start 2023-05-10T01:22:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.058+0000 7fa773ae8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa76c154160 0x7fa76c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.058+0000 7fa773ae8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0c0650 con 0x7fa76c069da0 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.058+0000 7fa773ae8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0bfd20 con 0x7fa76c154540 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.058+0000 7fa773ae8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0c0000 con 0x7fa76c154160 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa76c154160 0x7fa76c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa772085700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa76c069da0 0x7fa76c0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42692/0 (socket says 172.21.15.52:42692) 2023-05-10T01:22:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa772085700 1 -- 172.21.15.52:0/1670538494 learned_addr learned my addr 172.21.15.52:0/1670538494 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 --2- 172.21.15.52:0/1670538494 >> v2:172.21.15.52:3300/0 conn(0x7fa76c154160 0x7fa76c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33674/0 (socket says 172.21.15.52:33674) 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 -- 172.21.15.52:0/1670538494 >> v1:172.21.15.172:6789/0 conn(0x7fa76c154540 legacy=0x7fa76c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 -- 172.21.15.52:0/1670538494 >> v1:172.21.15.52:6789/0 conn(0x7fa76c069da0 legacy=0x7fa76c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa770882700 1 -- 172.21.15.52:0/1670538494 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124722912 0 0) 0x7fa76c0c0650 con 0x7fa76c069da0 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 -- 172.21.15.52:0/1670538494 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0c02e0 con 0x7fa76c154160 2023-05-10T01:22:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa771884700 1 --2- 172.21.15.52:0/1670538494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c0c5c60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa764009760 tx=0x7fa764009060).ready entity=mon.0 client_cookie=606b2fc2b86e00de server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa770882700 1 -- 172.21.15.52:0/1670538494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640090d0 con 0x7fa76c154160 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa770882700 1 -- 172.21.15.52:0/1670538494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400b520 con 0x7fa76c154160 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.059+0000 7fa770882700 1 -- 172.21.15.52:0/1670538494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400b8a0 con 0x7fa76c154160 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 -- 172.21.15.52:0/1670538494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 msgr2=0x7fa76c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 --2- 172.21.15.52:0/1670538494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c0c5c60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa764009760 tx=0x7fa764009060).stop 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 -- 172.21.15.52:0/1670538494 shutdown_connections 2023-05-10T01:22:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 --2- 172.21.15.52:0/1670538494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c0c5c60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 -- 172.21.15.52:0/1670538494 >> 172.21.15.52:0/1670538494 conn(0x7fa76c0cb6f0 msgr2=0x7fa76c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 -- 172.21.15.52:0/1670538494 shutdown_connections 2023-05-10T01:22:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.060+0000 7fa773ae8700 1 -- 172.21.15.52:0/1670538494 wait complete. 2023-05-10T01:22:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.061+0000 7fa773ae8700 1 Processor -- start 2023-05-10T01:22:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.061+0000 7fa773ae8700 1 -- start start 2023-05-10T01:22:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa76c069da0 0x7fa76c152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c154540 0x7fa76c0c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0c2da0 con 0x7fa76c154160 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c142c40 con 0x7fa76c154540 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa773ae8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c152e00 con 0x7fa76c069da0 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33680/0 (socket says 172.21.15.52:33680) 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 -- 172.21.15.52:0/3096719446 learned_addr learned my addr 172.21.15.52:0/3096719446 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa772085700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c154540 0x7fa76c0c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771884700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa76c069da0 0x7fa76c152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 -- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa76c069da0 msgr2=0x7fa76c152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa76c069da0 0x7fa76c152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 -- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c154540 msgr2=0x7fa76c0c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c154540 0x7fa76c0c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 -- 172.21.15.52:0/3096719446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640092a0 con 0x7fa76c154160 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.062+0000 7fa771083700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fa76000b490 tx=0x7fa760006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.063+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760012410 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.063+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760012590 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.063+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c1530e0 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.063+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760012950 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.063+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0c20b0 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.064+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c0666b0 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.064+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa76000f030 con 0x7fa76c154160 2023-05-10T01:22:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.064+0000 7fa769ffb700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 0x7fa74c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.065+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fa7600799e0 con 0x7fa76c154160 2023-05-10T01:22:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.065+0000 7fa771884700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 0x7fa74c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.065+0000 7fa771884700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 0x7fa74c061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa76400b2e0 tx=0x7fa764017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.069+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa76004ad80 con 0x7fa76c154160 2023-05-10T01:22:05.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.239+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa76c0c26f0 con 0x7fa74c05ed60 2023-05-10T01:22:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.250+0000 7fa769ffb700 1 -- 172.21.15.52:0/3096719446 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361281 (secure 0 0 0) 0x7fa76c0c26f0 con 0x7fa74c05ed60 2023-05-10T01:22:05.256 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:05.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 msgr2=0x7fa74c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 0x7fa74c061220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa76400b2e0 tx=0x7fa764017000).stop 2023-05-10T01:22:05.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 msgr2=0x7fa76c142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fa76000b490 tx=0x7fa760006ef0).stop 2023-05-10T01:22:05.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 shutdown_connections 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa74c05ed60 0x7fa74c061220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c154540 0x7fa76c0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa76c069da0 0x7fa76c152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 --2- 172.21.15.52:0/3096719446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa76c154160 0x7fa76c142450 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 >> 172.21.15.52:0/3096719446 conn(0x7fa76c0cb6f0 msgr2=0x7fa76c1534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:05.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 shutdown_connections 2023-05-10T01:22:05.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.253+0000 7fa773ae8700 1 -- 172.21.15.52:0/3096719446 wait complete. 2023-05-10T01:22:05.261 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:22:05.268 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:22:03.734533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":214,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":138912,"kb_used_data":5920,"kb_used_omap":0,"kb_used_meta":132928,"kb_avail":754835808,"statfs":{"total":773094113280,"available":772951867392,"internally_reserved":0,"allocated":6062080,"data_stored":2944068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":136118272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14668759,"num_objects":-16,"num_object_clones":0,"num_object_copies":-32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-692,"num_write_kb":-15215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.194488"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396349+0000","last_change":"2023-05-10T01:21:56.393474+0000","last_active":"2023-05-10T01:21:56.396349+0000","last_peered":"2023-05-10T01:21:56.396349+0000","last_clean":"2023-05-10T01:21:56.396349+0000","last_became_active":"2023-05-10T01:21:56.393150+0000","last_became_peered":"2023-05-10T01:21:56.393150+0000","last_unstale":"2023-05-10T01:21:56.396349+0000","last_undegraded":"2023-05-10T01:21:56.396349+0000","last_fullsized":"2023-05-10T01:21:56.396349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392197+0000","last_change":"2023-05-10T01:21:55.984077+0000","last_active":"2023-05-10T01:21:56.392197+0000","last_peered":"2023-05-10T01:21:56.392197+0000","last_clean":"2023-05-10T01:21:56.392197+0000","last_became_active":"2023-05-10T01:21:55.983518+0000","last_became_peered":"2023-05-10T01:21:55.983518+0000","last_unstale":"2023-05-10T01:21:56.392197+0000","last_undegraded":"2023-05-10T01:21:56.392197+0000","last_fullsized":"2023-05-10T01:21:56.392197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396287+0000","last_change":"2023-05-10T01:21:56.394558+0000","last_active":"2023-05-10T01:21:56.396287+0000","last_peered":"2023-05-10T01:21:56.396287+0000","last_clean":"2023-05-10T01:21:56.396287+0000","last_became_active":"2023-05-10T01:21:56.394269+0000","last_became_peered":"2023-05-10T01:21:56.394269+0000","last_unstale":"2023-05-10T01:21:56.396287+0000","last_undegraded":"2023-05-10T01:21:56.396287+0000","last_fullsized":"2023-05-10T01:21:56.396287+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372259+0000","last_change":"2023-05-10T01:21:55.995244+0000","last_active":"2023-05-10T01:21:56.372259+0000","last_peered":"2023-05-10T01:21:56.372259+0000","last_clean":"2023-05-10T01:21:56.372259+0000","last_became_active":"2023-05-10T01:21:55.994967+0000","last_became_peered":"2023-05-10T01:21:55.994967+0000","last_unstale":"2023-05-10T01:21:56.372259+0000","last_undegraded":"2023-05-10T01:21:56.372259+0000","last_fullsized":"2023-05-10T01:21:56.372259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393590+0000","last_change":"2023-05-10T01:21:56.387460+0000","last_active":"2023-05-10T01:21:56.393590+0000","last_peered":"2023-05-10T01:21:56.393590+0000","last_clean":"2023-05-10T01:21:56.393590+0000","last_became_active":"2023-05-10T01:21:56.387168+0000","last_became_peered":"2023-05-10T01:21:56.387168+0000","last_unstale":"2023-05-10T01:21:56.393590+0000","last_undegraded":"2023-05-10T01:21:56.393590+0000","last_fullsized":"2023-05-10T01:21:56.393590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375395+0000","last_change":"2023-05-10T01:21:55.981476+0000","last_active":"2023-05-10T01:21:56.375395+0000","last_peered":"2023-05-10T01:21:56.375395+0000","last_clean":"2023-05-10T01:21:56.375395+0000","last_became_active":"2023-05-10T01:21:55.981022+0000","last_became_peered":"2023-05-10T01:21:55.981022+0000","last_unstale":"2023-05-10T01:21:56.375395+0000","last_undegraded":"2023-05-10T01:21:56.375395+0000","last_fullsized":"2023-05-10T01:21:56.375395+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396467+0000","last_change":"2023-05-10T01:21:56.393248+0000","last_active":"2023-05-10T01:21:56.396467+0000","last_peered":"2023-05-10T01:21:56.396467+0000","last_clean":"2023-05-10T01:21:56.396467+0000","last_became_active":"2023-05-10T01:21:56.392940+0000","last_became_peered":"2023-05-10T01:21:56.392940+0000","last_unstale":"2023-05-10T01:21:56.396467+0000","last_undegraded":"2023-05-10T01:21:56.396467+0000","last_fullsized":"2023-05-10T01:21:56.396467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394545+0000","last_change":"2023-05-10T01:21:55.989682+0000","last_active":"2023-05-10T01:21:56.394545+0000","last_peered":"2023-05-10T01:21:56.394545+0000","last_clean":"2023-05-10T01:21:56.394545+0000","last_became_active":"2023-05-10T01:21:55.989221+0000","last_became_peered":"2023-05-10T01:21:55.989221+0000","last_unstale":"2023-05-10T01:21:56.394545+0000","last_undegraded":"2023-05-10T01:21:56.394545+0000","last_fullsized":"2023-05-10T01:21:56.394545+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398309+0000","last_change":"2023-05-10T01:21:56.396249+0000","last_active":"2023-05-10T01:21:56.398309+0000","last_peered":"2023-05-10T01:21:56.398309+0000","last_clean":"2023-05-10T01:21:56.398309+0000","last_became_active":"2023-05-10T01:21:56.395946+0000","last_became_peered":"2023-05-10T01:21:56.395946+0000","last_unstale":"2023-05-10T01:21:56.398309+0000","last_undegraded":"2023-05-10T01:21:56.398309+0000","last_fullsized":"2023-05-10T01:21:56.398309+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383417+0000","last_change":"2023-05-10T01:21:55.989419+0000","last_active":"2023-05-10T01:21:56.383417+0000","last_peered":"2023-05-10T01:21:56.383417+0000","last_clean":"2023-05-10T01:21:56.383417+0000","last_became_active":"2023-05-10T01:21:55.989168+0000","last_became_peered":"2023-05-10T01:21:55.989168+0000","last_unstale":"2023-05-10T01:21:56.383417+0000","last_undegraded":"2023-05-10T01:21:56.383417+0000","last_fullsized":"2023-05-10T01:21:56.383417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394522+0000","last_change":"2023-05-10T01:21:56.388422+0000","last_active":"2023-05-10T01:21:56.394522+0000","last_peered":"2023-05-10T01:21:56.394522+0000","last_clean":"2023-05-10T01:21:56.394522+0000","last_became_active":"2023-05-10T01:21:56.388135+0000","last_became_peered":"2023-05-10T01:21:56.388135+0000","last_unstale":"2023-05-10T01:21:56.394522+0000","last_undegraded":"2023-05-10T01:21:56.394522+0000","last_fullsized":"2023-05-10T01:21:56.394522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394435+0000","last_change":"2023-05-10T01:21:55.987682+0000","last_active":"2023-05-10T01:21:56.394435+0000","last_peered":"2023-05-10T01:21:56.394435+0000","last_clean":"2023-05-10T01:21:56.394435+0000","last_became_active":"2023-05-10T01:21:55.987380+0000","last_became_peered":"2023-05-10T01:21:55.987380+0000","last_unstale":"2023-05-10T01:21:56.394435+0000","last_undegraded":"2023-05-10T01:21:56.394435+0000","last_fullsized":"2023-05-10T01:21:56.394435+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396200+0000","last_change":"2023-05-10T01:21:56.392983+0000","last_active":"2023-05-10T01:21:56.396200+0000","last_peered":"2023-05-10T01:21:56.396200+0000","last_clean":"2023-05-10T01:21:56.396200+0000","last_became_active":"2023-05-10T01:21:56.392726+0000","last_became_peered":"2023-05-10T01:21:56.392726+0000","last_unstale":"2023-05-10T01:21:56.396200+0000","last_undegraded":"2023-05-10T01:21:56.396200+0000","last_fullsized":"2023-05-10T01:21:56.396200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379375+0000","last_change":"2023-05-10T01:21:55.985886+0000","last_active":"2023-05-10T01:21:56.379375+0000","last_peered":"2023-05-10T01:21:56.379375+0000","last_clean":"2023-05-10T01:21:56.379375+0000","last_became_active":"2023-05-10T01:21:55.985571+0000","last_became_peered":"2023-05-10T01:21:55.985571+0000","last_unstale":"2023-05-10T01:21:56.379375+0000","last_undegraded":"2023-05-10T01:21:56.379375+0000","last_fullsized":"2023-05-10T01:21:56.379375+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384785+0000","last_change":"2023-05-10T01:21:56.381538+0000","last_active":"2023-05-10T01:21:56.384785+0000","last_peered":"2023-05-10T01:21:56.384785+0000","last_clean":"2023-05-10T01:21:56.384785+0000","last_became_active":"2023-05-10T01:21:56.381059+0000","last_became_peered":"2023-05-10T01:21:56.381059+0000","last_unstale":"2023-05-10T01:21:56.384785+0000","last_undegraded":"2023-05-10T01:21:56.384785+0000","last_fullsized":"2023-05-10T01:21:56.384785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373368+0000","last_change":"2023-05-10T01:21:55.992753+0000","last_active":"2023-05-10T01:21:56.373368+0000","last_peered":"2023-05-10T01:21:56.373368+0000","last_clean":"2023-05-10T01:21:56.373368+0000","last_became_active":"2023-05-10T01:21:55.989112+0000","last_became_peered":"2023-05-10T01:21:55.989112+0000","last_unstale":"2023-05-10T01:21:56.373368+0000","last_undegraded":"2023-05-10T01:21:56.373368+0000","last_fullsized":"2023-05-10T01:21:56.373368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.389535+0000","last_change":"2023-05-10T01:21:56.385875+0000","last_active":"2023-05-10T01:21:56.389535+0000","last_peered":"2023-05-10T01:21:56.389535+0000","last_clean":"2023-05-10T01:21:56.389535+0000","last_became_active":"2023-05-10T01:21:56.385559+0000","last_became_peered":"2023-05-10T01:21:56.385559+0000","last_unstale":"2023-05-10T01:21:56.389535+0000","last_undegraded":"2023-05-10T01:21:56.389535+0000","last_fullsized":"2023-05-10T01:21:56.389535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374945+0000","last_change":"2023-05-10T01:21:55.995994+0000","last_active":"2023-05-10T01:21:56.374945+0000","last_peered":"2023-05-10T01:21:56.374945+0000","last_clean":"2023-05-10T01:21:56.374945+0000","last_became_active":"2023-05-10T01:21:55.995612+0000","last_became_peered":"2023-05-10T01:21:55.995612+0000","last_unstale":"2023-05-10T01:21:56.374945+0000","last_undegraded":"2023-05-10T01:21:56.374945+0000","last_fullsized":"2023-05-10T01:21:56.374945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397620+0000","last_change":"2023-05-10T01:21:56.393150+0000","last_active":"2023-05-10T01:21:56.397620+0000","last_peered":"2023-05-10T01:21:56.397620+0000","last_clean":"2023-05-10T01:21:56.397620+0000","last_became_active":"2023-05-10T01:21:56.392864+0000","last_became_peered":"2023-05-10T01:21:56.392864+0000","last_unstale":"2023-05-10T01:21:56.397620+0000","last_undegraded":"2023-05-10T01:21:56.397620+0000","last_fullsized":"2023-05-10T01:21:56.397620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374362+0000","last_change":"2023-05-10T01:21:55.989756+0000","last_active":"2023-05-10T01:21:56.374362+0000","last_peered":"2023-05-10T01:21:56.374362+0000","last_clean":"2023-05-10T01:21:56.374362+0000","last_became_active":"2023-05-10T01:21:55.989216+0000","last_became_peered":"2023-05-10T01:21:55.989216+0000","last_unstale":"2023-05-10T01:21:56.374362+0000","last_undegraded":"2023-05-10T01:21:56.374362+0000","last_fullsized":"2023-05-10T01:21:56.374362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385955+0000","last_change":"2023-05-10T01:21:56.379300+0000","last_active":"2023-05-10T01:21:56.385955+0000","last_peered":"2023-05-10T01:21:56.385955+0000","last_clean":"2023-05-10T01:21:56.385955+0000","last_became_active":"2023-05-10T01:21:56.378969+0000","last_became_peered":"2023-05-10T01:21:56.378969+0000","last_unstale":"2023-05-10T01:21:56.385955+0000","last_undegraded":"2023-05-10T01:21:56.385955+0000","last_fullsized":"2023-05-10T01:21:56.385955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376325+0000","last_change":"2023-05-10T01:21:55.996558+0000","last_active":"2023-05-10T01:21:56.376325+0000","last_peered":"2023-05-10T01:21:56.376325+0000","last_clean":"2023-05-10T01:21:56.376325+0000","last_became_active":"2023-05-10T01:21:55.996094+0000","last_became_peered":"2023-05-10T01:21:55.996094+0000","last_unstale":"2023-05-10T01:21:56.376325+0000","last_undegraded":"2023-05-10T01:21:56.376325+0000","last_fullsized":"2023-05-10T01:21:56.376325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393472+0000","last_change":"2023-05-10T01:21:56.389655+0000","last_active":"2023-05-10T01:21:56.393472+0000","last_peered":"2023-05-10T01:21:56.393472+0000","last_clean":"2023-05-10T01:21:56.393472+0000","last_became_active":"2023-05-10T01:21:56.389185+0000","last_became_peered":"2023-05-10T01:21:56.389185+0000","last_unstale":"2023-05-10T01:21:56.393472+0000","last_undegraded":"2023-05-10T01:21:56.393472+0000","last_fullsized":"2023-05-10T01:21:56.393472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397557+0000","last_change":"2023-05-10T01:21:55.990841+0000","last_active":"2023-05-10T01:21:56.397557+0000","last_peered":"2023-05-10T01:21:56.397557+0000","last_clean":"2023-05-10T01:21:56.397557+0000","last_became_active":"2023-05-10T01:21:55.990576+0000","last_became_peered":"2023-05-10T01:21:55.990576+0000","last_unstale":"2023-05-10T01:21:56.397557+0000","last_undegraded":"2023-05-10T01:21:56.397557+0000","last_fullsized":"2023-05-10T01:21:56.397557+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392743+0000","last_change":"2023-05-10T01:21:56.388127+0000","last_active":"2023-05-10T01:21:56.392743+0000","last_peered":"2023-05-10T01:21:56.392743+0000","last_clean":"2023-05-10T01:21:56.392743+0000","last_became_active":"2023-05-10T01:21:56.387864+0000","last_became_peered":"2023-05-10T01:21:56.387864+0000","last_unstale":"2023-05-10T01:21:56.392743+0000","last_undegraded":"2023-05-10T01:21:56.392743+0000","last_fullsized":"2023-05-10T01:21:56.392743+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397736+0000","last_change":"2023-05-10T01:21:55.988691+0000","last_active":"2023-05-10T01:21:56.397736+0000","last_peered":"2023-05-10T01:21:56.397736+0000","last_clean":"2023-05-10T01:21:56.397736+0000","last_became_active":"2023-05-10T01:21:55.988337+0000","last_became_peered":"2023-05-10T01:21:55.988337+0000","last_unstale":"2023-05-10T01:21:56.397736+0000","last_undegraded":"2023-05-10T01:21:56.397736+0000","last_fullsized":"2023-05-10T01:21:56.397736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393891+0000","last_change":"2023-05-10T01:21:56.387347+0000","last_active":"2023-05-10T01:21:56.393891+0000","last_peered":"2023-05-10T01:21:56.393891+0000","last_clean":"2023-05-10T01:21:56.393891+0000","last_became_active":"2023-05-10T01:21:56.386716+0000","last_became_peered":"2023-05-10T01:21:56.386716+0000","last_unstale":"2023-05-10T01:21:56.393891+0000","last_undegraded":"2023-05-10T01:21:56.393891+0000","last_fullsized":"2023-05-10T01:21:56.393891+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376282+0000","last_change":"2023-05-10T01:21:55.996347+0000","last_active":"2023-05-10T01:21:56.376282+0000","last_peered":"2023-05-10T01:21:56.376282+0000","last_clean":"2023-05-10T01:21:56.376282+0000","last_became_active":"2023-05-10T01:21:55.996084+0000","last_became_peered":"2023-05-10T01:21:55.996084+0000","last_unstale":"2023-05-10T01:21:56.376282+0000","last_undegraded":"2023-05-10T01:21:56.376282+0000","last_fullsized":"2023-05-10T01:21:56.376282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396251+0000","last_change":"2023-05-10T01:21:56.393820+0000","last_active":"2023-05-10T01:21:56.396251+0000","last_peered":"2023-05-10T01:21:56.396251+0000","last_clean":"2023-05-10T01:21:56.396251+0000","last_became_active":"2023-05-10T01:21:56.393487+0000","last_became_peered":"2023-05-10T01:21:56.393487+0000","last_unstale":"2023-05-10T01:21:56.396251+0000","last_undegraded":"2023-05-10T01:21:56.396251+0000","last_fullsized":"2023-05-10T01:21:56.396251+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373429+0000","last_change":"2023-05-10T01:21:55.984869+0000","last_active":"2023-05-10T01:21:56.373429+0000","last_peered":"2023-05-10T01:21:56.373429+0000","last_clean":"2023-05-10T01:21:56.373429+0000","last_became_active":"2023-05-10T01:21:55.984587+0000","last_became_peered":"2023-05-10T01:21:55.984587+0000","last_unstale":"2023-05-10T01:21:56.373429+0000","last_undegraded":"2023-05-10T01:21:56.373429+0000","last_fullsized":"2023-05-10T01:21:56.373429+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394933+0000","last_change":"2023-05-10T01:21:56.385313+0000","last_active":"2023-05-10T01:21:56.394933+0000","last_peered":"2023-05-10T01:21:56.394933+0000","last_clean":"2023-05-10T01:21:56.394933+0000","last_became_active":"2023-05-10T01:21:56.382048+0000","last_became_peered":"2023-05-10T01:21:56.382048+0000","last_unstale":"2023-05-10T01:21:56.394933+0000","last_undegraded":"2023-05-10T01:21:56.394933+0000","last_fullsized":"2023-05-10T01:21:56.394933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391542+0000","last_change":"2023-05-10T01:21:55.988731+0000","last_active":"2023-05-10T01:21:56.391542+0000","last_peered":"2023-05-10T01:21:56.391542+0000","last_clean":"2023-05-10T01:21:56.391542+0000","last_became_active":"2023-05-10T01:21:55.988305+0000","last_became_peered":"2023-05-10T01:21:55.988305+0000","last_unstale":"2023-05-10T01:21:56.391542+0000","last_undegraded":"2023-05-10T01:21:56.391542+0000","last_fullsized":"2023-05-10T01:21:56.391542+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394431+0000","last_change":"2023-05-10T01:21:56.389754+0000","last_active":"2023-05-10T01:21:56.394431+0000","last_peered":"2023-05-10T01:21:56.394431+0000","last_clean":"2023-05-10T01:21:56.394431+0000","last_became_active":"2023-05-10T01:21:56.389230+0000","last_became_peered":"2023-05-10T01:21:56.389230+0000","last_unstale":"2023-05-10T01:21:56.394431+0000","last_undegraded":"2023-05-10T01:21:56.394431+0000","last_fullsized":"2023-05-10T01:21:56.394431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375951+0000","last_change":"2023-05-10T01:21:55.977210+0000","last_active":"2023-05-10T01:21:56.375951+0000","last_peered":"2023-05-10T01:21:56.375951+0000","last_clean":"2023-05-10T01:21:56.375951+0000","last_became_active":"2023-05-10T01:21:55.976395+0000","last_became_peered":"2023-05-10T01:21:55.976395+0000","last_unstale":"2023-05-10T01:21:56.375951+0000","last_undegraded":"2023-05-10T01:21:56.375951+0000","last_fullsized":"2023-05-10T01:21:56.375951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398378+0000","last_change":"2023-05-10T01:21:56.396010+0000","last_active":"2023-05-10T01:21:56.398378+0000","last_peered":"2023-05-10T01:21:56.398378+0000","last_clean":"2023-05-10T01:21:56.398378+0000","last_became_active":"2023-05-10T01:21:56.395742+0000","last_became_peered":"2023-05-10T01:21:56.395742+0000","last_unstale":"2023-05-10T01:21:56.398378+0000","last_undegraded":"2023-05-10T01:21:56.398378+0000","last_fullsized":"2023-05-10T01:21:56.398378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377562+0000","last_change":"2023-05-10T01:21:55.985998+0000","last_active":"2023-05-10T01:21:56.377562+0000","last_peered":"2023-05-10T01:21:56.377562+0000","last_clean":"2023-05-10T01:21:56.377562+0000","last_became_active":"2023-05-10T01:21:55.985747+0000","last_became_peered":"2023-05-10T01:21:55.985747+0000","last_unstale":"2023-05-10T01:21:56.377562+0000","last_undegraded":"2023-05-10T01:21:56.377562+0000","last_fullsized":"2023-05-10T01:21:56.377562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401233+0000","last_change":"2023-05-10T01:21:56.396956+0000","last_active":"2023-05-10T01:21:56.401233+0000","last_peered":"2023-05-10T01:21:56.401233+0000","last_clean":"2023-05-10T01:21:56.401233+0000","last_became_active":"2023-05-10T01:21:56.396693+0000","last_became_peered":"2023-05-10T01:21:56.396693+0000","last_unstale":"2023-05-10T01:21:56.401233+0000","last_undegraded":"2023-05-10T01:21:56.401233+0000","last_fullsized":"2023-05-10T01:21:56.401233+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394027+0000","last_change":"2023-05-10T01:21:55.993591+0000","last_active":"2023-05-10T01:21:56.394027+0000","last_peered":"2023-05-10T01:21:56.394027+0000","last_clean":"2023-05-10T01:21:56.394027+0000","last_became_active":"2023-05-10T01:21:55.993336+0000","last_became_peered":"2023-05-10T01:21:55.993336+0000","last_unstale":"2023-05-10T01:21:56.394027+0000","last_undegraded":"2023-05-10T01:21:56.394027+0000","last_fullsized":"2023-05-10T01:21:56.394027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398490+0000","last_change":"2023-05-10T01:21:56.395020+0000","last_active":"2023-05-10T01:21:56.398490+0000","last_peered":"2023-05-10T01:21:56.398490+0000","last_clean":"2023-05-10T01:21:56.398490+0000","last_became_active":"2023-05-10T01:21:56.394720+0000","last_became_peered":"2023-05-10T01:21:56.394720+0000","last_unstale":"2023-05-10T01:21:56.398490+0000","last_undegraded":"2023-05-10T01:21:56.398490+0000","last_fullsized":"2023-05-10T01:21:56.398490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390284+0000","last_change":"2023-05-10T01:21:55.989997+0000","last_active":"2023-05-10T01:21:56.390284+0000","last_peered":"2023-05-10T01:21:56.390284+0000","last_clean":"2023-05-10T01:21:56.390284+0000","last_became_active":"2023-05-10T01:21:55.989659+0000","last_became_peered":"2023-05-10T01:21:55.989659+0000","last_unstale":"2023-05-10T01:21:56.390284+0000","last_undegraded":"2023-05-10T01:21:56.390284+0000","last_fullsized":"2023-05-10T01:21:56.390284+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391715+0000","last_change":"2023-05-10T01:21:56.386757+0000","last_active":"2023-05-10T01:21:56.391715+0000","last_peered":"2023-05-10T01:21:56.391715+0000","last_clean":"2023-05-10T01:21:56.391715+0000","last_became_active":"2023-05-10T01:21:56.386481+0000","last_became_peered":"2023-05-10T01:21:56.386481+0000","last_unstale":"2023-05-10T01:21:56.391715+0000","last_undegraded":"2023-05-10T01:21:56.391715+0000","last_fullsized":"2023-05-10T01:21:56.391715+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396357+0000","last_change":"2023-05-10T01:21:55.983679+0000","last_active":"2023-05-10T01:21:56.396357+0000","last_peered":"2023-05-10T01:21:56.396357+0000","last_clean":"2023-05-10T01:21:56.396357+0000","last_became_active":"2023-05-10T01:21:55.983331+0000","last_became_peered":"2023-05-10T01:21:55.983331+0000","last_unstale":"2023-05-10T01:21:56.396357+0000","last_undegraded":"2023-05-10T01:21:56.396357+0000","last_fullsized":"2023-05-10T01:21:56.396357+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387810+0000","last_change":"2023-05-10T01:21:56.382093+0000","last_active":"2023-05-10T01:21:56.387810+0000","last_peered":"2023-05-10T01:21:56.387810+0000","last_clean":"2023-05-10T01:21:56.387810+0000","last_became_active":"2023-05-10T01:21:56.381808+0000","last_became_peered":"2023-05-10T01:21:56.381808+0000","last_unstale":"2023-05-10T01:21:56.387810+0000","last_undegraded":"2023-05-10T01:21:56.387810+0000","last_fullsized":"2023-05-10T01:21:56.387810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376180+0000","last_change":"2023-05-10T01:21:55.985464+0000","last_active":"2023-05-10T01:21:56.376180+0000","last_peered":"2023-05-10T01:21:56.376180+0000","last_clean":"2023-05-10T01:21:56.376180+0000","last_became_active":"2023-05-10T01:21:55.984713+0000","last_became_peered":"2023-05-10T01:21:55.984713+0000","last_unstale":"2023-05-10T01:21:56.376180+0000","last_undegraded":"2023-05-10T01:21:56.376180+0000","last_fullsized":"2023-05-10T01:21:56.376180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390050+0000","last_change":"2023-05-10T01:21:56.388436+0000","last_active":"2023-05-10T01:21:56.390050+0000","last_peered":"2023-05-10T01:21:56.390050+0000","last_clean":"2023-05-10T01:21:56.390050+0000","last_became_active":"2023-05-10T01:21:56.387905+0000","last_became_peered":"2023-05-10T01:21:56.387905+0000","last_unstale":"2023-05-10T01:21:56.390050+0000","last_undegraded":"2023-05-10T01:21:56.390050+0000","last_fullsized":"2023-05-10T01:21:56.390050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.381068+0000","last_change":"2023-05-10T01:21:55.982476+0000","last_active":"2023-05-10T01:21:56.381068+0000","last_peered":"2023-05-10T01:21:56.381068+0000","last_clean":"2023-05-10T01:21:56.381068+0000","last_became_active":"2023-05-10T01:21:55.981967+0000","last_became_peered":"2023-05-10T01:21:55.981967+0000","last_unstale":"2023-05-10T01:21:56.381068+0000","last_undegraded":"2023-05-10T01:21:56.381068+0000","last_fullsized":"2023-05-10T01:21:56.381068+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390425+0000","last_change":"2023-05-10T01:21:56.384117+0000","last_active":"2023-05-10T01:21:56.390425+0000","last_peered":"2023-05-10T01:21:56.390425+0000","last_clean":"2023-05-10T01:21:56.390425+0000","last_became_active":"2023-05-10T01:21:56.383746+0000","last_became_peered":"2023-05-10T01:21:56.383746+0000","last_unstale":"2023-05-10T01:21:56.390425+0000","last_undegraded":"2023-05-10T01:21:56.390425+0000","last_fullsized":"2023-05-10T01:21:56.390425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378052+0000","last_change":"2023-05-10T01:21:55.981940+0000","last_active":"2023-05-10T01:21:56.378052+0000","last_peered":"2023-05-10T01:21:56.378052+0000","last_clean":"2023-05-10T01:21:56.378052+0000","last_became_active":"2023-05-10T01:21:55.981594+0000","last_became_peered":"2023-05-10T01:21:55.981594+0000","last_unstale":"2023-05-10T01:21:56.378052+0000","last_undegraded":"2023-05-10T01:21:56.378052+0000","last_fullsized":"2023-05-10T01:21:56.378052+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390861+0000","last_change":"2023-05-10T01:21:56.384951+0000","last_active":"2023-05-10T01:21:56.390861+0000","last_peered":"2023-05-10T01:21:56.390861+0000","last_clean":"2023-05-10T01:21:56.390861+0000","last_became_active":"2023-05-10T01:21:56.384677+0000","last_became_peered":"2023-05-10T01:21:56.384677+0000","last_unstale":"2023-05-10T01:21:56.390861+0000","last_undegraded":"2023-05-10T01:21:56.390861+0000","last_fullsized":"2023-05-10T01:21:56.390861+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384944+0000","last_change":"2023-05-10T01:21:55.986675+0000","last_active":"2023-05-10T01:21:56.384944+0000","last_peered":"2023-05-10T01:21:56.384944+0000","last_clean":"2023-05-10T01:21:56.384944+0000","last_became_active":"2023-05-10T01:21:55.986356+0000","last_became_peered":"2023-05-10T01:21:55.986356+0000","last_unstale":"2023-05-10T01:21:56.384944+0000","last_undegraded":"2023-05-10T01:21:56.384944+0000","last_fullsized":"2023-05-10T01:21:56.384944+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394680+0000","last_change":"2023-05-10T01:21:56.387696+0000","last_active":"2023-05-10T01:21:56.394680+0000","last_peered":"2023-05-10T01:21:56.394680+0000","last_clean":"2023-05-10T01:21:56.394680+0000","last_became_active":"2023-05-10T01:21:56.387266+0000","last_became_peered":"2023-05-10T01:21:56.387266+0000","last_unstale":"2023-05-10T01:21:56.394680+0000","last_undegraded":"2023-05-10T01:21:56.394680+0000","last_fullsized":"2023-05-10T01:21:56.394680+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393043+0000","last_change":"2023-05-10T01:21:55.988036+0000","last_active":"2023-05-10T01:21:56.393043+0000","last_peered":"2023-05-10T01:21:56.393043+0000","last_clean":"2023-05-10T01:21:56.393043+0000","last_became_active":"2023-05-10T01:21:55.987731+0000","last_became_peered":"2023-05-10T01:21:55.987731+0000","last_unstale":"2023-05-10T01:21:56.393043+0000","last_undegraded":"2023-05-10T01:21:56.393043+0000","last_fullsized":"2023-05-10T01:21:56.393043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.383820+0000","last_change":"2023-05-10T01:21:56.381131+0000","last_active":"2023-05-10T01:21:56.383820+0000","last_peered":"2023-05-10T01:21:56.383820+0000","last_clean":"2023-05-10T01:21:56.383820+0000","last_became_active":"2023-05-10T01:21:56.380922+0000","last_became_peered":"2023-05-10T01:21:56.380922+0000","last_unstale":"2023-05-10T01:21:56.383820+0000","last_undegraded":"2023-05-10T01:21:56.383820+0000","last_fullsized":"2023-05-10T01:21:56.383820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375476+0000","last_change":"2023-05-10T01:21:55.981305+0000","last_active":"2023-05-10T01:21:56.375476+0000","last_peered":"2023-05-10T01:21:56.375476+0000","last_clean":"2023-05-10T01:21:56.375476+0000","last_became_active":"2023-05-10T01:21:55.980073+0000","last_became_peered":"2023-05-10T01:21:55.980073+0000","last_unstale":"2023-05-10T01:21:56.375476+0000","last_undegraded":"2023-05-10T01:21:56.375476+0000","last_fullsized":"2023-05-10T01:21:56.375476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391889+0000","last_change":"2023-05-10T01:21:56.388494+0000","last_active":"2023-05-10T01:21:56.391889+0000","last_peered":"2023-05-10T01:21:56.391889+0000","last_clean":"2023-05-10T01:21:56.391889+0000","last_became_active":"2023-05-10T01:21:56.388105+0000","last_became_peered":"2023-05-10T01:21:56.388105+0000","last_unstale":"2023-05-10T01:21:56.391889+0000","last_undegraded":"2023-05-10T01:21:56.391889+0000","last_fullsized":"2023-05-10T01:21:56.391889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372965+0000","last_change":"2023-05-10T01:21:55.990808+0000","last_active":"2023-05-10T01:21:56.372965+0000","last_peered":"2023-05-10T01:21:56.372965+0000","last_clean":"2023-05-10T01:21:56.372965+0000","last_became_active":"2023-05-10T01:21:55.990499+0000","last_became_peered":"2023-05-10T01:21:55.990499+0000","last_unstale":"2023-05-10T01:21:56.372965+0000","last_undegraded":"2023-05-10T01:21:56.372965+0000","last_fullsized":"2023-05-10T01:21:56.372965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.392208+0000","last_change":"2023-05-10T01:21:56.389444+0000","last_active":"2023-05-10T01:21:56.392208+0000","last_peered":"2023-05-10T01:21:56.392208+0000","last_clean":"2023-05-10T01:21:56.392208+0000","last_became_active":"2023-05-10T01:21:56.389170+0000","last_became_peered":"2023-05-10T01:21:56.389170+0000","last_unstale":"2023-05-10T01:21:56.392208+0000","last_undegraded":"2023-05-10T01:21:56.392208+0000","last_fullsized":"2023-05-10T01:21:56.392208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384494+0000","last_change":"2023-05-10T01:21:55.986616+0000","last_active":"2023-05-10T01:21:56.384494+0000","last_peered":"2023-05-10T01:21:56.384494+0000","last_clean":"2023-05-10T01:21:56.384494+0000","last_became_active":"2023-05-10T01:21:55.986336+0000","last_became_peered":"2023-05-10T01:21:55.986336+0000","last_unstale":"2023-05-10T01:21:56.384494+0000","last_undegraded":"2023-05-10T01:21:56.384494+0000","last_fullsized":"2023-05-10T01:21:56.384494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393912+0000","last_change":"2023-05-10T01:21:56.391042+0000","last_active":"2023-05-10T01:21:56.393912+0000","last_peered":"2023-05-10T01:21:56.393912+0000","last_clean":"2023-05-10T01:21:56.393912+0000","last_became_active":"2023-05-10T01:21:56.389952+0000","last_became_peered":"2023-05-10T01:21:56.389952+0000","last_unstale":"2023-05-10T01:21:56.393912+0000","last_undegraded":"2023-05-10T01:21:56.393912+0000","last_fullsized":"2023-05-10T01:21:56.393912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375539+0000","last_change":"2023-05-10T01:21:55.983291+0000","last_active":"2023-05-10T01:21:56.375539+0000","last_peered":"2023-05-10T01:21:56.375539+0000","last_clean":"2023-05-10T01:21:56.375539+0000","last_became_active":"2023-05-10T01:21:55.983015+0000","last_became_peered":"2023-05-10T01:21:55.983015+0000","last_unstale":"2023-05-10T01:21:56.375539+0000","last_undegraded":"2023-05-10T01:21:56.375539+0000","last_fullsized":"2023-05-10T01:21:56.375539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393915+0000","last_change":"2023-05-10T01:21:56.391109+0000","last_active":"2023-05-10T01:21:56.393915+0000","last_peered":"2023-05-10T01:21:56.393915+0000","last_clean":"2023-05-10T01:21:56.393915+0000","last_became_active":"2023-05-10T01:21:56.390826+0000","last_became_peered":"2023-05-10T01:21:56.390826+0000","last_unstale":"2023-05-10T01:21:56.393915+0000","last_undegraded":"2023-05-10T01:21:56.393915+0000","last_fullsized":"2023-05-10T01:21:56.393915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373208+0000","last_change":"2023-05-10T01:21:55.983553+0000","last_active":"2023-05-10T01:21:56.373208+0000","last_peered":"2023-05-10T01:21:56.373208+0000","last_clean":"2023-05-10T01:21:56.373208+0000","last_became_active":"2023-05-10T01:21:55.983243+0000","last_became_peered":"2023-05-10T01:21:55.983243+0000","last_unstale":"2023-05-10T01:21:56.373208+0000","last_undegraded":"2023-05-10T01:21:56.373208+0000","last_fullsized":"2023-05-10T01:21:56.373208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395257+0000","last_change":"2023-05-10T01:21:56.390161+0000","last_active":"2023-05-10T01:21:56.395257+0000","last_peered":"2023-05-10T01:21:56.395257+0000","last_clean":"2023-05-10T01:21:56.395257+0000","last_became_active":"2023-05-10T01:21:56.389337+0000","last_became_peered":"2023-05-10T01:21:56.389337+0000","last_unstale":"2023-05-10T01:21:56.395257+0000","last_undegraded":"2023-05-10T01:21:56.395257+0000","last_fullsized":"2023-05-10T01:21:56.395257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387352+0000","last_change":"2023-05-10T01:21:55.974943+0000","last_active":"2023-05-10T01:21:56.387352+0000","last_peered":"2023-05-10T01:21:56.387352+0000","last_clean":"2023-05-10T01:21:56.387352+0000","last_became_active":"2023-05-10T01:21:55.974038+0000","last_became_peered":"2023-05-10T01:21:55.974038+0000","last_unstale":"2023-05-10T01:21:56.387352+0000","last_undegraded":"2023-05-10T01:21:56.387352+0000","last_fullsized":"2023-05-10T01:21:56.387352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394227+0000","last_change":"2023-05-10T01:21:56.392110+0000","last_active":"2023-05-10T01:21:56.394227+0000","last_peered":"2023-05-10T01:21:56.394227+0000","last_clean":"2023-05-10T01:21:56.394227+0000","last_became_active":"2023-05-10T01:21:56.391610+0000","last_became_peered":"2023-05-10T01:21:56.391610+0000","last_unstale":"2023-05-10T01:21:56.394227+0000","last_undegraded":"2023-05-10T01:21:56.394227+0000","last_fullsized":"2023-05-10T01:21:56.394227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394405+0000","last_change":"2023-05-10T01:21:55.976254+0000","last_active":"2023-05-10T01:21:56.394405+0000","last_peered":"2023-05-10T01:21:56.394405+0000","last_clean":"2023-05-10T01:21:56.394405+0000","last_became_active":"2023-05-10T01:21:55.975943+0000","last_became_peered":"2023-05-10T01:21:55.975943+0000","last_unstale":"2023-05-10T01:21:56.394405+0000","last_undegraded":"2023-05-10T01:21:56.394405+0000","last_fullsized":"2023-05-10T01:21:56.394405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393462+0000","last_change":"2023-05-10T01:21:56.383749+0000","last_active":"2023-05-10T01:21:56.393462+0000","last_peered":"2023-05-10T01:21:56.393462+0000","last_clean":"2023-05-10T01:21:56.393462+0000","last_became_active":"2023-05-10T01:21:56.382989+0000","last_became_peered":"2023-05-10T01:21:56.382989+0000","last_unstale":"2023-05-10T01:21:56.393462+0000","last_undegraded":"2023-05-10T01:21:56.393462+0000","last_fullsized":"2023-05-10T01:21:56.393462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386928+0000","last_change":"2023-05-10T01:21:55.988303+0000","last_active":"2023-05-10T01:21:56.386928+0000","last_peered":"2023-05-10T01:21:56.386928+0000","last_clean":"2023-05-10T01:21:56.386928+0000","last_became_active":"2023-05-10T01:21:55.987986+0000","last_became_peered":"2023-05-10T01:21:55.987986+0000","last_unstale":"2023-05-10T01:21:56.386928+0000","last_undegraded":"2023-05-10T01:21:56.386928+0000","last_fullsized":"2023-05-10T01:21:56.386928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391871+0000","last_change":"2023-05-10T01:21:56.388636+0000","last_active":"2023-05-10T01:21:56.391871+0000","last_peered":"2023-05-10T01:21:56.391871+0000","last_clean":"2023-05-10T01:21:56.391871+0000","last_became_active":"2023-05-10T01:21:56.388107+0000","last_became_peered":"2023-05-10T01:21:56.388107+0000","last_unstale":"2023-05-10T01:21:56.391871+0000","last_undegraded":"2023-05-10T01:21:56.391871+0000","last_fullsized":"2023-05-10T01:21:56.391871+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395972+0000","last_change":"2023-05-10T01:21:55.979791+0000","last_active":"2023-05-10T01:21:56.395972+0000","last_peered":"2023-05-10T01:21:56.395972+0000","last_clean":"2023-05-10T01:21:56.395972+0000","last_became_active":"2023-05-10T01:21:55.978489+0000","last_became_peered":"2023-05-10T01:21:55.978489+0000","last_unstale":"2023-05-10T01:21:56.395972+0000","last_undegraded":"2023-05-10T01:21:56.395972+0000","last_fullsized":"2023-05-10T01:21:56.395972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390030+0000","last_change":"2023-05-10T01:21:56.386816+0000","last_active":"2023-05-10T01:21:56.390030+0000","last_peered":"2023-05-10T01:21:56.390030+0000","last_clean":"2023-05-10T01:21:56.390030+0000","last_became_active":"2023-05-10T01:21:56.386546+0000","last_became_peered":"2023-05-10T01:21:56.386546+0000","last_unstale":"2023-05-10T01:21:56.390030+0000","last_undegraded":"2023-05-10T01:21:56.390030+0000","last_fullsized":"2023-05-10T01:21:56.390030+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373089+0000","last_change":"2023-05-10T01:21:55.988218+0000","last_active":"2023-05-10T01:21:56.373089+0000","last_peered":"2023-05-10T01:21:56.373089+0000","last_clean":"2023-05-10T01:21:56.373089+0000","last_became_active":"2023-05-10T01:21:55.987936+0000","last_became_peered":"2023-05-10T01:21:55.987936+0000","last_unstale":"2023-05-10T01:21:56.373089+0000","last_undegraded":"2023-05-10T01:21:56.373089+0000","last_fullsized":"2023-05-10T01:21:56.373089+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396213+0000","last_change":"2023-05-10T01:21:56.393981+0000","last_active":"2023-05-10T01:21:56.396213+0000","last_peered":"2023-05-10T01:21:56.396213+0000","last_clean":"2023-05-10T01:21:56.396213+0000","last_became_active":"2023-05-10T01:21:56.393672+0000","last_became_peered":"2023-05-10T01:21:56.393672+0000","last_unstale":"2023-05-10T01:21:56.396213+0000","last_undegraded":"2023-05-10T01:21:56.396213+0000","last_fullsized":"2023-05-10T01:21:56.396213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374941+0000","last_change":"2023-05-10T01:21:55.982605+0000","last_active":"2023-05-10T01:21:56.374941+0000","last_peered":"2023-05-10T01:21:56.374941+0000","last_clean":"2023-05-10T01:21:56.374941+0000","last_became_active":"2023-05-10T01:21:55.981073+0000","last_became_peered":"2023-05-10T01:21:55.981073+0000","last_unstale":"2023-05-10T01:21:56.374941+0000","last_undegraded":"2023-05-10T01:21:56.374941+0000","last_fullsized":"2023-05-10T01:21:56.374941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393378+0000","last_change":"2023-05-10T01:21:56.389293+0000","last_active":"2023-05-10T01:21:56.393378+0000","last_peered":"2023-05-10T01:21:56.393378+0000","last_clean":"2023-05-10T01:21:56.393378+0000","last_became_active":"2023-05-10T01:21:56.388996+0000","last_became_peered":"2023-05-10T01:21:56.388996+0000","last_unstale":"2023-05-10T01:21:56.393378+0000","last_undegraded":"2023-05-10T01:21:56.393378+0000","last_fullsized":"2023-05-10T01:21:56.393378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375642+0000","last_change":"2023-05-10T01:21:55.978009+0000","last_active":"2023-05-10T01:21:56.375642+0000","last_peered":"2023-05-10T01:21:56.375642+0000","last_clean":"2023-05-10T01:21:56.375642+0000","last_became_active":"2023-05-10T01:21:55.977745+0000","last_became_peered":"2023-05-10T01:21:55.977745+0000","last_unstale":"2023-05-10T01:21:56.375642+0000","last_undegraded":"2023-05-10T01:21:56.375642+0000","last_fullsized":"2023-05-10T01:21:56.375642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390033+0000","last_change":"2023-05-10T01:21:56.387952+0000","last_active":"2023-05-10T01:21:56.390033+0000","last_peered":"2023-05-10T01:21:56.390033+0000","last_clean":"2023-05-10T01:21:56.390033+0000","last_became_active":"2023-05-10T01:21:56.387673+0000","last_became_peered":"2023-05-10T01:21:56.387673+0000","last_unstale":"2023-05-10T01:21:56.390033+0000","last_undegraded":"2023-05-10T01:21:56.390033+0000","last_fullsized":"2023-05-10T01:21:56.390033+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384944+0000","last_change":"2023-05-10T01:21:55.982311+0000","last_active":"2023-05-10T01:21:56.384944+0000","last_peered":"2023-05-10T01:21:56.384944+0000","last_clean":"2023-05-10T01:21:56.384944+0000","last_became_active":"2023-05-10T01:21:55.981700+0000","last_became_peered":"2023-05-10T01:21:55.981700+0000","last_unstale":"2023-05-10T01:21:56.384944+0000","last_undegraded":"2023-05-10T01:21:56.384944+0000","last_fullsized":"2023-05-10T01:21:56.384944+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393179+0000","last_change":"2023-05-10T01:21:56.388591+0000","last_active":"2023-05-10T01:21:56.393179+0000","last_peered":"2023-05-10T01:21:56.393179+0000","last_clean":"2023-05-10T01:21:56.393179+0000","last_became_active":"2023-05-10T01:21:56.388330+0000","last_became_peered":"2023-05-10T01:21:56.388330+0000","last_unstale":"2023-05-10T01:21:56.393179+0000","last_undegraded":"2023-05-10T01:21:56.393179+0000","last_fullsized":"2023-05-10T01:21:56.393179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.373474+0000","last_change":"2023-05-10T01:21:55.989894+0000","last_active":"2023-05-10T01:21:56.373474+0000","last_peered":"2023-05-10T01:21:56.373474+0000","last_clean":"2023-05-10T01:21:56.373474+0000","last_became_active":"2023-05-10T01:21:55.989151+0000","last_became_peered":"2023-05-10T01:21:55.989151+0000","last_unstale":"2023-05-10T01:21:56.373474+0000","last_undegraded":"2023-05-10T01:21:56.373474+0000","last_fullsized":"2023-05-10T01:21:56.373474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.401225+0000","last_change":"2023-05-10T01:21:56.397647+0000","last_active":"2023-05-10T01:21:56.401225+0000","last_peered":"2023-05-10T01:21:56.401225+0000","last_clean":"2023-05-10T01:21:56.401225+0000","last_became_active":"2023-05-10T01:21:56.397366+0000","last_became_peered":"2023-05-10T01:21:56.397366+0000","last_unstale":"2023-05-10T01:21:56.401225+0000","last_undegraded":"2023-05-10T01:21:56.401225+0000","last_fullsized":"2023-05-10T01:21:56.401225+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378852+0000","last_change":"2023-05-10T01:21:55.982590+0000","last_active":"2023-05-10T01:21:56.378852+0000","last_peered":"2023-05-10T01:21:56.378852+0000","last_clean":"2023-05-10T01:21:56.378852+0000","last_became_active":"2023-05-10T01:21:55.982253+0000","last_became_peered":"2023-05-10T01:21:55.982253+0000","last_unstale":"2023-05-10T01:21:56.378852+0000","last_undegraded":"2023-05-10T01:21:56.378852+0000","last_fullsized":"2023-05-10T01:21:56.378852+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394756+0000","last_change":"2023-05-10T01:21:56.387217+0000","last_active":"2023-05-10T01:21:56.394756+0000","last_peered":"2023-05-10T01:21:56.394756+0000","last_clean":"2023-05-10T01:21:56.394756+0000","last_became_active":"2023-05-10T01:21:56.386938+0000","last_became_peered":"2023-05-10T01:21:56.386938+0000","last_unstale":"2023-05-10T01:21:56.394756+0000","last_undegraded":"2023-05-10T01:21:56.394756+0000","last_fullsized":"2023-05-10T01:21:56.394756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.377710+0000","last_change":"2023-05-10T01:21:55.986297+0000","last_active":"2023-05-10T01:21:56.377710+0000","last_peered":"2023-05-10T01:21:56.377710+0000","last_clean":"2023-05-10T01:21:56.377710+0000","last_became_active":"2023-05-10T01:21:55.985992+0000","last_became_peered":"2023-05-10T01:21:55.985992+0000","last_unstale":"2023-05-10T01:21:56.377710+0000","last_undegraded":"2023-05-10T01:21:56.377710+0000","last_fullsized":"2023-05-10T01:21:56.377710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398235+0000","last_change":"2023-05-10T01:21:56.394951+0000","last_active":"2023-05-10T01:21:56.398235+0000","last_peered":"2023-05-10T01:21:56.398235+0000","last_clean":"2023-05-10T01:21:56.398235+0000","last_became_active":"2023-05-10T01:21:56.394686+0000","last_became_peered":"2023-05-10T01:21:56.394686+0000","last_unstale":"2023-05-10T01:21:56.398235+0000","last_undegraded":"2023-05-10T01:21:56.398235+0000","last_fullsized":"2023-05-10T01:21:56.398235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396915+0000","last_change":"2023-05-10T01:21:55.984800+0000","last_active":"2023-05-10T01:21:56.396915+0000","last_peered":"2023-05-10T01:21:56.396915+0000","last_clean":"2023-05-10T01:21:56.396915+0000","last_became_active":"2023-05-10T01:21:55.984524+0000","last_became_peered":"2023-05-10T01:21:55.984524+0000","last_unstale":"2023-05-10T01:21:56.396915+0000","last_undegraded":"2023-05-10T01:21:56.396915+0000","last_fullsized":"2023-05-10T01:21:56.396915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393450+0000","last_change":"2023-05-10T01:21:56.389449+0000","last_active":"2023-05-10T01:21:56.393450+0000","last_peered":"2023-05-10T01:21:56.393450+0000","last_clean":"2023-05-10T01:21:56.393450+0000","last_became_active":"2023-05-10T01:21:56.388600+0000","last_became_peered":"2023-05-10T01:21:56.388600+0000","last_unstale":"2023-05-10T01:21:56.393450+0000","last_undegraded":"2023-05-10T01:21:56.393450+0000","last_fullsized":"2023-05-10T01:21:56.393450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394810+0000","last_change":"2023-05-10T01:21:55.986935+0000","last_active":"2023-05-10T01:21:56.394810+0000","last_peered":"2023-05-10T01:21:56.394810+0000","last_clean":"2023-05-10T01:21:56.394810+0000","last_became_active":"2023-05-10T01:21:55.986618+0000","last_became_peered":"2023-05-10T01:21:55.986618+0000","last_unstale":"2023-05-10T01:21:56.394810+0000","last_undegraded":"2023-05-10T01:21:56.394810+0000","last_fullsized":"2023-05-10T01:21:56.394810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395310+0000","last_change":"2023-05-10T01:21:56.385256+0000","last_active":"2023-05-10T01:21:56.395310+0000","last_peered":"2023-05-10T01:21:56.395310+0000","last_clean":"2023-05-10T01:21:56.395310+0000","last_became_active":"2023-05-10T01:21:56.384982+0000","last_became_peered":"2023-05-10T01:21:56.384982+0000","last_unstale":"2023-05-10T01:21:56.395310+0000","last_undegraded":"2023-05-10T01:21:56.395310+0000","last_fullsized":"2023-05-10T01:21:56.395310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387897+0000","last_change":"2023-05-10T01:21:55.988593+0000","last_active":"2023-05-10T01:21:56.387897+0000","last_peered":"2023-05-10T01:21:56.387897+0000","last_clean":"2023-05-10T01:21:56.387897+0000","last_became_active":"2023-05-10T01:21:55.986001+0000","last_became_peered":"2023-05-10T01:21:55.986001+0000","last_unstale":"2023-05-10T01:21:56.387897+0000","last_undegraded":"2023-05-10T01:21:56.387897+0000","last_fullsized":"2023-05-10T01:21:56.387897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390764+0000","last_change":"2023-05-10T01:21:56.384859+0000","last_active":"2023-05-10T01:21:56.390764+0000","last_peered":"2023-05-10T01:21:56.390764+0000","last_clean":"2023-05-10T01:21:56.390764+0000","last_became_active":"2023-05-10T01:21:56.384456+0000","last_became_peered":"2023-05-10T01:21:56.384456+0000","last_unstale":"2023-05-10T01:21:56.390764+0000","last_undegraded":"2023-05-10T01:21:56.390764+0000","last_fullsized":"2023-05-10T01:21:56.390764+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384127+0000","last_change":"2023-05-10T01:21:55.989343+0000","last_active":"2023-05-10T01:21:56.384127+0000","last_peered":"2023-05-10T01:21:56.384127+0000","last_clean":"2023-05-10T01:21:56.384127+0000","last_became_active":"2023-05-10T01:21:55.989107+0000","last_became_peered":"2023-05-10T01:21:55.989107+0000","last_unstale":"2023-05-10T01:21:56.384127+0000","last_undegraded":"2023-05-10T01:21:56.384127+0000","last_fullsized":"2023-05-10T01:21:56.384127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394649+0000","last_change":"2023-05-10T01:21:56.388984+0000","last_active":"2023-05-10T01:21:56.394649+0000","last_peered":"2023-05-10T01:21:56.394649+0000","last_clean":"2023-05-10T01:21:56.394649+0000","last_became_active":"2023-05-10T01:21:56.388706+0000","last_became_peered":"2023-05-10T01:21:56.388706+0000","last_unstale":"2023-05-10T01:21:56.394649+0000","last_undegraded":"2023-05-10T01:21:56.394649+0000","last_fullsized":"2023-05-10T01:21:56.394649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378918+0000","last_change":"2023-05-10T01:21:55.979920+0000","last_active":"2023-05-10T01:21:56.378918+0000","last_peered":"2023-05-10T01:21:56.378918+0000","last_clean":"2023-05-10T01:21:56.378918+0000","last_became_active":"2023-05-10T01:21:55.979642+0000","last_became_peered":"2023-05-10T01:21:55.979642+0000","last_unstale":"2023-05-10T01:21:56.378918+0000","last_undegraded":"2023-05-10T01:21:56.378918+0000","last_fullsized":"2023-05-10T01:21:56.378918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395277+0000","last_change":"2023-05-10T01:21:56.390549+0000","last_active":"2023-05-10T01:21:56.395277+0000","last_peered":"2023-05-10T01:21:56.395277+0000","last_clean":"2023-05-10T01:21:56.395277+0000","last_became_active":"2023-05-10T01:21:56.389725+0000","last_became_peered":"2023-05-10T01:21:56.389725+0000","last_unstale":"2023-05-10T01:21:56.395277+0000","last_undegraded":"2023-05-10T01:21:56.395277+0000","last_fullsized":"2023-05-10T01:21:56.395277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397441+0000","last_change":"2023-05-10T01:21:55.985996+0000","last_active":"2023-05-10T01:21:56.397441+0000","last_peered":"2023-05-10T01:21:56.397441+0000","last_clean":"2023-05-10T01:21:56.397441+0000","last_became_active":"2023-05-10T01:21:55.985693+0000","last_became_peered":"2023-05-10T01:21:55.985693+0000","last_unstale":"2023-05-10T01:21:56.397441+0000","last_undegraded":"2023-05-10T01:21:56.397441+0000","last_fullsized":"2023-05-10T01:21:56.397441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390084+0000","last_change":"2023-05-10T01:21:56.387575+0000","last_active":"2023-05-10T01:21:56.390084+0000","last_peered":"2023-05-10T01:21:56.390084+0000","last_clean":"2023-05-10T01:21:56.390084+0000","last_became_active":"2023-05-10T01:21:56.387380+0000","last_became_peered":"2023-05-10T01:21:56.387380+0000","last_unstale":"2023-05-10T01:21:56.390084+0000","last_undegraded":"2023-05-10T01:21:56.390084+0000","last_fullsized":"2023-05-10T01:21:56.390084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384279+0000","last_change":"2023-05-10T01:21:55.994254+0000","last_active":"2023-05-10T01:21:56.384279+0000","last_peered":"2023-05-10T01:21:56.384279+0000","last_clean":"2023-05-10T01:21:56.384279+0000","last_became_active":"2023-05-10T01:21:55.993796+0000","last_became_peered":"2023-05-10T01:21:55.993796+0000","last_unstale":"2023-05-10T01:21:56.384279+0000","last_undegraded":"2023-05-10T01:21:56.384279+0000","last_fullsized":"2023-05-10T01:21:56.384279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395063+0000","last_change":"2023-05-10T01:21:56.385556+0000","last_active":"2023-05-10T01:21:56.395063+0000","last_peered":"2023-05-10T01:21:56.395063+0000","last_clean":"2023-05-10T01:21:56.395063+0000","last_became_active":"2023-05-10T01:21:56.381923+0000","last_became_peered":"2023-05-10T01:21:56.381923+0000","last_unstale":"2023-05-10T01:21:56.395063+0000","last_undegraded":"2023-05-10T01:21:56.395063+0000","last_fullsized":"2023-05-10T01:21:56.395063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396818+0000","last_change":"2023-05-10T01:21:55.981924+0000","last_active":"2023-05-10T01:21:56.396818+0000","last_peered":"2023-05-10T01:21:56.396818+0000","last_clean":"2023-05-10T01:21:56.396818+0000","last_became_active":"2023-05-10T01:21:55.981638+0000","last_became_peered":"2023-05-10T01:21:55.981638+0000","last_unstale":"2023-05-10T01:21:56.396818+0000","last_undegraded":"2023-05-10T01:21:56.396818+0000","last_fullsized":"2023-05-10T01:21:56.396818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.391717+0000","last_change":"2023-05-10T01:21:56.389256+0000","last_active":"2023-05-10T01:21:56.391717+0000","last_peered":"2023-05-10T01:21:56.391717+0000","last_clean":"2023-05-10T01:21:56.391717+0000","last_became_active":"2023-05-10T01:21:56.388978+0000","last_became_peered":"2023-05-10T01:21:56.388978+0000","last_unstale":"2023-05-10T01:21:56.391717+0000","last_undegraded":"2023-05-10T01:21:56.391717+0000","last_fullsized":"2023-05-10T01:21:56.391717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384290+0000","last_change":"2023-05-10T01:21:55.982209+0000","last_active":"2023-05-10T01:21:56.384290+0000","last_peered":"2023-05-10T01:21:56.384290+0000","last_clean":"2023-05-10T01:21:56.384290+0000","last_became_active":"2023-05-10T01:21:55.981922+0000","last_became_peered":"2023-05-10T01:21:55.981922+0000","last_unstale":"2023-05-10T01:21:56.384290+0000","last_undegraded":"2023-05-10T01:21:56.384290+0000","last_fullsized":"2023-05-10T01:21:56.384290+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396433+0000","last_change":"2023-05-10T01:21:56.392425+0000","last_active":"2023-05-10T01:21:56.396433+0000","last_peered":"2023-05-10T01:21:56.396433+0000","last_clean":"2023-05-10T01:21:56.396433+0000","last_became_active":"2023-05-10T01:21:56.388917+0000","last_became_peered":"2023-05-10T01:21:56.388917+0000","last_unstale":"2023-05-10T01:21:56.396433+0000","last_undegraded":"2023-05-10T01:21:56.396433+0000","last_fullsized":"2023-05-10T01:21:56.396433+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.384283+0000","last_change":"2023-05-10T01:21:55.983687+0000","last_active":"2023-05-10T01:21:56.384283+0000","last_peered":"2023-05-10T01:21:56.384283+0000","last_clean":"2023-05-10T01:21:56.384283+0000","last_became_active":"2023-05-10T01:21:55.983496+0000","last_became_peered":"2023-05-10T01:21:55.983496+0000","last_unstale":"2023-05-10T01:21:56.384283+0000","last_undegraded":"2023-05-10T01:21:56.384283+0000","last_fullsized":"2023-05-10T01:21:56.384283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395333+0000","last_change":"2023-05-10T01:21:56.390584+0000","last_active":"2023-05-10T01:21:56.395333+0000","last_peered":"2023-05-10T01:21:56.395333+0000","last_clean":"2023-05-10T01:21:56.395333+0000","last_became_active":"2023-05-10T01:21:56.390323+0000","last_became_peered":"2023-05-10T01:21:56.390323+0000","last_unstale":"2023-05-10T01:21:56.395333+0000","last_undegraded":"2023-05-10T01:21:56.395333+0000","last_fullsized":"2023-05-10T01:21:56.395333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396396+0000","last_change":"2023-05-10T01:21:55.984806+0000","last_active":"2023-05-10T01:21:56.396396+0000","last_peered":"2023-05-10T01:21:56.396396+0000","last_clean":"2023-05-10T01:21:56.396396+0000","last_became_active":"2023-05-10T01:21:55.984490+0000","last_became_peered":"2023-05-10T01:21:55.984490+0000","last_unstale":"2023-05-10T01:21:56.396396+0000","last_undegraded":"2023-05-10T01:21:56.396396+0000","last_fullsized":"2023-05-10T01:21:56.396396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398704+0000","last_change":"2023-05-10T01:21:56.394803+0000","last_active":"2023-05-10T01:21:56.398704+0000","last_peered":"2023-05-10T01:21:56.398704+0000","last_clean":"2023-05-10T01:21:56.398704+0000","last_became_active":"2023-05-10T01:21:56.394534+0000","last_became_peered":"2023-05-10T01:21:56.394534+0000","last_unstale":"2023-05-10T01:21:56.398704+0000","last_undegraded":"2023-05-10T01:21:56.398704+0000","last_fullsized":"2023-05-10T01:21:56.398704+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375615+0000","last_change":"2023-05-10T01:21:55.987039+0000","last_active":"2023-05-10T01:21:56.375615+0000","last_peered":"2023-05-10T01:21:56.375615+0000","last_clean":"2023-05-10T01:21:56.375615+0000","last_became_active":"2023-05-10T01:21:55.986716+0000","last_became_peered":"2023-05-10T01:21:55.986716+0000","last_unstale":"2023-05-10T01:21:56.375615+0000","last_undegraded":"2023-05-10T01:21:56.375615+0000","last_fullsized":"2023-05-10T01:21:56.375615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398666+0000","last_change":"2023-05-10T01:21:56.395474+0000","last_active":"2023-05-10T01:21:56.398666+0000","last_peered":"2023-05-10T01:21:56.398666+0000","last_clean":"2023-05-10T01:21:56.398666+0000","last_became_active":"2023-05-10T01:21:56.395187+0000","last_became_peered":"2023-05-10T01:21:56.395187+0000","last_unstale":"2023-05-10T01:21:56.398666+0000","last_undegraded":"2023-05-10T01:21:56.398666+0000","last_fullsized":"2023-05-10T01:21:56.398666+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375565+0000","last_change":"2023-05-10T01:21:55.995788+0000","last_active":"2023-05-10T01:21:56.375565+0000","last_peered":"2023-05-10T01:21:56.375565+0000","last_clean":"2023-05-10T01:21:56.375565+0000","last_became_active":"2023-05-10T01:21:55.995511+0000","last_became_peered":"2023-05-10T01:21:55.995511+0000","last_unstale":"2023-05-10T01:21:56.375565+0000","last_undegraded":"2023-05-10T01:21:56.375565+0000","last_fullsized":"2023-05-10T01:21:56.375565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.386948+0000","last_change":"2023-05-10T01:21:56.381977+0000","last_active":"2023-05-10T01:21:56.386948+0000","last_peered":"2023-05-10T01:21:56.386948+0000","last_clean":"2023-05-10T01:21:56.386948+0000","last_became_active":"2023-05-10T01:21:56.381674+0000","last_became_peered":"2023-05-10T01:21:56.381674+0000","last_unstale":"2023-05-10T01:21:56.386948+0000","last_undegraded":"2023-05-10T01:21:56.386948+0000","last_fullsized":"2023-05-10T01:21:56.386948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387454+0000","last_change":"2023-05-10T01:21:55.977748+0000","last_active":"2023-05-10T01:21:56.387454+0000","last_peered":"2023-05-10T01:21:56.387454+0000","last_clean":"2023-05-10T01:21:56.387454+0000","last_became_active":"2023-05-10T01:21:55.977444+0000","last_became_peered":"2023-05-10T01:21:55.977444+0000","last_unstale":"2023-05-10T01:21:56.387454+0000","last_undegraded":"2023-05-10T01:21:56.387454+0000","last_fullsized":"2023-05-10T01:21:56.387454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.398685+0000","last_change":"2023-05-10T01:21:56.396855+0000","last_active":"2023-05-10T01:21:56.398685+0000","last_peered":"2023-05-10T01:21:56.398685+0000","last_clean":"2023-05-10T01:21:56.398685+0000","last_became_active":"2023-05-10T01:21:56.396558+0000","last_became_peered":"2023-05-10T01:21:56.396558+0000","last_unstale":"2023-05-10T01:21:56.398685+0000","last_undegraded":"2023-05-10T01:21:56.398685+0000","last_fullsized":"2023-05-10T01:21:56.398685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376271+0000","last_change":"2023-05-10T01:21:55.978862+0000","last_active":"2023-05-10T01:21:56.376271+0000","last_peered":"2023-05-10T01:21:56.376271+0000","last_clean":"2023-05-10T01:21:56.376271+0000","last_became_active":"2023-05-10T01:21:55.978571+0000","last_became_peered":"2023-05-10T01:21:55.978571+0000","last_unstale":"2023-05-10T01:21:56.376271+0000","last_undegraded":"2023-05-10T01:21:56.376271+0000","last_fullsized":"2023-05-10T01:21:56.376271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370802+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:21:56.370802+0000","last_peered":"2023-05-10T01:21:56.370802+0000","last_clean":"2023-05-10T01:21:56.370802+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:21:56.370802+0000","last_undegraded":"2023-05-10T01:21:56.370802+0000","last_fullsized":"2023-05-10T01:21:56.370802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394411+0000","last_change":"2023-05-10T01:21:56.386063+0000","last_active":"2023-05-10T01:21:56.394411+0000","last_peered":"2023-05-10T01:21:56.394411+0000","last_clean":"2023-05-10T01:21:56.394411+0000","last_became_active":"2023-05-10T01:21:56.385793+0000","last_became_peered":"2023-05-10T01:21:56.385793+0000","last_unstale":"2023-05-10T01:21:56.394411+0000","last_undegraded":"2023-05-10T01:21:56.394411+0000","last_fullsized":"2023-05-10T01:21:56.394411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.396031+0000","last_change":"2023-05-10T01:21:55.989340+0000","last_active":"2023-05-10T01:21:56.396031+0000","last_peered":"2023-05-10T01:21:56.396031+0000","last_clean":"2023-05-10T01:21:56.396031+0000","last_became_active":"2023-05-10T01:21:55.989048+0000","last_became_peered":"2023-05-10T01:21:55.989048+0000","last_unstale":"2023-05-10T01:21:56.396031+0000","last_undegraded":"2023-05-10T01:21:56.396031+0000","last_fullsized":"2023-05-10T01:21:56.396031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372423+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:21:56.372423+0000","last_peered":"2023-05-10T01:21:56.372423+0000","last_clean":"2023-05-10T01:21:56.372423+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:21:56.372423+0000","last_undegraded":"2023-05-10T01:21:56.372423+0000","last_fullsized":"2023-05-10T01:21:56.372423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.397071+0000","last_change":"2023-05-10T01:21:56.394425+0000","last_active":"2023-05-10T01:21:56.397071+0000","last_peered":"2023-05-10T01:21:56.397071+0000","last_clean":"2023-05-10T01:21:56.397071+0000","last_became_active":"2023-05-10T01:21:56.394093+0000","last_became_peered":"2023-05-10T01:21:56.394093+0000","last_unstale":"2023-05-10T01:21:56.397071+0000","last_undegraded":"2023-05-10T01:21:56.397071+0000","last_fullsized":"2023-05-10T01:21:56.397071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374092+0000","last_change":"2023-05-10T01:21:55.986090+0000","last_active":"2023-05-10T01:21:56.374092+0000","last_peered":"2023-05-10T01:21:56.374092+0000","last_clean":"2023-05-10T01:21:56.374092+0000","last_became_active":"2023-05-10T01:21:55.985835+0000","last_became_peered":"2023-05-10T01:21:55.985835+0000","last_unstale":"2023-05-10T01:21:56.374092+0000","last_undegraded":"2023-05-10T01:21:56.374092+0000","last_fullsized":"2023-05-10T01:21:56.374092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.387545+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:21:56.387545+0000","last_peered":"2023-05-10T01:21:56.387545+0000","last_clean":"2023-05-10T01:21:56.387545+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:21:56.387545+0000","last_undegraded":"2023-05-10T01:21:56.387545+0000","last_fullsized":"2023-05-10T01:21:56.387545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.393508+0000","last_change":"2023-05-10T01:21:56.392671+0000","last_active":"2023-05-10T01:21:56.393508+0000","last_peered":"2023-05-10T01:21:56.393508+0000","last_clean":"2023-05-10T01:21:56.393508+0000","last_became_active":"2023-05-10T01:21:56.392444+0000","last_became_peered":"2023-05-10T01:21:56.392444+0000","last_unstale":"2023-05-10T01:21:56.393508+0000","last_undegraded":"2023-05-10T01:21:56.393508+0000","last_fullsized":"2023-05-10T01:21:56.393508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.374173+0000","last_change":"2023-05-10T01:21:55.993109+0000","last_active":"2023-05-10T01:21:56.374173+0000","last_peered":"2023-05-10T01:21:56.374173+0000","last_clean":"2023-05-10T01:21:56.374173+0000","last_became_active":"2023-05-10T01:21:55.992808+0000","last_became_peered":"2023-05-10T01:21:55.992808+0000","last_unstale":"2023-05-10T01:21:56.374173+0000","last_undegraded":"2023-05-10T01:21:56.374173+0000","last_fullsized":"2023-05-10T01:21:56.374173+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.372296+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:21:56.372296+0000","last_peered":"2023-05-10T01:21:56.372296+0000","last_clean":"2023-05-10T01:21:56.372296+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:21:56.372296+0000","last_undegraded":"2023-05-10T01:21:56.372296+0000","last_fullsized":"2023-05-10T01:21:56.372296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379073+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:21:56.379073+0000","last_peered":"2023-05-10T01:21:56.379073+0000","last_clean":"2023-05-10T01:21:56.379073+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:21:56.379073+0000","last_undegraded":"2023-05-10T01:21:56.379073+0000","last_fullsized":"2023-05-10T01:21:56.379073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.395900+0000","last_change":"2023-05-10T01:21:56.388692+0000","last_active":"2023-05-10T01:21:56.395900+0000","last_peered":"2023-05-10T01:21:56.395900+0000","last_clean":"2023-05-10T01:21:56.395900+0000","last_became_active":"2023-05-10T01:21:56.388418+0000","last_became_peered":"2023-05-10T01:21:56.388418+0000","last_unstale":"2023-05-10T01:21:56.395900+0000","last_undegraded":"2023-05-10T01:21:56.395900+0000","last_fullsized":"2023-05-10T01:21:56.395900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379945+0000","last_change":"2023-05-10T01:21:55.981413+0000","last_active":"2023-05-10T01:21:56.379945+0000","last_peered":"2023-05-10T01:21:56.379945+0000","last_clean":"2023-05-10T01:21:56.379945+0000","last_became_active":"2023-05-10T01:21:55.981160+0000","last_became_peered":"2023-05-10T01:21:55.981160+0000","last_unstale":"2023-05-10T01:21:56.379945+0000","last_undegraded":"2023-05-10T01:21:56.379945+0000","last_fullsized":"2023-05-10T01:21:56.379945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.379161+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:21:56.379161+0000","last_peered":"2023-05-10T01:21:56.379161+0000","last_clean":"2023-05-10T01:21:56.379161+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:21:56.379161+0000","last_undegraded":"2023-05-10T01:21:56.379161+0000","last_fullsized":"2023-05-10T01:21:56.379161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.390004+0000","last_change":"2023-05-10T01:21:56.386770+0000","last_active":"2023-05-10T01:21:56.390004+0000","last_peered":"2023-05-10T01:21:56.390004+0000","last_clean":"2023-05-10T01:21:56.390004+0000","last_became_active":"2023-05-10T01:21:56.386485+0000","last_became_peered":"2023-05-10T01:21:56.386485+0000","last_unstale":"2023-05-10T01:21:56.390004+0000","last_undegraded":"2023-05-10T01:21:56.390004+0000","last_fullsized":"2023-05-10T01:21:56.390004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.378139+0000","last_change":"2023-05-10T01:21:55.986362+0000","last_active":"2023-05-10T01:21:56.378139+0000","last_peered":"2023-05-10T01:21:56.378139+0000","last_clean":"2023-05-10T01:21:56.378139+0000","last_became_active":"2023-05-10T01:21:55.985579+0000","last_became_peered":"2023-05-10T01:21:55.985579+0000","last_unstale":"2023-05-10T01:21:56.378139+0000","last_undegraded":"2023-05-10T01:21:56.378139+0000","last_fullsized":"2023-05-10T01:21:56.378139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.380000+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:21:56.380000+0000","last_peered":"2023-05-10T01:21:56.380000+0000","last_clean":"2023-05-10T01:21:56.380000+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:21:56.380000+0000","last_undegraded":"2023-05-10T01:21:56.380000+0000","last_fullsized":"2023-05-10T01:21:56.380000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.388353+0000","last_change":"2023-05-10T01:21:56.384106+0000","last_active":"2023-05-10T01:21:56.388353+0000","last_peered":"2023-05-10T01:21:56.388353+0000","last_clean":"2023-05-10T01:21:56.388353+0000","last_became_active":"2023-05-10T01:21:56.383829+0000","last_became_peered":"2023-05-10T01:21:56.383829+0000","last_unstale":"2023-05-10T01:21:56.388353+0000","last_undegraded":"2023-05-10T01:21:56.388353+0000","last_fullsized":"2023-05-10T01:21:56.388353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.376460+0000","last_change":"2023-05-10T01:21:55.987209+0000","last_active":"2023-05-10T01:21:56.376460+0000","last_peered":"2023-05-10T01:21:56.376460+0000","last_clean":"2023-05-10T01:21:56.376460+0000","last_became_active":"2023-05-10T01:21:55.986888+0000","last_became_peered":"2023-05-10T01:21:55.986888+0000","last_unstale":"2023-05-10T01:21:56.376460+0000","last_undegraded":"2023-05-10T01:21:56.376460+0000","last_fullsized":"2023-05-10T01:21:56.376460+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.370808+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:21:56.370808+0000","last_peered":"2023-05-10T01:21:56.370808+0000","last_clean":"2023-05-10T01:21:56.370808+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:21:56.370808+0000","last_undegraded":"2023-05-10T01:21:56.370808+0000","last_fullsized":"2023-05-10T01:21:56.370808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.394272+0000","last_change":"2023-05-10T01:21:56.387160+0000","last_active":"2023-05-10T01:21:56.394272+0000","last_peered":"2023-05-10T01:21:56.394272+0000","last_clean":"2023-05-10T01:21:56.394272+0000","last_became_active":"2023-05-10T01:21:56.386884+0000","last_became_peered":"2023-05-10T01:21:56.386884+0000","last_unstale":"2023-05-10T01:21:56.394272+0000","last_undegraded":"2023-05-10T01:21:56.394272+0000","last_fullsized":"2023-05-10T01:21:56.394272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:55.960990+0000","last_clean_scrub_stamp":"2023-05-10T01:21:55.960990+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.375961+0000","last_change":"2023-05-10T01:21:55.983841+0000","last_active":"2023-05-10T01:21:56.375961+0000","last_peered":"2023-05-10T01:21:56.375961+0000","last_clean":"2023-05-10T01:21:56.375961+0000","last_became_active":"2023-05-10T01:21:55.983556+0000","last_became_peered":"2023-05-10T01:21:55.983556+0000","last_unstale":"2023-05-10T01:21:56.375961+0000","last_undegraded":"2023-05-10T01:21:56.375961+0000","last_fullsized":"2023-05-10T01:21:56.375961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:21:54.955795+0000","last_clean_scrub_stamp":"2023-05-10T01:21:54.955795+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-05-10T01:21:56.385256+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:21:56.385256+0000","last_peered":"2023-05-10T01:21:56.385256+0000","last_clean":"2023-05-10T01:21:56.385256+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:21:56.385256+0000","last_undegraded":"2023-05-10T01:21:56.385256+0000","last_fullsized":"2023-05-10T01:21:56.385256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16368,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94355472,"statfs":{"total":96636764160,"available":96620003328,"internally_reserved":0,"allocated":761856,"data_stored":368110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.76500000000000001,"5min":0.79000000000000004,"15min":0.89900000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.60599999999999998},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.375},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.89800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.74099999999999999,"5min":0.77100000000000002,"15min":0.94899999999999995},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.626,"15min":0.59199999999999997},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.93300000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.92200000000000004},"last":0.82199999999999995}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":0.746,"15min":0.85899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.59499999999999997,"15min":0.58499999999999996},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.871},"last":0.755}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.311,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.78000000000000003},"last":0.432},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.68600000000000005}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.052},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.623}]},{"osd":6,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":0.76400000000000001,"5min":0.79200000000000004,"15min":0.88200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15720,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94356120,"statfs":{"total":96636764160,"available":96620666880,"internally_reserved":0,"allocated":753664,"data_stored":367502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":0.86199999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65800000000000003,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.75700000000000001,"15min":1.1160000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.42399999999999999,"15min":0.38900000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.28799999999999998},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":1.159},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.621},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.34599999999999997,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":1.321},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.85599999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15656,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94356184,"statfs":{"total":96636764160,"available":96620732416,"internally_reserved":0,"allocated":753664,"data_stored":367522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.25800000000000001,"5min":0.255,"15min":0.22},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.22700000000000001},"max":{"1min":0.54500000000000004,"5min":0.68999999999999995,"15min":0.77800000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.40400000000000003},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.55500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.46899999999999997},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47399999999999998,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.64300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.624},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":1.117},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78000000000000003,"5min":0.83599999999999997,"15min":1.05},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":1.3839999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":1.319},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89600000000000002,"5min":1.004,"15min":1.079},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.65400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.88200000000000001,"15min":1.0960000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.501,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.96899999999999997,"15min":1.3600000000000001},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15408,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94356432,"statfs":{"total":96636764160,"available":96620986368,"internally_reserved":0,"allocated":761856,"data_stored":367558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.21199999999999999},"max":{"1min":0.52900000000000003,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.28599999999999998,"15min":0.254},"max":{"1min":0.63,"5min":0.64200000000000002,"15min":0.80300000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.436,"15min":0.47399999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.251},"max":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":3.8370000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.33700000000000002,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.84099999999999997},"last":0.309}]},{"osd":3,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.85799999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.374},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.375},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.432},"max":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":1.224},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":1.002,"15min":1.1559999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16752,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94355088,"statfs":{"total":96636764160,"available":96619610112,"internally_reserved":0,"allocated":761856,"data_stored":368968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.25,"5min":0.248,"15min":0.217},"max":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.67100000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.371,"5min":0.32500000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.245},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41099999999999998},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.317}]},{"osd":3,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.436,"15min":0.40799999999999997},"min":{"1min":0.33600000000000002,"5min":0.27000000000000002,"15min":0.22},"max":{"1min":0.58799999999999997,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":0.68899999999999995,"5min":0.75,"15min":0.75},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.80700000000000005,"5min":0.89000000000000001,"15min":0.93100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94699999999999995,"15min":1.3320000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.50800000000000001,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed May 10 01:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":1.091},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.056},"last":0.55900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23856,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94347984,"statfs":{"total":96636764160,"available":96612335616,"internally_reserved":0,"allocated":761856,"data_stored":368098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.441,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.28399999999999997},"max":{"1min":0.64900000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40600000000000003,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.26500000000000001,"15min":0.23999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31},{"interface":"front","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28799999999999998,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.69899999999999995,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.45700000000000002},"min":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.28199999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":4,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":0.92200000000000004,"15min":1.0349999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.0589999999999999},"last":0.622}]},{"osd":5,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.439},"max":{"1min":0.92200000000000004,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64900000000000002,"15min":0.624},"min":{"1min":0.53500000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68700000000000006,"15min":0.65800000000000003},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.41199999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 10 01:21:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.628,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15976,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355864,"statfs":{"total":96636764160,"available":96620404736,"internally_reserved":0,"allocated":753664,"data_stored":367986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.72799999999999998,"5min":0.753,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69999999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.337}]},{"osd":1,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.92100000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.35499999999999998},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.35399999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71099999999999997,"5min":0.80400000000000005,"15min":0.85999999999999999},"last":1.3839999999999999}]},{"osd":3,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35399999999999998},"max":{"1min":0.65500000000000003,"5min":0.73899999999999999,"15min":0.83599999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.84899999999999998,"15min":0.89200000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34699999999999998},"max":{"1min":0.621,"5min":0.67900000000000005,"15min":0.88200000000000001},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47999999999999998,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.308},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":0.67300000000000004,"5min":0.82599999999999996,"15min":0.89400000000000002},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed May 10 01:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50600000000000001,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.81100000000000005,"15min":0.92700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.371},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0589999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19176,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94352664,"statfs":{"total":96636764160,"available":96617127936,"internally_reserved":0,"allocated":753664,"data_stored":368324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.56100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35399999999999998},"max":{"1min":0.66500000000000004,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63600000000000001,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.307},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.82599999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.72799999999999998,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.38900000000000001,"5min":0.34200000000000003,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.76500000000000001},"last":0.378}]},{"osd":6,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.51300000000000001},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":1.1120000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed May 10 01:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58899999999999997},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.39400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:22:05.281 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:22:05.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:22:05.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.429+0000 7faddb97c700 1 Processor -- start 2023-05-10T01:22:05.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.429+0000 7faddb97c700 1 -- start start 2023-05-10T01:22:05.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fadd414e430 0x7fadd4157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd4154db0 0x7fadd4066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fadd4067330 0x7fadd4065830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40653a0 con 0x7fadd414e430 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40677c0 con 0x7fadd4067330 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7faddb97c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4157ff0 con 0x7fadd4154db0 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.430+0000 7fadd9718700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fadd414e430 0x7fadd4157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fadd414e430 0x7fadd4157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33686/0 (socket says 172.21.15.52:33686) 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 -- 172.21.15.52:0/1453366904 learned_addr learned my addr 172.21.15.52:0/1453366904 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd8f17700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd4154db0 0x7fadd4066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9f19700 1 --2- 172.21.15.52:0/1453366904 >> v2:172.21.15.172:3300/0 conn(0x7fadd4067330 0x7fadd4065830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 -- 172.21.15.52:0/1453366904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd4154db0 msgr2=0x7fadd4066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd4154db0 0x7fadd4066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 -- 172.21.15.52:0/1453366904 >> v2:172.21.15.172:3300/0 conn(0x7fadd4067330 msgr2=0x7fadd4065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 --2- 172.21.15.52:0/1453366904 >> v2:172.21.15.172:3300/0 conn(0x7fadd4067330 0x7fadd4065830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 -- 172.21.15.52:0/1453366904 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd41582d0 con 0x7fadd414e430 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd9718700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd414e430 0x7fadd4157a10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fadd4064c30 tx=0x7fadcc0090f0).ready entity=mon.0 client_cookie=162e1c1d01b74fc9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd3fff700 1 -- 172.21.15.52:0/1453366904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00b600 con 0x7fadd414e430 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd3fff700 1 -- 172.21.15.52:0/1453366904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00b760 con 0x7fadd414e430 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.431+0000 7fadd3fff700 1 -- 172.21.15.52:0/1453366904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00bae0 con 0x7fadd414e430 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 -- 172.21.15.52:0/1453366904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd414e430 msgr2=0x7fadd4157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd414e430 0x7fadd4157a10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fadd4064c30 tx=0x7fadcc0090f0).stop 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 -- 172.21.15.52:0/1453366904 shutdown_connections 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 --2- 172.21.15.52:0/1453366904 >> v2:172.21.15.172:3300/0 conn(0x7fadd4067330 0x7fadd4065830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd414e430 0x7fadd4157a10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 --2- 172.21.15.52:0/1453366904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd4154db0 0x7fadd4066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 -- 172.21.15.52:0/1453366904 >> 172.21.15.52:0/1453366904 conn(0x7fadd40c8460 msgr2=0x7fadd40c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 -- 172.21.15.52:0/1453366904 shutdown_connections 2023-05-10T01:22:05.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.432+0000 7faddb97c700 1 -- 172.21.15.52:0/1453366904 wait complete. 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.433+0000 7faddb97c700 1 Processor -- start 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.433+0000 7faddb97c700 1 -- start start 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd414e430 0x7fadd4138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 0x7fadd4139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4139660 con 0x7fadd4067330 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40aace0 con 0x7fadd4154db0 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7faddb97c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40aafc0 con 0x7fadd414e430 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33690/0 (socket says 172.21.15.52:33690) 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 -- 172.21.15.52:0/399525197 learned_addr learned my addr 172.21.15.52:0/399525197 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd8f17700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd414e430 0x7fadd4138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9f19700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 0x7fadd4139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 -- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd414e430 msgr2=0x7fadd4138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd414e430 0x7fadd4138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 -- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 msgr2=0x7fadd4139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 0x7fadd4139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 -- 172.21.15.52:0/399525197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009370 con 0x7fadd4067330 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9f19700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 0x7fadd4139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd9718700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fadcc009130 tx=0x7fadcc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.434+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00b8d0 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.435+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00ba50 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.435+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd40ab2a0 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.435+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01c670 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.435+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd40ab860 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.436+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd406c340 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.436+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fadcc02c070 con 0x7fadd4067330 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.436+0000 7fadd17fa700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 0x7fadb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.436+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fadcc07b880 con 0x7fadd4067330 2023-05-10T01:22:05.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.437+0000 7fadd8f17700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 0x7fadb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.437+0000 7fadd8f17700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 0x7fadb4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fadd40aaaf0 tx=0x7fadc8008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.440+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fadcc04cd30 con 0x7fadd4067330 2023-05-10T01:22:05.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.680+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fadd40abbd0 con 0x7fadd4067330 2023-05-10T01:22:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.684+0000 7fadd17fa700 1 -- 172.21.15.52:0/399525197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fadcc02a0e0 con 0x7fadd4067330 2023-05-10T01:22:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 msgr2=0x7fadb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 0x7fadb4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fadd40aaaf0 tx=0x7fadc8008040).stop 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 msgr2=0x7fadd41384d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fadcc009130 tx=0x7fadcc017000).stop 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 shutdown_connections 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fadb405ed90 0x7fadb4061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadd4154db0 0x7fadd4139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4067330 0x7fadd41384d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 --2- 172.21.15.52:0/399525197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fadd414e430 0x7fadd4138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 >> 172.21.15.52:0/399525197 conn(0x7fadd40c8460 msgr2=0x7fadd40c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 shutdown_connections 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.686+0000 7faddb97c700 1 -- 172.21.15.52:0/399525197 wait complete. 2023-05-10T01:22:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:22:05.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:22:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.815+0000 7f6cd3855700 1 Processor -- start 2023-05-10T01:22:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.815+0000 7f6cd3855700 1 -- start start 2023-05-10T01:22:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd3855700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ccc154540 0x7f6ccc069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd3855700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0c0650 con 0x7f6ccc069b80 2023-05-10T01:22:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd3855700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc069fb0 con 0x7f6ccc154160 2023-05-10T01:22:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd3855700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0bfd20 con 0x7f6ccc154540 2023-05-10T01:22:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd1df2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ccc069b80 0x7f6ccc0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42718/0 (socket says 172.21.15.52:42718) 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd1df2700 1 -- 172.21.15.52:0/3053866133 learned_addr learned my addr 172.21.15.52:0/3053866133 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6cd0df0700 1 --2- 172.21.15.52:0/3053866133 >> v2:172.21.15.172:3300/0 conn(0x7f6ccc154540 0x7f6ccc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047240439 0 0) 0x7f6ccc0c0650 con 0x7f6ccc069b80 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb80033f0 con 0x7f6ccc069b80 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2269130294 0 0) 0x7f6cb80033f0 con 0x7f6ccc069b80 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 >> v2:172.21.15.172:3300/0 conn(0x7f6ccc154540 msgr2=0x7f6ccc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 --2- 172.21.15.52:0/3053866133 >> v2:172.21.15.172:3300/0 conn(0x7f6ccc154540 0x7f6ccc069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 >> v1:172.21.15.172:6789/0 conn(0x7f6ccc154160 legacy=0x7f6ccc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0c0000 con 0x7f6ccc069b80 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.816+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f6cbc001470 con 0x7f6ccc069b80 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 >> v1:172.21.15.52:6789/0 conn(0x7f6ccc069b80 legacy=0x7f6ccc0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb80038e0 0x7f6cb8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 0x7f6cb8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb8005050 0x7f6cb800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0bfd20 con 0x7f6cb8004690 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb800bfe0 con 0x7f6cb8005050 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb800c1a0 con 0x7f6cb80038e0 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 0x7f6cb8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd1df2700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb8005050 0x7f6cb800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd15f1700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb80038e0 0x7f6cb8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 -- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb80038e0 msgr2=0x7f6cb8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb80038e0 0x7f6cb8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 -- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb8005050 msgr2=0x7f6cb800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb8005050 0x7f6cb800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 -- 172.21.15.52:0/3053866133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80033f0 con 0x7f6cb8004690 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd1df2700 1 -- 172.21.15.52:0/3053866133 reap_dead start 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6cd0df0700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 0x7f6cb8004b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f6cc0006d80 tx=0x7f6cc0009060).ready entity=mon.0 client_cookie=23d196a21aab18de server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0009e90 con 0x7f6cb8004690 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc000e610 con 0x7f6cb8004690 2023-05-10T01:22:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.817+0000 7f6ccbfff700 1 -- 172.21.15.52:0/3053866133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000e9d0 con 0x7f6cb8004690 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 -- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 msgr2=0x7f6cb8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 0x7f6cb8004b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f6cc0006d80 tx=0x7f6cc0009060).stop 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 -- 172.21.15.52:0/3053866133 shutdown_connections 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 --2- 172.21.15.52:0/3053866133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb8004690 0x7f6cb8004b10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 -- 172.21.15.52:0/3053866133 >> 172.21.15.52:0/3053866133 conn(0x7f6ccc0cb6f0 msgr2=0x7f6ccc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 -- 172.21.15.52:0/3053866133 shutdown_connections 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.818+0000 7f6cd3855700 1 -- 172.21.15.52:0/3053866133 wait complete. 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.819+0000 7f6cd3855700 1 Processor -- start 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.819+0000 7f6cd3855700 1 -- start start 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb8004690 0x7f6ccc155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ccc1566a0 0x7f6ccc14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc157b00 con 0x7f6ccc0acd10 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ad680 con 0x7f6ccc1566a0 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd3855700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc156ef0 con 0x7f6cb8004690 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33714/0 (socket says 172.21.15.52:33714) 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 -- 172.21.15.52:0/116622642 learned_addr learned my addr 172.21.15.52:0/116622642 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd15f1700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb8004690 0x7f6ccc155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 -- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb8004690 msgr2=0x7f6ccc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb8004690 0x7f6ccc155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 -- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ccc1566a0 msgr2=0x7f6ccc14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ccc1566a0 0x7f6ccc14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.820+0000 7f6cd1df2700 1 -- 172.21.15.52:0/116622642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc1571d0 con 0x7f6ccc0acd10 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cd1df2700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f6ccc0c8a90 tx=0x7f6cbc001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00f660 con 0x7f6ccc0acd10 2023-05-10T01:22:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00f7c0 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc1574b0 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00fb40 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.821+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc156b20 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.822+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc157cb0 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.822+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6cbc01f070 con 0x7f6ccc0acd10 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.822+0000 7f6cc97fa700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 0x7f6cac061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.823+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f6cbc079300 con 0x7f6ccc0acd10 2023-05-10T01:22:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.823+0000 7f6cd15f1700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 0x7f6cac061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.823+0000 7f6cd15f1700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 0x7f6cac061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6cc40012e0 tx=0x7f6cc4007f30).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:05.827+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ccc157cb0 con 0x7f6ccc0acd10 2023-05-10T01:22:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.040+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ccc157cb0 con 0x7f6ccc0acd10 2023-05-10T01:22:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.041+0000 7f6cc97fa700 1 -- 172.21.15.52:0/116622642 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f6ccc157cb0 con 0x7f6ccc0acd10 2023-05-10T01:22:06.044 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:06.044 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:22:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 msgr2=0x7f6cac061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 0x7f6cac061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6cc40012e0 tx=0x7f6cc4007f30).stop 2023-05-10T01:22:06.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 msgr2=0x7f6ccc0ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f6ccc0c8a90 tx=0x7f6cbc001e50).stop 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 shutdown_connections 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cac05ed60 0x7f6cac061220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ccc0acd10 0x7f6ccc0ad190 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cb8004690 0x7f6ccc155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 --2- 172.21.15.52:0/116622642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ccc1566a0 0x7f6ccc14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 >> 172.21.15.52:0/116622642 conn(0x7f6ccc0cb6f0 msgr2=0x7f6ccc0abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 shutdown_connections 2023-05-10T01:22:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.043+0000 7f6cd3855700 1 -- 172.21.15.52:0/116622642 wait complete. 2023-05-10T01:22:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:22:06.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:21:56.367015+0000', 'modified': '2023-05-10T01:21:59.377887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5739}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5739': {'gid': 5739, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6836/751269855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 751269855}, {'type': 'v1', 'addr': '172.21.15.172:6836', 'nonce': 751269855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:22:06.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:22:06.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-10T01:22:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.579+0000 7f9a4c26a700 1 Processor -- start 2023-05-10T01:22:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.579+0000 7f9a4c26a700 1 -- start start 2023-05-10T01:22:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a4c26a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a44154540 0x7f9a44069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a4c26a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440c0650 con 0x7f9a44069b80 2023-05-10T01:22:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a4c26a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44069fb0 con 0x7f9a44154160 2023-05-10T01:22:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a4c26a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440bfd20 con 0x7f9a44154540 2023-05-10T01:22:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a49805700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a44154540 0x7f9a44069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a49805700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a44154540 0x7f9a44069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33720/0 (socket says 172.21.15.52:33720) 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a49805700 1 -- 172.21.15.52:0/2678915904 learned_addr learned my addr 172.21.15.52:0/2678915904 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.580+0000 7f9a4a807700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a44069b80 0x7f9a440c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42738/0 (socket says 172.21.15.52:42738) 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49004700 1 -- 172.21.15.52:0/2678915904 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854466769 0 0) 0x7f9a440c0650 con 0x7f9a44069b80 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49004700 1 -- 172.21.15.52:0/2678915904 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a300033f0 con 0x7f9a44069b80 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49805700 1 -- 172.21.15.52:0/2678915904 >> v1:172.21.15.172:6789/0 conn(0x7f9a44154160 legacy=0x7f9a440c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49805700 1 -- 172.21.15.52:0/2678915904 >> v1:172.21.15.52:6789/0 conn(0x7f9a44069b80 legacy=0x7f9a440c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49805700 1 -- 172.21.15.52:0/2678915904 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440c0000 con 0x7f9a44154540 2023-05-10T01:22:06.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49805700 1 --2- 172.21.15.52:0/2678915904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a44069690 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9a38006fd0 tx=0x7f9a380090f0).ready entity=mon.0 client_cookie=1f36fdf229d8e145 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49004700 1 -- 172.21.15.52:0/2678915904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800b580 con 0x7f9a44154540 2023-05-10T01:22:06.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49004700 1 -- 172.21.15.52:0/2678915904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800b6e0 con 0x7f9a44154540 2023-05-10T01:22:06.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.581+0000 7f9a49004700 1 -- 172.21.15.52:0/2678915904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800ba80 con 0x7f9a44154540 2023-05-10T01:22:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 -- 172.21.15.52:0/2678915904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 msgr2=0x7f9a44069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/2678915904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a44069690 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9a38006fd0 tx=0x7f9a380090f0).stop 2023-05-10T01:22:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 -- 172.21.15.52:0/2678915904 shutdown_connections 2023-05-10T01:22:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/2678915904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a44069690 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 -- 172.21.15.52:0/2678915904 >> 172.21.15.52:0/2678915904 conn(0x7f9a440cb6f0 msgr2=0x7f9a440c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 -- 172.21.15.52:0/2678915904 shutdown_connections 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.582+0000 7f9a4c26a700 1 -- 172.21.15.52:0/2678915904 wait complete. 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.583+0000 7f9a4c26a700 1 Processor -- start 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.583+0000 7f9a4c26a700 1 -- start start 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a44069b80 0x7f9a44158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 0x7f9a440ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44158820 con 0x7f9a44154540 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440b0840 con 0x7f9a44069b80 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440b0b20 con 0x7f9a44154160 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33728/0 (socket says 172.21.15.52:33728) 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 -- 172.21.15.52:0/3378344656 learned_addr learned my addr 172.21.15.52:0/3378344656 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a006700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a44069b80 0x7f9a44158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a49805700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 0x7f9a440ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 -- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 msgr2=0x7f9a440ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 0x7f9a440ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 -- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a44069b80 msgr2=0x7f9a44158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a44069b80 0x7f9a44158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 -- 172.21.15.52:0/3378344656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009370 con 0x7f9a44154540 2023-05-10T01:22:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a49805700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 0x7f9a440ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4a807700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9a3400c4c0 tx=0x7f9a34007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a427fc700 1 -- 172.21.15.52:0/3378344656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340072e0 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a427fc700 1 -- 172.21.15.52:0/3378344656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a34007440 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a440adcc0 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.584+0000 7f9a427fc700 1 -- 172.21.15.52:0/3378344656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340058f0 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.585+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440ae280 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.586+0000 7f9a427fc700 1 -- 172.21.15.52:0/3378344656 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9a3401a060 con 0x7f9a44154540 2023-05-10T01:22:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.586+0000 7f9a427fc700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 0x7f9a24061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.586+0000 7f9a427fc700 1 -- 172.21.15.52:0/3378344656 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f9a340792d0 con 0x7f9a44154540 2023-05-10T01:22:06.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.586+0000 7f9a4a006700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 0x7f9a24061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.587+0000 7f9a4a006700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 0x7f9a24061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9a3c004290 tx=0x7f9a3c001560).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.588+0000 7f9a5dbfcb80 1 Processor -- start 2023-05-10T01:22:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.588+0000 7f9a5dbfcb80 1 -- start start 2023-05-10T01:22:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993110c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99312d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9930ae5e0 con 0x55f9930e9300 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9930258a0 con 0x55f993132480 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f99303a900 con 0x55f99312d560 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33736/0 (socket says 172.21.15.52:33736) 2023-05-10T01:22:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 -- 172.21.15.52:0/1606164966 learned_addr learned my addr 172.21.15.52:0/1606164966 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a006700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993110c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a49805700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99312d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 -- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 msgr2=0x55f993110c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993110c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 -- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 msgr2=0x55f99312d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99312d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 -- 172.21.15.52:0/1606164966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f992edd310 con 0x55f9930e9300 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a49805700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99312d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.589+0000 7f9a4a807700 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9a3404e230 tx=0x7f9a3400f000).ready entity=mon.0 client_cookie=582e7560437fb072 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a237fe700 1 -- 172.21.15.52:0/1606164966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340790d0 con 0x55f9930e9300 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a237fe700 1 -- 172.21.15.52:0/1606164966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3404c7e0 con 0x55f9930e9300 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a237fe700 1 -- 172.21.15.52:0/1606164966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3404ab50 con 0x55f9930e9300 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/1606164966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 msgr2=0x55f9930e3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9a3404e230 tx=0x7f9a3400f000).stop 2023-05-10T01:22:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/1606164966 shutdown_connections 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9930e9300 0x55f9930e3710 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993110c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/1606164966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99312d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/1606164966 >> 172.21.15.52:0/1606164966 conn(0x55f992ea5e40 msgr2=0x55f9931319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/1606164966 shutdown_connections 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.590+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/1606164966 wait complete. 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.591+0000 7f9a5dbfcb80 1 -- start start 2023-05-10T01:22:06.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.591+0000 7f9a5dbfcb80 1 Processor -- start 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f99312ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993140a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f993001ed0 con 0x55f993132480 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99313f4d0 con 0x55f9930e9300 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9931414c0 con 0x55f99312d560 2023-05-10T01:22:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a5dbfcb80 10 client.0 ll_register_callbacks cb 0x55f9930a8200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33742/0 (socket says 172.21.15.52:33742) 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 -- 172.21.15.52:0/2837139537 learned_addr learned my addr 172.21.15.52:0/2837139537 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a49805700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f99312ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 -- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 msgr2=0x55f993140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 -- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 msgr2=0x55f99312ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f99312ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.592+0000 7f9a4a807700 1 -- 172.21.15.52:0/2837139537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440ae280 con 0x55f993132480 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f9a3404e140 tx=0x7f9a34059000).ready entity=mon.0 client_cookie=4ddf78855d467d91 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34010510 con 0x55f993132480 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f9a34079070 con 0x55f993132480 2023-05-10T01:22:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9930dc460 con 0x55f993132480 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a3404db40 con 0x55f993132480 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 10 client.5901 fetch_fsmap learned FSMap version 23 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f993033880 con 0x55f993132480 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9930dc460 con 0x55f993132480 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9a34066020 con 0x55f993132480 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 10 client.5901 fetch_fsmap finished waiting for FSMap version 23 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 10 client.5901 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:22:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 20 client.5901 populate_metadata read hostname 'smithi052' 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f99313e5b0 0x55f99313e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 4 client.5901 mds_command: new command op to 5739 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 --> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f992ea1ca0 con 0x55f99313e5b0 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.593+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f99313e5b0 0x55f99313e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a20ff9700 10 client.5901 ms_handle_connect on v2:172.21.15.172:6834/751269855 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f99313e5b0 0x55f99313e990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=992a7c1903cb12e1 server_cookie=56126aa74de7e9ce in_seq=0 out_seq=0 2023-05-10T01:22:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2837139537 <== mds.0 v2:172.21.15.172:6834/751269855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55f992ea1ca0 con 0x55f99313e5b0 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a20ff9700 10 client.5901 handle_command_reply: tid=0 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a5dbfcb80 1 client.5901 shutdown 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 msgr2=0x55f993140f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.594+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f9a3404e140 tx=0x7f9a34059000).stop 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 shutdown_connections 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f993140f60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f99313e5b0 0x55f99313e990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f99312ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a20ff9700 0 client.5901 ms_handle_reset on v2:172.21.15.172:6834/751269855 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2837139537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f993140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 >> 172.21.15.52:0/2837139537 conn(0x55f992ea5e40 msgr2=0x55f9930e8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 shutdown_connections 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2837139537 wait complete. 2023-05-10T01:22:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.595+0000 7f9a5dbfcb80 20 client.5901 trim_cache size 0 max 16384 2023-05-10T01:22:06.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.611+0000 7f9a5dbfcb80 1 Processor -- start 2023-05-10T01:22:06.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.611+0000 7f9a5dbfcb80 1 -- start start 2023-05-10T01:22:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f9930e9300 0x55f99312d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99313cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9930e6f10 con 0x55f99312d560 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99313d4c0 con 0x55f993132480 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f993132860 con 0x55f9930e9300 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33748/0 (socket says 172.21.15.52:33748) 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 -- 172.21.15.52:0/901709594 learned_addr learned my addr 172.21.15.52:0/901709594 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a4a006700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f9930e9300 0x55f99312d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a4a807700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99313cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 -- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f9930e9300 msgr2=0x55f99312d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f9930e9300 0x55f99312d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 -- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 msgr2=0x55f99313cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99313cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a49805700 1 -- 172.21.15.52:0/901709594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f99302f070 con 0x55f99312d560 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.612+0000 7f9a4a807700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99313cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a49805700 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9a38009ea0 tx=0x7f9a38017000).ready entity=mon.0 client_cookie=8e154245f314ad0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a23fff700 1 -- 172.21.15.52:0/901709594 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38022070 con 0x55f99312d560 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a23fff700 1 -- 172.21.15.52:0/901709594 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38000bc0 con 0x55f99312d560 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a23fff700 1 -- 172.21.15.52:0/901709594 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800ba80 con 0x55f99312d560 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/901709594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 msgr2=0x55f99313cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9a38009ea0 tx=0x7f9a38017000).stop 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/901709594 shutdown_connections 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f993132480 0x55f99313cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f9930e9300 0x55f99312d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/901709594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f99312d560 0x55f99313cae0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/901709594 >> 172.21.15.52:0/901709594 conn(0x55f992ea5e40 msgr2=0x55f9930dfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/901709594 shutdown_connections 2023-05-10T01:22:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.613+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/901709594 wait complete. 2023-05-10T01:22:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.614+0000 7f9a5dbfcb80 1 -- start start 2023-05-10T01:22:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.614+0000 7f9a5dbfcb80 1 Processor -- start 2023-05-10T01:22:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f9931924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f99312b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99312c050 con 0x55f993132480 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f993194080 con 0x55f9930e9300 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f99313eab0 con 0x55f99312d560 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 10 client.0 ll_register_callbacks cb 0x55f9930a8200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33756/0 (socket says 172.21.15.52:33756) 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 -- 172.21.15.52:0/2220297603 learned_addr learned my addr 172.21.15.52:0/2220297603 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f9931924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a49805700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f99312b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 -- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 msgr2=0x55f99312b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f99312b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 -- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 msgr2=0x55f9931924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f9931924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 -- 172.21.15.52:0/2220297603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440c0000 con 0x55f993132480 2023-05-10T01:22:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a4a807700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f9a3400c490 tx=0x7f9a3405f000).ready entity=mon.0 client_cookie=2630e9bf11c0f8af server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3406e070 con 0x55f993132480 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a3404c7e0 con 0x55f993132480 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.615+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f9a3404db40 con 0x55f993132480 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a34010510 con 0x55f993132480 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 10 client.5907 fetch_fsmap learned FSMap version 23 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f99302edc0 con 0x55f993132480 2023-05-10T01:22:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3404c7e0 con 0x55f993132480 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9a34071050 con 0x55f993132480 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 10 client.5907 fetch_fsmap finished waiting for FSMap version 23 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 10 client.5907 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 20 client.5907 populate_metadata read hostname 'smithi052' 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f9931113a0 0x55f993111780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 4 client.5907 mds_command: new command op to 5739 tid=0[{"prefix": "status"}] 2023-05-10T01:22:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 --> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f992ed8ca0 con 0x55f9931113a0 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f9931113a0 0x55f993111780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a20ff9700 10 client.5907 ms_handle_connect on v2:172.21.15.172:6834/751269855 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.616+0000 7f9a4a006700 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f9931113a0 0x55f993111780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3f15ba325a906e1b server_cookie=257a1e3b52c597cb in_seq=0 out_seq=0 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a20ff9700 1 -- 172.21.15.52:0/2220297603 <== mds.0 v2:172.21.15.172:6834/751269855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f992ed8ca0 con 0x55f9931113a0 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a20ff9700 10 client.5907 handle_command_reply: tid=0 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 client.5907 shutdown 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 msgr2=0x55f99312bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f9a3400c490 tx=0x7f9a3405f000).stop 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 shutdown_connections 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f993132480 0x55f99312bb60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:6834/751269855,v1:172.21.15.172:6836/751269855] conn(0x55f9931113a0 0x55f993111780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9930e9300 0x55f9931924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a20ff9700 0 client.5907 ms_handle_reset on v2:172.21.15.172:6834/751269855 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 --2- 172.21.15.52:0/2220297603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f99312d560 0x55f99312b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 >> 172.21.15.52:0/2220297603 conn(0x55f992ea5e40 msgr2=0x55f9930e96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 shutdown_connections 2023-05-10T01:22:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 1 -- 172.21.15.52:0/2220297603 wait complete. 2023-05-10T01:22:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a5dbfcb80 20 client.5907 trim_cache size 0 max 16384 2023-05-10T01:22:06.630 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:22:06.630 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 5739, 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.248326133999999, 2023-05-10T01:22:06.631 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2023-05-10T01:22:06.632 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 63, 2023-05-10T01:22:06.632 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 63, 2023-05-10T01:22:06.632 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.762616746999999 2023-05-10T01:22:06.632 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:22:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 msgr2=0x7f9a24061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 0x7f9a24061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9a3c004290 tx=0x7f9a3c001560).stop 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 msgr2=0x7f9a440c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9a3400c4c0 tx=0x7f9a34007c10).stop 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 shutdown_connections 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9a2405ed90 0x7f9a24061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a44154540 0x7f9a440c3e80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a44069b80 0x7f9a44158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 --2- 172.21.15.52:0/3378344656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a44154160 0x7f9a440ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.617+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 >> 172.21.15.52:0/3378344656 conn(0x7f9a440cb6f0 msgr2=0x7f9a4414e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.618+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 shutdown_connections 2023-05-10T01:22:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.618+0000 7f9a4c26a700 1 -- 172.21.15.52:0/3378344656 wait complete. 2023-05-10T01:22:06.635 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:22:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.737+0000 7fa242c1c700 1 Processor -- start 2023-05-10T01:22:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.737+0000 7fa242c1c700 1 -- start start 2023-05-10T01:22:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa242c1c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c151f40 0x7fa23c0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa242c1c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa23c064370 0x7fa23c064800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa242c1c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c0a9430 con 0x7fa23c067dc0 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa242c1c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0c3100 con 0x7fa23c064370 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa242c1c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c063ee0 con 0x7fa23c151f40 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa23c064370 0x7fa23c064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa23c064370 0x7fa23c064800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33764/0 (socket says 172.21.15.52:33764) 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 -- 172.21.15.52:0/2784225880 learned_addr learned my addr 172.21.15.52:0/2784225880 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2409b8700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c151f40 0x7fa23c0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 -- 172.21.15.52:0/2784225880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c151f40 msgr2=0x7fa23c0c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c151f40 0x7fa23c0c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 -- 172.21.15.52:0/2784225880 >> v1:172.21.15.172:6789/0 conn(0x7fa23c067dc0 legacy=0x7fa23c068240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.738+0000 7fa2411b9700 1 -- 172.21.15.52:0/2784225880 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0c2b40 con 0x7fa23c064370 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa2411b9700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c064370 0x7fa23c064800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa224006fd0 tx=0x7fa2240090f0).ready entity=mon.0 client_cookie=dbf4d3de5d338bed server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa23b7fe700 1 -- 172.21.15.52:0/2784225880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400b580 con 0x7fa23c064370 2023-05-10T01:22:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa23b7fe700 1 -- 172.21.15.52:0/2784225880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400b6e0 con 0x7fa23c064370 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa23b7fe700 1 -- 172.21.15.52:0/2784225880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400ba80 con 0x7fa23c064370 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 -- 172.21.15.52:0/2784225880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c064370 msgr2=0x7fa23c064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c064370 0x7fa23c064800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa224006fd0 tx=0x7fa2240090f0).stop 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 -- 172.21.15.52:0/2784225880 shutdown_connections 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c151f40 0x7fa23c0c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 --2- 172.21.15.52:0/2784225880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c064370 0x7fa23c064800 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 -- 172.21.15.52:0/2784225880 >> 172.21.15.52:0/2784225880 conn(0x7fa23c0c6870 msgr2=0x7fa23c0c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 -- 172.21.15.52:0/2784225880 shutdown_connections 2023-05-10T01:22:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.739+0000 7fa242c1c700 1 -- 172.21.15.52:0/2784225880 wait complete. 2023-05-10T01:22:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.740+0000 7fa242c1c700 1 Processor -- start 2023-05-10T01:22:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 -- start start 2023-05-10T01:22:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c064370 0x7fa23c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 0x7fa23c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0bdb60 con 0x7fa23c067dc0 2023-05-10T01:22:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0c4500 con 0x7fa23c151f40 2023-05-10T01:22:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa242c1c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0c47e0 con 0x7fa23c064370 2023-05-10T01:22:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33768/0 (socket says 172.21.15.52:33768) 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.741+0000 7fa23bfff700 1 -- 172.21.15.52:0/3982151842 learned_addr learned my addr 172.21.15.52:0/3982151842 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa2409b8700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c064370 0x7fa23c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa2411b9700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 0x7fa23c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 -- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c064370 msgr2=0x7fa23c0a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c064370 0x7fa23c0a5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 -- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 msgr2=0x7fa23c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 0x7fa23c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 -- 172.21.15.52:0/3982151842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009370 con 0x7fa23c067dc0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa2411b9700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 0x7fa23c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa23bfff700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fa22c00c790 tx=0x7fa22c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00a520 con 0x7fa23c067dc0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c00a680 con 0x7fa23c067dc0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0c4ac0 con 0x7fa23c067dc0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00aa40 con 0x7fa23c067dc0 2023-05-10T01:22:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.742+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c0c5080 con 0x7fa23c067dc0 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.743+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c05f360 con 0x7fa23c067dc0 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.744+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa22c010070 con 0x7fa23c067dc0 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.744+0000 7fa238ff9700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 0x7fa220061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.744+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fa22c079730 con 0x7fa23c067dc0 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.744+0000 7fa2409b8700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 0x7fa220061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.745+0000 7fa2409b8700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 0x7fa220061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa234009ba0 tx=0x7fa234008040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.748+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa22c04e610 con 0x7fa23c067dc0 2023-05-10T01:22:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.964+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa23c0a9430 con 0x7fa23c067dc0 2023-05-10T01:22:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.965+0000 7fa238ff9700 1 -- 172.21.15.52:0/3982151842 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa23c0a9430 con 0x7fa23c067dc0 2023-05-10T01:22:06.968 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:22:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.966+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 msgr2=0x7fa220061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.966+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 0x7fa220061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa234009ba0 tx=0x7fa234008040).stop 2023-05-10T01:22:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.966+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 msgr2=0x7fa23c0be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.966+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fa22c00c790 tx=0x7fa22c0015e0).stop 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 shutdown_connections 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22005ed90 0x7fa220061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c151f40 0x7fa23c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa23c064370 0x7fa23c0a5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 --2- 172.21.15.52:0/3982151842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa23c067dc0 0x7fa23c0be830 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 >> 172.21.15.52:0/3982151842 conn(0x7fa23c0c6870 msgr2=0x7fa23c151140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 shutdown_connections 2023-05-10T01:22:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:06.967+0000 7fa242c1c700 1 -- 172.21.15.52:0/3982151842 wait complete. 2023-05-10T01:22:06.980 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:22:06.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:22:06.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:22:06.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:22:06.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:22:06.981 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:22:06.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:22:06.982 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:22:06.982 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:22:06.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:06.983 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:22:06.998 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:06.999 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41509sec preferred_lft 41509sec 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:22:07.000 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:22:07.001 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:07.002 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:22:07.003 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:22:07.003 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:22:07.003 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:22:07.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.004 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:22:07.061 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:22:07.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.063 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:22:07.121 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:22:07.122 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:22:07.123 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:22:07.123 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:22:07.123 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:22:07.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.124 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:22:07.125 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:22:07.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:22:07.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:22:07.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:22:07.126 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:22:07.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.225 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:22:07.239 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:22:07.240 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:22:07.240 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:22:07.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:22:07.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.305 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:22:07.359 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:22:07.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:22:07.438 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:22:07.439 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:22:07.482 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:22:07.482 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:22:07.484 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:22:07.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:22:07.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:22:07.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:22:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.704+0000 7fefc36f2700 1 Processor -- start 2023-05-10T01:22:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.704+0000 7fefc36f2700 1 -- start start 2023-05-10T01:22:07.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc36f2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefbc154160 0x7fefbc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc36f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefbc069da0 0x7fefbc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc36f2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0c0650 con 0x7fefbc154540 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc36f2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0c1af0 con 0x7fefbc069da0 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc36f2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0bfd20 con 0x7fefbc154160 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc1c8f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefbc069da0 0x7fefbc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc1c8f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefbc069da0 0x7fefbc0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33784/0 (socket says 172.21.15.52:33784) 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc1c8f700 1 -- 172.21.15.52:0/2633170170 learned_addr learned my addr 172.21.15.52:0/2633170170 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.705+0000 7fefc148e700 1 --2- 172.21.15.52:0/2633170170 >> v2:172.21.15.172:3300/0 conn(0x7fefbc154160 0x7fefbc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc1c8f700 1 -- 172.21.15.52:0/2633170170 >> v2:172.21.15.172:3300/0 conn(0x7fefbc154160 msgr2=0x7fefbc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc1c8f700 1 --2- 172.21.15.52:0/2633170170 >> v2:172.21.15.172:3300/0 conn(0x7fefbc154160 0x7fefbc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc1c8f700 1 -- 172.21.15.52:0/2633170170 >> v1:172.21.15.172:6789/0 conn(0x7fefbc154540 legacy=0x7fefbc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc1c8f700 1 -- 172.21.15.52:0/2633170170 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0c0000 con 0x7fefbc069da0 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc1c8f700 1 --2- 172.21.15.52:0/2633170170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c6150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fefbc083020 tx=0x7fefac0090f0).ready entity=mon.0 client_cookie=bbc75c7ccbf780f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefbbfff700 1 -- 172.21.15.52:0/2633170170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00b600 con 0x7fefbc069da0 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefbbfff700 1 -- 172.21.15.52:0/2633170170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac00b760 con 0x7fefbc069da0 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefbbfff700 1 -- 172.21.15.52:0/2633170170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00bb00 con 0x7fefbc069da0 2023-05-10T01:22:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 -- 172.21.15.52:0/2633170170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 msgr2=0x7fefbc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 --2- 172.21.15.52:0/2633170170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c6150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fefbc083020 tx=0x7fefac0090f0).stop 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 -- 172.21.15.52:0/2633170170 shutdown_connections 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 --2- 172.21.15.52:0/2633170170 >> v2:172.21.15.172:3300/0 conn(0x7fefbc154160 0x7fefbc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 --2- 172.21.15.52:0/2633170170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c6150 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.706+0000 7fefc36f2700 1 -- 172.21.15.52:0/2633170170 >> 172.21.15.52:0/2633170170 conn(0x7fefbc0cb6f0 msgr2=0x7fefbc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.707+0000 7fefc36f2700 1 -- 172.21.15.52:0/2633170170 shutdown_connections 2023-05-10T01:22:07.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.707+0000 7fefc36f2700 1 -- 172.21.15.52:0/2633170170 wait complete. 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.708+0000 7fefc36f2700 1 Processor -- start 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.708+0000 7fefc36f2700 1 -- start start 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.708+0000 7fefc36f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 0x7fefbc0c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc154540 0x7fefbc0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c9920 con 0x7fefbc069da0 2023-05-10T01:22:07.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc165290 con 0x7fefbc154540 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1660b0 con 0x7fefbc154160 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33786/0 (socket says 172.21.15.52:33786) 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 -- 172.21.15.52:0/254961953 learned_addr learned my addr 172.21.15.52:0/254961953 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc1c8f700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc154540 0x7fefbc0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc0c8d700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 0x7fefbc0c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 -- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 msgr2=0x7fefbc0c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 0x7fefbc0c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 -- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc154540 msgr2=0x7fefbc0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc154540 0x7fefbc0c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 -- 172.21.15.52:0/254961953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009370 con 0x7fefbc069da0 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc0c8d700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 0x7fefbc0c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc148e700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fefb400e190 tx=0x7fefb4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:07.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400ed20 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400ee80 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4014610 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc1654a0 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.709+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc165a60 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.710+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc0666b0 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.711+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fefb401b030 con 0x7fefbc069da0 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.711+0000 7fefb97fa700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 0x7fef9c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:07.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.711+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7fefb407a090 con 0x7fefbc069da0 2023-05-10T01:22:07.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.711+0000 7fefc0c8d700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 0x7fef9c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:07.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.712+0000 7fefc0c8d700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 0x7fef9c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fefbc0ca2e0 tx=0x7fefb0009040).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:07.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.715+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefb404b4e0 con 0x7fefbc069da0 2023-05-10T01:22:07.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.917+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fefbc06c340 con 0x7fef9c05ed90 2023-05-10T01:22:07.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.919+0000 7fefb97fa700 1 -- 172.21.15.52:0/254961953 <== mgr.5027 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fefbc06c340 con 0x7fef9c05ed90 2023-05-10T01:22:07.921 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:22:07.921 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:22:07.922 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:22:07.922 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:22:07.922 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:22:07.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 msgr2=0x7fef9c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 0x7fef9c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fefbc0ca2e0 tx=0x7fefb0009040).stop 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 msgr2=0x7fefbc0c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fefb400e190 tx=0x7fefb4009900).stop 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 shutdown_connections 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fef9c05ed90 0x7fef9c061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc154540 0x7fefbc0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefbc069da0 0x7fefbc0c8f40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 --2- 172.21.15.52:0/254961953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefbc154160 0x7fefbc0c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 >> 172.21.15.52:0/254961953 conn(0x7fefbc0cb6f0 msgr2=0x7fefbc14ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 shutdown_connections 2023-05-10T01:22:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:07.921+0000 7fefc36f2700 1 -- 172.21.15.52:0/254961953 wait complete. 2023-05-10T01:22:07.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:22:08.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.050+0000 7efcf8dd5700 1 Processor -- start 2023-05-10T01:22:08.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.050+0000 7efcf8dd5700 1 -- start start 2023-05-10T01:22:08.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.051+0000 7efcf8dd5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efcf4154460 0x7efcf40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.051+0000 7efcf8dd5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 0x7efcf40685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.051+0000 7efcf8dd5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c94c0 con 0x7efcf4154080 2023-05-10T01:22:08.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.051+0000 7efcf8dd5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40cb7d0 con 0x7efcf4154460 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.051+0000 7efcf8dd5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4068a90 con 0x7efcf4068150 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efcf4154460 0x7efcf40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf259c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efcf4154080 0x7efcf40a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42810/0 (socket says 172.21.15.52:42810) 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf259c700 1 -- 172.21.15.52:0/2919791957 learned_addr learned my addr 172.21.15.52:0/2919791957 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf2d9d700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 0x7efcf40685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 -- 172.21.15.52:0/2919791957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 msgr2=0x7efcf40685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:08.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 0x7efcf40685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 -- 172.21.15.52:0/2919791957 >> v1:172.21.15.52:6789/0 conn(0x7efcf4154080 legacy=0x7efcf40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 -- 172.21.15.52:0/2919791957 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c88b0 con 0x7efcf4154460 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf159a700 1 -- 172.21.15.52:0/2919791957 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183174924 0 0) 0x7efcf40c94c0 con 0x7efcf4154080 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf2d9d700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 0x7efcf40685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf1d9b700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4154460 0x7efcf40aac90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7efcdc009760 tx=0x7efcdc009060).ready entity=mon.0 client_cookie=affc76e58fd4908c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf159a700 1 -- 172.21.15.52:0/2919791957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00b580 con 0x7efcf4154460 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf159a700 1 -- 172.21.15.52:0/2919791957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00b6e0 con 0x7efcf4154460 2023-05-10T01:22:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.052+0000 7efcf159a700 1 -- 172.21.15.52:0/2919791957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00ba60 con 0x7efcf4154460 2023-05-10T01:22:08.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 -- 172.21.15.52:0/2919791957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4154460 msgr2=0x7efcf40aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4154460 0x7efcf40aac90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7efcdc009760 tx=0x7efcdc009060).stop 2023-05-10T01:22:08.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 -- 172.21.15.52:0/2919791957 shutdown_connections 2023-05-10T01:22:08.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4068150 0x7efcf40685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/2919791957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4154460 0x7efcf40aac90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 -- 172.21.15.52:0/2919791957 >> 172.21.15.52:0/2919791957 conn(0x7efcf4067910 msgr2=0x7efcf40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 -- 172.21.15.52:0/2919791957 shutdown_connections 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.053+0000 7efcf8dd5700 1 -- 172.21.15.52:0/2919791957 wait complete. 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.054+0000 7efcf8dd5700 1 Processor -- start 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.054+0000 7efcf8dd5700 1 -- start start 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4154080 0x7efcf414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcf4154460 0x7efcf40c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4157660 con 0x7efcf4068150 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4151b80 con 0x7efcf4154460 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4151e20 con 0x7efcf4154080 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33800/0 (socket says 172.21.15.52:33800) 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 -- 172.21.15.52:0/3936288336 learned_addr learned my addr 172.21.15.52:0/3936288336 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 -- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4154080 msgr2=0x7efcf414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4154080 0x7efcf414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 -- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcf4154460 msgr2=0x7efcf40c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcf4154460 0x7efcf40c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 -- 172.21.15.52:0/3936288336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0092a0 con 0x7efcf4068150 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf259c700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7efcec00c4e0 tx=0x7efcec007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec0072e0 con 0x7efcf4068150 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec007440 con 0x7efcf4068150 2023-05-10T01:22:08.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf4152100 con 0x7efcf4068150 2023-05-10T01:22:08.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec0057a0 con 0x7efcf4068150 2023-05-10T01:22:08.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.055+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf41526c0 con 0x7efcf4068150 2023-05-10T01:22:08.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.056+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf4066720 con 0x7efcf4068150 2023-05-10T01:22:08.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.057+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efcec01a060 con 0x7efcf4068150 2023-05-10T01:22:08.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.057+0000 7efcea7fc700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 0x7efcd8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.057+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7efcec079520 con 0x7efcf4068150 2023-05-10T01:22:08.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.057+0000 7efcf1d9b700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 0x7efcd8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.058+0000 7efcf1d9b700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 0x7efcd8061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7efcf40c6730 tx=0x7efcdc017000).ready entity=mgr.5027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:08.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.061+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efcec04a9d0 con 0x7efcf4068150 2023-05-10T01:22:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.282+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7efcf40c8bf0 con 0x7efcf4068150 2023-05-10T01:22:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.694+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7efcec010070 con 0x7efcf4068150 2023-05-10T01:22:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.695+0000 7efcea7fc700 1 -- 172.21.15.52:0/3936288336 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7efcec076e00 con 0x7efcf4068150 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 msgr2=0x7efcd8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 0x7efcd8061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7efcf40c6730 tx=0x7efcdc017000).stop 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 msgr2=0x7efcf4157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7efcec00c4e0 tx=0x7efcec007c70).stop 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 shutdown_connections 2023-05-10T01:22:08.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efcd805ed90 0x7efcd8061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcf4154460 0x7efcf40c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcf4068150 0x7efcf4157170 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 --2- 172.21.15.52:0/3936288336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcf4154080 0x7efcf414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 >> 172.21.15.52:0/3936288336 conn(0x7efcf4067910 msgr2=0x7efcf414f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 shutdown_connections 2023-05-10T01:22:08.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.698+0000 7efcf8dd5700 1 -- 172.21.15.52:0/3936288336 wait complete. 2023-05-10T01:22:08.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:22:08.832 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:08.829+0000 7f78bfc5e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:22:08.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.840+0000 7f2ba9187700 1 Processor -- start 2023-05-10T01:22:08.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.840+0000 7f2ba9187700 1 -- start start 2023-05-10T01:22:08.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba9187700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ba4153cf0 0x7f2ba4063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba9187700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba40622a0 0x7f2ba40626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba9187700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40bf940 con 0x7f2ba41540d0 2023-05-10T01:22:08.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba9187700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba4067f50 con 0x7f2ba4153cf0 2023-05-10T01:22:08.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba9187700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40a7c80 con 0x7f2ba40622a0 2023-05-10T01:22:08.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ba4153cf0 0x7f2ba4063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ba4153cf0 0x7f2ba4063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33840/0 (socket says 172.21.15.52:33840) 2023-05-10T01:22:08.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba2d9d700 1 -- 172.21.15.52:0/657880244 learned_addr learned my addr 172.21.15.52:0/657880244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:08.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.841+0000 7f2ba359e700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba40622a0 0x7f2ba40626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba2d9d700 1 -- 172.21.15.52:0/657880244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba40622a0 msgr2=0x7f2ba40626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba2d9d700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba40622a0 0x7f2ba40626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba2d9d700 1 -- 172.21.15.52:0/657880244 >> v1:172.21.15.172:6789/0 conn(0x7f2ba41540d0 legacy=0x7f2ba40bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba2d9d700 1 -- 172.21.15.52:0/657880244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4062bd0 con 0x7f2ba4153cf0 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba2d9d700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba4153cf0 0x7f2ba4063fa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2b8c006fd0 tx=0x7f2b8c0090f0).ready entity=mon.0 client_cookie=c5a9171229b23c71 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba1d9b700 1 -- 172.21.15.52:0/657880244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00b580 con 0x7f2ba4153cf0 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba1d9b700 1 -- 172.21.15.52:0/657880244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c00b6e0 con 0x7f2ba4153cf0 2023-05-10T01:22:08.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba1d9b700 1 -- 172.21.15.52:0/657880244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00ba60 con 0x7f2ba4153cf0 2023-05-10T01:22:08.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 -- 172.21.15.52:0/657880244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba4153cf0 msgr2=0x7f2ba4063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba4153cf0 0x7f2ba4063fa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2b8c006fd0 tx=0x7f2b8c0090f0).stop 2023-05-10T01:22:08.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 -- 172.21.15.52:0/657880244 shutdown_connections 2023-05-10T01:22:08.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba40622a0 0x7f2ba40626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 --2- 172.21.15.52:0/657880244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba4153cf0 0x7f2ba4063fa0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 -- 172.21.15.52:0/657880244 >> 172.21.15.52:0/657880244 conn(0x7f2ba405e810 msgr2=0x7f2ba40c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 -- 172.21.15.52:0/657880244 shutdown_connections 2023-05-10T01:22:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.842+0000 7f2ba9187700 1 -- 172.21.15.52:0/657880244 wait complete. 2023-05-10T01:22:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.844+0000 7f2ba9187700 1 Processor -- start 2023-05-10T01:22:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.844+0000 7f2ba9187700 1 -- start start 2023-05-10T01:22:08.853 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:08.844+0000 7ff628205680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.844+0000 7f2ba9187700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba40622a0 0x7f2ba41641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba4153cf0 0x7f2ba40acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40ad570 con 0x7f2ba41540d0 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40ad850 con 0x7f2ba40622a0 2023-05-10T01:22:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40adb30 con 0x7f2ba4153cf0 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33848/0 (socket says 172.21.15.52:33848) 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 -- 172.21.15.52:0/2615527137 learned_addr learned my addr 172.21.15.52:0/2615527137 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba259c700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba4153cf0 0x7f2ba40acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba2d9d700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba40622a0 0x7f2ba41641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 -- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba4153cf0 msgr2=0x7f2ba40acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba4153cf0 0x7f2ba40acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 -- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba40622a0 msgr2=0x7f2ba41641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba40622a0 0x7f2ba41641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 -- 172.21.15.52:0/2615527137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c009370 con 0x7f2ba41540d0 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba359e700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2b9c009e90 tx=0x7f2b9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00caa0 con 0x7f2ba41540d0 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00f040 con 0x7f2ba41540d0 2023-05-10T01:22:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40ade10 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00ce10 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.845+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40a8d60 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.846+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba40ae330 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.847+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f2b9c013610 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.847+0000 7f2b9affd700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 0x7f2b880612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.847+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f2b9c07b060 con 0x7f2ba41540d0 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.847+0000 7f2ba2d9d700 1 -- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 msgr2=0x7f2b880612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:08.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.847+0000 7f2ba2d9d700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 0x7f2b880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:22:08.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:08.851+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b9c04c590 con 0x7f2ba41540d0 2023-05-10T01:22:08.895 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:08.892+0000 7f78bfc5e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:22:08.913 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:08.911+0000 7ff628205680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:22:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.026+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2ba406c340 con 0x7f2ba41540d0 2023-05-10T01:22:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.029+0000 7f2b9affd700 1 -- 172.21.15.52:0/2615527137 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b9c04fbb0 con 0x7f2ba41540d0 2023-05-10T01:22:09.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 msgr2=0x7f2b880612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:22:09.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 0x7f2b880612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:09.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 msgr2=0x7f2ba4167fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2b9c009e90 tx=0x7f2b9c00b040).stop 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 shutdown_connections 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b8805ede0 0x7f2b880612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba41540d0 0x7f2ba4167fb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba40622a0 0x7f2ba41641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 --2- 172.21.15.52:0/2615527137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba4153cf0 0x7f2ba40acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 >> 172.21.15.52:0/2615527137 conn(0x7f2ba405e810 msgr2=0x7f2ba40c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:09.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 shutdown_connections 2023-05-10T01:22:09.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.031+0000 7f2ba9187700 1 -- 172.21.15.52:0/2615527137 wait complete. 2023-05-10T01:22:09.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:09.046 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:22:09.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-10T01:22:09.163 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:09.160+0000 7f78bfc5e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:22:09.204 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:09.201+0000 7ff628205680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:22:09.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.226+0000 7f9bf7534700 1 Processor -- start 2023-05-10T01:22:09.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.226+0000 7f9bf7534700 1 -- start start 2023-05-10T01:22:09.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf7534700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 0x7f9bf0150370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf7534700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9bf00bc280 0x7f9bf0069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf7534700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf00bc760 con 0x7f9bf00bd800 2023-05-10T01:22:09.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf7534700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf00bca40 con 0x7f9bf00bc280 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf7534700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00bcd20 con 0x7f9bf014ff90 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf5ad1700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9bf00bd800 0x7f9bf0153ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42916/0 (socket says 172.21.15.52:42916) 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf5ad1700 1 -- 172.21.15.52:0/1623505262 learned_addr learned my addr 172.21.15.52:0/1623505262 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/1623505262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 0x7f9bf0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9bf4acf700 1 --2- 172.21.15.52:0/1623505262 >> v2:172.21.15.172:3300/0 conn(0x7f9bf00bc280 0x7f9bf0069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.227+0000 7f9be3fff700 1 -- 172.21.15.52:0/1623505262 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118956716 0 0) 0x7f9bf00bc760 con 0x7f9bf00bd800 2023-05-10T01:22:09.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9be3fff700 1 -- 172.21.15.52:0/1623505262 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd80033f0 con 0x7f9bf00bd800 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9bf52d0700 1 -- 172.21.15.52:0/1623505262 >> v2:172.21.15.172:3300/0 conn(0x7f9bf00bc280 msgr2=0x7f9bf0069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/1623505262 >> v2:172.21.15.172:3300/0 conn(0x7f9bf00bc280 0x7f9bf0069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9bf52d0700 1 -- 172.21.15.52:0/1623505262 >> v1:172.21.15.52:6789/0 conn(0x7f9bf00bd800 legacy=0x7f9bf0153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9bf52d0700 1 -- 172.21.15.52:0/1623505262 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf00bd000 con 0x7f9bf014ff90 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/1623505262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 0x7f9bf0150370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9be4009760 tx=0x7f9be4009060).ready entity=mon.2 client_cookie=2e1a70e95b6cd296 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9be3fff700 1 -- 172.21.15.52:0/1623505262 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400d4a0 con 0x7f9bf014ff90 2023-05-10T01:22:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9be3fff700 1 -- 172.21.15.52:0/1623505262 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400d600 con 0x7f9bf014ff90 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.228+0000 7f9be3fff700 1 -- 172.21.15.52:0/1623505262 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400d980 con 0x7f9bf014ff90 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 -- 172.21.15.52:0/1623505262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 msgr2=0x7f9bf0150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 --2- 172.21.15.52:0/1623505262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 0x7f9bf0150370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9be4009760 tx=0x7f9be4009060).stop 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 -- 172.21.15.52:0/1623505262 shutdown_connections 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 --2- 172.21.15.52:0/1623505262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf014ff90 0x7f9bf0150370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 --2- 172.21.15.52:0/1623505262 >> v2:172.21.15.172:3300/0 conn(0x7f9bf00bc280 0x7f9bf0069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 -- 172.21.15.52:0/1623505262 >> 172.21.15.52:0/1623505262 conn(0x7f9bf00c4610 msgr2=0x7f9bf0066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:09.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 -- 172.21.15.52:0/1623505262 shutdown_connections 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.229+0000 7f9bf7534700 1 -- 172.21.15.52:0/1623505262 wait complete. 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.230+0000 7f9bf7534700 1 Processor -- start 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.230+0000 7f9bf7534700 1 -- start start 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf00bc280 0x7f9bf00a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf014ff90 0x7f9bf00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00a7090 con 0x7f9bf00bd800 2023-05-10T01:22:09.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00a9370 con 0x7f9bf014ff90 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf7534700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00acbb0 con 0x7f9bf00bc280 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33904/0 (socket says 172.21.15.52:33904) 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 -- 172.21.15.52:0/2769404751 learned_addr learned my addr 172.21.15.52:0/2769404751 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf00bc280 0x7f9bf00a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf5ad1700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf014ff90 0x7f9bf00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:09.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf00bc280 msgr2=0x7f9bf00a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf00bc280 0x7f9bf00a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf014ff90 msgr2=0x7f9bf00c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf014ff90 0x7f9bf00c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be40092a0 con 0x7f9bf00bd800 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.231+0000 7f9bf4acf700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f9bec00e8d0 tx=0x7f9bec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:09.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.232+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec009470 con 0x7f9bf00bd800 2023-05-10T01:22:09.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.232+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf00ace90 con 0x7f9bf00bd800 2023-05-10T01:22:09.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.232+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec012600 con 0x7f9bf00bd800 2023-05-10T01:22:09.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.232+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec012980 con 0x7f9bf00bd800 2023-05-10T01:22:09.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.232+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf00ac750 con 0x7f9bf00bd800 2023-05-10T01:22:09.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf00ad0d0 con 0x7f9bf00bd800 2023-05-10T01:22:09.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f9bec022070 con 0x7f9bf00bd800 2023-05-10T01:22:09.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9be17fa700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:09.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6357+0+0 (secure 0 0 0) 0x7f9bec079f40 con 0x7f9bf00bd800 2023-05-10T01:22:09.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9bf52d0700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:09.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.233+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:22:09.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.237+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9bec0a88f0 con 0x7f9bf00bd800 2023-05-10T01:22:09.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.434+0000 7f9bf52d0700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:09.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.434+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:22:09.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.436+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bf00a6b80 con 0x7f9bd005ede0 2023-05-10T01:22:09.763 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:09.761+0000 7f78bfc5e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:22:09.835 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:09.832+0000 7f78bfc5e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:22:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.835+0000 7f9bf52d0700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:09.835+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:22:09.867 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:09.865+0000 7ff628205680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:22:09.935 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:09.932+0000 7ff628205680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:22:10.017 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.014+0000 7f78bfc5e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:22:10.127 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.125+0000 7ff628205680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:22:10.428 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.425+0000 7f78bfc5e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:22:10.529 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.526+0000 7f78bfc5e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:22:10.562 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.560+0000 7ff628205680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:22:10.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:10.636+0000 7f9bf52d0700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:10.636+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:22:10.670 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.667+0000 7ff628205680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:22:10.679 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.676+0000 7f78bfc5e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:22:10.751 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.748+0000 7f78bfc5e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:22:10.817 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:10.813+0000 7f78bfc5e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:22:10.827 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.825+0000 7ff628205680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:22:10.905 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.903+0000 7ff628205680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:22:10.975 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:10.972+0000 7ff628205680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:22:11.068 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:11.065+0000 7f78bfc5e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:22:11.245 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:11.243+0000 7ff628205680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:22:11.248 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:11.245+0000 7f78bfc5e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:22:11.433 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:11.431+0000 7ff628205680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:22:11.884 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:11.881+0000 7f78bfc5e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:22:11.951 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:11.947+0000 7f78bfc5e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:22:12.025 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.023+0000 7f78bfc5e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:22:12.111 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.109+0000 7ff628205680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:22:12.166 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.164+0000 7f78bfc5e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:22:12.182 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.180+0000 7ff628205680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:22:12.235 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.232+0000 7f78bfc5e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:22:12.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:12.238+0000 7f9bf52d0700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:22:12.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:12.238+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:22:12.259 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.257+0000 7ff628205680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:22:12.346 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.343+0000 7f78bfc5e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:22:12.412 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.410+0000 7ff628205680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:22:12.453 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.450+0000 7f78bfc5e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:22:12.484 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.482+0000 7ff628205680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:22:12.604 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.601+0000 7ff628205680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:22:12.715 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:12.713+0000 7ff628205680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:22:12.740 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.737+0000 7f78bfc5e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:22:12.809 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.806+0000 7f78bfc5e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:22:12.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:12.876+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 16) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f9bec077d50 con 0x7f9bf00bd800 2023-05-10T01:22:12.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:12.877+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:22:12.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:12.877+0000 7f9be17fa700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:22:12.940 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783b43a700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.941 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783b43a700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.941 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783b43a700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.941 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783b43a700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.941 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783b43a700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.942 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783e440700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.942 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783e440700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.942 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783e440700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.943 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783e440700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:12.943 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:22:12.936+0000 7f783e440700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:22:13.019 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:13.017+0000 7ff628205680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:22:13.092 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:22:13.089+0000 7ff628205680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:22:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.891+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f9bec0780d0 con 0x7f9bf00bd800 2023-05-10T01:22:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.891+0000 7f9be17fa700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.891+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bf00a6b80 con 0x7f9bd005ede0 2023-05-10T01:22:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.894+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.906+0000 7f9bf52d0700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd002fd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9be400d260 tx=0x7f9be4016000).ready entity=mgr.5294 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:13.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.911+0000 7f9be17fa700 1 -- 172.21.15.52:0/2769404751 <== mgr.5294 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9bf00a6b80 con 0x7f9bd005ede0 2023-05-10T01:22:13.915 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:22:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 msgr2=0x7f9bd002fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd002fd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9be400d260 tx=0x7f9be4016000).stop 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 msgr2=0x7f9bf00ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f9bec00e8d0 tx=0x7f9bec009060).stop 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 shutdown_connections 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9bd005ede0 0x7f9bd002fd40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf014ff90 0x7f9bf00c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf00bc280 0x7f9bf00a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 --2- 172.21.15.52:0/2769404751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bf00bd800 0x7f9bf00ac260 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 >> 172.21.15.52:0/2769404751 conn(0x7f9bf00c4610 msgr2=0x7f9bf0064ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 shutdown_connections 2023-05-10T01:22:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:13.914+0000 7f9bf7534700 1 -- 172.21.15.52:0/2769404751 wait complete. 2023-05-10T01:22:13.931 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:22:13.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-05-10T01:22:14.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.057+0000 7f96ce687700 1 Processor -- start 2023-05-10T01:22:14.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.057+0000 7f96ce687700 1 -- start start 2023-05-10T01:22:14.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ce687700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96c80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ce687700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96c8154460 0x7f96c80a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ce687700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80aa560 con 0x7f96c80aa140 2023-05-10T01:22:14.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ce687700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c80c94c0 con 0x7f96c8154460 2023-05-10T01:22:14.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ce687700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80cb7d0 con 0x7f96c8154080 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ccc24700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f96c80aa140 0x7f96c8068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43082/0 (socket says 172.21.15.52:43082) 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96ccc24700 1 -- 172.21.15.52:0/1214590311 learned_addr learned my addr 172.21.15.52:0/1214590311 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119527232 0 0) 0x7f96c0001490 con 0x7f96c80aa140 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96c7fff700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96c80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1214590311 >> v2:172.21.15.172:3300/0 conn(0x7f96c8154460 0x7f96c80a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.058+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b40033f0 con 0x7f96c80aa140 2023-05-10T01:22:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2271215879 0 0) 0x7f96b40033f0 con 0x7f96c80aa140 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 msgr2=0x7f96c80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96c80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 >> v2:172.21.15.172:3300/0 conn(0x7f96c8154460 msgr2=0x7f96c80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 --2- 172.21.15.52:0/1214590311 >> v2:172.21.15.172:3300/0 conn(0x7f96c8154460 0x7f96c80a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80c88b0 con 0x7f96c80aa140 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f96c0001980 con 0x7f96c80aa140 2023-05-10T01:22:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 >> v1:172.21.15.52:6789/0 conn(0x7f96c80aa140 legacy=0x7f96c8068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96b40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96b4004b80 0x7f96b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80c94c0 con 0x7f96b4003e10 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80cb7d0 con 0x7f96b4004b80 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b400b8e0 con 0x7f96c8154080 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c7fff700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96b40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96ccc24700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96b4004b80 0x7f96b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 -- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 msgr2=0x7f96b40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c8154080 0x7f96b40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 -- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96b4004b80 msgr2=0x7f96b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96b4004b80 0x7f96b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 -- 172.21.15.52:0/1214590311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40033f0 con 0x7f96b4003e10 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96ccc24700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96b4004b80 0x7f96b4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96b4004690 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f96c8067e20 tx=0x7f96bc009060).ready entity=mon.0 client_cookie=28d4f0094462aac8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc009e90 con 0x7f96b4003e10 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc009430 con 0x7f96b4003e10 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.059+0000 7f96c6ffd700 1 -- 172.21.15.52:0/1214590311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00e820 con 0x7f96b4003e10 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 -- 172.21.15.52:0/1214590311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 msgr2=0x7f96b4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 --2- 172.21.15.52:0/1214590311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96b4004690 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f96c8067e20 tx=0x7f96bc009060).stop 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ccc24700 1 -- 172.21.15.52:0/1214590311 reap_dead start 2023-05-10T01:22:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 -- 172.21.15.52:0/1214590311 shutdown_connections 2023-05-10T01:22:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 -- 172.21.15.52:0/1214590311 >> 172.21.15.52:0/1214590311 conn(0x7f96c8067910 msgr2=0x7f96c80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 -- 172.21.15.52:0/1214590311 shutdown_connections 2023-05-10T01:22:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.060+0000 7f96ce687700 1 -- 172.21.15.52:0/1214590311 wait complete. 2023-05-10T01:22:14.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.061+0000 7f96ce687700 1 Processor -- start 2023-05-10T01:22:14.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.061+0000 7f96ce687700 1 -- start start 2023-05-10T01:22:14.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c80adcd0 0x7f96c8154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c8154d30 0x7f96c814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8156310 con 0x7f96b4003e10 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8155220 con 0x7f96c8154d30 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ce687700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8155500 con 0x7f96c80adcd0 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34078/0 (socket says 172.21.15.52:34078) 2023-05-10T01:22:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 -- 172.21.15.52:0/3794410269 learned_addr learned my addr 172.21.15.52:0/3794410269 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c77fe700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c80adcd0 0x7f96c8154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96ccc24700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c8154d30 0x7f96c814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 -- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c80adcd0 msgr2=0x7f96c8154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c80adcd0 0x7f96c8154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 -- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c8154d30 msgr2=0x7f96c814c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.062+0000 7f96c7fff700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c8154d30 0x7f96c814c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96c7fff700 1 -- 172.21.15.52:0/3794410269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c81557e0 con 0x7f96b4003e10 2023-05-10T01:22:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96c7fff700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f96b80119f0 tx=0x7f96b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800f790 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b800f8f0 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800fc70 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c8155fa0 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.063+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c814c770 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.064+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c81565f0 con 0x7f96b4003e10 2023-05-10T01:22:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.064+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f96b8014650 con 0x7f96b4003e10 2023-05-10T01:22:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.065+0000 7f96affff700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 0x7f96a8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.065+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f96b807a2c0 con 0x7f96b4003e10 2023-05-10T01:22:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.065+0000 7f96c77fe700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 0x7f96a8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.065+0000 7f96c77fe700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 0x7f96a8061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f96c8067e20 tx=0x7f96bc01a000).ready entity=mgr.5294 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.069+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96b804b650 con 0x7f96b4003e10 2023-05-10T01:22:14.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.268+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f96c8156450 con 0x7f96a805ed40 2023-05-10T01:22:14.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.272+0000 7f96affff700 1 -- 172.21.15.52:0/3794410269 <== mgr.5294 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f96bc00e610 con 0x7f96a805ed40 2023-05-10T01:22:14.275 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 msgr2=0x7f96a8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 0x7f96a8061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f96c8067e20 tx=0x7f96bc01a000).stop 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 msgr2=0x7f96c813fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f96b80119f0 tx=0x7f96b8009060).stop 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 shutdown_connections 2023-05-10T01:22:14.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96a805ed40 0x7f96a8061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c8154d30 0x7f96c814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b4003e10 0x7f96c813fdb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 --2- 172.21.15.52:0/3794410269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c80adcd0 0x7f96c8154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 >> 172.21.15.52:0/3794410269 conn(0x7f96c8067910 msgr2=0x7f96c814dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 shutdown_connections 2023-05-10T01:22:14.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.274+0000 7f96ce687700 1 -- 172.21.15.52:0/3794410269 wait complete. 2023-05-10T01:22:14.289 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:22:14.289 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-10-01_23_00 in ~46s... 2023-05-10T01:22:14.290 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-10-01_24_00 in ~106s... 2023-05-10T01:22:14.290 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-05-10T01:22:14.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-10T01:22:14.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.407+0000 7f4f8c8e7700 1 Processor -- start 2023-05-10T01:22:14.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.407+0000 7f4f8c8e7700 1 -- start start 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8c8e7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f88153cf0 0x7f4f88063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8c8e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 0x7f4f880bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8c8e7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880a7c80 con 0x7f4f880622a0 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8c8e7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f88067f50 con 0x7f4f88153cf0 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8c8e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880a7ef0 con 0x7f4f881540d0 2023-05-10T01:22:14.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f8659c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f88153cf0 0x7f4f88063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f85d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 0x7f4f880bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f86d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4f880622a0 0x7f4f88157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:45644/0 (socket says 172.21.15.52:45644) 2023-05-10T01:22:14.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.408+0000 7f4f86d9d700 1 -- 172.21.15.52:0/2334618069 learned_addr learned my addr 172.21.15.52:0/2334618069 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:22:14.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8659c700 1 -- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 msgr2=0x7f4f880bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8659c700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 0x7f4f880bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8659c700 1 -- 172.21.15.52:0/2334618069 >> v1:172.21.15.172:6789/0 conn(0x7f4f880622a0 legacy=0x7f4f88157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8659c700 1 -- 172.21.15.52:0/2334618069 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880a81d0 con 0x7f4f88153cf0 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8559a700 1 -- 172.21.15.52:0/2334618069 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689233817 0 0) 0x7f4f880a7c80 con 0x7f4f880622a0 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f85d9b700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 0x7f4f880bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8659c700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f88153cf0 0x7f4f88063fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f4f80009e60 tx=0x7f4f80009780).ready entity=mon.1 client_cookie=7f33decc50035ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8559a700 1 -- 172.21.15.52:0/2334618069 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000e070 con 0x7f4f88153cf0 2023-05-10T01:22:14.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8559a700 1 -- 172.21.15.52:0/2334618069 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000bb60 con 0x7f4f88153cf0 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.409+0000 7f4f8559a700 1 -- 172.21.15.52:0/2334618069 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80012410 con 0x7f4f88153cf0 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f88153cf0 msgr2=0x7f4f88063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f88153cf0 0x7f4f88063fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f4f80009e60 tx=0x7f4f80009780).stop 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/2334618069 shutdown_connections 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f88153cf0 0x7f4f88063fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/2334618069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f881540d0 0x7f4f880bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/2334618069 >> 172.21.15.52:0/2334618069 conn(0x7f4f8805e810 msgr2=0x7f4f880c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:14.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/2334618069 shutdown_connections 2023-05-10T01:22:14.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.410+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/2334618069 wait complete. 2023-05-10T01:22:14.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.411+0000 7f4f8c8e7700 1 Processor -- start 2023-05-10T01:22:14.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.411+0000 7f4f8c8e7700 1 -- start start 2023-05-10T01:22:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f88153cf0 0x7f4f880a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 0x7f4f8814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88152060 con 0x7f4f880622a0 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880aadc0 con 0x7f4f881540d0 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880a9850 con 0x7f4f88153cf0 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34092/0 (socket says 172.21.15.52:34092) 2023-05-10T01:22:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 -- 172.21.15.52:0/3592821948 learned_addr learned my addr 172.21.15.52:0/3592821948 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:22:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f86d9d700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 0x7f4f8814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f85d9b700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f88153cf0 0x7f4f880a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 -- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f88153cf0 msgr2=0x7f4f880a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f88153cf0 0x7f4f880a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 -- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 msgr2=0x7f4f8814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 0x7f4f8814e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 -- 172.21.15.52:0/3592821948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f700092a0 con 0x7f4f880622a0 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f86d9d700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 0x7f4f8814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8659c700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4f8000b6c0 tx=0x7f4f80009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80009440 con 0x7f4f880622a0 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000bea0 con 0x7f4f880622a0 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f80009a20 con 0x7f4f880622a0 2023-05-10T01:22:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8001d880 con 0x7f4f880622a0 2023-05-10T01:22:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.412+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f88151770 con 0x7f4f880622a0 2023-05-10T01:22:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.413+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8806c340 con 0x7f4f880622a0 2023-05-10T01:22:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.414+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f4f8001dc70 con 0x7f4f880622a0 2023-05-10T01:22:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.414+0000 7f4f7e7fc700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 0x7f4f6c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:22:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.414+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f4f8007bda0 con 0x7f4f880622a0 2023-05-10T01:22:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.414+0000 7f4f85d9b700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 0x7f4f6c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:22:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.415+0000 7f4f85d9b700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 0x7f4f6c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f70009270 tx=0x7f4f70008040).ready entity=mgr.5294 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:22:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.418+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f8004d2c0 con 0x7f4f880622a0 2023-05-10T01:22:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.614+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f88064800 con 0x7f4f6c05ed40 2023-05-10T01:22:14.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.617+0000 7f4f7e7fc700 1 -- 172.21.15.52:0/3592821948 <== mgr.5294 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f4f88064800 con 0x7f4f6c05ed40 2023-05-10T01:22:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:22:14.620 INFO:teuthology.orchestra.run.smithi052.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-05-10T01:22:14.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 msgr2=0x7f4f6c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 0x7f4f6c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f70009270 tx=0x7f4f70008040).stop 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 msgr2=0x7f4f880aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4f8000b6c0 tx=0x7f4f80009780).stop 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 shutdown_connections 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4f6c05ed40 0x7f4f6c061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f881540d0 0x7f4f8814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f880622a0 0x7f4f880aa8d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 --2- 172.21.15.52:0/3592821948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4f88153cf0 0x7f4f880a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:22:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 >> 172.21.15.52:0/3592821948 conn(0x7f4f8805e810 msgr2=0x7f4f880ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:22:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 shutdown_connections 2023-05-10T01:22:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:22:14.619+0000 7f4f8c8e7700 1 -- 172.21.15.52:0/3592821948 wait complete. 2023-05-10T01:22:14.633 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-05-10T01:22:14.633 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-05-10T01:22:14.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:14.634 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:15.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:15.651 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:16.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:16.673 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:17.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:17.694 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:18.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:18.715 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:19.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:19.738 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:20.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:20.758 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:21.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:21.779 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:22.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:22.802 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:23.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:23.822 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:24.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:24.845 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:25.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:25.866 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:26.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:26.889 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:27.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:27.910 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:28.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:22:28.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:22:28.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:28.932 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:29.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:29.953 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:30.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:30.974 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:31.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:31.996 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:33.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:33.018 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:34.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:34.039 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:35.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:35.060 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:36.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:36.081 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:37.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:37.102 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:38.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:38.124 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:39.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:39.145 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:40.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:40.165 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:41.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:41.186 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:42.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:42.208 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:43.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:43.229 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:44.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:44.251 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:45.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:45.272 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:46.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:46.293 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:47.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:47.314 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:48.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:48.335 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:49.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:49.358 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:50.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:50.378 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:51.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:51.399 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:52.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:52.420 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:53.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:53.442 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:54.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:54.463 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:55.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:55.484 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:56.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:56.506 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:57.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:57.528 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:58.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:58.549 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:22:58.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:22:58.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:22:59.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:22:59.569 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:00.279 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:23:00.276+0000 7f782dc1f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:23:00.279 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:23:00.276+0000 7f782dc1f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:23:00.280 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:23:00.276+0000 7f782dc1f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:23:00.280 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:23:00.276+0000 7f782dc1f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:23:00.280 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:23:00.276+0000 7f782dc1f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:23:00.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:00.591 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:00.611 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:00.611 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-10-01_23_00_UTC'] 2023-05-10T01:23:00.611 DEBUG:tasks.cephfs.test_snap_schedules:exec=1683681734.289907, now = 1683681780.6119301, timo = 46 2023-05-10T01:23:01.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:01.613 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:01.631 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:02.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:02.633 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:02.653 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:03.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:03.654 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:03.672 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:04.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:04.674 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:04.694 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:05.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:05.697 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:05.716 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:06.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:06.718 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:06.738 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:07.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:07.739 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:07.758 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:08.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:08.760 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:08.779 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:09.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:09.781 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:09.801 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:10.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:10.802 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:10.822 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:11.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:11.823 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:11.843 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:12.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:12.845 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:12.863 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:13.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:13.866 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:13.884 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:14.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:14.887 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:14.906 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:15.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:15.908 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:15.928 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:16.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:16.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:16.950 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:17.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:17.951 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:17.971 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:18.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:18.973 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:18.991 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:19.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:19.994 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:20.014 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:21.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:21.017 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:21.035 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:22.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:22.037 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:22.056 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:23.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:23.057 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:23.077 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:24.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:24.079 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:24.098 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:25.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:25.101 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:26.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:26.122 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:26.142 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:27.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:27.143 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:27.162 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:28.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:28.164 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:28.183 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:28.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:23:28.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:23:29.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:29.185 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:29.204 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:30.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:30.206 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:30.225 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:31.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:31.227 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:31.247 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:32.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:32.249 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:32.268 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:33.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:33.272 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:33.292 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:34.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:34.294 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:34.313 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:35.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:35.314 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:35.333 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:36.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:36.336 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:36.355 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:37.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:37.357 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:37.376 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:38.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:38.378 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:38.397 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:39.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:39.399 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:39.419 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:40.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:40.421 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:40.440 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:41.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:41.441 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:41.461 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:42.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:42.463 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:42.482 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:43.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:43.484 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:44.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:44.507 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:44.527 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:45.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:45.529 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:45.549 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:46.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:46.551 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:46.570 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:47.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:47.571 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:47.591 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:48.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:48.592 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:48.613 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:49.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:49.615 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:49.634 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:50.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:50.636 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:50.655 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:51.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:51.658 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:51.677 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:52.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:52.679 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:52.698 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:53.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:53.700 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:53.719 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:54.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:54.721 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:54.741 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:55.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:55.743 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:55.763 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:56.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:56.765 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:56.785 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:57.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:57.786 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:57.806 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:58.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:23:58.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:23:58.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:58.808 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:58.847 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:23:59.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:23:59.848 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:23:59.867 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:24:00.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:00.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:24:00.889 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:24:00.889 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_24_00_UTC 2023-05-10T01:24:00.889 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-10-01_24_00_UTC'] 2023-05-10T01:24:00.890 DEBUG:tasks.cephfs.test_snap_schedules:exec=1683681734.289907, now = 1683681840.8900182, timo = 106 2023-05-10T01:24:01.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-10T01:24:02.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.021+0000 7f6ac7fff700 1 Processor -- start 2023-05-10T01:24:02.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.021+0000 7f6ac7fff700 1 -- start start 2023-05-10T01:24:02.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac80bdf10 0x7f6ac80698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac7fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac805e750 con 0x7f6ac8153f80 2023-05-10T01:24:02.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac7fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac8069ee0 con 0x7f6ac8153ba0 2023-05-10T01:24:02.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac7fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80bf530 con 0x7f6ac80bdf10 2023-05-10T01:24:02.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac67fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ac80bdf10 0x7f6ac80698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac77fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ac8153f80 0x7f6ac80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43118/0 (socket says 172.21.15.52:43118) 2023-05-10T01:24:02.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac77fe700 1 -- 172.21.15.52:0/3516768358 learned_addr learned my addr 172.21.15.52:0/3516768358 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:02.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac67fc700 1 -- 172.21.15.52:0/3516768358 >> v1:172.21.15.172:6789/0 conn(0x7f6ac8153ba0 legacy=0x7f6ac80bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac67fc700 1 -- 172.21.15.52:0/3516768358 >> v1:172.21.15.52:6789/0 conn(0x7f6ac8153f80 legacy=0x7f6ac80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac67fc700 1 -- 172.21.15.52:0/3516768358 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8158450 con 0x7f6ac80bdf10 2023-05-10T01:24:02.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac5ffb700 1 -- 172.21.15.52:0/3516768358 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682447540 0 0) 0x7f6ac805e750 con 0x7f6ac8153f80 2023-05-10T01:24:02.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac67fc700 1 --2- 172.21.15.52:0/3516768358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80698b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f6ab0009760 tx=0x7f6ab0009060).ready entity=mon.0 client_cookie=7745b830a76a13c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.022+0000 7f6ac5ffb700 1 -- 172.21.15.52:0/3516768358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000b580 con 0x7f6ac80bdf10 2023-05-10T01:24:02.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac5ffb700 1 -- 172.21.15.52:0/3516768358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000b6e0 con 0x7f6ac80bdf10 2023-05-10T01:24:02.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac5ffb700 1 -- 172.21.15.52:0/3516768358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000ba60 con 0x7f6ac80bdf10 2023-05-10T01:24:02.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 -- 172.21.15.52:0/3516768358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 msgr2=0x7f6ac80698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/3516768358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80698b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f6ab0009760 tx=0x7f6ab0009060).stop 2023-05-10T01:24:02.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 -- 172.21.15.52:0/3516768358 shutdown_connections 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/3516768358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80698b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 -- 172.21.15.52:0/3516768358 >> 172.21.15.52:0/3516768358 conn(0x7f6ac8062d70 msgr2=0x7f6ac805dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 -- 172.21.15.52:0/3516768358 shutdown_connections 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.023+0000 7f6ac7fff700 1 -- 172.21.15.52:0/3516768358 wait complete. 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.024+0000 7f6ac7fff700 1 Processor -- start 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.024+0000 7f6ac7fff700 1 -- start start 2023-05-10T01:24:02.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac8153ba0 0x7f6ac80ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ac8153f80 0x7f6ac8146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8164100 con 0x7f6ac80bdf10 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80bfda0 con 0x7f6ac8153ba0 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80acd00 con 0x7f6ac8153f80 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34106/0 (socket says 172.21.15.52:34106) 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.025+0000 7f6ac6ffd700 1 -- 172.21.15.52:0/2597309908 learned_addr learned my addr 172.21.15.52:0/2597309908 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 -- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ac8153f80 msgr2=0x7f6ac8146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ac8153f80 0x7f6ac8146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac67fc700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac8153ba0 0x7f6ac80ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 -- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac8153ba0 msgr2=0x7f6ac80ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac8153ba0 0x7f6ac80ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 -- 172.21.15.52:0/2597309908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00092a0 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac6ffd700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6ac000c840 tx=0x7f6ac0001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0006a20 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0006b80 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0007020 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80bfa70 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.026+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac80aca20 con 0x7f6ac80bdf10 2023-05-10T01:24:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.027+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac8047150 con 0x7f6ac80bdf10 2023-05-10T01:24:02.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.027+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6ac0018020 con 0x7f6ac80bdf10 2023-05-10T01:24:02.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.028+0000 7f6abeffd700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 0x7f6aac061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.028+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f6ac00795f0 con 0x7f6ac80bdf10 2023-05-10T01:24:02.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.028+0000 7f6ac67fc700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 0x7f6aac061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.028+0000 7f6ac67fc700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 0x7f6aac061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6ac80be310 tx=0x7f6ab0017000).ready entity=mgr.5294 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.032+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ac00488f0 con 0x7f6ac80bdf10 2023-05-10T01:24:02.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.228+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ac8158730 con 0x7f6aac05ee70 2023-05-10T01:24:02.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.233+0000 7f6abeffd700 1 -- 172.21.15.52:0/2597309908 <== mgr.5294 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6ac8158730 con 0x7f6aac05ee70 2023-05-10T01:24:02.236 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path snap_test_dir1 2023-05-10T01:24:02.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 msgr2=0x7f6aac061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 0x7f6aac061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6ac80be310 tx=0x7f6ab0017000).stop 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 msgr2=0x7f6ac80c2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f6ac000c840 tx=0x7f6ac0001660).stop 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 shutdown_connections 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6aac05ee70 0x7f6aac061330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ac8153f80 0x7f6ac8146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:02.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ac80bdf10 0x7f6ac80c2190 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 --2- 172.21.15.52:0/2597309908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ac8153ba0 0x7f6ac80ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 >> 172.21.15.52:0/2597309908 conn(0x7f6ac8062d70 msgr2=0x7f6ac8153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:02.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 shutdown_connections 2023-05-10T01:24:02.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.234+0000 7f6ac7fff700 1 -- 172.21.15.52:0/2597309908 wait complete. 2023-05-10T01:24:02.249 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-10T01:24:02.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:02.250 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:24:02.266 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:24:02.266 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_24_00_UTC 2023-05-10T01:24:02.266 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-10-01_23_00_UTC 2023-05-10T01:24:02.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:02.267 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-10-01_23_00_UTC) 2023-05-10T01:24:02.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-10-01_24_00_UTC 2023-05-10T01:24:02.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:02.327 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-10-01_24_00_UTC) 2023-05-10T01:24:02.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:02.387 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:24:02.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:24:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.600+0000 7f642b4b2700 1 Processor -- start 2023-05-10T01:24:02.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.600+0000 7f642b4b2700 1 -- start start 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642b4b2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6424154080 0x7f64240aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642b4b2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6424154460 0x7f64240a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642b4b2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240aa560 con 0x7f64240aa140 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642b4b2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64240c94c0 con 0x7f6424154460 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642b4b2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240cb7d0 con 0x7f6424154080 2023-05-10T01:24:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f6428a4d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6424154460 0x7f64240a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f642924e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6424154080 0x7f64240aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f6428a4d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6424154460 0x7f64240a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:60674/0 (socket says 172.21.15.52:60674) 2023-05-10T01:24:02.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.601+0000 7f6428a4d700 1 -- 172.21.15.52:0/458891948 learned_addr learned my addr 172.21.15.52:0/458891948 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6428a4d700 1 -- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6424154080 msgr2=0x7f64240aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6428a4d700 1 --2- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6424154080 0x7f64240aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6428a4d700 1 -- 172.21.15.52:0/458891948 >> v1:172.21.15.172:6789/0 conn(0x7f64240aa140 legacy=0x7f6424068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6423fff700 1 -- 172.21.15.52:0/458891948 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725444894 0 0) 0x7f6414001490 con 0x7f64240aa140 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6428a4d700 1 -- 172.21.15.52:0/458891948 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240c88b0 con 0x7f6424154460 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6428a4d700 1 --2- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154460 0x7f64240a9c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6418006fd0 tx=0x7f64180090f0).ready entity=mon.1 client_cookie=1639048819cd3fc2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6423fff700 1 -- 172.21.15.52:0/458891948 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800b580 con 0x7f6424154460 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6423fff700 1 -- 172.21.15.52:0/458891948 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800b6e0 con 0x7f6424154460 2023-05-10T01:24:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.602+0000 7f6423fff700 1 -- 172.21.15.52:0/458891948 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800ba60 con 0x7f6424154460 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 -- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154460 msgr2=0x7f64240a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 --2- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154460 0x7f64240a9c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6418006fd0 tx=0x7f64180090f0).stop 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 -- 172.21.15.52:0/458891948 shutdown_connections 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 --2- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6424154080 0x7f64240aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 --2- 172.21.15.52:0/458891948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154460 0x7f64240a9c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 -- 172.21.15.52:0/458891948 >> 172.21.15.52:0/458891948 conn(0x7f6424067910 msgr2=0x7f64240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 -- 172.21.15.52:0/458891948 shutdown_connections 2023-05-10T01:24:02.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.603+0000 7f642b4b2700 1 -- 172.21.15.52:0/458891948 wait complete. 2023-05-10T01:24:02.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.604+0000 7f642b4b2700 1 Processor -- start 2023-05-10T01:24:02.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.604+0000 7f642b4b2700 1 -- start start 2023-05-10T01:24:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 0x7f64241561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 0x7f6424151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424156b30 con 0x7f6424154460 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424156e10 con 0x7f6424154080 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642b4b2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64241570f0 con 0x7f64240aa140 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34124/0 (socket says 172.21.15.52:34124) 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 -- 172.21.15.52:0/903657976 learned_addr learned my addr 172.21.15.52:0/903657976 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642924e700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 0x7f64241561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6428a4d700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 0x7f6424151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 -- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 msgr2=0x7f64241561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 0x7f64241561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 -- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 msgr2=0x7f6424151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 0x7f6424151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 -- 172.21.15.52:0/903657976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009370 con 0x7f6424154460 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6428a4d700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 0x7f6424151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f642924e700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 0x7f64241561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.605+0000 7f6429a4f700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f641400c810 tx=0x7f64140014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.606+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414010510 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.606+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414010690 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.606+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414010a50 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.606+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64240ae930 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.606+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642414d720 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.607+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6424066720 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.607+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f6414010070 con 0x7f6424154460 2023-05-10T01:24:02.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.607+0000 7f64217fa700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 0x7f6404061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:02.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.607+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f6414079930 con 0x7f6424154460 2023-05-10T01:24:02.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.608+0000 7f642924e700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 0x7f6404061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:02.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.608+0000 7f642924e700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 0x7f6404061300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f641c009c00 tx=0x7f641c008040).ready entity=mgr.5294 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:02.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.611+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f641404aca0 con 0x7f6424154460 2023-05-10T01:24:02.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:02.834+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f64240aa540 con 0x7f6424154460 2023-05-10T01:24:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.730+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f64140030a0 con 0x7f6424154460 2023-05-10T01:24:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.731+0000 7f64217fa700 1 -- 172.21.15.52:0/903657976 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f64140722e0 con 0x7f6424154460 2023-05-10T01:24:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 msgr2=0x7f6404061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 0x7f6404061300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f641c009c00 tx=0x7f641c008040).stop 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 msgr2=0x7f64241523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f641400c810 tx=0x7f64140014a0).stop 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 shutdown_connections 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f640405ee40 0x7f6404061300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6424154460 0x7f64241523d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64240aa140 0x7f64241561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 --2- 172.21.15.52:0/903657976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6424154080 0x7f6424151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 >> 172.21.15.52:0/903657976 conn(0x7f6424067910 msgr2=0x7f64240c0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 shutdown_connections 2023-05-10T01:24:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:03.734+0000 7f642b4b2700 1 -- 172.21.15.52:0/903657976 wait complete. 2023-05-10T01:24:03.753 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:24:03.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:03.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:03.813 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:24:03.814 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:24:03.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:03.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:24:03.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:24:03.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:03.869 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:24:03.880 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:03.876+0000 7f0144b8e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:03.885 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:03.882+0000 7f7ae85c5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:03.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:03.942 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:03.938+0000 7f0144b8e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:03.952 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:03.948+0000 7f7ae85c5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.057+0000 7f38a7907700 1 Processor -- start 2023-05-10T01:24:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.057+0000 7f38a7907700 1 -- start start 2023-05-10T01:24:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a7907700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a0154540 0x7f38a0069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a7907700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38a0069b80 0x7f38a00c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a7907700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00c0650 con 0x7f38a0154160 2023-05-10T01:24:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a7907700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a0069fb0 con 0x7f38a0154540 2023-05-10T01:24:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a7907700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00bfd20 con 0x7f38a0069b80 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a0154540 0x7f38a0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38a0154540 0x7f38a0069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34188/0 (socket says 172.21.15.52:34188) 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 -- 172.21.15.52:0/1615385301 learned_addr learned my addr 172.21.15.52:0/1615385301 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a5ea4700 1 --2- 172.21.15.52:0/1615385301 >> v2:172.21.15.172:3300/0 conn(0x7f38a0069b80 0x7f38a00c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 -- 172.21.15.52:0/1615385301 >> v2:172.21.15.172:3300/0 conn(0x7f38a0069b80 msgr2=0x7f38a00c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 --2- 172.21.15.52:0/1615385301 >> v2:172.21.15.172:3300/0 conn(0x7f38a0069b80 0x7f38a00c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.058+0000 7f38a4ea2700 1 -- 172.21.15.52:0/1615385301 >> v1:172.21.15.172:6789/0 conn(0x7f38a0154160 legacy=0x7f38a00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a4ea2700 1 -- 172.21.15.52:0/1615385301 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00c0000 con 0x7f38a0154540 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a4ea2700 1 --2- 172.21.15.52:0/1615385301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a0069690 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f38a00c5200 tx=0x7f389c0090f0).ready entity=mon.0 client_cookie=954c24449e93edfc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f388ffff700 1 -- 172.21.15.52:0/1615385301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00b520 con 0x7f38a0154540 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f388ffff700 1 -- 172.21.15.52:0/1615385301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00b680 con 0x7f38a0154540 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f388ffff700 1 -- 172.21.15.52:0/1615385301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00ba20 con 0x7f38a0154540 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 -- 172.21.15.52:0/1615385301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 msgr2=0x7f38a0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 --2- 172.21.15.52:0/1615385301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a0069690 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f38a00c5200 tx=0x7f389c0090f0).stop 2023-05-10T01:24:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 -- 172.21.15.52:0/1615385301 shutdown_connections 2023-05-10T01:24:04.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 --2- 172.21.15.52:0/1615385301 >> v2:172.21.15.172:3300/0 conn(0x7f38a0069b80 0x7f38a00c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 --2- 172.21.15.52:0/1615385301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a0069690 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 -- 172.21.15.52:0/1615385301 >> 172.21.15.52:0/1615385301 conn(0x7f38a00cb6f0 msgr2=0x7f38a00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:04.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.059+0000 7f38a7907700 1 -- 172.21.15.52:0/1615385301 shutdown_connections 2023-05-10T01:24:04.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.060+0000 7f38a7907700 1 -- 172.21.15.52:0/1615385301 wait complete. 2023-05-10T01:24:04.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.061+0000 7f38a7907700 1 Processor -- start 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.061+0000 7f38a7907700 1 -- start start 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a0069b80 0x7f38a01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38a0154160 0x7f38a00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00ca620 con 0x7f38a0154540 2023-05-10T01:24:04.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00c3a20 con 0x7f38a0069b80 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00c3eb0 con 0x7f38a0154160 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34198/0 (socket says 172.21.15.52:34198) 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 -- 172.21.15.52:0/1527406589 learned_addr learned my addr 172.21.15.52:0/1527406589 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a56a3700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a0069b80 0x7f38a01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a4ea2700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38a0154160 0x7f38a00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38a0154160 msgr2=0x7f38a00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38a0154160 0x7f38a00c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a0069b80 msgr2=0x7f38a01581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a0069b80 0x7f38a01581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 -- 172.21.15.52:0/1527406589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c009370 con 0x7f38a0154540 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a5ea4700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3898009e90 tx=0x7f389800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800caa0 con 0x7f38a0154540 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389800f040 con 0x7f38a0154540 2023-05-10T01:24:04.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a00c2e10 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800ce10 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.062+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a00c33d0 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.063+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a00666b0 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.064+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3898013610 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.064+0000 7f388d7fa700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 0x7f38800612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.064+0000 7f38a56a3700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 msgr2=0x7f38800612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.064+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f389807a710 con 0x7f38a0154540 2023-05-10T01:24:04.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.064+0000 7f38a56a3700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 0x7f38800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.068+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f389804ba80 con 0x7f38a0154540 2023-05-10T01:24:04.214 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:04.210+0000 7f0144b8e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:04.243 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:04.239+0000 7f7ae85c5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:04.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.265+0000 7f38a56a3700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 msgr2=0x7f38800612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:04.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.265+0000 7f38a56a3700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 0x7f38800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:04.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.286+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38a00c3bb0 con 0x7f38a0154540 2023-05-10T01:24:04.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.287+0000 7f388d7fa700 1 -- 172.21.15.52:0/1527406589 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f389804f0a0 con 0x7f38a0154540 2023-05-10T01:24:04.291 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:04.291 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 msgr2=0x7f38800612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 0x7f38800612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 msgr2=0x7f38a00ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3898009e90 tx=0x7f389800b040).stop 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 shutdown_connections 2023-05-10T01:24:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f388005ee20 0x7f38800612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38a0154540 0x7f38a00ca130 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a0069b80 0x7f38a01581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 --2- 172.21.15.52:0/1527406589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38a0154160 0x7f38a00c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 >> 172.21.15.52:0/1527406589 conn(0x7f38a00cb6f0 msgr2=0x7f38a00aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 shutdown_connections 2023-05-10T01:24:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.289+0000 7f38a7907700 1 -- 172.21.15.52:0/1527406589 wait complete. 2023-05-10T01:24:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:24:04.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:04.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.461+0000 7f679a016700 1 Processor -- start 2023-05-10T01:24:04.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.462+0000 7f679a016700 1 -- start start 2023-05-10T01:24:04.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.462+0000 7f679a016700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6794158150 0x7f679415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.462+0000 7f679a016700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940683c0 con 0x7f679414e1f0 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.462+0000 7f679a016700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940be050 con 0x7f679414e5d0 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.462+0000 7f679a016700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6794137460 con 0x7f6794158150 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67937fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f679414e1f0 0x7f6794066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43264/0 (socket says 172.21.15.52:43264) 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67937fe700 1 -- 172.21.15.52:0/2318509656 learned_addr learned my addr 172.21.15.52:0/2318509656 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f6793fff700 1 --2- 172.21.15.52:0/2318509656 >> v2:172.21.15.172:3300/0 conn(0x7f6794158150 0x7f679415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087929214 0 0) 0x7f67940683c0 con 0x7f679414e1f0 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67800033f0 con 0x7f679414e1f0 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70508876 0 0) 0x7f67940be050 con 0x7f679414e5d0 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67940683c0 con 0x7f679414e5d0 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f6793fff700 1 -- 172.21.15.52:0/2318509656 >> v1:172.21.15.172:6789/0 conn(0x7f679414e5d0 legacy=0x7f6794157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f6793fff700 1 -- 172.21.15.52:0/2318509656 >> v1:172.21.15.52:6789/0 conn(0x7f679414e1f0 legacy=0x7f6794066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1968804122 0 0) 0x7f67800033f0 con 0x7f679414e1f0 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f6793fff700 1 -- 172.21.15.52:0/2318509656 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794067550 con 0x7f6794158150 2023-05-10T01:24:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f6793fff700 1 --2- 172.21.15.52:0/2318509656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6794158150 0x7f679415edf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f678c009e60 tx=0x7f678c009780).ready entity=mon.1 client_cookie=a5e3cb3804d91d8a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00e070 con 0x7f6794158150 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c00b7a0 con 0x7f6794158150 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.463+0000 7f67927fc700 1 -- 172.21.15.52:0/2318509656 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784001470 con 0x7f6794158150 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 -- 172.21.15.52:0/2318509656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6794158150 msgr2=0x7f679415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 --2- 172.21.15.52:0/2318509656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6794158150 0x7f679415edf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f678c009e60 tx=0x7f678c009780).stop 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 -- 172.21.15.52:0/2318509656 shutdown_connections 2023-05-10T01:24:04.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 --2- 172.21.15.52:0/2318509656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6794158150 0x7f679415edf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 -- 172.21.15.52:0/2318509656 >> 172.21.15.52:0/2318509656 conn(0x7f67940c7bb0 msgr2=0x7f67940c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:04.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 -- 172.21.15.52:0/2318509656 shutdown_connections 2023-05-10T01:24:04.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.464+0000 7f679a016700 1 -- 172.21.15.52:0/2318509656 wait complete. 2023-05-10T01:24:04.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.465+0000 7f679a016700 1 Processor -- start 2023-05-10T01:24:04.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.465+0000 7f679a016700 1 -- start start 2023-05-10T01:24:04.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f679414e5d0 0x7f67940c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67941367b0 con 0x7f6794158150 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c6c50 con 0x7f679414e1f0 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f679a016700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940abe40 con 0x7f679414e5d0 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f6793fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f67937fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f6792ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f679414e5d0 0x7f67940c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f6793fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34258/0 (socket says 172.21.15.52:34258) 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f67937fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:60810/0 (socket says 172.21.15.52:60810) 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.466+0000 7f6793fff700 1 -- 172.21.15.52:0/2791934526 learned_addr learned my addr 172.21.15.52:0/2791934526 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 -- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f679414e5d0 msgr2=0x7f67940c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f679414e5d0 0x7f67940c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 -- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 msgr2=0x7f67940ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 -- 172.21.15.52:0/2791934526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009a20 con 0x7f6794158150 2023-05-10T01:24:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f67937fe700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f6793fff700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f678c00b610 tx=0x7f6794158a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c021070 con 0x7f6794158150 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c009e90 con 0x7f6794158150 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6794168530 con 0x7f6794158150 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c01d650 con 0x7f6794158150 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.467+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6794167a50 con 0x7f6794158150 2023-05-10T01:24:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.468+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679406c340 con 0x7f6794158150 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.469+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f678c01d9c0 con 0x7f6794158150 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.469+0000 7f677b7fe700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 0x7f67740612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.469+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f678c07be50 con 0x7f6794158150 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.469+0000 7f67937fe700 1 -- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 msgr2=0x7f67740612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.469+0000 7f67937fe700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 0x7f67740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:04.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.473+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f678c04d0b0 con 0x7f6794158150 2023-05-10T01:24:04.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.649+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67940c43d0 con 0x7f6794158150 2023-05-10T01:24:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.650+0000 7f677b7fe700 1 -- 172.21.15.52:0/2791934526 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17821 (secure 0 0 0) 0x7f678c07d090 con 0x7f6794158150 2023-05-10T01:24:04.655 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:04.655 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":66,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:23:14.579428+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:6832/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/1387591592":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/573741442":"2023-05-11T01:22:12.821275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:04.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 msgr2=0x7f67740612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:04.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 0x7f67740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 msgr2=0x7f67940c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f678c00b610 tx=0x7f6794158a20).stop 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 shutdown_connections 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f677405ee20 0x7f67740612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6794158150 0x7f67940c6760 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f679414e1f0 0x7f67940ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 --2- 172.21.15.52:0/2791934526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f679414e5d0 0x7f67940c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 >> 172.21.15.52:0/2791934526 conn(0x7f67940c7bb0 msgr2=0x7f67941575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 shutdown_connections 2023-05-10T01:24:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.652+0000 7f679a016700 1 -- 172.21.15.52:0/2791934526 wait complete. 2023-05-10T01:24:04.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:21:53.995565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:21:55.337178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:24:04.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:24:04.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.790+0000 7f3667926700 1 Processor -- start 2023-05-10T01:24:04.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.790+0000 7f3667926700 1 -- start start 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36600a4a30 0x7f36600a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36601549d0 0x7f3660154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3660068a60 0x7f3660068f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3660137420 con 0x7f3660068a60 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366014e930 con 0x7f36601549d0 2023-05-10T01:24:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3667926700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366006a380 con 0x7f36600a4a30 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3660068a60 0x7f3660068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3660068a60 0x7f3660068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34264/0 (socket says 172.21.15.52:34264) 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 -- 172.21.15.52:0/25052243 learned_addr learned my addr 172.21.15.52:0/25052243 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f36656c2700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36600a4a30 0x7f36600a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3664ec1700 1 --2- 172.21.15.52:0/25052243 >> v2:172.21.15.172:3300/0 conn(0x7f36601549d0 0x7f3660154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 -- 172.21.15.52:0/25052243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36600a4a30 msgr2=0x7f36600a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:04.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36600a4a30 0x7f36600a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 -- 172.21.15.52:0/25052243 >> v2:172.21.15.172:3300/0 conn(0x7f36601549d0 msgr2=0x7f3660154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 --2- 172.21.15.52:0/25052243 >> v2:172.21.15.172:3300/0 conn(0x7f36601549d0 0x7f3660154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 -- 172.21.15.52:0/25052243 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660069770 con 0x7f3660068a60 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f3665ec3700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3660068a60 0x7f3660068f10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f3660063760 tx=0x7f3658009840).ready entity=mon.0 client_cookie=88deb3ba065a79b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.791+0000 7f364ffff700 1 -- 172.21.15.52:0/25052243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800e070 con 0x7f3660068a60 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f364ffff700 1 -- 172.21.15.52:0/25052243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800b970 con 0x7f3660068a60 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f364ffff700 1 -- 172.21.15.52:0/25052243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800bcf0 con 0x7f3660068a60 2023-05-10T01:24:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 -- 172.21.15.52:0/25052243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3660068a60 msgr2=0x7f3660068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3660068a60 0x7f3660068f10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f3660063760 tx=0x7f3658009840).stop 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 -- 172.21.15.52:0/25052243 shutdown_connections 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3660068a60 0x7f3660068f10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 --2- 172.21.15.52:0/25052243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36600a4a30 0x7f36600a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 --2- 172.21.15.52:0/25052243 >> v2:172.21.15.172:3300/0 conn(0x7f36601549d0 0x7f3660154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 -- 172.21.15.52:0/25052243 >> 172.21.15.52:0/25052243 conn(0x7f36600c4610 msgr2=0x7f3660066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 -- 172.21.15.52:0/25052243 shutdown_connections 2023-05-10T01:24:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.792+0000 7f3667926700 1 -- 172.21.15.52:0/25052243 wait complete. 2023-05-10T01:24:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.793+0000 7f3667926700 1 Processor -- start 2023-05-10T01:24:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.793+0000 7f3667926700 1 -- start start 2023-05-10T01:24:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660068a60 0x7f36600acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36601549d0 0x7f3660136a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600a7a40 con 0x7f36600a4a30 2023-05-10T01:24:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600a7c50 con 0x7f3660068a60 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3667926700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c19b0 con 0x7f36601549d0 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3664ec1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3664ec1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34268/0 (socket says 172.21.15.52:34268) 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3664ec1700 1 -- 172.21.15.52:0/737178245 learned_addr learned my addr 172.21.15.52:0/737178245 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f36656c2700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660068a60 0x7f36600acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.794+0000 7f3665ec3700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36601549d0 0x7f3660136a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36601549d0 msgr2=0x7f3660136a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36601549d0 0x7f3660136a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660068a60 msgr2=0x7f36600acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660068a60 0x7f36600acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 -- 172.21.15.52:0/737178245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658009ae0 con 0x7f36600a4a30 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3664ec1700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f365000e8d0 tx=0x7f3650009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650009390 con 0x7f36600a4a30 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650012600 con 0x7f36600a4a30 2023-05-10T01:24:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36600c1c90 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650012980 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.795+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600c2250 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.796+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36600c23e0 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.796+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3650022070 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.797+0000 7f364d7fa700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 0x7f36400612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.797+0000 7f36656c2700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 msgr2=0x7f36400612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.797+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f3650079e40 con 0x7f36600a4a30 2023-05-10T01:24:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.797+0000 7f36656c2700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 0x7f36400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:04.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.801+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f365004b1b0 con 0x7f36600a4a30 2023-05-10T01:24:04.820 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:04.816+0000 7f0144b8e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:04.891 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:04.887+0000 7f0144b8e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:04.912 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:04.908+0000 7f7ae85c5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:04.981 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:04.977+0000 7f7ae85c5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:05.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.998+0000 7f36656c2700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 msgr2=0x7f36400612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:05.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:04.998+0000 7f36656c2700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 0x7f36400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.020+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f366006c340 con 0x7f36600a4a30 2023-05-10T01:24:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.021+0000 7f364d7fa700 1 -- 172.21.15.52:0/737178245 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v66) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3650016070 con 0x7f36600a4a30 2023-05-10T01:24:05.025 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:24:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 msgr2=0x7f36400612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 0x7f36400612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 msgr2=0x7f36600a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f365000e8d0 tx=0x7f3650009060).stop 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 shutdown_connections 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f364005ee20 0x7f36400612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f36601549d0 0x7f3660136a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3660068a60 0x7f36600acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 --2- 172.21.15.52:0/737178245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36600a4a30 0x7f36600a7550 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 >> 172.21.15.52:0/737178245 conn(0x7f36600c4610 msgr2=0x7f3660157010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 shutdown_connections 2023-05-10T01:24:05.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.023+0000 7f3667926700 1 -- 172.21.15.52:0/737178245 wait complete. 2023-05-10T01:24:05.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:24:05.073 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.070+0000 7f0144b8e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:05.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.159+0000 7febfddde700 1 Processor -- start 2023-05-10T01:24:05.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.159+0000 7febfddde700 1 -- start start 2023-05-10T01:24:05.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfddde700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfddde700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febf805e450 0x7febf8064140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfddde700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80c3160 con 0x7febf8152bb0 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfddde700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf805ec10 con 0x7febf805e450 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfddde700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf805e930 con 0x7febf814f3a0 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfcddc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febf805e450 0x7febf8064140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febf805e450 0x7febf8064140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:60866/0 (socket says 172.21.15.52:60866) 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfcddc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:53946/0 (socket says 172.21.15.52:53946) 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 -- 172.21.15.52:0/3008239336 learned_addr learned my addr 172.21.15.52:0/3008239336 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfd5dd700 1 --1- 172.21.15.52:0/3008239336 >> v1:172.21.15.172:6789/0 conn(0x7febf8152bb0 0x7febf80a76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:45866/0 (socket says 172.21.15.52:45866) 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 -- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 msgr2=0x7febf814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 -- 172.21.15.52:0/3008239336 >> v1:172.21.15.172:6789/0 conn(0x7febf8152bb0 legacy=0x7febf80a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febf7fff700 1 -- 172.21.15.52:0/3008239336 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8063660 con 0x7febf805e450 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.160+0000 7febfcddc700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febf7fff700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf805e450 0x7febf8064140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7febe4006fd0 tx=0x7febe40090f0).ready entity=mon.1 client_cookie=7163d953df148ad6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febf77fe700 1 -- 172.21.15.52:0/3008239336 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400b580 con 0x7febf805e450 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febf77fe700 1 -- 172.21.15.52:0/3008239336 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400b6e0 con 0x7febf805e450 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febf77fe700 1 -- 172.21.15.52:0/3008239336 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400ba60 con 0x7febf805e450 2023-05-10T01:24:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 -- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf805e450 msgr2=0x7febf8064140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf805e450 0x7febf8064140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7febe4006fd0 tx=0x7febe40090f0).stop 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 -- 172.21.15.52:0/3008239336 shutdown_connections 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf814f3a0 0x7febf814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 --2- 172.21.15.52:0/3008239336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf805e450 0x7febf8064140 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 -- 172.21.15.52:0/3008239336 >> 172.21.15.52:0/3008239336 conn(0x7febf8062d70 msgr2=0x7febf805dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 -- 172.21.15.52:0/3008239336 shutdown_connections 2023-05-10T01:24:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.161+0000 7febfddde700 1 -- 172.21.15.52:0/3008239336 wait complete. 2023-05-10T01:24:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 Processor -- start 2023-05-10T01:24:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 -- start start 2023-05-10T01:24:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 0x7febf8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf814f3a0 0x7febf8164a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80c0910 con 0x7febf8152bb0 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80c0da0 con 0x7febf814f3a0 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.163+0000 7febfddde700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf8068b10 con 0x7febf805e450 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfd5dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfd5dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34318/0 (socket says 172.21.15.52:34318) 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfd5dd700 1 -- 172.21.15.52:0/444190187 learned_addr learned my addr 172.21.15.52:0/444190187 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 0x7febf8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febf7fff700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf814f3a0 0x7febf8164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 -- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf814f3a0 msgr2=0x7febf8164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf814f3a0 0x7febf8164a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 -- 172.21.15.52:0/444190187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 msgr2=0x7febf8068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 -- 172.21.15.52:0/444190187 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0092a0 con 0x7febf805e450 2023-05-10T01:24:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfd5dd700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfcddc700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 0x7febf8068620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7febec00e980 tx=0x7febec009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec012600 con 0x7febf805e450 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec012760 con 0x7febf805e450 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4009370 con 0x7febf805e450 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec012ae0 con 0x7febf805e450 2023-05-10T01:24:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.164+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf80bffe0 con 0x7febf805e450 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7febec022070 con 0x7febf805e450 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf80c0bf0 con 0x7febf805e450 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febf4ff9700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 0x7febe00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7febec07a080 con 0x7febf805e450 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febf7fff700 1 -- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 msgr2=0x7febe00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.166+0000 7febf7fff700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 0x7febe00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:05.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.171+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febec04b3f0 con 0x7febf805e450 2023-05-10T01:24:05.182 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:05.179+0000 7f7ae85c5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.358+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febf8047150 con 0x7febf805e450 2023-05-10T01:24:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.359+0000 7febf4ff9700 1 -- 172.21.15.52:0/444190187 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7febec0160a0 con 0x7febf805e450 2023-05-10T01:24:05.363 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:24:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 msgr2=0x7febe00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 0x7febe00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 msgr2=0x7febf8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 0x7febf8068620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7febec00e980 tx=0x7febec009060).stop 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 shutdown_connections 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febe005ee20 0x7febe00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf8152bb0 0x7febf8068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf805e450 0x7febf8068620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 --2- 172.21.15.52:0/444190187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf814f3a0 0x7febf8164a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 >> 172.21.15.52:0/444190187 conn(0x7febf8062d70 msgr2=0x7febf80c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 shutdown_connections 2023-05-10T01:24:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.361+0000 7febfddde700 1 -- 172.21.15.52:0/444190187 wait complete. 2023-05-10T01:24:05.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:24:05.488 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.484+0000 7f0144b8e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.498+0000 7f1f92321700 1 Processor -- start 2023-05-10T01:24:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.498+0000 7f1f92321700 1 -- start start 2023-05-10T01:24:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f92321700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f8c154460 0x7f1f8c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f92321700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0c94c0 con 0x7f1f8c068150 2023-05-10T01:24:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f92321700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0cb7d0 con 0x7f1f8c154080 2023-05-10T01:24:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f92321700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c88b0 con 0x7f1f8c154460 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f8c154460 0x7f1f8c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f908be700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1f8c068150 0x7f1f8c0c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43342/0 (socket says 172.21.15.52:43342) 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f908be700 1 -- 172.21.15.52:0/3295433646 learned_addr learned my addr 172.21.15.52:0/3295433646 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8b7fe700 1 -- 172.21.15.52:0/3295433646 >> v1:172.21.15.172:6789/0 conn(0x7f1f8c154080 legacy=0x7f1f8c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8b7fe700 1 -- 172.21.15.52:0/3295433646 >> v1:172.21.15.52:6789/0 conn(0x7f1f8c068150 legacy=0x7f1f8c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8b7fe700 1 -- 172.21.15.52:0/3295433646 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0c8b90 con 0x7f1f8c154460 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8b7fe700 1 --2- 172.21.15.52:0/3295433646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c0aac90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1f80009760 tx=0x7f1f80009060).ready entity=mon.0 client_cookie=c0c34653a572234 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8affd700 1 -- 172.21.15.52:0/3295433646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000b580 con 0x7f1f8c154460 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8affd700 1 -- 172.21.15.52:0/3295433646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000b6e0 con 0x7f1f8c154460 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.499+0000 7f1f8affd700 1 -- 172.21.15.52:0/3295433646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000ba60 con 0x7f1f8c154460 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 -- 172.21.15.52:0/3295433646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 msgr2=0x7f1f8c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 --2- 172.21.15.52:0/3295433646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c0aac90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1f80009760 tx=0x7f1f80009060).stop 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 -- 172.21.15.52:0/3295433646 shutdown_connections 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 --2- 172.21.15.52:0/3295433646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c0aac90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 -- 172.21.15.52:0/3295433646 >> 172.21.15.52:0/3295433646 conn(0x7f1f8c067910 msgr2=0x7f1f8c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 -- 172.21.15.52:0/3295433646 shutdown_connections 2023-05-10T01:24:05.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.500+0000 7f1f92321700 1 -- 172.21.15.52:0/3295433646 wait complete. 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.501+0000 7f1f92321700 1 Processor -- start 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.501+0000 7f1f92321700 1 -- start start 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 0x7f1f8c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f8c154080 0x7f1f8c0c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c156320 con 0x7f1f8c154460 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0aa270 con 0x7f1f8c068150 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f92321700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c21b0 con 0x7f1f8c154080 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f908be700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f908be700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34332/0 (socket says 172.21.15.52:34332) 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f908be700 1 -- 172.21.15.52:0/2748153217 learned_addr learned my addr 172.21.15.52:0/2748153217 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f8bfff700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 0x7f1f8c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.502+0000 7f1f8b7fe700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f8c154080 0x7f1f8c0c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 -- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f8c154080 msgr2=0x7f1f8c0c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f8c154080 0x7f1f8c0c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 -- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 msgr2=0x7f1f8c0b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 0x7f1f8c0b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 -- 172.21.15.52:0/2748153217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800092a0 con 0x7f1f8c154460 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f8bfff700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 0x7f1f8c0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f908be700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1f8400c790 tx=0x7f1f840015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84005d30 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84005e90 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c0aa510 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007320 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.503+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c155fb0 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.504+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c066720 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.504+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f1f84010030 con 0x7f1f8c154460 2023-05-10T01:24:05.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.505+0000 7f1f73fff700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 0x7f1f6c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.505+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f1f84079b20 con 0x7f1f8c154460 2023-05-10T01:24:05.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.505+0000 7f1f8bfff700 1 -- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 msgr2=0x7f1f6c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:05.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.505+0000 7f1f8bfff700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 0x7f1f6c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:05.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.509+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f8404ae90 con 0x7f1f8c154460 2023-05-10T01:24:05.591 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.587+0000 7f0144b8e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:05.633 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:05.629+0000 7f7ae85c5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.685+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f8c06c340 con 0x7f1f8c154460 2023-05-10T01:24:05.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.685+0000 7f1f73fff700 1 -- 172.21.15.52:0/2748153217 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f8404e4b0 con 0x7f1f8c154460 2023-05-10T01:24:05.689 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 msgr2=0x7f1f6c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 0x7f1f6c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 msgr2=0x7f1f8c14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1f8400c790 tx=0x7f1f840015e0).stop 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 shutdown_connections 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f6c05ee20 0x7f1f6c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:05.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f8c154460 0x7f1f8c14bb60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f8c068150 0x7f1f8c0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 --2- 172.21.15.52:0/2748153217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f8c154080 0x7f1f8c0c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 >> 172.21.15.52:0/2748153217 conn(0x7f1f8c067910 msgr2=0x7f1f8c0ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 shutdown_connections 2023-05-10T01:24:05.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.687+0000 7f1f92321700 1 -- 172.21.15.52:0/2748153217 wait complete. 2023-05-10T01:24:05.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:24:05.743 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:05.739+0000 7f7ae85c5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:05.743 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.739+0000 7f0144b8e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:05.816 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.812+0000 7f0144b8e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.822+0000 7fbfa9b63700 1 Processor -- start 2023-05-10T01:24:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.822+0000 7fbfa9b63700 1 -- start start 2023-05-10T01:24:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa9b63700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa4150d80 0x7fbfa4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa9b63700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfa406a060 0x7fbfa40c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa9b63700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa406a4d0 con 0x7fbfa41509a0 2023-05-10T01:24:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa9b63700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40bc1a0 con 0x7fbfa406a060 2023-05-10T01:24:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa9b63700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40bc480 con 0x7fbfa4150d80 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfa406a060 0x7fbfa40c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbfa41509a0 0x7fbfa4065d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43352/0 (socket says 172.21.15.52:43352) 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbfa406a060 0x7fbfa40c16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34340/0 (socket says 172.21.15.52:34340) 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa37fe700 1 -- 172.21.15.52:0/3621044830 learned_addr learned my addr 172.21.15.52:0/3621044830 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa2ffd700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa4150d80 0x7fbfa4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 -- 172.21.15.52:0/3621044830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa4150d80 msgr2=0x7fbfa4069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa4150d80 0x7fbfa4069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 -- 172.21.15.52:0/3621044830 >> v1:172.21.15.52:6789/0 conn(0x7fbfa41509a0 legacy=0x7fbfa4065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa27fc700 1 -- 172.21.15.52:0/3621044830 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124301524 0 0) 0x7fbfa406a4d0 con 0x7fbfa41509a0 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 -- 172.21.15.52:0/3621044830 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40bc760 con 0x7fbfa406a060 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.823+0000 7fbfa3fff700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa406a060 0x7fbfa40c16a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fbf9c009e60 tx=0x7fbf9c009780).ready entity=mon.0 client_cookie=6077a2fe9aff0443 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa27fc700 1 -- 172.21.15.52:0/3621044830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00e070 con 0x7fbfa406a060 2023-05-10T01:24:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa27fc700 1 -- 172.21.15.52:0/3621044830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00bb60 con 0x7fbfa406a060 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa27fc700 1 -- 172.21.15.52:0/3621044830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c012410 con 0x7fbfa406a060 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 -- 172.21.15.52:0/3621044830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa406a060 msgr2=0x7fbfa40c16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa406a060 0x7fbfa40c16a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fbf9c009e60 tx=0x7fbf9c009780).stop 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 -- 172.21.15.52:0/3621044830 shutdown_connections 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa406a060 0x7fbfa40c16a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/3621044830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa4150d80 0x7fbfa4069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 -- 172.21.15.52:0/3621044830 >> 172.21.15.52:0/3621044830 conn(0x7fbfa40c4610 msgr2=0x7fbfa4066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 -- 172.21.15.52:0/3621044830 shutdown_connections 2023-05-10T01:24:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.824+0000 7fbfa9b63700 1 -- 172.21.15.52:0/3621044830 wait complete. 2023-05-10T01:24:05.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 Processor -- start 2023-05-10T01:24:05.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 -- start start 2023-05-10T01:24:05.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa406a060 0x7fbfa4154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfa41509a0 0x7fbfa413bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4155bd0 con 0x7fbfa4150d80 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.826+0000 7fbfa9b63700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4155610 con 0x7fbfa41509a0 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa9b63700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41558f0 con 0x7fbfa406a060 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34346/0 (socket says 172.21.15.52:34346) 2023-05-10T01:24:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 -- 172.21.15.52:0/2363181499 learned_addr learned my addr 172.21.15.52:0/2363181499 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa37fe700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa406a060 0x7fbfa4154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa2ffd700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfa41509a0 0x7fbfa413bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 -- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa406a060 msgr2=0x7fbfa4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa406a060 0x7fbfa4154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 -- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfa41509a0 msgr2=0x7fbfa413bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfa41509a0 0x7fbfa413bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 -- 172.21.15.52:0/2363181499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009a20 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa3fff700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fbf9c00b6c0 tx=0x7fbf9c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c012410 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c01d630 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa413fd60 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c01d9f0 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.827+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa4155320 con 0x7fbfa4150d80 2023-05-10T01:24:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.828+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa406c340 con 0x7fbfa4150d80 2023-05-10T01:24:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.829+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fbf9c01dd60 con 0x7fbfa4150d80 2023-05-10T01:24:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.829+0000 7fbf8b7fe700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 0x7fbf840612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.829+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7fbf9c07bff0 con 0x7fbfa4150d80 2023-05-10T01:24:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.829+0000 7fbfa37fe700 1 -- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 msgr2=0x7fbf840612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.829+0000 7fbfa37fe700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 0x7fbf840612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:05.834+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf9c04d360 con 0x7fbfa4150d80 2023-05-10T01:24:05.884 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:05.880+0000 7f0144b8e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:05.903 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:05.900+0000 7f7ae85c5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:05.981 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:05.978+0000 7f7ae85c5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:06.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.010+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfa405de80 con 0x7fbfa4150d80 2023-05-10T01:24:06.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.010+0000 7fbf8b7fe700 1 -- 172.21.15.52:0/2363181499 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf9c050980 con 0x7fbfa4150d80 2023-05-10T01:24:06.015 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:24:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 msgr2=0x7fbf840612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 0x7fbf840612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 msgr2=0x7fbfa40a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fbf9c00b6c0 tx=0x7fbf9c009780).stop 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 shutdown_connections 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf8405ee20 0x7fbf840612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfa4150d80 0x7fbfa40a8ed0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfa406a060 0x7fbfa4154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 --2- 172.21.15.52:0/2363181499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfa41509a0 0x7fbfa413bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.013+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 >> 172.21.15.52:0/2363181499 conn(0x7fbfa40c4610 msgr2=0x7fbfa40c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.014+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 shutdown_connections 2023-05-10T01:24:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.014+0000 7fbfa9b63700 1 -- 172.21.15.52:0/2363181499 wait complete. 2023-05-10T01:24:06.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:06.060 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:06.055+0000 7f7ae85c5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:06.136 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:06.132+0000 7f0144b8e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:06.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.174+0000 7f1752e66700 1 Processor -- start 2023-05-10T01:24:06.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.174+0000 7f1752e66700 1 -- start start 2023-05-10T01:24:06.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f174c0c76d0 0x7f174c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c0a9b60 0x7f174c0a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f174c153810 0x7f174c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c1588f0 con 0x7f174c153810 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c157ce0 con 0x7f174c0c76d0 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752e66700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c157fc0 con 0x7f174c0a9b60 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f174c153810 0x7f174c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f174c153810 0x7f174c153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34354/0 (socket says 172.21.15.52:34354) 2023-05-10T01:24:06.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 -- 172.21.15.52:0/1901169890 learned_addr learned my addr 172.21.15.52:0/1901169890 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1751663700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c0a9b60 0x7f174c0a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1751e64700 1 --2- 172.21.15.52:0/1901169890 >> v2:172.21.15.172:3300/0 conn(0x7f174c0c76d0 0x7f174c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 -- 172.21.15.52:0/1901169890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c0a9b60 msgr2=0x7f174c0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c0a9b60 0x7f174c0a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 -- 172.21.15.52:0/1901169890 >> v2:172.21.15.172:3300/0 conn(0x7f174c0c76d0 msgr2=0x7f174c0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 --2- 172.21.15.52:0/1901169890 >> v2:172.21.15.172:3300/0 conn(0x7f174c0c76d0 0x7f174c0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.175+0000 7f1752665700 1 -- 172.21.15.52:0/1901169890 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c1582a0 con 0x7f174c153810 2023-05-10T01:24:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752665700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c153810 0x7f174c153c60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f174c084190 tx=0x7f1744009840).ready entity=mon.0 client_cookie=a62f581f43ca0d9d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1750e62700 1 -- 172.21.15.52:0/1901169890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400e070 con 0x7f174c153810 2023-05-10T01:24:06.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1750e62700 1 -- 172.21.15.52:0/1901169890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400b970 con 0x7f174c153810 2023-05-10T01:24:06.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1750e62700 1 -- 172.21.15.52:0/1901169890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400bcf0 con 0x7f174c153810 2023-05-10T01:24:06.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 -- 172.21.15.52:0/1901169890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c153810 msgr2=0x7f174c153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c153810 0x7f174c153c60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f174c084190 tx=0x7f1744009840).stop 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 -- 172.21.15.52:0/1901169890 shutdown_connections 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c153810 0x7f174c153c60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 --2- 172.21.15.52:0/1901169890 >> v2:172.21.15.172:3300/0 conn(0x7f174c0c76d0 0x7f174c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 --2- 172.21.15.52:0/1901169890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c0a9b60 0x7f174c0a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 -- 172.21.15.52:0/1901169890 >> 172.21.15.52:0/1901169890 conn(0x7f174c068320 msgr2=0x7f174c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 -- 172.21.15.52:0/1901169890 shutdown_connections 2023-05-10T01:24:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.176+0000 7f1752e66700 1 -- 172.21.15.52:0/1901169890 wait complete. 2023-05-10T01:24:06.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.177+0000 7f1752e66700 1 Processor -- start 2023-05-10T01:24:06.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 -- start start 2023-05-10T01:24:06.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 0x7f174c13b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c153810 0x7f174c0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c13be80 con 0x7f174c0c76d0 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c6140 con 0x7f174c0a9b60 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752e66700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c156810 con 0x7f174c153810 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1751663700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1751663700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34358/0 (socket says 172.21.15.52:34358) 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1751663700 1 -- 172.21.15.52:0/3704178781 learned_addr learned my addr 172.21.15.52:0/3704178781 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1751e64700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 0x7f174c13b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.178+0000 7f1752665700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c153810 0x7f174c0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c153810 msgr2=0x7f174c0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c153810 0x7f174c0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 msgr2=0x7f174c13b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 0x7f174c13b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 -- 172.21.15.52:0/3704178781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009ae0 con 0x7f174c0c76d0 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751e64700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 0x7f174c13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:06.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1751663700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f173c00e930 tx=0x7f173c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c012600 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c012760 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c012ae0 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c156af0 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.179+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c13baa0 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.180+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c13c0f0 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.180+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f173c022070 con 0x7f174c0c76d0 2023-05-10T01:24:06.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.181+0000 7f1739ffb700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 0x7f172c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.181+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f173c07a040 con 0x7f174c0c76d0 2023-05-10T01:24:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.181+0000 7f1751e64700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 msgr2=0x7f172c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.181+0000 7f1751e64700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 0x7f172c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:06.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.185+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f173c04b3b0 con 0x7f174c0c76d0 2023-05-10T01:24:06.317 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:06.313+0000 7f0144b8e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:06.335 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:06.331+0000 7f7ae85c5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:06.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.382+0000 7f1751e64700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 msgr2=0x7f172c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:06.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.382+0000 7f1751e64700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 0x7f172c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.400+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f174c047150 con 0x7f174c0c76d0 2023-05-10T01:24:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.400+0000 7f1739ffb700 1 -- 172.21.15.52:0/3704178781 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f173c04e9d0 con 0x7f174c0c76d0 2023-05-10T01:24:06.404 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:06.404 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:24:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 msgr2=0x7f172c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 0x7f172c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 msgr2=0x7f174c0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f173c00e930 tx=0x7f173c009060).stop 2023-05-10T01:24:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 shutdown_connections 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f172c05ee20 0x7f172c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f174c153810 0x7f174c0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c0a9b60 0x7f174c13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 --2- 172.21.15.52:0/3704178781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f174c0c76d0 0x7f174c0c5760 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 >> 172.21.15.52:0/3704178781 conn(0x7f174c068320 msgr2=0x7f174c14d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 shutdown_connections 2023-05-10T01:24:06.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.402+0000 7f1752e66700 1 -- 172.21.15.52:0/3704178781 wait complete. 2023-05-10T01:24:06.408 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:24:06.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:06.527 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:06.523+0000 7f7ae85c5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.536+0000 7f6f87158700 1 Processor -- start 2023-05-10T01:24:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.536+0000 7f6f87158700 1 -- start start 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f87158700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f80154540 0x7f6f80069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f87158700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6f80069b80 0x7f6f800c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f87158700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800c0650 con 0x7f6f80154160 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f87158700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f80069fb0 con 0x7f6f80154540 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f87158700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800bfd20 con 0x7f6f80069b80 2023-05-10T01:24:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f80154540 0x7f6f80069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f80154540 0x7f6f80069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34368/0 (socket says 172.21.15.52:34368) 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 -- 172.21.15.52:0/2481044485 learned_addr learned my addr 172.21.15.52:0/2481044485 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f856f5700 1 --2- 172.21.15.52:0/2481044485 >> v2:172.21.15.172:3300/0 conn(0x7f6f80069b80 0x7f6f800c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 -- 172.21.15.52:0/2481044485 >> v2:172.21.15.172:3300/0 conn(0x7f6f80069b80 msgr2=0x7f6f800c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 --2- 172.21.15.52:0/2481044485 >> v2:172.21.15.172:3300/0 conn(0x7f6f80069b80 0x7f6f800c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 -- 172.21.15.52:0/2481044485 >> v1:172.21.15.172:6789/0 conn(0x7f6f80154160 legacy=0x7f6f800c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 -- 172.21.15.52:0/2481044485 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800c0000 con 0x7f6f80154540 2023-05-10T01:24:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7ffff700 1 --2- 172.21.15.52:0/2481044485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80154540 0x7f6f80069690 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f6f800c5200 tx=0x7f6f6c0090f0).ready entity=mon.0 client_cookie=bf0aa1ea29f09e70 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7f7fe700 1 -- 172.21.15.52:0/2481044485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00b520 con 0x7f6f80154540 2023-05-10T01:24:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7f7fe700 1 -- 172.21.15.52:0/2481044485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00b680 con 0x7f6f80154540 2023-05-10T01:24:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.537+0000 7f6f7f7fe700 1 -- 172.21.15.52:0/2481044485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00ba00 con 0x7f6f80154540 2023-05-10T01:24:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 -- 172.21.15.52:0/2481044485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80154540 msgr2=0x7f6f80069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 --2- 172.21.15.52:0/2481044485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80154540 0x7f6f80069690 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f6f800c5200 tx=0x7f6f6c0090f0).stop 2023-05-10T01:24:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 -- 172.21.15.52:0/2481044485 shutdown_connections 2023-05-10T01:24:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 --2- 172.21.15.52:0/2481044485 >> v2:172.21.15.172:3300/0 conn(0x7f6f80069b80 0x7f6f800c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 --2- 172.21.15.52:0/2481044485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80154540 0x7f6f80069690 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 -- 172.21.15.52:0/2481044485 >> 172.21.15.52:0/2481044485 conn(0x7f6f800cb740 msgr2=0x7f6f800c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 -- 172.21.15.52:0/2481044485 shutdown_connections 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.538+0000 7f6f87158700 1 -- 172.21.15.52:0/2481044485 wait complete. 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.539+0000 7f6f87158700 1 Processor -- start 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.539+0000 7f6f87158700 1 -- start start 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80154160 0x7f6f80156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f80154540 0x7f6f80157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800ae840 con 0x7f6f80069b80 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80157940 con 0x7f6f80154160 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f87158700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f801526a0 con 0x7f6f80154540 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f84ef4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f84ef4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34372/0 (socket says 172.21.15.52:34372) 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f84ef4700 1 -- 172.21.15.52:0/4155388061 learned_addr learned my addr 172.21.15.52:0/4155388061 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f7ffff700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80154160 0x7f6f80156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.540+0000 7f6f856f5700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f80154540 0x7f6f80157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 -- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f80154540 msgr2=0x7f6f80157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f80154540 0x7f6f80157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 -- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80154160 msgr2=0x7f6f80156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80154160 0x7f6f80156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 -- 172.21.15.52:0/4155388061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c009370 con 0x7f6f80069b80 2023-05-10T01:24:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f84ef4700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f6f7400c4c0 tx=0x7f6f74007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400ce70 con 0x7f6f80069b80 2023-05-10T01:24:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74001e90 con 0x7f6f80069b80 2023-05-10T01:24:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800aea90 con 0x7f6f80069b80 2023-05-10T01:24:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74007270 con 0x7f6f80069b80 2023-05-10T01:24:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.541+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f800af050 con 0x7f6f80069b80 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.542+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f800666b0 con 0x7f6f80069b80 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.542+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f6f74010070 con 0x7f6f80069b80 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.543+0000 7f6f7cff9700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 0x7f6f680612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.543+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6645+0+0 (secure 0 0 0) 0x7f6f74079470 con 0x7f6f80069b80 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.543+0000 7f6f7ffff700 1 -- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 msgr2=0x7f6f680612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:06.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.543+0000 7f6f7ffff700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 0x7f6f680612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.547+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f7404a7e0 con 0x7f6f80069b80 2023-05-10T01:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.723+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8006c340 con 0x7f6f80069b80 2023-05-10T01:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.724+0000 7f6f7cff9700 1 -- 172.21.15.52:0/4155388061 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17821 (secure 0 0 0) 0x7f6f7404de00 con 0x7f6f80069b80 2023-05-10T01:24:06.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:06.728 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":66,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:23:14.579428+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:6832/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/1387591592":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/573741442":"2023-05-11T01:22:12.821275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 msgr2=0x7f6f680612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 0x7f6f680612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 msgr2=0x7f6f8013c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f6f7400c4c0 tx=0x7f6f74007e00).stop 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 shutdown_connections 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f6805ee20 0x7f6f680612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f80154540 0x7f6f80157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f80069b80 0x7f6f8013c850 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 --2- 172.21.15.52:0/4155388061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80154160 0x7f6f80156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 >> 172.21.15.52:0/4155388061 conn(0x7f6f800cb740 msgr2=0x7f6f80153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 shutdown_connections 2023-05-10T01:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.726+0000 7f6f87158700 1 -- 172.21.15.52:0/4155388061 wait complete. 2023-05-10T01:24:06.745 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:24:06.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:06.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.861+0000 7f5294cd8700 1 Processor -- start 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.861+0000 7f5294cd8700 1 -- start start 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f5294cd8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f52900684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f5294cd8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900bda30 con 0x7f5290068110 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f5294cd8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52901547e0 con 0x7f52900c4eb0 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f5294cd8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900bcb80 con 0x7f5290150d00 2023-05-10T01:24:06.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f528e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5290068110 0x7f52901505f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43422/0 (socket says 172.21.15.52:43422) 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f528e59c700 1 -- 172.21.15.52:0/4133007990 learned_addr learned my addr 172.21.15.52:0/4133007990 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.862+0000 7f528dd9b700 1 --2- 172.21.15.52:0/4133007990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f52900684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365045308 0 0) 0x7f52900bda30 con 0x7f5290068110 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52700033f0 con 0x7f5290068110 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649918273 0 0) 0x7f52901547e0 con 0x7f52900c4eb0 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528dd9b700 1 -- 172.21.15.52:0/4133007990 >> v1:172.21.15.172:6789/0 conn(0x7f52900c4eb0 legacy=0x7f5290064d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528dd9b700 1 -- 172.21.15.52:0/4133007990 >> v1:172.21.15.52:6789/0 conn(0x7f5290068110 legacy=0x7f52901505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528dd9b700 1 -- 172.21.15.52:0/4133007990 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290154ac0 con 0x7f5290150d00 2023-05-10T01:24:06.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528dd9b700 1 --2- 172.21.15.52:0/4133007990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f52900684f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5278009790 tx=0x7f5278009060).ready entity=mon.2 client_cookie=1933651d9599ae87 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800f510 con 0x7f5290150d00 2023-05-10T01:24:06.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527800f670 con 0x7f5290150d00 2023-05-10T01:24:06.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.863+0000 7f528d59a700 1 -- 172.21.15.52:0/4133007990 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800f9f0 con 0x7f5290150d00 2023-05-10T01:24:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 -- 172.21.15.52:0/4133007990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 msgr2=0x7f52900684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 --2- 172.21.15.52:0/4133007990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f52900684f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5278009790 tx=0x7f5278009060).stop 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 -- 172.21.15.52:0/4133007990 shutdown_connections 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 --2- 172.21.15.52:0/4133007990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f52900684f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 -- 172.21.15.52:0/4133007990 >> 172.21.15.52:0/4133007990 conn(0x7f52900c8390 msgr2=0x7f52900c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 -- 172.21.15.52:0/4133007990 shutdown_connections 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.864+0000 7f5294cd8700 1 -- 172.21.15.52:0/4133007990 wait complete. 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.865+0000 7f5294cd8700 1 Processor -- start 2023-05-10T01:24:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.865+0000 7f5294cd8700 1 -- start start 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290068110 0x7f5290149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f529014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900bf520 con 0x7f52900c4eb0 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900bf6b0 con 0x7f5290068110 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529014b360 con 0x7f5290150d00 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34414/0 (socket says 172.21.15.52:34414) 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 -- 172.21.15.52:0/1876372619 learned_addr learned my addr 172.21.15.52:0/1876372619 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528e59c700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290068110 0x7f5290149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528ed9d700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f529014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 msgr2=0x7f529014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f529014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290068110 msgr2=0x7f5290149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:06.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290068110 0x7f5290149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 -- 172.21.15.52:0/1876372619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780092a0 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f528dd9b700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f5278009e30 tx=0x7f5278017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800fe80 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527800f7e0 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529014b640 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527801b620 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.866+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529014bc00 con 0x7f52900c4eb0 2023-05-10T01:24:06.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.867+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52900bf820 con 0x7f52900c4eb0 2023-05-10T01:24:06.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.869+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f527800f070 con 0x7f52900c4eb0 2023-05-10T01:24:06.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.869+0000 7f52867fc700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 0x7f52740612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.869+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6701+0+0 (secure 0 0 0) 0x7f527807b810 con 0x7f52900c4eb0 2023-05-10T01:24:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.869+0000 7f528e59c700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 msgr2=0x7f52740612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.869+0000 7f528e59c700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 0x7f52740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:06.872+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f527804cbd0 con 0x7f52900c4eb0 2023-05-10T01:24:06.960 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:06.956+0000 7f0144b8e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:07.030 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.027+0000 7f0144b8e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.070+0000 7f528e59c700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 msgr2=0x7f52740612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:07.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.070+0000 7f528e59c700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 0x7f52740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.089+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f529006c340 con 0x7f52900c4eb0 2023-05-10T01:24:07.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.089+0000 7f52867fc700 1 -- 172.21.15.52:0/1876372619 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f52780501f0 con 0x7f52900c4eb0 2023-05-10T01:24:07.093 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:07.093 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 msgr2=0x7f52740612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 0x7f52740612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 msgr2=0x7f529014a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f5278009e30 tx=0x7f5278017000).stop 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 shutdown_connections 2023-05-10T01:24:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f527405ee20 0x7f52740612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5290150d00 0x7f529014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290068110 0x7f5290149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 --2- 172.21.15.52:0/1876372619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52900c4eb0 0x7f529014a8c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 >> 172.21.15.52:0/1876372619 conn(0x7f52900c8390 msgr2=0x7f52900677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 shutdown_connections 2023-05-10T01:24:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.091+0000 7f5294cd8700 1 -- 172.21.15.52:0/1876372619 wait complete. 2023-05-10T01:24:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:24:07.103 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.099+0000 7f0144b8e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:07.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:07.224 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.220+0000 7f7ae85c5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:07.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.229+0000 7f327eb75700 1 Processor -- start 2023-05-10T01:24:07.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.229+0000 7f327eb75700 1 -- start start 2023-05-10T01:24:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327eb75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278141fc0 0x7f3278066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327eb75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3278065700 0x7f32780c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327eb75700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780bd2d0 con 0x7f3278068c90 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327eb75700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32781423a0 con 0x7f3278065700 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327eb75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278067650 con 0x7f3278141fc0 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327d112700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3278065700 0x7f32780c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f3277fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3278068c90 0x7f3278064ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43438/0 (socket says 172.21.15.52:43438) 2023-05-10T01:24:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f3277fff700 1 -- 172.21.15.52:0/1259615198 learned_addr learned my addr 172.21.15.52:0/1259615198 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.230+0000 7f327c911700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278141fc0 0x7f3278066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f327d112700 1 -- 172.21.15.52:0/1259615198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278141fc0 msgr2=0x7f3278066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f327d112700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278141fc0 0x7f3278066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f327d112700 1 -- 172.21.15.52:0/1259615198 >> v1:172.21.15.52:6789/0 conn(0x7f3278068c90 legacy=0x7f3278064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f32777fe700 1 -- 172.21.15.52:0/1259615198 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115911720 0 0) 0x7f32780bd2d0 con 0x7f3278068c90 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f327d112700 1 -- 172.21.15.52:0/1259615198 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32780bd520 con 0x7f3278065700 2023-05-10T01:24:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f327d112700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278065700 0x7f32780c2400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f3270009e60 tx=0x7f3270009780).ready entity=mon.0 client_cookie=bc7e1919834e1c68 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f32777fe700 1 -- 172.21.15.52:0/1259615198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000e070 con 0x7f3278065700 2023-05-10T01:24:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f32777fe700 1 -- 172.21.15.52:0/1259615198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000bb60 con 0x7f3278065700 2023-05-10T01:24:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.231+0000 7f32777fe700 1 -- 172.21.15.52:0/1259615198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270012410 con 0x7f3278065700 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 -- 172.21.15.52:0/1259615198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278065700 msgr2=0x7f32780c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278065700 0x7f32780c2400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f3270009e60 tx=0x7f3270009780).stop 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 -- 172.21.15.52:0/1259615198 shutdown_connections 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278065700 0x7f32780c2400 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 --2- 172.21.15.52:0/1259615198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278141fc0 0x7f3278066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 -- 172.21.15.52:0/1259615198 >> 172.21.15.52:0/1259615198 conn(0x7f32780c4420 msgr2=0x7f32780c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 -- 172.21.15.52:0/1259615198 shutdown_connections 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.232+0000 7f327eb75700 1 -- 172.21.15.52:0/1259615198 wait complete. 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.233+0000 7f327eb75700 1 Processor -- start 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.233+0000 7f327eb75700 1 -- start start 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278065700 0x7f32780bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3278068c90 0x7f32780c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780c1930 con 0x7f3278141fc0 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32781592f0 con 0x7f3278068c90 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327eb75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780c0870 con 0x7f3278065700 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327c911700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278065700 0x7f32780bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34432/0 (socket says 172.21.15.52:34432) 2023-05-10T01:24:07.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 -- 172.21.15.52:0/676174857 learned_addr learned my addr 172.21.15.52:0/676174857 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f3277fff700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3278068c90 0x7f32780c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278065700 msgr2=0x7f32780bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278065700 0x7f32780bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3278068c90 msgr2=0x7f32780c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3278068c90 0x7f32780c1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 -- 172.21.15.52:0/676174857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009a20 con 0x7f3278141fc0 2023-05-10T01:24:07.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f327d112700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f3278064380 tx=0x7f3270009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.234+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270021070 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.235+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327001d630 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.235+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32781595b0 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.235+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270012410 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.235+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780bffd0 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.235+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278159740 con 0x7f3278141fc0 2023-05-10T01:24:07.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.236+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f327001dc00 con 0x7f3278141fc0 2023-05-10T01:24:07.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.236+0000 7f3274ff9700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 0x7f32600612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.236+0000 7f327c911700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 msgr2=0x7f32600612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:07.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.236+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6701+0+0 (secure 0 0 0) 0x7f327007bc00 con 0x7f3278141fc0 2023-05-10T01:24:07.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.236+0000 7f327c911700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 0x7f32600612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:07.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.240+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3270081020 con 0x7f3278141fc0 2023-05-10T01:24:07.246 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.242+0000 7f0144b8e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:07.300 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.297+0000 7f7ae85c5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:07.315 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.311+0000 7f0144b8e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:07.379 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.376+0000 7f7ae85c5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:07.427 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.423+0000 7f0144b8e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.437+0000 7f327c911700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 msgr2=0x7f32600612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.437+0000 7f327c911700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 0x7f32600612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:07.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.457+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32780c06d0 con 0x7f3278141fc0 2023-05-10T01:24:07.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.458+0000 7f3274ff9700 1 -- 172.21.15.52:0/676174857 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f32780c06d0 con 0x7f3278141fc0 2023-05-10T01:24:07.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:07.462 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:21:56.367015+0000","modified":"2023-05-10T01:21:59.377887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/751269855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":751269855},{"type":"v1","addr":"172.21.15.172:6836","nonce":751269855}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-05-10T01:24:07.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 msgr2=0x7f32600612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 0x7f32600612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 msgr2=0x7f327813ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f3278064380 tx=0x7f3270009780).stop 2023-05-10T01:24:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 shutdown_connections 2023-05-10T01:24:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f326005ee20 0x7f32600612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3278141fc0 0x7f327813ff20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3278065700 0x7f32780bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 --2- 172.21.15.52:0/676174857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3278068c90 0x7f32780c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 >> 172.21.15.52:0/676174857 conn(0x7f32780c4420 msgr2=0x7f3278157650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 shutdown_connections 2023-05-10T01:24:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.460+0000 7f327eb75700 1 -- 172.21.15.52:0/676174857 wait complete. 2023-05-10T01:24:07.467 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2023-05-10T01:24:07.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:07.532 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.528+0000 7f0144b8e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:07.534 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.530+0000 7f7ae85c5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:07.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.594+0000 7f1462634700 1 Processor -- start 2023-05-10T01:24:07.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 -- start start 2023-05-10T01:24:07.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c068c60 0x7f145c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f145c064ff0 0x7f145c0654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c067550 con 0x7f145c153ea0 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c065990 con 0x7f145c064ff0 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.595+0000 7f1462634700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0bc9a0 con 0x7f145c068c60 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f145c153ea0 0x7f145c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43454/0 (socket says 172.21.15.52:43454) 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145bfff700 1 -- 172.21.15.52:0/1347879094 learned_addr learned my addr 172.21.15.52:0/1347879094 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145b7fe700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c068c60 0x7f145c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f1460bd1700 1 --2- 172.21.15.52:0/1347879094 >> v2:172.21.15.172:3300/0 conn(0x7f145c064ff0 0x7f145c0654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533792116 0 0) 0x7f1450001110 con 0x7f145c153ea0 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14480033f0 con 0x7f145c153ea0 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538124370 0 0) 0x7f14480033f0 con 0x7f145c153ea0 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c068c60 msgr2=0x7f145c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c068c60 0x7f145c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 >> v2:172.21.15.172:3300/0 conn(0x7f145c064ff0 msgr2=0x7f145c0654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 --2- 172.21.15.52:0/1347879094 >> v2:172.21.15.172:3300/0 conn(0x7f145c064ff0 0x7f145c0654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0bcc80 con 0x7f145c153ea0 2023-05-10T01:24:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f1450001600 con 0x7f145c153ea0 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 >> v1:172.21.15.52:6789/0 conn(0x7f145c153ea0 legacy=0x7f145c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f1448003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1448004690 0x7f1448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1448005000 0x7f144800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c065990 con 0x7f14480038e0 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0bc9a0 con 0x7f1448004690 2023-05-10T01:24:07.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480054c0 con 0x7f1448005000 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145bfff700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f1448003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f145b7fe700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1448004690 0x7f1448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.596+0000 7f1460bd1700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1448005000 0x7f144800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 -- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1448005000 msgr2=0x7f144800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1448005000 0x7f144800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 -- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1448004690 msgr2=0x7f1448004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1448004690 0x7f1448004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 -- 172.21.15.52:0/1347879094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480033f0 con 0x7f14480038e0 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145bfff700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f1448003d00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f145000c370 tx=0x7f1450007900).ready entity=mon.0 client_cookie=3d13d243cc54559b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450007bf0 con 0x7f14480038e0 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145000cc60 con 0x7f14480038e0 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.597+0000 7f145affd700 1 -- 172.21.15.52:0/1347879094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500070d0 con 0x7f14480038e0 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 -- 172.21.15.52:0/1347879094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 msgr2=0x7f1448003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 --2- 172.21.15.52:0/1347879094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f1448003d00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f145000c370 tx=0x7f1450007900).stop 2023-05-10T01:24:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1460bd1700 1 -- 172.21.15.52:0/1347879094 reap_dead start 2023-05-10T01:24:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 -- 172.21.15.52:0/1347879094 shutdown_connections 2023-05-10T01:24:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 -- 172.21.15.52:0/1347879094 >> 172.21.15.52:0/1347879094 conn(0x7f145c0c4420 msgr2=0x7f145c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 -- 172.21.15.52:0/1347879094 shutdown_connections 2023-05-10T01:24:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.598+0000 7f1462634700 1 -- 172.21.15.52:0/1347879094 wait complete. 2023-05-10T01:24:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.599+0000 7f1462634700 1 Processor -- start 2023-05-10T01:24:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.599+0000 7f1462634700 1 -- start start 2023-05-10T01:24:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c0c1290 0x7f145c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f145c0c1710 0x7f145c0c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0c7340 con 0x7f14480038e0 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0ac910 con 0x7f145c0c1710 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1462634700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0ac330 con 0x7f145c0c1290 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34450/0 (socket says 172.21.15.52:34450) 2023-05-10T01:24:07.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 -- 172.21.15.52:0/1123874772 learned_addr learned my addr 172.21.15.52:0/1123874772 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145b7fe700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c0c1290 0x7f145c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1460bd1700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f145c0c1710 0x7f145c0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 -- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c0c1290 msgr2=0x7f145c0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c0c1290 0x7f145c0c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 -- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f145c0c1710 msgr2=0x7f145c0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f145c0c1710 0x7f145c0c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 -- 172.21.15.52:0/1123874772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0bf930 con 0x7f14480038e0 2023-05-10T01:24:07.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f145bfff700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f14480045d0 tx=0x7f1450015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.600+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500015c0 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.601+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450001720 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.601+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0bfc10 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.601+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450004770 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.601+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c0bec40 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c06c340 con 0x7f14480038e0 2023-05-10T01:24:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f1450010070 con 0x7f14480038e0 2023-05-10T01:24:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f1443fff700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 0x7f143c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6701+0+0 (secure 0 0 0) 0x7f145001c040 con 0x7f14480038e0 2023-05-10T01:24:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f145b7fe700 1 -- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 msgr2=0x7f143c0612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.602+0000 7f145b7fe700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 0x7f143c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.606+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f145004bc80 con 0x7f14480038e0 2023-05-10T01:24:07.615 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.611+0000 7f7ae85c5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:07.738 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.735+0000 7f7ae85c5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:07.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.784+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f145c067550 con 0x7f14480038e0 2023-05-10T01:24:07.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.785+0000 7f1443fff700 1 -- 172.21.15.52:0/1123874772 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17930 (secure 0 0 0) 0x7f145c067550 con 0x7f14480038e0 2023-05-10T01:24:07.789 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:07.789 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":67,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:06.730826+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:21:53.995565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-05-10T01:21:55.337178+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":67,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:6832/116173":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/1387591592":"2023-05-11T01:22:12.821275+0000","172.21.15.172:0/573741442":"2023-05-11T01:22:12.821275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:07.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 msgr2=0x7f143c0612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:07.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 0x7f143c0612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 msgr2=0x7f145c0ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f14480045d0 tx=0x7f1450015000).stop 2023-05-10T01:24:07.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 shutdown_connections 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f143c05ee20 0x7f143c0612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f145c0c1710 0x7f145c0c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14480038e0 0x7f145c0ab770 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 --2- 172.21.15.52:0/1123874772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f145c0c1290 0x7f145c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 >> 172.21.15.52:0/1123874772 conn(0x7f145c0c4420 msgr2=0x7f145c0a4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 shutdown_connections 2023-05-10T01:24:07.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.787+0000 7f1462634700 1 -- 172.21.15.52:0/1123874772 wait complete. 2023-05-10T01:24:07.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:24:07.826 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.822+0000 7f0144b8e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:07.854 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:07.850+0000 7f7ae85c5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:07.894 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:07.890+0000 7f0144b8e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.921+0000 7f0892667700 1 Processor -- start 2023-05-10T01:24:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.921+0000 7f0892667700 1 -- start start 2023-05-10T01:24:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f088c153ea0 0x7f088c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c068c60 0x7f088c066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f088c064ff0 0x7f088c0654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c065990 con 0x7f088c153ea0 2023-05-10T01:24:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0bc9a0 con 0x7f088c064ff0 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0892667700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0bcc80 con 0x7f088c068c60 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f088c153ea0 0x7f088c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f088c153ea0 0x7f088c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34458/0 (socket says 172.21.15.52:34458) 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088bfff700 1 -- 172.21.15.52:0/1761443077 learned_addr learned my addr 172.21.15.52:0/1761443077 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088b7fe700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c068c60 0x7f088c066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f0890c04700 1 --2- 172.21.15.52:0/1761443077 >> v2:172.21.15.172:3300/0 conn(0x7f088c064ff0 0x7f088c0654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088bfff700 1 -- 172.21.15.52:0/1761443077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c068c60 msgr2=0x7f088c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.922+0000 7f088bfff700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c068c60 0x7f088c066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088bfff700 1 -- 172.21.15.52:0/1761443077 >> v2:172.21.15.172:3300/0 conn(0x7f088c064ff0 msgr2=0x7f088c0654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088bfff700 1 --2- 172.21.15.52:0/1761443077 >> v2:172.21.15.172:3300/0 conn(0x7f088c064ff0 0x7f088c0654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088bfff700 1 -- 172.21.15.52:0/1761443077 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0bcf60 con 0x7f088c153ea0 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088bfff700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c153ea0 0x7f088c154280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f088c05f9d0 tx=0x7f087c0090f0).ready entity=mon.0 client_cookie=f028e5e5d97aeef7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088affd700 1 -- 172.21.15.52:0/1761443077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00b520 con 0x7f088c153ea0 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088affd700 1 -- 172.21.15.52:0/1761443077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c00b680 con 0x7f088c153ea0 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f088affd700 1 -- 172.21.15.52:0/1761443077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00ba00 con 0x7f088c153ea0 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 -- 172.21.15.52:0/1761443077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c153ea0 msgr2=0x7f088c154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c153ea0 0x7f088c154280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f088c05f9d0 tx=0x7f087c0090f0).stop 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 -- 172.21.15.52:0/1761443077 shutdown_connections 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 --2- 172.21.15.52:0/1761443077 >> v2:172.21.15.172:3300/0 conn(0x7f088c064ff0 0x7f088c0654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c153ea0 0x7f088c154280 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.923+0000 7f0892667700 1 --2- 172.21.15.52:0/1761443077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c068c60 0x7f088c066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.924+0000 7f0892667700 1 -- 172.21.15.52:0/1761443077 >> 172.21.15.52:0/1761443077 conn(0x7f088c0c4420 msgr2=0x7f088c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.924+0000 7f0892667700 1 -- 172.21.15.52:0/1761443077 shutdown_connections 2023-05-10T01:24:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.924+0000 7f0892667700 1 -- 172.21.15.52:0/1761443077 wait complete. 2023-05-10T01:24:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.925+0000 7f0892667700 1 Processor -- start 2023-05-10T01:24:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.925+0000 7f0892667700 1 -- start start 2023-05-10T01:24:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c064ff0 0x7f088c147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f088c153ea0 0x7f088c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0a9180 con 0x7f088c0c3100 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0a85b0 con 0x7f088c153ea0 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0892667700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0a8850 con 0x7f088c064ff0 2023-05-10T01:24:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34468/0 (socket says 172.21.15.52:34468) 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 -- 172.21.15.52:0/314222418 learned_addr learned my addr 172.21.15.52:0/314222418 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f088bfff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c064ff0 0x7f088c147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f088b7fe700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f088c153ea0 0x7f088c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c064ff0 msgr2=0x7f088c147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c064ff0 0x7f088c147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f088c153ea0 msgr2=0x7f088c0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:07.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f088c153ea0 0x7f088c0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 -- 172.21.15.52:0/314222418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009370 con 0x7f088c0c3100 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0890c04700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f0884009fa0 tx=0x7f0884009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.926+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400ebc0 con 0x7f088c0c3100 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.927+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400ed20 con 0x7f088c0c3100 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.927+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c0a8b30 con 0x7f088c0c3100 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.927+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884014610 con 0x7f088c0c3100 2023-05-10T01:24:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.927+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c1481b0 con 0x7f088c0c3100 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.928+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c0a9330 con 0x7f088c0c3100 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.928+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 21) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f088401b030 con 0x7f088c0c3100 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.929+0000 7f0883fff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.929+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6845+0+0 (secure 0 0 0) 0x7f088407a3a0 con 0x7f088c0c3100 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.929+0000 7f088bfff700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 msgr2=0x7f08700612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:07.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.929+0000 7f088bfff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:07.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:07.932+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f088404b670 con 0x7f088c0c3100 2023-05-10T01:24:08.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.130+0000 7f088bfff700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 msgr2=0x7f08700612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:08.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.130+0000 7f088bfff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:08.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.149+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f088c06c340 con 0x7f088c0c3100 2023-05-10T01:24:08.160 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:08.156+0000 7f7ae85c5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:08.232 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:08.229+0000 7f7ae85c5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:08.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.531+0000 7f088bfff700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 msgr2=0x7f08700612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:08.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.531+0000 7f088bfff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:24:08.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.743+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f0884012070 con 0x7f088c0c3100 2023-05-10T01:24:08.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.744+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 msgr2=0x7f08700612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:08.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.744+0000 7f0883fff700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:08.804 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c4b73700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c4b73700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c4b73700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c7b79700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c4b73700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c4b73700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c7b79700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c7b79700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c7b79700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:08.800+0000 7f00c7b79700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:08.807 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:08.807 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:08.808 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:24:08.822 INFO:tasks.ceph.mds.d.smithi172.stderr: -5> 2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:08.822 INFO:tasks.ceph.mds.d.smithi172.stderr: -4> 2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:08.823 INFO:tasks.ceph.mds.d.smithi172.stderr: -2> 2023-05-10T01:24:08.804+0000 7fb65dcaa700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:24:08.843 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:24:08.909 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:24:08.906+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:24:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.908+0000 7f0883fff700 1 -- 172.21.15.52:0/314222418 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0884076720 con 0x7f088c0c3100 2023-05-10T01:24:08.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 msgr2=0x7f088c0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:08.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f0884009fa0 tx=0x7f0884009900).stop 2023-05-10T01:24:08.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 shutdown_connections 2023-05-10T01:24:08.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f087005ee20 0x7f08700612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:08.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f088c0c3100 0x7f088c0a9610 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f088c064ff0 0x7f088c147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 --2- 172.21.15.52:0/314222418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f088c153ea0 0x7f088c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 >> 172.21.15.52:0/314222418 conn(0x7f088c0c4420 msgr2=0x7f088c0ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 shutdown_connections 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:08.910+0000 7f0892667700 1 -- 172.21.15.52:0/314222418 wait complete. 2023-05-10T01:24:08.915 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:24:08.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:24:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.045+0000 7fd69b395700 1 Processor -- start 2023-05-10T01:24:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.045+0000 7fd69b395700 1 -- start start 2023-05-10T01:24:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd69b395700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6940c6100 0x7fd6941541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:09.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd69b395700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940ca5f0 con 0x7fd6940aa200 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd69b395700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940c8820 con 0x7fd6940c5d20 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd69b395700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940c6550 con 0x7fd6940c6100 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd698930700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd6940aa200 0x7fd694153a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43498/0 (socket says 172.21.15.52:43498) 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd698930700 1 -- 172.21.15.52:0/1839917563 learned_addr learned my addr 172.21.15.52:0/1839917563 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd699932700 1 --2- 172.21.15.52:0/1839917563 >> v2:172.21.15.172:3300/0 conn(0x7fd6940c6100 0x7fd6941541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048591684 0 0) 0x7fd6940ca5f0 con 0x7fd6940aa200 2023-05-10T01:24:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd67c0033f0 con 0x7fd6940aa200 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd699932700 1 -- 172.21.15.52:0/1839917563 >> v1:172.21.15.172:6789/0 conn(0x7fd6940c5d20 legacy=0x7fd694069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd699932700 1 -- 172.21.15.52:0/1839917563 >> v1:172.21.15.52:6789/0 conn(0x7fd6940aa200 legacy=0x7fd694153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872121832 0 0) 0x7fd6940c8820 con 0x7fd6940c5d20 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.046+0000 7fd699932700 1 -- 172.21.15.52:0/1839917563 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940c8b00 con 0x7fd6940c6100 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd699932700 1 --2- 172.21.15.52:0/1839917563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940c6100 0x7fd6941541a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fd68c009e60 tx=0x7fd68c009780).ready entity=mon.1 client_cookie=c47eeda6404ffe07 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00e070 con 0x7fd6940c6100 2023-05-10T01:24:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00bb60 con 0x7fd6940c6100 2023-05-10T01:24:09.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd683fff700 1 -- 172.21.15.52:0/1839917563 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00bee0 con 0x7fd6940c6100 2023-05-10T01:24:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 -- 172.21.15.52:0/1839917563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940c6100 msgr2=0x7fd6941541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 --2- 172.21.15.52:0/1839917563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940c6100 0x7fd6941541a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fd68c009e60 tx=0x7fd68c009780).stop 2023-05-10T01:24:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 -- 172.21.15.52:0/1839917563 shutdown_connections 2023-05-10T01:24:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 --2- 172.21.15.52:0/1839917563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940c6100 0x7fd6941541a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 -- 172.21.15.52:0/1839917563 >> 172.21.15.52:0/1839917563 conn(0x7fd6940cb6f0 msgr2=0x7fd6940c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 -- 172.21.15.52:0/1839917563 shutdown_connections 2023-05-10T01:24:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.047+0000 7fd69b395700 1 -- 172.21.15.52:0/1839917563 wait complete. 2023-05-10T01:24:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.048+0000 7fd69b395700 1 Processor -- start 2023-05-10T01:24:09.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.048+0000 7fd69b395700 1 -- start start 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940aa200 0x7fd6941650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6940c5d20 0x7fd69414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941655e0 con 0x7fd6940c6100 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694158670 con 0x7fd6940aa200 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd69b395700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c27f0 con 0x7fd6940c5d20 2023-05-10T01:24:09.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd699932700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd699932700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34490/0 (socket says 172.21.15.52:34490) 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.049+0000 7fd699932700 1 -- 172.21.15.52:0/3377720306 learned_addr learned my addr 172.21.15.52:0/3377720306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699131700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940aa200 0x7fd6941650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd698930700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6940c5d20 0x7fd69414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 -- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6940c5d20 msgr2=0x7fd69414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6940c5d20 0x7fd69414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 -- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940aa200 msgr2=0x7fd6941650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940aa200 0x7fd6941650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 -- 172.21.15.52:0/3377720306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c009a20 con 0x7fd6940c6100 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd699932700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fd68c00b6c0 tx=0x7fd68c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c01d630 con 0x7fd6940c6100 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c01d790 con 0x7fd6940c6100 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940c2ad0 con 0x7fd6940c6100 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c01db10 con 0x7fd6940c6100 2023-05-10T01:24:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.050+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd694164bd0 con 0x7fd6940c6100 2023-05-10T01:24:09.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.051+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940b0c70 con 0x7fd6940c6100 2023-05-10T01:24:09.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.052+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 22) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fd68c030430 con 0x7fd6940c6100 2023-05-10T01:24:09.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.052+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6931+0+0 (secure 0 0 0) 0x7fd68c07c670 con 0x7fd6940c6100 2023-05-10T01:24:09.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.056+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd68c04d900 con 0x7fd6940c6100 2023-05-10T01:24:09.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.275+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd694066720 con 0x7fd6940c6100 2023-05-10T01:24:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.747+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fd68c07a2c0 con 0x7fd6940c6100 2023-05-10T01:24:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.747+0000 7fd6817fa700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 0x7fd674067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:09.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.750+0000 7fd699131700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 0x7fd674067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.753+0000 7fd699131700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 0x7fd674067ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd690007fd0 tx=0x7fd690007bb0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.909+0000 7fd6817fa700 1 -- 172.21.15.52:0/3377720306 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd68c044e80 con 0x7fd6940c6100 2023-05-10T01:24:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 msgr2=0x7fd674067ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 0x7fd674067ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd690007fd0 tx=0x7fd690007bb0).stop 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 msgr2=0x7fd6940c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fd68c00b6c0 tx=0x7fd68c009780).stop 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 shutdown_connections 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd6740301b0 0x7fd674067ae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6940c6100 0x7fd6940c1cc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6940aa200 0x7fd6941650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 --2- 172.21.15.52:0/3377720306 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6940c5d20 0x7fd69414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 >> 172.21.15.52:0/3377720306 conn(0x7fd6940cb6f0 msgr2=0x7fd6940acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 shutdown_connections 2023-05-10T01:24:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:09.912+0000 7fd69b395700 1 -- 172.21.15.52:0/3377720306 wait complete. 2023-05-10T01:24:09.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:24:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.052+0000 7f5d46bce700 1 Processor -- start 2023-05-10T01:24:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.052+0000 7f5d46bce700 1 -- start start 2023-05-10T01:24:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d46bce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d401501b0 0x7f5d40064d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d46bce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400686f0 0x7f5d400c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d46bce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400c2280 con 0x7f5d40150590 2023-05-10T01:24:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d46bce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d40065580 con 0x7f5d401501b0 2023-05-10T01:24:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d46bce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400c1950 con 0x7f5d400686f0 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d401501b0 0x7f5d40064d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d401501b0 0x7f5d40064d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34510/0 (socket says 172.21.15.52:34510) 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 -- 172.21.15.52:0/3223463576 learned_addr learned my addr 172.21.15.52:0/3223463576 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d463cd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d40150590 0x7f5d400c2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43526/0 (socket says 172.21.15.52:43526) 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d453cb700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400686f0 0x7f5d400c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 -- 172.21.15.52:0/3223463576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400686f0 msgr2=0x7f5d400c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400686f0 0x7f5d400c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 -- 172.21.15.52:0/3223463576 >> v1:172.21.15.52:6789/0 conn(0x7f5d40150590 legacy=0x7f5d400c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.053+0000 7f5d45bcc700 1 -- 172.21.15.52:0/3223463576 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400c1c30 con 0x7f5d401501b0 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d401501b0 0x7f5d40064d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f5d3800c0d0 tx=0x7f5d3800a950).ready entity=mon.0 client_cookie=fa09a25134dc72ac server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d44bca700 1 -- 172.21.15.52:0/3223463576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800f070 con 0x7f5d401501b0 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d44bca700 1 -- 172.21.15.52:0/3223463576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800cdf0 con 0x7f5d401501b0 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d44bca700 1 -- 172.21.15.52:0/3223463576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800a2e0 con 0x7f5d401501b0 2023-05-10T01:24:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 -- 172.21.15.52:0/3223463576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d401501b0 msgr2=0x7f5d40064d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d401501b0 0x7f5d40064d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f5d3800c0d0 tx=0x7f5d3800a950).stop 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 -- 172.21.15.52:0/3223463576 shutdown_connections 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d401501b0 0x7f5d40064d30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 --2- 172.21.15.52:0/3223463576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400686f0 0x7f5d400c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 -- 172.21.15.52:0/3223463576 >> 172.21.15.52:0/3223463576 conn(0x7f5d40067910 msgr2=0x7f5d400c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 -- 172.21.15.52:0/3223463576 shutdown_connections 2023-05-10T01:24:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.054+0000 7f5d46bce700 1 -- 172.21.15.52:0/3223463576 wait complete. 2023-05-10T01:24:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.055+0000 7f5d46bce700 1 Processor -- start 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 -- start start 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 0x7f5d4014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 0x7f5d40154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4014d280 con 0x7f5d400beab0 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400be780 con 0x7f5d400686f0 2023-05-10T01:24:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d46bce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400bf420 con 0x7f5d40150590 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d463cd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d463cd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34518/0 (socket says 172.21.15.52:34518) 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.056+0000 7f5d463cd700 1 -- 172.21.15.52:0/188266806 learned_addr learned my addr 172.21.15.52:0/188266806 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d453cb700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 0x7f5d40154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 0x7f5d4014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 -- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 msgr2=0x7f5d40154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 0x7f5d40154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 -- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 msgr2=0x7f5d4014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 0x7f5d4014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 -- 172.21.15.52:0/188266806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3800abf0 con 0x7f5d400beab0 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 0x7f5d4014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d453cb700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 0x7f5d40154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d463cd700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f5d3000c440 tx=0x7f5d30007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300072e0 con 0x7f5d400beab0 2023-05-10T01:24:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30007440 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300058f0 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d400bdb70 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.057+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d400be130 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.058+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40047150 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.058+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 23) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5d30010070 con 0x7f5d400beab0 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.059+0000 7f5d3dffb700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 0x7f5d200611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.059+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6931+0+0 (secure 0 0 0) 0x7f5d300792c0 con 0x7f5d400beab0 2023-05-10T01:24:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.059+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 0x7f5d200611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.059+0000 7f5d45bcc700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 0x7f5d200611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5d4005ede0 tx=0x7f5d3800a950).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.063+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d3004a5d0 con 0x7f5d400beab0 2023-05-10T01:24:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.235+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d400c1f10 con 0x7f5d400beab0 2023-05-10T01:24:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.911+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5d3004dbf0 con 0x7f5d400beab0 2023-05-10T01:24:10.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.919+0000 7f5d3dffb700 1 -- 172.21.15.52:0/188266806 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5d30005ce0 con 0x7f5d400beab0 2023-05-10T01:24:10.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.920+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 msgr2=0x7f5d200611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.920+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 0x7f5d200611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5d4005ede0 tx=0x7f5d3800a950).stop 2023-05-10T01:24:10.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.920+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 msgr2=0x7f5d400bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:10.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.920+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f5d3000c440 tx=0x7f5d30007dd0).stop 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 shutdown_connections 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5d2005ecf0 0x7f5d200611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d400beab0 0x7f5d400bef30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400686f0 0x7f5d4014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 --2- 172.21.15.52:0/188266806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d40150590 0x7f5d40154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:10.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 >> 172.21.15.52:0/188266806 conn(0x7f5d40067910 msgr2=0x7f5d400c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:10.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.921+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 shutdown_connections 2023-05-10T01:24:10.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:10.923+0000 7f5d46bce700 1 -- 172.21.15.52:0/188266806 wait complete. 2023-05-10T01:24:10.927 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:24:10.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:24:11.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.063+0000 7f14434e7700 1 Processor -- start 2023-05-10T01:24:11.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.063+0000 7f14434e7700 1 -- start start 2023-05-10T01:24:11.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f14434e7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 0x7f143c06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f14434e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 0x7f143c063d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f14434e7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c0c3120 con 0x7f143c14ff30 2023-05-10T01:24:11.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f14434e7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c154b40 con 0x7f143c154300 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f14434e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c150a70 con 0x7f143c1546e0 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f1441283700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 0x7f143c06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f1441a84700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f143c14ff30 0x7f143c150360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:46082/0 (socket says 172.21.15.52:46082) 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f1441a84700 1 -- 172.21.15.52:0/1162278872 learned_addr learned my addr 172.21.15.52:0/1162278872 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.064+0000 7f1440a82700 1 --2- 172.21.15.52:0/1162278872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 0x7f143c063d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1440a82700 1 -- 172.21.15.52:0/1162278872 >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 msgr2=0x7f143c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:11.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1440a82700 1 --2- 172.21.15.52:0/1162278872 >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 0x7f143c06a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1440a82700 1 -- 172.21.15.52:0/1162278872 >> v1:172.21.15.172:6789/0 conn(0x7f143c14ff30 legacy=0x7f143c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1440a82700 1 -- 172.21.15.52:0/1162278872 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c068530 con 0x7f143c1546e0 2023-05-10T01:24:11.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1441283700 1 --2- 172.21.15.52:0/1162278872 >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 0x7f143c06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:11.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f1440a82700 1 --2- 172.21.15.52:0/1162278872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 0x7f143c063d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1430009760 tx=0x7f1430009060).ready entity=mon.2 client_cookie=62949ece0c3afee9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:11.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f143bfff700 1 -- 172.21.15.52:0/1162278872 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000f510 con 0x7f143c1546e0 2023-05-10T01:24:11.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f143bfff700 1 -- 172.21.15.52:0/1162278872 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000f670 con 0x7f143c1546e0 2023-05-10T01:24:11.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f143bfff700 1 -- 172.21.15.52:0/1162278872 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000f9f0 con 0x7f143c1546e0 2023-05-10T01:24:11.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 -- 172.21.15.52:0/1162278872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 msgr2=0x7f143c063d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 --2- 172.21.15.52:0/1162278872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 0x7f143c063d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1430009760 tx=0x7f1430009060).stop 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 -- 172.21.15.52:0/1162278872 shutdown_connections 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 --2- 172.21.15.52:0/1162278872 >> v2:172.21.15.172:3300/0 conn(0x7f143c154300 0x7f143c06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 --2- 172.21.15.52:0/1162278872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c1546e0 0x7f143c063d40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.065+0000 7f14434e7700 1 -- 172.21.15.52:0/1162278872 >> 172.21.15.52:0/1162278872 conn(0x7f143c0c3d80 msgr2=0x7f143c0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.066+0000 7f14434e7700 1 -- 172.21.15.52:0/1162278872 shutdown_connections 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.066+0000 7f14434e7700 1 -- 172.21.15.52:0/1162278872 wait complete. 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.067+0000 7f14434e7700 1 Processor -- start 2023-05-10T01:24:11.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.067+0000 7f14434e7700 1 -- start start 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.067+0000 7f14434e7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.067+0000 7f14434e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f143c154300 0x7f143c0a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c151340 con 0x7f143c1546e0 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c147b80 con 0x7f143c154300 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c1478a0 con 0x7f143c14ff30 2023-05-10T01:24:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441a84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:54166/0 (socket says 172.21.15.52:54166) 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 -- 172.21.15.52:0/52415460 learned_addr learned my addr 172.21.15.52:0/52415460 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441a84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34534/0 (socket says 172.21.15.52:34534) 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1440a82700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f143c154300 0x7f143c0a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 -- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f143c154300 msgr2=0x7f143c0a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f143c154300 0x7f143c0a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 -- 172.21.15.52:0/52415460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 msgr2=0x7f143c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 -- 172.21.15.52:0/52415460 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340092a0 con 0x7f143c14ff30 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441a84700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f1441283700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f143400ea50 tx=0x7f1434009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400ee90 con 0x7f143c14ff30 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143400c850 con 0x7f143c14ff30 2023-05-10T01:24:11.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400cbd0 con 0x7f143c14ff30 2023-05-10T01:24:11.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14300092a0 con 0x7f143c14ff30 2023-05-10T01:24:11.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.068+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c150fd0 con 0x7f143c14ff30 2023-05-10T01:24:11.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.069+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c06c340 con 0x7f143c14ff30 2023-05-10T01:24:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.070+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1434022070 con 0x7f143c14ff30 2023-05-10T01:24:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.070+0000 7f14397fa700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 0x7f141c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.070+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f143407a050 con 0x7f143c14ff30 2023-05-10T01:24:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.070+0000 7f1440a82700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 0x7f141c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.071+0000 7f1440a82700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 0x7f141c061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1430009fd0 tx=0x7f1430017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.075+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f143404b4b0 con 0x7f143c14ff30 2023-05-10T01:24:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.252+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f143c151620 con 0x7f143c14ff30 2023-05-10T01:24:11.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.924+0000 7f14397fa700 1 -- 172.21.15.52:0/52415460 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7f143404ead0 con 0x7f143c14ff30 2023-05-10T01:24:11.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 msgr2=0x7f141c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 0x7f141c061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1430009fd0 tx=0x7f1430017000).stop 2023-05-10T01:24:11.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 msgr2=0x7f143c0a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:11.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f143400ea50 tx=0x7f1434009060).stop 2023-05-10T01:24:11.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 shutdown_connections 2023-05-10T01:24:11.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f141c05ed90 0x7f141c061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f143c1546e0 0x7f143c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f143c14ff30 0x7f143c0a78d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 --2- 172.21.15.52:0/52415460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f143c154300 0x7f143c0a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:11.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.928+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 >> 172.21.15.52:0/52415460 conn(0x7f143c0c3d80 msgr2=0x7f143c0bbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:11.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.929+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 shutdown_connections 2023-05-10T01:24:11.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:11.929+0000 7f14434e7700 1 -- 172.21.15.52:0/52415460 wait complete. 2023-05-10T01:24:11.936 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:24:11.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:24:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.080+0000 7fe411c23700 1 Processor -- start 2023-05-10T01:24:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.080+0000 7fe411c23700 1 -- start start 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe411c23700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe40c154080 0x7fe40c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe411c23700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe40c068150 0x7fe40c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe411c23700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c0c94c0 con 0x7fe40c154460 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe411c23700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c0cb7d0 con 0x7fe40c068150 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe411c23700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c068a90 con 0x7fe40c154080 2023-05-10T01:24:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe40c068150 0x7fe40c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe40c068150 0x7fe40c0685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34542/0 (socket says 172.21.15.52:34542) 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 -- 172.21.15.52:0/3500650554 learned_addr learned my addr 172.21.15.52:0/3500650554 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40b7fe700 1 --2- 172.21.15.52:0/3500650554 >> v2:172.21.15.172:3300/0 conn(0x7fe40c154080 0x7fe40c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 -- 172.21.15.52:0/3500650554 >> v2:172.21.15.172:3300/0 conn(0x7fe40c154080 msgr2=0x7fe40c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 --2- 172.21.15.52:0/3500650554 >> v2:172.21.15.172:3300/0 conn(0x7fe40c154080 0x7fe40c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.081+0000 7fe40bfff700 1 -- 172.21.15.52:0/3500650554 >> v1:172.21.15.172:6789/0 conn(0x7fe40c154460 legacy=0x7fe40c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe40bfff700 1 -- 172.21.15.52:0/3500650554 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0c88b0 con 0x7fe40c068150 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe40bfff700 1 --2- 172.21.15.52:0/3500650554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c0685a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fe40c06bd00 tx=0x7fe404009840).ready entity=mon.0 client_cookie=a7426437527bd5a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe40a7fc700 1 -- 172.21.15.52:0/3500650554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400e070 con 0x7fe40c068150 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe40a7fc700 1 -- 172.21.15.52:0/3500650554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40400ba50 con 0x7fe40c068150 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe40a7fc700 1 -- 172.21.15.52:0/3500650554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400bdd0 con 0x7fe40c068150 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 -- 172.21.15.52:0/3500650554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 msgr2=0x7fe40c0685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 --2- 172.21.15.52:0/3500650554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c0685a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fe40c06bd00 tx=0x7fe404009840).stop 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 -- 172.21.15.52:0/3500650554 shutdown_connections 2023-05-10T01:24:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 --2- 172.21.15.52:0/3500650554 >> v2:172.21.15.172:3300/0 conn(0x7fe40c154080 0x7fe40c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 --2- 172.21.15.52:0/3500650554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c0685a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 -- 172.21.15.52:0/3500650554 >> 172.21.15.52:0/3500650554 conn(0x7fe40c067910 msgr2=0x7fe40c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 -- 172.21.15.52:0/3500650554 shutdown_connections 2023-05-10T01:24:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.082+0000 7fe411c23700 1 -- 172.21.15.52:0/3500650554 wait complete. 2023-05-10T01:24:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 Processor -- start 2023-05-10T01:24:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 -- start start 2023-05-10T01:24:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe40c154080 0x7fe40c13c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 0x7fe40c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c13c030 con 0x7fe40c068150 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c14ff30 con 0x7fe40c154460 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe411c23700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c156340 con 0x7fe40c154080 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe40b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe40b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34544/0 (socket says 172.21.15.52:34544) 2023-05-10T01:24:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.084+0000 7fe40b7fe700 1 -- 172.21.15.52:0/3704345466 learned_addr learned my addr 172.21.15.52:0/3704345466 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40bfff700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 0x7fe40c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 -- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe40c154080 msgr2=0x7fe40c13c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40affd700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe40c154080 0x7fe40c13c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe40c154080 0x7fe40c13c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 -- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 msgr2=0x7fe40c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 0x7fe40c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 -- 172.21.15.52:0/3704345466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404009ae0 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40bfff700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 0x7fe40c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe40b7fe700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fe3fc00d890 tx=0x7fe3fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0125f0 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc012750 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c155730 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc012ad0 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.085+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c155cf0 con 0x7fe40c068150 2023-05-10T01:24:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.086+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c1539a0 con 0x7fe40c068150 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.086+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3fc013480 con 0x7fe40c068150 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.087+0000 7fe3f37fe700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 0x7fe3ec061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.087+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe3fc079920 con 0x7fe40c068150 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.087+0000 7fe40affd700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 0x7fe3ec061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.087+0000 7fe40affd700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 0x7fe3ec061280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe40c0b0ce0 tx=0x7fe400009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.091+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3fc04af00 con 0x7fe40c068150 2023-05-10T01:24:12.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.264+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe40c066720 con 0x7fe40c068150 2023-05-10T01:24:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.267+0000 7fe3f37fe700 1 -- 172.21.15.52:0/3704345466 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v8) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe3fc04e520 con 0x7fe40c068150 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 msgr2=0x7fe3ec061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 0x7fe3ec061280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe40c0b0ce0 tx=0x7fe400009040).stop 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 msgr2=0x7fe40c14fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fe3fc00d890 tx=0x7fe3fc008040).stop 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 shutdown_connections 2023-05-10T01:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3ec05edc0 0x7fe3ec061280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe40c154460 0x7fe40c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe40c068150 0x7fe40c14fa40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 --2- 172.21.15.52:0/3704345466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe40c154080 0x7fe40c13c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 >> 172.21.15.52:0/3704345466 conn(0x7fe40c067910 msgr2=0x7fe40c0ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 shutdown_connections 2023-05-10T01:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.269+0000 7fe411c23700 1 -- 172.21.15.52:0/3704345466 wait complete. 2023-05-10T01:24:12.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:24:12.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.401+0000 7f7fada45700 1 Processor -- start 2023-05-10T01:24:12.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.401+0000 7f7fada45700 1 -- start start 2023-05-10T01:24:12.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fada45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7fa80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fada45700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80c94c0 con 0x7f7fa8154460 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fada45700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80cb7d0 con 0x7f7fa8068150 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fada45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c88b0 con 0x7f7fa8154080 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa67fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7fa8154460 0x7f7fa80a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43568/0 (socket says 172.21.15.52:43568) 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa67fc700 1 -- 172.21.15.52:0/1607277400 learned_addr learned my addr 172.21.15.52:0/1607277400 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:12.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa6ffd700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7fa80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602279247 0 0) 0x7f7fa80c94c0 con 0x7f7fa8154460 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f880033f0 con 0x7f7fa8154460 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2548924839 0 0) 0x7f7f880033f0 con 0x7f7fa8154460 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 msgr2=0x7f7fa80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7fa80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 >> v1:172.21.15.172:6789/0 conn(0x7f7fa8068150 legacy=0x7f7fa8068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80c8b90 con 0x7f7fa8154460 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7f900017f0 con 0x7f7fa8154460 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 >> v1:172.21.15.52:6789/0 conn(0x7f7fa8154460 legacy=0x7f7fa80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7f88003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88003e00 0x7f7f88004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88004b80 0x7f7f88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c88b0 con 0x7f7f88003e00 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8800b8e0 con 0x7f7f88004b80 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.402+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8800baa0 con 0x7f7fa8154080 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88003e00 0x7f7f88004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa6ffd700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7f88003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa77fe700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88004b80 0x7f7f88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 -- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 msgr2=0x7f7f88003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa8154080 0x7f7f88003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 -- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88004b80 msgr2=0x7f7f88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88004b80 0x7f7f88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 -- 172.21.15.52:0/1607277400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880033f0 con 0x7f7f88003e00 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa67fc700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88003e00 0x7f7f88004690 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f7fa8067e20 tx=0x7f7f90001d90).ready entity=mon.0 client_cookie=61a7fd6031390a2a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000cd70 con 0x7f7f88003e00 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90005b20 con 0x7f7f88003e00 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.403+0000 7f7fa5ffb700 1 -- 172.21.15.52:0/1607277400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900070d0 con 0x7f7f88003e00 2023-05-10T01:24:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 -- 172.21.15.52:0/1607277400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88003e00 msgr2=0x7f7f88004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 --2- 172.21.15.52:0/1607277400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88003e00 0x7f7f88004690 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f7fa8067e20 tx=0x7f7f90001d90).stop 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fa77fe700 1 -- 172.21.15.52:0/1607277400 reap_dead start 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 -- 172.21.15.52:0/1607277400 shutdown_connections 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 -- 172.21.15.52:0/1607277400 >> 172.21.15.52:0/1607277400 conn(0x7f7fa8067910 msgr2=0x7f7fa80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 -- 172.21.15.52:0/1607277400 shutdown_connections 2023-05-10T01:24:12.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.404+0000 7f7fada45700 1 -- 172.21.15.52:0/1607277400 wait complete. 2023-05-10T01:24:12.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.405+0000 7f7fada45700 1 Processor -- start 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.405+0000 7f7fada45700 1 -- start start 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88003e00 0x7f7fa813d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa80c0400 0x7f7fa80c0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80afc40 con 0x7f7fa8164820 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8155430 con 0x7f7f88003e00 2023-05-10T01:24:12.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa813d880 con 0x7f7fa80c0400 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34568/0 (socket says 172.21.15.52:34568) 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 -- 172.21.15.52:0/2518106371 learned_addr learned my addr 172.21.15.52:0/2518106371 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa67fc700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa80c0400 0x7f7fa80c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa6ffd700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88003e00 0x7f7fa813d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 -- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa80c0400 msgr2=0x7f7fa80c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa80c0400 0x7f7fa80c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 -- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88003e00 msgr2=0x7f7fa813d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88003e00 0x7f7fa813d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 -- 172.21.15.52:0/2518106371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80c0d70 con 0x7f7fa8164820 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fa77fe700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f7fa80cbc90 tx=0x7f7f98007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011590 con 0x7f7fa8164820 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f980116f0 con 0x7f7fa8164820 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa8154840 con 0x7f7fa8164820 2023-05-10T01:24:12.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011a70 con 0x7f7fa8164820 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.406+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa8154b00 con 0x7f7fa8164820 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.407+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8066720 con 0x7f7fa8164820 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.408+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7f9801a030 con 0x7f7fa8164820 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.408+0000 7f7f9effd700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 0x7f7f8c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.408+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7f980791a0 con 0x7f7fa8164820 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.408+0000 7f7fa6ffd700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 0x7f7f8c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.409+0000 7f7fa6ffd700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 0x7f7f8c061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7fa0006d80 tx=0x7f7fa0009060).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.412+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f980498f0 con 0x7f7fa8164820 2023-05-10T01:24:12.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.587+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7fa806bd30 con 0x7f7fa8164820 2023-05-10T01:24:12.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.591+0000 7f7f9effd700 1 -- 172.21.15.52:0/2518106371 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f9804a890 con 0x7f7fa8164820 2023-05-10T01:24:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 msgr2=0x7f7f8c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 0x7f7f8c061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7fa0006d80 tx=0x7f7fa0009060).stop 2023-05-10T01:24:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 msgr2=0x7f7fa8164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f7fa80cbc90 tx=0x7f7f98007b90).stop 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 shutdown_connections 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7f8c05ed60 0x7f7f8c061220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8164820 0x7f7fa8164ca0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f88003e00 0x7f7fa813d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 --2- 172.21.15.52:0/2518106371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa80c0400 0x7f7fa80c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 >> 172.21.15.52:0/2518106371 conn(0x7f7fa8067910 msgr2=0x7f7fa80c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 shutdown_connections 2023-05-10T01:24:12.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.593+0000 7f7fada45700 1 -- 172.21.15.52:0/2518106371 wait complete. 2023-05-10T01:24:12.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-05-10T01:24:12.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.721+0000 7f9131269700 1 Processor -- start 2023-05-10T01:24:12.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.721+0000 7f9131269700 1 -- start start 2023-05-10T01:24:12.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9131269700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f912c154540 0x7f912c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9131269700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c0c0650 con 0x7f912c069b80 2023-05-10T01:24:12.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9131269700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c069fb0 con 0x7f912c154160 2023-05-10T01:24:12.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9131269700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0bfd20 con 0x7f912c154540 2023-05-10T01:24:12.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f912b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f912c069b80 0x7f912c0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43592/0 (socket says 172.21.15.52:43592) 2023-05-10T01:24:12.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f912b7fe700 1 -- 172.21.15.52:0/4073508693 learned_addr learned my addr 172.21.15.52:0/4073508693 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f912a7fc700 1 --2- 172.21.15.52:0/4073508693 >> v2:172.21.15.172:3300/0 conn(0x7f912c154540 0x7f912c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782505870 0 0) 0x7f912c0c0650 con 0x7f912c069b80 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f910c0033f0 con 0x7f912c069b80 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23930496 0 0) 0x7f912c069fb0 con 0x7f912c154160 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c0c0650 con 0x7f912c154160 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4290859613 0 0) 0x7f910c0033f0 con 0x7f912c069b80 2023-05-10T01:24:12.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 >> v2:172.21.15.172:3300/0 conn(0x7f912c154540 msgr2=0x7f912c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 --2- 172.21.15.52:0/4073508693 >> v2:172.21.15.172:3300/0 conn(0x7f912c154540 0x7f912c069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 >> v1:172.21.15.172:6789/0 conn(0x7f912c154160 legacy=0x7f912c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0c0000 con 0x7f912c069b80 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f911c0017f0 con 0x7f912c069b80 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f912a7fc700 1 --2- 172.21.15.52:0/4073508693 >> v2:172.21.15.172:3300/0 conn(0x7f912c154540 0x7f912c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.722+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 >> v1:172.21.15.52:6789/0 conn(0x7f912c069b80 legacy=0x7f912c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f910c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910c004690 0x7f910c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f910c005000 0x7f910c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0bfd20 con 0x7f910c003a70 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00bf60 con 0x7f910c004690 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00c0d0 con 0x7f910c005000 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f910c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912a7fc700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910c004690 0x7f910c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912b7fe700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f910c005000 0x7f910c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 -- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f910c005000 msgr2=0x7f910c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f910c005000 0x7f910c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 -- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910c004690 msgr2=0x7f910c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910c004690 0x7f910c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 -- 172.21.15.52:0/4073508693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0033f0 con 0x7f910c003a70 2023-05-10T01:24:12.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912b7fe700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f910c005000 0x7f910c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912b7fe700 1 -- 172.21.15.52:0/4073508693 reap_dead start 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f912affd700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f910c003e70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f9124001890 tx=0x7f9124007bb0).ready entity=mon.0 client_cookie=d2a5c2bbb693e6e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007020 con 0x7f910c003a70 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124007180 con 0x7f910c003a70 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.723+0000 7f9129ffb700 1 -- 172.21.15.52:0/4073508693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007500 con 0x7f910c003a70 2023-05-10T01:24:12.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 -- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 msgr2=0x7f910c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f910c003e70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f9124001890 tx=0x7f9124007bb0).stop 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 -- 172.21.15.52:0/4073508693 shutdown_connections 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 --2- 172.21.15.52:0/4073508693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f910c003e70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 -- 172.21.15.52:0/4073508693 >> 172.21.15.52:0/4073508693 conn(0x7f912c0cb740 msgr2=0x7f912c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 -- 172.21.15.52:0/4073508693 shutdown_connections 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.724+0000 7f9131269700 1 -- 172.21.15.52:0/4073508693 wait complete. 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.725+0000 7f9131269700 1 Processor -- start 2023-05-10T01:24:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.725+0000 7f9131269700 1 -- start start 2023-05-10T01:24:12.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f912c169910 0x7f912c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 0x7f912c062350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0650c0 con 0x7f910c003a70 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0ab730 con 0x7f912c0ab2b0 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f9131269700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c064250 con 0x7f912c169910 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34584/0 (socket says 172.21.15.52:34584) 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 -- 172.21.15.52:0/272462312 learned_addr learned my addr 172.21.15.52:0/272462312 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912b7fe700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 0x7f912c062350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912a7fc700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f912c169910 0x7f912c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 -- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f912c169910 msgr2=0x7f912c0aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f912c169910 0x7f912c0aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 -- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 msgr2=0x7f912c062350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 0x7f912c062350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 -- 172.21.15.52:0/272462312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c144f30 con 0x7f910c003a70 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912b7fe700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 0x7f912c062350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:12.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.726+0000 7f912affd700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f9124006f60 tx=0x7f9124015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124018030 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124013670 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c0644d0 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124013a30 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c064a70 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.727+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c0666b0 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.728+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f912401d070 con 0x7f910c003a70 2023-05-10T01:24:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.728+0000 7f9122ffd700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 0x7f9110061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:12.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.728+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9124079eb0 con 0x7f910c003a70 2023-05-10T01:24:12.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.728+0000 7f912a7fc700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 0x7f9110061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:12.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.729+0000 7f912a7fc700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 0x7f9110061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f912c0c4930 tx=0x7f9114009060).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:12.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.732+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f912404b4f0 con 0x7f910c003a70 2023-05-10T01:24:12.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:12.973+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f912c06c340 con 0x7f910c003a70 2023-05-10T01:24:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.920+0000 7f9122ffd700 1 -- 172.21.15.52:0/272462312 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v514) v1 ==== 154+0+0 (secure 0 0 0) 0x7f9124024070 con 0x7f910c003a70 2023-05-10T01:24:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 msgr2=0x7f9110061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 0x7f9110061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f912c0c4930 tx=0x7f9114009060).stop 2023-05-10T01:24:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 msgr2=0x7f912c144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f9124006f60 tx=0x7f9124015000).stop 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 shutdown_connections 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f911005ed60 0x7f9110061220 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f912c0ab2b0 0x7f912c062350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f910c003a70 0x7f912c144a40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 --2- 172.21.15.52:0/272462312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f912c169910 0x7f912c0aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.922+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 >> 172.21.15.52:0/272462312 conn(0x7f912c0cb740 msgr2=0x7f912c0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:13.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.923+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 shutdown_connections 2023-05-10T01:24:13.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:13.923+0000 7f9131269700 1 -- 172.21.15.52:0/272462312 wait complete. 2023-05-10T01:24:13.940 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-05-10T01:24:13.941 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-05-10T01:24:13.941 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:24:13.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-05-10T01:24:14.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.061+0000 7f0b3fc73700 1 Processor -- start 2023-05-10T01:24:14.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.061+0000 7f0b3fc73700 1 -- start start 2023-05-10T01:24:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3fc73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154160 0x7f0b380c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3fc73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b38154540 0x7f0b380c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3fc73700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380c0650 con 0x7f0b38069690 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3fc73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380c1af0 con 0x7f0b38154540 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3fc73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380bfd20 con 0x7f0b38154160 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b38154540 0x7f0b380c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b38154540 0x7f0b380c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34592/0 (socket says 172.21.15.52:34592) 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 -- 172.21.15.52:0/1952267493 learned_addr learned my addr 172.21.15.52:0/1952267493 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:14.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 -- 172.21.15.52:0/1952267493 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154160 msgr2=0x7f0b380c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3da0f700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154160 0x7f0b380c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154160 0x7f0b380c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 -- 172.21.15.52:0/1952267493 >> v1:172.21.15.172:6789/0 conn(0x7f0b38069690 legacy=0x7f0b38157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 -- 172.21.15.52:0/1952267493 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380c0000 con 0x7f0b38154540 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3d20e700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38154540 0x7f0b380c6150 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f0b2c006fd0 tx=0x7f0b2c0090f0).ready entity=mon.0 client_cookie=c863003c95c06506 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:14.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.062+0000 7f0b3ca0d700 1 -- 172.21.15.52:0/1952267493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00b600 con 0x7f0b38154540 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3ca0d700 1 -- 172.21.15.52:0/1952267493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c00b760 con 0x7f0b38154540 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3ca0d700 1 -- 172.21.15.52:0/1952267493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00bb00 con 0x7f0b38154540 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1952267493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38154540 msgr2=0x7f0b380c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38154540 0x7f0b380c6150 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f0b2c006fd0 tx=0x7f0b2c0090f0).stop 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1952267493 shutdown_connections 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154160 0x7f0b380c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1952267493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38154540 0x7f0b380c6150 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1952267493 >> 172.21.15.52:0/1952267493 conn(0x7f0b380cb6f0 msgr2=0x7f0b380c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:14.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1952267493 shutdown_connections 2023-05-10T01:24:14.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.063+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1952267493 wait complete. 2023-05-10T01:24:14.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.064+0000 7f0b3fc73700 1 Processor -- start 2023-05-10T01:24:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.064+0000 7f0b3fc73700 1 -- start start 2023-05-10T01:24:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b38154160 0x7f0b3814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 0x7f0b3814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b381503f0 con 0x7f0b38069690 2023-05-10T01:24:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3814e020 con 0x7f0b38154160 2023-05-10T01:24:14.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3fc73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3814f7e0 con 0x7f0b38154540 2023-05-10T01:24:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34598/0 (socket says 172.21.15.52:34598) 2023-05-10T01:24:14.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 -- 172.21.15.52:0/1867574066 learned_addr learned my addr 172.21.15.52:0/1867574066 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:14.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3d20e700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b38154160 0x7f0b3814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3e210700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 0x7f0b3814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 -- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 msgr2=0x7f0b3814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:14.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 0x7f0b3814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 -- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b38154160 msgr2=0x7f0b3814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:14.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b38154160 0x7f0b3814d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 -- 172.21.15.52:0/1867574066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009370 con 0x7f0b38069690 2023-05-10T01:24:14.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3e210700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 0x7f0b3814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:14.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.065+0000 7f0b3da0f700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f0b3000cfc0 tx=0x7f0b30007890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:14.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.066+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000ae40 con 0x7f0b38069690 2023-05-10T01:24:14.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.066+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3814fac0 con 0x7f0b38069690 2023-05-10T01:24:14.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.066+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30016400 con 0x7f0b38069690 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.066+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300167a0 con 0x7f0b38069690 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.066+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38150080 con 0x7f0b38069690 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.067+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b380666b0 con 0x7f0b38069690 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.067+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0b3000e400 con 0x7f0b38069690 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.067+0000 7f0b35ffb700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 0x7f0b18061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:14.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.067+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0b3007a6d0 con 0x7f0b38069690 2023-05-10T01:24:14.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.068+0000 7f0b3d20e700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 0x7f0b18061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:14.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.068+0000 7f0b3d20e700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 0x7f0b18061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0b2c006fd0 tx=0x7f0b2c017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:14.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.071+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b3004bd60 con 0x7f0b38069690 2023-05-10T01:24:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.314+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f0b3806c340 con 0x7f0b38069690 2023-05-10T01:24:14.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.924+0000 7f0b35ffb700 1 -- 172.21.15.52:0/1867574066 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v515) v1 ==== 159+0+0 (secure 0 0 0) 0x7f0b3004f380 con 0x7f0b38069690 2023-05-10T01:24:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 msgr2=0x7f0b18061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 0x7f0b18061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0b2c006fd0 tx=0x7f0b2c017000).stop 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 msgr2=0x7f0b38068750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f0b3000cfc0 tx=0x7f0b30007890).stop 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 shutdown_connections 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b1805edc0 0x7f0b18061280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b38154540 0x7f0b3814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b38069690 0x7f0b38068750 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 --2- 172.21.15.52:0/1867574066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b38154160 0x7f0b3814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.926+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 >> 172.21.15.52:0/1867574066 conn(0x7f0b380cb6f0 msgr2=0x7f0b3815a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.927+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 shutdown_connections 2023-05-10T01:24:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:14.927+0000 7f0b3fc73700 1 -- 172.21.15.52:0/1867574066 wait complete. 2023-05-10T01:24:14.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:24:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.065+0000 7f95f4bde700 1 Processor -- start 2023-05-10T01:24:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.065+0000 7f95f4bde700 1 -- start start 2023-05-10T01:24:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95f4bde700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95f0154460 0x7f95f00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95f4bde700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95f0068150 0x7f95f00685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95f4bde700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00c94c0 con 0x7f95f0154080 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95f4bde700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00cb7d0 con 0x7f95f0154460 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95f4bde700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f0068a90 con 0x7f95f0068150 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95edd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95f0154460 0x7f95f00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95edd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95f0154460 0x7f95f00aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34608/0 (socket says 172.21.15.52:34608) 2023-05-10T01:24:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.066+0000 7f95edd9b700 1 -- 172.21.15.52:0/1858245432 learned_addr learned my addr 172.21.15.52:0/1858245432 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95eed9d700 1 --2- 172.21.15.52:0/1858245432 >> v2:172.21.15.172:3300/0 conn(0x7f95f0068150 0x7f95f00685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95edd9b700 1 -- 172.21.15.52:0/1858245432 >> v2:172.21.15.172:3300/0 conn(0x7f95f0068150 msgr2=0x7f95f00685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95edd9b700 1 --2- 172.21.15.52:0/1858245432 >> v2:172.21.15.172:3300/0 conn(0x7f95f0068150 0x7f95f00685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95edd9b700 1 -- 172.21.15.52:0/1858245432 >> v1:172.21.15.172:6789/0 conn(0x7f95f0154080 legacy=0x7f95f00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95edd9b700 1 -- 172.21.15.52:0/1858245432 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00c88b0 con 0x7f95f0154460 2023-05-10T01:24:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95edd9b700 1 --2- 172.21.15.52:0/1858245432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154460 0x7f95f00aac90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f95f005f9d0 tx=0x7f95e40090f0).ready entity=mon.0 client_cookie=bc84b0efe4e8c3f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95ed59a700 1 -- 172.21.15.52:0/1858245432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400b520 con 0x7f95f0154460 2023-05-10T01:24:15.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95ed59a700 1 -- 172.21.15.52:0/1858245432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400b680 con 0x7f95f0154460 2023-05-10T01:24:15.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.067+0000 7f95ed59a700 1 -- 172.21.15.52:0/1858245432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ba00 con 0x7f95f0154460 2023-05-10T01:24:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 -- 172.21.15.52:0/1858245432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154460 msgr2=0x7f95f00aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 --2- 172.21.15.52:0/1858245432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154460 0x7f95f00aac90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f95f005f9d0 tx=0x7f95e40090f0).stop 2023-05-10T01:24:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 -- 172.21.15.52:0/1858245432 shutdown_connections 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 --2- 172.21.15.52:0/1858245432 >> v2:172.21.15.172:3300/0 conn(0x7f95f0068150 0x7f95f00685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 --2- 172.21.15.52:0/1858245432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154460 0x7f95f00aac90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 -- 172.21.15.52:0/1858245432 >> 172.21.15.52:0/1858245432 conn(0x7f95f0067910 msgr2=0x7f95f00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 -- 172.21.15.52:0/1858245432 shutdown_connections 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.068+0000 7f95f4bde700 1 -- 172.21.15.52:0/1858245432 wait complete. 2023-05-10T01:24:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 Processor -- start 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 -- start start 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95f0068150 0x7f95f0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 0x7f95f0156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0157b30 con 0x7f95f0154080 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00b07c0 con 0x7f95f0154460 2023-05-10T01:24:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.069+0000 7f95f4bde700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0151a00 con 0x7f95f0068150 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34614/0 (socket says 172.21.15.52:34614) 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 -- 172.21.15.52:0/3826132180 learned_addr learned my addr 172.21.15.52:0/3826132180 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95eed9d700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 0x7f95f0156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95ee59c700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95f0068150 0x7f95f0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 -- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95f0068150 msgr2=0x7f95f0151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95f0068150 0x7f95f0151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 -- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 msgr2=0x7f95f0156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 0x7f95f0156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 -- 172.21.15.52:0/3826132180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009370 con 0x7f95f0154080 2023-05-10T01:24:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95eed9d700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 0x7f95f0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95edd9b700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f95e4009130 tx=0x7f95e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400be90 con 0x7f95f0154080 2023-05-10T01:24:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400b7f0 con 0x7f95f0154080 2023-05-10T01:24:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f01539c0 con 0x7f95f0154080 2023-05-10T01:24:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e401b660 con 0x7f95f0154080 2023-05-10T01:24:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.070+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f00c2680 con 0x7f95f0154080 2023-05-10T01:24:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.071+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f0066720 con 0x7f95f0154080 2023-05-10T01:24:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.071+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f95e402b070 con 0x7f95f0154080 2023-05-10T01:24:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.072+0000 7f95de7fc700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 0x7f95cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.072+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f95e407b0d0 con 0x7f95f0154080 2023-05-10T01:24:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.072+0000 7f95ee59c700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 0x7f95cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.072+0000 7f95ee59c700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 0x7f95cc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f95f0167b00 tx=0x7f95e8009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.076+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95e404c710 con 0x7f95f0154080 2023-05-10T01:24:15.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.249+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f95f01539c0 con 0x7f95f0154080 2023-05-10T01:24:15.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.252+0000 7f95de7fc700 1 -- 172.21.15.52:0/3826132180 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95f01539c0 con 0x7f95f0154080 2023-05-10T01:24:15.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 msgr2=0x7f95cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 0x7f95cc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f95f0167b00 tx=0x7f95e8009040).stop 2023-05-10T01:24:15.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 msgr2=0x7f95f01534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f95e4009130 tx=0x7f95e4017000).stop 2023-05-10T01:24:15.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 shutdown_connections 2023-05-10T01:24:15.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f95cc05ed90 0x7f95cc061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95f0154460 0x7f95f0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95f0068150 0x7f95f0151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 --2- 172.21.15.52:0/3826132180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95f0154080 0x7f95f01534d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 >> 172.21.15.52:0/3826132180 conn(0x7f95f0067910 msgr2=0x7f95f00cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:15.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 shutdown_connections 2023-05-10T01:24:15.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.254+0000 7f95f4bde700 1 -- 172.21.15.52:0/3826132180 wait complete. 2023-05-10T01:24:15.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:24:15.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:15.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:15.330 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:24:15.331 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:24:15.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:15.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.451+0000 7ff7c08af700 1 Processor -- start 2023-05-10T01:24:15.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.451+0000 7ff7c08af700 1 -- start start 2023-05-10T01:24:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7c08af700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7c08af700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0c08a0 con 0x7ff7bc154160 2023-05-10T01:24:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7c08af700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0bfc90 con 0x7ff7bc154540 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7c08af700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0ab1f0 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7bad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7bad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34624/0 (socket says 172.21.15.52:34624) 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7bad9d700 1 -- 172.21.15.52:0/2781489862 learned_addr learned my addr 172.21.15.52:0/2781489862 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7bad9d700 1 -- 172.21.15.52:0/2781489862 >> v1:172.21.15.172:6789/0 conn(0x7ff7bc154540 legacy=0x7ff7bc0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.452+0000 7ff7bad9d700 1 -- 172.21.15.52:0/2781489862 >> v1:172.21.15.52:6789/0 conn(0x7ff7bc154160 legacy=0x7ff7bc0a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7b9d9b700 1 -- 172.21.15.52:0/2781489862 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588004723 0 0) 0x7ff7bc0c08a0 con 0x7ff7bc154160 2023-05-10T01:24:15.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7bad9d700 1 -- 172.21.15.52:0/2781489862 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0bff70 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7bad9d700 1 --2- 172.21.15.52:0/2781489862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7ff7b4009f20 tx=0x7ff7b4009840).ready entity=mon.0 client_cookie=4814d17efd39dc3f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7b9d9b700 1 -- 172.21.15.52:0/2781489862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400e070 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7b9d9b700 1 -- 172.21.15.52:0/2781489862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400ba40 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7b9d9b700 1 -- 172.21.15.52:0/2781489862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400bdc0 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 -- 172.21.15.52:0/2781489862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc0c63b0 msgr2=0x7ff7bc0aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 --2- 172.21.15.52:0/2781489862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7ff7b4009f20 tx=0x7ff7b4009840).stop 2023-05-10T01:24:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 -- 172.21.15.52:0/2781489862 shutdown_connections 2023-05-10T01:24:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 --2- 172.21.15.52:0/2781489862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc0c63b0 0x7ff7bc0aad00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 -- 172.21.15.52:0/2781489862 >> 172.21.15.52:0/2781489862 conn(0x7ff7bc0cb6c0 msgr2=0x7ff7bc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 -- 172.21.15.52:0/2781489862 shutdown_connections 2023-05-10T01:24:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.453+0000 7ff7c08af700 1 -- 172.21.15.52:0/2781489862 wait complete. 2023-05-10T01:24:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.454+0000 7ff7c08af700 1 Processor -- start 2023-05-10T01:24:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 -- start start 2023-05-10T01:24:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7bc0c63b0 0x7ff7bc157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 0x7ff7bc0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc157a80 con 0x7ff7bc154540 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc158400 con 0x7ff7bc154160 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7c08af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc156e70 con 0x7ff7bc0c63b0 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7bad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7bad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34630/0 (socket says 172.21.15.52:34630) 2023-05-10T01:24:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.455+0000 7ff7bad9d700 1 -- 172.21.15.52:0/3919365065 learned_addr learned my addr 172.21.15.52:0/3919365065 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 -- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7bc0c63b0 msgr2=0x7ff7bc157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7bc0c63b0 0x7ff7bc157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 -- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 msgr2=0x7ff7bc0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7b3fff700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 0x7ff7bc0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 0x7ff7bc0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 -- 172.21.15.52:0/3919365065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009ae0 con 0x7ff7bc154540 2023-05-10T01:24:15.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7b3fff700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 0x7ff7bc0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:15.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7bad9d700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7ff7b400b6c0 tx=0x7ff7b4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40092e0 con 0x7ff7bc154540 2023-05-10T01:24:15.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b401d410 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b401d790 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc157150 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.456+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc157710 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.457+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc157d60 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.457+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff7b401b040 con 0x7ff7bc154540 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.458+0000 7ff7b27fc700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 0x7ff7a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.458+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff7b407b750 con 0x7ff7bc154540 2023-05-10T01:24:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.458+0000 7ff7ba59c700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 0x7ff7a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.458+0000 7ff7ba59c700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 0x7ff7a0061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff7ac001570 tx=0x7ff7ac007830).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.462+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7b404cd90 con 0x7ff7bc154540 2023-05-10T01:24:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.681+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7bc157d60 con 0x7ff7bc154540 2023-05-10T01:24:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.682+0000 7ff7b27fc700 1 -- 172.21.15.52:0/3919365065 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff7b40503b0 con 0x7ff7bc154540 2023-05-10T01:24:15.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:15.686 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2751670729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2751670729},{"type":"v1","addr":"172.21.15.52:6834","nonce":2751670729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5491,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/185788383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":185788383},{"type":"v1","addr":"172.21.15.52:6835","nonce":185788383}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3249385471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3249385471},{"type":"v1","addr":"172.21.15.172:6837","nonce":3249385471}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/4039727904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4039727904},{"type":"v1","addr":"172.21.15.172:6836","nonce":4039727904}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-05-10T01:24:15.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 msgr2=0x7ff7a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 0x7ff7a0061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff7ac001570 tx=0x7ff7ac007830).stop 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 msgr2=0x7ff7bc0c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7ff7b400b6c0 tx=0x7ff7b4009840).stop 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 shutdown_connections 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7a005ed60 0x7ff7a0061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7bc154540 0x7ff7bc0c2f20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7bc0c63b0 0x7ff7bc157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 --2- 172.21.15.52:0/3919365065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7bc154160 0x7ff7bc0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 >> 172.21.15.52:0/3919365065 conn(0x7ff7bc0cb6c0 msgr2=0x7ff7bc153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 shutdown_connections 2023-05-10T01:24:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.684+0000 7ff7c08af700 1 -- 172.21.15.52:0/3919365065 wait complete. 2023-05-10T01:24:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 25 2023-05-10T01:24:15.699 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:24:15.700 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:24:15.700 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:24:15.700 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:15.700 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:24:15.701 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:24:15.701 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:24:15.701 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:15.701 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:24:15.702 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:24:15.702 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:24:15.702 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:15.702 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:24:15.703 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:24:15.703 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:24:15.703 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:15.708 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:24:15.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:24:15.710 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:24:15.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:24:15.712 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:24:15.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:24:15.713 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:24:15.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:24:15.751 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:24:15.751 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:15.752 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:24:15.752 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:15.756 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:24:15.756 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:24:15.757 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:15.757 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:15.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:24:15.824 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:24:15.826 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:24:15.834 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:24:15.835 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:24:15.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.881+0000 7f63ccdd5700 1 Processor -- start 2023-05-10T01:24:15.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.881+0000 7f63ccdd5700 1 -- start start 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63ccdd5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154540 0x7f63c8069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63ccdd5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63c8069b80 0x7f63c80c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63ccdd5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80c0650 con 0x7f63c8154160 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63ccdd5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806a010 con 0x7f63c8069b80 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63ccdd5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80bfd20 con 0x7f63c8154540 2023-05-10T01:24:15.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c6d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63c8069b80 0x7f63c80c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c659c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f63c8154160 0x7f63c80c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43674/0 (socket says 172.21.15.52:43674) 2023-05-10T01:24:15.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c659c700 1 -- 172.21.15.52:0/2979881121 learned_addr learned my addr 172.21.15.52:0/2979881121 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:15.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c5d9b700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154540 0x7f63c8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c6d9d700 1 -- 172.21.15.52:0/2979881121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154540 msgr2=0x7f63c8069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c6d9d700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154540 0x7f63c8069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c6d9d700 1 -- 172.21.15.52:0/2979881121 >> v1:172.21.15.52:6789/0 conn(0x7f63c8154160 legacy=0x7f63c80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c559a700 1 -- 172.21.15.52:0/2979881121 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726749685 0 0) 0x7f63c80c0650 con 0x7f63c8154160 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.882+0000 7f63c6d9d700 1 -- 172.21.15.52:0/2979881121 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80c0000 con 0x7f63c8069b80 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63c6d9d700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c80c0ae0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f63c0009e60 tx=0x7f63c0009780).ready entity=mon.0 client_cookie=54ede0b0c6bee3e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63c559a700 1 -- 172.21.15.52:0/2979881121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000e070 con 0x7f63c8069b80 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63c559a700 1 -- 172.21.15.52:0/2979881121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000bc30 con 0x7f63c8069b80 2023-05-10T01:24:15.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63c559a700 1 -- 172.21.15.52:0/2979881121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0012410 con 0x7f63c8069b80 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 -- 172.21.15.52:0/2979881121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 msgr2=0x7f63c80c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c80c0ae0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f63c0009e60 tx=0x7f63c0009780).stop 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 -- 172.21.15.52:0/2979881121 shutdown_connections 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c80c0ae0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/2979881121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154540 0x7f63c8069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 -- 172.21.15.52:0/2979881121 >> 172.21.15.52:0/2979881121 conn(0x7f63c80cb6f0 msgr2=0x7f63c80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 -- 172.21.15.52:0/2979881121 shutdown_connections 2023-05-10T01:24:15.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.883+0000 7f63ccdd5700 1 -- 172.21.15.52:0/2979881121 wait complete. 2023-05-10T01:24:15.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.884+0000 7f63ccdd5700 1 Processor -- start 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.884+0000 7f63ccdd5700 1 -- start start 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154160 0x7f63c80c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 0x7f63c8142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8150720 con 0x7f63c8069b80 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c2e00 con 0x7f63c8154540 2023-05-10T01:24:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63ccdd5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c2560 con 0x7f63c8154160 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63c659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63c659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34664/0 (socket says 172.21.15.52:34664) 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63c659c700 1 -- 172.21.15.52:0/555427554 learned_addr learned my addr 172.21.15.52:0/555427554 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63c5d9b700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154160 0x7f63c80c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.885+0000 7f63c6d9d700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 0x7f63c8142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 -- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154160 msgr2=0x7f63c80c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154160 0x7f63c80c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 -- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 msgr2=0x7f63c8142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 0x7f63c8142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 -- 172.21.15.52:0/555427554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009a20 con 0x7f63c8069b80 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c6d9d700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 0x7f63c8142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63c659c700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f63b000c4e0 tx=0x7f63b0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00072e0 con 0x7f63c8069b80 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0007440 con 0x7f63c8069b80 2023-05-10T01:24:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00057a0 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c80c2840 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.886+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c80c2220 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.887+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c80666b0 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.887+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f63b0010070 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.888+0000 7f63be7fc700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 0x7f63ac061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.888+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f63b00790b0 con 0x7f63c8069b80 2023-05-10T01:24:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.888+0000 7f63c5d9b700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 0x7f63ac061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.888+0000 7f63c5d9b700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 0x7f63ac061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f63c8153970 tx=0x7f63b8008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:15.892+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63b004a6f0 con 0x7f63c8069b80 2023-05-10T01:24:16.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.082+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f63c806c340 con 0x7f63c8069b80 2023-05-10T01:24:16.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.933+0000 7f63be7fc700 1 -- 172.21.15.52:0/555427554 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) v1 ==== 97+0+0 (secure 0 0 0) 0x7f63b0007db0 con 0x7f63c8069b80 2023-05-10T01:24:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 msgr2=0x7f63ac061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 0x7f63ac061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f63c8153970 tx=0x7f63b8008040).stop 2023-05-10T01:24:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 msgr2=0x7f63c8152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f63b000c4e0 tx=0x7f63b0007c70).stop 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 shutdown_connections 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f63ac05edc0 0x7f63ac061280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c8154540 0x7f63c8142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c8069b80 0x7f63c8152d00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 --2- 172.21.15.52:0/555427554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8154160 0x7f63c80c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 >> 172.21.15.52:0/555427554 conn(0x7f63c80cb6f0 msgr2=0x7f63c80ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 shutdown_connections 2023-05-10T01:24:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:16.935+0000 7f63ccdd5700 1 -- 172.21.15.52:0/555427554 wait complete. 2023-05-10T01:24:16.941 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:24:16.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:24:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.072+0000 7f08c02af700 1 Processor -- start 2023-05-10T01:24:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.072+0000 7f08c02af700 1 -- start start 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08c02af700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 0x7f08b80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08c02af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 0x7f08b80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08c02af700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80c6640 con 0x7f08b8154160 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08c02af700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80ab1f0 con 0x7f08b8154540 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08c02af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c08a0 con 0x7f08b80c5ca0 2023-05-10T01:24:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08be84c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 0x7f08b80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08bd84a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 0x7f08b80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08be04b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f08b8154160 0x7f08b80a9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:46230/0 (socket says 172.21.15.52:46230) 2023-05-10T01:24:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.073+0000 7f08be04b700 1 -- 172.21.15.52:0/1749418961 learned_addr learned my addr 172.21.15.52:0/1749418961 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08be84c700 1 -- 172.21.15.52:0/1749418961 >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 msgr2=0x7f08b80aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08be84c700 1 --2- 172.21.15.52:0/1749418961 >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 0x7f08b80aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08be84c700 1 -- 172.21.15.52:0/1749418961 >> v1:172.21.15.172:6789/0 conn(0x7f08b8154160 legacy=0x7f08b80a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08be84c700 1 -- 172.21.15.52:0/1749418961 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80bfc90 con 0x7f08b80c5ca0 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08bd84a700 1 --2- 172.21.15.52:0/1749418961 >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 0x7f08b80aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08be84c700 1 --2- 172.21.15.52:0/1749418961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 0x7f08b80c6150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f08a8009e60 tx=0x7f08a8009780).ready entity=mon.2 client_cookie=848af489eb4f5fbe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08bd049700 1 -- 172.21.15.52:0/1749418961 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800e070 con 0x7f08b80c5ca0 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08bd049700 1 -- 172.21.15.52:0/1749418961 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800bb60 con 0x7f08b80c5ca0 2023-05-10T01:24:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.074+0000 7f08bd049700 1 -- 172.21.15.52:0/1749418961 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8012410 con 0x7f08b80c5ca0 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 -- 172.21.15.52:0/1749418961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 msgr2=0x7f08b80c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 --2- 172.21.15.52:0/1749418961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 0x7f08b80c6150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f08a8009e60 tx=0x7f08a8009780).stop 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 -- 172.21.15.52:0/1749418961 shutdown_connections 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 --2- 172.21.15.52:0/1749418961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b80c5ca0 0x7f08b80c6150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 --2- 172.21.15.52:0/1749418961 >> v2:172.21.15.172:3300/0 conn(0x7f08b8154540 0x7f08b80aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 -- 172.21.15.52:0/1749418961 >> 172.21.15.52:0/1749418961 conn(0x7f08b80cb6c0 msgr2=0x7f08b80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 -- 172.21.15.52:0/1749418961 shutdown_connections 2023-05-10T01:24:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.075+0000 7f08c02af700 1 -- 172.21.15.52:0/1749418961 wait complete. 2023-05-10T01:24:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.076+0000 7f08c02af700 1 Processor -- start 2023-05-10T01:24:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.076+0000 7f08c02af700 1 -- start start 2023-05-10T01:24:17.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.076+0000 7f08c02af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08b80c5ca0 0x7f08b8144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b8154540 0x7f08b80ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b814cdc0 con 0x7f08b8154160 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b814d900 con 0x7f08b80c5ca0 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b814dd90 con 0x7f08b8154540 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34684/0 (socket says 172.21.15.52:34684) 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 -- 172.21.15.52:0/2414742395 learned_addr learned my addr 172.21.15.52:0/2414742395 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:17.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08be84c700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b8154540 0x7f08b80ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08be04b700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08b80c5ca0 0x7f08b8144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 -- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b8154540 msgr2=0x7f08b80ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b8154540 0x7f08b80ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 -- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08b80c5ca0 msgr2=0x7f08b8144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08b80c5ca0 0x7f08b8144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 -- 172.21.15.52:0/2414742395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0092a0 con 0x7f08b8154160 2023-05-10T01:24:17.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08bd84a700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f08ac00e980 tx=0x7f08ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00c7f0 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00c950 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a8009a20 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00ccd0 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.077+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b814d2b0 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.078+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80666b0 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.079+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f08ac022070 con 0x7f08b8154160 2023-05-10T01:24:17.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.079+0000 7f08b67fc700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 0x7f0898061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.079+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f08ac079d50 con 0x7f08b8154160 2023-05-10T01:24:17.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.079+0000 7f08be04b700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 0x7f0898061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.080+0000 7f08be04b700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 0x7f0898061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f08b00016a0 tx=0x7f08b0009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.083+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08ac04b540 con 0x7f08b8154160 2023-05-10T01:24:17.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.324+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08b806c340 con 0x7f08b8154160 2023-05-10T01:24:17.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.324+0000 7f08b67fc700 1 -- 172.21.15.52:0/2414742395 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f08ac04eb60 con 0x7f08b8154160 2023-05-10T01:24:17.328 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:17.328 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:17.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:17.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.330 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.330 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.330 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:17.331 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.332 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:24:17.333 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.334 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.335 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.337 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.338 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.339 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:24:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:24:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:24:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.343 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.344 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.345 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.345 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:24:17.345 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:24:17.345 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.346 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.347 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:17.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.349 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:24:17.350 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.351 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.352 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:24:17.353 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:17.354 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.354 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:17.354 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:24:17.354 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:24:17.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 msgr2=0x7f0898061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 0x7f0898061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f08b00016a0 tx=0x7f08b0009040).stop 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 msgr2=0x7f08b814c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f08ac00e980 tx=0x7f08ac009060).stop 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 shutdown_connections 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089805ed90 0x7f0898061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08b8154540 0x7f08b80ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08b80c5ca0 0x7f08b8144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 --2- 172.21.15.52:0/2414742395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08b8154160 0x7f08b814c3c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 >> 172.21.15.52:0/2414742395 conn(0x7f08b80cb6c0 msgr2=0x7f08b80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 shutdown_connections 2023-05-10T01:24:17.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.326+0000 7f08c02af700 1 -- 172.21.15.52:0/2414742395 wait complete. 2023-05-10T01:24:17.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.470+0000 7fe07eabc700 1 Processor -- start 2023-05-10T01:24:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.470+0000 7fe07eabc700 1 -- start start 2023-05-10T01:24:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07eabc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe078138690 0x7fe0780c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07eabc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0780c3090 0x7fe0780622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07eabc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780c37e0 con 0x7fe078062790 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07eabc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe078138a70 con 0x7fe078138690 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07eabc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780be3c0 con 0x7fe0780c3090 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.471+0000 7fe07c858700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe078138690 0x7fe0780c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe078138690 0x7fe0780c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34690/0 (socket says 172.21.15.52:34690) 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07d059700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe078062790 0x7fe078063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43706/0 (socket says 172.21.15.52:43706) 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 -- 172.21.15.52:0/2297038456 learned_addr learned my addr 172.21.15.52:0/2297038456 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe077fff700 1 --2- 172.21.15.52:0/2297038456 >> v2:172.21.15.172:3300/0 conn(0x7fe0780c3090 0x7fe0780622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 -- 172.21.15.52:0/2297038456 >> v2:172.21.15.172:3300/0 conn(0x7fe0780c3090 msgr2=0x7fe0780622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 --2- 172.21.15.52:0/2297038456 >> v2:172.21.15.172:3300/0 conn(0x7fe0780c3090 0x7fe0780622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 -- 172.21.15.52:0/2297038456 >> v1:172.21.15.52:6789/0 conn(0x7fe078062790 legacy=0x7fe078063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 -- 172.21.15.52:0/2297038456 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780bef80 con 0x7fe078138690 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe0777fe700 1 -- 172.21.15.52:0/2297038456 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947339828 0 0) 0x7fe0780c37e0 con 0x7fe078062790 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe07c858700 1 --2- 172.21.15.52:0/2297038456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780c4eb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fe07806bf80 tx=0x7fe070009840).ready entity=mon.0 client_cookie=52d291c531774d7f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe0777fe700 1 -- 172.21.15.52:0/2297038456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000e070 con 0x7fe078138690 2023-05-10T01:24:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe0777fe700 1 -- 172.21.15.52:0/2297038456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000ba50 con 0x7fe078138690 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.472+0000 7fe0777fe700 1 -- 172.21.15.52:0/2297038456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000bdd0 con 0x7fe078138690 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 -- 172.21.15.52:0/2297038456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 msgr2=0x7fe0780c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 --2- 172.21.15.52:0/2297038456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780c4eb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fe07806bf80 tx=0x7fe070009840).stop 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 -- 172.21.15.52:0/2297038456 shutdown_connections 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 --2- 172.21.15.52:0/2297038456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780c4eb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 --2- 172.21.15.52:0/2297038456 >> v2:172.21.15.172:3300/0 conn(0x7fe0780c3090 0x7fe0780622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 -- 172.21.15.52:0/2297038456 >> 172.21.15.52:0/2297038456 conn(0x7fe0780c8a90 msgr2=0x7fe0780c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 -- 172.21.15.52:0/2297038456 shutdown_connections 2023-05-10T01:24:17.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.473+0000 7fe07eabc700 1 -- 172.21.15.52:0/2297038456 wait complete. 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.474+0000 7fe07eabc700 1 Processor -- start 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.474+0000 7fe07eabc700 1 -- start start 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe078062790 0x7fe078135560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0780c3090 0x7fe0780c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078135a50 con 0x7fe078138690 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078162220 con 0x7fe0780c3090 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c12f0 con 0x7fe078062790 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34698/0 (socket says 172.21.15.52:34698) 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 -- 172.21.15.52:0/329644303 learned_addr learned my addr 172.21.15.52:0/329644303 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe077fff700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0780c3090 0x7fe0780c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07c858700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe078062790 0x7fe078135560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 -- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe078062790 msgr2=0x7fe078135560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe078062790 0x7fe078135560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 -- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0780c3090 msgr2=0x7fe0780c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0780c3090 0x7fe0780c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 -- 172.21.15.52:0/329644303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070009ae0 con 0x7fe078138690 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07d059700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fe06000c4c0 tx=0x7fe060007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600072e0 con 0x7fe078138690 2023-05-10T01:24:17.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078162460 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe060007440 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600058f0 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.475+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe078162a20 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.476+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078162c10 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.477+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe060010070 con 0x7fe078138690 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.477+0000 7fe074ff9700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 0x7fe05c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.477+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fe060078f20 con 0x7fe078138690 2023-05-10T01:24:17.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.477+0000 7fe07c858700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 0x7fe05c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.478+0000 7fe07c858700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 0x7fe05c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe0700070b0 tx=0x7fe070009840).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.481+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe06004a710 con 0x7fe078138690 2023-05-10T01:24:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.656+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe07806c340 con 0x7fe078138690 2023-05-10T01:24:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.657+0000 7fe074ff9700 1 -- 172.21.15.52:0/329644303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+14211 (secure 0 0 0) 0x7fe06004dd30 con 0x7fe078138690 2023-05-10T01:24:17.661 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:17.661 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":76,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:16.928809+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:17.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 msgr2=0x7fe05c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 0x7fe05c061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe0700070b0 tx=0x7fe070009840).stop 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 msgr2=0x7fe0780bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fe06000c4c0 tx=0x7fe060007be0).stop 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 shutdown_connections 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe05c05ed90 0x7fe05c061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe078138690 0x7fe0780bfb30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe078062790 0x7fe078135560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 --2- 172.21.15.52:0/329644303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0780c3090 0x7fe0780c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 >> 172.21.15.52:0/329644303 conn(0x7fe0780c8a90 msgr2=0x7fe0781515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 shutdown_connections 2023-05-10T01:24:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.659+0000 7fe07eabc700 1 -- 172.21.15.52:0/329644303 wait complete. 2023-05-10T01:24:17.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:24:17.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:24:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.791+0000 7f463acc3700 1 Processor -- start 2023-05-10T01:24:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.791+0000 7f463acc3700 1 -- start start 2023-05-10T01:24:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f463acc3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4634154080 0x7f46340aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f463acc3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634068150 0x7f46340685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f463acc3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340c94c0 con 0x7f4634154460 2023-05-10T01:24:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f463acc3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46340cb7d0 con 0x7f4634154080 2023-05-10T01:24:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f463acc3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634068a90 con 0x7f4634068150 2023-05-10T01:24:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4634154080 0x7f46340aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4634154080 0x7f46340aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34702/0 (socket says 172.21.15.52:34702) 2023-05-10T01:24:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4633fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4634154460 0x7f46340a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43718/0 (socket says 172.21.15.52:43718) 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 -- 172.21.15.52:0/4149241495 learned_addr learned my addr 172.21.15.52:0/4149241495 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4639260700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634068150 0x7f46340685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 -- 172.21.15.52:0/4149241495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634068150 msgr2=0x7f46340685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634068150 0x7f46340685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 -- 172.21.15.52:0/4149241495 >> v1:172.21.15.52:6789/0 conn(0x7f4634154460 legacy=0x7f46340a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f46337fe700 1 -- 172.21.15.52:0/4149241495 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068564317 0 0) 0x7f46340c94c0 con 0x7f4634154460 2023-05-10T01:24:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.792+0000 7f4638a5f700 1 -- 172.21.15.52:0/4149241495 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340c88b0 con 0x7f4634154080 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f4638a5f700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f46340aac90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f462c006fd0 tx=0x7f462c0090f0).ready entity=mon.0 client_cookie=c3d988bc6ddd13b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f46337fe700 1 -- 172.21.15.52:0/4149241495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00b580 con 0x7f4634154080 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f46337fe700 1 -- 172.21.15.52:0/4149241495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00b6e0 con 0x7f4634154080 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f46337fe700 1 -- 172.21.15.52:0/4149241495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00ba60 con 0x7f4634154080 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 -- 172.21.15.52:0/4149241495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 msgr2=0x7f46340aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f46340aac90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f462c006fd0 tx=0x7f462c0090f0).stop 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 -- 172.21.15.52:0/4149241495 shutdown_connections 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634068150 0x7f46340685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 --2- 172.21.15.52:0/4149241495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f46340aac90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 -- 172.21.15.52:0/4149241495 >> 172.21.15.52:0/4149241495 conn(0x7f4634067910 msgr2=0x7f46340cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 -- 172.21.15.52:0/4149241495 shutdown_connections 2023-05-10T01:24:17.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.793+0000 7f463acc3700 1 -- 172.21.15.52:0/4149241495 wait complete. 2023-05-10T01:24:17.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.794+0000 7f463acc3700 1 Processor -- start 2023-05-10T01:24:17.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.794+0000 7f463acc3700 1 -- start start 2023-05-10T01:24:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4634068150 0x7f46341448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634154460 0x7f46340c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634155d30 con 0x7f4634154080 2023-05-10T01:24:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634155120 con 0x7f4634068150 2023-05-10T01:24:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f463acc3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634155400 con 0x7f4634154460 2023-05-10T01:24:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f4633fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f4633fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34708/0 (socket says 172.21.15.52:34708) 2023-05-10T01:24:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.795+0000 7f4633fff700 1 -- 172.21.15.52:0/4118268674 learned_addr learned my addr 172.21.15.52:0/4118268674 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4639260700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634154460 0x7f46340c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4638a5f700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4634068150 0x7f46341448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 -- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634154460 msgr2=0x7f46340c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634154460 0x7f46340c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 -- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4634068150 msgr2=0x7f46341448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4634068150 0x7f46341448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 -- 172.21.15.52:0/4118268674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009370 con 0x7f4634154080 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4633fff700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f462400c7c0 tx=0x7f4624001580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624005c70 con 0x7f4634154080 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4624005dd0 con 0x7f4634154080 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624007340 con 0x7f4634154080 2023-05-10T01:24:17.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46341556e0 con 0x7f4634154080 2023-05-10T01:24:17.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.796+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4634144db0 con 0x7f4634154080 2023-05-10T01:24:17.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.797+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634155ee0 con 0x7f4634154080 2023-05-10T01:24:17.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.797+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4624010030 con 0x7f4634154080 2023-05-10T01:24:17.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.798+0000 7f4630ff9700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 0x7f4618061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:17.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.798+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f4624079910 con 0x7f4634154080 2023-05-10T01:24:17.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.798+0000 7f4638a5f700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 0x7f4618061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:17.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.798+0000 7f4638a5f700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 0x7f4618061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f462c009fd0 tx=0x7f462c017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:17.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.802+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4634155ee0 con 0x7f4634154080 2023-05-10T01:24:17.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.975+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f463406c340 con 0x7f4634154080 2023-05-10T01:24:17.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.975+0000 7f4630ff9700 1 -- 172.21.15.52:0/4118268674 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v76) v1 ==== 110+0+10 (secure 0 0 0) 0x7f462404aff0 con 0x7f4634154080 2023-05-10T01:24:17.979 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 msgr2=0x7f4618061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 0x7f4618061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f462c009fd0 tx=0x7f462c017000).stop 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 msgr2=0x7f4634154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f462400c7c0 tx=0x7f4624001580).stop 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 shutdown_connections 2023-05-10T01:24:17.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f461805ed90 0x7f4618061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4634154460 0x7f46340c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4634068150 0x7f46341448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 --2- 172.21.15.52:0/4118268674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4634154080 0x7f4634154840 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 >> 172.21.15.52:0/4118268674 conn(0x7f4634067910 msgr2=0x7f46340ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 shutdown_connections 2023-05-10T01:24:17.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:17.977+0000 7f463acc3700 1 -- 172.21.15.52:0/4118268674 wait complete. 2023-05-10T01:24:17.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:24:18.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.107+0000 7f6f58716700 1 Processor -- start 2023-05-10T01:24:18.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.107+0000 7f6f58716700 1 -- start start 2023-05-10T01:24:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.108+0000 7f6f58716700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.108+0000 7f6f58716700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f50154460 0x7f6f500a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.108+0000 7f6f58716700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500aa560 con 0x7f6f500aa140 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.108+0000 7f6f58716700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500c94c0 con 0x7f6f50154460 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.108+0000 7f6f58716700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500cb7d0 con 0x7f6f50154080 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f50154460 0x7f6f500a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f50154460 0x7f6f500a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34714/0 (socket says 172.21.15.52:34714) 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 -- 172.21.15.52:0/4291940005 learned_addr learned my addr 172.21.15.52:0/4291940005 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f564b2700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 -- 172.21.15.52:0/4291940005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 msgr2=0x7f6f500aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 -- 172.21.15.52:0/4291940005 >> v1:172.21.15.172:6789/0 conn(0x7f6f500aa140 legacy=0x7f6f50068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 -- 172.21.15.52:0/4291940005 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500c88b0 con 0x7f6f50154460 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f55cb1700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f500a9c50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f6f44006fd0 tx=0x7f6f440090f0).ready entity=mon.0 client_cookie=cf0ef2d280974d3a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f554b0700 1 -- 172.21.15.52:0/4291940005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400b600 con 0x7f6f50154460 2023-05-10T01:24:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f554b0700 1 -- 172.21.15.52:0/4291940005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400b760 con 0x7f6f50154460 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.109+0000 7f6f554b0700 1 -- 172.21.15.52:0/4291940005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400bae0 con 0x7f6f50154460 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 -- 172.21.15.52:0/4291940005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 msgr2=0x7f6f500a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f500a9c50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f6f44006fd0 tx=0x7f6f440090f0).stop 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 -- 172.21.15.52:0/4291940005 shutdown_connections 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 --2- 172.21.15.52:0/4291940005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f500a9c50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 -- 172.21.15.52:0/4291940005 >> 172.21.15.52:0/4291940005 conn(0x7f6f50067910 msgr2=0x7f6f500cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 -- 172.21.15.52:0/4291940005 shutdown_connections 2023-05-10T01:24:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.110+0000 7f6f58716700 1 -- 172.21.15.52:0/4291940005 wait complete. 2023-05-10T01:24:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.111+0000 7f6f58716700 1 Processor -- start 2023-05-10T01:24:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.111+0000 7f6f58716700 1 -- start start 2023-05-10T01:24:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f500aa140 0x7f6f500ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500abdd0 con 0x7f6f50154460 2023-05-10T01:24:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500ac0b0 con 0x7f6f500aa140 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500ac390 con 0x7f6f50154080 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34724/0 (socket says 172.21.15.52:34724) 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 -- 172.21.15.52:0/4264253314 learned_addr learned my addr 172.21.15.52:0/4264253314 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f564b2700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f500aa140 0x7f6f500ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f55cb1700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 -- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 msgr2=0x7f6f500c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 -- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f500aa140 msgr2=0x7f6f500ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f500aa140 0x7f6f500ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 -- 172.21.15.52:0/4264253314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009370 con 0x7f6f50154460 2023-05-10T01:24:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f56cb3700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f6f4000c440 tx=0x7f6f40007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400123f0 con 0x7f6f50154460 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40001e90 con 0x7f6f50154460 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500ac670 con 0x7f6f50154460 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40012760 con 0x7f6f50154460 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.112+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500c5460 con 0x7f6f50154460 2023-05-10T01:24:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.113+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50066720 con 0x7f6f50154460 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.114+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6f40010070 con 0x7f6f50154460 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.114+0000 7f6f4e7fc700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 0x7f6f30061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.114+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f6f40078900 con 0x7f6f50154460 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.114+0000 7f6f564b2700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 0x7f6f30061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.115+0000 7f6f564b2700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 0x7f6f30061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6f4800f610 tx=0x7f6f480077f0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.118+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f400478f0 con 0x7f6f50154460 2023-05-10T01:24:18.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.291+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f500aa560 con 0x7f6f50154460 2023-05-10T01:24:18.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.292+0000 7f6f4e7fc700 1 -- 172.21.15.52:0/4264253314 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f500aa560 con 0x7f6f50154460 2023-05-10T01:24:18.296 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:24:18.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 msgr2=0x7f6f30061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 0x7f6f30061220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6f4800f610 tx=0x7f6f480077f0).stop 2023-05-10T01:24:18.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 msgr2=0x7f6f50141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f6f4000c440 tx=0x7f6f40007d70).stop 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 shutdown_connections 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6f3005ed60 0x7f6f30061220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f50154460 0x7f6f50141690 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f500aa140 0x7f6f500ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 --2- 172.21.15.52:0/4264253314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f50154080 0x7f6f500c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.293+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 >> 172.21.15.52:0/4264253314 conn(0x7f6f50067910 msgr2=0x7f6f5014db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:18.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.294+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 shutdown_connections 2023-05-10T01:24:18.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.294+0000 7f6f58716700 1 -- 172.21.15.52:0/4264253314 wait complete. 2023-05-10T01:24:18.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:24:18.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.422+0000 7f2b79c36700 1 Processor -- start 2023-05-10T01:24:18.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.422+0000 7f2b79c36700 1 -- start start 2023-05-10T01:24:18.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b79c36700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b74154160 0x7f2b740c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b79c36700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b740c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b79c36700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740c0650 con 0x7f2b74154540 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b79c36700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740c1af0 con 0x7f2b74154160 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b79c36700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740bfd20 con 0x7f2b74069da0 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b73fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b740c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b737fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b74154160 0x7f2b740c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b72ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2b74154540 0x7f2b74069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:46282/0 (socket says 172.21.15.52:46282) 2023-05-10T01:24:18.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b72ffd700 1 -- 172.21.15.52:0/3988565669 learned_addr learned my addr 172.21.15.52:0/3988565669 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:18.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b73fff700 1 -- 172.21.15.52:0/3988565669 >> v2:172.21.15.172:3300/0 conn(0x7f2b74154160 msgr2=0x7f2b740c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b727fc700 1 -- 172.21.15.52:0/3988565669 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740217952 0 0) 0x7f2b740c0650 con 0x7f2b74154540 2023-05-10T01:24:18.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.423+0000 7f2b73fff700 1 --2- 172.21.15.52:0/3988565669 >> v2:172.21.15.172:3300/0 conn(0x7f2b74154160 0x7f2b740c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b73fff700 1 -- 172.21.15.52:0/3988565669 >> v1:172.21.15.172:6789/0 conn(0x7f2b74154540 legacy=0x7f2b74069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b73fff700 1 -- 172.21.15.52:0/3988565669 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740c0000 con 0x7f2b74069da0 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b73fff700 1 --2- 172.21.15.52:0/3988565669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b740c6150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f2b6c009e60 tx=0x7f2b6c009780).ready entity=mon.2 client_cookie=29dc00ac2df0e3f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b727fc700 1 -- 172.21.15.52:0/3988565669 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00e070 con 0x7f2b74069da0 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b727fc700 1 -- 172.21.15.52:0/3988565669 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00bb60 con 0x7f2b74069da0 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b727fc700 1 -- 172.21.15.52:0/3988565669 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c012410 con 0x7f2b74069da0 2023-05-10T01:24:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 -- 172.21.15.52:0/3988565669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 msgr2=0x7f2b740c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 --2- 172.21.15.52:0/3988565669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b740c6150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f2b6c009e60 tx=0x7f2b6c009780).stop 2023-05-10T01:24:18.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 -- 172.21.15.52:0/3988565669 shutdown_connections 2023-05-10T01:24:18.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 --2- 172.21.15.52:0/3988565669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b740c6150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 --2- 172.21.15.52:0/3988565669 >> v2:172.21.15.172:3300/0 conn(0x7f2b74154160 0x7f2b740c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 -- 172.21.15.52:0/3988565669 >> 172.21.15.52:0/3988565669 conn(0x7f2b740cb6f0 msgr2=0x7f2b740c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 -- 172.21.15.52:0/3988565669 shutdown_connections 2023-05-10T01:24:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.424+0000 7f2b79c36700 1 -- 172.21.15.52:0/3988565669 wait complete. 2023-05-10T01:24:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.426+0000 7f2b79c36700 1 Processor -- start 2023-05-10T01:24:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.426+0000 7f2b79c36700 1 -- start start 2023-05-10T01:24:18.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b741383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74154160 0x7f2b740adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740ae600 con 0x7f2b74154540 2023-05-10T01:24:18.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74150d30 con 0x7f2b74154160 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741518b0 con 0x7f2b74069da0 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34734/0 (socket says 172.21.15.52:34734) 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 -- 172.21.15.52:0/2954831585 learned_addr learned my addr 172.21.15.52:0/2954831585 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b737fe700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b741383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b72ffd700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74154160 0x7f2b740adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 -- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 msgr2=0x7f2b741383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b741383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 -- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74154160 msgr2=0x7f2b740adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74154160 0x7f2b740adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 -- 172.21.15.52:0/2954831585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c009a20 con 0x7f2b74154540 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b73fff700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f2b740bfe60 tx=0x7f2b6c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00b6f0 con 0x7f2b74154540 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c01d630 con 0x7f2b74154540 2023-05-10T01:24:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b74150f80 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c01d9b0 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.427+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b741515c0 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.429+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2b6c01dd20 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.429+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b740666b0 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.429+0000 7f2b5b7fe700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 0x7f2b54061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.429+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f2b6c07b810 con 0x7f2b74154540 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.429+0000 7f2b737fe700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 0x7f2b54061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.430+0000 7f2b737fe700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 0x7f2b54061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2b7414fce0 tx=0x7f2b64009060).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.433+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b6c04d000 con 0x7f2b74154540 2023-05-10T01:24:18.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.609+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2b74151a20 con 0x7f2b74154540 2023-05-10T01:24:18.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.609+0000 7f2b5b7fe700 1 -- 172.21.15.52:0/2954831585 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2b6c050620 con 0x7f2b74154540 2023-05-10T01:24:18.613 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:24:18.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:24:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 msgr2=0x7f2b54061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 0x7f2b54061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2b7414fce0 tx=0x7f2b64009060).stop 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 msgr2=0x7f2b740ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f2b740bfe60 tx=0x7f2b6c009780).stop 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 shutdown_connections 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2b5405ed90 0x7f2b54061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b74154540 0x7f2b740ae110 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b74069da0 0x7f2b741383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 --2- 172.21.15.52:0/2954831585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74154160 0x7f2b740adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 >> 172.21.15.52:0/2954831585 conn(0x7f2b740cb6f0 msgr2=0x7f2b740c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 shutdown_connections 2023-05-10T01:24:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.611+0000 7f2b79c36700 1 -- 172.21.15.52:0/2954831585 wait complete. 2023-05-10T01:24:18.626 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:24:18.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:24:18.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.744+0000 7f7b5d5c4700 1 Processor -- start 2023-05-10T01:24:18.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.744+0000 7f7b5d5c4700 1 -- start start 2023-05-10T01:24:18.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b5d5c4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7b580c1150 0x7f7b580c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b5d5c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5806a130 con 0x7f7b58153f80 2023-05-10T01:24:18.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b5d5c4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5806a410 con 0x7f7b580c61e0 2023-05-10T01:24:18.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b5d5c4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58069f50 con 0x7f7b580c1150 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b57fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7b58153f80 0x7f7b580a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43754/0 (socket says 172.21.15.52:43754) 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b57fff700 1 -- 172.21.15.52:0/3938481007 learned_addr learned my addr 172.21.15.52:0/3938481007 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721929025 0 0) 0x7f7b5806a130 con 0x7f7b58153f80 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b440033f0 con 0x7f7b58153f80 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b577fe700 1 --2- 172.21.15.52:0/3938481007 >> v2:172.21.15.172:3300/0 conn(0x7f7b580c1150 0x7f7b580c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867266125 0 0) 0x7f7b440033f0 con 0x7f7b58153f80 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 >> v2:172.21.15.172:3300/0 conn(0x7f7b580c1150 msgr2=0x7f7b580c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 --2- 172.21.15.52:0/3938481007 >> v2:172.21.15.172:3300/0 conn(0x7f7b580c1150 0x7f7b580c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 >> v1:172.21.15.172:6789/0 conn(0x7f7b580c61e0 legacy=0x7f7b58154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5806a6f0 con 0x7f7b58153f80 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7b48001470 con 0x7f7b58153f80 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 >> v1:172.21.15.52:6789/0 conn(0x7f7b58153f80 legacy=0x7f7b580a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b440038e0 0x7f7b44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b44004690 0x7f7b44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 0x7f7b4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58069f50 con 0x7f7b44005000 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400be50 con 0x7f7b44004690 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400c010 con 0x7f7b440038e0 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.745+0000 7f7b5cdc3700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 0x7f7b4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b57fff700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b440038e0 0x7f7b44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b577fe700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b44004690 0x7f7b44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 -- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b440038e0 msgr2=0x7f7b44003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b440038e0 0x7f7b44003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 -- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b44004690 msgr2=0x7f7b44004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b44004690 0x7f7b44004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 -- 172.21.15.52:0/3938481007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5806a6f0 con 0x7f7b44005000 2023-05-10T01:24:18.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 -- 172.21.15.52:0/3938481007 reap_dead start 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5cdc3700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 0x7f7b4400b8e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f7b50001e60 tx=0x7f7b50007f30).ready entity=mon.0 client_cookie=29b78e2ffcd257f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50006a20 con 0x7f7b44005000 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50006b80 con 0x7f7b44005000 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b56ffd700 1 -- 172.21.15.52:0/3938481007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000c6a0 con 0x7f7b44005000 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 msgr2=0x7f7b4400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.746+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 0x7f7b4400b8e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f7b50001e60 tx=0x7f7b50007f30).stop 2023-05-10T01:24:18.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.747+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/3938481007 shutdown_connections 2023-05-10T01:24:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.747+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/3938481007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b44005000 0x7f7b4400b8e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.747+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/3938481007 >> 172.21.15.52:0/3938481007 conn(0x7f7b580cb5f0 msgr2=0x7f7b580c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.747+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/3938481007 shutdown_connections 2023-05-10T01:24:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.747+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/3938481007 wait complete. 2023-05-10T01:24:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.748+0000 7f7b5d5c4700 1 Processor -- start 2023-05-10T01:24:18.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.748+0000 7f7b5d5c4700 1 -- start start 2023-05-10T01:24:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b44005000 0x7f7b58150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b580687a0 0x7f7b580afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58164ad0 con 0x7f7b58151070 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58068be0 con 0x7f7b580687a0 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58163ec0 con 0x7f7b44005000 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34752/0 (socket says 172.21.15.52:34752) 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 -- 172.21.15.52:0/2643192944 learned_addr learned my addr 172.21.15.52:0/2643192944 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:18.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5cdc3700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b580687a0 0x7f7b580afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b57fff700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b44005000 0x7f7b58150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 -- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b44005000 msgr2=0x7f7b58150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b44005000 0x7f7b58150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 -- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b580687a0 msgr2=0x7f7b580afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b580687a0 0x7f7b580afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 -- 172.21.15.52:0/2643192944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b581641a0 con 0x7f7b58151070 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b577fe700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7b4c0119f0 tx=0x7f7b4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00f730 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c00f890 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00fc50 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b58164480 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.749+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580b03e0 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.750+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58164c80 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.751+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7b4c024070 con 0x7f7b58151070 2023-05-10T01:24:18.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.751+0000 7f7b3ffff700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 0x7f7b38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.751+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f7b4c07a260 con 0x7f7b58151070 2023-05-10T01:24:18.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.751+0000 7f7b57fff700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 0x7f7b38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.752+0000 7f7b57fff700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 0x7f7b38061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7b48001200 tx=0x7f7b480077c0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:18.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.755+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b58164c80 con 0x7f7b58151070 2023-05-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:18.929+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f7b5805f510 con 0x7f7b58151070 2023-05-10T01:24:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.019+0000 7f7b3ffff700 1 -- 172.21.15.52:0/2643192944 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 152+0+0 (secure 0 0 0) 0x7f7b4c018020 con 0x7f7b58151070 2023-05-10T01:24:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 msgr2=0x7f7b38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 0x7f7b38061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7b48001200 tx=0x7f7b480077c0).stop 2023-05-10T01:24:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 msgr2=0x7f7b580682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7b4c0119f0 tx=0x7f7b4c009060).stop 2023-05-10T01:24:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 shutdown_connections 2023-05-10T01:24:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7b3805ed90 0x7f7b38061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b580687a0 0x7f7b580afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b44005000 0x7f7b58150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 --2- 172.21.15.52:0/2643192944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b58151070 0x7f7b580682b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.021+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 >> 172.21.15.52:0/2643192944 conn(0x7f7b580cb5f0 msgr2=0x7f7b580c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.022+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 shutdown_connections 2023-05-10T01:24:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.022+0000 7f7b5d5c4700 1 -- 172.21.15.52:0/2643192944 wait complete. 2023-05-10T01:24:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:24:19.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:24:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.162+0000 7fa7f12a8700 1 Processor -- start 2023-05-10T01:24:19.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.162+0000 7fa7f12a8700 1 -- start start 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec153cf0 0x7fa7ec063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7ec1540d0 0x7fa7ec0bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7ec0622a0 0x7fa7ec062730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec067f50 con 0x7fa7ec1540d0 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec062c20 con 0x7fa7ec0622a0 2023-05-10T01:24:19.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7f12a8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0a7c80 con 0x7fa7ec153cf0 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7ec1540d0 0x7fa7ec0bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7ec1540d0 0x7fa7ec0bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34760/0 (socket says 172.21.15.52:34760) 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/1566405755 learned_addr learned my addr 172.21.15.52:0/1566405755 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7eaffd700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec153cf0 0x7fa7ec063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7eb7fe700 1 --2- 172.21.15.52:0/1566405755 >> v2:172.21.15.172:3300/0 conn(0x7fa7ec0622a0 0x7fa7ec062730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/1566405755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec153cf0 msgr2=0x7fa7ec063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:19.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec153cf0 0x7fa7ec063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/1566405755 >> v2:172.21.15.172:3300/0 conn(0x7fa7ec0622a0 msgr2=0x7fa7ec062730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/1566405755 >> v2:172.21.15.172:3300/0 conn(0x7fa7ec0622a0 0x7fa7ec062730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.163+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/1566405755 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0a7ef0 con 0x7fa7ec1540d0 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec0bf230 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa7ec0bf000 tx=0x7fa7d40090f0).ready entity=mon.0 client_cookie=28cbce261567b621 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7e9ffb700 1 -- 172.21.15.52:0/1566405755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400f510 con 0x7fa7ec1540d0 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7e9ffb700 1 -- 172.21.15.52:0/1566405755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d400f670 con 0x7fa7ec1540d0 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7e9ffb700 1 -- 172.21.15.52:0/1566405755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400f9f0 con 0x7fa7ec1540d0 2023-05-10T01:24:19.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 -- 172.21.15.52:0/1566405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec1540d0 msgr2=0x7fa7ec0bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec0bf230 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa7ec0bf000 tx=0x7fa7d40090f0).stop 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 -- 172.21.15.52:0/1566405755 shutdown_connections 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/1566405755 >> v2:172.21.15.172:3300/0 conn(0x7fa7ec0622a0 0x7fa7ec062730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec153cf0 0x7fa7ec063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/1566405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec0bf230 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 -- 172.21.15.52:0/1566405755 >> 172.21.15.52:0/1566405755 conn(0x7fa7ec05e810 msgr2=0x7fa7ec0c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 -- 172.21.15.52:0/1566405755 shutdown_connections 2023-05-10T01:24:19.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.164+0000 7fa7f12a8700 1 -- 172.21.15.52:0/1566405755 wait complete. 2023-05-10T01:24:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 Processor -- start 2023-05-10T01:24:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 -- start start 2023-05-10T01:24:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec0622a0 0x7fa7ec141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0ad050 con 0x7fa7ec153cf0 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0ac440 con 0x7fa7ec1540d0 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.166+0000 7fa7f12a8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0ac720 con 0x7fa7ec0622a0 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34766/0 (socket says 172.21.15.52:34766) 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/3996143767 learned_addr learned my addr 172.21.15.52:0/3996143767 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7eaffd700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec0622a0 0x7fa7ec141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7eb7fe700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec0622a0 msgr2=0x7fa7ec141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec0622a0 0x7fa7ec141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec1540d0 msgr2=0x7fa7ec167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 -- 172.21.15.52:0/3996143767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4009370 con 0x7fa7ec153cf0 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7ea7fc700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa7d4011000 tx=0x7fa7d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:19.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400f7e0 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d400f940 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d401c670 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec0aca00 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.167+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1419f0 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.168+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0ad3c0 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.169+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa7d4022020 con 0x7fa7ec153cf0 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.169+0000 7fa7e2ffd700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 0x7fa7d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:19.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.169+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5903+0+0 (secure 0 0 0) 0x7fa7d407aa10 con 0x7fa7ec153cf0 2023-05-10T01:24:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.169+0000 7fa7eaffd700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 0x7fa7d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.170+0000 7fa7eaffd700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 0x7fa7d0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa7e4009bc0 tx=0x7fa7e4008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.173+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7d404c090 con 0x7fa7ec153cf0 2023-05-10T01:24:19.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:19.347+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa7ec0ad190 con 0x7fa7ec153cf0 2023-05-10T01:24:20.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.029+0000 7fa7e2ffd700 1 -- 172.21.15.52:0/3996143767 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7d404f6b0 con 0x7fa7ec153cf0 2023-05-10T01:24:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.049+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 msgr2=0x7fa7d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.049+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 0x7fa7d0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa7e4009bc0 tx=0x7fa7e4008040).stop 2023-05-10T01:24:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.049+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 msgr2=0x7fa7ec0a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.049+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa7d4011000 tx=0x7fa7d4017000).stop 2023-05-10T01:24:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 shutdown_connections 2023-05-10T01:24:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7d005ed90 0x7fa7d0061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec1540d0 0x7fa7ec167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7ec0622a0 0x7fa7ec141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 --2- 172.21.15.52:0/3996143767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec153cf0 0x7fa7ec0a4870 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 >> 172.21.15.52:0/3996143767 conn(0x7fa7ec05e810 msgr2=0x7fa7ec0c4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 shutdown_connections 2023-05-10T01:24:20.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.050+0000 7fa7f12a8700 1 -- 172.21.15.52:0/3996143767 wait complete. 2023-05-10T01:24:20.058 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:24:20.069 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:24:20.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.191+0000 7f3b98718700 1 Processor -- start 2023-05-10T01:24:20.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.191+0000 7f3b98718700 1 -- start start 2023-05-10T01:24:20.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b98718700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b900cb410 0x7f3b901544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b98718700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b90155570 0x7f3b90068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b98718700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b900c6310 con 0x7f3b90154110 2023-05-10T01:24:20.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b98718700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900c6830 con 0x7f3b900cb410 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b98718700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b901550e0 con 0x7f3b90155570 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b95cb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b900cb410 0x7f3b901544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b964b4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b90154110 0x7f3b900c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43788/0 (socket says 172.21.15.52:43788) 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b964b4700 1 -- 172.21.15.52:0/1459238617 learned_addr learned my addr 172.21.15.52:0/1459238617 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b96cb5700 1 --2- 172.21.15.52:0/1459238617 >> v2:172.21.15.172:3300/0 conn(0x7f3b90155570 0x7f3b90068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b95cb3700 1 -- 172.21.15.52:0/1459238617 >> v2:172.21.15.172:3300/0 conn(0x7f3b90155570 msgr2=0x7f3b90068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b95cb3700 1 --2- 172.21.15.52:0/1459238617 >> v2:172.21.15.172:3300/0 conn(0x7f3b90155570 0x7f3b90068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b95cb3700 1 -- 172.21.15.52:0/1459238617 >> v1:172.21.15.52:6789/0 conn(0x7f3b90154110 legacy=0x7f3b900c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b954b2700 1 -- 172.21.15.52:0/1459238617 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934380632 0 0) 0x7f3b8c001290 con 0x7f3b90154110 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.192+0000 7f3b95cb3700 1 -- 172.21.15.52:0/1459238617 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900c6550 con 0x7f3b900cb410 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b95cb3700 1 --2- 172.21.15.52:0/1459238617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b900cb410 0x7f3b901544f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f3b900aa6b0 tx=0x7f3b80009060).ready entity=mon.0 client_cookie=47ff7e5c8d85f1b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b954b2700 1 -- 172.21.15.52:0/1459238617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000b580 con 0x7f3b900cb410 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b954b2700 1 -- 172.21.15.52:0/1459238617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000b6e0 con 0x7f3b900cb410 2023-05-10T01:24:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b954b2700 1 -- 172.21.15.52:0/1459238617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000ba60 con 0x7f3b900cb410 2023-05-10T01:24:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 -- 172.21.15.52:0/1459238617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b900cb410 msgr2=0x7f3b901544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 --2- 172.21.15.52:0/1459238617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b900cb410 0x7f3b901544f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f3b900aa6b0 tx=0x7f3b80009060).stop 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 -- 172.21.15.52:0/1459238617 shutdown_connections 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 --2- 172.21.15.52:0/1459238617 >> v2:172.21.15.172:3300/0 conn(0x7f3b90155570 0x7f3b90068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 --2- 172.21.15.52:0/1459238617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b900cb410 0x7f3b901544f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 -- 172.21.15.52:0/1459238617 >> 172.21.15.52:0/1459238617 conn(0x7f3b900678d0 msgr2=0x7f3b900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 -- 172.21.15.52:0/1459238617 shutdown_connections 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.193+0000 7f3b98718700 1 -- 172.21.15.52:0/1459238617 wait complete. 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.194+0000 7f3b98718700 1 Processor -- start 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.194+0000 7f3b98718700 1 -- start start 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900cb410 0x7f3b900c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b90155570 0x7f3b900ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90149f10 con 0x7f3b90154110 2023-05-10T01:24:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900c2f70 con 0x7f3b900cb410 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b98718700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900c3250 con 0x7f3b90155570 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b95cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b95cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34778/0 (socket says 172.21.15.52:34778) 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b95cb3700 1 -- 172.21.15.52:0/3869049294 learned_addr learned my addr 172.21.15.52:0/3869049294 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b964b4700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900cb410 0x7f3b900c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b96cb5700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b90155570 0x7f3b900ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b95cb3700 1 -- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b90155570 msgr2=0x7f3b900ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.195+0000 7f3b95cb3700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b90155570 0x7f3b900ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b95cb3700 1 -- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900cb410 msgr2=0x7f3b900c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b95cb3700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900cb410 0x7f3b900c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b95cb3700 1 -- 172.21.15.52:0/3869049294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800092a0 con 0x7f3b90154110 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b95cb3700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f3b90083c40 tx=0x7f3b80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000b850 con 0x7f3b90154110 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000b9b0 con 0x7f3b90154110 2023-05-10T01:24:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b900c3530 con 0x7f3b90154110 2023-05-10T01:24:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8001b620 con 0x7f3b90154110 2023-05-10T01:24:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.196+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900c3af0 con 0x7f3b90154110 2023-05-10T01:24:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.197+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b90066720 con 0x7f3b90154110 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.198+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b8002b070 con 0x7f3b90154110 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.198+0000 7f3b7e7fc700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 0x7f3b70061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.198+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6285+0+0 (secure 0 0 0) 0x7f3b8007b5a0 con 0x7f3b90154110 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.198+0000 7f3b964b4700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 0x7f3b70061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.198+0000 7f3b964b4700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 0x7f3b70061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b8c007840 tx=0x7f3b8c009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.202+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b8004caa0 con 0x7f3b90154110 2023-05-10T01:24:20.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.419+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b900c3d10 con 0x7f3b90154110 2023-05-10T01:24:20.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.425+0000 7f3b7e7fc700 1 -- 172.21.15.52:0/3869049294 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3b800290c0 con 0x7f3b90154110 2023-05-10T01:24:20.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.429+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 msgr2=0x7f3b70061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.429+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 0x7f3b70061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b8c007840 tx=0x7f3b8c009040).stop 2023-05-10T01:24:20.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.429+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 msgr2=0x7f3b90149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.429+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f3b90083c40 tx=0x7f3b80017000).stop 2023-05-10T01:24:20.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 shutdown_connections 2023-05-10T01:24:20.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b7005ed90 0x7f3b70061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b90155570 0x7f3b900ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900cb410 0x7f3b900c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 --2- 172.21.15.52:0/3869049294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b90154110 0x7f3b90149a20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.431+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 >> 172.21.15.52:0/3869049294 conn(0x7f3b900678d0 msgr2=0x7f3b900c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.432+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 shutdown_connections 2023-05-10T01:24:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.432+0000 7f3b98718700 1 -- 172.21.15.52:0/3869049294 wait complete. 2023-05-10T01:24:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 9 and data pool 10 2023-05-10T01:24:20.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:20.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.574+0000 7f94a27ce700 1 Processor -- start 2023-05-10T01:24:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 -- start start 2023-05-10T01:24:20.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f949c153d90 0x7f949c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f949c154170 0x7f949c0699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c063340 con 0x7f949c063710 2023-05-10T01:24:20.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c068440 con 0x7f949c153d90 2023-05-10T01:24:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f94a27ce700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c062eb0 con 0x7f949c154170 2023-05-10T01:24:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.575+0000 7f949bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f949c153d90 0x7f949c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f949c153d90 0x7f949c067f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34786/0 (socket says 172.21.15.52:34786) 2023-05-10T01:24:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 -- 172.21.15.52:0/3363893251 learned_addr learned my addr 172.21.15.52:0/3363893251 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 -- 172.21.15.52:0/3363893251 >> v2:172.21.15.172:3300/0 conn(0x7f949c154170 msgr2=0x7f949c0699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 --2- 172.21.15.52:0/3363893251 >> v2:172.21.15.172:3300/0 conn(0x7f949c154170 0x7f949c0699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:20.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 -- 172.21.15.52:0/3363893251 >> v1:172.21.15.172:6789/0 conn(0x7f949c063710 legacy=0x7f949c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:20.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 -- 172.21.15.52:0/3363893251 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0622a0 con 0x7f949c153d90 2023-05-10T01:24:20.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949bfff700 1 --2- 172.21.15.52:0/3363893251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c067f50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f949c05fc90 tx=0x7f948c0090f0).ready entity=mon.0 client_cookie=a4c496b939f6f2ad server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949b7fe700 1 -- 172.21.15.52:0/3363893251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00b5a0 con 0x7f949c153d90 2023-05-10T01:24:20.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949b7fe700 1 -- 172.21.15.52:0/3363893251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00b700 con 0x7f949c153d90 2023-05-10T01:24:20.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.576+0000 7f949b7fe700 1 -- 172.21.15.52:0/3363893251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00ba80 con 0x7f949c153d90 2023-05-10T01:24:20.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 -- 172.21.15.52:0/3363893251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 msgr2=0x7f949c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3363893251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c067f50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f949c05fc90 tx=0x7f948c0090f0).stop 2023-05-10T01:24:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 -- 172.21.15.52:0/3363893251 shutdown_connections 2023-05-10T01:24:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3363893251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c067f50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3363893251 >> v2:172.21.15.172:3300/0 conn(0x7f949c154170 0x7f949c0699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:20.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 -- 172.21.15.52:0/3363893251 >> 172.21.15.52:0/3363893251 conn(0x7f949c0c8a90 msgr2=0x7f949c0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 -- 172.21.15.52:0/3363893251 shutdown_connections 2023-05-10T01:24:20.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.577+0000 7f94a27ce700 1 -- 172.21.15.52:0/3363893251 wait complete. 2023-05-10T01:24:20.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 Processor -- start 2023-05-10T01:24:20.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 -- start start 2023-05-10T01:24:20.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 0x7f949c164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f949c0c1300 0x7f949c0c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0ac230 con 0x7f949c153d90 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c1c50 con 0x7f949c0c1300 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.578+0000 7f94a27ce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c0980 con 0x7f949c063710 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34794/0 (socket says 172.21.15.52:34794) 2023-05-10T01:24:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 -- 172.21.15.52:0/3043999973 learned_addr learned my addr 172.21.15.52:0/3043999973 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f949bfff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 0x7f949c164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f94a0d6b700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f949c0c1300 0x7f949c0c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 -- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 msgr2=0x7f949c164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 0x7f949c164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 -- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f949c0c1300 msgr2=0x7f949c0c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f949c0c1300 0x7f949c0c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 -- 172.21.15.52:0/3043999973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009370 con 0x7f949c153d90 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f949bfff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 0x7f949c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9493fff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f948400b490 tx=0x7f9484009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484002320 con 0x7f949c153d90 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484002480 con 0x7f949c153d90 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c0abbe0 con 0x7f949c153d90 2023-05-10T01:24:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484002840 con 0x7f949c153d90 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.579+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c167440 con 0x7f949c153d90 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.580+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0aba40 con 0x7f949c153d90 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.580+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f948400f030 con 0x7f949c153d90 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.581+0000 7f9498ff9700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 0x7f9480061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.581+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9484079930 con 0x7f949c153d90 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.581+0000 7f949bfff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 0x7f9480061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.581+0000 7f949bfff700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 0x7f9480061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f948c009130 tx=0x7f948c015000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.585+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f949c0aba40 con 0x7f949c153d90 2023-05-10T01:24:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.759+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949c0aba40 con 0x7f949c153d90 2023-05-10T01:24:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.760+0000 7f9498ff9700 1 -- 172.21.15.52:0/3043999973 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17442 (secure 0 0 0) 0x7f949c0aba40 con 0x7f949c153d90 2023-05-10T01:24:20.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:20.764 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:20.421782+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 msgr2=0x7f9480061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 0x7f9480061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f948c009130 tx=0x7f948c015000).stop 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 msgr2=0x7f949c166f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f948400b490 tx=0x7f9484009060).stop 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 shutdown_connections 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f948005ed60 0x7f9480061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f949c0c1300 0x7f949c0c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f949c063710 0x7f949c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 --2- 172.21.15.52:0/3043999973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f949c153d90 0x7f949c166f50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.761+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 >> 172.21.15.52:0/3043999973 conn(0x7f949c0c8a90 msgr2=0x7f949c152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.762+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 shutdown_connections 2023-05-10T01:24:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.762+0000 7f94a27ce700 1 -- 172.21.15.52:0/3043999973 wait complete. 2023-05-10T01:24:20.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:20.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.890+0000 7f81137c4700 1 Processor -- start 2023-05-10T01:24:20.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.890+0000 7f81137c4700 1 -- start start 2023-05-10T01:24:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f81137c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f810c069da0 0x7f810c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f81137c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0c0650 con 0x7f810c154540 2023-05-10T01:24:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f81137c4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0c1af0 con 0x7f810c154160 2023-05-10T01:24:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f81137c4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0bfd20 con 0x7f810c069da0 2023-05-10T01:24:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8111d61700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f810c069da0 0x7f810c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8110d5f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f810c154540 0x7f810c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43818/0 (socket says 172.21.15.52:43818) 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8110d5f700 1 -- 172.21.15.52:0/3195544466 learned_addr learned my addr 172.21.15.52:0/3195544466 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8111d61700 1 -- 172.21.15.52:0/3195544466 >> v1:172.21.15.172:6789/0 conn(0x7f810c154160 legacy=0x7f810c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8111d61700 1 -- 172.21.15.52:0/3195544466 >> v1:172.21.15.52:6789/0 conn(0x7f810c154540 legacy=0x7f810c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.891+0000 7f8111d61700 1 -- 172.21.15.52:0/3195544466 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0c0000 con 0x7f810c069da0 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f8111d61700 1 --2- 172.21.15.52:0/3195544466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c15f1f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f80fc009e60 tx=0x7f80fc009780).ready entity=mon.0 client_cookie=51bf93a129ed69fd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f810bfff700 1 -- 172.21.15.52:0/3195544466 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00e070 con 0x7f810c069da0 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f810bfff700 1 -- 172.21.15.52:0/3195544466 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc00bc30 con 0x7f810c069da0 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f810bfff700 1 -- 172.21.15.52:0/3195544466 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc012410 con 0x7f810c069da0 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 -- 172.21.15.52:0/3195544466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 msgr2=0x7f810c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 --2- 172.21.15.52:0/3195544466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c15f1f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f80fc009e60 tx=0x7f80fc009780).stop 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 -- 172.21.15.52:0/3195544466 shutdown_connections 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 --2- 172.21.15.52:0/3195544466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c15f1f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 -- 172.21.15.52:0/3195544466 >> 172.21.15.52:0/3195544466 conn(0x7f810c0cb6f0 msgr2=0x7f810c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 -- 172.21.15.52:0/3195544466 shutdown_connections 2023-05-10T01:24:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.892+0000 7f81137c4700 1 -- 172.21.15.52:0/3195544466 wait complete. 2023-05-10T01:24:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.893+0000 7f81137c4700 1 Processor -- start 2023-05-10T01:24:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.893+0000 7f81137c4700 1 -- start start 2023-05-10T01:24:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810c154160 0x7f810c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f810c154540 0x7f810c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0af860 con 0x7f810c069da0 2023-05-10T01:24:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c168670 con 0x7f810c154540 2023-05-10T01:24:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f81137c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c154950 con 0x7f810c154160 2023-05-10T01:24:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f8111560700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f8111560700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34806/0 (socket says 172.21.15.52:34806) 2023-05-10T01:24:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.894+0000 7f8111560700 1 -- 172.21.15.52:0/2667198081 learned_addr learned my addr 172.21.15.52:0/2667198081 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111d61700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f810c154540 0x7f810c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8110d5f700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810c154160 0x7f810c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 -- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810c154160 msgr2=0x7f810c0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810c154160 0x7f810c0aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 -- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f810c154540 msgr2=0x7f810c0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f810c154540 0x7f810c0af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 -- 172.21.15.52:0/2667198081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc009a20 con 0x7f810c069da0 2023-05-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f8111560700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f810400c470 tx=0x7f8104007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400f470 con 0x7f810c069da0 2023-05-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400f5d0 con 0x7f810c069da0 2023-05-10T01:24:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c167a80 con 0x7f810c069da0 2023-05-10T01:24:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400f970 con 0x7f810c069da0 2023-05-10T01:24:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.895+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c168020 con 0x7f810c069da0 2023-05-10T01:24:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.896+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0666b0 con 0x7f810c069da0 2023-05-10T01:24:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.896+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8104019030 con 0x7f810c069da0 2023-05-10T01:24:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.897+0000 7f81097fa700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 0x7f80ec061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.897+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f8104078f90 con 0x7f810c069da0 2023-05-10T01:24:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.897+0000 7f8110d5f700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 0x7f80ec061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.897+0000 7f8110d5f700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 0x7f80ec061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f810c1679e0 tx=0x7f8100009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:20.901+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81040488f0 con 0x7f810c069da0 2023-05-10T01:24:21.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.072+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f810c06c340 con 0x7f810c069da0 2023-05-10T01:24:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.073+0000 7f81097fa700 1 -- 172.21.15.52:0/2667198081 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17442 (secure 0 0 0) 0x7f8104017030 con 0x7f810c069da0 2023-05-10T01:24:21.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:21.078 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:20.421782+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 msgr2=0x7f80ec061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 0x7f80ec061220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f810c1679e0 tx=0x7f8100009040).stop 2023-05-10T01:24:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 msgr2=0x7f810c152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f810400c470 tx=0x7f8104007dc0).stop 2023-05-10T01:24:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 shutdown_connections 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f80ec05ed60 0x7f80ec061220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f810c154540 0x7f810c0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f810c069da0 0x7f810c152f00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 --2- 172.21.15.52:0/2667198081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810c154160 0x7f810c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 >> 172.21.15.52:0/2667198081 conn(0x7f810c0cb6f0 msgr2=0x7f810c14dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 shutdown_connections 2023-05-10T01:24:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.075+0000 7f81137c4700 1 -- 172.21.15.52:0/2667198081 wait complete. 2023-05-10T01:24:21.091 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:24:21.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.207+0000 7f276609b700 1 Processor -- start 2023-05-10T01:24:21.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.207+0000 7f276609b700 1 -- start start 2023-05-10T01:24:21.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f276609b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f27600aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f276609b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27600c94c0 con 0x7f2760154460 2023-05-10T01:24:21.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f276609b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27600cb7d0 con 0x7f2760154080 2023-05-10T01:24:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f276609b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c88b0 con 0x7f2760068860 2023-05-10T01:24:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275effd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2760154460 0x7f2760068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43832/0 (socket says 172.21.15.52:43832) 2023-05-10T01:24:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275effd700 1 -- 172.21.15.52:0/1630566240 learned_addr learned my addr 172.21.15.52:0/1630566240 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084678907 0 0) 0x7f27600c94c0 con 0x7f2760154460 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c0033f0 con 0x7f2760154460 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275ffff700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f27600aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731693351 0 0) 0x7f274c0033f0 con 0x7f2760154460 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 msgr2=0x7f27600aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f27600aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 >> v1:172.21.15.172:6789/0 conn(0x7f2760154080 legacy=0x7f27600a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600c8b90 con 0x7f2760154460 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.208+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f2754001470 con 0x7f2760154460 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 >> v1:172.21.15.52:6789/0 conn(0x7f2760154460 legacy=0x7f2760068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f274c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f274c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f274c004b80 0x7f274c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c88b0 con 0x7f274c003eb0 2023-05-10T01:24:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c00b990 con 0x7f274c004b80 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c00bb50 con 0x7f2760068860 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f274c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275f7fe700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f274c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275ffff700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f274c004b80 0x7f274c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 -- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 msgr2=0x7f274c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2760068860 0x7f274c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 -- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f274c004b80 msgr2=0x7f274c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f274c004b80 0x7f274c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 -- 172.21.15.52:0/1630566240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0033f0 con 0x7f274c003eb0 2023-05-10T01:24:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275effd700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f274c004690 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f275400c190 tx=0x7f2754001e70).ready entity=mon.0 client_cookie=ff4f88187fa5b89a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754007a40 con 0x7f274c003eb0 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275400cac0 con 0x7f274c003eb0 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.209+0000 7f275e7fc700 1 -- 172.21.15.52:0/1630566240 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275400ce40 con 0x7f274c003eb0 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 -- 172.21.15.52:0/1630566240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 msgr2=0x7f274c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 --2- 172.21.15.52:0/1630566240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f274c004690 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f275400c190 tx=0x7f2754001e70).stop 2023-05-10T01:24:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f275ffff700 1 -- 172.21.15.52:0/1630566240 reap_dead start 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 -- 172.21.15.52:0/1630566240 shutdown_connections 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 -- 172.21.15.52:0/1630566240 >> 172.21.15.52:0/1630566240 conn(0x7f2760067910 msgr2=0x7f27600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 -- 172.21.15.52:0/1630566240 shutdown_connections 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.210+0000 7f276609b700 1 -- 172.21.15.52:0/1630566240 wait complete. 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.211+0000 7f276609b700 1 Processor -- start 2023-05-10T01:24:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.211+0000 7f276609b700 1 -- start start 2023-05-10T01:24:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f276014d300 0x7f276014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27600c5a70 0x7f27600c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c2690 con 0x7f274c003eb0 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c3e10 con 0x7f27600c5a70 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c2e30 con 0x7f276014d300 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34826/0 (socket says 172.21.15.52:34826) 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 -- 172.21.15.52:0/671463781 learned_addr learned my addr 172.21.15.52:0/671463781 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275ffff700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27600c5a70 0x7f27600c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275effd700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f276014d300 0x7f276014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 -- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f276014d300 msgr2=0x7f276014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f276014d300 0x7f276014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 -- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27600c5a70 msgr2=0x7f27600c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27600c5a70 0x7f27600c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 -- 172.21.15.52:0/671463781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600ae070 con 0x7f274c003eb0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f275f7fe700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f2750002a30 tx=0x7f2750007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750003340 con 0x7f274c003eb0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275000f6c0 con 0x7f274c003eb0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.212+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27600c63e0 con 0x7f274c003eb0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.213+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275000fa40 con 0x7f274c003eb0 2023-05-10T01:24:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.213+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27600c2b50 con 0x7f274c003eb0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.213+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600c6fb0 con 0x7f274c003eb0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.214+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f275001b030 con 0x7f274c003eb0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.214+0000 7f27477fe700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 0x7f2740061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.214+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f2750079860 con 0x7f274c003eb0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.215+0000 7f275effd700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 0x7f2740061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.215+0000 7f275effd700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 0x7f2740061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2754001eb0 tx=0x7f2754015000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.218+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f275004e6c0 con 0x7f274c003eb0 2023-05-10T01:24:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:21.435+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2760066720 con 0x7f274c003eb0 2023-05-10T01:24:21.526 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:21.523+0000 7fd7ca918700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:24:22.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.427+0000 7f27477fe700 1 -- 172.21.15.52:0/671463781 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f275004e2b0 con 0x7f274c003eb0 2023-05-10T01:24:22.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 msgr2=0x7f2740061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 0x7f2740061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2754001eb0 tx=0x7f2754015000).stop 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 msgr2=0x7f27600c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f2750002a30 tx=0x7f2750007b90).stop 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 shutdown_connections 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f274005ed90 0x7f2740061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27600c5a70 0x7f27600c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f274c003eb0 0x7f27600c3920 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 --2- 172.21.15.52:0/671463781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f276014d300 0x7f276014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 >> 172.21.15.52:0/671463781 conn(0x7f2760067910 msgr2=0x7f27600ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 shutdown_connections 2023-05-10T01:24:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.429+0000 7f276609b700 1 -- 172.21.15.52:0/671463781 wait complete. 2023-05-10T01:24:22.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:24:22.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.571+0000 7fceba03d700 1 Processor -- start 2023-05-10T01:24:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.571+0000 7fceba03d700 1 -- start start 2023-05-10T01:24:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceba03d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 0x7fceb40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceba03d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406a130 con 0x7fceb40c5cf0 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceba03d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406a410 con 0x7fceb4155370 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceba03d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4069f50 con 0x7fceb4153f80 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceb883a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fceb40c5cf0 0x7fceb40c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43850/0 (socket says 172.21.15.52:43850) 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceb883a700 1 -- 172.21.15.52:0/2584017165 learned_addr learned my addr 172.21.15.52:0/2584017165 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceb903b700 1 --2- 172.21.15.52:0/2584017165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 0x7fceb40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345147762 0 0) 0x7fceb406a130 con 0x7fceb40c5cf0 2023-05-10T01:24:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.572+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea00033f0 con 0x7fceb40c5cf0 2023-05-10T01:24:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181785378 0 0) 0x7fceb406a410 con 0x7fceb4155370 2023-05-10T01:24:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb406a130 con 0x7fceb4155370 2023-05-10T01:24:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035225794 0 0) 0x7fcea00033f0 con 0x7fceb40c5cf0 2023-05-10T01:24:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb903b700 1 -- 172.21.15.52:0/2584017165 >> v1:172.21.15.172:6789/0 conn(0x7fceb4155370 legacy=0x7fceb40c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb903b700 1 -- 172.21.15.52:0/2584017165 >> v1:172.21.15.52:6789/0 conn(0x7fceb40c5cf0 legacy=0x7fceb40c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb903b700 1 -- 172.21.15.52:0/2584017165 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb406a6f0 con 0x7fceb4153f80 2023-05-10T01:24:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb903b700 1 --2- 172.21.15.52:0/2584017165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 0x7fceb40a9d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fceac009790 tx=0x7fceac009060).ready entity=mon.2 client_cookie=7dd81470f2ed84fe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8001470 con 0x7fceb4153f80 2023-05-10T01:24:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011400 con 0x7fceb4153f80 2023-05-10T01:24:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceb3fff700 1 -- 172.21.15.52:0/2584017165 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011780 con 0x7fceb4153f80 2023-05-10T01:24:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceba03d700 1 -- 172.21.15.52:0/2584017165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 msgr2=0x7fceb40a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceba03d700 1 --2- 172.21.15.52:0/2584017165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 0x7fceb40a9d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fceac009790 tx=0x7fceac009060).stop 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceba03d700 1 -- 172.21.15.52:0/2584017165 shutdown_connections 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceba03d700 1 --2- 172.21.15.52:0/2584017165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb4153f80 0x7fceb40a9d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.573+0000 7fceba03d700 1 -- 172.21.15.52:0/2584017165 >> 172.21.15.52:0/2584017165 conn(0x7fceb40cb5f0 msgr2=0x7fceb40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.574+0000 7fceba03d700 1 -- 172.21.15.52:0/2584017165 shutdown_connections 2023-05-10T01:24:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.574+0000 7fceba03d700 1 -- 172.21.15.52:0/2584017165 wait complete. 2023-05-10T01:24:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.575+0000 7fceba03d700 1 Processor -- start 2023-05-10T01:24:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.575+0000 7fceba03d700 1 -- start start 2023-05-10T01:24:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.575+0000 7fceba03d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb40c5cf0 0x7fceb4144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb4155370 0x7fceb40c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40c0a20 con 0x7fceb4153f80 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40af210 con 0x7fceb4155370 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40af4f0 con 0x7fceb40c5cf0 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34840/0 (socket says 172.21.15.52:34840) 2023-05-10T01:24:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 -- 172.21.15.52:0/2589141145 learned_addr learned my addr 172.21.15.52:0/2589141145 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb983c700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb4155370 0x7fceb40c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb903b700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb40c5cf0 0x7fceb4144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 -- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb40c5cf0 msgr2=0x7fceb4144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb40c5cf0 0x7fceb4144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 -- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb4155370 msgr2=0x7fceb40c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb4155370 0x7fceb40c0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 -- 172.21.15.52:0/2589141145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0092a0 con 0x7fceb4153f80 2023-05-10T01:24:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb883a700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcea800c790 tx=0x7fcea8001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8007320 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8007480 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb40af7d0 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80059d0 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.576+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb40afd90 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.577+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4083110 con 0x7fceb4153f80 2023-05-10T01:24:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.578+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcea8010030 con 0x7fceb4153f80 2023-05-10T01:24:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.578+0000 7fceb17fa700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 0x7fce94061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.578+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fcea8079be0 con 0x7fceb4153f80 2023-05-10T01:24:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.578+0000 7fceb903b700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 0x7fce94061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.579+0000 7fceb903b700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 0x7fce94061220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fceac00a010 tx=0x7fceac016000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.582+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcea804b070 con 0x7fceb4153f80 2023-05-10T01:24:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:22.797+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fceb40affb0 con 0x7fceb4153f80 2023-05-10T01:24:23.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.434+0000 7fceb17fa700 1 -- 172.21.15.52:0/2589141145 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcea804e690 con 0x7fceb4153f80 2023-05-10T01:24:23.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 msgr2=0x7fce94061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 0x7fce94061220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fceac00a010 tx=0x7fceac016000).stop 2023-05-10T01:24:23.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 msgr2=0x7fceb40c0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcea800c790 tx=0x7fcea8001a50).stop 2023-05-10T01:24:23.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 shutdown_connections 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce9405ed60 0x7fce94061220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb4155370 0x7fceb40c0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb40c5cf0 0x7fceb4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 --2- 172.21.15.52:0/2589141145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb4153f80 0x7fceb40c0040 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 >> 172.21.15.52:0/2589141145 conn(0x7fceb40cb5f0 msgr2=0x7fceb4152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 shutdown_connections 2023-05-10T01:24:23.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.436+0000 7fceba03d700 1 -- 172.21.15.52:0/2589141145 wait complete. 2023-05-10T01:24:23.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.576+0000 7f9201bcd700 1 Processor -- start 2023-05-10T01:24:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 -- start start 2023-05-10T01:24:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91fc154160 0x7f91fc0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91fc0c5ca0 0x7f91fc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0c6640 con 0x7f91fc154540 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0ab1f0 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f9201bcd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0c08a0 con 0x7f91fc154160 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.577+0000 7f91fbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91fc0c5ca0 0x7f91fc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91faffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f91fc154540 0x7f91fc0a9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43866/0 (socket says 172.21.15.52:43866) 2023-05-10T01:24:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91faffd700 1 -- 172.21.15.52:0/2158003392 learned_addr learned my addr 172.21.15.52:0/2158003392 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fb7fe700 1 --2- 172.21.15.52:0/2158003392 >> v2:172.21.15.172:3300/0 conn(0x7f91fc154160 0x7f91fc0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fa7fc700 1 -- 172.21.15.52:0/2158003392 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471533634 0 0) 0x7f91f0001110 con 0x7f91fc154540 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fa7fc700 1 -- 172.21.15.52:0/2158003392 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e80033f0 con 0x7f91fc154540 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fbfff700 1 -- 172.21.15.52:0/2158003392 >> v2:172.21.15.172:3300/0 conn(0x7f91fc154160 msgr2=0x7f91fc0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fbfff700 1 --2- 172.21.15.52:0/2158003392 >> v2:172.21.15.172:3300/0 conn(0x7f91fc154160 0x7f91fc0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fbfff700 1 -- 172.21.15.52:0/2158003392 >> v1:172.21.15.52:6789/0 conn(0x7f91fc154540 legacy=0x7f91fc0a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fbfff700 1 -- 172.21.15.52:0/2158003392 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0bfc90 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fbfff700 1 --2- 172.21.15.52:0/2158003392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc0c5ca0 0x7f91fc0c6150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f91fc083020 tx=0x7f91f4009780).ready entity=mon.0 client_cookie=546931b73adaa2ba server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fa7fc700 1 -- 172.21.15.52:0/2158003392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400e070 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fa7fc700 1 -- 172.21.15.52:0/2158003392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400bb60 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.578+0000 7f91fa7fc700 1 -- 172.21.15.52:0/2158003392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4012410 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 -- 172.21.15.52:0/2158003392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc0c5ca0 msgr2=0x7f91fc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 --2- 172.21.15.52:0/2158003392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc0c5ca0 0x7f91fc0c6150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f91fc083020 tx=0x7f91f4009780).stop 2023-05-10T01:24:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 -- 172.21.15.52:0/2158003392 shutdown_connections 2023-05-10T01:24:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 --2- 172.21.15.52:0/2158003392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc0c5ca0 0x7f91fc0c6150 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 --2- 172.21.15.52:0/2158003392 >> v2:172.21.15.172:3300/0 conn(0x7f91fc154160 0x7f91fc0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 -- 172.21.15.52:0/2158003392 >> 172.21.15.52:0/2158003392 conn(0x7f91fc0cb6c0 msgr2=0x7f91fc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 -- 172.21.15.52:0/2158003392 shutdown_connections 2023-05-10T01:24:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.579+0000 7f9201bcd700 1 -- 172.21.15.52:0/2158003392 wait complete. 2023-05-10T01:24:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.580+0000 7f9201bcd700 1 Processor -- start 2023-05-10T01:24:23.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.580+0000 7f9201bcd700 1 -- start start 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91fc0c5ca0 0x7f91fc16bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91fc154160 0x7f91fc0ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0ace70 con 0x7f91fc154540 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc16c5d0 con 0x7f91fc154160 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f9201bcd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc16c8b0 con 0x7f91fc0c5ca0 2023-05-10T01:24:23.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34856/0 (socket says 172.21.15.52:34856) 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 -- 172.21.15.52:0/4243545287 learned_addr learned my addr 172.21.15.52:0/4243545287 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91faffd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91fc154160 0x7f91fc0ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fb7fe700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91fc0c5ca0 0x7f91fc16bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 -- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91fc0c5ca0 msgr2=0x7f91fc16bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91fc0c5ca0 0x7f91fc16bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 -- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91fc154160 msgr2=0x7f91fc0ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91fc154160 0x7f91fc0ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.581+0000 7f91fbfff700 1 -- 172.21.15.52:0/4243545287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4009a20 con 0x7f91fc154540 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f91fbfff700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f91fc084210 tx=0x7f91f4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f401d630 con 0x7f91fc154540 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f401d790 con 0x7f91fc154540 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f401db30 con 0x7f91fc154540 2023-05-10T01:24:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc16cb90 con 0x7f91fc154540 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.582+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc168b30 con 0x7f91fc154540 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.583+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc0666b0 con 0x7f91fc154540 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.583+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f91f4027460 con 0x7f91fc154540 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.584+0000 7f91e37fe700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 0x7f91dc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.584+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f91f407c150 con 0x7f91fc154540 2023-05-10T01:24:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.584+0000 7f91fb7fe700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 0x7f91dc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.584+0000 7f91fb7fe700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 0x7f91dc061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f91ec00bb00 tx=0x7f91ec008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.588+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91f404d470 con 0x7f91fc154540 2023-05-10T01:24:23.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.802+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91fc168d20 con 0x7f91fc154540 2023-05-10T01:24:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.803+0000 7f91e37fe700 1 -- 172.21.15.52:0/4243545287 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f91f4050a90 con 0x7f91fc154540 2023-05-10T01:24:23.807 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:23.807 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.804+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 msgr2=0x7f91dc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.804+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 0x7f91dc061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f91ec00bb00 tx=0x7f91ec008040).stop 2023-05-10T01:24:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 msgr2=0x7f91fc159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f91fc084210 tx=0x7f91f4009780).stop 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 shutdown_connections 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f91dc05ed60 0x7f91dc061220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91fc154540 0x7f91fc159230 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91fc0c5ca0 0x7f91fc16bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 --2- 172.21.15.52:0/4243545287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91fc154160 0x7f91fc0ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 >> 172.21.15.52:0/4243545287 conn(0x7f91fc0cb6c0 msgr2=0x7f91fc0ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:23.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 shutdown_connections 2023-05-10T01:24:23.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.805+0000 7f9201bcd700 1 -- 172.21.15.52:0/4243545287 wait complete. 2023-05-10T01:24:23.810 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:23.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.932+0000 7ffb2b482700 1 Processor -- start 2023-05-10T01:24:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.932+0000 7ffb2b482700 1 -- start start 2023-05-10T01:24:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb2b482700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb24154170 0x7ffb24063710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb2b482700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb24062f90 0x7ffb24063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb2b482700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb24062b00 con 0x7ffb24153d90 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb2b482700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240640f0 con 0x7ffb24062f90 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb2b482700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb24068610 con 0x7ffb24154170 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb29a1f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb24062f90 0x7ffb24063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb29a1f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb24062f90 0x7ffb24063c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34862/0 (socket says 172.21.15.52:34862) 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.933+0000 7ffb29a1f700 1 -- 172.21.15.52:0/2520941969 learned_addr learned my addr 172.21.15.52:0/2520941969 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb28a1d700 1 --2- 172.21.15.52:0/2520941969 >> v2:172.21.15.172:3300/0 conn(0x7ffb24154170 0x7ffb24063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb29a1f700 1 -- 172.21.15.52:0/2520941969 >> v2:172.21.15.172:3300/0 conn(0x7ffb24154170 msgr2=0x7ffb24063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb29a1f700 1 --2- 172.21.15.52:0/2520941969 >> v2:172.21.15.172:3300/0 conn(0x7ffb24154170 0x7ffb24063710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb29a1f700 1 -- 172.21.15.52:0/2520941969 >> v1:172.21.15.172:6789/0 conn(0x7ffb24153d90 legacy=0x7ffb24069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb29a1f700 1 -- 172.21.15.52:0/2520941969 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24068330 con 0x7ffb24062f90 2023-05-10T01:24:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb29a1f700 1 --2- 172.21.15.52:0/2520941969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24063c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7ffb24065240 tx=0x7ffb140090f0).ready entity=mon.0 client_cookie=7a0b4fb81111f89e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb23fff700 1 -- 172.21.15.52:0/2520941969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400b5a0 con 0x7ffb24062f90 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb23fff700 1 -- 172.21.15.52:0/2520941969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400b700 con 0x7ffb24062f90 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb23fff700 1 -- 172.21.15.52:0/2520941969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400ba80 con 0x7ffb24062f90 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb2b482700 1 -- 172.21.15.52:0/2520941969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 msgr2=0x7ffb24063c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.934+0000 7ffb2b482700 1 --2- 172.21.15.52:0/2520941969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24063c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7ffb24065240 tx=0x7ffb140090f0).stop 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 -- 172.21.15.52:0/2520941969 shutdown_connections 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 --2- 172.21.15.52:0/2520941969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24063c00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 --2- 172.21.15.52:0/2520941969 >> v2:172.21.15.172:3300/0 conn(0x7ffb24154170 0x7ffb24063710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 -- 172.21.15.52:0/2520941969 >> 172.21.15.52:0/2520941969 conn(0x7ffb240c8a90 msgr2=0x7ffb240c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 -- 172.21.15.52:0/2520941969 shutdown_connections 2023-05-10T01:24:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.935+0000 7ffb2b482700 1 -- 172.21.15.52:0/2520941969 wait complete. 2023-05-10T01:24:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.936+0000 7ffb2b482700 1 Processor -- start 2023-05-10T01:24:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.936+0000 7ffb2b482700 1 -- start start 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb24153d90 0x7ffb24163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 0x7ffb24164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240c2e10 con 0x7ffb24062f90 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24158bc0 con 0x7ffb24154170 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24164920 con 0x7ffb24153d90 2023-05-10T01:24:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34866/0 (socket says 172.21.15.52:34866) 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 -- 172.21.15.52:0/354706849 learned_addr learned my addr 172.21.15.52:0/354706849 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb29a1f700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 0x7ffb24164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb28a1d700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb24153d90 0x7ffb24163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 -- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb24153d90 msgr2=0x7ffb24163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb24153d90 0x7ffb24163f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 -- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 msgr2=0x7ffb24164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 0x7ffb24164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 -- 172.21.15.52:0/354706849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009370 con 0x7ffb24062f90 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb29a1f700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 0x7ffb24164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2921e700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7ffb1c00c840 tx=0x7ffb1c0025e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00a580 con 0x7ffb24062f90 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c00a720 con 0x7ffb24062f90 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00aae0 con 0x7ffb24062f90 2023-05-10T01:24:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.937+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb240c2570 con 0x7ffb24062f90 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.938+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb240c2b30 con 0x7ffb24062f90 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.938+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2406c340 con 0x7ffb24062f90 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.939+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffb1c010070 con 0x7ffb24062f90 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.939+0000 7ffb217fa700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 0x7ffb04061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.939+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ffb1c079a70 con 0x7ffb24062f90 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.939+0000 7ffb28a1d700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 0x7ffb04061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.940+0000 7ffb28a1d700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 0x7ffb04061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ffb18006fd0 tx=0x7ffb18008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:23.943+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffb1c04af00 con 0x7ffb24062f90 2023-05-10T01:24:24.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.117+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb240bf590 con 0x7ffb24062f90 2023-05-10T01:24:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.118+0000 7ffb217fa700 1 -- 172.21.15.52:0/354706849 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17429 (secure 0 0 0) 0x7ffb1c079e60 con 0x7ffb24062f90 2023-05-10T01:24:24.122 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:24.122 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":80,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:21.423629+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.119+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 msgr2=0x7ffb04061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.119+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 0x7ffb04061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ffb18006fd0 tx=0x7ffb18008040).stop 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 msgr2=0x7ffb24157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7ffb1c00c840 tx=0x7ffb1c0025e0).stop 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 shutdown_connections 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb0405ed90 0x7ffb04061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb24154170 0x7ffb24164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb24062f90 0x7ffb24157100 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 --2- 172.21.15.52:0/354706849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb24153d90 0x7ffb24163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 >> 172.21.15.52:0/354706849 conn(0x7ffb240c8a90 msgr2=0x7ffb24063710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 shutdown_connections 2023-05-10T01:24:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.120+0000 7ffb2b482700 1 -- 172.21.15.52:0/354706849 wait complete. 2023-05-10T01:24:24.136 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:24:24.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.249+0000 7f95ba924700 1 Processor -- start 2023-05-10T01:24:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.249+0000 7f95ba924700 1 -- start start 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba924700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95b40c76d0 0x7f95b40c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba924700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95b40a9b60 0x7f95b40a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba924700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b41588f0 con 0x7f95b4153810 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba924700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4157ce0 con 0x7f95b40a9b60 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba924700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4157fc0 con 0x7f95b40c76d0 2023-05-10T01:24:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95b40a9b60 0x7f95b40a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95b40a9b60 0x7f95b40a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34876/0 (socket says 172.21.15.52:34876) 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95ba123700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f95b4153810 0x7f95b4153c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43894/0 (socket says 172.21.15.52:43894) 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 -- 172.21.15.52:0/3395069169 learned_addr learned my addr 172.21.15.52:0/3395069169 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9922700 1 --2- 172.21.15.52:0/3395069169 >> v2:172.21.15.172:3300/0 conn(0x7f95b40c76d0 0x7f95b40c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 -- 172.21.15.52:0/3395069169 >> v2:172.21.15.172:3300/0 conn(0x7f95b40c76d0 msgr2=0x7f95b40c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 --2- 172.21.15.52:0/3395069169 >> v2:172.21.15.172:3300/0 conn(0x7f95b40c76d0 0x7f95b40c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 -- 172.21.15.52:0/3395069169 >> v1:172.21.15.52:6789/0 conn(0x7f95b4153810 legacy=0x7f95b4153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 -- 172.21.15.52:0/3395069169 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b41582a0 con 0x7f95b40a9b60 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b8920700 1 -- 172.21.15.52:0/3395069169 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732355965 0 0) 0x7f95b41588f0 con 0x7f95b4153810 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.250+0000 7f95b9121700 1 --2- 172.21.15.52:0/3395069169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40a9b60 0x7f95b40a9ff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f95b4084190 tx=0x7f95a80090f0).ready entity=mon.0 client_cookie=ffd8b9a35ba82c55 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95b8920700 1 -- 172.21.15.52:0/3395069169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800b600 con 0x7f95b40a9b60 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95b8920700 1 -- 172.21.15.52:0/3395069169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800b760 con 0x7f95b40a9b60 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95b8920700 1 -- 172.21.15.52:0/3395069169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800bae0 con 0x7f95b40a9b60 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 -- 172.21.15.52:0/3395069169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40a9b60 msgr2=0x7f95b40a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 --2- 172.21.15.52:0/3395069169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40a9b60 0x7f95b40a9ff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f95b4084190 tx=0x7f95a80090f0).stop 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 -- 172.21.15.52:0/3395069169 shutdown_connections 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 --2- 172.21.15.52:0/3395069169 >> v2:172.21.15.172:3300/0 conn(0x7f95b40c76d0 0x7f95b40c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 --2- 172.21.15.52:0/3395069169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40a9b60 0x7f95b40a9ff0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 -- 172.21.15.52:0/3395069169 >> 172.21.15.52:0/3395069169 conn(0x7f95b4068320 msgr2=0x7f95b4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 -- 172.21.15.52:0/3395069169 shutdown_connections 2023-05-10T01:24:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.251+0000 7f95ba924700 1 -- 172.21.15.52:0/3395069169 wait complete. 2023-05-10T01:24:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.252+0000 7f95ba924700 1 Processor -- start 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.252+0000 7f95ba924700 1 -- start start 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95b40a9b60 0x7f95b40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95b4153810 0x7f95b40c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40aba50 con 0x7f95b40c76d0 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40aafa0 con 0x7f95b4153810 2023-05-10T01:24:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba924700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41545a0 con 0x7f95b40a9b60 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34880/0 (socket says 172.21.15.52:34880) 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 -- 172.21.15.52:0/2731225838 learned_addr learned my addr 172.21.15.52:0/2731225838 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95ba123700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95b4153810 0x7f95b40c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9922700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95b40a9b60 0x7f95b40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 -- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95b40a9b60 msgr2=0x7f95b40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95b40a9b60 0x7f95b40aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 -- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95b4153810 msgr2=0x7f95b40c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95b4153810 0x7f95b40c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.253+0000 7f95b9121700 1 -- 172.21.15.52:0/2731225838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009370 con 0x7f95b40c76d0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95b9121700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f95a8009130 tx=0x7f95a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800b8d0 con 0x7f95b40c76d0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800ba30 con 0x7f95b40c76d0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40c49d0 con 0x7f95b40c76d0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a801c670 con 0x7f95b40c76d0 2023-05-10T01:24:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.254+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b40ab490 con 0x7f95b40c76d0 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.255+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4047150 con 0x7f95b40c76d0 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.255+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f95a800f070 con 0x7f95b40c76d0 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.255+0000 7f95b1ffb700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 0x7f9594061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.256+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f95a807b310 con 0x7f95b40c76d0 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.256+0000 7f95b9922700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 0x7f9594061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.256+0000 7f95b9922700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 0x7f9594061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f95ac00bb20 tx=0x7f95ac008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.260+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95a804c850 con 0x7f95b40c76d0 2023-05-10T01:24:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.431+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95b4158580 con 0x7f959405ed60 2023-05-10T01:24:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.443+0000 7f95b1ffb700 1 -- 172.21.15.52:0/2731225838 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353010 (secure 0 0 0) 0x7f95b4158580 con 0x7f959405ed60 2023-05-10T01:24:24.451 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:24.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 msgr2=0x7f9594061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 0x7f9594061220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f95ac00bb20 tx=0x7f95ac008040).stop 2023-05-10T01:24:24.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 msgr2=0x7f95b40c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f95a8009130 tx=0x7f95a8017000).stop 2023-05-10T01:24:24.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 shutdown_connections 2023-05-10T01:24:24.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f959405ed60 0x7f9594061220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95b4153810 0x7f95b40c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95b40a9b60 0x7f95b40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 --2- 172.21.15.52:0/2731225838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95b40c76d0 0x7f95b40c44e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 >> 172.21.15.52:0/2731225838 conn(0x7f95b4068320 msgr2=0x7f95b40c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 shutdown_connections 2023-05-10T01:24:24.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.446+0000 7f95ba924700 1 -- 172.21.15.52:0/2731225838 wait complete. 2023-05-10T01:24:24.457 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:24:24.461 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:24:22.755106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":142460,"kb_used_data":7228,"kb_used_omap":0,"kb_used_meta":135168,"kb_avail":754832260,"statfs":{"total":773094113280,"available":772948234240,"internally_reserved":0,"allocated":7401472,"data_stored":3673497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":138412032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28005,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.154943"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029536+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023764+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028963+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036008+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027778+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025778+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027567+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025122+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026370+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021886+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021984+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035588+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025824+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026743+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027071+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026247+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025354+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031299+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028525+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025556+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.030216+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025422+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029541+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025553+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029144+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.032211+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027506+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028845+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024102+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027958+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027076+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.030838+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021863+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025947+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027073+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026270+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023672+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024187+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027471+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024864+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029020+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026268+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028127+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021905+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029773+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036128+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027530+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026394+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031738+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031690+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026668+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021305+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029219+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023744+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025182+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021314+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505833+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:17.505833+0000","last_peered":"2023-05-10T01:24:17.505833+0000","last_clean":"2023-05-10T01:24:17.505833+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:17.505833+0000","last_undegraded":"2023-05-10T01:24:17.505833+0000","last_fullsized":"2023-05-10T01:24:17.505833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025783+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505738+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:17.505738+0000","last_peered":"2023-05-10T01:24:17.505738+0000","last_clean":"2023-05-10T01:24:17.505738+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:17.505738+0000","last_undegraded":"2023-05-10T01:24:17.505738+0000","last_fullsized":"2023-05-10T01:24:17.505738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031678+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505736+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:17.505736+0000","last_peered":"2023-05-10T01:24:17.505736+0000","last_clean":"2023-05-10T01:24:17.505736+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:17.505736+0000","last_undegraded":"2023-05-10T01:24:17.505736+0000","last_fullsized":"2023-05-10T01:24:17.505736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024166+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505775+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:17.505775+0000","last_peered":"2023-05-10T01:24:17.505775+0000","last_clean":"2023-05-10T01:24:17.505775+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:17.505775+0000","last_undegraded":"2023-05-10T01:24:17.505775+0000","last_fullsized":"2023-05-10T01:24:17.505775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506127+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:17.506127+0000","last_peered":"2023-05-10T01:24:17.506127+0000","last_clean":"2023-05-10T01:24:17.506127+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:17.506127+0000","last_undegraded":"2023-05-10T01:24:17.506127+0000","last_fullsized":"2023-05-10T01:24:17.506127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.026815+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506182+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:17.506182+0000","last_peered":"2023-05-10T01:24:17.506182+0000","last_clean":"2023-05-10T01:24:17.506182+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:17.506182+0000","last_undegraded":"2023-05-10T01:24:17.506182+0000","last_fullsized":"2023-05-10T01:24:17.506182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506178+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:17.506178+0000","last_peered":"2023-05-10T01:24:17.506178+0000","last_clean":"2023-05-10T01:24:17.506178+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:17.506178+0000","last_undegraded":"2023-05-10T01:24:17.506178+0000","last_fullsized":"2023-05-10T01:24:17.506178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028589+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505853+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:17.505853+0000","last_peered":"2023-05-10T01:24:17.505853+0000","last_clean":"2023-05-10T01:24:17.505853+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:17.505853+0000","last_undegraded":"2023-05-10T01:24:17.505853+0000","last_fullsized":"2023-05-10T01:24:17.505853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023748+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.182958+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:17.182958+0000","last_peered":"2023-05-10T01:24:17.182958+0000","last_clean":"2023-05-10T01:24:17.182958+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:17.182958+0000","last_undegraded":"2023-05-10T01:24:17.182958+0000","last_fullsized":"2023-05-10T01:24:17.182958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16788,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355052,"statfs":{"total":96636764160,"available":96619573248,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.73799999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16136,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":94355704,"statfs":{"total":96636764160,"available":96620240896,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.49299999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.56599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16020,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355820,"statfs":{"total":96636764160,"available":96620359680,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.376},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575022,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15892,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":14976,"kb_avail":94355948,"statfs":{"total":96636764160,"available":96620490752,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15335424},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.372},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.27500000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.31},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575022,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17224,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":94354616,"statfs":{"total":96636764160,"available":96619126784,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.216},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.35799999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.40100000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24276,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":23360,"kb_avail":94347564,"statfs":{"total":96636764160,"available":96611905536,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23920640},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.38,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.23999999999999999},"max":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.313},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93400000000000005,"15min":1.0589999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.439},"max":{"1min":0.87,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.502,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.27,"15min":1.27},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":1.216,"15min":1.216},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.52800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.432},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16404,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355436,"statfs":{"total":96636764160,"available":96619966464,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.57199999999999995}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.42799999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.505},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.40100000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19720,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94352120,"statfs":{"total":96636764160,"available":96616570880,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:24:24.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:24.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.614+0000 7fe29b59e700 1 Processor -- start 2023-05-10T01:24:24.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.614+0000 7fe29b59e700 1 -- start start 2023-05-10T01:24:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe29c154e40 0x7fe29c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c158960 con 0x7fe29c0c7370 2023-05-10T01:24:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c1552f0 con 0x7fe29c154e40 2023-05-10T01:24:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c157d50 con 0x7fe29c0ad030 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29ad9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe293fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe29c154e40 0x7fe29c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29ad9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:54528/0 (socket says 172.21.15.52:54528) 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.615+0000 7fe29ad9d700 1 -- 172.21.15.52:0/1020944572 learned_addr learned my addr 172.21.15.52:0/1020944572 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe293fff700 1 -- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 msgr2=0x7fe29c14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe293fff700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe293fff700 1 -- 172.21.15.52:0/1020944572 >> v1:172.21.15.172:6789/0 conn(0x7fe29c0c7370 legacy=0x7fe29c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe299d9b700 1 -- 172.21.15.52:0/1020944572 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050014617 0 0) 0x7fe29c158960 con 0x7fe29c0c7370 2023-05-10T01:24:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe293fff700 1 -- 172.21.15.52:0/1020944572 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c158030 con 0x7fe29c154e40 2023-05-10T01:24:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29ad9d700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:24.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe293fff700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c154e40 0x7fe29c0acb40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fe284009760 tx=0x7fe284009060).ready entity=mon.1 client_cookie=d6ba850d04038981 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe299d9b700 1 -- 172.21.15.52:0/1020944572 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400f510 con 0x7fe29c154e40 2023-05-10T01:24:24.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe299d9b700 1 -- 172.21.15.52:0/1020944572 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400f670 con 0x7fe29c154e40 2023-05-10T01:24:24.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe299d9b700 1 -- 172.21.15.52:0/1020944572 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400f9f0 con 0x7fe29c154e40 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 -- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c154e40 msgr2=0x7fe29c0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c154e40 0x7fe29c0acb40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fe284009760 tx=0x7fe284009060).stop 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 -- 172.21.15.52:0/1020944572 shutdown_connections 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c0ad030 0x7fe29c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 --2- 172.21.15.52:0/1020944572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c154e40 0x7fe29c0acb40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 -- 172.21.15.52:0/1020944572 >> 172.21.15.52:0/1020944572 conn(0x7fe29c068320 msgr2=0x7fe29c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.616+0000 7fe29b59e700 1 -- 172.21.15.52:0/1020944572 shutdown_connections 2023-05-10T01:24:24.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.617+0000 7fe29b59e700 1 -- 172.21.15.52:0/1020944572 wait complete. 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 Processor -- start 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 -- start start 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c0c7370 0x7fe29c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 0x7fe29c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0af8b0 con 0x7fe29c0ad030 2023-05-10T01:24:24.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c168130 con 0x7fe29c0c7370 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c167520 con 0x7fe29c154e40 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34894/0 (socket says 172.21.15.52:34894) 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.618+0000 7fe29a59c700 1 -- 172.21.15.52:0/3727383868 learned_addr learned my addr 172.21.15.52:0/3727383868 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe293fff700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c0c7370 0x7fe29c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29ad9d700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 0x7fe29c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 -- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 msgr2=0x7fe29c0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 0x7fe29c0af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 -- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c0c7370 msgr2=0x7fe29c0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c0c7370 0x7fe29c0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 -- 172.21.15.52:0/3727383868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294009ae0 con 0x7fe29c0ad030 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29ad9d700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 0x7fe29c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29a59c700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe28c001eb0 tx=0x7fe28c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00f470 con 0x7fe29c0ad030 2023-05-10T01:24:24.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00f5f0 con 0x7fe29c0ad030 2023-05-10T01:24:24.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2840092a0 con 0x7fe29c0ad030 2023-05-10T01:24:24.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00f9b0 con 0x7fe29c0ad030 2023-05-10T01:24:24.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.619+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c167ae0 con 0x7fe29c0ad030 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.620+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c1672b0 con 0x7fe29c0ad030 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.620+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe28c019030 con 0x7fe29c0ad030 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.621+0000 7fe2927fc700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 0x7fe280061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.621+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe28c079140 con 0x7fe29c0ad030 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.621+0000 7fe293fff700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 0x7fe280061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.621+0000 7fe293fff700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 0x7fe280061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe29c0c4b90 tx=0x7fe284017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.625+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe28c04a5d0 con 0x7fe29c0ad030 2023-05-10T01:24:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.793+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe29c047150 con 0x7fe28005ed90 2023-05-10T01:24:24.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.803+0000 7fe2927fc700 1 -- 172.21.15.52:0/3727383868 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356879 (secure 0 0 0) 0x7fe29c047150 con 0x7fe28005ed90 2023-05-10T01:24:24.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:24.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 msgr2=0x7fe280061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 0x7fe280061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe29c0c4b90 tx=0x7fe284017000).stop 2023-05-10T01:24:24.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 msgr2=0x7fe29c14e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe28c001eb0 tx=0x7fe28c007c70).stop 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 shutdown_connections 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe28005ed90 0x7fe280061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe29c154e40 0x7fe29c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe29c0ad030 0x7fe29c14e980 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 --2- 172.21.15.52:0/3727383868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe29c0c7370 0x7fe29c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 >> 172.21.15.52:0/3727383868 conn(0x7fe29c068320 msgr2=0x7fe29c14f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 shutdown_connections 2023-05-10T01:24:24.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.806+0000 7fe29b59e700 1 -- 172.21.15.52:0/3727383868 wait complete. 2023-05-10T01:24:24.816 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:24:24.822 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:24:24.755661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":143416,"kb_used_data":7416,"kb_used_omap":0,"kb_used_meta":135936,"kb_avail":754831304,"statfs":{"total":773094113280,"available":772947255296,"internally_reserved":0,"allocated":7593984,"data_stored":3773185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139198464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28005,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.154943"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441633+0000","last_change":"2023-05-10T01:24:20.438462+0000","last_active":"2023-05-10T01:24:20.441633+0000","last_peered":"2023-05-10T01:24:20.441633+0000","last_clean":"2023-05-10T01:24:20.441633+0000","last_became_active":"2023-05-10T01:24:20.437602+0000","last_became_peered":"2023-05-10T01:24:20.437602+0000","last_unstale":"2023-05-10T01:24:20.441633+0000","last_undegraded":"2023-05-10T01:24:20.441633+0000","last_fullsized":"2023-05-10T01:24:20.441633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439744+0000","last_change":"2023-05-10T01:24:20.044308+0000","last_active":"2023-05-10T01:24:20.439744+0000","last_peered":"2023-05-10T01:24:20.439744+0000","last_clean":"2023-05-10T01:24:20.439744+0000","last_became_active":"2023-05-10T01:24:20.043980+0000","last_became_peered":"2023-05-10T01:24:20.043980+0000","last_unstale":"2023-05-10T01:24:20.439744+0000","last_undegraded":"2023-05-10T01:24:20.439744+0000","last_fullsized":"2023-05-10T01:24:20.439744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023764+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028963+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036008+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.442739+0000","last_change":"2023-05-10T01:24:20.039146+0000","last_active":"2023-05-10T01:24:20.442739+0000","last_peered":"2023-05-10T01:24:20.442739+0000","last_clean":"2023-05-10T01:24:20.442739+0000","last_became_active":"2023-05-10T01:24:20.038857+0000","last_became_peered":"2023-05-10T01:24:20.038857+0000","last_unstale":"2023-05-10T01:24:20.442739+0000","last_undegraded":"2023-05-10T01:24:20.442739+0000","last_fullsized":"2023-05-10T01:24:20.442739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454152+0000","last_change":"2023-05-10T01:24:20.453347+0000","last_active":"2023-05-10T01:24:20.454152+0000","last_peered":"2023-05-10T01:24:20.454152+0000","last_clean":"2023-05-10T01:24:20.454152+0000","last_became_active":"2023-05-10T01:24:20.452959+0000","last_became_peered":"2023-05-10T01:24:20.452959+0000","last_unstale":"2023-05-10T01:24:20.454152+0000","last_undegraded":"2023-05-10T01:24:20.454152+0000","last_fullsized":"2023-05-10T01:24:20.454152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440955+0000","last_change":"2023-05-10T01:24:20.040295+0000","last_active":"2023-05-10T01:24:20.440955+0000","last_peered":"2023-05-10T01:24:20.440955+0000","last_clean":"2023-05-10T01:24:20.440955+0000","last_became_active":"2023-05-10T01:24:20.039974+0000","last_became_peered":"2023-05-10T01:24:20.039974+0000","last_unstale":"2023-05-10T01:24:20.440955+0000","last_undegraded":"2023-05-10T01:24:20.440955+0000","last_fullsized":"2023-05-10T01:24:20.440955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451107+0000","last_change":"2023-05-10T01:24:20.450452+0000","last_active":"2023-05-10T01:24:20.451107+0000","last_peered":"2023-05-10T01:24:20.451107+0000","last_clean":"2023-05-10T01:24:20.451107+0000","last_became_active":"2023-05-10T01:24:20.450171+0000","last_became_peered":"2023-05-10T01:24:20.450171+0000","last_unstale":"2023-05-10T01:24:20.451107+0000","last_undegraded":"2023-05-10T01:24:20.451107+0000","last_fullsized":"2023-05-10T01:24:20.451107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432650+0000","last_change":"2023-05-10T01:24:20.041100+0000","last_active":"2023-05-10T01:24:20.432650+0000","last_peered":"2023-05-10T01:24:20.432650+0000","last_clean":"2023-05-10T01:24:20.432650+0000","last_became_active":"2023-05-10T01:24:20.040636+0000","last_became_peered":"2023-05-10T01:24:20.040636+0000","last_unstale":"2023-05-10T01:24:20.432650+0000","last_undegraded":"2023-05-10T01:24:20.432650+0000","last_fullsized":"2023-05-10T01:24:20.432650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463345+0000","last_change":"2023-05-10T01:24:20.458665+0000","last_active":"2023-05-10T01:24:20.463345+0000","last_peered":"2023-05-10T01:24:20.463345+0000","last_clean":"2023-05-10T01:24:20.463345+0000","last_became_active":"2023-05-10T01:24:20.458404+0000","last_became_peered":"2023-05-10T01:24:20.458404+0000","last_unstale":"2023-05-10T01:24:20.463345+0000","last_undegraded":"2023-05-10T01:24:20.463345+0000","last_fullsized":"2023-05-10T01:24:20.463345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025122+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431401+0000","last_change":"2023-05-10T01:24:20.040275+0000","last_active":"2023-05-10T01:24:20.431401+0000","last_peered":"2023-05-10T01:24:20.431401+0000","last_clean":"2023-05-10T01:24:20.431401+0000","last_became_active":"2023-05-10T01:24:20.039976+0000","last_became_peered":"2023-05-10T01:24:20.039976+0000","last_unstale":"2023-05-10T01:24:20.431401+0000","last_undegraded":"2023-05-10T01:24:20.431401+0000","last_fullsized":"2023-05-10T01:24:20.431401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444477+0000","last_change":"2023-05-10T01:24:20.439090+0000","last_active":"2023-05-10T01:24:20.444477+0000","last_peered":"2023-05-10T01:24:20.444477+0000","last_clean":"2023-05-10T01:24:20.444477+0000","last_became_active":"2023-05-10T01:24:20.438697+0000","last_became_peered":"2023-05-10T01:24:20.438697+0000","last_unstale":"2023-05-10T01:24:20.444477+0000","last_undegraded":"2023-05-10T01:24:20.444477+0000","last_fullsized":"2023-05-10T01:24:20.444477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021886+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021984+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035588+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446959+0000","last_change":"2023-05-10T01:24:20.444458+0000","last_active":"2023-05-10T01:24:20.446959+0000","last_peered":"2023-05-10T01:24:20.446959+0000","last_clean":"2023-05-10T01:24:20.446959+0000","last_became_active":"2023-05-10T01:24:20.444146+0000","last_became_peered":"2023-05-10T01:24:20.444146+0000","last_unstale":"2023-05-10T01:24:20.446959+0000","last_undegraded":"2023-05-10T01:24:20.446959+0000","last_fullsized":"2023-05-10T01:24:20.446959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459848+0000","last_change":"2023-05-10T01:24:20.041326+0000","last_active":"2023-05-10T01:24:20.459848+0000","last_peered":"2023-05-10T01:24:20.459848+0000","last_clean":"2023-05-10T01:24:20.459848+0000","last_became_active":"2023-05-10T01:24:20.040987+0000","last_became_peered":"2023-05-10T01:24:20.040987+0000","last_unstale":"2023-05-10T01:24:20.459848+0000","last_undegraded":"2023-05-10T01:24:20.459848+0000","last_fullsized":"2023-05-10T01:24:20.459848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431284+0000","last_change":"2023-05-10T01:24:20.038134+0000","last_active":"2023-05-10T01:24:20.431284+0000","last_peered":"2023-05-10T01:24:20.431284+0000","last_clean":"2023-05-10T01:24:20.431284+0000","last_became_active":"2023-05-10T01:24:20.037865+0000","last_became_peered":"2023-05-10T01:24:20.037865+0000","last_unstale":"2023-05-10T01:24:20.431284+0000","last_undegraded":"2023-05-10T01:24:20.431284+0000","last_fullsized":"2023-05-10T01:24:20.431284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432761+0000","last_change":"2023-05-10T01:24:20.040914+0000","last_active":"2023-05-10T01:24:20.432761+0000","last_peered":"2023-05-10T01:24:20.432761+0000","last_clean":"2023-05-10T01:24:20.432761+0000","last_became_active":"2023-05-10T01:24:20.040295+0000","last_became_peered":"2023-05-10T01:24:20.040295+0000","last_unstale":"2023-05-10T01:24:20.432761+0000","last_undegraded":"2023-05-10T01:24:20.432761+0000","last_fullsized":"2023-05-10T01:24:20.432761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447280+0000","last_change":"2023-05-10T01:24:20.045598+0000","last_active":"2023-05-10T01:24:20.447280+0000","last_peered":"2023-05-10T01:24:20.447280+0000","last_clean":"2023-05-10T01:24:20.447280+0000","last_became_active":"2023-05-10T01:24:20.045183+0000","last_became_peered":"2023-05-10T01:24:20.045183+0000","last_unstale":"2023-05-10T01:24:20.447280+0000","last_undegraded":"2023-05-10T01:24:20.447280+0000","last_fullsized":"2023-05-10T01:24:20.447280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025354+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463435+0000","last_change":"2023-05-10T01:24:20.459353+0000","last_active":"2023-05-10T01:24:20.463435+0000","last_peered":"2023-05-10T01:24:20.463435+0000","last_clean":"2023-05-10T01:24:20.463435+0000","last_became_active":"2023-05-10T01:24:20.458772+0000","last_became_peered":"2023-05-10T01:24:20.458772+0000","last_unstale":"2023-05-10T01:24:20.463435+0000","last_undegraded":"2023-05-10T01:24:20.463435+0000","last_fullsized":"2023-05-10T01:24:20.463435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031299+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440326+0000","last_change":"2023-05-10T01:24:20.437715+0000","last_active":"2023-05-10T01:24:20.440326+0000","last_peered":"2023-05-10T01:24:20.440326+0000","last_clean":"2023-05-10T01:24:20.440326+0000","last_became_active":"2023-05-10T01:24:20.437438+0000","last_became_peered":"2023-05-10T01:24:20.437438+0000","last_unstale":"2023-05-10T01:24:20.440326+0000","last_undegraded":"2023-05-10T01:24:20.440326+0000","last_fullsized":"2023-05-10T01:24:20.440326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438621+0000","last_change":"2023-05-10T01:24:20.045908+0000","last_active":"2023-05-10T01:24:20.438621+0000","last_peered":"2023-05-10T01:24:20.438621+0000","last_clean":"2023-05-10T01:24:20.438621+0000","last_became_active":"2023-05-10T01:24:20.045609+0000","last_became_peered":"2023-05-10T01:24:20.045609+0000","last_unstale":"2023-05-10T01:24:20.438621+0000","last_undegraded":"2023-05-10T01:24:20.438621+0000","last_fullsized":"2023-05-10T01:24:20.438621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025556+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.030216+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025422+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029541+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449967+0000","last_change":"2023-05-10T01:24:20.048246+0000","last_active":"2023-05-10T01:24:20.449967+0000","last_peered":"2023-05-10T01:24:20.449967+0000","last_clean":"2023-05-10T01:24:20.449967+0000","last_became_active":"2023-05-10T01:24:20.047976+0000","last_became_peered":"2023-05-10T01:24:20.047976+0000","last_unstale":"2023-05-10T01:24:20.449967+0000","last_undegraded":"2023-05-10T01:24:20.449967+0000","last_fullsized":"2023-05-10T01:24:20.449967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.430966+0000","last_change":"2023-05-10T01:24:20.035217+0000","last_active":"2023-05-10T01:24:20.430966+0000","last_peered":"2023-05-10T01:24:20.430966+0000","last_clean":"2023-05-10T01:24:20.430966+0000","last_became_active":"2023-05-10T01:24:20.034906+0000","last_became_peered":"2023-05-10T01:24:20.034906+0000","last_unstale":"2023-05-10T01:24:20.430966+0000","last_undegraded":"2023-05-10T01:24:20.430966+0000","last_fullsized":"2023-05-10T01:24:20.430966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447711+0000","last_change":"2023-05-10T01:24:20.443372+0000","last_active":"2023-05-10T01:24:20.447711+0000","last_peered":"2023-05-10T01:24:20.447711+0000","last_clean":"2023-05-10T01:24:20.447711+0000","last_became_active":"2023-05-10T01:24:20.443089+0000","last_became_peered":"2023-05-10T01:24:20.443089+0000","last_unstale":"2023-05-10T01:24:20.447711+0000","last_undegraded":"2023-05-10T01:24:20.447711+0000","last_fullsized":"2023-05-10T01:24:20.447711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.032211+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431470+0000","last_change":"2023-05-10T01:24:20.040862+0000","last_active":"2023-05-10T01:24:20.431470+0000","last_peered":"2023-05-10T01:24:20.431470+0000","last_clean":"2023-05-10T01:24:20.431470+0000","last_became_active":"2023-05-10T01:24:20.040538+0000","last_became_peered":"2023-05-10T01:24:20.040538+0000","last_unstale":"2023-05-10T01:24:20.431470+0000","last_undegraded":"2023-05-10T01:24:20.431470+0000","last_fullsized":"2023-05-10T01:24:20.431470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432810+0000","last_change":"2023-05-10T01:24:20.036237+0000","last_active":"2023-05-10T01:24:20.432810+0000","last_peered":"2023-05-10T01:24:20.432810+0000","last_clean":"2023-05-10T01:24:20.432810+0000","last_became_active":"2023-05-10T01:24:20.035938+0000","last_became_peered":"2023-05-10T01:24:20.035938+0000","last_unstale":"2023-05-10T01:24:20.432810+0000","last_undegraded":"2023-05-10T01:24:20.432810+0000","last_fullsized":"2023-05-10T01:24:20.432810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440401+0000","last_change":"2023-05-10T01:24:20.437391+0000","last_active":"2023-05-10T01:24:20.440401+0000","last_peered":"2023-05-10T01:24:20.440401+0000","last_clean":"2023-05-10T01:24:20.440401+0000","last_became_active":"2023-05-10T01:24:20.436953+0000","last_became_peered":"2023-05-10T01:24:20.436953+0000","last_unstale":"2023-05-10T01:24:20.440401+0000","last_undegraded":"2023-05-10T01:24:20.440401+0000","last_fullsized":"2023-05-10T01:24:20.440401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024102+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447405+0000","last_change":"2023-05-10T01:24:20.442195+0000","last_active":"2023-05-10T01:24:20.447405+0000","last_peered":"2023-05-10T01:24:20.447405+0000","last_clean":"2023-05-10T01:24:20.447405+0000","last_became_active":"2023-05-10T01:24:20.441921+0000","last_became_peered":"2023-05-10T01:24:20.441921+0000","last_unstale":"2023-05-10T01:24:20.447405+0000","last_undegraded":"2023-05-10T01:24:20.447405+0000","last_fullsized":"2023-05-10T01:24:20.447405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027958+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431766+0000","last_change":"2023-05-10T01:24:20.032017+0000","last_active":"2023-05-10T01:24:20.431766+0000","last_peered":"2023-05-10T01:24:20.431766+0000","last_clean":"2023-05-10T01:24:20.431766+0000","last_became_active":"2023-05-10T01:24:20.031718+0000","last_became_peered":"2023-05-10T01:24:20.031718+0000","last_unstale":"2023-05-10T01:24:20.431766+0000","last_undegraded":"2023-05-10T01:24:20.431766+0000","last_fullsized":"2023-05-10T01:24:20.431766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432045+0000","last_change":"2023-05-10T01:24:20.045212+0000","last_active":"2023-05-10T01:24:20.432045+0000","last_peered":"2023-05-10T01:24:20.432045+0000","last_clean":"2023-05-10T01:24:20.432045+0000","last_became_active":"2023-05-10T01:24:20.039882+0000","last_became_peered":"2023-05-10T01:24:20.039882+0000","last_unstale":"2023-05-10T01:24:20.432045+0000","last_undegraded":"2023-05-10T01:24:20.432045+0000","last_fullsized":"2023-05-10T01:24:20.432045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458898+0000","last_change":"2023-05-10T01:24:20.451923+0000","last_active":"2023-05-10T01:24:20.458898+0000","last_peered":"2023-05-10T01:24:20.458898+0000","last_clean":"2023-05-10T01:24:20.458898+0000","last_became_active":"2023-05-10T01:24:20.450847+0000","last_became_peered":"2023-05-10T01:24:20.450847+0000","last_unstale":"2023-05-10T01:24:20.458898+0000","last_undegraded":"2023-05-10T01:24:20.458898+0000","last_fullsized":"2023-05-10T01:24:20.458898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021863+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463477+0000","last_change":"2023-05-10T01:24:20.459865+0000","last_active":"2023-05-10T01:24:20.463477+0000","last_peered":"2023-05-10T01:24:20.463477+0000","last_clean":"2023-05-10T01:24:20.463477+0000","last_became_active":"2023-05-10T01:24:20.459515+0000","last_became_peered":"2023-05-10T01:24:20.459515+0000","last_unstale":"2023-05-10T01:24:20.463477+0000","last_undegraded":"2023-05-10T01:24:20.463477+0000","last_fullsized":"2023-05-10T01:24:20.463477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454298+0000","last_change":"2023-05-10T01:24:20.044669+0000","last_active":"2023-05-10T01:24:20.454298+0000","last_peered":"2023-05-10T01:24:20.454298+0000","last_clean":"2023-05-10T01:24:20.454298+0000","last_became_active":"2023-05-10T01:24:20.044344+0000","last_became_peered":"2023-05-10T01:24:20.044344+0000","last_unstale":"2023-05-10T01:24:20.454298+0000","last_undegraded":"2023-05-10T01:24:20.454298+0000","last_fullsized":"2023-05-10T01:24:20.454298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440538+0000","last_change":"2023-05-10T01:24:20.437997+0000","last_active":"2023-05-10T01:24:20.440538+0000","last_peered":"2023-05-10T01:24:20.440538+0000","last_clean":"2023-05-10T01:24:20.440538+0000","last_became_active":"2023-05-10T01:24:20.437543+0000","last_became_peered":"2023-05-10T01:24:20.437543+0000","last_unstale":"2023-05-10T01:24:20.440538+0000","last_undegraded":"2023-05-10T01:24:20.440538+0000","last_fullsized":"2023-05-10T01:24:20.440538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447793+0000","last_change":"2023-05-10T01:24:20.043479+0000","last_active":"2023-05-10T01:24:20.447793+0000","last_peered":"2023-05-10T01:24:20.447793+0000","last_clean":"2023-05-10T01:24:20.447793+0000","last_became_active":"2023-05-10T01:24:20.042740+0000","last_became_peered":"2023-05-10T01:24:20.042740+0000","last_unstale":"2023-05-10T01:24:20.447793+0000","last_undegraded":"2023-05-10T01:24:20.447793+0000","last_fullsized":"2023-05-10T01:24:20.447793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431645+0000","last_change":"2023-05-10T01:24:20.041177+0000","last_active":"2023-05-10T01:24:20.431645+0000","last_peered":"2023-05-10T01:24:20.431645+0000","last_clean":"2023-05-10T01:24:20.431645+0000","last_became_active":"2023-05-10T01:24:20.040883+0000","last_became_peered":"2023-05-10T01:24:20.040883+0000","last_unstale":"2023-05-10T01:24:20.431645+0000","last_undegraded":"2023-05-10T01:24:20.431645+0000","last_fullsized":"2023-05-10T01:24:20.431645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439291+0000","last_change":"2023-05-10T01:24:20.437109+0000","last_active":"2023-05-10T01:24:20.439291+0000","last_peered":"2023-05-10T01:24:20.439291+0000","last_clean":"2023-05-10T01:24:20.439291+0000","last_became_active":"2023-05-10T01:24:20.436810+0000","last_became_peered":"2023-05-10T01:24:20.436810+0000","last_unstale":"2023-05-10T01:24:20.439291+0000","last_undegraded":"2023-05-10T01:24:20.439291+0000","last_fullsized":"2023-05-10T01:24:20.439291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023672+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024187+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463377+0000","last_change":"2023-05-10T01:24:20.459050+0000","last_active":"2023-05-10T01:24:20.463377+0000","last_peered":"2023-05-10T01:24:20.463377+0000","last_clean":"2023-05-10T01:24:20.463377+0000","last_became_active":"2023-05-10T01:24:20.458758+0000","last_became_peered":"2023-05-10T01:24:20.458758+0000","last_unstale":"2023-05-10T01:24:20.463377+0000","last_undegraded":"2023-05-10T01:24:20.463377+0000","last_fullsized":"2023-05-10T01:24:20.463377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027471+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.450025+0000","last_change":"2023-05-10T01:24:20.042766+0000","last_active":"2023-05-10T01:24:20.450025+0000","last_peered":"2023-05-10T01:24:20.450025+0000","last_clean":"2023-05-10T01:24:20.450025+0000","last_became_active":"2023-05-10T01:24:20.042490+0000","last_became_peered":"2023-05-10T01:24:20.042490+0000","last_unstale":"2023-05-10T01:24:20.450025+0000","last_undegraded":"2023-05-10T01:24:20.450025+0000","last_fullsized":"2023-05-10T01:24:20.450025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029020+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.433006+0000","last_change":"2023-05-10T01:24:20.037935+0000","last_active":"2023-05-10T01:24:20.433006+0000","last_peered":"2023-05-10T01:24:20.433006+0000","last_clean":"2023-05-10T01:24:20.433006+0000","last_became_active":"2023-05-10T01:24:20.037566+0000","last_became_peered":"2023-05-10T01:24:20.037566+0000","last_unstale":"2023-05-10T01:24:20.433006+0000","last_undegraded":"2023-05-10T01:24:20.433006+0000","last_fullsized":"2023-05-10T01:24:20.433006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458929+0000","last_change":"2023-05-10T01:24:20.455086+0000","last_active":"2023-05-10T01:24:20.458929+0000","last_peered":"2023-05-10T01:24:20.458929+0000","last_clean":"2023-05-10T01:24:20.458929+0000","last_became_active":"2023-05-10T01:24:20.454818+0000","last_became_peered":"2023-05-10T01:24:20.454818+0000","last_unstale":"2023-05-10T01:24:20.458929+0000","last_undegraded":"2023-05-10T01:24:20.458929+0000","last_fullsized":"2023-05-10T01:24:20.458929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028127+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446853+0000","last_change":"2023-05-10T01:24:20.440480+0000","last_active":"2023-05-10T01:24:20.446853+0000","last_peered":"2023-05-10T01:24:20.446853+0000","last_clean":"2023-05-10T01:24:20.446853+0000","last_became_active":"2023-05-10T01:24:20.440029+0000","last_became_peered":"2023-05-10T01:24:20.440029+0000","last_unstale":"2023-05-10T01:24:20.446853+0000","last_undegraded":"2023-05-10T01:24:20.446853+0000","last_fullsized":"2023-05-10T01:24:20.446853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021905+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454376+0000","last_change":"2023-05-10T01:24:20.450582+0000","last_active":"2023-05-10T01:24:20.454376+0000","last_peered":"2023-05-10T01:24:20.454376+0000","last_clean":"2023-05-10T01:24:20.454376+0000","last_became_active":"2023-05-10T01:24:20.450302+0000","last_became_peered":"2023-05-10T01:24:20.450302+0000","last_unstale":"2023-05-10T01:24:20.454376+0000","last_undegraded":"2023-05-10T01:24:20.454376+0000","last_fullsized":"2023-05-10T01:24:20.454376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029773+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036128+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463458+0000","last_change":"2023-05-10T01:24:20.459687+0000","last_active":"2023-05-10T01:24:20.463458+0000","last_peered":"2023-05-10T01:24:20.463458+0000","last_clean":"2023-05-10T01:24:20.463458+0000","last_became_active":"2023-05-10T01:24:20.459335+0000","last_became_peered":"2023-05-10T01:24:20.459335+0000","last_unstale":"2023-05-10T01:24:20.463458+0000","last_undegraded":"2023-05-10T01:24:20.463458+0000","last_fullsized":"2023-05-10T01:24:20.463458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027530+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457009+0000","last_change":"2023-05-10T01:24:20.044573+0000","last_active":"2023-05-10T01:24:20.457009+0000","last_peered":"2023-05-10T01:24:20.457009+0000","last_clean":"2023-05-10T01:24:20.457009+0000","last_became_active":"2023-05-10T01:24:20.044299+0000","last_became_peered":"2023-05-10T01:24:20.044299+0000","last_unstale":"2023-05-10T01:24:20.457009+0000","last_undegraded":"2023-05-10T01:24:20.457009+0000","last_fullsized":"2023-05-10T01:24:20.457009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440634+0000","last_change":"2023-05-10T01:24:20.439231+0000","last_active":"2023-05-10T01:24:20.440634+0000","last_peered":"2023-05-10T01:24:20.440634+0000","last_clean":"2023-05-10T01:24:20.440634+0000","last_became_active":"2023-05-10T01:24:20.438862+0000","last_became_peered":"2023-05-10T01:24:20.438862+0000","last_unstale":"2023-05-10T01:24:20.440634+0000","last_undegraded":"2023-05-10T01:24:20.440634+0000","last_fullsized":"2023-05-10T01:24:20.440634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031738+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439860+0000","last_change":"2023-05-10T01:24:20.436161+0000","last_active":"2023-05-10T01:24:20.439860+0000","last_peered":"2023-05-10T01:24:20.439860+0000","last_clean":"2023-05-10T01:24:20.439860+0000","last_became_active":"2023-05-10T01:24:20.435870+0000","last_became_peered":"2023-05-10T01:24:20.435870+0000","last_unstale":"2023-05-10T01:24:20.439860+0000","last_undegraded":"2023-05-10T01:24:20.439860+0000","last_fullsized":"2023-05-10T01:24:20.439860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031690+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431691+0000","last_change":"2023-05-10T01:24:20.043700+0000","last_active":"2023-05-10T01:24:20.431691+0000","last_peered":"2023-05-10T01:24:20.431691+0000","last_clean":"2023-05-10T01:24:20.431691+0000","last_became_active":"2023-05-10T01:24:20.043173+0000","last_became_peered":"2023-05-10T01:24:20.043173+0000","last_unstale":"2023-05-10T01:24:20.431691+0000","last_undegraded":"2023-05-10T01:24:20.431691+0000","last_fullsized":"2023-05-10T01:24:20.431691+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463316+0000","last_change":"2023-05-10T01:24:20.458201+0000","last_active":"2023-05-10T01:24:20.463316+0000","last_peered":"2023-05-10T01:24:20.463316+0000","last_clean":"2023-05-10T01:24:20.463316+0000","last_became_active":"2023-05-10T01:24:20.457952+0000","last_became_peered":"2023-05-10T01:24:20.457952+0000","last_unstale":"2023-05-10T01:24:20.463316+0000","last_undegraded":"2023-05-10T01:24:20.463316+0000","last_fullsized":"2023-05-10T01:24:20.463316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021305+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459739+0000","last_change":"2023-05-10T01:24:20.454958+0000","last_active":"2023-05-10T01:24:20.459739+0000","last_peered":"2023-05-10T01:24:20.459739+0000","last_clean":"2023-05-10T01:24:20.459739+0000","last_became_active":"2023-05-10T01:24:20.454675+0000","last_became_peered":"2023-05-10T01:24:20.454675+0000","last_unstale":"2023-05-10T01:24:20.459739+0000","last_undegraded":"2023-05-10T01:24:20.459739+0000","last_fullsized":"2023-05-10T01:24:20.459739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029219+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454768+0000","last_change":"2023-05-10T01:24:20.453355+0000","last_active":"2023-05-10T01:24:20.454768+0000","last_peered":"2023-05-10T01:24:20.454768+0000","last_clean":"2023-05-10T01:24:20.454768+0000","last_became_active":"2023-05-10T01:24:20.453115+0000","last_became_peered":"2023-05-10T01:24:20.453115+0000","last_unstale":"2023-05-10T01:24:20.454768+0000","last_undegraded":"2023-05-10T01:24:20.454768+0000","last_fullsized":"2023-05-10T01:24:20.454768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023744+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025182+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.445126+0000","last_change":"2023-05-10T01:24:20.443260+0000","last_active":"2023-05-10T01:24:20.445126+0000","last_peered":"2023-05-10T01:24:20.445126+0000","last_clean":"2023-05-10T01:24:20.445126+0000","last_became_active":"2023-05-10T01:24:20.442965+0000","last_became_peered":"2023-05-10T01:24:20.442965+0000","last_unstale":"2023-05-10T01:24:20.445126+0000","last_undegraded":"2023-05-10T01:24:20.445126+0000","last_fullsized":"2023-05-10T01:24:20.445126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021314+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505833+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:17.505833+0000","last_peered":"2023-05-10T01:24:17.505833+0000","last_clean":"2023-05-10T01:24:17.505833+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:17.505833+0000","last_undegraded":"2023-05-10T01:24:17.505833+0000","last_fullsized":"2023-05-10T01:24:17.505833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459163+0000","last_change":"2023-05-10T01:24:20.454422+0000","last_active":"2023-05-10T01:24:20.459163+0000","last_peered":"2023-05-10T01:24:20.459163+0000","last_clean":"2023-05-10T01:24:20.459163+0000","last_became_active":"2023-05-10T01:24:20.454203+0000","last_became_peered":"2023-05-10T01:24:20.454203+0000","last_unstale":"2023-05-10T01:24:20.459163+0000","last_undegraded":"2023-05-10T01:24:20.459163+0000","last_fullsized":"2023-05-10T01:24:20.459163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431226+0000","last_change":"2023-05-10T01:24:20.041801+0000","last_active":"2023-05-10T01:24:20.431226+0000","last_peered":"2023-05-10T01:24:20.431226+0000","last_clean":"2023-05-10T01:24:20.431226+0000","last_became_active":"2023-05-10T01:24:20.041469+0000","last_became_peered":"2023-05-10T01:24:20.041469+0000","last_unstale":"2023-05-10T01:24:20.431226+0000","last_undegraded":"2023-05-10T01:24:20.431226+0000","last_fullsized":"2023-05-10T01:24:20.431226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505738+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:17.505738+0000","last_peered":"2023-05-10T01:24:17.505738+0000","last_clean":"2023-05-10T01:24:17.505738+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:17.505738+0000","last_undegraded":"2023-05-10T01:24:17.505738+0000","last_fullsized":"2023-05-10T01:24:17.505738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031678+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431784+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:20.431784+0000","last_peered":"2023-05-10T01:24:20.431784+0000","last_clean":"2023-05-10T01:24:20.431784+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:20.431784+0000","last_undegraded":"2023-05-10T01:24:20.431784+0000","last_fullsized":"2023-05-10T01:24:20.431784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459768+0000","last_change":"2023-05-10T01:24:20.449951+0000","last_active":"2023-05-10T01:24:20.459768+0000","last_peered":"2023-05-10T01:24:20.459768+0000","last_clean":"2023-05-10T01:24:20.459768+0000","last_became_active":"2023-05-10T01:24:20.449732+0000","last_became_peered":"2023-05-10T01:24:20.449732+0000","last_unstale":"2023-05-10T01:24:20.459768+0000","last_undegraded":"2023-05-10T01:24:20.459768+0000","last_fullsized":"2023-05-10T01:24:20.459768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024166+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505775+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:17.505775+0000","last_peered":"2023-05-10T01:24:17.505775+0000","last_clean":"2023-05-10T01:24:17.505775+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:17.505775+0000","last_undegraded":"2023-05-10T01:24:17.505775+0000","last_fullsized":"2023-05-10T01:24:17.505775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506127+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:17.506127+0000","last_peered":"2023-05-10T01:24:17.506127+0000","last_clean":"2023-05-10T01:24:17.506127+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:17.506127+0000","last_undegraded":"2023-05-10T01:24:17.506127+0000","last_fullsized":"2023-05-10T01:24:17.506127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440378+0000","last_change":"2023-05-10T01:24:20.437212+0000","last_active":"2023-05-10T01:24:20.440378+0000","last_peered":"2023-05-10T01:24:20.440378+0000","last_clean":"2023-05-10T01:24:20.440378+0000","last_became_active":"2023-05-10T01:24:20.436615+0000","last_became_peered":"2023-05-10T01:24:20.436615+0000","last_unstale":"2023-05-10T01:24:20.440378+0000","last_undegraded":"2023-05-10T01:24:20.440378+0000","last_fullsized":"2023-05-10T01:24:20.440378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452262+0000","last_change":"2023-05-10T01:24:20.039528+0000","last_active":"2023-05-10T01:24:20.452262+0000","last_peered":"2023-05-10T01:24:20.452262+0000","last_clean":"2023-05-10T01:24:20.452262+0000","last_became_active":"2023-05-10T01:24:20.039224+0000","last_became_peered":"2023-05-10T01:24:20.039224+0000","last_unstale":"2023-05-10T01:24:20.452262+0000","last_undegraded":"2023-05-10T01:24:20.452262+0000","last_fullsized":"2023-05-10T01:24:20.452262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506182+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:17.506182+0000","last_peered":"2023-05-10T01:24:17.506182+0000","last_clean":"2023-05-10T01:24:17.506182+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:17.506182+0000","last_undegraded":"2023-05-10T01:24:17.506182+0000","last_fullsized":"2023-05-10T01:24:17.506182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460951+0000","last_change":"2023-05-10T01:24:20.456847+0000","last_active":"2023-05-10T01:24:20.460951+0000","last_peered":"2023-05-10T01:24:20.460951+0000","last_clean":"2023-05-10T01:24:20.460951+0000","last_became_active":"2023-05-10T01:24:20.456275+0000","last_became_peered":"2023-05-10T01:24:20.456275+0000","last_unstale":"2023-05-10T01:24:20.460951+0000","last_undegraded":"2023-05-10T01:24:20.460951+0000","last_fullsized":"2023-05-10T01:24:20.460951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506178+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:17.506178+0000","last_peered":"2023-05-10T01:24:17.506178+0000","last_clean":"2023-05-10T01:24:17.506178+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:17.506178+0000","last_undegraded":"2023-05-10T01:24:17.506178+0000","last_fullsized":"2023-05-10T01:24:17.506178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460760+0000","last_change":"2023-05-10T01:24:20.456245+0000","last_active":"2023-05-10T01:24:20.460760+0000","last_peered":"2023-05-10T01:24:20.460760+0000","last_clean":"2023-05-10T01:24:20.460760+0000","last_became_active":"2023-05-10T01:24:20.455951+0000","last_became_peered":"2023-05-10T01:24:20.455951+0000","last_unstale":"2023-05-10T01:24:20.460760+0000","last_undegraded":"2023-05-10T01:24:20.460760+0000","last_fullsized":"2023-05-10T01:24:20.460760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028589+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505853+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:17.505853+0000","last_peered":"2023-05-10T01:24:17.505853+0000","last_clean":"2023-05-10T01:24:17.505853+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:17.505853+0000","last_undegraded":"2023-05-10T01:24:17.505853+0000","last_fullsized":"2023-05-10T01:24:17.505853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463289+0000","last_change":"2023-05-10T01:24:20.456478+0000","last_active":"2023-05-10T01:24:20.463289+0000","last_peered":"2023-05-10T01:24:20.463289+0000","last_clean":"2023-05-10T01:24:20.463289+0000","last_became_active":"2023-05-10T01:24:20.456221+0000","last_became_peered":"2023-05-10T01:24:20.456221+0000","last_unstale":"2023-05-10T01:24:20.463289+0000","last_undegraded":"2023-05-10T01:24:20.463289+0000","last_fullsized":"2023-05-10T01:24:20.463289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023748+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452551+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:20.452551+0000","last_peered":"2023-05-10T01:24:20.452551+0000","last_clean":"2023-05-10T01:24:20.452551+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:20.452551+0000","last_undegraded":"2023-05-10T01:24:20.452551+0000","last_fullsized":"2023-05-10T01:24:20.452551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16788,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355052,"statfs":{"total":96636764160,"available":96619573248,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.73799999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16380,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355460,"statfs":{"total":96636764160,"available":96619991040,"internally_reserved":0,"allocated":970752,"data_stored":483007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16020,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355820,"statfs":{"total":96636764160,"available":96620359680,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.376},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16120,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94355720,"statfs":{"total":96636764160,"available":96620257280,"internally_reserved":0,"allocated":966656,"data_stored":482973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.621},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17472,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94354368,"statfs":{"total":96636764160,"available":96618872832,"internally_reserved":0,"allocated":974848,"data_stored":483597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.72499999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.622}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24276,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":23360,"kb_avail":94347564,"statfs":{"total":96636764160,"available":96611905536,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23920640},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.38,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.23999999999999999},"max":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.313},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93400000000000005,"15min":1.0589999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.439},"max":{"1min":0.87,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.502,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.27,"15min":1.27},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":1.216,"15min":1.216},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.52800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.432},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16640,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355200,"statfs":{"total":96636764160,"available":96619724800,"internally_reserved":0,"allocated":974848,"data_stored":483617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19720,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94352120,"statfs":{"total":96636764160,"available":96616570880,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:24:24.830 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.975+0000 7f852b2cc700 1 Processor -- start 2023-05-10T01:24:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.975+0000 7f852b2cc700 1 -- start start 2023-05-10T01:24:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f852b2cc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f8524069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f852b2cc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240c0650 con 0x7f8524069b80 2023-05-10T01:24:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f852b2cc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852406a010 con 0x7f8524154160 2023-05-10T01:24:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f852b2cc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240bfd20 con 0x7f8524154540 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f8529869700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8524069b80 0x7f85240c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43922/0 (socket says 172.21.15.52:43922) 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f8529869700 1 -- 172.21.15.52:0/3583944081 learned_addr learned my addr 172.21.15.52:0/3583944081 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f8528867700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f8524069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.976+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045202118 0 0) 0x7f85240c0650 con 0x7f8524069b80 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85100033f0 con 0x7f8524069b80 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687021630 0 0) 0x7f852406a010 con 0x7f8524154160 2023-05-10T01:24:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85240c0650 con 0x7f8524154160 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349266460 0 0) 0x7f85100033f0 con 0x7f8524069b80 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 msgr2=0x7f8524069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f8524069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 >> v1:172.21.15.172:6789/0 conn(0x7f8524154160 legacy=0x7f85240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240c0000 con 0x7f8524069b80 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f85140017f0 con 0x7f8524069b80 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 >> v1:172.21.15.52:6789/0 conn(0x7f8524069b80 legacy=0x7f85240c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f8510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510004690 0x7f8510004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f85100050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240bfd20 con 0x7f8510003aa0 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851000b9e0 con 0x7f8510004690 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851000bba0 con 0x7f8524154540 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f8510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8528867700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510004690 0x7f8510004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529869700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f85100050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 -- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 msgr2=0x7f85100050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524154540 0x7f85100050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 -- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510004690 msgr2=0x7f8510004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8510004690 0x7f8510004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 -- 172.21.15.52:0/3583944081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100033f0 con 0x7f8510003aa0 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.977+0000 7f8529068700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f8510003ea0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f851c0018d0 tx=0x7f851c007bb0).ready entity=mon.0 client_cookie=a06c6f79dc66175d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c007020 con 0x7f8510003aa0 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c007180 con 0x7f8510003aa0 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f8523fff700 1 -- 172.21.15.52:0/3583944081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c007500 con 0x7f8510003aa0 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 -- 172.21.15.52:0/3583944081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 msgr2=0x7f8510003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 --2- 172.21.15.52:0/3583944081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f8510003ea0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f851c0018d0 tx=0x7f851c007bb0).stop 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f8529869700 1 -- 172.21.15.52:0/3583944081 reap_dead start 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 -- 172.21.15.52:0/3583944081 shutdown_connections 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 -- 172.21.15.52:0/3583944081 >> 172.21.15.52:0/3583944081 conn(0x7f85240cb6f0 msgr2=0x7f85240c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 -- 172.21.15.52:0/3583944081 shutdown_connections 2023-05-10T01:24:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.978+0000 7f852b2cc700 1 -- 172.21.15.52:0/3583944081 wait complete. 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.979+0000 7f852b2cc700 1 Processor -- start 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.979+0000 7f852b2cc700 1 -- start start 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 0x7f85240c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524165090 0x7f85241586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240c4be0 con 0x7f8510003aa0 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524156bf0 con 0x7f852414fa50 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f852b2cc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240c2220 con 0x7f8524165090 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f8529068700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f8529068700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34914/0 (socket says 172.21.15.52:34914) 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.980+0000 7f8529068700 1 -- 172.21.15.52:0/65639934 learned_addr learned my addr 172.21.15.52:0/65639934 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 -- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524165090 msgr2=0x7f85241586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529869700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524165090 0x7f85241586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8528867700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 0x7f85240c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524165090 0x7f85241586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 -- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 msgr2=0x7f85240c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 0x7f85240c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 -- 172.21.15.52:0/65639934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240c4900 con 0x7f8510003aa0 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8528867700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 0x7f85240c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f8529068700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f851000b9b0 tx=0x7f851c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c007020 con 0x7f8510003aa0 2023-05-10T01:24:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c012610 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524156e90 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c012990 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.981+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85240c44f0 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.982+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524156a50 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.982+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f851c024030 con 0x7f8510003aa0 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.982+0000 7f85217fa700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 0x7f8504061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:24.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.983+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f851c07a9e0 con 0x7f8510003aa0 2023-05-10T01:24:24.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.983+0000 7f8528867700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 0x7f8504061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:24.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.983+0000 7f8528867700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 0x7f8504061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8518009270 tx=0x7f8518008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:24.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:24.988+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8524156a50 con 0x7f8510003aa0 2023-05-10T01:24:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.154+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85240c46e0 con 0x7f850405ed90 2023-05-10T01:24:25.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.165+0000 7f85217fa700 1 -- 172.21.15.52:0/65639934 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356879 (secure 0 0 0) 0x7f8518009950 con 0x7f850405ed90 2023-05-10T01:24:25.171 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:25.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 msgr2=0x7f8504061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 0x7f8504061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8518009270 tx=0x7f8518008040).stop 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 msgr2=0x7f85240c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f851000b9b0 tx=0x7f851c016000).stop 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 shutdown_connections 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f850405ed90 0x7f8504061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8524165090 0x7f85241586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8510003aa0 0x7f85240c1d30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 --2- 172.21.15.52:0/65639934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f852414fa50 0x7f85240c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 >> 172.21.15.52:0/65639934 conn(0x7f85240cb6f0 msgr2=0x7f85240ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 shutdown_connections 2023-05-10T01:24:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.168+0000 7f852b2cc700 1 -- 172.21.15.52:0/65639934 wait complete. 2023-05-10T01:24:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:24:25.183 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:24:24.755661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":143416,"kb_used_data":7416,"kb_used_omap":0,"kb_used_meta":135936,"kb_avail":754831304,"statfs":{"total":773094113280,"available":772947255296,"internally_reserved":0,"allocated":7593984,"data_stored":3773185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139198464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28005,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.154943"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441633+0000","last_change":"2023-05-10T01:24:20.438462+0000","last_active":"2023-05-10T01:24:20.441633+0000","last_peered":"2023-05-10T01:24:20.441633+0000","last_clean":"2023-05-10T01:24:20.441633+0000","last_became_active":"2023-05-10T01:24:20.437602+0000","last_became_peered":"2023-05-10T01:24:20.437602+0000","last_unstale":"2023-05-10T01:24:20.441633+0000","last_undegraded":"2023-05-10T01:24:20.441633+0000","last_fullsized":"2023-05-10T01:24:20.441633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439744+0000","last_change":"2023-05-10T01:24:20.044308+0000","last_active":"2023-05-10T01:24:20.439744+0000","last_peered":"2023-05-10T01:24:20.439744+0000","last_clean":"2023-05-10T01:24:20.439744+0000","last_became_active":"2023-05-10T01:24:20.043980+0000","last_became_peered":"2023-05-10T01:24:20.043980+0000","last_unstale":"2023-05-10T01:24:20.439744+0000","last_undegraded":"2023-05-10T01:24:20.439744+0000","last_fullsized":"2023-05-10T01:24:20.439744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023764+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028963+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036008+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.442739+0000","last_change":"2023-05-10T01:24:20.039146+0000","last_active":"2023-05-10T01:24:20.442739+0000","last_peered":"2023-05-10T01:24:20.442739+0000","last_clean":"2023-05-10T01:24:20.442739+0000","last_became_active":"2023-05-10T01:24:20.038857+0000","last_became_peered":"2023-05-10T01:24:20.038857+0000","last_unstale":"2023-05-10T01:24:20.442739+0000","last_undegraded":"2023-05-10T01:24:20.442739+0000","last_fullsized":"2023-05-10T01:24:20.442739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454152+0000","last_change":"2023-05-10T01:24:20.453347+0000","last_active":"2023-05-10T01:24:20.454152+0000","last_peered":"2023-05-10T01:24:20.454152+0000","last_clean":"2023-05-10T01:24:20.454152+0000","last_became_active":"2023-05-10T01:24:20.452959+0000","last_became_peered":"2023-05-10T01:24:20.452959+0000","last_unstale":"2023-05-10T01:24:20.454152+0000","last_undegraded":"2023-05-10T01:24:20.454152+0000","last_fullsized":"2023-05-10T01:24:20.454152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440955+0000","last_change":"2023-05-10T01:24:20.040295+0000","last_active":"2023-05-10T01:24:20.440955+0000","last_peered":"2023-05-10T01:24:20.440955+0000","last_clean":"2023-05-10T01:24:20.440955+0000","last_became_active":"2023-05-10T01:24:20.039974+0000","last_became_peered":"2023-05-10T01:24:20.039974+0000","last_unstale":"2023-05-10T01:24:20.440955+0000","last_undegraded":"2023-05-10T01:24:20.440955+0000","last_fullsized":"2023-05-10T01:24:20.440955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451107+0000","last_change":"2023-05-10T01:24:20.450452+0000","last_active":"2023-05-10T01:24:20.451107+0000","last_peered":"2023-05-10T01:24:20.451107+0000","last_clean":"2023-05-10T01:24:20.451107+0000","last_became_active":"2023-05-10T01:24:20.450171+0000","last_became_peered":"2023-05-10T01:24:20.450171+0000","last_unstale":"2023-05-10T01:24:20.451107+0000","last_undegraded":"2023-05-10T01:24:20.451107+0000","last_fullsized":"2023-05-10T01:24:20.451107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432650+0000","last_change":"2023-05-10T01:24:20.041100+0000","last_active":"2023-05-10T01:24:20.432650+0000","last_peered":"2023-05-10T01:24:20.432650+0000","last_clean":"2023-05-10T01:24:20.432650+0000","last_became_active":"2023-05-10T01:24:20.040636+0000","last_became_peered":"2023-05-10T01:24:20.040636+0000","last_unstale":"2023-05-10T01:24:20.432650+0000","last_undegraded":"2023-05-10T01:24:20.432650+0000","last_fullsized":"2023-05-10T01:24:20.432650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463345+0000","last_change":"2023-05-10T01:24:20.458665+0000","last_active":"2023-05-10T01:24:20.463345+0000","last_peered":"2023-05-10T01:24:20.463345+0000","last_clean":"2023-05-10T01:24:20.463345+0000","last_became_active":"2023-05-10T01:24:20.458404+0000","last_became_peered":"2023-05-10T01:24:20.458404+0000","last_unstale":"2023-05-10T01:24:20.463345+0000","last_undegraded":"2023-05-10T01:24:20.463345+0000","last_fullsized":"2023-05-10T01:24:20.463345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025122+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431401+0000","last_change":"2023-05-10T01:24:20.040275+0000","last_active":"2023-05-10T01:24:20.431401+0000","last_peered":"2023-05-10T01:24:20.431401+0000","last_clean":"2023-05-10T01:24:20.431401+0000","last_became_active":"2023-05-10T01:24:20.039976+0000","last_became_peered":"2023-05-10T01:24:20.039976+0000","last_unstale":"2023-05-10T01:24:20.431401+0000","last_undegraded":"2023-05-10T01:24:20.431401+0000","last_fullsized":"2023-05-10T01:24:20.431401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444477+0000","last_change":"2023-05-10T01:24:20.439090+0000","last_active":"2023-05-10T01:24:20.444477+0000","last_peered":"2023-05-10T01:24:20.444477+0000","last_clean":"2023-05-10T01:24:20.444477+0000","last_became_active":"2023-05-10T01:24:20.438697+0000","last_became_peered":"2023-05-10T01:24:20.438697+0000","last_unstale":"2023-05-10T01:24:20.444477+0000","last_undegraded":"2023-05-10T01:24:20.444477+0000","last_fullsized":"2023-05-10T01:24:20.444477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021886+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021984+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035588+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446959+0000","last_change":"2023-05-10T01:24:20.444458+0000","last_active":"2023-05-10T01:24:20.446959+0000","last_peered":"2023-05-10T01:24:20.446959+0000","last_clean":"2023-05-10T01:24:20.446959+0000","last_became_active":"2023-05-10T01:24:20.444146+0000","last_became_peered":"2023-05-10T01:24:20.444146+0000","last_unstale":"2023-05-10T01:24:20.446959+0000","last_undegraded":"2023-05-10T01:24:20.446959+0000","last_fullsized":"2023-05-10T01:24:20.446959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459848+0000","last_change":"2023-05-10T01:24:20.041326+0000","last_active":"2023-05-10T01:24:20.459848+0000","last_peered":"2023-05-10T01:24:20.459848+0000","last_clean":"2023-05-10T01:24:20.459848+0000","last_became_active":"2023-05-10T01:24:20.040987+0000","last_became_peered":"2023-05-10T01:24:20.040987+0000","last_unstale":"2023-05-10T01:24:20.459848+0000","last_undegraded":"2023-05-10T01:24:20.459848+0000","last_fullsized":"2023-05-10T01:24:20.459848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431284+0000","last_change":"2023-05-10T01:24:20.038134+0000","last_active":"2023-05-10T01:24:20.431284+0000","last_peered":"2023-05-10T01:24:20.431284+0000","last_clean":"2023-05-10T01:24:20.431284+0000","last_became_active":"2023-05-10T01:24:20.037865+0000","last_became_peered":"2023-05-10T01:24:20.037865+0000","last_unstale":"2023-05-10T01:24:20.431284+0000","last_undegraded":"2023-05-10T01:24:20.431284+0000","last_fullsized":"2023-05-10T01:24:20.431284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432761+0000","last_change":"2023-05-10T01:24:20.040914+0000","last_active":"2023-05-10T01:24:20.432761+0000","last_peered":"2023-05-10T01:24:20.432761+0000","last_clean":"2023-05-10T01:24:20.432761+0000","last_became_active":"2023-05-10T01:24:20.040295+0000","last_became_peered":"2023-05-10T01:24:20.040295+0000","last_unstale":"2023-05-10T01:24:20.432761+0000","last_undegraded":"2023-05-10T01:24:20.432761+0000","last_fullsized":"2023-05-10T01:24:20.432761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447280+0000","last_change":"2023-05-10T01:24:20.045598+0000","last_active":"2023-05-10T01:24:20.447280+0000","last_peered":"2023-05-10T01:24:20.447280+0000","last_clean":"2023-05-10T01:24:20.447280+0000","last_became_active":"2023-05-10T01:24:20.045183+0000","last_became_peered":"2023-05-10T01:24:20.045183+0000","last_unstale":"2023-05-10T01:24:20.447280+0000","last_undegraded":"2023-05-10T01:24:20.447280+0000","last_fullsized":"2023-05-10T01:24:20.447280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025354+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463435+0000","last_change":"2023-05-10T01:24:20.459353+0000","last_active":"2023-05-10T01:24:20.463435+0000","last_peered":"2023-05-10T01:24:20.463435+0000","last_clean":"2023-05-10T01:24:20.463435+0000","last_became_active":"2023-05-10T01:24:20.458772+0000","last_became_peered":"2023-05-10T01:24:20.458772+0000","last_unstale":"2023-05-10T01:24:20.463435+0000","last_undegraded":"2023-05-10T01:24:20.463435+0000","last_fullsized":"2023-05-10T01:24:20.463435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031299+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440326+0000","last_change":"2023-05-10T01:24:20.437715+0000","last_active":"2023-05-10T01:24:20.440326+0000","last_peered":"2023-05-10T01:24:20.440326+0000","last_clean":"2023-05-10T01:24:20.440326+0000","last_became_active":"2023-05-10T01:24:20.437438+0000","last_became_peered":"2023-05-10T01:24:20.437438+0000","last_unstale":"2023-05-10T01:24:20.440326+0000","last_undegraded":"2023-05-10T01:24:20.440326+0000","last_fullsized":"2023-05-10T01:24:20.440326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438621+0000","last_change":"2023-05-10T01:24:20.045908+0000","last_active":"2023-05-10T01:24:20.438621+0000","last_peered":"2023-05-10T01:24:20.438621+0000","last_clean":"2023-05-10T01:24:20.438621+0000","last_became_active":"2023-05-10T01:24:20.045609+0000","last_became_peered":"2023-05-10T01:24:20.045609+0000","last_unstale":"2023-05-10T01:24:20.438621+0000","last_undegraded":"2023-05-10T01:24:20.438621+0000","last_fullsized":"2023-05-10T01:24:20.438621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025556+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.030216+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025422+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029541+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449967+0000","last_change":"2023-05-10T01:24:20.048246+0000","last_active":"2023-05-10T01:24:20.449967+0000","last_peered":"2023-05-10T01:24:20.449967+0000","last_clean":"2023-05-10T01:24:20.449967+0000","last_became_active":"2023-05-10T01:24:20.047976+0000","last_became_peered":"2023-05-10T01:24:20.047976+0000","last_unstale":"2023-05-10T01:24:20.449967+0000","last_undegraded":"2023-05-10T01:24:20.449967+0000","last_fullsized":"2023-05-10T01:24:20.449967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.430966+0000","last_change":"2023-05-10T01:24:20.035217+0000","last_active":"2023-05-10T01:24:20.430966+0000","last_peered":"2023-05-10T01:24:20.430966+0000","last_clean":"2023-05-10T01:24:20.430966+0000","last_became_active":"2023-05-10T01:24:20.034906+0000","last_became_peered":"2023-05-10T01:24:20.034906+0000","last_unstale":"2023-05-10T01:24:20.430966+0000","last_undegraded":"2023-05-10T01:24:20.430966+0000","last_fullsized":"2023-05-10T01:24:20.430966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447711+0000","last_change":"2023-05-10T01:24:20.443372+0000","last_active":"2023-05-10T01:24:20.447711+0000","last_peered":"2023-05-10T01:24:20.447711+0000","last_clean":"2023-05-10T01:24:20.447711+0000","last_became_active":"2023-05-10T01:24:20.443089+0000","last_became_peered":"2023-05-10T01:24:20.443089+0000","last_unstale":"2023-05-10T01:24:20.447711+0000","last_undegraded":"2023-05-10T01:24:20.447711+0000","last_fullsized":"2023-05-10T01:24:20.447711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.032211+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431470+0000","last_change":"2023-05-10T01:24:20.040862+0000","last_active":"2023-05-10T01:24:20.431470+0000","last_peered":"2023-05-10T01:24:20.431470+0000","last_clean":"2023-05-10T01:24:20.431470+0000","last_became_active":"2023-05-10T01:24:20.040538+0000","last_became_peered":"2023-05-10T01:24:20.040538+0000","last_unstale":"2023-05-10T01:24:20.431470+0000","last_undegraded":"2023-05-10T01:24:20.431470+0000","last_fullsized":"2023-05-10T01:24:20.431470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432810+0000","last_change":"2023-05-10T01:24:20.036237+0000","last_active":"2023-05-10T01:24:20.432810+0000","last_peered":"2023-05-10T01:24:20.432810+0000","last_clean":"2023-05-10T01:24:20.432810+0000","last_became_active":"2023-05-10T01:24:20.035938+0000","last_became_peered":"2023-05-10T01:24:20.035938+0000","last_unstale":"2023-05-10T01:24:20.432810+0000","last_undegraded":"2023-05-10T01:24:20.432810+0000","last_fullsized":"2023-05-10T01:24:20.432810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440401+0000","last_change":"2023-05-10T01:24:20.437391+0000","last_active":"2023-05-10T01:24:20.440401+0000","last_peered":"2023-05-10T01:24:20.440401+0000","last_clean":"2023-05-10T01:24:20.440401+0000","last_became_active":"2023-05-10T01:24:20.436953+0000","last_became_peered":"2023-05-10T01:24:20.436953+0000","last_unstale":"2023-05-10T01:24:20.440401+0000","last_undegraded":"2023-05-10T01:24:20.440401+0000","last_fullsized":"2023-05-10T01:24:20.440401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024102+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447405+0000","last_change":"2023-05-10T01:24:20.442195+0000","last_active":"2023-05-10T01:24:20.447405+0000","last_peered":"2023-05-10T01:24:20.447405+0000","last_clean":"2023-05-10T01:24:20.447405+0000","last_became_active":"2023-05-10T01:24:20.441921+0000","last_became_peered":"2023-05-10T01:24:20.441921+0000","last_unstale":"2023-05-10T01:24:20.447405+0000","last_undegraded":"2023-05-10T01:24:20.447405+0000","last_fullsized":"2023-05-10T01:24:20.447405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027958+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431766+0000","last_change":"2023-05-10T01:24:20.032017+0000","last_active":"2023-05-10T01:24:20.431766+0000","last_peered":"2023-05-10T01:24:20.431766+0000","last_clean":"2023-05-10T01:24:20.431766+0000","last_became_active":"2023-05-10T01:24:20.031718+0000","last_became_peered":"2023-05-10T01:24:20.031718+0000","last_unstale":"2023-05-10T01:24:20.431766+0000","last_undegraded":"2023-05-10T01:24:20.431766+0000","last_fullsized":"2023-05-10T01:24:20.431766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432045+0000","last_change":"2023-05-10T01:24:20.045212+0000","last_active":"2023-05-10T01:24:20.432045+0000","last_peered":"2023-05-10T01:24:20.432045+0000","last_clean":"2023-05-10T01:24:20.432045+0000","last_became_active":"2023-05-10T01:24:20.039882+0000","last_became_peered":"2023-05-10T01:24:20.039882+0000","last_unstale":"2023-05-10T01:24:20.432045+0000","last_undegraded":"2023-05-10T01:24:20.432045+0000","last_fullsized":"2023-05-10T01:24:20.432045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458898+0000","last_change":"2023-05-10T01:24:20.451923+0000","last_active":"2023-05-10T01:24:20.458898+0000","last_peered":"2023-05-10T01:24:20.458898+0000","last_clean":"2023-05-10T01:24:20.458898+0000","last_became_active":"2023-05-10T01:24:20.450847+0000","last_became_peered":"2023-05-10T01:24:20.450847+0000","last_unstale":"2023-05-10T01:24:20.458898+0000","last_undegraded":"2023-05-10T01:24:20.458898+0000","last_fullsized":"2023-05-10T01:24:20.458898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021863+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463477+0000","last_change":"2023-05-10T01:24:20.459865+0000","last_active":"2023-05-10T01:24:20.463477+0000","last_peered":"2023-05-10T01:24:20.463477+0000","last_clean":"2023-05-10T01:24:20.463477+0000","last_became_active":"2023-05-10T01:24:20.459515+0000","last_became_peered":"2023-05-10T01:24:20.459515+0000","last_unstale":"2023-05-10T01:24:20.463477+0000","last_undegraded":"2023-05-10T01:24:20.463477+0000","last_fullsized":"2023-05-10T01:24:20.463477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454298+0000","last_change":"2023-05-10T01:24:20.044669+0000","last_active":"2023-05-10T01:24:20.454298+0000","last_peered":"2023-05-10T01:24:20.454298+0000","last_clean":"2023-05-10T01:24:20.454298+0000","last_became_active":"2023-05-10T01:24:20.044344+0000","last_became_peered":"2023-05-10T01:24:20.044344+0000","last_unstale":"2023-05-10T01:24:20.454298+0000","last_undegraded":"2023-05-10T01:24:20.454298+0000","last_fullsized":"2023-05-10T01:24:20.454298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440538+0000","last_change":"2023-05-10T01:24:20.437997+0000","last_active":"2023-05-10T01:24:20.440538+0000","last_peered":"2023-05-10T01:24:20.440538+0000","last_clean":"2023-05-10T01:24:20.440538+0000","last_became_active":"2023-05-10T01:24:20.437543+0000","last_became_peered":"2023-05-10T01:24:20.437543+0000","last_unstale":"2023-05-10T01:24:20.440538+0000","last_undegraded":"2023-05-10T01:24:20.440538+0000","last_fullsized":"2023-05-10T01:24:20.440538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447793+0000","last_change":"2023-05-10T01:24:20.043479+0000","last_active":"2023-05-10T01:24:20.447793+0000","last_peered":"2023-05-10T01:24:20.447793+0000","last_clean":"2023-05-10T01:24:20.447793+0000","last_became_active":"2023-05-10T01:24:20.042740+0000","last_became_peered":"2023-05-10T01:24:20.042740+0000","last_unstale":"2023-05-10T01:24:20.447793+0000","last_undegraded":"2023-05-10T01:24:20.447793+0000","last_fullsized":"2023-05-10T01:24:20.447793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431645+0000","last_change":"2023-05-10T01:24:20.041177+0000","last_active":"2023-05-10T01:24:20.431645+0000","last_peered":"2023-05-10T01:24:20.431645+0000","last_clean":"2023-05-10T01:24:20.431645+0000","last_became_active":"2023-05-10T01:24:20.040883+0000","last_became_peered":"2023-05-10T01:24:20.040883+0000","last_unstale":"2023-05-10T01:24:20.431645+0000","last_undegraded":"2023-05-10T01:24:20.431645+0000","last_fullsized":"2023-05-10T01:24:20.431645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439291+0000","last_change":"2023-05-10T01:24:20.437109+0000","last_active":"2023-05-10T01:24:20.439291+0000","last_peered":"2023-05-10T01:24:20.439291+0000","last_clean":"2023-05-10T01:24:20.439291+0000","last_became_active":"2023-05-10T01:24:20.436810+0000","last_became_peered":"2023-05-10T01:24:20.436810+0000","last_unstale":"2023-05-10T01:24:20.439291+0000","last_undegraded":"2023-05-10T01:24:20.439291+0000","last_fullsized":"2023-05-10T01:24:20.439291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023672+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024187+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463377+0000","last_change":"2023-05-10T01:24:20.459050+0000","last_active":"2023-05-10T01:24:20.463377+0000","last_peered":"2023-05-10T01:24:20.463377+0000","last_clean":"2023-05-10T01:24:20.463377+0000","last_became_active":"2023-05-10T01:24:20.458758+0000","last_became_peered":"2023-05-10T01:24:20.458758+0000","last_unstale":"2023-05-10T01:24:20.463377+0000","last_undegraded":"2023-05-10T01:24:20.463377+0000","last_fullsized":"2023-05-10T01:24:20.463377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027471+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.450025+0000","last_change":"2023-05-10T01:24:20.042766+0000","last_active":"2023-05-10T01:24:20.450025+0000","last_peered":"2023-05-10T01:24:20.450025+0000","last_clean":"2023-05-10T01:24:20.450025+0000","last_became_active":"2023-05-10T01:24:20.042490+0000","last_became_peered":"2023-05-10T01:24:20.042490+0000","last_unstale":"2023-05-10T01:24:20.450025+0000","last_undegraded":"2023-05-10T01:24:20.450025+0000","last_fullsized":"2023-05-10T01:24:20.450025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029020+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.433006+0000","last_change":"2023-05-10T01:24:20.037935+0000","last_active":"2023-05-10T01:24:20.433006+0000","last_peered":"2023-05-10T01:24:20.433006+0000","last_clean":"2023-05-10T01:24:20.433006+0000","last_became_active":"2023-05-10T01:24:20.037566+0000","last_became_peered":"2023-05-10T01:24:20.037566+0000","last_unstale":"2023-05-10T01:24:20.433006+0000","last_undegraded":"2023-05-10T01:24:20.433006+0000","last_fullsized":"2023-05-10T01:24:20.433006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458929+0000","last_change":"2023-05-10T01:24:20.455086+0000","last_active":"2023-05-10T01:24:20.458929+0000","last_peered":"2023-05-10T01:24:20.458929+0000","last_clean":"2023-05-10T01:24:20.458929+0000","last_became_active":"2023-05-10T01:24:20.454818+0000","last_became_peered":"2023-05-10T01:24:20.454818+0000","last_unstale":"2023-05-10T01:24:20.458929+0000","last_undegraded":"2023-05-10T01:24:20.458929+0000","last_fullsized":"2023-05-10T01:24:20.458929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028127+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446853+0000","last_change":"2023-05-10T01:24:20.440480+0000","last_active":"2023-05-10T01:24:20.446853+0000","last_peered":"2023-05-10T01:24:20.446853+0000","last_clean":"2023-05-10T01:24:20.446853+0000","last_became_active":"2023-05-10T01:24:20.440029+0000","last_became_peered":"2023-05-10T01:24:20.440029+0000","last_unstale":"2023-05-10T01:24:20.446853+0000","last_undegraded":"2023-05-10T01:24:20.446853+0000","last_fullsized":"2023-05-10T01:24:20.446853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021905+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454376+0000","last_change":"2023-05-10T01:24:20.450582+0000","last_active":"2023-05-10T01:24:20.454376+0000","last_peered":"2023-05-10T01:24:20.454376+0000","last_clean":"2023-05-10T01:24:20.454376+0000","last_became_active":"2023-05-10T01:24:20.450302+0000","last_became_peered":"2023-05-10T01:24:20.450302+0000","last_unstale":"2023-05-10T01:24:20.454376+0000","last_undegraded":"2023-05-10T01:24:20.454376+0000","last_fullsized":"2023-05-10T01:24:20.454376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029773+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036128+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463458+0000","last_change":"2023-05-10T01:24:20.459687+0000","last_active":"2023-05-10T01:24:20.463458+0000","last_peered":"2023-05-10T01:24:20.463458+0000","last_clean":"2023-05-10T01:24:20.463458+0000","last_became_active":"2023-05-10T01:24:20.459335+0000","last_became_peered":"2023-05-10T01:24:20.459335+0000","last_unstale":"2023-05-10T01:24:20.463458+0000","last_undegraded":"2023-05-10T01:24:20.463458+0000","last_fullsized":"2023-05-10T01:24:20.463458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027530+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457009+0000","last_change":"2023-05-10T01:24:20.044573+0000","last_active":"2023-05-10T01:24:20.457009+0000","last_peered":"2023-05-10T01:24:20.457009+0000","last_clean":"2023-05-10T01:24:20.457009+0000","last_became_active":"2023-05-10T01:24:20.044299+0000","last_became_peered":"2023-05-10T01:24:20.044299+0000","last_unstale":"2023-05-10T01:24:20.457009+0000","last_undegraded":"2023-05-10T01:24:20.457009+0000","last_fullsized":"2023-05-10T01:24:20.457009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440634+0000","last_change":"2023-05-10T01:24:20.439231+0000","last_active":"2023-05-10T01:24:20.440634+0000","last_peered":"2023-05-10T01:24:20.440634+0000","last_clean":"2023-05-10T01:24:20.440634+0000","last_became_active":"2023-05-10T01:24:20.438862+0000","last_became_peered":"2023-05-10T01:24:20.438862+0000","last_unstale":"2023-05-10T01:24:20.440634+0000","last_undegraded":"2023-05-10T01:24:20.440634+0000","last_fullsized":"2023-05-10T01:24:20.440634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031738+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439860+0000","last_change":"2023-05-10T01:24:20.436161+0000","last_active":"2023-05-10T01:24:20.439860+0000","last_peered":"2023-05-10T01:24:20.439860+0000","last_clean":"2023-05-10T01:24:20.439860+0000","last_became_active":"2023-05-10T01:24:20.435870+0000","last_became_peered":"2023-05-10T01:24:20.435870+0000","last_unstale":"2023-05-10T01:24:20.439860+0000","last_undegraded":"2023-05-10T01:24:20.439860+0000","last_fullsized":"2023-05-10T01:24:20.439860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031690+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431691+0000","last_change":"2023-05-10T01:24:20.043700+0000","last_active":"2023-05-10T01:24:20.431691+0000","last_peered":"2023-05-10T01:24:20.431691+0000","last_clean":"2023-05-10T01:24:20.431691+0000","last_became_active":"2023-05-10T01:24:20.043173+0000","last_became_peered":"2023-05-10T01:24:20.043173+0000","last_unstale":"2023-05-10T01:24:20.431691+0000","last_undegraded":"2023-05-10T01:24:20.431691+0000","last_fullsized":"2023-05-10T01:24:20.431691+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463316+0000","last_change":"2023-05-10T01:24:20.458201+0000","last_active":"2023-05-10T01:24:20.463316+0000","last_peered":"2023-05-10T01:24:20.463316+0000","last_clean":"2023-05-10T01:24:20.463316+0000","last_became_active":"2023-05-10T01:24:20.457952+0000","last_became_peered":"2023-05-10T01:24:20.457952+0000","last_unstale":"2023-05-10T01:24:20.463316+0000","last_undegraded":"2023-05-10T01:24:20.463316+0000","last_fullsized":"2023-05-10T01:24:20.463316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021305+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459739+0000","last_change":"2023-05-10T01:24:20.454958+0000","last_active":"2023-05-10T01:24:20.459739+0000","last_peered":"2023-05-10T01:24:20.459739+0000","last_clean":"2023-05-10T01:24:20.459739+0000","last_became_active":"2023-05-10T01:24:20.454675+0000","last_became_peered":"2023-05-10T01:24:20.454675+0000","last_unstale":"2023-05-10T01:24:20.459739+0000","last_undegraded":"2023-05-10T01:24:20.459739+0000","last_fullsized":"2023-05-10T01:24:20.459739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029219+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454768+0000","last_change":"2023-05-10T01:24:20.453355+0000","last_active":"2023-05-10T01:24:20.454768+0000","last_peered":"2023-05-10T01:24:20.454768+0000","last_clean":"2023-05-10T01:24:20.454768+0000","last_became_active":"2023-05-10T01:24:20.453115+0000","last_became_peered":"2023-05-10T01:24:20.453115+0000","last_unstale":"2023-05-10T01:24:20.454768+0000","last_undegraded":"2023-05-10T01:24:20.454768+0000","last_fullsized":"2023-05-10T01:24:20.454768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023744+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025182+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.445126+0000","last_change":"2023-05-10T01:24:20.443260+0000","last_active":"2023-05-10T01:24:20.445126+0000","last_peered":"2023-05-10T01:24:20.445126+0000","last_clean":"2023-05-10T01:24:20.445126+0000","last_became_active":"2023-05-10T01:24:20.442965+0000","last_became_peered":"2023-05-10T01:24:20.442965+0000","last_unstale":"2023-05-10T01:24:20.445126+0000","last_undegraded":"2023-05-10T01:24:20.445126+0000","last_fullsized":"2023-05-10T01:24:20.445126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021314+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505833+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:17.505833+0000","last_peered":"2023-05-10T01:24:17.505833+0000","last_clean":"2023-05-10T01:24:17.505833+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:17.505833+0000","last_undegraded":"2023-05-10T01:24:17.505833+0000","last_fullsized":"2023-05-10T01:24:17.505833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459163+0000","last_change":"2023-05-10T01:24:20.454422+0000","last_active":"2023-05-10T01:24:20.459163+0000","last_peered":"2023-05-10T01:24:20.459163+0000","last_clean":"2023-05-10T01:24:20.459163+0000","last_became_active":"2023-05-10T01:24:20.454203+0000","last_became_peered":"2023-05-10T01:24:20.454203+0000","last_unstale":"2023-05-10T01:24:20.459163+0000","last_undegraded":"2023-05-10T01:24:20.459163+0000","last_fullsized":"2023-05-10T01:24:20.459163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431226+0000","last_change":"2023-05-10T01:24:20.041801+0000","last_active":"2023-05-10T01:24:20.431226+0000","last_peered":"2023-05-10T01:24:20.431226+0000","last_clean":"2023-05-10T01:24:20.431226+0000","last_became_active":"2023-05-10T01:24:20.041469+0000","last_became_peered":"2023-05-10T01:24:20.041469+0000","last_unstale":"2023-05-10T01:24:20.431226+0000","last_undegraded":"2023-05-10T01:24:20.431226+0000","last_fullsized":"2023-05-10T01:24:20.431226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505738+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:17.505738+0000","last_peered":"2023-05-10T01:24:17.505738+0000","last_clean":"2023-05-10T01:24:17.505738+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:17.505738+0000","last_undegraded":"2023-05-10T01:24:17.505738+0000","last_fullsized":"2023-05-10T01:24:17.505738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031678+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431784+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:20.431784+0000","last_peered":"2023-05-10T01:24:20.431784+0000","last_clean":"2023-05-10T01:24:20.431784+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:20.431784+0000","last_undegraded":"2023-05-10T01:24:20.431784+0000","last_fullsized":"2023-05-10T01:24:20.431784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459768+0000","last_change":"2023-05-10T01:24:20.449951+0000","last_active":"2023-05-10T01:24:20.459768+0000","last_peered":"2023-05-10T01:24:20.459768+0000","last_clean":"2023-05-10T01:24:20.459768+0000","last_became_active":"2023-05-10T01:24:20.449732+0000","last_became_peered":"2023-05-10T01:24:20.449732+0000","last_unstale":"2023-05-10T01:24:20.459768+0000","last_undegraded":"2023-05-10T01:24:20.459768+0000","last_fullsized":"2023-05-10T01:24:20.459768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024166+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505775+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:17.505775+0000","last_peered":"2023-05-10T01:24:17.505775+0000","last_clean":"2023-05-10T01:24:17.505775+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:17.505775+0000","last_undegraded":"2023-05-10T01:24:17.505775+0000","last_fullsized":"2023-05-10T01:24:17.505775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506127+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:17.506127+0000","last_peered":"2023-05-10T01:24:17.506127+0000","last_clean":"2023-05-10T01:24:17.506127+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:17.506127+0000","last_undegraded":"2023-05-10T01:24:17.506127+0000","last_fullsized":"2023-05-10T01:24:17.506127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440378+0000","last_change":"2023-05-10T01:24:20.437212+0000","last_active":"2023-05-10T01:24:20.440378+0000","last_peered":"2023-05-10T01:24:20.440378+0000","last_clean":"2023-05-10T01:24:20.440378+0000","last_became_active":"2023-05-10T01:24:20.436615+0000","last_became_peered":"2023-05-10T01:24:20.436615+0000","last_unstale":"2023-05-10T01:24:20.440378+0000","last_undegraded":"2023-05-10T01:24:20.440378+0000","last_fullsized":"2023-05-10T01:24:20.440378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452262+0000","last_change":"2023-05-10T01:24:20.039528+0000","last_active":"2023-05-10T01:24:20.452262+0000","last_peered":"2023-05-10T01:24:20.452262+0000","last_clean":"2023-05-10T01:24:20.452262+0000","last_became_active":"2023-05-10T01:24:20.039224+0000","last_became_peered":"2023-05-10T01:24:20.039224+0000","last_unstale":"2023-05-10T01:24:20.452262+0000","last_undegraded":"2023-05-10T01:24:20.452262+0000","last_fullsized":"2023-05-10T01:24:20.452262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506182+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:17.506182+0000","last_peered":"2023-05-10T01:24:17.506182+0000","last_clean":"2023-05-10T01:24:17.506182+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:17.506182+0000","last_undegraded":"2023-05-10T01:24:17.506182+0000","last_fullsized":"2023-05-10T01:24:17.506182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460951+0000","last_change":"2023-05-10T01:24:20.456847+0000","last_active":"2023-05-10T01:24:20.460951+0000","last_peered":"2023-05-10T01:24:20.460951+0000","last_clean":"2023-05-10T01:24:20.460951+0000","last_became_active":"2023-05-10T01:24:20.456275+0000","last_became_peered":"2023-05-10T01:24:20.456275+0000","last_unstale":"2023-05-10T01:24:20.460951+0000","last_undegraded":"2023-05-10T01:24:20.460951+0000","last_fullsized":"2023-05-10T01:24:20.460951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506178+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:17.506178+0000","last_peered":"2023-05-10T01:24:17.506178+0000","last_clean":"2023-05-10T01:24:17.506178+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:17.506178+0000","last_undegraded":"2023-05-10T01:24:17.506178+0000","last_fullsized":"2023-05-10T01:24:17.506178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460760+0000","last_change":"2023-05-10T01:24:20.456245+0000","last_active":"2023-05-10T01:24:20.460760+0000","last_peered":"2023-05-10T01:24:20.460760+0000","last_clean":"2023-05-10T01:24:20.460760+0000","last_became_active":"2023-05-10T01:24:20.455951+0000","last_became_peered":"2023-05-10T01:24:20.455951+0000","last_unstale":"2023-05-10T01:24:20.460760+0000","last_undegraded":"2023-05-10T01:24:20.460760+0000","last_fullsized":"2023-05-10T01:24:20.460760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028589+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505853+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:17.505853+0000","last_peered":"2023-05-10T01:24:17.505853+0000","last_clean":"2023-05-10T01:24:17.505853+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:17.505853+0000","last_undegraded":"2023-05-10T01:24:17.505853+0000","last_fullsized":"2023-05-10T01:24:17.505853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463289+0000","last_change":"2023-05-10T01:24:20.456478+0000","last_active":"2023-05-10T01:24:20.463289+0000","last_peered":"2023-05-10T01:24:20.463289+0000","last_clean":"2023-05-10T01:24:20.463289+0000","last_became_active":"2023-05-10T01:24:20.456221+0000","last_became_peered":"2023-05-10T01:24:20.456221+0000","last_unstale":"2023-05-10T01:24:20.463289+0000","last_undegraded":"2023-05-10T01:24:20.463289+0000","last_fullsized":"2023-05-10T01:24:20.463289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023748+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452551+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:20.452551+0000","last_peered":"2023-05-10T01:24:20.452551+0000","last_clean":"2023-05-10T01:24:20.452551+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:20.452551+0000","last_undegraded":"2023-05-10T01:24:20.452551+0000","last_fullsized":"2023-05-10T01:24:20.452551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16788,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355052,"statfs":{"total":96636764160,"available":96619573248,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.73799999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16380,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355460,"statfs":{"total":96636764160,"available":96619991040,"internally_reserved":0,"allocated":970752,"data_stored":483007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16020,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355820,"statfs":{"total":96636764160,"available":96620359680,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.376},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16120,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94355720,"statfs":{"total":96636764160,"available":96620257280,"internally_reserved":0,"allocated":966656,"data_stored":482973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.621},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17472,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94354368,"statfs":{"total":96636764160,"available":96618872832,"internally_reserved":0,"allocated":974848,"data_stored":483597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.72499999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.622}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24276,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":23360,"kb_avail":94347564,"statfs":{"total":96636764160,"available":96611905536,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23920640},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.38,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.23999999999999999},"max":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.313},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93400000000000005,"15min":1.0589999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.439},"max":{"1min":0.87,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.502,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.27,"15min":1.27},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":1.216,"15min":1.216},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.52800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.432},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16640,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355200,"statfs":{"total":96636764160,"available":96619724800,"internally_reserved":0,"allocated":974848,"data_stored":483617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19720,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94352120,"statfs":{"total":96636764160,"available":96616570880,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:24:25.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-05-10T01:24:25.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-05-10T01:24:25.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.023764+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-05-10T01:24:25.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-05-10T01:24:25.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.028963+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-05-10T01:24:25.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-05-10T01:24:25.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.036008+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-05-10T01:24:25.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-05-10T01:24:25.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.025122+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-05-10T01:24:25.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-05-10T01:24:25.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021886+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-05-10T01:24:25.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-05-10T01:24:25.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021984+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-05-10T01:24:25.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-05-10T01:24:25.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.035588+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-05-10T01:24:25.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-05-10T01:24:25.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-05-10T01:24:25.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-05-10T01:24:25.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-05-10T01:24:25.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.025354+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-05-10T01:24:25.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.031299+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-05-10T01:24:25.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-05-10T01:24:25.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.025556+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-05-10T01:24:25.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-05-10T01:24:25.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.030216+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-05-10T01:24:25.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-05-10T01:24:25.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.025422+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-05-10T01:24:25.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-05-10T01:24:25.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.029541+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-05-10T01:24:25.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-05-10T01:24:25.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-05-10T01:24:25.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.032211+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-05-10T01:24:25.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-05-10T01:24:25.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-05-10T01:24:25.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.024102+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-05-10T01:24:25.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.027958+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-05-10T01:24:25.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-05-10T01:24:25.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-05-10T01:24:25.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021863+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-05-10T01:24:25.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-05-10T01:24:25.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.023672+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-05-10T01:24:25.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-05-10T01:24:25.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.024187+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-05-10T01:24:25.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.027471+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-05-10T01:24:25.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-05-10T01:24:25.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-05-10T01:24:25.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.029020+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-05-10T01:24:25.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-05-10T01:24:25.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.028127+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-05-10T01:24:25.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021905+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-05-10T01:24:25.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.029773+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-05-10T01:24:25.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-05-10T01:24:25.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.036128+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-05-10T01:24:25.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.027530+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-05-10T01:24:25.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-05-10T01:24:25.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.031738+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-05-10T01:24:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.031690+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-05-10T01:24:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-05-10T01:24:25.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021305+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-05-10T01:24:25.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.029219+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-05-10T01:24:25.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.023744+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-05-10T01:24:25.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-05-10T01:24:25.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.025182+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-05-10T01:24:25.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.021314+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:24:25.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-05-10T01:24:25.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-05-10T01:24:25.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.035740+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-05-10T01:24:25.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:20.019186+0000', 'last_change': '2023-05-10T01:24:20.019186+0000', 'last_active': '2023-05-10T01:24:20.019186+0000', 'last_peered': '2023-05-10T01:24:20.019186+0000', 'last_clean': '2023-05-10T01:24:20.019186+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:20.019186+0000', 'last_undegraded': '2023-05-10T01:24:20.019186+0000', 'last_fullsized': '2023-05-10T01:24:20.019186+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:20.019186+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:24:25.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-05-10T01:24:25.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.031678+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:24:25.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-05-10T01:24:25.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.024166+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-05-10T01:24:25.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.027740+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-05-10T01:24:25.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.028589+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:24:25.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-05-10T01:24:25.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:19.017602+0000', 'last_change': '2023-05-10T01:24:19.023748+0000', 'last_active': '2023-05-10T01:24:19.017602+0000', 'last_peered': '2023-05-10T01:24:19.017602+0000', 'last_clean': '2023-05-10T01:24:19.017602+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:19.017602+0000', 'last_undegraded': '2023-05-10T01:24:19.017602+0000', 'last_fullsized': '2023-05-10T01:24:19.017602+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:19.017602+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:24:25.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:24:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 Processor -- start 2023-05-10T01:24:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 -- start start 2023-05-10T01:24:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac40c5b70 0x7f9ac4063730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40c44e0 con 0x7f9ac40c33d0 2023-05-10T01:24:25.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40c38d0 con 0x7f9ac4153e00 2023-05-10T01:24:25.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9acaf1d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40c3bb0 con 0x7f9ac40c5b70 2023-05-10T01:24:25.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac40c5b70 0x7f9ac4063730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac40c5b70 0x7f9ac4063730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34924/0 (socket says 172.21.15.52:34924) 2023-05-10T01:24:25.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac94ba700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ac40c33d0 0x7f9ac4063c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43940/0 (socket says 172.21.15.52:43940) 2023-05-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 -- 172.21.15.52:0/2918826555 learned_addr learned my addr 172.21.15.52:0/2918826555 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 -- 172.21.15.52:0/2918826555 >> v1:172.21.15.172:6789/0 conn(0x7f9ac4153e00 legacy=0x7f9ac40c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 -- 172.21.15.52:0/2918826555 >> v1:172.21.15.52:6789/0 conn(0x7f9ac40c33d0 legacy=0x7f9ac4063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 -- 172.21.15.52:0/2918826555 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40c3e90 con 0x7f9ac40c5b70 2023-05-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac37fe700 1 -- 172.21.15.52:0/2918826555 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558530216 0 0) 0x7f9ac40c44e0 con 0x7f9ac40c33d0 2023-05-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac3fff700 1 --2- 172.21.15.52:0/2918826555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40c5b70 0x7f9ac4063730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9aac006fd0 tx=0x7f9aac0090f0).ready entity=mon.0 client_cookie=fc047e68a60019ff server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac37fe700 1 -- 172.21.15.52:0/2918826555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00b600 con 0x7f9ac40c5b70 2023-05-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac37fe700 1 -- 172.21.15.52:0/2918826555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac00b760 con 0x7f9ac40c5b70 2023-05-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.351+0000 7f9ac37fe700 1 -- 172.21.15.52:0/2918826555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00bae0 con 0x7f9ac40c5b70 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 -- 172.21.15.52:0/2918826555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40c5b70 msgr2=0x7f9ac4063730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/2918826555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40c5b70 0x7f9ac4063730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9aac006fd0 tx=0x7f9aac0090f0).stop 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 -- 172.21.15.52:0/2918826555 shutdown_connections 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/2918826555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40c5b70 0x7f9ac4063730 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 -- 172.21.15.52:0/2918826555 >> 172.21.15.52:0/2918826555 conn(0x7f9ac405dd40 msgr2=0x7f9ac405e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 -- 172.21.15.52:0/2918826555 shutdown_connections 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.352+0000 7f9acaf1d700 1 -- 172.21.15.52:0/2918826555 wait complete. 2023-05-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.353+0000 7f9acaf1d700 1 Processor -- start 2023-05-10T01:24:25.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.353+0000 7f9acaf1d700 1 -- start start 2023-05-10T01:24:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ac40c33d0 0x7f9ac4168f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ac40c5b70 0x7f9ac40ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4150220 con 0x7f9ac4153e00 2023-05-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40ac230 con 0x7f9ac40c5b70 2023-05-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40ac510 con 0x7f9ac40c33d0 2023-05-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34930/0 (socket says 172.21.15.52:34930) 2023-05-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 -- 172.21.15.52:0/4174105559 learned_addr learned my addr 172.21.15.52:0/4174105559 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac8cb9700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ac40c33d0 0x7f9ac4168f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac3fff700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ac40c5b70 0x7f9ac40ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 -- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ac40c33d0 msgr2=0x7f9ac4168f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ac40c33d0 0x7f9ac4168f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 -- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ac40c5b70 msgr2=0x7f9ac40ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ac40c5b70 0x7f9ac40ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 -- 172.21.15.52:0/4174105559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac009370 con 0x7f9ac4153e00 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac94ba700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f9ab400c420 tx=0x7f9ab4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40070d0 con 0x7f9ac4153e00 2023-05-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4007230 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40ac7f0 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40056e0 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.355+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40abed0 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.356+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac406c340 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.356+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9ab4010070 con 0x7f9ac4153e00 2023-05-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.356+0000 7f9ac0ff9700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 0x7f9aa8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.357+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9ab4079270 con 0x7f9ac4153e00 2023-05-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.357+0000 7f9ac8cb9700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 0x7f9aa8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.357+0000 7f9ac8cb9700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 0x7f9aa8061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9abc004290 tx=0x7f9abc0014c0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.361+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ab404a5f0 con 0x7f9ac4153e00 2023-05-10T01:24:25.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.604+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9ac40c4170 con 0x7f9ac4153e00 2023-05-10T01:24:25.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.605+0000 7f9ac0ff9700 1 -- 172.21.15.52:0/4174105559 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1111 (secure 0 0 0) 0x7f9ab404dc10 con 0x7f9ac4153e00 2023-05-10T01:24:25.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:25.609 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":890,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":80,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":66},{"state_name":"creating+peering","count":39},{"state_name":"unknown","count":32}],"num_pgs":137,"num_pools":4,"num_objects":10,"data_bytes":624,"bytes_used":146857984,"bytes_avail":772947255296,"bytes_total":773094113280,"unknown_pgs_ratio":0.23357664048671722,"inactive_pgs_ratio":0.28467154502868652},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-05-10T01:23:14.899867+0000","services":{}},"progress_events":{}} 2023-05-10T01:24:25.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 msgr2=0x7f9aa8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 0x7f9aa8061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9abc004290 tx=0x7f9abc0014c0).stop 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 msgr2=0x7f9ac414c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f9ab400c420 tx=0x7f9ab4007bb0).stop 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 shutdown_connections 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9aa805ed60 0x7f9aa8061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac4153e00 0x7f9ac414c600 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ac40c33d0 0x7f9ac4168f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 --2- 172.21.15.52:0/4174105559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ac40c5b70 0x7f9ac40ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 >> 172.21.15.52:0/4174105559 conn(0x7f9ac405dd40 msgr2=0x7f9ac4064300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:25.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 shutdown_connections 2023-05-10T01:24:25.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.607+0000 7f9acaf1d700 1 -- 172.21.15.52:0/4174105559 wait complete. 2023-05-10T01:24:25.623 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:24:25.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:25.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.736+0000 7fe40647e700 1 Processor -- start 2023-05-10T01:24:25.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 -- start start 2023-05-10T01:24:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 0x7fe400154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe400064ff0 0x7fe400065480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400067550 con 0x7fe400068c60 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe400065970 con 0x7fe400064ff0 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.737+0000 7fe40647e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000bc9a0 con 0x7fe400153ea0 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe400064ff0 0x7fe400065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3f7fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe400068c60 0x7fe400066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43954/0 (socket says 172.21.15.52:43954) 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe400064ff0 0x7fe400065480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34936/0 (socket says 172.21.15.52:34936) 2023-05-10T01:24:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3f7fff700 1 -- 172.21.15.52:0/2011695388 learned_addr learned my addr 172.21.15.52:0/2011695388 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 -- 172.21.15.52:0/2011695388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 msgr2=0x7fe400154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3fffff700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 0x7fe400154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3ff7fe700 1 -- 172.21.15.52:0/2011695388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221143641 0 0) 0x7fe3e8001110 con 0x7fe400068c60 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 0x7fe400154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 -- 172.21.15.52:0/2011695388 >> v1:172.21.15.52:6789/0 conn(0x7fe400068c60 legacy=0x7fe400066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 -- 172.21.15.52:0/2011695388 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000bcc80 con 0x7fe400064ff0 2023-05-10T01:24:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3fffff700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 0x7fe400154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe404a1b700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400064ff0 0x7fe400065480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fe3f8009e60 tx=0x7fe3f8009780).ready entity=mon.0 client_cookie=5d2ed32e659b3d1f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3ff7fe700 1 -- 172.21.15.52:0/2011695388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800e070 con 0x7fe400064ff0 2023-05-10T01:24:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3ff7fe700 1 -- 172.21.15.52:0/2011695388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f800bc30 con 0x7fe400064ff0 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.738+0000 7fe3ff7fe700 1 -- 172.21.15.52:0/2011695388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8012410 con 0x7fe400064ff0 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 -- 172.21.15.52:0/2011695388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400064ff0 msgr2=0x7fe400065480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400064ff0 0x7fe400065480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fe3f8009e60 tx=0x7fe3f8009780).stop 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 -- 172.21.15.52:0/2011695388 shutdown_connections 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400064ff0 0x7fe400065480 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 --2- 172.21.15.52:0/2011695388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400153ea0 0x7fe400154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 -- 172.21.15.52:0/2011695388 >> 172.21.15.52:0/2011695388 conn(0x7fe4000c4420 msgr2=0x7fe4000c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:25.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 -- 172.21.15.52:0/2011695388 shutdown_connections 2023-05-10T01:24:25.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.739+0000 7fe40647e700 1 -- 172.21.15.52:0/2011695388 wait complete. 2023-05-10T01:24:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.740+0000 7fe40647e700 1 Processor -- start 2023-05-10T01:24:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.740+0000 7fe40647e700 1 -- start start 2023-05-10T01:24:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400064ff0 0x7fe4001527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4000bf860 0x7fe4000a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000a66a0 con 0x7fe400153ea0 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000bf3d0 con 0x7fe4000bf860 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000beaa0 con 0x7fe400064ff0 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34942/0 (socket says 172.21.15.52:34942) 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1162188977 learned_addr learned my addr 172.21.15.52:0/1162188977 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe404a1b700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4000bf860 0x7fe4000a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400064ff0 msgr2=0x7fe4001527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400064ff0 0x7fe4001527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4000bf860 msgr2=0x7fe4000a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4000bf860 0x7fe4000a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1162188977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009a20 con 0x7fe400153ea0 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fe3e800c460 tx=0x7fe3e80079f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80072e0 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8007440 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80057a0 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4000bed80 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4000c12a0 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.742+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40006c340 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.743+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3e8010070 con 0x7fe400153ea0 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.743+0000 7fe3fcff9700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 0x7fe3e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.743+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe3e8078fc0 con 0x7fe400153ea0 2023-05-10T01:24:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.743+0000 7fe3fffff700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 0x7fe3e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.744+0000 7fe3fffff700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 0x7fe3e4061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe3f0006fd0 tx=0x7fe3f0008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.747+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3e804a450 con 0x7fe400153ea0 2023-05-10T01:24:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.916+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4000bf540 con 0x7fe3e405ed90 2023-05-10T01:24:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.927+0000 7fe3fcff9700 1 -- 172.21.15.52:0/1162188977 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356879 (secure 0 0 0) 0x7fe4000bf540 con 0x7fe3e405ed90 2023-05-10T01:24:25.936 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 msgr2=0x7fe3e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 0x7fe3e4061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe3f0006fd0 tx=0x7fe3f0008040).stop 2023-05-10T01:24:25.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 msgr2=0x7fe4000a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:25.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fe3e800c460 tx=0x7fe3e80079f0).stop 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 shutdown_connections 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3e405ed90 0x7fe3e4061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4000bf860 0x7fe4000a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe400064ff0 0x7fe4001527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 --2- 172.21.15.52:0/1162188977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe400153ea0 0x7fe4000a5cc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 >> 172.21.15.52:0/1162188977 conn(0x7fe4000c4420 msgr2=0x7fe400153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 shutdown_connections 2023-05-10T01:24:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:25.930+0000 7fe40647e700 1 -- 172.21.15.52:0/1162188977 wait complete. 2023-05-10T01:24:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:24:25.945 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:24:24.755661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":143416,"kb_used_data":7416,"kb_used_omap":0,"kb_used_meta":135936,"kb_avail":754831304,"statfs":{"total":773094113280,"available":772947255296,"internally_reserved":0,"allocated":7593984,"data_stored":3773185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139198464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28005,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.154943"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441633+0000","last_change":"2023-05-10T01:24:20.438462+0000","last_active":"2023-05-10T01:24:20.441633+0000","last_peered":"2023-05-10T01:24:20.441633+0000","last_clean":"2023-05-10T01:24:20.441633+0000","last_became_active":"2023-05-10T01:24:20.437602+0000","last_became_peered":"2023-05-10T01:24:20.437602+0000","last_unstale":"2023-05-10T01:24:20.441633+0000","last_undegraded":"2023-05-10T01:24:20.441633+0000","last_fullsized":"2023-05-10T01:24:20.441633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439744+0000","last_change":"2023-05-10T01:24:20.044308+0000","last_active":"2023-05-10T01:24:20.439744+0000","last_peered":"2023-05-10T01:24:20.439744+0000","last_clean":"2023-05-10T01:24:20.439744+0000","last_became_active":"2023-05-10T01:24:20.043980+0000","last_became_peered":"2023-05-10T01:24:20.043980+0000","last_unstale":"2023-05-10T01:24:20.439744+0000","last_undegraded":"2023-05-10T01:24:20.439744+0000","last_fullsized":"2023-05-10T01:24:20.439744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023764+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028963+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036008+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.442739+0000","last_change":"2023-05-10T01:24:20.039146+0000","last_active":"2023-05-10T01:24:20.442739+0000","last_peered":"2023-05-10T01:24:20.442739+0000","last_clean":"2023-05-10T01:24:20.442739+0000","last_became_active":"2023-05-10T01:24:20.038857+0000","last_became_peered":"2023-05-10T01:24:20.038857+0000","last_unstale":"2023-05-10T01:24:20.442739+0000","last_undegraded":"2023-05-10T01:24:20.442739+0000","last_fullsized":"2023-05-10T01:24:20.442739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454152+0000","last_change":"2023-05-10T01:24:20.453347+0000","last_active":"2023-05-10T01:24:20.454152+0000","last_peered":"2023-05-10T01:24:20.454152+0000","last_clean":"2023-05-10T01:24:20.454152+0000","last_became_active":"2023-05-10T01:24:20.452959+0000","last_became_peered":"2023-05-10T01:24:20.452959+0000","last_unstale":"2023-05-10T01:24:20.454152+0000","last_undegraded":"2023-05-10T01:24:20.454152+0000","last_fullsized":"2023-05-10T01:24:20.454152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440955+0000","last_change":"2023-05-10T01:24:20.040295+0000","last_active":"2023-05-10T01:24:20.440955+0000","last_peered":"2023-05-10T01:24:20.440955+0000","last_clean":"2023-05-10T01:24:20.440955+0000","last_became_active":"2023-05-10T01:24:20.039974+0000","last_became_peered":"2023-05-10T01:24:20.039974+0000","last_unstale":"2023-05-10T01:24:20.440955+0000","last_undegraded":"2023-05-10T01:24:20.440955+0000","last_fullsized":"2023-05-10T01:24:20.440955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451107+0000","last_change":"2023-05-10T01:24:20.450452+0000","last_active":"2023-05-10T01:24:20.451107+0000","last_peered":"2023-05-10T01:24:20.451107+0000","last_clean":"2023-05-10T01:24:20.451107+0000","last_became_active":"2023-05-10T01:24:20.450171+0000","last_became_peered":"2023-05-10T01:24:20.450171+0000","last_unstale":"2023-05-10T01:24:20.451107+0000","last_undegraded":"2023-05-10T01:24:20.451107+0000","last_fullsized":"2023-05-10T01:24:20.451107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432650+0000","last_change":"2023-05-10T01:24:20.041100+0000","last_active":"2023-05-10T01:24:20.432650+0000","last_peered":"2023-05-10T01:24:20.432650+0000","last_clean":"2023-05-10T01:24:20.432650+0000","last_became_active":"2023-05-10T01:24:20.040636+0000","last_became_peered":"2023-05-10T01:24:20.040636+0000","last_unstale":"2023-05-10T01:24:20.432650+0000","last_undegraded":"2023-05-10T01:24:20.432650+0000","last_fullsized":"2023-05-10T01:24:20.432650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463345+0000","last_change":"2023-05-10T01:24:20.458665+0000","last_active":"2023-05-10T01:24:20.463345+0000","last_peered":"2023-05-10T01:24:20.463345+0000","last_clean":"2023-05-10T01:24:20.463345+0000","last_became_active":"2023-05-10T01:24:20.458404+0000","last_became_peered":"2023-05-10T01:24:20.458404+0000","last_unstale":"2023-05-10T01:24:20.463345+0000","last_undegraded":"2023-05-10T01:24:20.463345+0000","last_fullsized":"2023-05-10T01:24:20.463345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025122+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431401+0000","last_change":"2023-05-10T01:24:20.040275+0000","last_active":"2023-05-10T01:24:20.431401+0000","last_peered":"2023-05-10T01:24:20.431401+0000","last_clean":"2023-05-10T01:24:20.431401+0000","last_became_active":"2023-05-10T01:24:20.039976+0000","last_became_peered":"2023-05-10T01:24:20.039976+0000","last_unstale":"2023-05-10T01:24:20.431401+0000","last_undegraded":"2023-05-10T01:24:20.431401+0000","last_fullsized":"2023-05-10T01:24:20.431401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444477+0000","last_change":"2023-05-10T01:24:20.439090+0000","last_active":"2023-05-10T01:24:20.444477+0000","last_peered":"2023-05-10T01:24:20.444477+0000","last_clean":"2023-05-10T01:24:20.444477+0000","last_became_active":"2023-05-10T01:24:20.438697+0000","last_became_peered":"2023-05-10T01:24:20.438697+0000","last_unstale":"2023-05-10T01:24:20.444477+0000","last_undegraded":"2023-05-10T01:24:20.444477+0000","last_fullsized":"2023-05-10T01:24:20.444477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021886+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021984+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035588+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446959+0000","last_change":"2023-05-10T01:24:20.444458+0000","last_active":"2023-05-10T01:24:20.446959+0000","last_peered":"2023-05-10T01:24:20.446959+0000","last_clean":"2023-05-10T01:24:20.446959+0000","last_became_active":"2023-05-10T01:24:20.444146+0000","last_became_peered":"2023-05-10T01:24:20.444146+0000","last_unstale":"2023-05-10T01:24:20.446959+0000","last_undegraded":"2023-05-10T01:24:20.446959+0000","last_fullsized":"2023-05-10T01:24:20.446959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459848+0000","last_change":"2023-05-10T01:24:20.041326+0000","last_active":"2023-05-10T01:24:20.459848+0000","last_peered":"2023-05-10T01:24:20.459848+0000","last_clean":"2023-05-10T01:24:20.459848+0000","last_became_active":"2023-05-10T01:24:20.040987+0000","last_became_peered":"2023-05-10T01:24:20.040987+0000","last_unstale":"2023-05-10T01:24:20.459848+0000","last_undegraded":"2023-05-10T01:24:20.459848+0000","last_fullsized":"2023-05-10T01:24:20.459848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431284+0000","last_change":"2023-05-10T01:24:20.038134+0000","last_active":"2023-05-10T01:24:20.431284+0000","last_peered":"2023-05-10T01:24:20.431284+0000","last_clean":"2023-05-10T01:24:20.431284+0000","last_became_active":"2023-05-10T01:24:20.037865+0000","last_became_peered":"2023-05-10T01:24:20.037865+0000","last_unstale":"2023-05-10T01:24:20.431284+0000","last_undegraded":"2023-05-10T01:24:20.431284+0000","last_fullsized":"2023-05-10T01:24:20.431284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432761+0000","last_change":"2023-05-10T01:24:20.040914+0000","last_active":"2023-05-10T01:24:20.432761+0000","last_peered":"2023-05-10T01:24:20.432761+0000","last_clean":"2023-05-10T01:24:20.432761+0000","last_became_active":"2023-05-10T01:24:20.040295+0000","last_became_peered":"2023-05-10T01:24:20.040295+0000","last_unstale":"2023-05-10T01:24:20.432761+0000","last_undegraded":"2023-05-10T01:24:20.432761+0000","last_fullsized":"2023-05-10T01:24:20.432761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447280+0000","last_change":"2023-05-10T01:24:20.045598+0000","last_active":"2023-05-10T01:24:20.447280+0000","last_peered":"2023-05-10T01:24:20.447280+0000","last_clean":"2023-05-10T01:24:20.447280+0000","last_became_active":"2023-05-10T01:24:20.045183+0000","last_became_peered":"2023-05-10T01:24:20.045183+0000","last_unstale":"2023-05-10T01:24:20.447280+0000","last_undegraded":"2023-05-10T01:24:20.447280+0000","last_fullsized":"2023-05-10T01:24:20.447280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025354+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463435+0000","last_change":"2023-05-10T01:24:20.459353+0000","last_active":"2023-05-10T01:24:20.463435+0000","last_peered":"2023-05-10T01:24:20.463435+0000","last_clean":"2023-05-10T01:24:20.463435+0000","last_became_active":"2023-05-10T01:24:20.458772+0000","last_became_peered":"2023-05-10T01:24:20.458772+0000","last_unstale":"2023-05-10T01:24:20.463435+0000","last_undegraded":"2023-05-10T01:24:20.463435+0000","last_fullsized":"2023-05-10T01:24:20.463435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031299+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440326+0000","last_change":"2023-05-10T01:24:20.437715+0000","last_active":"2023-05-10T01:24:20.440326+0000","last_peered":"2023-05-10T01:24:20.440326+0000","last_clean":"2023-05-10T01:24:20.440326+0000","last_became_active":"2023-05-10T01:24:20.437438+0000","last_became_peered":"2023-05-10T01:24:20.437438+0000","last_unstale":"2023-05-10T01:24:20.440326+0000","last_undegraded":"2023-05-10T01:24:20.440326+0000","last_fullsized":"2023-05-10T01:24:20.440326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438621+0000","last_change":"2023-05-10T01:24:20.045908+0000","last_active":"2023-05-10T01:24:20.438621+0000","last_peered":"2023-05-10T01:24:20.438621+0000","last_clean":"2023-05-10T01:24:20.438621+0000","last_became_active":"2023-05-10T01:24:20.045609+0000","last_became_peered":"2023-05-10T01:24:20.045609+0000","last_unstale":"2023-05-10T01:24:20.438621+0000","last_undegraded":"2023-05-10T01:24:20.438621+0000","last_fullsized":"2023-05-10T01:24:20.438621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025556+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.030216+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025422+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029541+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449967+0000","last_change":"2023-05-10T01:24:20.048246+0000","last_active":"2023-05-10T01:24:20.449967+0000","last_peered":"2023-05-10T01:24:20.449967+0000","last_clean":"2023-05-10T01:24:20.449967+0000","last_became_active":"2023-05-10T01:24:20.047976+0000","last_became_peered":"2023-05-10T01:24:20.047976+0000","last_unstale":"2023-05-10T01:24:20.449967+0000","last_undegraded":"2023-05-10T01:24:20.449967+0000","last_fullsized":"2023-05-10T01:24:20.449967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.430966+0000","last_change":"2023-05-10T01:24:20.035217+0000","last_active":"2023-05-10T01:24:20.430966+0000","last_peered":"2023-05-10T01:24:20.430966+0000","last_clean":"2023-05-10T01:24:20.430966+0000","last_became_active":"2023-05-10T01:24:20.034906+0000","last_became_peered":"2023-05-10T01:24:20.034906+0000","last_unstale":"2023-05-10T01:24:20.430966+0000","last_undegraded":"2023-05-10T01:24:20.430966+0000","last_fullsized":"2023-05-10T01:24:20.430966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447711+0000","last_change":"2023-05-10T01:24:20.443372+0000","last_active":"2023-05-10T01:24:20.447711+0000","last_peered":"2023-05-10T01:24:20.447711+0000","last_clean":"2023-05-10T01:24:20.447711+0000","last_became_active":"2023-05-10T01:24:20.443089+0000","last_became_peered":"2023-05-10T01:24:20.443089+0000","last_unstale":"2023-05-10T01:24:20.447711+0000","last_undegraded":"2023-05-10T01:24:20.447711+0000","last_fullsized":"2023-05-10T01:24:20.447711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.032211+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431470+0000","last_change":"2023-05-10T01:24:20.040862+0000","last_active":"2023-05-10T01:24:20.431470+0000","last_peered":"2023-05-10T01:24:20.431470+0000","last_clean":"2023-05-10T01:24:20.431470+0000","last_became_active":"2023-05-10T01:24:20.040538+0000","last_became_peered":"2023-05-10T01:24:20.040538+0000","last_unstale":"2023-05-10T01:24:20.431470+0000","last_undegraded":"2023-05-10T01:24:20.431470+0000","last_fullsized":"2023-05-10T01:24:20.431470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432810+0000","last_change":"2023-05-10T01:24:20.036237+0000","last_active":"2023-05-10T01:24:20.432810+0000","last_peered":"2023-05-10T01:24:20.432810+0000","last_clean":"2023-05-10T01:24:20.432810+0000","last_became_active":"2023-05-10T01:24:20.035938+0000","last_became_peered":"2023-05-10T01:24:20.035938+0000","last_unstale":"2023-05-10T01:24:20.432810+0000","last_undegraded":"2023-05-10T01:24:20.432810+0000","last_fullsized":"2023-05-10T01:24:20.432810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440401+0000","last_change":"2023-05-10T01:24:20.437391+0000","last_active":"2023-05-10T01:24:20.440401+0000","last_peered":"2023-05-10T01:24:20.440401+0000","last_clean":"2023-05-10T01:24:20.440401+0000","last_became_active":"2023-05-10T01:24:20.436953+0000","last_became_peered":"2023-05-10T01:24:20.436953+0000","last_unstale":"2023-05-10T01:24:20.440401+0000","last_undegraded":"2023-05-10T01:24:20.440401+0000","last_fullsized":"2023-05-10T01:24:20.440401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024102+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447405+0000","last_change":"2023-05-10T01:24:20.442195+0000","last_active":"2023-05-10T01:24:20.447405+0000","last_peered":"2023-05-10T01:24:20.447405+0000","last_clean":"2023-05-10T01:24:20.447405+0000","last_became_active":"2023-05-10T01:24:20.441921+0000","last_became_peered":"2023-05-10T01:24:20.441921+0000","last_unstale":"2023-05-10T01:24:20.447405+0000","last_undegraded":"2023-05-10T01:24:20.447405+0000","last_fullsized":"2023-05-10T01:24:20.447405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027958+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431766+0000","last_change":"2023-05-10T01:24:20.032017+0000","last_active":"2023-05-10T01:24:20.431766+0000","last_peered":"2023-05-10T01:24:20.431766+0000","last_clean":"2023-05-10T01:24:20.431766+0000","last_became_active":"2023-05-10T01:24:20.031718+0000","last_became_peered":"2023-05-10T01:24:20.031718+0000","last_unstale":"2023-05-10T01:24:20.431766+0000","last_undegraded":"2023-05-10T01:24:20.431766+0000","last_fullsized":"2023-05-10T01:24:20.431766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432045+0000","last_change":"2023-05-10T01:24:20.045212+0000","last_active":"2023-05-10T01:24:20.432045+0000","last_peered":"2023-05-10T01:24:20.432045+0000","last_clean":"2023-05-10T01:24:20.432045+0000","last_became_active":"2023-05-10T01:24:20.039882+0000","last_became_peered":"2023-05-10T01:24:20.039882+0000","last_unstale":"2023-05-10T01:24:20.432045+0000","last_undegraded":"2023-05-10T01:24:20.432045+0000","last_fullsized":"2023-05-10T01:24:20.432045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458898+0000","last_change":"2023-05-10T01:24:20.451923+0000","last_active":"2023-05-10T01:24:20.458898+0000","last_peered":"2023-05-10T01:24:20.458898+0000","last_clean":"2023-05-10T01:24:20.458898+0000","last_became_active":"2023-05-10T01:24:20.450847+0000","last_became_peered":"2023-05-10T01:24:20.450847+0000","last_unstale":"2023-05-10T01:24:20.458898+0000","last_undegraded":"2023-05-10T01:24:20.458898+0000","last_fullsized":"2023-05-10T01:24:20.458898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021863+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463477+0000","last_change":"2023-05-10T01:24:20.459865+0000","last_active":"2023-05-10T01:24:20.463477+0000","last_peered":"2023-05-10T01:24:20.463477+0000","last_clean":"2023-05-10T01:24:20.463477+0000","last_became_active":"2023-05-10T01:24:20.459515+0000","last_became_peered":"2023-05-10T01:24:20.459515+0000","last_unstale":"2023-05-10T01:24:20.463477+0000","last_undegraded":"2023-05-10T01:24:20.463477+0000","last_fullsized":"2023-05-10T01:24:20.463477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454298+0000","last_change":"2023-05-10T01:24:20.044669+0000","last_active":"2023-05-10T01:24:20.454298+0000","last_peered":"2023-05-10T01:24:20.454298+0000","last_clean":"2023-05-10T01:24:20.454298+0000","last_became_active":"2023-05-10T01:24:20.044344+0000","last_became_peered":"2023-05-10T01:24:20.044344+0000","last_unstale":"2023-05-10T01:24:20.454298+0000","last_undegraded":"2023-05-10T01:24:20.454298+0000","last_fullsized":"2023-05-10T01:24:20.454298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440538+0000","last_change":"2023-05-10T01:24:20.437997+0000","last_active":"2023-05-10T01:24:20.440538+0000","last_peered":"2023-05-10T01:24:20.440538+0000","last_clean":"2023-05-10T01:24:20.440538+0000","last_became_active":"2023-05-10T01:24:20.437543+0000","last_became_peered":"2023-05-10T01:24:20.437543+0000","last_unstale":"2023-05-10T01:24:20.440538+0000","last_undegraded":"2023-05-10T01:24:20.440538+0000","last_fullsized":"2023-05-10T01:24:20.440538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447793+0000","last_change":"2023-05-10T01:24:20.043479+0000","last_active":"2023-05-10T01:24:20.447793+0000","last_peered":"2023-05-10T01:24:20.447793+0000","last_clean":"2023-05-10T01:24:20.447793+0000","last_became_active":"2023-05-10T01:24:20.042740+0000","last_became_peered":"2023-05-10T01:24:20.042740+0000","last_unstale":"2023-05-10T01:24:20.447793+0000","last_undegraded":"2023-05-10T01:24:20.447793+0000","last_fullsized":"2023-05-10T01:24:20.447793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431645+0000","last_change":"2023-05-10T01:24:20.041177+0000","last_active":"2023-05-10T01:24:20.431645+0000","last_peered":"2023-05-10T01:24:20.431645+0000","last_clean":"2023-05-10T01:24:20.431645+0000","last_became_active":"2023-05-10T01:24:20.040883+0000","last_became_peered":"2023-05-10T01:24:20.040883+0000","last_unstale":"2023-05-10T01:24:20.431645+0000","last_undegraded":"2023-05-10T01:24:20.431645+0000","last_fullsized":"2023-05-10T01:24:20.431645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439291+0000","last_change":"2023-05-10T01:24:20.437109+0000","last_active":"2023-05-10T01:24:20.439291+0000","last_peered":"2023-05-10T01:24:20.439291+0000","last_clean":"2023-05-10T01:24:20.439291+0000","last_became_active":"2023-05-10T01:24:20.436810+0000","last_became_peered":"2023-05-10T01:24:20.436810+0000","last_unstale":"2023-05-10T01:24:20.439291+0000","last_undegraded":"2023-05-10T01:24:20.439291+0000","last_fullsized":"2023-05-10T01:24:20.439291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023672+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024187+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463377+0000","last_change":"2023-05-10T01:24:20.459050+0000","last_active":"2023-05-10T01:24:20.463377+0000","last_peered":"2023-05-10T01:24:20.463377+0000","last_clean":"2023-05-10T01:24:20.463377+0000","last_became_active":"2023-05-10T01:24:20.458758+0000","last_became_peered":"2023-05-10T01:24:20.458758+0000","last_unstale":"2023-05-10T01:24:20.463377+0000","last_undegraded":"2023-05-10T01:24:20.463377+0000","last_fullsized":"2023-05-10T01:24:20.463377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027471+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.450025+0000","last_change":"2023-05-10T01:24:20.042766+0000","last_active":"2023-05-10T01:24:20.450025+0000","last_peered":"2023-05-10T01:24:20.450025+0000","last_clean":"2023-05-10T01:24:20.450025+0000","last_became_active":"2023-05-10T01:24:20.042490+0000","last_became_peered":"2023-05-10T01:24:20.042490+0000","last_unstale":"2023-05-10T01:24:20.450025+0000","last_undegraded":"2023-05-10T01:24:20.450025+0000","last_fullsized":"2023-05-10T01:24:20.450025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029020+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.433006+0000","last_change":"2023-05-10T01:24:20.037935+0000","last_active":"2023-05-10T01:24:20.433006+0000","last_peered":"2023-05-10T01:24:20.433006+0000","last_clean":"2023-05-10T01:24:20.433006+0000","last_became_active":"2023-05-10T01:24:20.037566+0000","last_became_peered":"2023-05-10T01:24:20.037566+0000","last_unstale":"2023-05-10T01:24:20.433006+0000","last_undegraded":"2023-05-10T01:24:20.433006+0000","last_fullsized":"2023-05-10T01:24:20.433006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458929+0000","last_change":"2023-05-10T01:24:20.455086+0000","last_active":"2023-05-10T01:24:20.458929+0000","last_peered":"2023-05-10T01:24:20.458929+0000","last_clean":"2023-05-10T01:24:20.458929+0000","last_became_active":"2023-05-10T01:24:20.454818+0000","last_became_peered":"2023-05-10T01:24:20.454818+0000","last_unstale":"2023-05-10T01:24:20.458929+0000","last_undegraded":"2023-05-10T01:24:20.458929+0000","last_fullsized":"2023-05-10T01:24:20.458929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028127+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446853+0000","last_change":"2023-05-10T01:24:20.440480+0000","last_active":"2023-05-10T01:24:20.446853+0000","last_peered":"2023-05-10T01:24:20.446853+0000","last_clean":"2023-05-10T01:24:20.446853+0000","last_became_active":"2023-05-10T01:24:20.440029+0000","last_became_peered":"2023-05-10T01:24:20.440029+0000","last_unstale":"2023-05-10T01:24:20.446853+0000","last_undegraded":"2023-05-10T01:24:20.446853+0000","last_fullsized":"2023-05-10T01:24:20.446853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021905+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454376+0000","last_change":"2023-05-10T01:24:20.450582+0000","last_active":"2023-05-10T01:24:20.454376+0000","last_peered":"2023-05-10T01:24:20.454376+0000","last_clean":"2023-05-10T01:24:20.454376+0000","last_became_active":"2023-05-10T01:24:20.450302+0000","last_became_peered":"2023-05-10T01:24:20.450302+0000","last_unstale":"2023-05-10T01:24:20.454376+0000","last_undegraded":"2023-05-10T01:24:20.454376+0000","last_fullsized":"2023-05-10T01:24:20.454376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029773+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.036128+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463458+0000","last_change":"2023-05-10T01:24:20.459687+0000","last_active":"2023-05-10T01:24:20.463458+0000","last_peered":"2023-05-10T01:24:20.463458+0000","last_clean":"2023-05-10T01:24:20.463458+0000","last_became_active":"2023-05-10T01:24:20.459335+0000","last_became_peered":"2023-05-10T01:24:20.459335+0000","last_unstale":"2023-05-10T01:24:20.463458+0000","last_undegraded":"2023-05-10T01:24:20.463458+0000","last_fullsized":"2023-05-10T01:24:20.463458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027530+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457009+0000","last_change":"2023-05-10T01:24:20.044573+0000","last_active":"2023-05-10T01:24:20.457009+0000","last_peered":"2023-05-10T01:24:20.457009+0000","last_clean":"2023-05-10T01:24:20.457009+0000","last_became_active":"2023-05-10T01:24:20.044299+0000","last_became_peered":"2023-05-10T01:24:20.044299+0000","last_unstale":"2023-05-10T01:24:20.457009+0000","last_undegraded":"2023-05-10T01:24:20.457009+0000","last_fullsized":"2023-05-10T01:24:20.457009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440634+0000","last_change":"2023-05-10T01:24:20.439231+0000","last_active":"2023-05-10T01:24:20.440634+0000","last_peered":"2023-05-10T01:24:20.440634+0000","last_clean":"2023-05-10T01:24:20.440634+0000","last_became_active":"2023-05-10T01:24:20.438862+0000","last_became_peered":"2023-05-10T01:24:20.438862+0000","last_unstale":"2023-05-10T01:24:20.440634+0000","last_undegraded":"2023-05-10T01:24:20.440634+0000","last_fullsized":"2023-05-10T01:24:20.440634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031738+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439860+0000","last_change":"2023-05-10T01:24:20.436161+0000","last_active":"2023-05-10T01:24:20.439860+0000","last_peered":"2023-05-10T01:24:20.439860+0000","last_clean":"2023-05-10T01:24:20.439860+0000","last_became_active":"2023-05-10T01:24:20.435870+0000","last_became_peered":"2023-05-10T01:24:20.435870+0000","last_unstale":"2023-05-10T01:24:20.439860+0000","last_undegraded":"2023-05-10T01:24:20.439860+0000","last_fullsized":"2023-05-10T01:24:20.439860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031690+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431691+0000","last_change":"2023-05-10T01:24:20.043700+0000","last_active":"2023-05-10T01:24:20.431691+0000","last_peered":"2023-05-10T01:24:20.431691+0000","last_clean":"2023-05-10T01:24:20.431691+0000","last_became_active":"2023-05-10T01:24:20.043173+0000","last_became_peered":"2023-05-10T01:24:20.043173+0000","last_unstale":"2023-05-10T01:24:20.431691+0000","last_undegraded":"2023-05-10T01:24:20.431691+0000","last_fullsized":"2023-05-10T01:24:20.431691+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463316+0000","last_change":"2023-05-10T01:24:20.458201+0000","last_active":"2023-05-10T01:24:20.463316+0000","last_peered":"2023-05-10T01:24:20.463316+0000","last_clean":"2023-05-10T01:24:20.463316+0000","last_became_active":"2023-05-10T01:24:20.457952+0000","last_became_peered":"2023-05-10T01:24:20.457952+0000","last_unstale":"2023-05-10T01:24:20.463316+0000","last_undegraded":"2023-05-10T01:24:20.463316+0000","last_fullsized":"2023-05-10T01:24:20.463316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021305+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459739+0000","last_change":"2023-05-10T01:24:20.454958+0000","last_active":"2023-05-10T01:24:20.459739+0000","last_peered":"2023-05-10T01:24:20.459739+0000","last_clean":"2023-05-10T01:24:20.459739+0000","last_became_active":"2023-05-10T01:24:20.454675+0000","last_became_peered":"2023-05-10T01:24:20.454675+0000","last_unstale":"2023-05-10T01:24:20.459739+0000","last_undegraded":"2023-05-10T01:24:20.459739+0000","last_fullsized":"2023-05-10T01:24:20.459739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.029219+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454768+0000","last_change":"2023-05-10T01:24:20.453355+0000","last_active":"2023-05-10T01:24:20.454768+0000","last_peered":"2023-05-10T01:24:20.454768+0000","last_clean":"2023-05-10T01:24:20.454768+0000","last_became_active":"2023-05-10T01:24:20.453115+0000","last_became_peered":"2023-05-10T01:24:20.453115+0000","last_unstale":"2023-05-10T01:24:20.454768+0000","last_undegraded":"2023-05-10T01:24:20.454768+0000","last_fullsized":"2023-05-10T01:24:20.454768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023744+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.025182+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.445126+0000","last_change":"2023-05-10T01:24:20.443260+0000","last_active":"2023-05-10T01:24:20.445126+0000","last_peered":"2023-05-10T01:24:20.445126+0000","last_clean":"2023-05-10T01:24:20.445126+0000","last_became_active":"2023-05-10T01:24:20.442965+0000","last_became_peered":"2023-05-10T01:24:20.442965+0000","last_unstale":"2023-05-10T01:24:20.445126+0000","last_undegraded":"2023-05-10T01:24:20.445126+0000","last_fullsized":"2023-05-10T01:24:20.445126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.021314+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.035740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505833+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:17.505833+0000","last_peered":"2023-05-10T01:24:17.505833+0000","last_clean":"2023-05-10T01:24:17.505833+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:17.505833+0000","last_undegraded":"2023-05-10T01:24:17.505833+0000","last_fullsized":"2023-05-10T01:24:17.505833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459163+0000","last_change":"2023-05-10T01:24:20.454422+0000","last_active":"2023-05-10T01:24:20.459163+0000","last_peered":"2023-05-10T01:24:20.459163+0000","last_clean":"2023-05-10T01:24:20.459163+0000","last_became_active":"2023-05-10T01:24:20.454203+0000","last_became_peered":"2023-05-10T01:24:20.454203+0000","last_unstale":"2023-05-10T01:24:20.459163+0000","last_undegraded":"2023-05-10T01:24:20.459163+0000","last_fullsized":"2023-05-10T01:24:20.459163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431226+0000","last_change":"2023-05-10T01:24:20.041801+0000","last_active":"2023-05-10T01:24:20.431226+0000","last_peered":"2023-05-10T01:24:20.431226+0000","last_clean":"2023-05-10T01:24:20.431226+0000","last_became_active":"2023-05-10T01:24:20.041469+0000","last_became_peered":"2023-05-10T01:24:20.041469+0000","last_unstale":"2023-05-10T01:24:20.431226+0000","last_undegraded":"2023-05-10T01:24:20.431226+0000","last_fullsized":"2023-05-10T01:24:20.431226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505738+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:17.505738+0000","last_peered":"2023-05-10T01:24:17.505738+0000","last_clean":"2023-05-10T01:24:17.505738+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:17.505738+0000","last_undegraded":"2023-05-10T01:24:17.505738+0000","last_fullsized":"2023-05-10T01:24:17.505738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:20.019186+0000","last_change":"2023-05-10T01:24:20.019186+0000","last_active":"2023-05-10T01:24:20.019186+0000","last_peered":"2023-05-10T01:24:20.019186+0000","last_clean":"2023-05-10T01:24:20.019186+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:20.019186+0000","last_undegraded":"2023-05-10T01:24:20.019186+0000","last_fullsized":"2023-05-10T01:24:20.019186+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.031678+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431784+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:20.431784+0000","last_peered":"2023-05-10T01:24:20.431784+0000","last_clean":"2023-05-10T01:24:20.431784+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:20.431784+0000","last_undegraded":"2023-05-10T01:24:20.431784+0000","last_fullsized":"2023-05-10T01:24:20.431784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459768+0000","last_change":"2023-05-10T01:24:20.449951+0000","last_active":"2023-05-10T01:24:20.459768+0000","last_peered":"2023-05-10T01:24:20.459768+0000","last_clean":"2023-05-10T01:24:20.459768+0000","last_became_active":"2023-05-10T01:24:20.449732+0000","last_became_peered":"2023-05-10T01:24:20.449732+0000","last_unstale":"2023-05-10T01:24:20.459768+0000","last_undegraded":"2023-05-10T01:24:20.459768+0000","last_fullsized":"2023-05-10T01:24:20.459768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.024166+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505775+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:17.505775+0000","last_peered":"2023-05-10T01:24:17.505775+0000","last_clean":"2023-05-10T01:24:17.505775+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:17.505775+0000","last_undegraded":"2023-05-10T01:24:17.505775+0000","last_fullsized":"2023-05-10T01:24:17.505775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506127+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:17.506127+0000","last_peered":"2023-05-10T01:24:17.506127+0000","last_clean":"2023-05-10T01:24:17.506127+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:17.506127+0000","last_undegraded":"2023-05-10T01:24:17.506127+0000","last_fullsized":"2023-05-10T01:24:17.506127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440378+0000","last_change":"2023-05-10T01:24:20.437212+0000","last_active":"2023-05-10T01:24:20.440378+0000","last_peered":"2023-05-10T01:24:20.440378+0000","last_clean":"2023-05-10T01:24:20.440378+0000","last_became_active":"2023-05-10T01:24:20.436615+0000","last_became_peered":"2023-05-10T01:24:20.436615+0000","last_unstale":"2023-05-10T01:24:20.440378+0000","last_undegraded":"2023-05-10T01:24:20.440378+0000","last_fullsized":"2023-05-10T01:24:20.440378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452262+0000","last_change":"2023-05-10T01:24:20.039528+0000","last_active":"2023-05-10T01:24:20.452262+0000","last_peered":"2023-05-10T01:24:20.452262+0000","last_clean":"2023-05-10T01:24:20.452262+0000","last_became_active":"2023-05-10T01:24:20.039224+0000","last_became_peered":"2023-05-10T01:24:20.039224+0000","last_unstale":"2023-05-10T01:24:20.452262+0000","last_undegraded":"2023-05-10T01:24:20.452262+0000","last_fullsized":"2023-05-10T01:24:20.452262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506182+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:17.506182+0000","last_peered":"2023-05-10T01:24:17.506182+0000","last_clean":"2023-05-10T01:24:17.506182+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:17.506182+0000","last_undegraded":"2023-05-10T01:24:17.506182+0000","last_fullsized":"2023-05-10T01:24:17.506182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460951+0000","last_change":"2023-05-10T01:24:20.456847+0000","last_active":"2023-05-10T01:24:20.460951+0000","last_peered":"2023-05-10T01:24:20.460951+0000","last_clean":"2023-05-10T01:24:20.460951+0000","last_became_active":"2023-05-10T01:24:20.456275+0000","last_became_peered":"2023-05-10T01:24:20.456275+0000","last_unstale":"2023-05-10T01:24:20.460951+0000","last_undegraded":"2023-05-10T01:24:20.460951+0000","last_fullsized":"2023-05-10T01:24:20.460951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.027740+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.506178+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:17.506178+0000","last_peered":"2023-05-10T01:24:17.506178+0000","last_clean":"2023-05-10T01:24:17.506178+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:17.506178+0000","last_undegraded":"2023-05-10T01:24:17.506178+0000","last_fullsized":"2023-05-10T01:24:17.506178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460760+0000","last_change":"2023-05-10T01:24:20.456245+0000","last_active":"2023-05-10T01:24:20.460760+0000","last_peered":"2023-05-10T01:24:20.460760+0000","last_clean":"2023-05-10T01:24:20.460760+0000","last_became_active":"2023-05-10T01:24:20.455951+0000","last_became_peered":"2023-05-10T01:24:20.455951+0000","last_unstale":"2023-05-10T01:24:20.460760+0000","last_undegraded":"2023-05-10T01:24:20.460760+0000","last_fullsized":"2023-05-10T01:24:20.460760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.028589+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-05-10T01:24:17.505853+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:17.505853+0000","last_peered":"2023-05-10T01:24:17.505853+0000","last_clean":"2023-05-10T01:24:17.505853+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:17.505853+0000","last_undegraded":"2023-05-10T01:24:17.505853+0000","last_fullsized":"2023-05-10T01:24:17.505853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463289+0000","last_change":"2023-05-10T01:24:20.456478+0000","last_active":"2023-05-10T01:24:20.463289+0000","last_peered":"2023-05-10T01:24:20.463289+0000","last_clean":"2023-05-10T01:24:20.463289+0000","last_became_active":"2023-05-10T01:24:20.456221+0000","last_became_peered":"2023-05-10T01:24:20.456221+0000","last_unstale":"2023-05-10T01:24:20.463289+0000","last_undegraded":"2023-05-10T01:24:20.463289+0000","last_fullsized":"2023-05-10T01:24:20.463289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:19.017602+0000","last_change":"2023-05-10T01:24:19.023748+0000","last_active":"2023-05-10T01:24:19.017602+0000","last_peered":"2023-05-10T01:24:19.017602+0000","last_clean":"2023-05-10T01:24:19.017602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:19.017602+0000","last_undegraded":"2023-05-10T01:24:19.017602+0000","last_fullsized":"2023-05-10T01:24:19.017602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452551+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:20.452551+0000","last_peered":"2023-05-10T01:24:20.452551+0000","last_clean":"2023-05-10T01:24:20.452551+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:20.452551+0000","last_undegraded":"2023-05-10T01:24:20.452551+0000","last_fullsized":"2023-05-10T01:24:20.452551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16788,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94355052,"statfs":{"total":96636764160,"available":96619573248,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.73799999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16380,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355460,"statfs":{"total":96636764160,"available":96619991040,"internally_reserved":0,"allocated":970752,"data_stored":483007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16020,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355820,"statfs":{"total":96636764160,"available":96620359680,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.376},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16120,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94355720,"statfs":{"total":96636764160,"available":96620257280,"internally_reserved":0,"allocated":966656,"data_stored":482973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.621},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17472,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94354368,"statfs":{"total":96636764160,"available":96618872832,"internally_reserved":0,"allocated":974848,"data_stored":483597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.72499999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.622}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24276,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":23360,"kb_avail":94347564,"statfs":{"total":96636764160,"available":96611905536,"internally_reserved":0,"allocated":929792,"data_stored":461619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23920640},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.38,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.23999999999999999},"max":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.434},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.624,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44},"min":{"1min":0.32200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.313},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93400000000000005,"15min":1.0589999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.439},"max":{"1min":0.87,"5min":0.93899999999999995,"15min":0.97099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.502,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.27,"15min":1.27},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":1.216,"15min":1.216},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 10 01:23:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.52800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.432},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.5}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16640,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355200,"statfs":{"total":96636764160,"available":96619724800,"internally_reserved":0,"allocated":974848,"data_stored":483617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575024,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19720,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94352120,"statfs":{"total":96636764160,"available":96616570880,"internally_reserved":0,"allocated":917504,"data_stored":455134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:24:28.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:24:28.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:24:28.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:29.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.081+0000 7f5b3930b700 1 Processor -- start 2023-05-10T01:24:29.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.081+0000 7f5b3930b700 1 -- start start 2023-05-10T01:24:29.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b3930b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b34063e20 0x7f5b340c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b3930b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340bdc20 con 0x7f5b3413b920 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b3930b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340c4e30 con 0x7f5b3413b540 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b3930b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b340c53f0 con 0x7f5b34063e20 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b337fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b3413b920 0x7f5b340be0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43966/0 (socket says 172.21.15.52:43966) 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.082+0000 7f5b337fe700 1 -- 172.21.15.52:0/604324550 learned_addr learned my addr 172.21.15.52:0/604324550 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 --2- 172.21.15.52:0/604324550 >> v2:172.21.15.172:3300/0 conn(0x7f5b34063e20 0x7f5b340c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372948818 0 0) 0x7f5b340bdc20 con 0x7f5b3413b920 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b140033f0 con 0x7f5b3413b920 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4292557660 0 0) 0x7f5b140033f0 con 0x7f5b3413b920 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 >> v2:172.21.15.172:3300/0 conn(0x7f5b34063e20 msgr2=0x7f5b340c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 --2- 172.21.15.52:0/604324550 >> v2:172.21.15.172:3300/0 conn(0x7f5b34063e20 0x7f5b340c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 >> v1:172.21.15.172:6789/0 conn(0x7f5b3413b540 legacy=0x7f5b34063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340c5110 con 0x7f5b3413b920 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5b240017f0 con 0x7f5b3413b920 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 >> v1:172.21.15.52:6789/0 conn(0x7f5b3413b920 legacy=0x7f5b340be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b140038e0 0x7f5b14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 0x7f5b14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14005000 0x7f5b1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340c53f0 con 0x7f5b14004690 2023-05-10T01:24:29.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1400beb0 con 0x7f5b140038e0 2023-05-10T01:24:29.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1400c070 con 0x7f5b14005000 2023-05-10T01:24:29.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 0x7f5b14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b32ffd700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b140038e0 0x7f5b14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b337fe700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14005000 0x7f5b1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 -- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14005000 msgr2=0x7f5b1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14005000 0x7f5b1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 -- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b140038e0 msgr2=0x7f5b14003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b140038e0 0x7f5b14003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b327fc700 1 -- 172.21.15.52:0/604324550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140033f0 con 0x7f5b14004690 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.083+0000 7f5b337fe700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14005000 0x7f5b1400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b337fe700 1 -- 172.21.15.52:0/604324550 reap_dead start 2023-05-10T01:24:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b327fc700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 0x7f5b14004b10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f5b34064220 tx=0x7f5b1c009060).ready entity=mon.0 client_cookie=a8c63d90bad17794 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c009e90 con 0x7f5b14004690 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c009430 con 0x7f5b14004690 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b31ffb700 1 -- 172.21.15.52:0/604324550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00e850 con 0x7f5b14004690 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 -- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 msgr2=0x7f5b14004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 0x7f5b14004b10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f5b34064220 tx=0x7f5b1c009060).stop 2023-05-10T01:24:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 -- 172.21.15.52:0/604324550 shutdown_connections 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 --2- 172.21.15.52:0/604324550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b14004690 0x7f5b14004b10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 -- 172.21.15.52:0/604324550 >> 172.21.15.52:0/604324550 conn(0x7f5b340c8a90 msgr2=0x7f5b340c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 -- 172.21.15.52:0/604324550 shutdown_connections 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.084+0000 7f5b3930b700 1 -- 172.21.15.52:0/604324550 wait complete. 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 Processor -- start 2023-05-10T01:24:29.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 -- start start 2023-05-10T01:24:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14004690 0x7f5b340aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b340aafd0 0x7f5b341578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34157460 con 0x7f5b34157de0 2023-05-10T01:24:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341568c0 con 0x7f5b340aafd0 2023-05-10T01:24:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b3930b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34156b30 con 0x7f5b14004690 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b337fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b337fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34962/0 (socket says 172.21.15.52:34962) 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.086+0000 7f5b337fe700 1 -- 172.21.15.52:0/1673934591 learned_addr learned my addr 172.21.15.52:0/1673934591 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 -- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14004690 msgr2=0x7f5b340aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14004690 0x7f5b340aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 -- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b340aafd0 msgr2=0x7f5b341578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b340aafd0 0x7f5b341578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 -- 172.21.15.52:0/1673934591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34156e10 con 0x7f5b34157de0 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b337fe700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f5b3405f9d0 tx=0x7f5b24007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400e830 con 0x7f5b34157de0 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400e990 con 0x7f5b34157de0 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b341570f0 con 0x7f5b34157de0 2023-05-10T01:24:29.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400ed10 con 0x7f5b34157de0 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.087+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b34162090 con 0x7f5b34157de0 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.088+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b341622b0 con 0x7f5b34157de0 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.088+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5b24014640 con 0x7f5b34157de0 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.089+0000 7f5b2affd700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 0x7f5b18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.089+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f5b24079470 con 0x7f5b34157de0 2023-05-10T01:24:29.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.089+0000 7f5b32ffd700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 0x7f5b18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.089+0000 7f5b32ffd700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 0x7f5b18061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5b2c007fd0 tx=0x7f5b2c007bb0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.093+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b2404a8a0 con 0x7f5b34157de0 2023-05-10T01:24:29.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.263+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b3406c340 con 0x7f5b1805ed90 2023-05-10T01:24:29.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.274+0000 7f5b2affd700 1 -- 172.21.15.52:0/1673934591 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361260 (secure 0 0 0) 0x7f5b3406c340 con 0x7f5b1805ed90 2023-05-10T01:24:29.280 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 msgr2=0x7f5b18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 0x7f5b18061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5b2c007fd0 tx=0x7f5b2c007bb0).stop 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 msgr2=0x7f5b34161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f5b3405f9d0 tx=0x7f5b24007f10).stop 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 shutdown_connections 2023-05-10T01:24:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5b1805ed90 0x7f5b18061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b34157de0 0x7f5b34161960 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b14004690 0x7f5b340aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 --2- 172.21.15.52:0/1673934591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b340aafd0 0x7f5b341578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 >> 172.21.15.52:0/1673934591 conn(0x7f5b340c8a90 msgr2=0x7f5b340c7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 shutdown_connections 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.277+0000 7f5b3930b700 1 -- 172.21.15.52:0/1673934591 wait complete. 2023-05-10T01:24:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:24:29.292 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:24:28.756888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":269,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":144384,"kb_used_data":7616,"kb_used_omap":0,"kb_used_meta":136704,"kb_avail":754830336,"statfs":{"total":773094113280,"available":772946264064,"internally_reserved":0,"allocated":7798784,"data_stored":3868396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":139984896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26323,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156170"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441633+0000","last_change":"2023-05-10T01:24:20.438462+0000","last_active":"2023-05-10T01:24:20.441633+0000","last_peered":"2023-05-10T01:24:20.441633+0000","last_clean":"2023-05-10T01:24:20.441633+0000","last_became_active":"2023-05-10T01:24:20.437602+0000","last_became_peered":"2023-05-10T01:24:20.437602+0000","last_unstale":"2023-05-10T01:24:20.441633+0000","last_undegraded":"2023-05-10T01:24:20.441633+0000","last_fullsized":"2023-05-10T01:24:20.441633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439744+0000","last_change":"2023-05-10T01:24:20.044308+0000","last_active":"2023-05-10T01:24:20.439744+0000","last_peered":"2023-05-10T01:24:20.439744+0000","last_clean":"2023-05-10T01:24:20.439744+0000","last_became_active":"2023-05-10T01:24:20.043980+0000","last_became_peered":"2023-05-10T01:24:20.043980+0000","last_unstale":"2023-05-10T01:24:20.439744+0000","last_undegraded":"2023-05-10T01:24:20.439744+0000","last_fullsized":"2023-05-10T01:24:20.439744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.461271+0000","last_change":"2023-05-10T01:24:20.455137+0000","last_active":"2023-05-10T01:24:20.461271+0000","last_peered":"2023-05-10T01:24:20.461271+0000","last_clean":"2023-05-10T01:24:20.461271+0000","last_became_active":"2023-05-10T01:24:20.454811+0000","last_became_peered":"2023-05-10T01:24:20.454811+0000","last_unstale":"2023-05-10T01:24:20.461271+0000","last_undegraded":"2023-05-10T01:24:20.461271+0000","last_fullsized":"2023-05-10T01:24:20.461271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428936+0000","last_change":"2023-05-10T01:24:20.038419+0000","last_active":"2023-05-10T01:24:20.428936+0000","last_peered":"2023-05-10T01:24:20.428936+0000","last_clean":"2023-05-10T01:24:20.428936+0000","last_became_active":"2023-05-10T01:24:20.038124+0000","last_became_peered":"2023-05-10T01:24:20.038124+0000","last_unstale":"2023-05-10T01:24:20.428936+0000","last_undegraded":"2023-05-10T01:24:20.428936+0000","last_fullsized":"2023-05-10T01:24:20.428936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438328+0000","last_change":"2023-05-10T01:24:20.434811+0000","last_active":"2023-05-10T01:24:20.438328+0000","last_peered":"2023-05-10T01:24:20.438328+0000","last_clean":"2023-05-10T01:24:20.438328+0000","last_became_active":"2023-05-10T01:24:20.434517+0000","last_became_peered":"2023-05-10T01:24:20.434517+0000","last_unstale":"2023-05-10T01:24:20.438328+0000","last_undegraded":"2023-05-10T01:24:20.438328+0000","last_fullsized":"2023-05-10T01:24:20.438328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444725+0000","last_change":"2023-05-10T01:24:20.045268+0000","last_active":"2023-05-10T01:24:20.444725+0000","last_peered":"2023-05-10T01:24:20.444725+0000","last_clean":"2023-05-10T01:24:20.444725+0000","last_became_active":"2023-05-10T01:24:20.044966+0000","last_became_peered":"2023-05-10T01:24:20.044966+0000","last_unstale":"2023-05-10T01:24:20.444725+0000","last_undegraded":"2023-05-10T01:24:20.444725+0000","last_fullsized":"2023-05-10T01:24:20.444725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.448598+0000","last_change":"2023-05-10T01:24:20.447496+0000","last_active":"2023-05-10T01:24:20.448598+0000","last_peered":"2023-05-10T01:24:20.448598+0000","last_clean":"2023-05-10T01:24:20.448598+0000","last_became_active":"2023-05-10T01:24:20.447196+0000","last_became_peered":"2023-05-10T01:24:20.447196+0000","last_unstale":"2023-05-10T01:24:20.448598+0000","last_undegraded":"2023-05-10T01:24:20.448598+0000","last_fullsized":"2023-05-10T01:24:20.448598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.443580+0000","last_change":"2023-05-10T01:24:20.039741+0000","last_active":"2023-05-10T01:24:20.443580+0000","last_peered":"2023-05-10T01:24:20.443580+0000","last_clean":"2023-05-10T01:24:20.443580+0000","last_became_active":"2023-05-10T01:24:20.039463+0000","last_became_peered":"2023-05-10T01:24:20.039463+0000","last_unstale":"2023-05-10T01:24:20.443580+0000","last_undegraded":"2023-05-10T01:24:20.443580+0000","last_fullsized":"2023-05-10T01:24:20.443580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457799+0000","last_change":"2023-05-10T01:24:20.451704+0000","last_active":"2023-05-10T01:24:20.457799+0000","last_peered":"2023-05-10T01:24:20.457799+0000","last_clean":"2023-05-10T01:24:20.457799+0000","last_became_active":"2023-05-10T01:24:20.451398+0000","last_became_peered":"2023-05-10T01:24:20.451398+0000","last_unstale":"2023-05-10T01:24:20.457799+0000","last_undegraded":"2023-05-10T01:24:20.457799+0000","last_fullsized":"2023-05-10T01:24:20.457799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.442739+0000","last_change":"2023-05-10T01:24:20.039146+0000","last_active":"2023-05-10T01:24:20.442739+0000","last_peered":"2023-05-10T01:24:20.442739+0000","last_clean":"2023-05-10T01:24:20.442739+0000","last_became_active":"2023-05-10T01:24:20.038857+0000","last_became_peered":"2023-05-10T01:24:20.038857+0000","last_unstale":"2023-05-10T01:24:20.442739+0000","last_undegraded":"2023-05-10T01:24:20.442739+0000","last_fullsized":"2023-05-10T01:24:20.442739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454152+0000","last_change":"2023-05-10T01:24:20.453347+0000","last_active":"2023-05-10T01:24:20.454152+0000","last_peered":"2023-05-10T01:24:20.454152+0000","last_clean":"2023-05-10T01:24:20.454152+0000","last_became_active":"2023-05-10T01:24:20.452959+0000","last_became_peered":"2023-05-10T01:24:20.452959+0000","last_unstale":"2023-05-10T01:24:20.454152+0000","last_undegraded":"2023-05-10T01:24:20.454152+0000","last_fullsized":"2023-05-10T01:24:20.454152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440955+0000","last_change":"2023-05-10T01:24:20.040295+0000","last_active":"2023-05-10T01:24:20.440955+0000","last_peered":"2023-05-10T01:24:20.440955+0000","last_clean":"2023-05-10T01:24:20.440955+0000","last_became_active":"2023-05-10T01:24:20.039974+0000","last_became_peered":"2023-05-10T01:24:20.039974+0000","last_unstale":"2023-05-10T01:24:20.440955+0000","last_undegraded":"2023-05-10T01:24:20.440955+0000","last_fullsized":"2023-05-10T01:24:20.440955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451107+0000","last_change":"2023-05-10T01:24:20.450452+0000","last_active":"2023-05-10T01:24:20.451107+0000","last_peered":"2023-05-10T01:24:20.451107+0000","last_clean":"2023-05-10T01:24:20.451107+0000","last_became_active":"2023-05-10T01:24:20.450171+0000","last_became_peered":"2023-05-10T01:24:20.450171+0000","last_unstale":"2023-05-10T01:24:20.451107+0000","last_undegraded":"2023-05-10T01:24:20.451107+0000","last_fullsized":"2023-05-10T01:24:20.451107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432650+0000","last_change":"2023-05-10T01:24:20.041100+0000","last_active":"2023-05-10T01:24:20.432650+0000","last_peered":"2023-05-10T01:24:20.432650+0000","last_clean":"2023-05-10T01:24:20.432650+0000","last_became_active":"2023-05-10T01:24:20.040636+0000","last_became_peered":"2023-05-10T01:24:20.040636+0000","last_unstale":"2023-05-10T01:24:20.432650+0000","last_undegraded":"2023-05-10T01:24:20.432650+0000","last_fullsized":"2023-05-10T01:24:20.432650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463345+0000","last_change":"2023-05-10T01:24:20.458665+0000","last_active":"2023-05-10T01:24:20.463345+0000","last_peered":"2023-05-10T01:24:20.463345+0000","last_clean":"2023-05-10T01:24:20.463345+0000","last_became_active":"2023-05-10T01:24:20.458404+0000","last_became_peered":"2023-05-10T01:24:20.458404+0000","last_unstale":"2023-05-10T01:24:20.463345+0000","last_undegraded":"2023-05-10T01:24:20.463345+0000","last_fullsized":"2023-05-10T01:24:20.463345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428363+0000","last_change":"2023-05-10T01:24:20.042534+0000","last_active":"2023-05-10T01:24:20.428363+0000","last_peered":"2023-05-10T01:24:20.428363+0000","last_clean":"2023-05-10T01:24:20.428363+0000","last_became_active":"2023-05-10T01:24:20.039147+0000","last_became_peered":"2023-05-10T01:24:20.039147+0000","last_unstale":"2023-05-10T01:24:20.428363+0000","last_undegraded":"2023-05-10T01:24:20.428363+0000","last_fullsized":"2023-05-10T01:24:20.428363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457984+0000","last_change":"2023-05-10T01:24:20.455058+0000","last_active":"2023-05-10T01:24:20.457984+0000","last_peered":"2023-05-10T01:24:20.457984+0000","last_clean":"2023-05-10T01:24:20.457984+0000","last_became_active":"2023-05-10T01:24:20.454775+0000","last_became_peered":"2023-05-10T01:24:20.454775+0000","last_unstale":"2023-05-10T01:24:20.457984+0000","last_undegraded":"2023-05-10T01:24:20.457984+0000","last_fullsized":"2023-05-10T01:24:20.457984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431401+0000","last_change":"2023-05-10T01:24:20.040275+0000","last_active":"2023-05-10T01:24:20.431401+0000","last_peered":"2023-05-10T01:24:20.431401+0000","last_clean":"2023-05-10T01:24:20.431401+0000","last_became_active":"2023-05-10T01:24:20.039976+0000","last_became_peered":"2023-05-10T01:24:20.039976+0000","last_unstale":"2023-05-10T01:24:20.431401+0000","last_undegraded":"2023-05-10T01:24:20.431401+0000","last_fullsized":"2023-05-10T01:24:20.431401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444477+0000","last_change":"2023-05-10T01:24:20.439090+0000","last_active":"2023-05-10T01:24:20.444477+0000","last_peered":"2023-05-10T01:24:20.444477+0000","last_clean":"2023-05-10T01:24:20.444477+0000","last_became_active":"2023-05-10T01:24:20.438697+0000","last_became_peered":"2023-05-10T01:24:20.438697+0000","last_unstale":"2023-05-10T01:24:20.444477+0000","last_undegraded":"2023-05-10T01:24:20.444477+0000","last_fullsized":"2023-05-10T01:24:20.444477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.427186+0000","last_change":"2023-05-10T01:24:20.035582+0000","last_active":"2023-05-10T01:24:20.427186+0000","last_peered":"2023-05-10T01:24:20.427186+0000","last_clean":"2023-05-10T01:24:20.427186+0000","last_became_active":"2023-05-10T01:24:20.033450+0000","last_became_peered":"2023-05-10T01:24:20.033450+0000","last_unstale":"2023-05-10T01:24:20.427186+0000","last_undegraded":"2023-05-10T01:24:20.427186+0000","last_fullsized":"2023-05-10T01:24:20.427186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463562+0000","last_change":"2023-05-10T01:24:20.458396+0000","last_active":"2023-05-10T01:24:20.463562+0000","last_peered":"2023-05-10T01:24:20.463562+0000","last_clean":"2023-05-10T01:24:20.463562+0000","last_became_active":"2023-05-10T01:24:20.458060+0000","last_became_peered":"2023-05-10T01:24:20.458060+0000","last_unstale":"2023-05-10T01:24:20.463562+0000","last_undegraded":"2023-05-10T01:24:20.463562+0000","last_fullsized":"2023-05-10T01:24:20.463562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.427327+0000","last_change":"2023-05-10T01:24:20.047691+0000","last_active":"2023-05-10T01:24:20.427327+0000","last_peered":"2023-05-10T01:24:20.427327+0000","last_clean":"2023-05-10T01:24:20.427327+0000","last_became_active":"2023-05-10T01:24:20.047373+0000","last_became_peered":"2023-05-10T01:24:20.047373+0000","last_unstale":"2023-05-10T01:24:20.427327+0000","last_undegraded":"2023-05-10T01:24:20.427327+0000","last_fullsized":"2023-05-10T01:24:20.427327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463652+0000","last_change":"2023-05-10T01:24:20.459443+0000","last_active":"2023-05-10T01:24:20.463652+0000","last_peered":"2023-05-10T01:24:20.463652+0000","last_clean":"2023-05-10T01:24:20.463652+0000","last_became_active":"2023-05-10T01:24:20.458875+0000","last_became_peered":"2023-05-10T01:24:20.458875+0000","last_unstale":"2023-05-10T01:24:20.463652+0000","last_undegraded":"2023-05-10T01:24:20.463652+0000","last_fullsized":"2023-05-10T01:24:20.463652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.461236+0000","last_change":"2023-05-10T01:24:20.043020+0000","last_active":"2023-05-10T01:24:20.461236+0000","last_peered":"2023-05-10T01:24:20.461236+0000","last_clean":"2023-05-10T01:24:20.461236+0000","last_became_active":"2023-05-10T01:24:20.042714+0000","last_became_peered":"2023-05-10T01:24:20.042714+0000","last_unstale":"2023-05-10T01:24:20.461236+0000","last_undegraded":"2023-05-10T01:24:20.461236+0000","last_fullsized":"2023-05-10T01:24:20.461236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446959+0000","last_change":"2023-05-10T01:24:20.444458+0000","last_active":"2023-05-10T01:24:20.446959+0000","last_peered":"2023-05-10T01:24:20.446959+0000","last_clean":"2023-05-10T01:24:20.446959+0000","last_became_active":"2023-05-10T01:24:20.444146+0000","last_became_peered":"2023-05-10T01:24:20.444146+0000","last_unstale":"2023-05-10T01:24:20.446959+0000","last_undegraded":"2023-05-10T01:24:20.446959+0000","last_fullsized":"2023-05-10T01:24:20.446959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459848+0000","last_change":"2023-05-10T01:24:20.041326+0000","last_active":"2023-05-10T01:24:20.459848+0000","last_peered":"2023-05-10T01:24:20.459848+0000","last_clean":"2023-05-10T01:24:20.459848+0000","last_became_active":"2023-05-10T01:24:20.040987+0000","last_became_peered":"2023-05-10T01:24:20.040987+0000","last_unstale":"2023-05-10T01:24:20.459848+0000","last_undegraded":"2023-05-10T01:24:20.459848+0000","last_fullsized":"2023-05-10T01:24:20.459848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459917+0000","last_change":"2023-05-10T01:24:20.453066+0000","last_active":"2023-05-10T01:24:20.459917+0000","last_peered":"2023-05-10T01:24:20.459917+0000","last_clean":"2023-05-10T01:24:20.459917+0000","last_became_active":"2023-05-10T01:24:20.452743+0000","last_became_peered":"2023-05-10T01:24:20.452743+0000","last_unstale":"2023-05-10T01:24:20.459917+0000","last_undegraded":"2023-05-10T01:24:20.459917+0000","last_fullsized":"2023-05-10T01:24:20.459917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431284+0000","last_change":"2023-05-10T01:24:20.038134+0000","last_active":"2023-05-10T01:24:20.431284+0000","last_peered":"2023-05-10T01:24:20.431284+0000","last_clean":"2023-05-10T01:24:20.431284+0000","last_became_active":"2023-05-10T01:24:20.037865+0000","last_became_peered":"2023-05-10T01:24:20.037865+0000","last_unstale":"2023-05-10T01:24:20.431284+0000","last_undegraded":"2023-05-10T01:24:20.431284+0000","last_fullsized":"2023-05-10T01:24:20.431284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457546+0000","last_change":"2023-05-10T01:24:20.449053+0000","last_active":"2023-05-10T01:24:20.457546+0000","last_peered":"2023-05-10T01:24:20.457546+0000","last_clean":"2023-05-10T01:24:20.457546+0000","last_became_active":"2023-05-10T01:24:20.448757+0000","last_became_peered":"2023-05-10T01:24:20.448757+0000","last_unstale":"2023-05-10T01:24:20.457546+0000","last_undegraded":"2023-05-10T01:24:20.457546+0000","last_fullsized":"2023-05-10T01:24:20.457546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432761+0000","last_change":"2023-05-10T01:24:20.040914+0000","last_active":"2023-05-10T01:24:20.432761+0000","last_peered":"2023-05-10T01:24:20.432761+0000","last_clean":"2023-05-10T01:24:20.432761+0000","last_became_active":"2023-05-10T01:24:20.040295+0000","last_became_peered":"2023-05-10T01:24:20.040295+0000","last_unstale":"2023-05-10T01:24:20.432761+0000","last_undegraded":"2023-05-10T01:24:20.432761+0000","last_fullsized":"2023-05-10T01:24:20.432761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.453349+0000","last_change":"2023-05-10T01:24:20.447485+0000","last_active":"2023-05-10T01:24:20.453349+0000","last_peered":"2023-05-10T01:24:20.453349+0000","last_clean":"2023-05-10T01:24:20.453349+0000","last_became_active":"2023-05-10T01:24:20.442549+0000","last_became_peered":"2023-05-10T01:24:20.442549+0000","last_unstale":"2023-05-10T01:24:20.453349+0000","last_undegraded":"2023-05-10T01:24:20.453349+0000","last_fullsized":"2023-05-10T01:24:20.453349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447280+0000","last_change":"2023-05-10T01:24:20.045598+0000","last_active":"2023-05-10T01:24:20.447280+0000","last_peered":"2023-05-10T01:24:20.447280+0000","last_clean":"2023-05-10T01:24:20.447280+0000","last_became_active":"2023-05-10T01:24:20.045183+0000","last_became_peered":"2023-05-10T01:24:20.045183+0000","last_unstale":"2023-05-10T01:24:20.447280+0000","last_undegraded":"2023-05-10T01:24:20.447280+0000","last_fullsized":"2023-05-10T01:24:20.447280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.455834+0000","last_change":"2023-05-10T01:24:20.455120+0000","last_active":"2023-05-10T01:24:20.455834+0000","last_peered":"2023-05-10T01:24:20.455834+0000","last_clean":"2023-05-10T01:24:20.455834+0000","last_became_active":"2023-05-10T01:24:20.454828+0000","last_became_peered":"2023-05-10T01:24:20.454828+0000","last_unstale":"2023-05-10T01:24:20.455834+0000","last_undegraded":"2023-05-10T01:24:20.455834+0000","last_fullsized":"2023-05-10T01:24:20.455834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.429082+0000","last_change":"2023-05-10T01:24:20.037841+0000","last_active":"2023-05-10T01:24:20.429082+0000","last_peered":"2023-05-10T01:24:20.429082+0000","last_clean":"2023-05-10T01:24:20.429082+0000","last_became_active":"2023-05-10T01:24:20.037514+0000","last_became_peered":"2023-05-10T01:24:20.037514+0000","last_unstale":"2023-05-10T01:24:20.429082+0000","last_undegraded":"2023-05-10T01:24:20.429082+0000","last_fullsized":"2023-05-10T01:24:20.429082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463435+0000","last_change":"2023-05-10T01:24:20.459353+0000","last_active":"2023-05-10T01:24:20.463435+0000","last_peered":"2023-05-10T01:24:20.463435+0000","last_clean":"2023-05-10T01:24:20.463435+0000","last_became_active":"2023-05-10T01:24:20.458772+0000","last_became_peered":"2023-05-10T01:24:20.458772+0000","last_unstale":"2023-05-10T01:24:20.463435+0000","last_undegraded":"2023-05-10T01:24:20.463435+0000","last_fullsized":"2023-05-10T01:24:20.463435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449840+0000","last_change":"2023-05-10T01:24:20.048214+0000","last_active":"2023-05-10T01:24:20.449840+0000","last_peered":"2023-05-10T01:24:20.449840+0000","last_clean":"2023-05-10T01:24:20.449840+0000","last_became_active":"2023-05-10T01:24:20.047826+0000","last_became_peered":"2023-05-10T01:24:20.047826+0000","last_unstale":"2023-05-10T01:24:20.449840+0000","last_undegraded":"2023-05-10T01:24:20.449840+0000","last_fullsized":"2023-05-10T01:24:20.449840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440326+0000","last_change":"2023-05-10T01:24:20.437715+0000","last_active":"2023-05-10T01:24:20.440326+0000","last_peered":"2023-05-10T01:24:20.440326+0000","last_clean":"2023-05-10T01:24:20.440326+0000","last_became_active":"2023-05-10T01:24:20.437438+0000","last_became_peered":"2023-05-10T01:24:20.437438+0000","last_unstale":"2023-05-10T01:24:20.440326+0000","last_undegraded":"2023-05-10T01:24:20.440326+0000","last_fullsized":"2023-05-10T01:24:20.440326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438621+0000","last_change":"2023-05-10T01:24:20.045908+0000","last_active":"2023-05-10T01:24:20.438621+0000","last_peered":"2023-05-10T01:24:20.438621+0000","last_clean":"2023-05-10T01:24:20.438621+0000","last_became_active":"2023-05-10T01:24:20.045609+0000","last_became_peered":"2023-05-10T01:24:20.045609+0000","last_unstale":"2023-05-10T01:24:20.438621+0000","last_undegraded":"2023-05-10T01:24:20.438621+0000","last_fullsized":"2023-05-10T01:24:20.438621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444918+0000","last_change":"2023-05-10T01:24:20.443941+0000","last_active":"2023-05-10T01:24:20.444918+0000","last_peered":"2023-05-10T01:24:20.444918+0000","last_clean":"2023-05-10T01:24:20.444918+0000","last_became_active":"2023-05-10T01:24:20.443561+0000","last_became_peered":"2023-05-10T01:24:20.443561+0000","last_unstale":"2023-05-10T01:24:20.444918+0000","last_undegraded":"2023-05-10T01:24:20.444918+0000","last_fullsized":"2023-05-10T01:24:20.444918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428804+0000","last_change":"2023-05-10T01:24:20.044022+0000","last_active":"2023-05-10T01:24:20.428804+0000","last_peered":"2023-05-10T01:24:20.428804+0000","last_clean":"2023-05-10T01:24:20.428804+0000","last_became_active":"2023-05-10T01:24:20.043682+0000","last_became_peered":"2023-05-10T01:24:20.043682+0000","last_unstale":"2023-05-10T01:24:20.428804+0000","last_undegraded":"2023-05-10T01:24:20.428804+0000","last_fullsized":"2023-05-10T01:24:20.428804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.456803+0000","last_change":"2023-05-10T01:24:20.449090+0000","last_active":"2023-05-10T01:24:20.456803+0000","last_peered":"2023-05-10T01:24:20.456803+0000","last_clean":"2023-05-10T01:24:20.456803+0000","last_became_active":"2023-05-10T01:24:20.448800+0000","last_became_peered":"2023-05-10T01:24:20.448800+0000","last_unstale":"2023-05-10T01:24:20.456803+0000","last_undegraded":"2023-05-10T01:24:20.456803+0000","last_fullsized":"2023-05-10T01:24:20.456803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460733+0000","last_change":"2023-05-10T01:24:20.046413+0000","last_active":"2023-05-10T01:24:20.460733+0000","last_peered":"2023-05-10T01:24:20.460733+0000","last_clean":"2023-05-10T01:24:20.460733+0000","last_became_active":"2023-05-10T01:24:20.044871+0000","last_became_peered":"2023-05-10T01:24:20.044871+0000","last_unstale":"2023-05-10T01:24:20.460733+0000","last_undegraded":"2023-05-10T01:24:20.460733+0000","last_fullsized":"2023-05-10T01:24:20.460733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454164+0000","last_change":"2023-05-10T01:24:20.453440+0000","last_active":"2023-05-10T01:24:20.454164+0000","last_peered":"2023-05-10T01:24:20.454164+0000","last_clean":"2023-05-10T01:24:20.454164+0000","last_became_active":"2023-05-10T01:24:20.453174+0000","last_became_peered":"2023-05-10T01:24:20.453174+0000","last_unstale":"2023-05-10T01:24:20.454164+0000","last_undegraded":"2023-05-10T01:24:20.454164+0000","last_fullsized":"2023-05-10T01:24:20.454164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428664+0000","last_change":"2023-05-10T01:24:20.044634+0000","last_active":"2023-05-10T01:24:20.428664+0000","last_peered":"2023-05-10T01:24:20.428664+0000","last_clean":"2023-05-10T01:24:20.428664+0000","last_became_active":"2023-05-10T01:24:20.044332+0000","last_became_peered":"2023-05-10T01:24:20.044332+0000","last_unstale":"2023-05-10T01:24:20.428664+0000","last_undegraded":"2023-05-10T01:24:20.428664+0000","last_fullsized":"2023-05-10T01:24:20.428664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451843+0000","last_change":"2023-05-10T01:24:20.450931+0000","last_active":"2023-05-10T01:24:20.451843+0000","last_peered":"2023-05-10T01:24:20.451843+0000","last_clean":"2023-05-10T01:24:20.451843+0000","last_became_active":"2023-05-10T01:24:20.450657+0000","last_became_peered":"2023-05-10T01:24:20.450657+0000","last_unstale":"2023-05-10T01:24:20.451843+0000","last_undegraded":"2023-05-10T01:24:20.451843+0000","last_fullsized":"2023-05-10T01:24:20.451843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440935+0000","last_change":"2023-05-10T01:24:20.050049+0000","last_active":"2023-05-10T01:24:20.440935+0000","last_peered":"2023-05-10T01:24:20.440935+0000","last_clean":"2023-05-10T01:24:20.440935+0000","last_became_active":"2023-05-10T01:24:20.049794+0000","last_became_peered":"2023-05-10T01:24:20.049794+0000","last_unstale":"2023-05-10T01:24:20.440935+0000","last_undegraded":"2023-05-10T01:24:20.440935+0000","last_fullsized":"2023-05-10T01:24:20.440935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447354+0000","last_change":"2023-05-10T01:24:20.442924+0000","last_active":"2023-05-10T01:24:20.447354+0000","last_peered":"2023-05-10T01:24:20.447354+0000","last_clean":"2023-05-10T01:24:20.447354+0000","last_became_active":"2023-05-10T01:24:20.441999+0000","last_became_peered":"2023-05-10T01:24:20.441999+0000","last_unstale":"2023-05-10T01:24:20.447354+0000","last_undegraded":"2023-05-10T01:24:20.447354+0000","last_fullsized":"2023-05-10T01:24:20.447354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449967+0000","last_change":"2023-05-10T01:24:20.048246+0000","last_active":"2023-05-10T01:24:20.449967+0000","last_peered":"2023-05-10T01:24:20.449967+0000","last_clean":"2023-05-10T01:24:20.449967+0000","last_became_active":"2023-05-10T01:24:20.047976+0000","last_became_peered":"2023-05-10T01:24:20.047976+0000","last_unstale":"2023-05-10T01:24:20.449967+0000","last_undegraded":"2023-05-10T01:24:20.449967+0000","last_fullsized":"2023-05-10T01:24:20.449967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.456144+0000","last_change":"2023-05-10T01:24:20.454869+0000","last_active":"2023-05-10T01:24:20.456144+0000","last_peered":"2023-05-10T01:24:20.456144+0000","last_clean":"2023-05-10T01:24:20.456144+0000","last_became_active":"2023-05-10T01:24:20.454642+0000","last_became_peered":"2023-05-10T01:24:20.454642+0000","last_unstale":"2023-05-10T01:24:20.456144+0000","last_undegraded":"2023-05-10T01:24:20.456144+0000","last_fullsized":"2023-05-10T01:24:20.456144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.430966+0000","last_change":"2023-05-10T01:24:20.035217+0000","last_active":"2023-05-10T01:24:20.430966+0000","last_peered":"2023-05-10T01:24:20.430966+0000","last_clean":"2023-05-10T01:24:20.430966+0000","last_became_active":"2023-05-10T01:24:20.034906+0000","last_became_peered":"2023-05-10T01:24:20.034906+0000","last_unstale":"2023-05-10T01:24:20.430966+0000","last_undegraded":"2023-05-10T01:24:20.430966+0000","last_fullsized":"2023-05-10T01:24:20.430966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447711+0000","last_change":"2023-05-10T01:24:20.443372+0000","last_active":"2023-05-10T01:24:20.447711+0000","last_peered":"2023-05-10T01:24:20.447711+0000","last_clean":"2023-05-10T01:24:20.447711+0000","last_became_active":"2023-05-10T01:24:20.443089+0000","last_became_peered":"2023-05-10T01:24:20.443089+0000","last_unstale":"2023-05-10T01:24:20.447711+0000","last_undegraded":"2023-05-10T01:24:20.447711+0000","last_fullsized":"2023-05-10T01:24:20.447711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.838066+0000","last_change":"2023-05-10T01:24:20.039728+0000","last_active":"2023-05-10T01:24:20.838066+0000","last_peered":"2023-05-10T01:24:20.838066+0000","last_clean":"2023-05-10T01:24:20.838066+0000","last_became_active":"2023-05-10T01:24:20.039179+0000","last_became_peered":"2023-05-10T01:24:20.039179+0000","last_unstale":"2023-05-10T01:24:20.838066+0000","last_undegraded":"2023-05-10T01:24:20.838066+0000","last_fullsized":"2023-05-10T01:24:20.838066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447391+0000","last_change":"2023-05-10T01:24:20.443480+0000","last_active":"2023-05-10T01:24:20.447391+0000","last_peered":"2023-05-10T01:24:20.447391+0000","last_clean":"2023-05-10T01:24:20.447391+0000","last_became_active":"2023-05-10T01:24:20.442847+0000","last_became_peered":"2023-05-10T01:24:20.442847+0000","last_unstale":"2023-05-10T01:24:20.447391+0000","last_undegraded":"2023-05-10T01:24:20.447391+0000","last_fullsized":"2023-05-10T01:24:20.447391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431470+0000","last_change":"2023-05-10T01:24:20.040862+0000","last_active":"2023-05-10T01:24:20.431470+0000","last_peered":"2023-05-10T01:24:20.431470+0000","last_clean":"2023-05-10T01:24:20.431470+0000","last_became_active":"2023-05-10T01:24:20.040538+0000","last_became_peered":"2023-05-10T01:24:20.040538+0000","last_unstale":"2023-05-10T01:24:20.431470+0000","last_undegraded":"2023-05-10T01:24:20.431470+0000","last_fullsized":"2023-05-10T01:24:20.431470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.448064+0000","last_change":"2023-05-10T01:24:20.443352+0000","last_active":"2023-05-10T01:24:20.448064+0000","last_peered":"2023-05-10T01:24:20.448064+0000","last_clean":"2023-05-10T01:24:20.448064+0000","last_became_active":"2023-05-10T01:24:20.443021+0000","last_became_peered":"2023-05-10T01:24:20.443021+0000","last_unstale":"2023-05-10T01:24:20.448064+0000","last_undegraded":"2023-05-10T01:24:20.448064+0000","last_fullsized":"2023-05-10T01:24:20.448064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432810+0000","last_change":"2023-05-10T01:24:20.036237+0000","last_active":"2023-05-10T01:24:20.432810+0000","last_peered":"2023-05-10T01:24:20.432810+0000","last_clean":"2023-05-10T01:24:20.432810+0000","last_became_active":"2023-05-10T01:24:20.035938+0000","last_became_peered":"2023-05-10T01:24:20.035938+0000","last_unstale":"2023-05-10T01:24:20.432810+0000","last_undegraded":"2023-05-10T01:24:20.432810+0000","last_fullsized":"2023-05-10T01:24:20.432810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440401+0000","last_change":"2023-05-10T01:24:20.437391+0000","last_active":"2023-05-10T01:24:20.440401+0000","last_peered":"2023-05-10T01:24:20.440401+0000","last_clean":"2023-05-10T01:24:20.440401+0000","last_became_active":"2023-05-10T01:24:20.436953+0000","last_became_peered":"2023-05-10T01:24:20.436953+0000","last_unstale":"2023-05-10T01:24:20.440401+0000","last_undegraded":"2023-05-10T01:24:20.440401+0000","last_fullsized":"2023-05-10T01:24:20.440401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.429326+0000","last_change":"2023-05-10T01:24:20.042397+0000","last_active":"2023-05-10T01:24:20.429326+0000","last_peered":"2023-05-10T01:24:20.429326+0000","last_clean":"2023-05-10T01:24:20.429326+0000","last_became_active":"2023-05-10T01:24:20.042083+0000","last_became_peered":"2023-05-10T01:24:20.042083+0000","last_unstale":"2023-05-10T01:24:20.429326+0000","last_undegraded":"2023-05-10T01:24:20.429326+0000","last_fullsized":"2023-05-10T01:24:20.429326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447405+0000","last_change":"2023-05-10T01:24:20.442195+0000","last_active":"2023-05-10T01:24:20.447405+0000","last_peered":"2023-05-10T01:24:20.447405+0000","last_clean":"2023-05-10T01:24:20.447405+0000","last_became_active":"2023-05-10T01:24:20.441921+0000","last_became_peered":"2023-05-10T01:24:20.441921+0000","last_unstale":"2023-05-10T01:24:20.447405+0000","last_undegraded":"2023-05-10T01:24:20.447405+0000","last_fullsized":"2023-05-10T01:24:20.447405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438078+0000","last_change":"2023-05-10T01:24:20.044636+0000","last_active":"2023-05-10T01:24:20.438078+0000","last_peered":"2023-05-10T01:24:20.438078+0000","last_clean":"2023-05-10T01:24:20.438078+0000","last_became_active":"2023-05-10T01:24:20.044360+0000","last_became_peered":"2023-05-10T01:24:20.044360+0000","last_unstale":"2023-05-10T01:24:20.438078+0000","last_undegraded":"2023-05-10T01:24:20.438078+0000","last_fullsized":"2023-05-10T01:24:20.438078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457847+0000","last_change":"2023-05-10T01:24:20.452751+0000","last_active":"2023-05-10T01:24:20.457847+0000","last_peered":"2023-05-10T01:24:20.457847+0000","last_clean":"2023-05-10T01:24:20.457847+0000","last_became_active":"2023-05-10T01:24:20.452533+0000","last_became_peered":"2023-05-10T01:24:20.452533+0000","last_unstale":"2023-05-10T01:24:20.457847+0000","last_undegraded":"2023-05-10T01:24:20.457847+0000","last_fullsized":"2023-05-10T01:24:20.457847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431766+0000","last_change":"2023-05-10T01:24:20.032017+0000","last_active":"2023-05-10T01:24:20.431766+0000","last_peered":"2023-05-10T01:24:20.431766+0000","last_clean":"2023-05-10T01:24:20.431766+0000","last_became_active":"2023-05-10T01:24:20.031718+0000","last_became_peered":"2023-05-10T01:24:20.031718+0000","last_unstale":"2023-05-10T01:24:20.431766+0000","last_undegraded":"2023-05-10T01:24:20.431766+0000","last_fullsized":"2023-05-10T01:24:20.431766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.461246+0000","last_change":"2023-05-10T01:24:20.454653+0000","last_active":"2023-05-10T01:24:20.461246+0000","last_peered":"2023-05-10T01:24:20.461246+0000","last_clean":"2023-05-10T01:24:20.461246+0000","last_became_active":"2023-05-10T01:24:20.454391+0000","last_became_peered":"2023-05-10T01:24:20.454391+0000","last_unstale":"2023-05-10T01:24:20.461246+0000","last_undegraded":"2023-05-10T01:24:20.461246+0000","last_fullsized":"2023-05-10T01:24:20.461246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.432045+0000","last_change":"2023-05-10T01:24:20.045212+0000","last_active":"2023-05-10T01:24:20.432045+0000","last_peered":"2023-05-10T01:24:20.432045+0000","last_clean":"2023-05-10T01:24:20.432045+0000","last_became_active":"2023-05-10T01:24:20.039882+0000","last_became_peered":"2023-05-10T01:24:20.039882+0000","last_unstale":"2023-05-10T01:24:20.432045+0000","last_undegraded":"2023-05-10T01:24:20.432045+0000","last_fullsized":"2023-05-10T01:24:20.432045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458898+0000","last_change":"2023-05-10T01:24:20.451923+0000","last_active":"2023-05-10T01:24:20.458898+0000","last_peered":"2023-05-10T01:24:20.458898+0000","last_clean":"2023-05-10T01:24:20.458898+0000","last_became_active":"2023-05-10T01:24:20.450847+0000","last_became_peered":"2023-05-10T01:24:20.450847+0000","last_unstale":"2023-05-10T01:24:20.458898+0000","last_undegraded":"2023-05-10T01:24:20.458898+0000","last_fullsized":"2023-05-10T01:24:20.458898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452444+0000","last_change":"2023-05-10T01:24:20.046553+0000","last_active":"2023-05-10T01:24:20.452444+0000","last_peered":"2023-05-10T01:24:20.452444+0000","last_clean":"2023-05-10T01:24:20.452444+0000","last_became_active":"2023-05-10T01:24:20.046231+0000","last_became_peered":"2023-05-10T01:24:20.046231+0000","last_unstale":"2023-05-10T01:24:20.452444+0000","last_undegraded":"2023-05-10T01:24:20.452444+0000","last_fullsized":"2023-05-10T01:24:20.452444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463477+0000","last_change":"2023-05-10T01:24:20.459865+0000","last_active":"2023-05-10T01:24:20.463477+0000","last_peered":"2023-05-10T01:24:20.463477+0000","last_clean":"2023-05-10T01:24:20.463477+0000","last_became_active":"2023-05-10T01:24:20.459515+0000","last_became_peered":"2023-05-10T01:24:20.459515+0000","last_unstale":"2023-05-10T01:24:20.463477+0000","last_undegraded":"2023-05-10T01:24:20.463477+0000","last_fullsized":"2023-05-10T01:24:20.463477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454298+0000","last_change":"2023-05-10T01:24:20.044669+0000","last_active":"2023-05-10T01:24:20.454298+0000","last_peered":"2023-05-10T01:24:20.454298+0000","last_clean":"2023-05-10T01:24:20.454298+0000","last_became_active":"2023-05-10T01:24:20.044344+0000","last_became_peered":"2023-05-10T01:24:20.044344+0000","last_unstale":"2023-05-10T01:24:20.454298+0000","last_undegraded":"2023-05-10T01:24:20.454298+0000","last_fullsized":"2023-05-10T01:24:20.454298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440538+0000","last_change":"2023-05-10T01:24:20.437997+0000","last_active":"2023-05-10T01:24:20.440538+0000","last_peered":"2023-05-10T01:24:20.440538+0000","last_clean":"2023-05-10T01:24:20.440538+0000","last_became_active":"2023-05-10T01:24:20.437543+0000","last_became_peered":"2023-05-10T01:24:20.437543+0000","last_unstale":"2023-05-10T01:24:20.440538+0000","last_undegraded":"2023-05-10T01:24:20.440538+0000","last_fullsized":"2023-05-10T01:24:20.440538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447793+0000","last_change":"2023-05-10T01:24:20.043479+0000","last_active":"2023-05-10T01:24:20.447793+0000","last_peered":"2023-05-10T01:24:20.447793+0000","last_clean":"2023-05-10T01:24:20.447793+0000","last_became_active":"2023-05-10T01:24:20.042740+0000","last_became_peered":"2023-05-10T01:24:20.042740+0000","last_unstale":"2023-05-10T01:24:20.447793+0000","last_undegraded":"2023-05-10T01:24:20.447793+0000","last_fullsized":"2023-05-10T01:24:20.447793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463667+0000","last_change":"2023-05-10T01:24:20.459643+0000","last_active":"2023-05-10T01:24:20.463667+0000","last_peered":"2023-05-10T01:24:20.463667+0000","last_clean":"2023-05-10T01:24:20.463667+0000","last_became_active":"2023-05-10T01:24:20.459166+0000","last_became_peered":"2023-05-10T01:24:20.459166+0000","last_unstale":"2023-05-10T01:24:20.463667+0000","last_undegraded":"2023-05-10T01:24:20.463667+0000","last_fullsized":"2023-05-10T01:24:20.463667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431645+0000","last_change":"2023-05-10T01:24:20.041177+0000","last_active":"2023-05-10T01:24:20.431645+0000","last_peered":"2023-05-10T01:24:20.431645+0000","last_clean":"2023-05-10T01:24:20.431645+0000","last_became_active":"2023-05-10T01:24:20.040883+0000","last_became_peered":"2023-05-10T01:24:20.040883+0000","last_unstale":"2023-05-10T01:24:20.431645+0000","last_undegraded":"2023-05-10T01:24:20.431645+0000","last_fullsized":"2023-05-10T01:24:20.431645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439291+0000","last_change":"2023-05-10T01:24:20.437109+0000","last_active":"2023-05-10T01:24:20.439291+0000","last_peered":"2023-05-10T01:24:20.439291+0000","last_clean":"2023-05-10T01:24:20.439291+0000","last_became_active":"2023-05-10T01:24:20.436810+0000","last_became_peered":"2023-05-10T01:24:20.436810+0000","last_unstale":"2023-05-10T01:24:20.439291+0000","last_undegraded":"2023-05-10T01:24:20.439291+0000","last_fullsized":"2023-05-10T01:24:20.439291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.429326+0000","last_change":"2023-05-10T01:24:20.047419+0000","last_active":"2023-05-10T01:24:20.429326+0000","last_peered":"2023-05-10T01:24:20.429326+0000","last_clean":"2023-05-10T01:24:20.429326+0000","last_became_active":"2023-05-10T01:24:20.047036+0000","last_became_peered":"2023-05-10T01:24:20.047036+0000","last_unstale":"2023-05-10T01:24:20.429326+0000","last_undegraded":"2023-05-10T01:24:20.429326+0000","last_fullsized":"2023-05-10T01:24:20.429326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444884+0000","last_change":"2023-05-10T01:24:20.443770+0000","last_active":"2023-05-10T01:24:20.444884+0000","last_peered":"2023-05-10T01:24:20.444884+0000","last_clean":"2023-05-10T01:24:20.444884+0000","last_became_active":"2023-05-10T01:24:20.443488+0000","last_became_peered":"2023-05-10T01:24:20.443488+0000","last_unstale":"2023-05-10T01:24:20.444884+0000","last_undegraded":"2023-05-10T01:24:20.444884+0000","last_fullsized":"2023-05-10T01:24:20.444884+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428768+0000","last_change":"2023-05-10T01:24:20.045648+0000","last_active":"2023-05-10T01:24:20.428768+0000","last_peered":"2023-05-10T01:24:20.428768+0000","last_clean":"2023-05-10T01:24:20.428768+0000","last_became_active":"2023-05-10T01:24:20.045300+0000","last_became_peered":"2023-05-10T01:24:20.045300+0000","last_unstale":"2023-05-10T01:24:20.428768+0000","last_undegraded":"2023-05-10T01:24:20.428768+0000","last_fullsized":"2023-05-10T01:24:20.428768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463377+0000","last_change":"2023-05-10T01:24:20.459050+0000","last_active":"2023-05-10T01:24:20.463377+0000","last_peered":"2023-05-10T01:24:20.463377+0000","last_clean":"2023-05-10T01:24:20.463377+0000","last_became_active":"2023-05-10T01:24:20.458758+0000","last_became_peered":"2023-05-10T01:24:20.458758+0000","last_unstale":"2023-05-10T01:24:20.463377+0000","last_undegraded":"2023-05-10T01:24:20.463377+0000","last_fullsized":"2023-05-10T01:24:20.463377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.429667+0000","last_change":"2023-05-10T01:24:20.042949+0000","last_active":"2023-05-10T01:24:20.429667+0000","last_peered":"2023-05-10T01:24:20.429667+0000","last_clean":"2023-05-10T01:24:20.429667+0000","last_became_active":"2023-05-10T01:24:20.042615+0000","last_became_peered":"2023-05-10T01:24:20.042615+0000","last_unstale":"2023-05-10T01:24:20.429667+0000","last_undegraded":"2023-05-10T01:24:20.429667+0000","last_fullsized":"2023-05-10T01:24:20.429667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439565+0000","last_change":"2023-05-10T01:24:20.438034+0000","last_active":"2023-05-10T01:24:20.439565+0000","last_peered":"2023-05-10T01:24:20.439565+0000","last_clean":"2023-05-10T01:24:20.439565+0000","last_became_active":"2023-05-10T01:24:20.437758+0000","last_became_peered":"2023-05-10T01:24:20.437758+0000","last_unstale":"2023-05-10T01:24:20.439565+0000","last_undegraded":"2023-05-10T01:24:20.439565+0000","last_fullsized":"2023-05-10T01:24:20.439565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.450025+0000","last_change":"2023-05-10T01:24:20.042766+0000","last_active":"2023-05-10T01:24:20.450025+0000","last_peered":"2023-05-10T01:24:20.450025+0000","last_clean":"2023-05-10T01:24:20.450025+0000","last_became_active":"2023-05-10T01:24:20.042490+0000","last_became_peered":"2023-05-10T01:24:20.042490+0000","last_unstale":"2023-05-10T01:24:20.450025+0000","last_undegraded":"2023-05-10T01:24:20.450025+0000","last_fullsized":"2023-05-10T01:24:20.450025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440377+0000","last_change":"2023-05-10T01:24:20.439625+0000","last_active":"2023-05-10T01:24:20.440377+0000","last_peered":"2023-05-10T01:24:20.440377+0000","last_clean":"2023-05-10T01:24:20.440377+0000","last_became_active":"2023-05-10T01:24:20.438967+0000","last_became_peered":"2023-05-10T01:24:20.438967+0000","last_unstale":"2023-05-10T01:24:20.440377+0000","last_undegraded":"2023-05-10T01:24:20.440377+0000","last_fullsized":"2023-05-10T01:24:20.440377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.451069+0000","last_change":"2023-05-10T01:24:20.052854+0000","last_active":"2023-05-10T01:24:20.451069+0000","last_peered":"2023-05-10T01:24:20.451069+0000","last_clean":"2023-05-10T01:24:20.451069+0000","last_became_active":"2023-05-10T01:24:20.052595+0000","last_became_peered":"2023-05-10T01:24:20.052595+0000","last_unstale":"2023-05-10T01:24:20.451069+0000","last_undegraded":"2023-05-10T01:24:20.451069+0000","last_fullsized":"2023-05-10T01:24:20.451069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447898+0000","last_change":"2023-05-10T01:24:20.446249+0000","last_active":"2023-05-10T01:24:20.447898+0000","last_peered":"2023-05-10T01:24:20.447898+0000","last_clean":"2023-05-10T01:24:20.447898+0000","last_became_active":"2023-05-10T01:24:20.445949+0000","last_became_peered":"2023-05-10T01:24:20.445949+0000","last_unstale":"2023-05-10T01:24:20.447898+0000","last_undegraded":"2023-05-10T01:24:20.447898+0000","last_fullsized":"2023-05-10T01:24:20.447898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.433006+0000","last_change":"2023-05-10T01:24:20.037935+0000","last_active":"2023-05-10T01:24:20.433006+0000","last_peered":"2023-05-10T01:24:20.433006+0000","last_clean":"2023-05-10T01:24:20.433006+0000","last_became_active":"2023-05-10T01:24:20.037566+0000","last_became_peered":"2023-05-10T01:24:20.037566+0000","last_unstale":"2023-05-10T01:24:20.433006+0000","last_undegraded":"2023-05-10T01:24:20.433006+0000","last_fullsized":"2023-05-10T01:24:20.433006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.458929+0000","last_change":"2023-05-10T01:24:20.455086+0000","last_active":"2023-05-10T01:24:20.458929+0000","last_peered":"2023-05-10T01:24:20.458929+0000","last_clean":"2023-05-10T01:24:20.458929+0000","last_became_active":"2023-05-10T01:24:20.454818+0000","last_became_peered":"2023-05-10T01:24:20.454818+0000","last_unstale":"2023-05-10T01:24:20.458929+0000","last_undegraded":"2023-05-10T01:24:20.458929+0000","last_fullsized":"2023-05-10T01:24:20.458929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454582+0000","last_change":"2023-05-10T01:24:20.052103+0000","last_active":"2023-05-10T01:24:20.454582+0000","last_peered":"2023-05-10T01:24:20.454582+0000","last_clean":"2023-05-10T01:24:20.454582+0000","last_became_active":"2023-05-10T01:24:20.051708+0000","last_became_peered":"2023-05-10T01:24:20.051708+0000","last_unstale":"2023-05-10T01:24:20.454582+0000","last_undegraded":"2023-05-10T01:24:20.454582+0000","last_fullsized":"2023-05-10T01:24:20.454582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.446853+0000","last_change":"2023-05-10T01:24:20.440480+0000","last_active":"2023-05-10T01:24:20.446853+0000","last_peered":"2023-05-10T01:24:20.446853+0000","last_clean":"2023-05-10T01:24:20.446853+0000","last_became_active":"2023-05-10T01:24:20.440029+0000","last_became_peered":"2023-05-10T01:24:20.440029+0000","last_unstale":"2023-05-10T01:24:20.446853+0000","last_undegraded":"2023-05-10T01:24:20.446853+0000","last_fullsized":"2023-05-10T01:24:20.446853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.449692+0000","last_change":"2023-05-10T01:24:20.041884+0000","last_active":"2023-05-10T01:24:20.449692+0000","last_peered":"2023-05-10T01:24:20.449692+0000","last_clean":"2023-05-10T01:24:20.449692+0000","last_became_active":"2023-05-10T01:24:20.041178+0000","last_became_peered":"2023-05-10T01:24:20.041178+0000","last_unstale":"2023-05-10T01:24:20.449692+0000","last_undegraded":"2023-05-10T01:24:20.449692+0000","last_fullsized":"2023-05-10T01:24:20.449692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454376+0000","last_change":"2023-05-10T01:24:20.450582+0000","last_active":"2023-05-10T01:24:20.454376+0000","last_peered":"2023-05-10T01:24:20.454376+0000","last_clean":"2023-05-10T01:24:20.454376+0000","last_became_active":"2023-05-10T01:24:20.450302+0000","last_became_peered":"2023-05-10T01:24:20.450302+0000","last_unstale":"2023-05-10T01:24:20.454376+0000","last_undegraded":"2023-05-10T01:24:20.454376+0000","last_fullsized":"2023-05-10T01:24:20.454376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.461136+0000","last_change":"2023-05-10T01:24:20.044578+0000","last_active":"2023-05-10T01:24:20.461136+0000","last_peered":"2023-05-10T01:24:20.461136+0000","last_clean":"2023-05-10T01:24:20.461136+0000","last_became_active":"2023-05-10T01:24:20.042613+0000","last_became_peered":"2023-05-10T01:24:20.042613+0000","last_unstale":"2023-05-10T01:24:20.461136+0000","last_undegraded":"2023-05-10T01:24:20.461136+0000","last_fullsized":"2023-05-10T01:24:20.461136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447620+0000","last_change":"2023-05-10T01:24:20.442341+0000","last_active":"2023-05-10T01:24:20.447620+0000","last_peered":"2023-05-10T01:24:20.447620+0000","last_clean":"2023-05-10T01:24:20.447620+0000","last_became_active":"2023-05-10T01:24:20.442026+0000","last_became_peered":"2023-05-10T01:24:20.442026+0000","last_unstale":"2023-05-10T01:24:20.447620+0000","last_undegraded":"2023-05-10T01:24:20.447620+0000","last_fullsized":"2023-05-10T01:24:20.447620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.438191+0000","last_change":"2023-05-10T01:24:20.051464+0000","last_active":"2023-05-10T01:24:20.438191+0000","last_peered":"2023-05-10T01:24:20.438191+0000","last_clean":"2023-05-10T01:24:20.438191+0000","last_became_active":"2023-05-10T01:24:20.051201+0000","last_became_peered":"2023-05-10T01:24:20.051201+0000","last_unstale":"2023-05-10T01:24:20.438191+0000","last_undegraded":"2023-05-10T01:24:20.438191+0000","last_fullsized":"2023-05-10T01:24:20.438191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463458+0000","last_change":"2023-05-10T01:24:20.459687+0000","last_active":"2023-05-10T01:24:20.463458+0000","last_peered":"2023-05-10T01:24:20.463458+0000","last_clean":"2023-05-10T01:24:20.463458+0000","last_became_active":"2023-05-10T01:24:20.459335+0000","last_became_peered":"2023-05-10T01:24:20.459335+0000","last_unstale":"2023-05-10T01:24:20.463458+0000","last_undegraded":"2023-05-10T01:24:20.463458+0000","last_fullsized":"2023-05-10T01:24:20.463458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440991+0000","last_change":"2023-05-10T01:24:20.050842+0000","last_active":"2023-05-10T01:24:20.440991+0000","last_peered":"2023-05-10T01:24:20.440991+0000","last_clean":"2023-05-10T01:24:20.440991+0000","last_became_active":"2023-05-10T01:24:20.050534+0000","last_became_peered":"2023-05-10T01:24:20.050534+0000","last_unstale":"2023-05-10T01:24:20.440991+0000","last_undegraded":"2023-05-10T01:24:20.440991+0000","last_fullsized":"2023-05-10T01:24:20.440991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.456045+0000","last_change":"2023-05-10T01:24:20.455362+0000","last_active":"2023-05-10T01:24:20.456045+0000","last_peered":"2023-05-10T01:24:20.456045+0000","last_clean":"2023-05-10T01:24:20.456045+0000","last_became_active":"2023-05-10T01:24:20.455078+0000","last_became_peered":"2023-05-10T01:24:20.455078+0000","last_unstale":"2023-05-10T01:24:20.456045+0000","last_undegraded":"2023-05-10T01:24:20.456045+0000","last_fullsized":"2023-05-10T01:24:20.456045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457009+0000","last_change":"2023-05-10T01:24:20.044573+0000","last_active":"2023-05-10T01:24:20.457009+0000","last_peered":"2023-05-10T01:24:20.457009+0000","last_clean":"2023-05-10T01:24:20.457009+0000","last_became_active":"2023-05-10T01:24:20.044299+0000","last_became_peered":"2023-05-10T01:24:20.044299+0000","last_unstale":"2023-05-10T01:24:20.457009+0000","last_undegraded":"2023-05-10T01:24:20.457009+0000","last_fullsized":"2023-05-10T01:24:20.457009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440634+0000","last_change":"2023-05-10T01:24:20.439231+0000","last_active":"2023-05-10T01:24:20.440634+0000","last_peered":"2023-05-10T01:24:20.440634+0000","last_clean":"2023-05-10T01:24:20.440634+0000","last_became_active":"2023-05-10T01:24:20.438862+0000","last_became_peered":"2023-05-10T01:24:20.438862+0000","last_unstale":"2023-05-10T01:24:20.440634+0000","last_undegraded":"2023-05-10T01:24:20.440634+0000","last_fullsized":"2023-05-10T01:24:20.440634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452408+0000","last_change":"2023-05-10T01:24:20.043280+0000","last_active":"2023-05-10T01:24:20.452408+0000","last_peered":"2023-05-10T01:24:20.452408+0000","last_clean":"2023-05-10T01:24:20.452408+0000","last_became_active":"2023-05-10T01:24:20.042985+0000","last_became_peered":"2023-05-10T01:24:20.042985+0000","last_unstale":"2023-05-10T01:24:20.452408+0000","last_undegraded":"2023-05-10T01:24:20.452408+0000","last_fullsized":"2023-05-10T01:24:20.452408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.439860+0000","last_change":"2023-05-10T01:24:20.436161+0000","last_active":"2023-05-10T01:24:20.439860+0000","last_peered":"2023-05-10T01:24:20.439860+0000","last_clean":"2023-05-10T01:24:20.439860+0000","last_became_active":"2023-05-10T01:24:20.435870+0000","last_became_peered":"2023-05-10T01:24:20.435870+0000","last_unstale":"2023-05-10T01:24:20.439860+0000","last_undegraded":"2023-05-10T01:24:20.439860+0000","last_fullsized":"2023-05-10T01:24:20.439860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.435312+0000","last_change":"2023-05-10T01:24:20.039739+0000","last_active":"2023-05-10T01:24:20.435312+0000","last_peered":"2023-05-10T01:24:20.435312+0000","last_clean":"2023-05-10T01:24:20.435312+0000","last_became_active":"2023-05-10T01:24:20.039492+0000","last_became_peered":"2023-05-10T01:24:20.039492+0000","last_unstale":"2023-05-10T01:24:20.435312+0000","last_undegraded":"2023-05-10T01:24:20.435312+0000","last_fullsized":"2023-05-10T01:24:20.435312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447372+0000","last_change":"2023-05-10T01:24:20.443279+0000","last_active":"2023-05-10T01:24:20.447372+0000","last_peered":"2023-05-10T01:24:20.447372+0000","last_clean":"2023-05-10T01:24:20.447372+0000","last_became_active":"2023-05-10T01:24:20.442264+0000","last_became_peered":"2023-05-10T01:24:20.442264+0000","last_unstale":"2023-05-10T01:24:20.447372+0000","last_undegraded":"2023-05-10T01:24:20.447372+0000","last_fullsized":"2023-05-10T01:24:20.447372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431691+0000","last_change":"2023-05-10T01:24:20.043700+0000","last_active":"2023-05-10T01:24:20.431691+0000","last_peered":"2023-05-10T01:24:20.431691+0000","last_clean":"2023-05-10T01:24:20.431691+0000","last_became_active":"2023-05-10T01:24:20.043173+0000","last_became_peered":"2023-05-10T01:24:20.043173+0000","last_unstale":"2023-05-10T01:24:20.431691+0000","last_undegraded":"2023-05-10T01:24:20.431691+0000","last_fullsized":"2023-05-10T01:24:20.431691+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463316+0000","last_change":"2023-05-10T01:24:20.458201+0000","last_active":"2023-05-10T01:24:20.463316+0000","last_peered":"2023-05-10T01:24:20.463316+0000","last_clean":"2023-05-10T01:24:20.463316+0000","last_became_active":"2023-05-10T01:24:20.457952+0000","last_became_peered":"2023-05-10T01:24:20.457952+0000","last_unstale":"2023-05-10T01:24:20.463316+0000","last_undegraded":"2023-05-10T01:24:20.463316+0000","last_fullsized":"2023-05-10T01:24:20.463316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.426330+0000","last_change":"2023-05-10T01:24:20.041698+0000","last_active":"2023-05-10T01:24:20.426330+0000","last_peered":"2023-05-10T01:24:20.426330+0000","last_clean":"2023-05-10T01:24:20.426330+0000","last_became_active":"2023-05-10T01:24:20.040755+0000","last_became_peered":"2023-05-10T01:24:20.040755+0000","last_unstale":"2023-05-10T01:24:20.426330+0000","last_undegraded":"2023-05-10T01:24:20.426330+0000","last_fullsized":"2023-05-10T01:24:20.426330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459739+0000","last_change":"2023-05-10T01:24:20.454958+0000","last_active":"2023-05-10T01:24:20.459739+0000","last_peered":"2023-05-10T01:24:20.459739+0000","last_clean":"2023-05-10T01:24:20.459739+0000","last_became_active":"2023-05-10T01:24:20.454675+0000","last_became_peered":"2023-05-10T01:24:20.454675+0000","last_unstale":"2023-05-10T01:24:20.459739+0000","last_undegraded":"2023-05-10T01:24:20.459739+0000","last_fullsized":"2023-05-10T01:24:20.459739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441534+0000","last_change":"2023-05-10T01:24:20.050023+0000","last_active":"2023-05-10T01:24:20.441534+0000","last_peered":"2023-05-10T01:24:20.441534+0000","last_clean":"2023-05-10T01:24:20.441534+0000","last_became_active":"2023-05-10T01:24:20.049754+0000","last_became_peered":"2023-05-10T01:24:20.049754+0000","last_unstale":"2023-05-10T01:24:20.441534+0000","last_undegraded":"2023-05-10T01:24:20.441534+0000","last_fullsized":"2023-05-10T01:24:20.441534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.454768+0000","last_change":"2023-05-10T01:24:20.453355+0000","last_active":"2023-05-10T01:24:20.454768+0000","last_peered":"2023-05-10T01:24:20.454768+0000","last_clean":"2023-05-10T01:24:20.454768+0000","last_became_active":"2023-05-10T01:24:20.453115+0000","last_became_peered":"2023-05-10T01:24:20.453115+0000","last_unstale":"2023-05-10T01:24:20.454768+0000","last_undegraded":"2023-05-10T01:24:20.454768+0000","last_fullsized":"2023-05-10T01:24:20.454768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428883+0000","last_change":"2023-05-10T01:24:20.041343+0000","last_active":"2023-05-10T01:24:20.428883+0000","last_peered":"2023-05-10T01:24:20.428883+0000","last_clean":"2023-05-10T01:24:20.428883+0000","last_became_active":"2023-05-10T01:24:20.038912+0000","last_became_peered":"2023-05-10T01:24:20.038912+0000","last_unstale":"2023-05-10T01:24:20.428883+0000","last_undegraded":"2023-05-10T01:24:20.428883+0000","last_fullsized":"2023-05-10T01:24:20.428883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444934+0000","last_change":"2023-05-10T01:24:20.443970+0000","last_active":"2023-05-10T01:24:20.444934+0000","last_peered":"2023-05-10T01:24:20.444934+0000","last_clean":"2023-05-10T01:24:20.444934+0000","last_became_active":"2023-05-10T01:24:20.443676+0000","last_became_peered":"2023-05-10T01:24:20.443676+0000","last_unstale":"2023-05-10T01:24:20.444934+0000","last_undegraded":"2023-05-10T01:24:20.444934+0000","last_fullsized":"2023-05-10T01:24:20.444934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.429727+0000","last_change":"2023-05-10T01:24:20.042742+0000","last_active":"2023-05-10T01:24:20.429727+0000","last_peered":"2023-05-10T01:24:20.429727+0000","last_clean":"2023-05-10T01:24:20.429727+0000","last_became_active":"2023-05-10T01:24:20.042142+0000","last_became_peered":"2023-05-10T01:24:20.042142+0000","last_unstale":"2023-05-10T01:24:20.429727+0000","last_undegraded":"2023-05-10T01:24:20.429727+0000","last_fullsized":"2023-05-10T01:24:20.429727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.445126+0000","last_change":"2023-05-10T01:24:20.443260+0000","last_active":"2023-05-10T01:24:20.445126+0000","last_peered":"2023-05-10T01:24:20.445126+0000","last_clean":"2023-05-10T01:24:20.445126+0000","last_became_active":"2023-05-10T01:24:20.442965+0000","last_became_peered":"2023-05-10T01:24:20.442965+0000","last_unstale":"2023-05-10T01:24:20.445126+0000","last_undegraded":"2023-05-10T01:24:20.445126+0000","last_fullsized":"2023-05-10T01:24:20.445126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.425642+0000","last_change":"2023-05-10T01:24:20.037675+0000","last_active":"2023-05-10T01:24:20.425642+0000","last_peered":"2023-05-10T01:24:20.425642+0000","last_clean":"2023-05-10T01:24:20.425642+0000","last_became_active":"2023-05-10T01:24:20.037033+0000","last_became_peered":"2023-05-10T01:24:20.037033+0000","last_unstale":"2023-05-10T01:24:20.425642+0000","last_undegraded":"2023-05-10T01:24:20.425642+0000","last_fullsized":"2023-05-10T01:24:20.425642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.461220+0000","last_change":"2023-05-10T01:24:20.454458+0000","last_active":"2023-05-10T01:24:20.461220+0000","last_peered":"2023-05-10T01:24:20.461220+0000","last_clean":"2023-05-10T01:24:20.461220+0000","last_became_active":"2023-05-10T01:24:20.454146+0000","last_became_peered":"2023-05-10T01:24:20.454146+0000","last_unstale":"2023-05-10T01:24:20.461220+0000","last_undegraded":"2023-05-10T01:24:20.461220+0000","last_fullsized":"2023-05-10T01:24:20.461220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.442875+0000","last_change":"2023-05-10T01:24:20.039258+0000","last_active":"2023-05-10T01:24:20.442875+0000","last_peered":"2023-05-10T01:24:20.442875+0000","last_clean":"2023-05-10T01:24:20.442875+0000","last_became_active":"2023-05-10T01:24:20.039004+0000","last_became_peered":"2023-05-10T01:24:20.039004+0000","last_unstale":"2023-05-10T01:24:20.442875+0000","last_undegraded":"2023-05-10T01:24:20.442875+0000","last_fullsized":"2023-05-10T01:24:20.442875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.425792+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:20.425792+0000","last_peered":"2023-05-10T01:24:20.425792+0000","last_clean":"2023-05-10T01:24:20.425792+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:20.425792+0000","last_undegraded":"2023-05-10T01:24:20.425792+0000","last_fullsized":"2023-05-10T01:24:20.425792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459163+0000","last_change":"2023-05-10T01:24:20.454422+0000","last_active":"2023-05-10T01:24:20.459163+0000","last_peered":"2023-05-10T01:24:20.459163+0000","last_clean":"2023-05-10T01:24:20.459163+0000","last_became_active":"2023-05-10T01:24:20.454203+0000","last_became_peered":"2023-05-10T01:24:20.454203+0000","last_unstale":"2023-05-10T01:24:20.459163+0000","last_undegraded":"2023-05-10T01:24:20.459163+0000","last_fullsized":"2023-05-10T01:24:20.459163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431226+0000","last_change":"2023-05-10T01:24:20.041801+0000","last_active":"2023-05-10T01:24:20.431226+0000","last_peered":"2023-05-10T01:24:20.431226+0000","last_clean":"2023-05-10T01:24:20.431226+0000","last_became_active":"2023-05-10T01:24:20.041469+0000","last_became_peered":"2023-05-10T01:24:20.041469+0000","last_unstale":"2023-05-10T01:24:20.431226+0000","last_undegraded":"2023-05-10T01:24:20.431226+0000","last_fullsized":"2023-05-10T01:24:20.431226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.435402+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:20.435402+0000","last_peered":"2023-05-10T01:24:20.435402+0000","last_clean":"2023-05-10T01:24:20.435402+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:20.435402+0000","last_undegraded":"2023-05-10T01:24:20.435402+0000","last_fullsized":"2023-05-10T01:24:20.435402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.447643+0000","last_change":"2023-05-10T01:24:20.442436+0000","last_active":"2023-05-10T01:24:20.447643+0000","last_peered":"2023-05-10T01:24:20.447643+0000","last_clean":"2023-05-10T01:24:20.447643+0000","last_became_active":"2023-05-10T01:24:20.442122+0000","last_became_peered":"2023-05-10T01:24:20.442122+0000","last_unstale":"2023-05-10T01:24:20.447643+0000","last_undegraded":"2023-05-10T01:24:20.447643+0000","last_fullsized":"2023-05-10T01:24:20.447643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.435303+0000","last_change":"2023-05-10T01:24:20.051426+0000","last_active":"2023-05-10T01:24:20.435303+0000","last_peered":"2023-05-10T01:24:20.435303+0000","last_clean":"2023-05-10T01:24:20.435303+0000","last_became_active":"2023-05-10T01:24:20.051181+0000","last_became_peered":"2023-05-10T01:24:20.051181+0000","last_unstale":"2023-05-10T01:24:20.435303+0000","last_undegraded":"2023-05-10T01:24:20.435303+0000","last_fullsized":"2023-05-10T01:24:20.435303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.431784+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:20.431784+0000","last_peered":"2023-05-10T01:24:20.431784+0000","last_clean":"2023-05-10T01:24:20.431784+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:20.431784+0000","last_undegraded":"2023-05-10T01:24:20.431784+0000","last_fullsized":"2023-05-10T01:24:20.431784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.459768+0000","last_change":"2023-05-10T01:24:20.449951+0000","last_active":"2023-05-10T01:24:20.459768+0000","last_peered":"2023-05-10T01:24:20.459768+0000","last_clean":"2023-05-10T01:24:20.459768+0000","last_became_active":"2023-05-10T01:24:20.449732+0000","last_became_peered":"2023-05-10T01:24:20.449732+0000","last_unstale":"2023-05-10T01:24:20.459768+0000","last_undegraded":"2023-05-10T01:24:20.459768+0000","last_fullsized":"2023-05-10T01:24:20.459768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428479+0000","last_change":"2023-05-10T01:24:20.048065+0000","last_active":"2023-05-10T01:24:20.428479+0000","last_peered":"2023-05-10T01:24:20.428479+0000","last_clean":"2023-05-10T01:24:20.428479+0000","last_became_active":"2023-05-10T01:24:20.047211+0000","last_became_peered":"2023-05-10T01:24:20.047211+0000","last_unstale":"2023-05-10T01:24:20.428479+0000","last_undegraded":"2023-05-10T01:24:20.428479+0000","last_fullsized":"2023-05-10T01:24:20.428479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.434935+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:20.434935+0000","last_peered":"2023-05-10T01:24:20.434935+0000","last_clean":"2023-05-10T01:24:20.434935+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:20.434935+0000","last_undegraded":"2023-05-10T01:24:20.434935+0000","last_fullsized":"2023-05-10T01:24:20.434935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441155+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:20.441155+0000","last_peered":"2023-05-10T01:24:20.441155+0000","last_clean":"2023-05-10T01:24:20.441155+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:20.441155+0000","last_undegraded":"2023-05-10T01:24:20.441155+0000","last_fullsized":"2023-05-10T01:24:20.441155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.440378+0000","last_change":"2023-05-10T01:24:20.437212+0000","last_active":"2023-05-10T01:24:20.440378+0000","last_peered":"2023-05-10T01:24:20.440378+0000","last_clean":"2023-05-10T01:24:20.440378+0000","last_became_active":"2023-05-10T01:24:20.436615+0000","last_became_peered":"2023-05-10T01:24:20.436615+0000","last_unstale":"2023-05-10T01:24:20.440378+0000","last_undegraded":"2023-05-10T01:24:20.440378+0000","last_fullsized":"2023-05-10T01:24:20.440378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452262+0000","last_change":"2023-05-10T01:24:20.039528+0000","last_active":"2023-05-10T01:24:20.452262+0000","last_peered":"2023-05-10T01:24:20.452262+0000","last_clean":"2023-05-10T01:24:20.452262+0000","last_became_active":"2023-05-10T01:24:20.039224+0000","last_became_peered":"2023-05-10T01:24:20.039224+0000","last_unstale":"2023-05-10T01:24:20.452262+0000","last_undegraded":"2023-05-10T01:24:20.452262+0000","last_fullsized":"2023-05-10T01:24:20.452262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.441247+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:20.441247+0000","last_peered":"2023-05-10T01:24:20.441247+0000","last_clean":"2023-05-10T01:24:20.441247+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:20.441247+0000","last_undegraded":"2023-05-10T01:24:20.441247+0000","last_fullsized":"2023-05-10T01:24:20.441247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460951+0000","last_change":"2023-05-10T01:24:20.456847+0000","last_active":"2023-05-10T01:24:20.460951+0000","last_peered":"2023-05-10T01:24:20.460951+0000","last_clean":"2023-05-10T01:24:20.460951+0000","last_became_active":"2023-05-10T01:24:20.456275+0000","last_became_peered":"2023-05-10T01:24:20.456275+0000","last_unstale":"2023-05-10T01:24:20.460951+0000","last_undegraded":"2023-05-10T01:24:20.460951+0000","last_fullsized":"2023-05-10T01:24:20.460951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.457872+0000","last_change":"2023-05-10T01:24:20.044460+0000","last_active":"2023-05-10T01:24:20.457872+0000","last_peered":"2023-05-10T01:24:20.457872+0000","last_clean":"2023-05-10T01:24:20.457872+0000","last_became_active":"2023-05-10T01:24:20.044178+0000","last_became_peered":"2023-05-10T01:24:20.044178+0000","last_unstale":"2023-05-10T01:24:20.457872+0000","last_undegraded":"2023-05-10T01:24:20.457872+0000","last_fullsized":"2023-05-10T01:24:20.457872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.445036+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:20.445036+0000","last_peered":"2023-05-10T01:24:20.445036+0000","last_clean":"2023-05-10T01:24:20.445036+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:20.445036+0000","last_undegraded":"2023-05-10T01:24:20.445036+0000","last_fullsized":"2023-05-10T01:24:20.445036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.460760+0000","last_change":"2023-05-10T01:24:20.456245+0000","last_active":"2023-05-10T01:24:20.460760+0000","last_peered":"2023-05-10T01:24:20.460760+0000","last_clean":"2023-05-10T01:24:20.460760+0000","last_became_active":"2023-05-10T01:24:20.455951+0000","last_became_peered":"2023-05-10T01:24:20.455951+0000","last_unstale":"2023-05-10T01:24:20.460760+0000","last_undegraded":"2023-05-10T01:24:20.460760+0000","last_fullsized":"2023-05-10T01:24:20.460760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.444835+0000","last_change":"2023-05-10T01:24:20.051881+0000","last_active":"2023-05-10T01:24:20.444835+0000","last_peered":"2023-05-10T01:24:20.444835+0000","last_clean":"2023-05-10T01:24:20.444835+0000","last_became_active":"2023-05-10T01:24:20.051631+0000","last_became_peered":"2023-05-10T01:24:20.051631+0000","last_unstale":"2023-05-10T01:24:20.444835+0000","last_undegraded":"2023-05-10T01:24:20.444835+0000","last_fullsized":"2023-05-10T01:24:20.444835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.427232+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:20.427232+0000","last_peered":"2023-05-10T01:24:20.427232+0000","last_clean":"2023-05-10T01:24:20.427232+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:20.427232+0000","last_undegraded":"2023-05-10T01:24:20.427232+0000","last_fullsized":"2023-05-10T01:24:20.427232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.463289+0000","last_change":"2023-05-10T01:24:20.456478+0000","last_active":"2023-05-10T01:24:20.463289+0000","last_peered":"2023-05-10T01:24:20.463289+0000","last_clean":"2023-05-10T01:24:20.463289+0000","last_became_active":"2023-05-10T01:24:20.456221+0000","last_became_peered":"2023-05-10T01:24:20.456221+0000","last_unstale":"2023-05-10T01:24:20.463289+0000","last_undegraded":"2023-05-10T01:24:20.463289+0000","last_fullsized":"2023-05-10T01:24:20.463289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:20.019186+0000","last_clean_scrub_stamp":"2023-05-10T01:24:20.019186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.428909+0000","last_change":"2023-05-10T01:24:20.042277+0000","last_active":"2023-05-10T01:24:20.428909+0000","last_peered":"2023-05-10T01:24:20.428909+0000","last_clean":"2023-05-10T01:24:20.428909+0000","last_became_active":"2023-05-10T01:24:20.041885+0000","last_became_peered":"2023-05-10T01:24:20.041885+0000","last_unstale":"2023-05-10T01:24:20.428909+0000","last_undegraded":"2023-05-10T01:24:20.428909+0000","last_fullsized":"2023-05-10T01:24:20.428909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:19.017602+0000","last_clean_scrub_stamp":"2023-05-10T01:24:19.017602+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-05-10T01:24:20.452551+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:20.452551+0000","last_peered":"2023-05-10T01:24:20.452551+0000","last_clean":"2023-05-10T01:24:20.452551+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:20.452551+0000","last_undegraded":"2023-05-10T01:24:20.452551+0000","last_fullsized":"2023-05-10T01:24:20.452551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575024,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17028,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94354812,"statfs":{"total":96636764160,"available":96619327488,"internally_reserved":0,"allocated":978944,"data_stored":483989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.437},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.379}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.504},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16380,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94355460,"statfs":{"total":96636764160,"available":96619991040,"internally_reserved":0,"allocated":970752,"data_stored":483007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16264,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355576,"statfs":{"total":96636764160,"available":96620109824,"internally_reserved":0,"allocated":983040,"data_stored":483729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.253},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.28499999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575023,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16120,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94355720,"statfs":{"total":96636764160,"available":96620257280,"internally_reserved":0,"allocated":966656,"data_stored":482973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.317},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.28100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.498},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.621},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.51100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575023,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17472,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94354368,"statfs":{"total":96636764160,"available":96618872832,"internally_reserved":0,"allocated":974848,"data_stored":483597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.72499999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.622}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24512,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":23552,"kb_avail":94347328,"statfs":{"total":96636764160,"available":96611663872,"internally_reserved":0,"allocated":974848,"data_stored":483597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24117248},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.307},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.627},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.77700000000000002}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16640,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":15680,"kb_avail":94355200,"statfs":{"total":96636764160,"available":96619724800,"internally_reserved":0,"allocated":974848,"data_stored":483617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16056320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.40400000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575025,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19968,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94351872,"statfs":{"total":96636764160,"available":96616316928,"internally_reserved":0,"allocated":974848,"data_stored":483887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":1.716},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":1.946}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":2.0449999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":1.615}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.31900000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.502}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":1.4550000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":1.5740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:24:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:24:29.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:24:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.463+0000 7f1f672f1700 1 Processor -- start 2023-05-10T01:24:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 -- start start 2023-05-10T01:24:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f60154080 0x7f1f600aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f600a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f600c94c0 con 0x7f1f600aa140 2023-05-10T01:24:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600aa5b0 con 0x7f1f60154080 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f672f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600cb7d0 con 0x7f1f60154460 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.464+0000 7f1f6508d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f60154080 0x7f1f600aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f60154080 0x7f1f600aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34966/0 (socket says 172.21.15.52:34966) 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 -- 172.21.15.52:0/3750827211 learned_addr learned my addr 172.21.15.52:0/3750827211 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6488c700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f600a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 -- 172.21.15.52:0/3750827211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 msgr2=0x7f1f600a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f600a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 -- 172.21.15.52:0/3750827211 >> v1:172.21.15.172:6789/0 conn(0x7f1f600aa140 legacy=0x7f1f60068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 -- 172.21.15.52:0/3750827211 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600c88b0 con 0x7f1f60154080 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f6508d700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f600aac90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f1f58009f20 tx=0x7f1f58009840).ready entity=mon.0 client_cookie=f2eb68c2aeab9b08 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f5ffff700 1 -- 172.21.15.52:0/3750827211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800e070 con 0x7f1f60154080 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f5ffff700 1 -- 172.21.15.52:0/3750827211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5800ba80 con 0x7f1f60154080 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.465+0000 7f1f5ffff700 1 -- 172.21.15.52:0/3750827211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800be00 con 0x7f1f60154080 2023-05-10T01:24:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 -- 172.21.15.52:0/3750827211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 msgr2=0x7f1f600aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f600aac90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f1f58009f20 tx=0x7f1f58009840).stop 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 -- 172.21.15.52:0/3750827211 shutdown_connections 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f600aac90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 --2- 172.21.15.52:0/3750827211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f600a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 -- 172.21.15.52:0/3750827211 >> 172.21.15.52:0/3750827211 conn(0x7f1f60067910 msgr2=0x7f1f600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 -- 172.21.15.52:0/3750827211 shutdown_connections 2023-05-10T01:24:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.466+0000 7f1f672f1700 1 -- 172.21.15.52:0/3750827211 wait complete. 2023-05-10T01:24:29.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.467+0000 7f1f672f1700 1 Processor -- start 2023-05-10T01:24:29.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.467+0000 7f1f672f1700 1 -- start start 2023-05-10T01:24:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f600aa140 0x7f1f60156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f60168290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600ae970 con 0x7f1f60154080 2023-05-10T01:24:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601554b0 con 0x7f1f600aa140 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600aec10 con 0x7f1f60154460 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34974/0 (socket says 172.21.15.52:34974) 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 -- 172.21.15.52:0/2121437590 learned_addr learned my addr 172.21.15.52:0/2121437590 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6508d700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f600aa140 0x7f1f60156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6588e700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f60168290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 -- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 msgr2=0x7f1f60168290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f60168290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 -- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f600aa140 msgr2=0x7f1f60156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f600aa140 0x7f1f60156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 -- 172.21.15.52:0/2121437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009ae0 con 0x7f1f60154080 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f6488c700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f1f5400d890 tx=0x7f1f54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011590 con 0x7f1f60154080 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540116f0 con 0x7f1f60154080 2023-05-10T01:24:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.468+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f600aeef0 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.469+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54011a70 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.469+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f60155160 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.469+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60066720 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.470+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1f5401c460 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.470+0000 7f1f5d7fa700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 0x7f1f40061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.470+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f1f54079a90 con 0x7f1f60154080 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.470+0000 7f1f6508d700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 0x7f1f40061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.471+0000 7f1f6508d700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 0x7f1f40061220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1f5800ba50 tx=0x7f1f58009840).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.474+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f5404aec0 con 0x7f1f60154080 2023-05-10T01:24:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.715+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1f6006c340 con 0x7f1f60154080 2023-05-10T01:24:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.719+0000 7f1f5d7fa700 1 -- 172.21.15.52:0/2121437590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1f54011e60 con 0x7f1f60154080 2023-05-10T01:24:29.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 msgr2=0x7f1f40061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 0x7f1f40061220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1f5800ba50 tx=0x7f1f58009840).stop 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 msgr2=0x7f1f601571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f1f5400d890 tx=0x7f1f54008040).stop 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 shutdown_connections 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1f4005ed60 0x7f1f40061220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f60154460 0x7f1f60168290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f600aa140 0x7f1f60156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 --2- 172.21.15.52:0/2121437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f60154080 0x7f1f601571c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 >> 172.21.15.52:0/2121437590 conn(0x7f1f60067910 msgr2=0x7f1f60153220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 shutdown_connections 2023-05-10T01:24:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.721+0000 7f1f672f1700 1 -- 172.21.15.52:0/2121437590 wait complete. 2023-05-10T01:24:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:24:29.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.850+0000 7f2477da3700 1 Processor -- start 2023-05-10T01:24:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.850+0000 7f2477da3700 1 -- start start 2023-05-10T01:24:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 0x7f24700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154540 0x7f24700c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2470069690 0x7f2470069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700c0650 con 0x7f2470069690 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247006a010 con 0x7f2470154160 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2477da3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700bfd20 con 0x7f2470154540 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2476340700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2470069690 0x7f2470069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2476340700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2470069690 0x7f2470069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34980/0 (socket says 172.21.15.52:34980) 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.851+0000 7f2476340700 1 -- 172.21.15.52:0/3290832640 learned_addr learned my addr 172.21.15.52:0/3290832640 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2475b3f700 1 --2- 172.21.15.52:0/3290832640 >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 0x7f24700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f247533e700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154540 0x7f24700c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 -- 172.21.15.52:0/3290832640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154540 msgr2=0x7f24700c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154540 0x7f24700c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 -- 172.21.15.52:0/3290832640 >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 msgr2=0x7f24700c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 --2- 172.21.15.52:0/3290832640 >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 0x7f24700c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 -- 172.21.15.52:0/3290832640 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700c0000 con 0x7f2470069690 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2475b3f700 1 --2- 172.21.15.52:0/3290832640 >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 0x7f24700c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2476340700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f2470069b20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2470083020 tx=0x7f2460009840).ready entity=mon.0 client_cookie=4ea05b8649319fa1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2474b3d700 1 -- 172.21.15.52:0/3290832640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000e070 con 0x7f2470069690 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2474b3d700 1 -- 172.21.15.52:0/3290832640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000ba50 con 0x7f2470069690 2023-05-10T01:24:29.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2474b3d700 1 -- 172.21.15.52:0/3290832640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000bdd0 con 0x7f2470069690 2023-05-10T01:24:29.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2477da3700 1 -- 172.21.15.52:0/3290832640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 msgr2=0x7f2470069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.852+0000 7f2477da3700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f2470069b20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2470083020 tx=0x7f2460009840).stop 2023-05-10T01:24:29.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 -- 172.21.15.52:0/3290832640 shutdown_connections 2023-05-10T01:24:29.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f2470069b20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 --2- 172.21.15.52:0/3290832640 >> v2:172.21.15.172:3300/0 conn(0x7f2470154160 0x7f24700c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 --2- 172.21.15.52:0/3290832640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154540 0x7f24700c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 -- 172.21.15.52:0/3290832640 >> 172.21.15.52:0/3290832640 conn(0x7f24700cb6f0 msgr2=0x7f24700c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:29.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 -- 172.21.15.52:0/3290832640 shutdown_connections 2023-05-10T01:24:29.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.853+0000 7f2477da3700 1 -- 172.21.15.52:0/3290832640 wait complete. 2023-05-10T01:24:29.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.854+0000 7f2477da3700 1 Processor -- start 2023-05-10T01:24:29.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.854+0000 7f2477da3700 1 -- start start 2023-05-10T01:24:29.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154160 0x7f2470167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 0x7f2470167760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2470163cc0 con 0x7f2470069690 2023-05-10T01:24:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c3900 con 0x7f2470154540 2023-05-10T01:24:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2470167dc0 con 0x7f2470154160 2023-05-10T01:24:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34984/0 (socket says 172.21.15.52:34984) 2023-05-10T01:24:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 -- 172.21.15.52:0/3706387447 learned_addr learned my addr 172.21.15.52:0/3706387447 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f247533e700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154160 0x7f2470167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2476340700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 0x7f2470167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 -- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154160 msgr2=0x7f2470167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154160 0x7f2470167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 -- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 msgr2=0x7f2470167760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 0x7f2470167760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:29.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 -- 172.21.15.52:0/3706387447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009ae0 con 0x7f2470069690 2023-05-10T01:24:29.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2476340700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 0x7f2470167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:29.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2475b3f700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f246800c880 tx=0x7f2468008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468010580 con 0x7f2470069690 2023-05-10T01:24:29.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680106e0 con 0x7f2470069690 2023-05-10T01:24:29.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468010a60 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.855+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24701680a0 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.856+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700adf00 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.856+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700b0da0 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.857+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f246801b460 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.857+0000 7f246dffb700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 0x7f2450061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.857+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f2468079d50 con 0x7f2470069690 2023-05-10T01:24:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.857+0000 7f247533e700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 0x7f2450061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:29.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.858+0000 7f247533e700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 0x7f2450061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f247015b210 tx=0x7f2464008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:29.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:29.861+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f246804b180 con 0x7f2470069690 2023-05-10T01:24:30.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.075+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24700666b0 con 0x7f2470069690 2023-05-10T01:24:30.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.075+0000 7f246dffb700 1 -- 172.21.15.52:0/3706387447 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f246804e7a0 con 0x7f2470069690 2023-05-10T01:24:30.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:30.078 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:30.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 msgr2=0x7f2450061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 0x7f2450061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f247015b210 tx=0x7f2464008040).stop 2023-05-10T01:24:30.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 msgr2=0x7f247015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f246800c880 tx=0x7f2468008040).stop 2023-05-10T01:24:30.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 shutdown_connections 2023-05-10T01:24:30.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f245005ed90 0x7f2450061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470154540 0x7f2470167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470069690 0x7f247015a690 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 --2- 172.21.15.52:0/3706387447 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2470154160 0x7f2470167270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 >> 172.21.15.52:0/3706387447 conn(0x7f24700cb6f0 msgr2=0x7f247014e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 shutdown_connections 2023-05-10T01:24:30.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.077+0000 7f2477da3700 1 -- 172.21.15.52:0/3706387447 wait complete. 2023-05-10T01:24:30.082 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:30.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:24:20.422217+0000', 'modified': '2023-05-10T01:24:23.426686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6216}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6216': {'gid': 6216, 'name': 'd', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/2321787937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6835', 'nonce': 2321787937}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2321787937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:24:30.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:24:30.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-10T01:24:30.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.618+0000 7f0a5a600700 1 Processor -- start 2023-05-10T01:24:30.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.618+0000 7f0a5a600700 1 -- start start 2023-05-10T01:24:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a5a600700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a54069740 0x7f0a54069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a5a600700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a540aab30 0x7f0a540c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a5a600700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5406a910 con 0x7f0a540c5f60 2023-05-10T01:24:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a5a600700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540c65e0 con 0x7f0a540aab30 2023-05-10T01:24:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a5a600700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540bfa20 con 0x7f0a54069740 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a58dfd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a540aab30 0x7f0a540c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a59dff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0a540c5f60 0x7f0a54153af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44010/0 (socket says 172.21.15.52:44010) 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.619+0000 7f0a59dff700 1 -- 172.21.15.52:0/131891740 learned_addr learned my addr 172.21.15.52:0/131891740 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a595fe700 1 --2- 172.21.15.52:0/131891740 >> v2:172.21.15.172:3300/0 conn(0x7f0a54069740 0x7f0a54069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a43fff700 1 -- 172.21.15.52:0/131891740 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762119398 0 0) 0x7f0a5406a910 con 0x7f0a540c5f60 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a43fff700 1 -- 172.21.15.52:0/131891740 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a3c0033f0 con 0x7f0a540c5f60 2023-05-10T01:24:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a58dfd700 1 -- 172.21.15.52:0/131891740 >> v2:172.21.15.172:3300/0 conn(0x7f0a54069740 msgr2=0x7f0a54069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/131891740 >> v2:172.21.15.172:3300/0 conn(0x7f0a54069740 0x7f0a54069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a58dfd700 1 -- 172.21.15.52:0/131891740 >> v1:172.21.15.52:6789/0 conn(0x7f0a540c5f60 legacy=0x7f0a54153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a58dfd700 1 -- 172.21.15.52:0/131891740 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540c6390 con 0x7f0a540aab30 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/131891740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a540c5a70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f0a540c74c0 tx=0x7f0a44009060).ready entity=mon.0 client_cookie=914a57208a153178 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a43fff700 1 -- 172.21.15.52:0/131891740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400d4a0 con 0x7f0a540aab30 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a43fff700 1 -- 172.21.15.52:0/131891740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4400d600 con 0x7f0a540aab30 2023-05-10T01:24:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.620+0000 7f0a43fff700 1 -- 172.21.15.52:0/131891740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400d980 con 0x7f0a540aab30 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 -- 172.21.15.52:0/131891740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 msgr2=0x7f0a540c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 --2- 172.21.15.52:0/131891740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a540c5a70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f0a540c74c0 tx=0x7f0a44009060).stop 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 -- 172.21.15.52:0/131891740 shutdown_connections 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 --2- 172.21.15.52:0/131891740 >> v2:172.21.15.172:3300/0 conn(0x7f0a54069740 0x7f0a54069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 --2- 172.21.15.52:0/131891740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a540c5a70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 -- 172.21.15.52:0/131891740 >> 172.21.15.52:0/131891740 conn(0x7f0a540cb540 msgr2=0x7f0a540c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 -- 172.21.15.52:0/131891740 shutdown_connections 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.621+0000 7f0a5a600700 1 -- 172.21.15.52:0/131891740 wait complete. 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.622+0000 7f0a5a600700 1 Processor -- start 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.622+0000 7f0a5a600700 1 -- start start 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a54069740 0x7f0a540acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a540c5f60 0x7f0a54144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54144d50 con 0x7f0a540aab30 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a540ada70 con 0x7f0a540c5f60 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a540adcc0 con 0x7f0a54069740 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34998/0 (socket says 172.21.15.52:34998) 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2499524128 learned_addr learned my addr 172.21.15.52:0/2499524128 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a59dff700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a540c5f60 0x7f0a54144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a54069740 0x7f0a540acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a54069740 msgr2=0x7f0a540acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a54069740 0x7f0a540acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a540c5f60 msgr2=0x7f0a54144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a540c5f60 0x7f0a54144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2499524128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440092a0 con 0x7f0a540aab30 2023-05-10T01:24:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f0a44010000 tx=0x7f0a44016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a417fa700 1 -- 172.21.15.52:0/2499524128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400dd40 con 0x7f0a540aab30 2023-05-10T01:24:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a417fa700 1 -- 172.21.15.52:0/2499524128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4400d770 con 0x7f0a540aab30 2023-05-10T01:24:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.623+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a540adfa0 con 0x7f0a540aab30 2023-05-10T01:24:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.624+0000 7f0a417fa700 1 -- 172.21.15.52:0/2499524128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400dea0 con 0x7f0a540aab30 2023-05-10T01:24:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.624+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a540ae560 con 0x7f0a540aab30 2023-05-10T01:24:30.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.625+0000 7f0a417fa700 1 -- 172.21.15.52:0/2499524128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0a4400f070 con 0x7f0a540aab30 2023-05-10T01:24:30.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.625+0000 7f0a417fa700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 0x7f0a34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.625+0000 7f0a417fa700 1 -- 172.21.15.52:0/2499524128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0a4407b360 con 0x7f0a540aab30 2023-05-10T01:24:30.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.625+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 0x7f0a34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.626+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 0x7f0a34061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0a50009bc0 tx=0x7f0a50008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.627+0000 7f0a6d1f4b80 1 Processor -- start 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.627+0000 7f0a6d1f4b80 1 -- start start 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c81a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 0x5628a8c599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c1f5e0 con 0x5628a8c54450 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8b968a0 con 0x5628a8ca2210 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628a8bab900 con 0x5628a8c595e0 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35006/0 (socket says 172.21.15.52:35006) 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a59dff700 1 -- 172.21.15.52:0/3995770281 learned_addr learned my addr 172.21.15.52:0/3995770281 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a595fe700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c81a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.628+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 0x5628a8c599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 -- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 msgr2=0x5628a8c81a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c81a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 -- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 msgr2=0x5628a8c599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 0x5628a8c599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 -- 172.21.15.52:0/3995770281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a8a4e310 con 0x5628a8c54450 2023-05-10T01:24:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 0x5628a8c599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a59dff700 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f0a4c001c00 tx=0x7f0a4c009040).ready entity=mon.0 client_cookie=37f6c048f1b9acce server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a3a7fc700 1 -- 172.21.15.52:0/3995770281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0020f0 con 0x5628a8c54450 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a3a7fc700 1 -- 172.21.15.52:0/3995770281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c005d10 con 0x5628a8c54450 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a3a7fc700 1 -- 172.21.15.52:0/3995770281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00e880 con 0x5628a8c54450 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/3995770281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 msgr2=0x5628a8c548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f0a4c001c00 tx=0x7f0a4c009040).stop 2023-05-10T01:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/3995770281 shutdown_connections 2023-05-10T01:24:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c54450 0x5628a8c548d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c81a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/3995770281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8ca2210 0x5628a8c599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.629+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/3995770281 >> 172.21.15.52:0/3995770281 conn(0x5628a8a16e40 msgr2=0x5628a8ca26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.630+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/3995770281 shutdown_connections 2023-05-10T01:24:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.630+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/3995770281 wait complete. 2023-05-10T01:24:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.630+0000 7f0a6d1f4b80 1 -- start start 2023-05-10T01:24:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.630+0000 7f0a6d1f4b80 1 Processor -- start 2023-05-10T01:24:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c7c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c98c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8b72ed0 con 0x5628a8ca2210 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c99100 con 0x5628a8c54450 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628a8cafe70 con 0x5628a8c595e0 2023-05-10T01:24:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a6d1f4b80 10 client.0 ll_register_callbacks cb 0x5628a8c193c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35014/0 (socket says 172.21.15.52:35014) 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a59dff700 1 -- 172.21.15.52:0/1223898546 learned_addr learned my addr 172.21.15.52:0/1223898546 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c7c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c98c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.631+0000 7f0a59dff700 1 -- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 msgr2=0x5628a8c98c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c98c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a59dff700 1 -- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 msgr2=0x5628a8c7c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c7c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a59dff700 1 -- 172.21.15.52:0/1223898546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c00f040 con 0x5628a8ca2210 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c7c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f0a4c001af0 tx=0x7f0a4c017000).ready entity=mon.0 client_cookie=77c5506d1732c99b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00e7a0 con 0x5628a8ca2210 2023-05-10T01:24:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0a4c020d90 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628a8c517e0 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c00ee40 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 10 client.6387 fetch_fsmap learned FSMap version 30 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5628a8ba4880 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628a8c517e0 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a4c004a30 con 0x5628a8ca2210 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 10 client.6387 fetch_fsmap finished waiting for FSMap version 30 2023-05-10T01:24:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 10 client.6387 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:24:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 20 client.6387 populate_metadata read hostname 'smithi052' 2023-05-10T01:24:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8cae140 0x5628a8c79b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 4 client.6387 mds_command: new command op to 6216 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:24:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.632+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 --> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628a8a12ca0 con 0x5628a8cae140 2023-05-10T01:24:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.633+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8cae140 0x5628a8c79b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.633+0000 7f0a2f7fe700 10 client.6387 ms_handle_connect on v2:172.21.15.172:6835/2321787937 2023-05-10T01:24:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.633+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8cae140 0x5628a8c79b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=931a88d019b05e8f server_cookie=9c843615e5e75073 in_seq=0 out_seq=0 2023-05-10T01:24:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/1223898546 <== mds.0 v2:172.21.15.172:6835/2321787937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5628a8a12ca0 con 0x5628a8cae140 2023-05-10T01:24:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a2f7fe700 10 client.6387 handle_command_reply: tid=0 2023-05-10T01:24:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 client.6387 shutdown 2023-05-10T01:24:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 msgr2=0x5628a8caf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f0a4c001af0 tx=0x7f0a4c017000).stop 2023-05-10T01:24:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 shutdown_connections 2023-05-10T01:24:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8cae140 0x5628a8c79b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8caf150 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a2f7fe700 0 client.6387 ms_handle_reset on v2:172.21.15.172:6835/2321787937 2023-05-10T01:24:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c7c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1223898546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c595e0 0x5628a8c98c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 >> 172.21.15.52:0/1223898546 conn(0x5628a8a16e40 msgr2=0x5628a8c5b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 shutdown_connections 2023-05-10T01:24:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1223898546 wait complete. 2023-05-10T01:24:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.634+0000 7f0a6d1f4b80 20 client.6387 trim_cache size 0 max 16384 2023-05-10T01:24:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 Processor -- start 2023-05-10T01:24:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 -- start start 2023-05-10T01:24:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 0x5628a8c81760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 0x5628a8c5b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c7b610 con 0x5628a8ca2210 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c9e7c0 con 0x5628a8c595e0 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.651+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c58b40 con 0x5628a8c54450 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35022/0 (socket says 172.21.15.52:35022) 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 -- 172.21.15.52:0/1301134978 learned_addr learned my addr 172.21.15.52:0/1301134978 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 0x5628a8c81760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 0x5628a8c5b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 -- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 msgr2=0x5628a8c81760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 0x5628a8c81760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 -- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 msgr2=0x5628a8c5b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 0x5628a8c5b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 -- 172.21.15.52:0/1301134978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a8ba0070 con 0x5628a8ca2210 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a595fe700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 0x5628a8c81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 0x5628a8c5b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a59dff700 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0a4c001780 tx=0x7f0a4c01d000).ready entity=mon.0 client_cookie=e77bd92049ebe2d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a3affd700 1 -- 172.21.15.52:0/1301134978 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c02e070 con 0x5628a8ca2210 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a3affd700 1 -- 172.21.15.52:0/1301134978 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c007c20 con 0x5628a8ca2210 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.652+0000 7f0a3affd700 1 -- 172.21.15.52:0/1301134978 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00ee40 con 0x5628a8ca2210 2023-05-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1301134978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 msgr2=0x5628a8c53860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0a4c001780 tx=0x7f0a4c01d000).stop 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1301134978 shutdown_connections 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8ca2210 0x5628a8c53860 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8c54450 0x5628a8c81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/1301134978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c595e0 0x5628a8c5b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1301134978 >> 172.21.15.52:0/1301134978 conn(0x5628a8a16e40 msgr2=0x5628a8c55a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1301134978 shutdown_connections 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/1301134978 wait complete. 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 -- start start 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.653+0000 7f0a6d1f4b80 1 Processor -- start 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8ca2210 0x5628a8c54830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c88680 con 0x5628a8c595e0 2023-05-10T01:24:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c7a490 con 0x5628a8c54450 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628a8c557a0 con 0x5628a8ca2210 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a6d1f4b80 10 client.0 ll_register_callbacks cb 0x5628a8c193c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a58dfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a58dfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35026/0 (socket says 172.21.15.52:35026) 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2728883488 learned_addr learned my addr 172.21.15.52:0/2728883488 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.654+0000 7f0a59dff700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8ca2210 0x5628a8c54830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8ca2210 msgr2=0x5628a8c54830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8ca2210 0x5628a8c54830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 msgr2=0x5628a8c79ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c79ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 -- 172.21.15.52:0/2728883488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628a8ba4880 con 0x5628a8c595e0 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a58dfd700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f0a44006aa0 tx=0x7f0a4407b040).ready entity=mon.0 client_cookie=f79764e40a67a602 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44018e00 con 0x5628a8c595e0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a4c005d10 con 0x5628a8c595e0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0a4400d8e0 con 0x5628a8c595e0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4404cbc0 con 0x5628a8c595e0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 10 client.6393 fetch_fsmap learned FSMap version 30 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5628a8b9fdc0 con 0x5628a8c595e0 2023-05-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c005d10 con 0x5628a8c595e0 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a4404f9a0 con 0x5628a8c595e0 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 10 client.6393 fetch_fsmap finished waiting for FSMap version 30 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 10 client.6393 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 20 client.6393 populate_metadata read hostname 'smithi052' 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8c54d20 0x5628a8c55100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 4 client.6393 mds_command: new command op to 6216 tid=0[{"prefix": "status"}] 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.655+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 --> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5628a8a49ca0 con 0x5628a8c54d20 2023-05-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8c54d20 0x5628a8c55100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a2f7fe700 10 client.6393 ms_handle_connect on v2:172.21.15.172:6835/2321787937 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a595fe700 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8c54d20 0x5628a8c55100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d3c39274ca7d9e87 server_cookie=f2e93e8a9270bed6 in_seq=0 out_seq=0 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a2f7fe700 1 -- 172.21.15.52:0/2728883488 <== mds.0 v2:172.21.15.172:6835/2321787937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5628a8a49ca0 con 0x5628a8c54d20 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a2f7fe700 10 client.6393 handle_command_reply: tid=0 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 client.6393 shutdown 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 msgr2=0x5628a8c79fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f0a44006aa0 tx=0x7f0a4407b040).stop 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 shutdown_connections 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:6835/2321787937,v1:172.21.15.172:6837/2321787937] conn(0x5628a8c54d20 0x5628a8c55100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5628a8ca2210 0x5628a8c54830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628a8c54450 0x5628a8c79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a2f7fe700 0 client.6393 ms_handle_reset on v2:172.21.15.172:6835/2321787937 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 --2- 172.21.15.52:0/2728883488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628a8c595e0 0x5628a8c79fa0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 >> 172.21.15.52:0/2728883488 conn(0x5628a8a16e40 msgr2=0x5628a8c53860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 shutdown_connections 2023-05-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 1 -- 172.21.15.52:0/2728883488 wait complete. 2023-05-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.656+0000 7f0a6d1f4b80 20 client.6393 trim_cache size 0 max 16384 2023-05-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6216, 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.232509374999999, 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 30, 2023-05-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 80, 2023-05-10T01:24:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 80, 2023-05-10T01:24:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 14.822622381 2023-05-10T01:24:30.680 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 msgr2=0x7f0a34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 0x7f0a34061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0a50009bc0 tx=0x7f0a50008040).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 msgr2=0x7f0a54144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f0a44010000 tx=0x7f0a44016000).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 shutdown_connections 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0a3405ed90 0x7f0a34061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a540c5f60 0x7f0a54144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a54069740 0x7f0a540acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 --2- 172.21.15.52:0/2499524128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a540aab30 0x7f0a54144370 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 >> 172.21.15.52:0/2499524128 conn(0x7f0a540cb540 msgr2=0x7f0a540c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 shutdown_connections 2023-05-10T01:24:30.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.657+0000 7f0a5a600700 1 -- 172.21.15.52:0/2499524128 wait complete. 2023-05-10T01:24:30.684 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:24:30.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.791+0000 7f4e4da61700 1 Processor -- start 2023-05-10T01:24:30.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.791+0000 7f4e4da61700 1 -- start start 2023-05-10T01:24:30.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4da61700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e480c1450 0x7f4e480a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4da61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e481545a0 0x7f4e48064a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4da61700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e48154a50 con 0x7f4e480aa0f0 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4da61700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e48154d30 con 0x7f4e480c1450 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4da61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48155010 con 0x7f4e481545a0 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e480c1450 0x7f4e480a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e480c1450 0x7f4e480a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35032/0 (socket says 172.21.15.52:35032) 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 -- 172.21.15.52:0/3413250767 learned_addr learned my addr 172.21.15.52:0/3413250767 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e47fff700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e481545a0 0x7f4e48064a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 -- 172.21.15.52:0/3413250767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e481545a0 msgr2=0x7f4e48064a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e481545a0 0x7f4e48064a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 -- 172.21.15.52:0/3413250767 >> v1:172.21.15.172:6789/0 conn(0x7f4e480aa0f0 legacy=0x7f4e48157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 -- 172.21.15.52:0/3413250767 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e481552f0 con 0x7f4e480c1450 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e4ca5f700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480a9c00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f4e3c006fd0 tx=0x7f4e3c0090f0).ready entity=mon.0 client_cookie=724c0610f1163166 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.792+0000 7f4e477fe700 1 -- 172.21.15.52:0/3413250767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00b600 con 0x7f4e480c1450 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e477fe700 1 -- 172.21.15.52:0/3413250767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00b760 con 0x7f4e480c1450 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e477fe700 1 -- 172.21.15.52:0/3413250767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00bae0 con 0x7f4e480c1450 2023-05-10T01:24:30.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 -- 172.21.15.52:0/3413250767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 msgr2=0x7f4e480a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480a9c00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f4e3c006fd0 tx=0x7f4e3c0090f0).stop 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 -- 172.21.15.52:0/3413250767 shutdown_connections 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480a9c00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 --2- 172.21.15.52:0/3413250767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e481545a0 0x7f4e48064a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 -- 172.21.15.52:0/3413250767 >> 172.21.15.52:0/3413250767 conn(0x7f4e480cb5f0 msgr2=0x7f4e480c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 -- 172.21.15.52:0/3413250767 shutdown_connections 2023-05-10T01:24:30.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.793+0000 7f4e4da61700 1 -- 172.21.15.52:0/3413250767 wait complete. 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.794+0000 7f4e4da61700 1 Processor -- start 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.794+0000 7f4e4da61700 1 -- start start 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e480aa0f0 0x7f4e48146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 0x7f4e480c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c9330 con 0x7f4e480c1450 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c3a00 con 0x7f4e481545a0 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4da61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c3ca0 con 0x7f4e480aa0f0 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e47fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e47fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35040/0 (socket says 172.21.15.52:35040) 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e47fff700 1 -- 172.21.15.52:0/1425978996 learned_addr learned my addr 172.21.15.52:0/1425978996 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4ca5f700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e480aa0f0 0x7f4e48146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.795+0000 7f4e4d260700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 0x7f4e480c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 -- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e480aa0f0 msgr2=0x7f4e48146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e480aa0f0 0x7f4e48146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 -- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 msgr2=0x7f4e480c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 0x7f4e480c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 -- 172.21.15.52:0/1425978996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c009370 con 0x7f4e480c1450 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e4d260700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 0x7f4e480c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e47fff700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f4e3400c650 tx=0x7f4e34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34010580 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e340106e0 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e480c3f80 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34010a60 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.796+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e480c4540 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.797+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e480834e0 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.797+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e3401b460 con 0x7f4e480c1450 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.798+0000 7f4e44ff9700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 0x7f4e30061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:30.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.798+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f4e34079c30 con 0x7f4e480c1450 2023-05-10T01:24:30.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.798+0000 7f4e4ca5f700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 0x7f4e30061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:30.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.799+0000 7f4e4ca5f700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 0x7f4e30061280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4e3c009130 tx=0x7f4e3c017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:30.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:30.802+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e3404b060 con 0x7f4e480c1450 2023-05-10T01:24:31.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.018+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e4805ef90 con 0x7f4e480c1450 2023-05-10T01:24:31.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.019+0000 7f4e44ff9700 1 -- 172.21.15.52:0/1425978996 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e3404e680 con 0x7f4e480c1450 2023-05-10T01:24:31.022 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:24:31.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.020+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 msgr2=0x7f4e30061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.020+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 0x7f4e30061280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4e3c009130 tx=0x7f4e3c017000).stop 2023-05-10T01:24:31.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.020+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 msgr2=0x7f4e480c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.020+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f4e3400c650 tx=0x7f4e34008040).stop 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 shutdown_connections 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e3005edc0 0x7f4e30061280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e481545a0 0x7f4e480c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e480aa0f0 0x7f4e48146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 --2- 172.21.15.52:0/1425978996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e480c1450 0x7f4e480c8950 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 >> 172.21.15.52:0/1425978996 conn(0x7f4e480cb5f0 msgr2=0x7f4e48064a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 shutdown_connections 2023-05-10T01:24:31.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.021+0000 7f4e4da61700 1 -- 172.21.15.52:0/1425978996 wait complete. 2023-05-10T01:24:31.034 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:24:31.035 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:24:31.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:24:31.036 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:24:31.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:24:31.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:24:31.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:24:31.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:24:31.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:24:31.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.041 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:24:31.057 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:24:31.057 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:24:31.058 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41365sec preferred_lft 41365sec 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:24:31.059 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:24:31.060 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:24:31.061 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:24:31.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.062 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:24:31.120 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:24:31.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.123 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:24:31.179 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:24:31.180 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:24:31.180 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:24:31.180 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:24:31.181 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:24:31.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.182 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:24:31.183 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:24:31.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:24:31.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:24:31.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:24:31.185 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:24:31.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.281 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:24:31.295 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:24:31.295 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:24:31.295 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:24:31.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:24:31.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.359 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:24:31.414 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:24:31.414 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:24:31.493 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:24:31.493 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:24:31.540 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:24:31.541 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:24:31.543 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:24:31.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:31.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:24:31.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:24:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.763+0000 7f123faf7700 1 Processor -- start 2023-05-10T01:24:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.763+0000 7f123faf7700 1 -- start start 2023-05-10T01:24:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123faf7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1238069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123faf7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1238069b80 0x7f12380c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123faf7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380c0650 con 0x7f1238154160 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123faf7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123806a010 con 0x7f1238069b80 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123faf7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380bfd20 con 0x7f1238154540 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123d893700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1238154160 0x7f12380c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44068/0 (socket says 172.21.15.52:44068) 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123d893700 1 -- 172.21.15.52:0/3151954701 learned_addr learned my addr 172.21.15.52:0/3151954701 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123e094700 1 --2- 172.21.15.52:0/3151954701 >> v2:172.21.15.172:3300/0 conn(0x7f1238069b80 0x7f12380c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123d092700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1238069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435545726 0 0) 0x7f12380c0650 con 0x7f1238154160 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12200033f0 con 0x7f1238154160 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959237032 0 0) 0x7f12200033f0 con 0x7f1238154160 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 msgr2=0x7f1238069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1238069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 >> v2:172.21.15.172:3300/0 conn(0x7f1238069b80 msgr2=0x7f12380c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 --2- 172.21.15.52:0/3151954701 >> v2:172.21.15.172:3300/0 conn(0x7f1238069b80 0x7f12380c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380c0000 con 0x7f1238154160 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f1234001470 con 0x7f1238154160 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 >> v1:172.21.15.52:6789/0 conn(0x7f1238154160 legacy=0x7f12380c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.764+0000 7f123c891700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12200038e0 0x7f1220003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1220004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1220004b80 0x7f1220005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123806a010 con 0x7f1220004b80 2023-05-10T01:24:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12380bfd20 con 0x7f12200038e0 2023-05-10T01:24:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122000b8e0 con 0x7f1238154540 2023-05-10T01:24:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1220004b80 0x7f1220005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123d893700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12200038e0 0x7f1220003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123d092700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1220004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 -- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 msgr2=0x7f1220004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1220004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 -- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12200038e0 msgr2=0x7f1220003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12200038e0 0x7f1220003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 -- 172.21.15.52:0/3151954701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200033f0 con 0x7f1220004b80 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123d092700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1238154540 0x7f1220004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123e094700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1220004b80 0x7f1220005000 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f123000e210 tx=0x7f123000b040).ready entity=mon.0 client_cookie=e823a53057d91020 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.765+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230009ac0 con 0x7f1220004b80 2023-05-10T01:24:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000f040 con 0x7f1220004b80 2023-05-10T01:24:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123c891700 1 -- 172.21.15.52:0/3151954701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000ecd0 con 0x7f1220004b80 2023-05-10T01:24:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 -- 172.21.15.52:0/3151954701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1220004b80 msgr2=0x7f1220005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 --2- 172.21.15.52:0/3151954701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1220004b80 0x7f1220005000 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f123000e210 tx=0x7f123000b040).stop 2023-05-10T01:24:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123e094700 1 -- 172.21.15.52:0/3151954701 reap_dead start 2023-05-10T01:24:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 -- 172.21.15.52:0/3151954701 shutdown_connections 2023-05-10T01:24:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 -- 172.21.15.52:0/3151954701 >> 172.21.15.52:0/3151954701 conn(0x7f12380cb740 msgr2=0x7f12380c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 -- 172.21.15.52:0/3151954701 shutdown_connections 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.766+0000 7f123faf7700 1 -- 172.21.15.52:0/3151954701 wait complete. 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.767+0000 7f123faf7700 1 Processor -- start 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.767+0000 7f123faf7700 1 -- start start 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 0x7f12380af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1238156bf0 0x7f12380c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12380c2220 con 0x7f1238164fc0 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1238157170 con 0x7f1238156bf0 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123faf7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1238157450 con 0x7f12380af470 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35066/0 (socket says 172.21.15.52:35066) 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 -- 172.21.15.52:0/2939907051 learned_addr learned my addr 172.21.15.52:0/2939907051 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:31.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123d893700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 0x7f12380af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123d092700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1238156bf0 0x7f12380c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 -- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 msgr2=0x7f12380af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 0x7f12380af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 -- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1238156bf0 msgr2=0x7f12380c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1238156bf0 0x7f12380c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 -- 172.21.15.52:0/2939907051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238157730 con 0x7f1238164fc0 2023-05-10T01:24:31.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123d893700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 0x7f12380af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.768+0000 7f123e094700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f1230014000 tx=0x7f123001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.769+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230009ac0 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.769+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230013c20 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.769+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238157a10 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.769+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123001d400 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.769+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238165420 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.770+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12380666b0 con 0x7f1238164fc0 2023-05-10T01:24:31.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.770+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f123001d7b0 con 0x7f1238164fc0 2023-05-10T01:24:31.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.770+0000 7f1225ffb700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 0x7f1218061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:31.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.770+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f123007b500 con 0x7f1238164fc0 2023-05-10T01:24:31.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.771+0000 7f123d893700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 0x7f1218061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:31.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.771+0000 7f123d893700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 0x7f1218061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1234001120 tx=0x7f1234009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:31.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.774+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f123004c990 con 0x7f1238164fc0 2023-05-10T01:24:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.975+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f123806c340 con 0x7f121805ed90 2023-05-10T01:24:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.977+0000 7f1225ffb700 1 -- 172.21.15.52:0/2939907051 <== mgr.5372 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f123806c340 con 0x7f121805ed90 2023-05-10T01:24:31.982 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:24:31.983 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:31.983 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:24:31.983 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:31.983 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:24:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 msgr2=0x7f1218061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 0x7f1218061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1234001120 tx=0x7f1234009040).stop 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 msgr2=0x7f12381529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f1230014000 tx=0x7f123001a000).stop 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 shutdown_connections 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f121805ed90 0x7f1218061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238164fc0 0x7f12381529a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12380af470 0x7f12380af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 --2- 172.21.15.52:0/2939907051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1238156bf0 0x7f12380c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 >> 172.21.15.52:0/2939907051 conn(0x7f12380cb740 msgr2=0x7f12380acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 shutdown_connections 2023-05-10T01:24:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:31.979+0000 7f123faf7700 1 -- 172.21.15.52:0/2939907051 wait complete. 2023-05-10T01:24:31.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:24:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.110+0000 7f66f855e700 1 Processor -- start 2023-05-10T01:24:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 -- start start 2023-05-10T01:24:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 0x7f66f00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66f0068150 0x7f66f0068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00c94c0 con 0x7f66f0154460 2023-05-10T01:24:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f00cb7d0 con 0x7f66f0068150 2023-05-10T01:24:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.111+0000 7f66f855e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0068a60 con 0x7f66f0154080 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66f0068150 0x7f66f0068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f5af9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66f0154460 0x7f66f00a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44088/0 (socket says 172.21.15.52:44088) 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66f0068150 0x7f66f0068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35072/0 (socket says 172.21.15.52:35072) 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f5af9700 1 -- 172.21.15.52:0/976404489 learned_addr learned my addr 172.21.15.52:0/976404489 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f62fa700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 0x7f66f00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 -- 172.21.15.52:0/976404489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 msgr2=0x7f66f00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 0x7f66f00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 -- 172.21.15.52:0/976404489 >> v1:172.21.15.52:6789/0 conn(0x7f66f0154460 legacy=0x7f66f00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 -- 172.21.15.52:0/976404489 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00c88b0 con 0x7f66f0068150 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f62fa700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 0x7f66f00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f6afb700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0068150 0x7f66f0068570 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f66e0009e60 tx=0x7f66e0009780).ready entity=mon.0 client_cookie=a7ca26ad723caff4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f52f8700 1 -- 172.21.15.52:0/976404489 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e000e070 con 0x7f66f0068150 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f52f8700 1 -- 172.21.15.52:0/976404489 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e000bc30 con 0x7f66f0068150 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.112+0000 7f66f52f8700 1 -- 172.21.15.52:0/976404489 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0012410 con 0x7f66f0068150 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 -- 172.21.15.52:0/976404489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0068150 msgr2=0x7f66f0068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0068150 0x7f66f0068570 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f66e0009e60 tx=0x7f66e0009780).stop 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 -- 172.21.15.52:0/976404489 shutdown_connections 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0068150 0x7f66f0068570 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 --2- 172.21.15.52:0/976404489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154080 0x7f66f00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 -- 172.21.15.52:0/976404489 >> 172.21.15.52:0/976404489 conn(0x7f66f0067910 msgr2=0x7f66f00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 -- 172.21.15.52:0/976404489 shutdown_connections 2023-05-10T01:24:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.113+0000 7f66f855e700 1 -- 172.21.15.52:0/976404489 wait complete. 2023-05-10T01:24:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.114+0000 7f66f855e700 1 Processor -- start 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.114+0000 7f66f855e700 1 -- start start 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f0068150 0x7f66f0144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154460 0x7f66f0164900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01679b0 con 0x7f66f0154080 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0167f70 con 0x7f66f0068150 2023-05-10T01:24:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0164ea0 con 0x7f66f0154460 2023-05-10T01:24:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35078/0 (socket says 172.21.15.52:35078) 2023-05-10T01:24:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 -- 172.21.15.52:0/4134007538 learned_addr learned my addr 172.21.15.52:0/4134007538 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f62fa700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f0068150 0x7f66f0144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f6afb700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154460 0x7f66f0164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 -- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154460 msgr2=0x7f66f0164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154460 0x7f66f0164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 -- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f0068150 msgr2=0x7f66f0144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f0068150 0x7f66f0144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 -- 172.21.15.52:0/4134007538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009a20 con 0x7f66f0154080 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f5af9700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f66e400c470 tx=0x7f66e4007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ce10 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40072e0 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0165180 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40057a0 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.115+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f014fac0 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.117+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f0066720 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.117+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f66e4010070 con 0x7f66f0154080 2023-05-10T01:24:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.117+0000 7f66ee7fc700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 0x7f66d0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.117+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f66e4078ff0 con 0x7f66f0154080 2023-05-10T01:24:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.117+0000 7f66f62fa700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 0x7f66d0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.118+0000 7f66f62fa700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 0x7f66d0061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f66e8006fd0 tx=0x7f66e8008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.121+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66e404a480 con 0x7f66f0154080 2023-05-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.342+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f66f0168100 con 0x7f66f0154080 2023-05-10T01:24:32.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.836+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f66e4076de0 con 0x7f66f0154080 2023-05-10T01:24:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.838+0000 7f66ee7fc700 1 -- 172.21.15.52:0/4134007538 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7f66e4075c80 con 0x7f66f0154080 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 msgr2=0x7f66d0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 0x7f66d0061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f66e8006fd0 tx=0x7f66e8008040).stop 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 msgr2=0x7f66f0164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f66e400c470 tx=0x7f66e4007d50).stop 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 shutdown_connections 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66d005ed90 0x7f66d0061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66f0154460 0x7f66f0164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f0068150 0x7f66f0144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 --2- 172.21.15.52:0/4134007538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66f0154080 0x7f66f0164410 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 >> 172.21.15.52:0/4134007538 conn(0x7f66f0067910 msgr2=0x7f66f00c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:32.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 shutdown_connections 2023-05-10T01:24:32.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.840+0000 7f66f855e700 1 -- 172.21.15.52:0/4134007538 wait complete. 2023-05-10T01:24:32.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:24:32.978 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:32.975+0000 7f672bebe680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:32.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.979+0000 7f6cf7cc7700 1 Processor -- start 2023-05-10T01:24:32.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.979+0000 7f6cf7cc7700 1 -- start start 2023-05-10T01:24:32.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf7cc7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cf0154080 0x7f6cf00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf7cc7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6cf0154460 0x7f6cf00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf7cc7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00c94c0 con 0x7f6cf00aa140 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf7cc7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00aa590 con 0x7f6cf0154080 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf7cc7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00cb7d0 con 0x7f6cf0154460 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf5a63700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cf0154080 0x7f6cf00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf5a63700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cf0154080 0x7f6cf00aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35110/0 (socket says 172.21.15.52:35110) 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf6264700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6cf00aa140 0x7f6cf0068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44128/0 (socket says 172.21.15.52:44128) 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.980+0000 7f6cf5a63700 1 -- 172.21.15.52:0/3671336313 learned_addr learned my addr 172.21.15.52:0/3671336313 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5262700 1 --2- 172.21.15.52:0/3671336313 >> v2:172.21.15.172:3300/0 conn(0x7f6cf0154460 0x7f6cf00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5a63700 1 -- 172.21.15.52:0/3671336313 >> v2:172.21.15.172:3300/0 conn(0x7f6cf0154460 msgr2=0x7f6cf00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5a63700 1 --2- 172.21.15.52:0/3671336313 >> v2:172.21.15.172:3300/0 conn(0x7f6cf0154460 0x7f6cf00a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5a63700 1 -- 172.21.15.52:0/3671336313 >> v1:172.21.15.52:6789/0 conn(0x7f6cf00aa140 legacy=0x7f6cf0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf4a61700 1 -- 172.21.15.52:0/3671336313 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135493337 0 0) 0x7f6cf00c94c0 con 0x7f6cf00aa140 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5a63700 1 -- 172.21.15.52:0/3671336313 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00c88b0 con 0x7f6cf0154080 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf5a63700 1 --2- 172.21.15.52:0/3671336313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154080 0x7f6cf00aac90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6cf0084310 tx=0x7f6cec0090f0).ready entity=mon.0 client_cookie=fa3855fea84e2b83 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf4a61700 1 -- 172.21.15.52:0/3671336313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00b520 con 0x7f6cf0154080 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf4a61700 1 -- 172.21.15.52:0/3671336313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec00b680 con 0x7f6cf0154080 2023-05-10T01:24:32.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.981+0000 7f6cf4a61700 1 -- 172.21.15.52:0/3671336313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00ba00 con 0x7f6cf0154080 2023-05-10T01:24:32.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/3671336313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154080 msgr2=0x7f6cf00aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/3671336313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154080 0x7f6cf00aac90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6cf0084310 tx=0x7f6cec0090f0).stop 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/3671336313 shutdown_connections 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/3671336313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154080 0x7f6cf00aac90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/3671336313 >> v2:172.21.15.172:3300/0 conn(0x7f6cf0154460 0x7f6cf00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/3671336313 >> 172.21.15.52:0/3671336313 conn(0x7f6cf0067910 msgr2=0x7f6cf00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:32.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/3671336313 shutdown_connections 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.982+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/3671336313 wait complete. 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.983+0000 7f6cf7cc7700 1 Processor -- start 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.983+0000 7f6cf7cc7700 1 -- start start 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 0x7f6cf014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 0x7f6cf00b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00b0bd0 con 0x7f6cf0154460 2023-05-10T01:24:32.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00ade00 con 0x7f6cf0154080 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0157110 con 0x7f6cf00aa140 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35118/0 (socket says 172.21.15.52:35118) 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 -- 172.21.15.52:0/2966647951 learned_addr learned my addr 172.21.15.52:0/2966647951 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf5262700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 0x7f6cf00b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf5a63700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 0x7f6cf014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:32.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 -- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 msgr2=0x7f6cf014c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 0x7f6cf014c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 -- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 msgr2=0x7f6cf00b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 0x7f6cf00b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 -- 172.21.15.52:0/2966647951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009370 con 0x7f6cf0154460 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf5a63700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 0x7f6cf014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf5262700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 0x7f6cf00b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:32.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf6264700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f6ce800c7e0 tx=0x7f6ce8007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:32.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8005c70 con 0x7f6cf0154460 2023-05-10T01:24:32.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8005dd0 con 0x7f6cf0154460 2023-05-10T01:24:32.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf0156870 con 0x7f6cf0154460 2023-05-10T01:24:32.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.984+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8007320 con 0x7f6cf0154460 2023-05-10T01:24:32.993 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:32.985+0000 7f30f6d31680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:32.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.985+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf0156e30 con 0x7f6cf0154460 2023-05-10T01:24:32.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.985+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf00adbd0 con 0x7f6cf0154460 2023-05-10T01:24:32.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.986+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f6ce8010030 con 0x7f6cf0154460 2023-05-10T01:24:32.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.987+0000 7f6ce1ffb700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 0x7f6cd00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:32.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.987+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f6ce8079a80 con 0x7f6cf0154460 2023-05-10T01:24:32.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.987+0000 7f6cf5a63700 1 -- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 msgr2=0x7f6cd00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:32.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.987+0000 7f6cf5a63700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 0x7f6cd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:32.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:32.991+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6cf00adbd0 con 0x7f6cf0154460 2023-05-10T01:24:33.042 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:33.039+0000 7f672bebe680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:33.054 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:33.052+0000 7f30f6d31680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:33.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.164+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6cf00adbd0 con 0x7f6cf0154460 2023-05-10T01:24:33.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.168+0000 7f6ce1ffb700 1 -- 172.21.15.52:0/2966647951 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6cf00adbd0 con 0x7f6cf0154460 2023-05-10T01:24:33.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 msgr2=0x7f6cd00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 0x7f6cd00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 msgr2=0x7f6cf00b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f6ce800c7e0 tx=0x7f6ce8007f60).stop 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 shutdown_connections 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6cd005ede0 0x7f6cd00612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cf0154460 0x7f6cf00b06e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6cf00aa140 0x7f6cf014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 --2- 172.21.15.52:0/2966647951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf0154080 0x7f6cf00b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 >> 172.21.15.52:0/2966647951 conn(0x7f6cf0067910 msgr2=0x7f6cf014e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:33.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 shutdown_connections 2023-05-10T01:24:33.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.170+0000 7f6cf7cc7700 1 -- 172.21.15.52:0/2966647951 wait complete. 2023-05-10T01:24:33.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:33.186 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:24:33.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-10T01:24:33.313 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:33.310+0000 7f672bebe680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:33.344 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:33.342+0000 7f30f6d31680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.365+0000 7f1e80ce9700 1 Processor -- start 2023-05-10T01:24:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.365+0000 7f1e80ce9700 1 -- start start 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e80ce9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e7c064a40 0x7f1e7c068a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e80ce9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1e7c155830 0x7f1e7c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e80ce9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c069c50 con 0x7f1e7c06a0e0 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e80ce9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c135370 con 0x7f1e7c064a40 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e80ce9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c156170 con 0x7f1e7c155830 2023-05-10T01:24:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e7c064a40 0x7f1e7c068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e7c064a40 0x7f1e7c068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35156/0 (socket says 172.21.15.52:35156) 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e79d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e7c06a0e0 0x7f1e7c066480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44172/0 (socket says 172.21.15.52:44172) 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 -- 172.21.15.52:0/1284513070 learned_addr learned my addr 172.21.15.52:0/1284513070 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7ad9d700 1 --2- 172.21.15.52:0/1284513070 >> v2:172.21.15.172:3300/0 conn(0x7f1e7c155830 0x7f1e7c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 -- 172.21.15.52:0/1284513070 >> v2:172.21.15.172:3300/0 conn(0x7f1e7c155830 msgr2=0x7f1e7c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/1284513070 >> v2:172.21.15.172:3300/0 conn(0x7f1e7c155830 0x7f1e7c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 -- 172.21.15.52:0/1284513070 >> v1:172.21.15.52:6789/0 conn(0x7f1e7c06a0e0 legacy=0x7f1e7c066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 -- 172.21.15.52:0/1284513070 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c069040 con 0x7f1e7c064a40 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/1284513070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c064a40 0x7f1e7c068a60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f1e7c0c3a80 tx=0x7f1e6c0090f0).ready entity=mon.0 client_cookie=9da3863cbef871e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7959a700 1 -- 172.21.15.52:0/1284513070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00d4a0 con 0x7f1e7c064a40 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7959a700 1 -- 172.21.15.52:0/1284513070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00d600 con 0x7f1e7c064a40 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.366+0000 7f1e7959a700 1 -- 172.21.15.52:0/1284513070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00d980 con 0x7f1e7c064a40 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 -- 172.21.15.52:0/1284513070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c064a40 msgr2=0x7f1e7c068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 --2- 172.21.15.52:0/1284513070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c064a40 0x7f1e7c068a60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f1e7c0c3a80 tx=0x7f1e6c0090f0).stop 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 -- 172.21.15.52:0/1284513070 shutdown_connections 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 --2- 172.21.15.52:0/1284513070 >> v2:172.21.15.172:3300/0 conn(0x7f1e7c155830 0x7f1e7c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 --2- 172.21.15.52:0/1284513070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c064a40 0x7f1e7c068a60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 -- 172.21.15.52:0/1284513070 >> 172.21.15.52:0/1284513070 conn(0x7f1e7c0c4610 msgr2=0x7f1e7c066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 -- 172.21.15.52:0/1284513070 shutdown_connections 2023-05-10T01:24:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.367+0000 7f1e80ce9700 1 -- 172.21.15.52:0/1284513070 wait complete. 2023-05-10T01:24:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.368+0000 7f1e80ce9700 1 Processor -- start 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.368+0000 7f1e80ce9700 1 -- start start 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c064a40 0x7f1e7c0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e7c06a0e0 0x7f1e7c1613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c155830 0x7f1e7c1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c1201b0 con 0x7f1e7c155830 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c0120 con 0x7f1e7c064a40 2023-05-10T01:24:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e80ce9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c0400 con 0x7f1e7c06a0e0 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e7ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c155830 0x7f1e7c1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e7ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c155830 0x7f1e7c1618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35166/0 (socket says 172.21.15.52:35166) 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e7ad9d700 1 -- 172.21.15.52:0/850515137 learned_addr learned my addr 172.21.15.52:0/850515137 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c064a40 0x7f1e7c0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.369+0000 7f1e79d9b700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e7c06a0e0 0x7f1e7c1613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e7c06a0e0 msgr2=0x7f1e7c1613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e7c06a0e0 0x7f1e7c1613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c064a40 msgr2=0x7f1e7c0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c064a40 0x7f1e7c0acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009370 con 0x7f1e7c155830 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e7ad9d700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e7c155830 0x7f1e7c1618e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f1e74009df0 tx=0x7f1e7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400caa0 con 0x7f1e7c155830 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400f040 con 0x7f1e7c155830 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e80ce9700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c0c06e0 con 0x7f1e7c155830 2023-05-10T01:24:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400ce10 con 0x7f1e7c155830 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.370+0000 7f1e80ce9700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c0ad0e0 con 0x7f1e7c155830 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.371+0000 7f1e80ce9700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c120360 con 0x7f1e7c155830 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.371+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f1e74013610 con 0x7f1e7c155830 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.372+0000 7f1e6a7fc700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.372+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f1e7407a520 con 0x7f1e7c155830 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.372+0000 7f1e7a59c700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.372+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.376+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e7404b9b0 con 0x7f1e7c155830 2023-05-10T01:24:33.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.573+0000 7f1e7a59c700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:33.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.573+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:33.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.577+0000 7f1e80ce9700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e7c1333c0 con 0x7f1e5805ede0 2023-05-10T01:24:33.919 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:33.916+0000 7f672bebe680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:33.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.974+0000 7f1e7a59c700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:33.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:33.974+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:24:33.991 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:33.988+0000 7f672bebe680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:34.011 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.008+0000 7f30f6d31680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:34.079 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.077+0000 7f30f6d31680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:34.173 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.171+0000 7f672bebe680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:34.272 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.269+0000 7f30f6d31680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:34.587 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.585+0000 7f672bebe680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:34.689 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.686+0000 7f672bebe680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:34.709 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.706+0000 7f30f6d31680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:34.775+0000 7f1e7a59c700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:34.775+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:24:34.817 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.814+0000 7f30f6d31680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:34.841 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.838+0000 7f672bebe680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:34.914 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.911+0000 7f672bebe680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:34.975 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:34.972+0000 7f30f6d31680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:34.980 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:34.977+0000 7f672bebe680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:35.053 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:35.050+0000 7f30f6d31680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:35.123 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:35.121+0000 7f30f6d31680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:35.233 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:35.230+0000 7f672bebe680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:35.395 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:35.392+0000 7f30f6d31680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:35.413 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:35.411+0000 7f672bebe680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:35.583 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:35.581+0000 7f30f6d31680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:36.059 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.056+0000 7f672bebe680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:36.126 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.123+0000 7f672bebe680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:36.199 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.196+0000 7f672bebe680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:36.267 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.264+0000 7f30f6d31680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:36.337 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.335+0000 7f30f6d31680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:36.342 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.339+0000 7f672bebe680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:36.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:36.377+0000 7f1e7a59c700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:36.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:36.377+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:24:36.410 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.407+0000 7f672bebe680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:36.415 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.413+0000 7f30f6d31680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:36.527 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.524+0000 7f672bebe680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:36.570 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.567+0000 7f30f6d31680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:36.632 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.630+0000 7f672bebe680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:36.643 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.641+0000 7f30f6d31680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:36.764 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.761+0000 7f30f6d31680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:36.876 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:36.873+0000 7f30f6d31680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:36.919 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.916+0000 7f672bebe680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:36.988 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:36.985+0000 7f672bebe680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:37.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:37.056+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 26) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f1e74078310 con 0x7f1e7c155830 2023-05-10T01:24:37.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:37.056+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 msgr2=0x7f1e580612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:37.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:37.056+0000 7f1e6a7fc700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e580612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:37.119 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66a6e99700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.119 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66a6e99700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.119 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66a6e99700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.119 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66a6e99700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.119 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66a6e99700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.120 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66aa6a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.120 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66aa6a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.120 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66aa6a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.120 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66aa6a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.120 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:37.116+0000 7f66aa6a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:37.189 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:37.186+0000 7f30f6d31680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:37.262 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:37.260+0000 7f30f6d31680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.070+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f1e74078690 con 0x7f1e7c155830 2023-05-10T01:24:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.070+0000 7f1e6a7fc700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e5802fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.070+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e7c1333c0 con 0x7f1e5805ede0 2023-05-10T01:24:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.073+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e5802fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.074+0000 7f1e7a59c700 1 --2- 172.21.15.52:0/850515137 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1e5805ede0 0x7f1e5802fd40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1e6c009130 tx=0x7f1e6c016000).ready entity=mgr.5624 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:38.078 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:38.075+0000 7f66d9949700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-10T01:24:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.076+0000 7f1e6a7fc700 1 -- 172.21.15.52:0/850515137 <== mgr.5624 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f1e7c1333c0 con 0x7f1e5805ede0 2023-05-10T01:24:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-10T01:24:38.083 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-10T01:24:38.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:38.085 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:24:38.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:24:38.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.267+0000 7f6497e96700 1 Processor -- start 2023-05-10T01:24:38.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.267+0000 7f6497e96700 1 -- start start 2023-05-10T01:24:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6497e96700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f649006a0e0 0x7f6490150640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6497e96700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900c3120 con 0x7f6490154300 2023-05-10T01:24:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6497e96700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6490068530 con 0x7f64901546e0 2023-05-10T01:24:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6497e96700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6490154b10 con 0x7f649006a0e0 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6495431700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f649006a0e0 0x7f6490150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6495c32700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6490154300 0x7f649014ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44334/0 (socket says 172.21.15.52:44334) 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.268+0000 7f6495c32700 1 -- 172.21.15.52:0/2952626259 learned_addr learned my addr 172.21.15.52:0/2952626259 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6495431700 1 -- 172.21.15.52:0/2952626259 >> v1:172.21.15.172:6789/0 conn(0x7f64901546e0 legacy=0x7f64900c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6495431700 1 -- 172.21.15.52:0/2952626259 >> v1:172.21.15.52:6789/0 conn(0x7f6490154300 legacy=0x7f649014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6495431700 1 -- 172.21.15.52:0/2952626259 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900c2880 con 0x7f649006a0e0 2023-05-10T01:24:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6495431700 1 --2- 172.21.15.52:0/2952626259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f649006a0e0 0x7f6490150640 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6480009760 tx=0x7f6480009060).ready entity=mon.0 client_cookie=50951e5e19a63a6d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:38.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6494c30700 1 -- 172.21.15.52:0/2952626259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000b580 con 0x7f649006a0e0 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6494c30700 1 -- 172.21.15.52:0/2952626259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000b6e0 con 0x7f649006a0e0 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6494c30700 1 -- 172.21.15.52:0/2952626259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000ba60 con 0x7f649006a0e0 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6497e96700 1 -- 172.21.15.52:0/2952626259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f649006a0e0 msgr2=0x7f6490150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6497e96700 1 --2- 172.21.15.52:0/2952626259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f649006a0e0 0x7f6490150640 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6480009760 tx=0x7f6480009060).stop 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6497e96700 1 -- 172.21.15.52:0/2952626259 shutdown_connections 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6497e96700 1 --2- 172.21.15.52:0/2952626259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f649006a0e0 0x7f6490150640 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.269+0000 7f6497e96700 1 -- 172.21.15.52:0/2952626259 >> 172.21.15.52:0/2952626259 conn(0x7f64900c3d80 msgr2=0x7f64900c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.270+0000 7f6497e96700 1 -- 172.21.15.52:0/2952626259 shutdown_connections 2023-05-10T01:24:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.270+0000 7f6497e96700 1 -- 172.21.15.52:0/2952626259 wait complete. 2023-05-10T01:24:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.271+0000 7f6497e96700 1 Processor -- start 2023-05-10T01:24:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.271+0000 7f6497e96700 1 -- start start 2023-05-10T01:24:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649006a0e0 0x7f64901466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6490154300 0x7f64900a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490150dd0 con 0x7f64901546e0 2023-05-10T01:24:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900a7750 con 0x7f649006a0e0 2023-05-10T01:24:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6497e96700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900a7a30 con 0x7f6490154300 2023-05-10T01:24:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35326/0 (socket says 172.21.15.52:35326) 2023-05-10T01:24:38.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 -- 172.21.15.52:0/519691012 learned_addr learned my addr 172.21.15.52:0/519691012 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6495c32700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649006a0e0 0x7f64901466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6495431700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6490154300 0x7f64900a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 -- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6490154300 msgr2=0x7f64900a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6490154300 0x7f64900a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 -- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649006a0e0 msgr2=0x7f64901466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649006a0e0 0x7f64901466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 -- 172.21.15.52:0/519691012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800092a0 con 0x7f64901546e0 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f6496433700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f648c00c440 tx=0x7f648c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00ce40 con 0x7f64901546e0 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c00f470 con 0x7f64901546e0 2023-05-10T01:24:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.272+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00f7f0 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.273+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64900a7d10 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.273+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64900a71f0 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.274+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900a7f50 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.274+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 27) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f648c010070 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.274+0000 7f647dffb700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 0x7f6470061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.274+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f648c078fe0 con 0x7f64901546e0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.274+0000 7f6495c32700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 0x7f6470061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.275+0000 7f6495c32700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 0x7f6470061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6488001a90 tx=0x7f6488001560).ready entity=mgr.5624 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.278+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f648c0478f0 con 0x7f64901546e0 2023-05-10T01:24:38.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:38.500+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f649006c340 con 0x7f64901546e0 2023-05-10T01:24:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.075+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f648c076dd0 con 0x7f64901546e0 2023-05-10T01:24:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.076+0000 7f647dffb700 1 -- 172.21.15.52:0/519691012 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7f648c073730 con 0x7f64901546e0 2023-05-10T01:24:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.078+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 msgr2=0x7f6470061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.078+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 0x7f6470061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6488001a90 tx=0x7f6488001560).stop 2023-05-10T01:24:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.078+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 msgr2=0x7f64900a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.078+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f648c00c440 tx=0x7f648c007dd0).stop 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 shutdown_connections 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f647005ed40 0x7f6470061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901546e0 0x7f64900a4870 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649006a0e0 0x7f64901466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 --2- 172.21.15.52:0/519691012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6490154300 0x7f64900a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 >> 172.21.15.52:0/519691012 conn(0x7f64900c3d80 msgr2=0x7f64900bb770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 shutdown_connections 2023-05-10T01:24:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.079+0000 7f6497e96700 1 -- 172.21.15.52:0/519691012 wait complete. 2023-05-10T01:24:39.097 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:24:39.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:39.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:39.168 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:24:39.169 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:24:39.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:24:39.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:24:39.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:24:39.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:24:39.215 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:24:39.223 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:39.220+0000 7f64a5eed680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:39.226 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:39.224+0000 7fede243b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:24:39.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:39.284 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:39.282+0000 7f64a5eed680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:39.292 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:39.290+0000 7fede243b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:24:39.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.398+0000 7f4de98ef700 1 Processor -- start 2023-05-10T01:24:39.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.398+0000 7f4de98ef700 1 -- start start 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de98ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4de4154540 0x7f4de4069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de98ef700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40c0650 con 0x7f4de4069b80 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de98ef700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de4069fb0 con 0x7f4de4154160 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de98ef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40bfd20 con 0x7f4de4154540 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4de4154540 0x7f4de4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4de4154540 0x7f4de4069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35388/0 (socket says 172.21.15.52:35388) 2023-05-10T01:24:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 -- 172.21.15.52:0/4170815957 learned_addr learned my addr 172.21.15.52:0/4170815957 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de37fe700 1 --1- 172.21.15.52:0/4170815957 >> v1:172.21.15.52:6789/0 conn(0x7f4de4069b80 0x7f4de40c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44406/0 (socket says 172.21.15.52:44406) 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 -- 172.21.15.52:0/4170815957 >> v1:172.21.15.172:6789/0 conn(0x7f4de4154160 legacy=0x7f4de40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 -- 172.21.15.52:0/4170815957 >> v1:172.21.15.52:6789/0 conn(0x7f4de4069b80 legacy=0x7f4de40c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.399+0000 7f4de27fc700 1 -- 172.21.15.52:0/4170815957 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40c0000 con 0x7f4de4154540 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de27fc700 1 --2- 172.21.15.52:0/4170815957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de4069690 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4dd8006fd0 tx=0x7f4dd80090f0).ready entity=mon.0 client_cookie=b6f7ffcecb99a7b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de1ffb700 1 -- 172.21.15.52:0/4170815957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800b600 con 0x7f4de4154540 2023-05-10T01:24:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de1ffb700 1 -- 172.21.15.52:0/4170815957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800b760 con 0x7f4de4154540 2023-05-10T01:24:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de1ffb700 1 -- 172.21.15.52:0/4170815957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800bb00 con 0x7f4de4154540 2023-05-10T01:24:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 -- 172.21.15.52:0/4170815957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 msgr2=0x7f4de4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 --2- 172.21.15.52:0/4170815957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de4069690 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f4dd8006fd0 tx=0x7f4dd80090f0).stop 2023-05-10T01:24:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 -- 172.21.15.52:0/4170815957 shutdown_connections 2023-05-10T01:24:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 --2- 172.21.15.52:0/4170815957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de4069690 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 -- 172.21.15.52:0/4170815957 >> 172.21.15.52:0/4170815957 conn(0x7f4de40cb6f0 msgr2=0x7f4de40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 -- 172.21.15.52:0/4170815957 shutdown_connections 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.400+0000 7f4de98ef700 1 -- 172.21.15.52:0/4170815957 wait complete. 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.402+0000 7f4de98ef700 1 Processor -- start 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.402+0000 7f4de98ef700 1 -- start start 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.402+0000 7f4de98ef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de4069b80 0x7f4de414d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.402+0000 7f4de98ef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de4154160 0x7f4de40c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.402+0000 7f4de98ef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de98ef700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40ca470 con 0x7f4de4154540 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de98ef700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4168af0 con 0x7f4de4154160 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de98ef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4168200 con 0x7f4de4069b80 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35396/0 (socket says 172.21.15.52:35396) 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 -- 172.21.15.52:0/3588640647 learned_addr learned my addr 172.21.15.52:0/3588640647 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de27fc700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de4154160 0x7f4de40c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de2ffd700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de4069b80 0x7f4de414d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de4069b80 msgr2=0x7f4de414d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de4069b80 0x7f4de414d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de4154160 msgr2=0x7f4de40c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de4154160 0x7f4de40c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 -- 172.21.15.52:0/3588640647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8009370 con 0x7f4de4154540 2023-05-10T01:24:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de37fe700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f4ddc00c790 tx=0x7f4ddc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005c70 con 0x7f4de4154540 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc005dd0 con 0x7f4de4154540 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de40c2a20 con 0x7f4de4154540 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc007320 con 0x7f4de4154540 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.403+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4168780 con 0x7f4de4154540 2023-05-10T01:24:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.404+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de40666b0 con 0x7f4de4154540 2023-05-10T01:24:39.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.405+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f4ddc010030 con 0x7f4de4154540 2023-05-10T01:24:39.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.405+0000 7f4dcaffd700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 0x7f4dc4061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.405+0000 7f4de2ffd700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 msgr2=0x7f4dc4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:39.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.405+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f4ddc079ba0 con 0x7f4de4154540 2023-05-10T01:24:39.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.405+0000 7f4de2ffd700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 0x7f4dc4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:39.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.410+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ddc04aec0 con 0x7f4de4154540 2023-05-10T01:24:39.558 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:39.555+0000 7f64a5eed680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:39.585 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:39.582+0000 7fede243b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:24:39.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.607+0000 7f4de2ffd700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 msgr2=0x7f4dc4061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:39.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.607+0000 7f4de2ffd700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 0x7f4dc4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.627+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4de4168c80 con 0x7f4de4154540 2023-05-10T01:24:39.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.627+0000 7f4dcaffd700 1 -- 172.21.15.52:0/3588640647 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f4ddc04e4e0 con 0x7f4de4154540 2023-05-10T01:24:39.630 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:39.631 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:39.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 msgr2=0x7f4dc4061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:39.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 0x7f4dc4061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:39.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 msgr2=0x7f4de40c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f4ddc00c790 tx=0x7f4ddc0015e0).stop 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 shutdown_connections 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dc405edb0 0x7f4dc4061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de4154540 0x7f4de40c9f80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de4069b80 0x7f4de414d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 --2- 172.21.15.52:0/3588640647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de4154160 0x7f4de40c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 >> 172.21.15.52:0/3588640647 conn(0x7f4de40cb6f0 msgr2=0x7f4de40ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:39.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 shutdown_connections 2023-05-10T01:24:39.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.629+0000 7f4de98ef700 1 -- 172.21.15.52:0/3588640647 wait complete. 2023-05-10T01:24:39.634 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:39.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.799+0000 7f6a79e0e700 1 Processor -- start 2023-05-10T01:24:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.799+0000 7f6a79e0e700 1 -- start start 2023-05-10T01:24:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a79e0e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a74065870 0x7f6a74065c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a79e0e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a741541e0 0x7f6a74158570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a79e0e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740a4880 con 0x7f6a74069550 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a79e0e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740c2140 con 0x7f6a74065870 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a79e0e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74158a60 con 0x7f6a741541e0 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a78e0c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a74065870 0x7f6a74065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a78e0c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a74065870 0x7f6a74065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35446/0 (socket says 172.21.15.52:35446) 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a78e0c700 1 -- 172.21.15.52:0/2860102940 learned_addr learned my addr 172.21.15.52:0/2860102940 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:39.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.800+0000 7f6a7960d700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a741541e0 0x7f6a74158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a78e0c700 1 -- 172.21.15.52:0/2860102940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a741541e0 msgr2=0x7f6a74158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a78e0c700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a741541e0 0x7f6a74158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a78e0c700 1 -- 172.21.15.52:0/2860102940 >> v1:172.21.15.172:6789/0 conn(0x7f6a74069550 legacy=0x7f6a74153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a737fe700 1 -- 172.21.15.52:0/2860102940 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13061172 0 0) 0x7f6a740a4880 con 0x7f6a74069550 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a78e0c700 1 -- 172.21.15.52:0/2860102940 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7406a640 con 0x7f6a74065870 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a78e0c700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a74065870 0x7f6a74065c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f6a68009830 tx=0x7f6a680090f0).ready entity=mon.0 client_cookie=af8d843b29952b51 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a737fe700 1 -- 172.21.15.52:0/2860102940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800b580 con 0x7f6a74065870 2023-05-10T01:24:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a737fe700 1 -- 172.21.15.52:0/2860102940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800b6e0 con 0x7f6a74065870 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a737fe700 1 -- 172.21.15.52:0/2860102940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800ba60 con 0x7f6a74065870 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2860102940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a74065870 msgr2=0x7f6a74065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a74065870 0x7f6a74065c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f6a68009830 tx=0x7f6a680090f0).stop 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2860102940 shutdown_connections 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a741541e0 0x7f6a74158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2860102940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a74065870 0x7f6a74065c50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.801+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2860102940 >> 172.21.15.52:0/2860102940 conn(0x7f6a74067f50 msgr2=0x7f6a74068360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:39.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.802+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2860102940 shutdown_connections 2023-05-10T01:24:39.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.802+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2860102940 wait complete. 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.803+0000 7f6a79e0e700 1 Processor -- start 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.803+0000 7f6a79e0e700 1 -- start start 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a74065870 0x7f6a740c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a74069550 0x7f6a740c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740c16d0 con 0x7f6a741541e0 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740aca00 con 0x7f6a74069550 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740c79a0 con 0x7f6a74065870 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35456/0 (socket says 172.21.15.52:35456) 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 -- 172.21.15.52:0/2481593351 learned_addr learned my addr 172.21.15.52:0/2481593351 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a78e0c700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a74065870 0x7f6a740c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a73fff700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a74069550 0x7f6a740c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 -- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a74065870 msgr2=0x7f6a740c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a74065870 0x7f6a740c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 -- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a74069550 msgr2=0x7f6a740c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a74069550 0x7f6a740c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 -- 172.21.15.52:0/2481593351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009370 con 0x7f6a741541e0 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a7960d700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f6a6c009e20 tx=0x7f6a6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c009b50 con 0x7f6a741541e0 2023-05-10T01:24:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00f040 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00ccb0 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.804+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a740acc10 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.805+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a740ad1d0 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.805+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a740c55f0 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.806+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f6a6c01d460 con 0x7f6a741541e0 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.806+0000 7f6a70ff9700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 0x7f6a5c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:39.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.806+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f6a6c07a5b0 con 0x7f6a741541e0 2023-05-10T01:24:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.806+0000 7f6a78e0c700 1 -- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 msgr2=0x7f6a5c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.806+0000 7f6a78e0c700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 0x7f6a5c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.810+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a740c55f0 con 0x7f6a741541e0 2023-05-10T01:24:39.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.985+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a740c55f0 con 0x7f6a741541e0 2023-05-10T01:24:39.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.986+0000 7f6a70ff9700 1 -- 172.21.15.52:0/2481593351 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17678 (secure 0 0 0) 0x7f6a740c55f0 con 0x7f6a741541e0 2023-05-10T01:24:39.990 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:39.990 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:37.000341+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3367984383":"2023-05-11T01:24:37.000297+0000","172.21.15.172:0/1287555803":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6833/116173":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6832/116173":"2023-05-11T01:24:37.000297+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:39.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 msgr2=0x7f6a5c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:39.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 0x7f6a5c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:39.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 msgr2=0x7f6a740c11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:39.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f6a6c009e20 tx=0x7f6a6c00b040).stop 2023-05-10T01:24:39.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 shutdown_connections 2023-05-10T01:24:39.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6a5c05ede0 0x7f6a5c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:39.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a741541e0 0x7f6a740c11e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a74065870 0x7f6a740c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 --2- 172.21.15.52:0/2481593351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a74069550 0x7f6a740c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 >> 172.21.15.52:0/2481593351 conn(0x7f6a74067f50 msgr2=0x7f6a74152150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 shutdown_connections 2023-05-10T01:24:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:39.988+0000 7f6a79e0e700 1 -- 172.21.15.52:0/2481593351 wait complete. 2023-05-10T01:24:40.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:24:18.967401+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:24:19.384615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:24:40.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:24:40.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.123+0000 7f388c1bf700 1 Processor -- start 2023-05-10T01:24:40.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.123+0000 7f388c1bf700 1 -- start start 2023-05-10T01:24:40.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388c1bf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3884155f40 0x7f388406a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388c1bf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3884069c50 con 0x7f3884068a60 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388c1bf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3884069040 con 0x7f3884064a40 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388c1bf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3884135370 con 0x7f3884155f40 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388975a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3884068a60 0x7f3884155830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44478/0 (socket says 172.21.15.52:44478) 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388a75c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3884155f40 0x7f388406a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.124+0000 7f388975a700 1 -- 172.21.15.52:0/2770119271 learned_addr learned my addr 172.21.15.52:0/2770119271 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:40.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388a75c700 1 -- 172.21.15.52:0/2770119271 >> v1:172.21.15.172:6789/0 conn(0x7f3884064a40 legacy=0x7f3884066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388a75c700 1 -- 172.21.15.52:0/2770119271 >> v1:172.21.15.52:6789/0 conn(0x7f3884068a60 legacy=0x7f3884155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388a75c700 1 -- 172.21.15.52:0/2770119271 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884069320 con 0x7f3884155f40 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f3888f59700 1 -- 172.21.15.52:0/2770119271 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877828512 0 0) 0x7f3884069c50 con 0x7f3884068a60 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388a75c700 1 --2- 172.21.15.52:0/2770119271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884155f40 0x7f388406a0e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f387c009e60 tx=0x7f387c009780).ready entity=mon.0 client_cookie=ade87eee3e2b3a5f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f3888f59700 1 -- 172.21.15.52:0/2770119271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c00e070 con 0x7f3884155f40 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f3888f59700 1 -- 172.21.15.52:0/2770119271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c00bc30 con 0x7f3884155f40 2023-05-10T01:24:40.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f3888f59700 1 -- 172.21.15.52:0/2770119271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c012410 con 0x7f3884155f40 2023-05-10T01:24:40.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388c1bf700 1 -- 172.21.15.52:0/2770119271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884155f40 msgr2=0x7f388406a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388c1bf700 1 --2- 172.21.15.52:0/2770119271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884155f40 0x7f388406a0e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f387c009e60 tx=0x7f387c009780).stop 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388c1bf700 1 -- 172.21.15.52:0/2770119271 shutdown_connections 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.125+0000 7f388c1bf700 1 --2- 172.21.15.52:0/2770119271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884155f40 0x7f388406a0e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.126+0000 7f388c1bf700 1 -- 172.21.15.52:0/2770119271 >> 172.21.15.52:0/2770119271 conn(0x7f38840c4610 msgr2=0x7f3884066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.126+0000 7f388c1bf700 1 -- 172.21.15.52:0/2770119271 shutdown_connections 2023-05-10T01:24:40.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.126+0000 7f388c1bf700 1 -- 172.21.15.52:0/2770119271 wait complete. 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 Processor -- start 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 -- start start 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3884064a40 0x7f3884133900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 0x7f38840ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884136450 con 0x7f3884068a60 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884135840 con 0x7f3884064a40 2023-05-10T01:24:40.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.127+0000 7f388c1bf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3884135b20 con 0x7f3884155f40 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35468/0 (socket says 172.21.15.52:35468) 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 -- 172.21.15.52:0/531175042 learned_addr learned my addr 172.21.15.52:0/531175042 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f3889f5b700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3884064a40 0x7f3884133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388a75c700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 0x7f38840ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 msgr2=0x7f38840ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 0x7f38840ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3884064a40 msgr2=0x7f3884133900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3884064a40 0x7f3884133900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 -- 172.21.15.52:0/531175042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c009a20 con 0x7f3884068a60 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388a75c700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 0x7f38840ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388975a700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f388000c4c0 tx=0x7f3880007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800072e0 con 0x7f3884068a60 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880007440 con 0x7f3884068a60 2023-05-10T01:24:40.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3884135e00 con 0x7f3884068a60 2023-05-10T01:24:40.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800057a0 con 0x7f3884068a60 2023-05-10T01:24:40.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.128+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38841354d0 con 0x7f3884068a60 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.129+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38841365c0 con 0x7f3884068a60 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.130+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f388001a060 con 0x7f3884068a60 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.130+0000 7f3871ffb700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 0x7f38640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.130+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f38800795e0 con 0x7f3884068a60 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.130+0000 7f3889f5b700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 msgr2=0x7f38640612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.130+0000 7f3889f5b700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 0x7f38640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:40.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.134+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f388004a900 con 0x7f3884068a60 2023-05-10T01:24:40.164 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:40.161+0000 7f64a5eed680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:40.235 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:40.232+0000 7f64a5eed680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:40.252 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:40.250+0000 7fede243b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:24:40.322 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:40.320+0000 7fede243b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:24:40.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.331+0000 7f3889f5b700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 msgr2=0x7f38640612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:40.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.331+0000 7f3889f5b700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 0x7f38640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.355+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f388406c340 con 0x7f3884068a60 2023-05-10T01:24:40.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.356+0000 7f3871ffb700 1 -- 172.21.15.52:0/531175042 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v81) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3880018070 con 0x7f3884068a60 2023-05-10T01:24:40.359 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 msgr2=0x7f38640612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 0x7f38640612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 msgr2=0x7f38840abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f388000c4c0 tx=0x7f3880007c10).stop 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 shutdown_connections 2023-05-10T01:24:40.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f386405ede0 0x7f38640612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3884155f40 0x7f38840ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3884064a40 0x7f3884133900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 --2- 172.21.15.52:0/531175042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3884068a60 0x7f38840abf80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 >> 172.21.15.52:0/531175042 conn(0x7f38840c4610 msgr2=0x7f3884067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 shutdown_connections 2023-05-10T01:24:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.358+0000 7f388c1bf700 1 -- 172.21.15.52:0/531175042 wait complete. 2023-05-10T01:24:40.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:24:40.418 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:40.416+0000 7f64a5eed680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:40.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.492+0000 7fde7dc6d700 1 Processor -- start 2023-05-10T01:24:40.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.492+0000 7fde7dc6d700 1 -- start start 2023-05-10T01:24:40.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde7dc6d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 0x7fde780aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde7dc6d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780ca5f0 con 0x7fde780c6100 2023-05-10T01:24:40.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde7dc6d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde78154630 con 0x7fde78153a90 2023-05-10T01:24:40.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde7dc6d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780c8820 con 0x7fde780c5d20 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde76ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fde780c6100 0x7fde78069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44492/0 (socket says 172.21.15.52:44492) 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde76ffd700 1 -- 172.21.15.52:0/2116376188 learned_addr learned my addr 172.21.15.52:0/2116376188 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.493+0000 7fde777fe700 1 --2- 172.21.15.52:0/2116376188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 0x7fde780aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679308274 0 0) 0x7fde780ca5f0 con 0x7fde780c6100 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde580033f0 con 0x7fde780c6100 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119958557 0 0) 0x7fde78154630 con 0x7fde78153a90 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde780ca5f0 con 0x7fde78153a90 2023-05-10T01:24:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde777fe700 1 -- 172.21.15.52:0/2116376188 >> v1:172.21.15.172:6789/0 conn(0x7fde78153a90 legacy=0x7fde78153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde777fe700 1 -- 172.21.15.52:0/2116376188 >> v1:172.21.15.52:6789/0 conn(0x7fde780c6100 legacy=0x7fde78069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde777fe700 1 -- 172.21.15.52:0/2116376188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780c8b00 con 0x7fde780c5d20 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde777fe700 1 --2- 172.21.15.52:0/2116376188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 0x7fde780aa200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fde60009790 tx=0x7fde60009060).ready entity=mon.2 client_cookie=f428b57be8a6b66d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000f510 con 0x7fde780c5d20 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000f670 con 0x7fde780c5d20 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.494+0000 7fde767fc700 1 -- 172.21.15.52:0/2116376188 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000f9f0 con 0x7fde780c5d20 2023-05-10T01:24:40.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 -- 172.21.15.52:0/2116376188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 msgr2=0x7fde780aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/2116376188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 0x7fde780aa200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fde60009790 tx=0x7fde60009060).stop 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 -- 172.21.15.52:0/2116376188 shutdown_connections 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/2116376188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde780c5d20 0x7fde780aa200 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 -- 172.21.15.52:0/2116376188 >> 172.21.15.52:0/2116376188 conn(0x7fde780cb6f0 msgr2=0x7fde780c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 -- 172.21.15.52:0/2116376188 shutdown_connections 2023-05-10T01:24:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.495+0000 7fde7dc6d700 1 -- 172.21.15.52:0/2116376188 wait complete. 2023-05-10T01:24:40.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.496+0000 7fde7dc6d700 1 Processor -- start 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.496+0000 7fde7dc6d700 1 -- start start 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 0x7fde78153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde78153a90 0x7fde7814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78155380 con 0x7fde780c6100 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78154770 con 0x7fde780c5d20 2023-05-10T01:24:40.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde7dc6d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde78154a50 con 0x7fde78153a90 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 0x7fde78153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:33828/0 (socket says 172.21.15.52:33828) 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 -- 172.21.15.52:0/1950829070 learned_addr learned my addr 172.21.15.52:0/1950829070 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde77fff700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde78153a90 0x7fde7814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 -- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde78153a90 msgr2=0x7fde7814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde78153a90 0x7fde7814f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 -- 172.21.15.52:0/1950829070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 msgr2=0x7fde78153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 0x7fde78153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde777fe700 1 -- 172.21.15.52:0/1950829070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600092a0 con 0x7fde780c5d20 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.497+0000 7fde76ffd700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 0x7fde78153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde777fe700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fde78083c40 tx=0x7fde60017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000fe80 con 0x7fde780c5d20 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000f7e0 con 0x7fde780c5d20 2023-05-10T01:24:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78154d30 con 0x7fde780c5d20 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6001b640 con 0x7fde780c5d20 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.498+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78154410 con 0x7fde780c5d20 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.499+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde78066720 con 0x7fde780c5d20 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.499+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fde6000f070 con 0x7fde780c5d20 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.500+0000 7fde6f7fe700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 0x7fde5c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.500+0000 7fde76ffd700 1 -- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 msgr2=0x7fde5c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:40.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.500+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fde6007b760 con 0x7fde780c5d20 2023-05-10T01:24:40.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.500+0000 7fde76ffd700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 0x7fde5c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:40.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.504+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde6004ca00 con 0x7fde780c5d20 2023-05-10T01:24:40.521 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:40.519+0000 7fede243b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:24:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.679+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde7806c340 con 0x7fde780c5d20 2023-05-10T01:24:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.679+0000 7fde6f7fe700 1 -- 172.21.15.52:0/1950829070 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde60050020 con 0x7fde780c5d20 2023-05-10T01:24:40.683 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:24:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 msgr2=0x7fde5c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 0x7fde5c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 msgr2=0x7fde78152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fde78083c40 tx=0x7fde60017000).stop 2023-05-10T01:24:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 shutdown_connections 2023-05-10T01:24:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fde5c05ede0 0x7fde5c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde78153a90 0x7fde7814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde780c5d20 0x7fde78152700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 --2- 172.21.15.52:0/1950829070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde780c6100 0x7fde78153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 >> 172.21.15.52:0/1950829070 conn(0x7fde780cb6f0 msgr2=0x7fde780c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 shutdown_connections 2023-05-10T01:24:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.681+0000 7fde7dc6d700 1 -- 172.21.15.52:0/1950829070 wait complete. 2023-05-10T01:24:40.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:24:40.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.817+0000 7fd1fc532700 1 Processor -- start 2023-05-10T01:24:40.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.817+0000 7fd1fc532700 1 -- start start 2023-05-10T01:24:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 0x7fd1f40be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1f40be580 0x7fd1f4066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1f4067330 0x7fd1f40692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f40677e0 con 0x7fd1f40be580 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f40622a0 con 0x7fd1f4067330 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1fc532700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f4063100 con 0x7fd1f413b410 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.818+0000 7fd1f9acd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1f40be580 0x7fd1f4066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1f40be580 0x7fd1f4066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35512/0 (socket says 172.21.15.52:35512) 2023-05-10T01:24:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 -- 172.21.15.52:0/298264635 learned_addr learned my addr 172.21.15.52:0/298264635 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1faacf700 1 --2- 172.21.15.52:0/298264635 >> v2:172.21.15.172:3300/0 conn(0x7fd1f4067330 0x7fd1f40692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1fa2ce700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 0x7fd1f40be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 -- 172.21.15.52:0/298264635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 msgr2=0x7fd1f40be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 0x7fd1f40be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 -- 172.21.15.52:0/298264635 >> v2:172.21.15.172:3300/0 conn(0x7fd1f4067330 msgr2=0x7fd1f40692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 --2- 172.21.15.52:0/298264635 >> v2:172.21.15.172:3300/0 conn(0x7fd1f4067330 0x7fd1f40692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 -- 172.21.15.52:0/298264635 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f40635f0 con 0x7fd1f40be580 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1fa2ce700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 0x7fd1f40be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f9acd700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f40be580 0x7fd1f4066e40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fd1f40c5060 tx=0x7fd1f00090f0).ready entity=mon.0 client_cookie=f78f831cff978d74 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f92cc700 1 -- 172.21.15.52:0/298264635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000b520 con 0x7fd1f40be580 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f92cc700 1 -- 172.21.15.52:0/298264635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000b680 con 0x7fd1f40be580 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.819+0000 7fd1f92cc700 1 -- 172.21.15.52:0/298264635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000ba00 con 0x7fd1f40be580 2023-05-10T01:24:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 -- 172.21.15.52:0/298264635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f40be580 msgr2=0x7fd1f4066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f40be580 0x7fd1f4066e40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fd1f40c5060 tx=0x7fd1f00090f0).stop 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 -- 172.21.15.52:0/298264635 shutdown_connections 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 --2- 172.21.15.52:0/298264635 >> v2:172.21.15.172:3300/0 conn(0x7fd1f4067330 0x7fd1f40692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f413b410 0x7fd1f40be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 --2- 172.21.15.52:0/298264635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f40be580 0x7fd1f4066e40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 -- 172.21.15.52:0/298264635 >> 172.21.15.52:0/298264635 conn(0x7fd1f40c8460 msgr2=0x7fd1f40c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 -- 172.21.15.52:0/298264635 shutdown_connections 2023-05-10T01:24:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.820+0000 7fd1fc532700 1 -- 172.21.15.52:0/298264635 wait complete. 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.822+0000 7fd1fc532700 1 Processor -- start 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.822+0000 7fd1fc532700 1 -- start start 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f40be580 0x7fd1f40aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f413b410 0x7fd1f41387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f4152250 con 0x7fd1f4067330 2023-05-10T01:24:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f41658a0 con 0x7fd1f413b410 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fc532700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f4165b80 con 0x7fd1f40be580 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35516/0 (socket says 172.21.15.52:35516) 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 -- 172.21.15.52:0/155704948 learned_addr learned my addr 172.21.15.52:0/155704948 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1f9acd700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f40be580 0x7fd1f40aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1faacf700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f413b410 0x7fd1f41387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 -- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f40be580 msgr2=0x7fd1f40aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f40be580 0x7fd1f40aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 -- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f413b410 msgr2=0x7fd1f41387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f413b410 0x7fd1f41387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.823+0000 7fd1fa2ce700 1 -- 172.21.15.52:0/155704948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0009370 con 0x7fd1f4067330 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1fa2ce700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fd1e400d860 tx=0x7fd1e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400f520 con 0x7fd1f4067330 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400f680 con 0x7fd1f4067330 2023-05-10T01:24:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f4165e60 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400fa00 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.824+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f4139810 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.825+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd1e401a030 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.825+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f4152530 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.825+0000 7fd1e27fc700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 0x7fd1d40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.826+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fd1e4079880 con 0x7fd1f4067330 2023-05-10T01:24:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.826+0000 7fd1f9acd700 1 -- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 msgr2=0x7fd1d40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:40.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.826+0000 7fd1f9acd700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 0x7fd1d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:40.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:40.830+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1e404aba0 con 0x7fd1f4067330 2023-05-10T01:24:40.836 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:40.834+0000 7f64a5eed680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:40.940 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:40.937+0000 7f64a5eed680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:40.963 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:40.960+0000 7fede243b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:24:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.004+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1f406c340 con 0x7fd1f4067330 2023-05-10T01:24:41.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.005+0000 7fd1e27fc700 1 -- 172.21.15.52:0/155704948 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1e404e1c0 con 0x7fd1f4067330 2023-05-10T01:24:41.007 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:24:41.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.006+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 msgr2=0x7fd1d40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.006+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 0x7fd1d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.006+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 msgr2=0x7fd1f41652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.006+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fd1e400d860 tx=0x7fd1e4008040).stop 2023-05-10T01:24:41.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 shutdown_connections 2023-05-10T01:24:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1d405ede0 0x7fd1d40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1f413b410 0x7fd1f41387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f4067330 0x7fd1f41652e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 --2- 172.21.15.52:0/155704948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1f40be580 0x7fd1f40aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 >> 172.21.15.52:0/155704948 conn(0x7fd1f40c8460 msgr2=0x7fd1f4065420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 shutdown_connections 2023-05-10T01:24:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.007+0000 7fd1fc532700 1 -- 172.21.15.52:0/155704948 wait complete. 2023-05-10T01:24:41.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:24:41.073 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.071+0000 7fede243b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:41.093 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:41.090+0000 7f64a5eed680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.143+0000 7f712e5d1700 1 Processor -- start 2023-05-10T01:24:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.143+0000 7f712e5d1700 1 -- start start 2023-05-10T01:24:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712e5d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 0x7f71280aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712e5d1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 0x7f71280a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712e5d1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280aa560 con 0x7f71280aa140 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712e5d1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280c94c0 con 0x7f7128154460 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712e5d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280cb7d0 con 0x7f7128154080 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f71277fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 0x7f71280a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f7127fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 0x7f71280aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712cb6e700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f71280aa140 0x7f7128068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:47082/0 (socket says 172.21.15.52:47082) 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f712cb6e700 1 -- 172.21.15.52:0/3747644044 learned_addr learned my addr 172.21.15.52:0/3747644044 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f7127fff700 1 -- 172.21.15.52:0/3747644044 >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 msgr2=0x7f71280a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f7127fff700 1 --2- 172.21.15.52:0/3747644044 >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 0x7f71280a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f7127fff700 1 -- 172.21.15.52:0/3747644044 >> v1:172.21.15.172:6789/0 conn(0x7f71280aa140 legacy=0x7f7128068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.144+0000 7f7126ffd700 1 -- 172.21.15.52:0/3747644044 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097613080 0 0) 0x7f7120001490 con 0x7f71280aa140 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f7127fff700 1 -- 172.21.15.52:0/3747644044 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280c88b0 con 0x7f7128154080 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f71277fe700 1 --2- 172.21.15.52:0/3747644044 >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 0x7f71280a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f7127fff700 1 --2- 172.21.15.52:0/3747644044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 0x7f71280aac90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f711c009760 tx=0x7f711c009060).ready entity=mon.2 client_cookie=2fb36d6d9add5e61 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f7126ffd700 1 -- 172.21.15.52:0/3747644044 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00f510 con 0x7f7128154080 2023-05-10T01:24:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f7126ffd700 1 -- 172.21.15.52:0/3747644044 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00f670 con 0x7f7128154080 2023-05-10T01:24:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f7126ffd700 1 -- 172.21.15.52:0/3747644044 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00f9f0 con 0x7f7128154080 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f712e5d1700 1 -- 172.21.15.52:0/3747644044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 msgr2=0x7f71280aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.145+0000 7f712e5d1700 1 --2- 172.21.15.52:0/3747644044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 0x7f71280aac90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f711c009760 tx=0x7f711c009060).stop 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 -- 172.21.15.52:0/3747644044 shutdown_connections 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 --2- 172.21.15.52:0/3747644044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154080 0x7f71280aac90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 --2- 172.21.15.52:0/3747644044 >> v2:172.21.15.172:3300/0 conn(0x7f7128154460 0x7f71280a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 -- 172.21.15.52:0/3747644044 >> 172.21.15.52:0/3747644044 conn(0x7f7128067910 msgr2=0x7f71280cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 -- 172.21.15.52:0/3747644044 shutdown_connections 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.146+0000 7f712e5d1700 1 -- 172.21.15.52:0/3747644044 wait complete. 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.147+0000 7f712e5d1700 1 Processor -- start 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.147+0000 7f712e5d1700 1 -- start start 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71280aa140 0x7f71280b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154460 0x7f71281649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280abe00 con 0x7f7128154080 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128164f90 con 0x7f71280aa140 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128165270 con 0x7f7128154460 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35532/0 (socket says 172.21.15.52:35532) 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 -- 172.21.15.52:0/2302320046 learned_addr learned my addr 172.21.15.52:0/2302320046 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712cb6e700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154460 0x7f71281649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f7127fff700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71280aa140 0x7f71280b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 -- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154460 msgr2=0x7f71281649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154460 0x7f71281649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 -- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71280aa140 msgr2=0x7f71280b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71280aa140 0x7f71280b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 -- 172.21.15.52:0/2302320046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180092a0 con 0x7f7128154080 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f71277fe700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f711800e980 tx=0x7f7118009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118012600 con 0x7f7128154080 2023-05-10T01:24:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118012760 con 0x7f7128154080 2023-05-10T01:24:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0092a0 con 0x7f7128154080 2023-05-10T01:24:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.148+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118012ae0 con 0x7f7128154080 2023-05-10T01:24:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.149+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71280b0600 con 0x7f7128154080 2023-05-10T01:24:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280abfb0 con 0x7f7128154080 2023-05-10T01:24:41.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f7118022070 con 0x7f7128154080 2023-05-10T01:24:41.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f710ffff700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 0x7f71080612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f711807a0c0 con 0x7f7128154080 2023-05-10T01:24:41.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f7127fff700 1 -- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 msgr2=0x7f71080612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:41.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.150+0000 7f7127fff700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 0x7f71080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:41.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.155+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71280abfb0 con 0x7f7128154080 2023-05-10T01:24:41.168 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:41.165+0000 7f64a5eed680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:41.234 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:41.231+0000 7f64a5eed680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:41.235 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.233+0000 7fede243b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:41.312 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.310+0000 7fede243b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.328+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f712806c340 con 0x7f7128154080 2023-05-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.328+0000 7f710ffff700 1 -- 172.21.15.52:0/2302320046 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71180160a0 con 0x7f7128154080 2023-05-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:24:41.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 msgr2=0x7f71080612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:41.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 0x7f71080612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 msgr2=0x7f71281644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f711800e980 tx=0x7f7118009060).stop 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 shutdown_connections 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f710805ede0 0x7f71080612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7128154460 0x7f71281649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71280aa140 0x7f71280b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 --2- 172.21.15.52:0/2302320046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128154080 0x7f71281644d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 >> 172.21.15.52:0/2302320046 conn(0x7f7128067910 msgr2=0x7f7128153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 shutdown_connections 2023-05-10T01:24:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.330+0000 7f712e5d1700 1 -- 172.21.15.52:0/2302320046 wait complete. 2023-05-10T01:24:41.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:41.385 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.383+0000 7fede243b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:24:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.461+0000 7febd920a700 1 Processor -- start 2023-05-10T01:24:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.461+0000 7febd920a700 1 -- start start 2023-05-10T01:24:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.461+0000 7febd920a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febd4153ea0 0x7febd4154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.461+0000 7febd920a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febd4068c60 0x7febd4066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd920a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40bc9a0 con 0x7febd4064ff0 2023-05-10T01:24:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd920a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd40bcc80 con 0x7febd4153ea0 2023-05-10T01:24:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd920a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd40bcf60 con 0x7febd4068c60 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febd4153ea0 0x7febd4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febd4153ea0 0x7febd4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35538/0 (socket says 172.21.15.52:35538) 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 -- 172.21.15.52:0/3991327137 learned_addr learned my addr 172.21.15.52:0/3991327137 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd259c700 1 --2- 172.21.15.52:0/3991327137 >> v2:172.21.15.172:3300/0 conn(0x7febd4068c60 0x7febd4066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 -- 172.21.15.52:0/3991327137 >> v2:172.21.15.172:3300/0 conn(0x7febd4068c60 msgr2=0x7febd4066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 --2- 172.21.15.52:0/3991327137 >> v2:172.21.15.172:3300/0 conn(0x7febd4068c60 0x7febd4066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 -- 172.21.15.52:0/3991327137 >> v1:172.21.15.52:6789/0 conn(0x7febd4064ff0 legacy=0x7febd40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd1d9b700 1 -- 172.21.15.52:0/3991327137 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570910590 0 0) 0x7febd40bc9a0 con 0x7febd4064ff0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 -- 172.21.15.52:0/3991327137 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40bd240 con 0x7febd4153ea0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd2d9d700 1 --2- 172.21.15.52:0/3991327137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4153ea0 0x7febd4154280 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7febd4064aa0 tx=0x7febc40090f0).ready entity=mon.0 client_cookie=f13f40ef9a871d53 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd1d9b700 1 -- 172.21.15.52:0/3991327137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400b520 con 0x7febd4153ea0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd1d9b700 1 -- 172.21.15.52:0/3991327137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400b680 con 0x7febd4153ea0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.462+0000 7febd1d9b700 1 -- 172.21.15.52:0/3991327137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400ba00 con 0x7febd4153ea0 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 -- 172.21.15.52:0/3991327137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4153ea0 msgr2=0x7febd4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 --2- 172.21.15.52:0/3991327137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4153ea0 0x7febd4154280 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7febd4064aa0 tx=0x7febc40090f0).stop 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 -- 172.21.15.52:0/3991327137 shutdown_connections 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 --2- 172.21.15.52:0/3991327137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4153ea0 0x7febd4154280 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 --2- 172.21.15.52:0/3991327137 >> v2:172.21.15.172:3300/0 conn(0x7febd4068c60 0x7febd4066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 -- 172.21.15.52:0/3991327137 >> 172.21.15.52:0/3991327137 conn(0x7febd40c4420 msgr2=0x7febd40c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 -- 172.21.15.52:0/3991327137 shutdown_connections 2023-05-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.463+0000 7febd920a700 1 -- 172.21.15.52:0/3991327137 wait complete. 2023-05-10T01:24:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.464+0000 7febd920a700 1 Processor -- start 2023-05-10T01:24:41.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.464+0000 7febd920a700 1 -- start start 2023-05-10T01:24:41.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd4064ff0 0x7febd4146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd4153ea0 0x7febd40622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4062c80 con 0x7febd4146d10 2023-05-10T01:24:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40a7480 con 0x7febd4064ff0 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd920a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40a7720 con 0x7febd4153ea0 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35546/0 (socket says 172.21.15.52:35546) 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 -- 172.21.15.52:0/2730312140 learned_addr learned my addr 172.21.15.52:0/2730312140 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd259c700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd4153ea0 0x7febd40622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd2d9d700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd4064ff0 0x7febd4146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd4153ea0 msgr2=0x7febd40622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd4153ea0 0x7febd40622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd4064ff0 msgr2=0x7febd4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd4064ff0 0x7febd4146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.465+0000 7febd359e700 1 -- 172.21.15.52:0/2730312140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009370 con 0x7febd4146d10 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febd359e700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7febcc002230 tx=0x7febcc007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc010510 con 0x7febd4146d10 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc010670 con 0x7febd4146d10 2023-05-10T01:24:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc010a10 con 0x7febd4146d10 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd40a7a00 con 0x7febd4146d10 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.466+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd40a7fc0 con 0x7febd4146d10 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.467+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd406c340 con 0x7febd4146d10 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.467+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7febcc010070 con 0x7febd4146d10 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.468+0000 7febbaffd700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 0x7febb40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.468+0000 7febd2d9d700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 msgr2=0x7febb40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.468+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7febcc079a80 con 0x7febd4146d10 2023-05-10T01:24:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.468+0000 7febd2d9d700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 0x7febb40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.471+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febcc04ada0 con 0x7febd4146d10 2023-05-10T01:24:41.489 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:41.486+0000 7f64a5eed680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.669+0000 7febd2d9d700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 msgr2=0x7febb40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.669+0000 7febd2d9d700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 0x7febb40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:41.674 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.671+0000 7fede243b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:24:41.675 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:41.671+0000 7f64a5eed680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.702+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febd40691a0 con 0x7febd4146d10 2023-05-10T01:24:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.703+0000 7febbaffd700 1 -- 172.21.15.52:0/2730312140 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7febcc04e3c0 con 0x7febd4146d10 2023-05-10T01:24:41.706 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 msgr2=0x7febb40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 0x7febb40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 msgr2=0x7febd4062790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7febcc002230 tx=0x7febcc007f70).stop 2023-05-10T01:24:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 shutdown_connections 2023-05-10T01:24:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febb405ede0 0x7febb40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febd4146d10 0x7febd4062790 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd4064ff0 0x7febd4146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.704+0000 7febd920a700 1 --2- 172.21.15.52:0/2730312140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd4153ea0 0x7febd40622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.705+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 >> 172.21.15.52:0/2730312140 conn(0x7febd40c4420 msgr2=0x7febd40c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.705+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 shutdown_connections 2023-05-10T01:24:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.705+0000 7febd920a700 1 -- 172.21.15.52:0/2730312140 wait complete. 2023-05-10T01:24:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:41.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:41.866 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:41.864+0000 7fede243b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.877+0000 7f03d6ed7700 1 Processor -- start 2023-05-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.877+0000 7f03d6ed7700 1 -- start start 2023-05-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d6ed7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03d0154540 0x7f03d00aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d6ed7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03d00c5ca0 0x7f03d00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d6ed7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00c6640 con 0x7f03d0154160 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d6ed7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00ab1f0 con 0x7f03d0154540 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d6ed7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00c08a0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03d0154540 0x7f03d00aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d4c73700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f03d0154160 0x7f03d00a9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44568/0 (socket says 172.21.15.52:44568) 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03d0154540 0x7f03d00aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35552/0 (socket says 172.21.15.52:35552) 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d4c73700 1 -- 172.21.15.52:0/2072020708 learned_addr learned my addr 172.21.15.52:0/2072020708 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03d5474700 1 --2- 172.21.15.52:0/2072020708 >> v2:172.21.15.172:3300/0 conn(0x7f03d00c5ca0 0x7f03d00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 -- 172.21.15.52:0/2072020708 >> v2:172.21.15.172:3300/0 conn(0x7f03d00c5ca0 msgr2=0x7f03d00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 --2- 172.21.15.52:0/2072020708 >> v2:172.21.15.172:3300/0 conn(0x7f03d00c5ca0 0x7f03d00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 -- 172.21.15.52:0/2072020708 >> v1:172.21.15.52:6789/0 conn(0x7f03d0154160 legacy=0x7f03d00a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cf7fe700 1 -- 172.21.15.52:0/2072020708 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966268590 0 0) 0x7f03c4001110 con 0x7f03d0154160 2023-05-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.878+0000 7f03cffff700 1 -- 172.21.15.52:0/2072020708 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00bfc90 con 0x7f03d0154540 2023-05-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03cffff700 1 --2- 172.21.15.52:0/2072020708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d0154540 0x7f03d00aad00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f03d00c0810 tx=0x7f03bc009060).ready entity=mon.0 client_cookie=842b23bec7c523ae server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03cf7fe700 1 -- 172.21.15.52:0/2072020708 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00b580 con 0x7f03d0154540 2023-05-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03cf7fe700 1 -- 172.21.15.52:0/2072020708 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00b6e0 con 0x7f03d0154540 2023-05-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03cf7fe700 1 -- 172.21.15.52:0/2072020708 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00ba60 con 0x7f03d0154540 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 -- 172.21.15.52:0/2072020708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d0154540 msgr2=0x7f03d00aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/2072020708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d0154540 0x7f03d00aad00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f03d00c0810 tx=0x7f03bc009060).stop 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 -- 172.21.15.52:0/2072020708 shutdown_connections 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/2072020708 >> v2:172.21.15.172:3300/0 conn(0x7f03d00c5ca0 0x7f03d00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/2072020708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d0154540 0x7f03d00aad00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 -- 172.21.15.52:0/2072020708 >> 172.21.15.52:0/2072020708 conn(0x7f03d00cb6c0 msgr2=0x7f03d00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 -- 172.21.15.52:0/2072020708 shutdown_connections 2023-05-10T01:24:41.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.879+0000 7f03d6ed7700 1 -- 172.21.15.52:0/2072020708 wait complete. 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.880+0000 7f03d6ed7700 1 Processor -- start 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 -- start start 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03d0154160 0x7f03d013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d0154540 0x7f03d014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00af780 con 0x7f03d00c5ca0 2023-05-10T01:24:41.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d013fe40 con 0x7f03d0154540 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d6ed7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d014f7c0 con 0x7f03d0154160 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.881+0000 7f03d4c73700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35556/0 (socket says 172.21.15.52:35556) 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 -- 172.21.15.52:0/229926018 learned_addr learned my addr 172.21.15.52:0/229926018 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d5474700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d0154540 0x7f03d014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03cffff700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03d0154160 0x7f03d013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:41.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 -- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03d0154160 msgr2=0x7f03d013f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03d0154160 0x7f03d013f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 -- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d0154540 msgr2=0x7f03d014f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d0154540 0x7f03d014f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 -- 172.21.15.52:0/229926018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0092a0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d4c73700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f03c400c510 tx=0x7f03c4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400ce80 con 0x7f03d00c5ca0 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40072e0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d00af9e0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4007660 con 0x7f03d00c5ca0 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.882+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00affa0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.883+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d00666b0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.884+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f03c401a060 con 0x7f03d00c5ca0 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.884+0000 7f03ccff9700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 0x7f03b80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.884+0000 7f03cffff700 1 -- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 msgr2=0x7f03b80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.884+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f03c40793c0 con 0x7f03d00c5ca0 2023-05-10T01:24:41.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.884+0000 7f03cffff700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 0x7f03b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:41.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:41.888+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03c404a680 con 0x7f03d00c5ca0 2023-05-10T01:24:42.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.077+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d00c6640 con 0x7f03d00c5ca0 2023-05-10T01:24:42.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.077+0000 7f03ccff9700 1 -- 172.21.15.52:0/229926018 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17678 (secure 0 0 0) 0x7f03d00c6640 con 0x7f03d00c5ca0 2023-05-10T01:24:42.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:42.080 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:37.000341+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3367984383":"2023-05-11T01:24:37.000297+0000","172.21.15.172:0/1287555803":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6833/116173":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6832/116173":"2023-05-11T01:24:37.000297+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:42.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 msgr2=0x7f03b80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:42.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 0x7f03b80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 msgr2=0x7f03d00af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f03c400c510 tx=0x7f03c4007ad0).stop 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 shutdown_connections 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f03b805ede0 0x7f03b80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d0154540 0x7f03d014f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03d00c5ca0 0x7f03d00af290 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 --2- 172.21.15.52:0/229926018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03d0154160 0x7f03d013f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.079+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 >> 172.21.15.52:0/229926018 conn(0x7f03d00cb6c0 msgr2=0x7f03d00acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.080+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 shutdown_connections 2023-05-10T01:24:42.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.080+0000 7f03d6ed7700 1 -- 172.21.15.52:0/229926018 wait complete. 2023-05-10T01:24:42.094 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:24:42.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.212+0000 7fdfe40fa700 1 Processor -- start 2023-05-10T01:24:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.212+0000 7fdfe40fa700 1 -- start start 2023-05-10T01:24:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe40fa700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 0x7fdfdc066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe40fa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 0x7fdfdc0bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe40fa700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0a6cd0 con 0x7fdfdc0bc530 2023-05-10T01:24:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe40fa700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc152250 con 0x7fdfdc1519f0 2023-05-10T01:24:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe40fa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0c4b10 con 0x7fdfdc151dd0 2023-05-10T01:24:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe1e96700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 0x7fdfdc066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe2697700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdfdc0bc530 0x7fdfdc067850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:47144/0 (socket says 172.21.15.52:47144) 2023-05-10T01:24:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe1695700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 0x7fdfdc0bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.213+0000 7fdfe2697700 1 -- 172.21.15.52:0/3167464004 learned_addr learned my addr 172.21.15.52:0/3167464004 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:42.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1695700 1 -- 172.21.15.52:0/3167464004 >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 msgr2=0x7fdfdc066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:42.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1695700 1 --2- 172.21.15.52:0/3167464004 >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 0x7fdfdc066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1695700 1 -- 172.21.15.52:0/3167464004 >> v1:172.21.15.172:6789/0 conn(0x7fdfdc0bc530 legacy=0x7fdfdc067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe0e94700 1 -- 172.21.15.52:0/3167464004 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69197523 0 0) 0x7fdfdc0a6cd0 con 0x7fdfdc0bc530 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1695700 1 -- 172.21.15.52:0/3167464004 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc066a00 con 0x7fdfdc151dd0 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1e96700 1 --2- 172.21.15.52:0/3167464004 >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 0x7fdfdc066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe1695700 1 --2- 172.21.15.52:0/3167464004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 0x7fdfdc0bc040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdfd0009760 tx=0x7fdfd0009060).ready entity=mon.2 client_cookie=e01ca2bf6f92803a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe0e94700 1 -- 172.21.15.52:0/3167464004 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000f510 con 0x7fdfdc151dd0 2023-05-10T01:24:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe0e94700 1 -- 172.21.15.52:0/3167464004 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd000f670 con 0x7fdfdc151dd0 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.214+0000 7fdfe0e94700 1 -- 172.21.15.52:0/3167464004 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000f9f0 con 0x7fdfdc151dd0 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 -- 172.21.15.52:0/3167464004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 msgr2=0x7fdfdc0bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/3167464004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 0x7fdfdc0bc040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdfd0009760 tx=0x7fdfd0009060).stop 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 -- 172.21.15.52:0/3167464004 shutdown_connections 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/3167464004 >> v2:172.21.15.172:3300/0 conn(0x7fdfdc1519f0 0x7fdfdc066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/3167464004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc151dd0 0x7fdfdc0bc040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 -- 172.21.15.52:0/3167464004 >> 172.21.15.52:0/3167464004 conn(0x7fdfdc0c7bb0 msgr2=0x7fdfdc0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 -- 172.21.15.52:0/3167464004 shutdown_connections 2023-05-10T01:24:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.215+0000 7fdfe40fa700 1 -- 172.21.15.52:0/3167464004 wait complete. 2023-05-10T01:24:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.216+0000 7fdfe40fa700 1 Processor -- start 2023-05-10T01:24:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.216+0000 7fdfe40fa700 1 -- start start 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 0x7fdfdc161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 0x7fdfdc162b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 0x7fdfdc0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1641a0 con 0x7fdfdc1519f0 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc161f60 con 0x7fdfdc151dd0 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe40fa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1632d0 con 0x7fdfdc0bc530 2023-05-10T01:24:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe1695700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 0x7fdfdc162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe1e96700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 0x7fdfdc161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe1695700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 0x7fdfdc162b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35594/0 (socket says 172.21.15.52:35594) 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 0x7fdfdc0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe1695700 1 -- 172.21.15.52:0/2039057590 learned_addr learned my addr 172.21.15.52:0/2039057590 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 msgr2=0x7fdfdc161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 0x7fdfdc161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 msgr2=0x7fdfdc162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 0x7fdfdc162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 -- 172.21.15.52:0/2039057590 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc009a20 con 0x7fdfdc151dd0 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe1e96700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 0x7fdfdc161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.217+0000 7fdfe2697700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 0x7fdfdc0aa490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fdfd400c490 tx=0x7fdfd4007d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.218+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40070d0 con 0x7fdfdc151dd0 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.218+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4007230 con 0x7fdfdc151dd0 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.218+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd00092a0 con 0x7fdfdc151dd0 2023-05-10T01:24:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.218+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40075d0 con 0x7fdfdc151dd0 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.218+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc163590 con 0x7fdfdc151dd0 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.219+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc06c340 con 0x7fdfdc151dd0 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.219+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fdfd4010070 con 0x7fdfdc151dd0 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.219+0000 7fdfd9ffb700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 0x7fdfbc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.219+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fdfd4079210 con 0x7fdfdc151dd0 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.220+0000 7fdfe1e96700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 msgr2=0x7fdfbc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.220+0000 7fdfe1e96700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 0x7fdfbc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:42.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.224+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdfd404a530 con 0x7fdfdc151dd0 2023-05-10T01:24:42.320 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.317+0000 7f64a5eed680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:42.387 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.384+0000 7f64a5eed680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:42.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.421+0000 7fdfe1e96700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 msgr2=0x7fdfbc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:42.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.421+0000 7fdfe1e96700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 0x7fdfbc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:42.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.444+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfdc0c4290 con 0x7fdfdc151dd0 2023-05-10T01:24:42.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.445+0000 7fdfd9ffb700 1 -- 172.21.15.52:0/2039057590 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fdfd404db50 con 0x7fdfdc151dd0 2023-05-10T01:24:42.447 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:42.447 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:42.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 msgr2=0x7fdfbc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 0x7fdfbc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 msgr2=0x7fdfdc0aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 0x7fdfdc0aa490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fdfd400c490 tx=0x7fdfd4007d50).stop 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 shutdown_connections 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdfbc05ede0 0x7fdfbc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfdc151dd0 0x7fdfdc0aa490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdfdc0bc530 0x7fdfdc161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 --2- 172.21.15.52:0/2039057590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfdc1519f0 0x7fdfdc162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 >> 172.21.15.52:0/2039057590 conn(0x7fdfdc0c7bb0 msgr2=0x7fdfdc14f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 shutdown_connections 2023-05-10T01:24:42.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.447+0000 7fdfe40fa700 1 -- 172.21.15.52:0/2039057590 wait complete. 2023-05-10T01:24:42.452 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:42.460 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.458+0000 7f64a5eed680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:42.462 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:42.571 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:42.568+0000 7fede243b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:24:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.579+0000 7fe3a6b1b700 1 Processor -- start 2023-05-10T01:24:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.579+0000 7fe3a6b1b700 1 -- start start 2023-05-10T01:24:42.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a6b1b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 0x7fe3a0065c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a6b1b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 0x7fe3a0158570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a6b1b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00a4880 con 0x7fe3a0069550 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a6b1b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00c2140 con 0x7fe3a01541e0 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a6b1b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0158a60 con 0x7fe3a0065870 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a5b19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 0x7fe3a0065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a631a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 0x7fe3a0158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a5318700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe3a0069550 0x7fe3a0153ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:47156/0 (socket says 172.21.15.52:47156) 2023-05-10T01:24:42.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a5318700 1 -- 172.21.15.52:0/1121303223 learned_addr learned my addr 172.21.15.52:0/1121303223 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:42.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.580+0000 7fe3a4b17700 1 -- 172.21.15.52:0/1121303223 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373298111 0 0) 0x7fe3a00a4880 con 0x7fe3a0069550 2023-05-10T01:24:42.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a4b17700 1 -- 172.21.15.52:0/1121303223 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3880033f0 con 0x7fe3a0069550 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a5b19700 1 -- 172.21.15.52:0/1121303223 >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 msgr2=0x7fe3a0158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a5b19700 1 --2- 172.21.15.52:0/1121303223 >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 0x7fe3a0158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a5b19700 1 -- 172.21.15.52:0/1121303223 >> v1:172.21.15.172:6789/0 conn(0x7fe3a0069550 legacy=0x7fe3a0153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a5b19700 1 -- 172.21.15.52:0/1121303223 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a006a640 con 0x7fe3a0065870 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a631a700 1 --2- 172.21.15.52:0/1121303223 >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 0x7fe3a0158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a5b19700 1 --2- 172.21.15.52:0/1121303223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 0x7fe3a0065c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe390009760 tx=0x7fe390009060).ready entity=mon.2 client_cookie=f7e942e206aacbc2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a4b17700 1 -- 172.21.15.52:0/1121303223 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000d4a0 con 0x7fe3a0065870 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a4b17700 1 -- 172.21.15.52:0/1121303223 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000d600 con 0x7fe3a0065870 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a4b17700 1 -- 172.21.15.52:0/1121303223 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000d980 con 0x7fe3a0065870 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/1121303223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 msgr2=0x7fe3a0065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/1121303223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 0x7fe3a0065c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe390009760 tx=0x7fe390009060).stop 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/1121303223 shutdown_connections 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/1121303223 >> v2:172.21.15.172:3300/0 conn(0x7fe3a01541e0 0x7fe3a0158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/1121303223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a0065870 0x7fe3a0065c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.581+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/1121303223 >> 172.21.15.52:0/1121303223 conn(0x7fe3a0067f50 msgr2=0x7fe3a0068360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.582+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/1121303223 shutdown_connections 2023-05-10T01:24:42.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.582+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/1121303223 wait complete. 2023-05-10T01:24:42.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 Processor -- start 2023-05-10T01:24:42.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 -- start start 2023-05-10T01:24:42.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a0065870 0x7fe3a0147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a01541e0 0x7fe3a00c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00bc1a0 con 0x7fe3a0069550 2023-05-10T01:24:42.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00bb2f0 con 0x7fe3a0065870 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.583+0000 7fe3a6b1b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00bb590 con 0x7fe3a01541e0 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35610/0 (socket says 172.21.15.52:35610) 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 -- 172.21.15.52:0/3301092487 learned_addr learned my addr 172.21.15.52:0/3301092487 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5b19700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a0065870 0x7fe3a0147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a631a700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a01541e0 0x7fe3a00c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a01541e0 msgr2=0x7fe3a00c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a01541e0 0x7fe3a00c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a0065870 msgr2=0x7fe3a0147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a0065870 0x7fe3a0147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 -- 172.21.15.52:0/3301092487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398009a20 con 0x7fe3a0069550 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a5318700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe39c00c4c0 tx=0x7fe39c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0072e0 con 0x7fe3a0069550 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c007440 con 0x7fe3a0069550 2023-05-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0057a0 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3900092a0 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.584+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a00bbb50 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.585+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a0047150 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.586+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe39c010070 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.587+0000 7fe38dffb700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 0x7fe380061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.587+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fe39c079580 con 0x7fe3a0069550 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.587+0000 7fe3a5b19700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 msgr2=0x7fe380061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:42.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.587+0000 7fe3a5b19700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 0x7fe380061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:42.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.590+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe39c0488f0 con 0x7fe3a0069550 2023-05-10T01:24:42.605 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.602+0000 7f64a5eed680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:42.644 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:42.642+0000 7fede243b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:24:42.674 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.671+0000 7f64a5eed680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:42.722 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:42.719+0000 7fede243b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:24:42.788 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.785+0000 7f64a5eed680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.788+0000 7fe3a5b19700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 msgr2=0x7fe380061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.788+0000 7fe3a5b19700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 0x7fe380061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.809+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a00c16d0 con 0x7fe3a0069550 2023-05-10T01:24:42.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.810+0000 7fe38dffb700 1 -- 172.21.15.52:0/3301092487 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4493 (secure 0 0 0) 0x7fe3a00c16d0 con 0x7fe3a0069550 2023-05-10T01:24:42.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:42.812 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:20.422217+0000","modified":"2023-05-10T01:24:23.426686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6216":{"gid":6216,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2321787937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2321787937},{"type":"v1","addr":"172.21.15.172:6837","nonce":2321787937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-05-10T01:24:42.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 msgr2=0x7fe380061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 0x7fe380061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 msgr2=0x7fe3a00c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe39c00c4c0 tx=0x7fe39c007c10).stop 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 shutdown_connections 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe38005edb0 0x7fe380061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3a01541e0 0x7fe3a00c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a0065870 0x7fe3a0147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 --2- 172.21.15.52:0/3301092487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0069550 0x7fe3a00c59f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 >> 172.21.15.52:0/3301092487 conn(0x7fe3a0067f50 msgr2=0x7fe3a00c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 shutdown_connections 2023-05-10T01:24:42.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.811+0000 7fe3a6b1b700 1 -- 172.21.15.52:0/3301092487 wait complete. 2023-05-10T01:24:42.816 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2023-05-10T01:24:42.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:42.876 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:42.874+0000 7fede243b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:24:42.894 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:42.892+0000 7f64a5eed680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.944+0000 7f2eb214a700 1 Processor -- start 2023-05-10T01:24:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.944+0000 7f2eb214a700 1 -- start start 2023-05-10T01:24:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb214a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2eac0694e0 0x7f2eac0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb214a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac063040 con 0x7f2eac153e30 2023-05-10T01:24:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb214a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0c80d0 con 0x7f2eac153a50 2023-05-10T01:24:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb214a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0c7ec0 con 0x7f2eac0694e0 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb0947700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2eac0694e0 0x7f2eac0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb1949700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2eac153e30 0x7f2eac1542a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44638/0 (socket says 172.21.15.52:44638) 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb1949700 1 -- 172.21.15.52:0/3077754617 learned_addr learned my addr 172.21.15.52:0/3077754617 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb0947700 1 -- 172.21.15.52:0/3077754617 >> v1:172.21.15.172:6789/0 conn(0x7f2eac153a50 legacy=0x7f2eac064030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb0947700 1 -- 172.21.15.52:0/3077754617 >> v1:172.21.15.52:6789/0 conn(0x7f2eac153e30 legacy=0x7f2eac1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2e9bfff700 1 -- 172.21.15.52:0/3077754617 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446023769 0 0) 0x7f2eac063040 con 0x7f2eac153e30 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.945+0000 7f2eb0947700 1 -- 172.21.15.52:0/3077754617 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0c83b0 con 0x7f2eac0694e0 2023-05-10T01:24:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb0947700 1 --2- 172.21.15.52:0/3077754617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0629b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f2e9c009760 tx=0x7f2e9c009060).ready entity=mon.0 client_cookie=fd8acdf8d189cb2f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2e9bfff700 1 -- 172.21.15.52:0/3077754617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00b580 con 0x7f2eac0694e0 2023-05-10T01:24:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2e9bfff700 1 -- 172.21.15.52:0/3077754617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c00b6e0 con 0x7f2eac0694e0 2023-05-10T01:24:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2e9bfff700 1 -- 172.21.15.52:0/3077754617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00ba60 con 0x7f2eac0694e0 2023-05-10T01:24:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 -- 172.21.15.52:0/3077754617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 msgr2=0x7f2eac0629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 --2- 172.21.15.52:0/3077754617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0629b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f2e9c009760 tx=0x7f2e9c009060).stop 2023-05-10T01:24:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 -- 172.21.15.52:0/3077754617 shutdown_connections 2023-05-10T01:24:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 --2- 172.21.15.52:0/3077754617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0629b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 -- 172.21.15.52:0/3077754617 >> 172.21.15.52:0/3077754617 conn(0x7f2eac05e810 msgr2=0x7f2eac0622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 -- 172.21.15.52:0/3077754617 shutdown_connections 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.946+0000 7f2eb214a700 1 -- 172.21.15.52:0/3077754617 wait complete. 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.947+0000 7f2eb214a700 1 Processor -- start 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.947+0000 7f2eb214a700 1 -- start start 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eac153a50 0x7f2eac0bef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2eac153e30 0x7f2eac0a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0a5940 con 0x7f2eac0694e0 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0c3a80 con 0x7f2eac153a50 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb214a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0a4dc0 con 0x7f2eac153e30 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb1148700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb1148700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35624/0 (socket says 172.21.15.52:35624) 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.948+0000 7f2eb1148700 1 -- 172.21.15.52:0/1559714872 learned_addr learned my addr 172.21.15.52:0/1559714872 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb0947700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eac153a50 0x7f2eac0bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1949700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2eac153e30 0x7f2eac0a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 -- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2eac153e30 msgr2=0x7f2eac0a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2eac153e30 0x7f2eac0a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 -- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eac153a50 msgr2=0x7f2eac0bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eac153a50 0x7f2eac0bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 -- 172.21.15.52:0/1559714872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0092a0 con 0x7f2eac0694e0 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb1148700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f2ea800c4c0 tx=0x7f2ea8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800ce70 con 0x7f2eac0694e0 2023-05-10T01:24:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8001e90 con 0x7f2eac0694e0 2023-05-10T01:24:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0a5100 con 0x7f2eac0694e0 2023-05-10T01:24:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007250 con 0x7f2eac0694e0 2023-05-10T01:24:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.949+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac0c2220 con 0x7f2eac0694e0 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.950+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac047150 con 0x7f2eac0694e0 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.951+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2ea8010070 con 0x7f2eac0694e0 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.951+0000 7f2e997fa700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 0x7f2e8c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.951+0000 7f2eb0947700 1 -- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 msgr2=0x7f2e8c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.951+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f2ea80795d0 con 0x7f2eac0694e0 2023-05-10T01:24:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.951+0000 7f2eb0947700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 0x7f2e8c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:42.958 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:42.953+0000 7fede243b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:24:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:42.955+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ea804a8f0 con 0x7f2eac0694e0 2023-05-10T01:24:43.078 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:43.075+0000 7fede243b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:24:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.130+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eac0bdcd0 con 0x7f2eac0694e0 2023-05-10T01:24:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.131+0000 7f2e997fa700 1 -- 172.21.15.52:0/1559714872 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17678 (secure 0 0 0) 0x7f2ea804df10 con 0x7f2eac0694e0 2023-05-10T01:24:43.134 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:43.134 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:37.000341+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:18.967401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:19.384615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3367984383":"2023-05-11T01:24:37.000297+0000","172.21.15.172:0/1287555803":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6833/116173":"2023-05-11T01:24:37.000297+0000","172.21.15.172:6832/116173":"2023-05-11T01:24:37.000297+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 msgr2=0x7f2e8c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 0x7f2e8c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 msgr2=0x7f2eac0c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f2ea800c4c0 tx=0x7f2ea8007e00).stop 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 shutdown_connections 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f2e8c05ede0 0x7f2e8c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2eac153e30 0x7f2eac0a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eac0694e0 0x7f2eac0c1d30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 --2- 172.21.15.52:0/1559714872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eac153a50 0x7f2eac0bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 >> 172.21.15.52:0/1559714872 conn(0x7f2eac05e810 msgr2=0x7f2eac1564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 shutdown_connections 2023-05-10T01:24:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.133+0000 7f2eb214a700 1 -- 172.21.15.52:0/1559714872 wait complete. 2023-05-10T01:24:43.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:24:43.190 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:43.188+0000 7f64a5eed680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:43.193 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:43.190+0000 7fede243b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:24:43.260 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:43.257+0000 7f64a5eed680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:43.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.265+0000 7f7041c42700 1 Processor -- start 2023-05-10T01:24:43.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.265+0000 7f7041c42700 1 -- start start 2023-05-10T01:24:43.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.266+0000 7f7041c42700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 0x7f703c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.266+0000 7f7041c42700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 0x7f703c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.266+0000 7f7041c42700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0683c0 con 0x7f703c0672a0 2023-05-10T01:24:43.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.266+0000 7f7041c42700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c137460 con 0x7f703c066e40 2023-05-10T01:24:43.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.266+0000 7f7041c42700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0c3510 con 0x7f703c14e1f0 2023-05-10T01:24:43.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 0x7f703c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f703c0672a0 0x7f703c154480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:47190/0 (socket says 172.21.15.52:47190) 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703bfff700 1 -- 172.21.15.52:0/1017208878 learned_addr learned my addr 172.21.15.52:0/1017208878 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 0x7f703c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703a7fc700 1 -- 172.21.15.52:0/1017208878 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736261861 0 0) 0x7f703c0683c0 con 0x7f703c0672a0 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703a7fc700 1 -- 172.21.15.52:0/1017208878 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f701c0033f0 con 0x7f703c0672a0 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 -- 172.21.15.52:0/1017208878 >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 msgr2=0x7f703c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:43.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 --2- 172.21.15.52:0/1017208878 >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 0x7f703c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 -- 172.21.15.52:0/1017208878 >> v1:172.21.15.172:6789/0 conn(0x7f703c0672a0 legacy=0x7f703c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 -- 172.21.15.52:0/1017208878 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0be050 con 0x7f703c14e1f0 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703affd700 1 --2- 172.21.15.52:0/1017208878 >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 0x7f703c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703b7fe700 1 --2- 172.21.15.52:0/1017208878 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 0x7f703c14e5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7024009760 tx=0x7f7024009060).ready entity=mon.2 client_cookie=9b1cab5381f7ab49 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703a7fc700 1 -- 172.21.15.52:0/1017208878 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400d4a0 con 0x7f703c14e1f0 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703a7fc700 1 -- 172.21.15.52:0/1017208878 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400d600 con 0x7f703c14e1f0 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.267+0000 7f703a7fc700 1 -- 172.21.15.52:0/1017208878 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400d980 con 0x7f703c14e1f0 2023-05-10T01:24:43.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 -- 172.21.15.52:0/1017208878 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 msgr2=0x7f703c14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 --2- 172.21.15.52:0/1017208878 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 0x7f703c14e5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7024009760 tx=0x7f7024009060).stop 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 -- 172.21.15.52:0/1017208878 shutdown_connections 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 --2- 172.21.15.52:0/1017208878 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c14e1f0 0x7f703c14e5d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 --2- 172.21.15.52:0/1017208878 >> v2:172.21.15.172:3300/0 conn(0x7f703c066e40 0x7f703c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 -- 172.21.15.52:0/1017208878 >> 172.21.15.52:0/1017208878 conn(0x7f703c0c7bb0 msgr2=0x7f703c0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 -- 172.21.15.52:0/1017208878 shutdown_connections 2023-05-10T01:24:43.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.268+0000 7f7041c42700 1 -- 172.21.15.52:0/1017208878 wait complete. 2023-05-10T01:24:43.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 Processor -- start 2023-05-10T01:24:43.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 -- start start 2023-05-10T01:24:43.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c066e40 0x7f703c0c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0bef80 con 0x7f703c14e1f0 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0bf240 con 0x7f703c0672a0 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f7041c42700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0bf520 con 0x7f703c066e40 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f703bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.270+0000 7f703affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c066e40 0x7f703c0c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:43.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35642/0 (socket says 172.21.15.52:35642) 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:33964/0 (socket says 172.21.15.52:33964) 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 -- 172.21.15.52:0/478484345 learned_addr learned my addr 172.21.15.52:0/478484345 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c066e40 msgr2=0x7f703c0c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c066e40 0x7f703c0c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 msgr2=0x7f703c0c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 -- 172.21.15.52:0/478484345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0092a0 con 0x7f703c14e1f0 2023-05-10T01:24:43.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703affd700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f703bfff700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f703400c790 tx=0x7f7034007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034005d30 con 0x7f703c14e1f0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70240092a0 con 0x7f703c14e1f0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034005e90 con 0x7f703c14e1f0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c0bfae0 con 0x7f703c14e1f0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.271+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034007320 con 0x7f703c14e1f0 2023-05-10T01:24:43.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.272+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c0bfd00 con 0x7f703c14e1f0 2023-05-10T01:24:43.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.275+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 28) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f7034010030 con 0x7f703c14e1f0 2023-05-10T01:24:43.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.276+0000 7f70337fe700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:43.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.276+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f703407a3f0 con 0x7f703c14e1f0 2023-05-10T01:24:43.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.276+0000 7f703b7fe700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 msgr2=0x7f70200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:43.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.276+0000 7f703b7fe700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:24:43.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.279+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f703404b5b0 con 0x7f703c14e1f0 2023-05-10T01:24:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.477+0000 7f703b7fe700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 msgr2=0x7f70200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.477+0000 7f703b7fe700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:24:43.497 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:43.495+0000 7fede243b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:24:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.502+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f703c06c340 con 0x7f703c14e1f0 2023-05-10T01:24:43.571 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:24:43.569+0000 7fede243b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:24:43.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.878+0000 7f703b7fe700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 msgr2=0x7f70200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:24:43.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:43.878+0000 7f703b7fe700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:24:44.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.083+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 29) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f703407a080 con 0x7f703c14e1f0 2023-05-10T01:24:44.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.083+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 msgr2=0x7f70200612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:24:44.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.083+0000 7f70337fe700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:44.143 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6425ed2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6425ed2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6425ed2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6425ed2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6425ed2700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6428ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6428ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.145 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6428ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.145 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6428ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.145 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:24:44.140+0000 7f6428ed8700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:24:44.146 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:44.146 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:44.146 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:24:44.149 INFO:tasks.ceph.mds.d.smithi172.stderr: -2465> 2023-05-10T01:24:21.523+0000 7fd7ca918700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:24:44.152 INFO:tasks.ceph.mds.d.smithi172.stderr: -4> 2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:44.153 INFO:tasks.ceph.mds.d.smithi172.stderr: -3> 2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:24:44.153 INFO:tasks.ceph.mds.d.smithi172.stderr: -1> 2023-05-10T01:24:44.143+0000 7fd7c7111700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:24:44.171 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:24:44.274 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:24:44.272+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:24:44.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.274+0000 7f70337fe700 1 -- 172.21.15.52:0/478484345 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70340735a0 con 0x7f703c14e1f0 2023-05-10T01:24:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 msgr2=0x7f703c0c0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f703400c790 tx=0x7f7034007f90).stop 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 shutdown_connections 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f702005ede0 0x7f70200612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f703c14e1f0 0x7f703c0c0c00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f703c066e40 0x7f703c0c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 --2- 172.21.15.52:0/478484345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f703c0672a0 0x7f703c0c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 >> 172.21.15.52:0/478484345 conn(0x7f703c0c7bb0 msgr2=0x7f703c136b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 shutdown_connections 2023-05-10T01:24:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.277+0000 7f7041c42700 1 -- 172.21.15.52:0/478484345 wait complete. 2023-05-10T01:24:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:24:44.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:24:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 Processor -- start 2023-05-10T01:24:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 -- start start 2023-05-10T01:24:44.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fd0154080 0x7f8fd00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 0x7f8fd00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00c94c0 con 0x7f8fd00aa140 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00aa590 con 0x7f8fd0154080 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.416+0000 7f8fd6241700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00cb7d0 con 0x7f8fd0154460 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fd0154080 0x7f8fd00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8fd00aa140 0x7f8fd0068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44674/0 (socket says 172.21.15.52:44674) 2023-05-10T01:24:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fd0154080 0x7f8fd00aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35654/0 (socket says 172.21.15.52:35654) 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcffff700 1 -- 172.21.15.52:0/1856319196 learned_addr learned my addr 172.21.15.52:0/1856319196 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1856319196 >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 0x7f8fd00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1856319196 >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 msgr2=0x7f8fd00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 --2- 172.21.15.52:0/1856319196 >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 0x7f8fd00a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fce7fc700 1 -- 172.21.15.52:0/1856319196 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232029222 0 0) 0x7f8fd00c94c0 con 0x7f8fd00aa140 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1856319196 >> v1:172.21.15.52:6789/0 conn(0x7f8fd00aa140 legacy=0x7f8fd0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1856319196 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00c88b0 con 0x7f8fd0154080 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1856319196 >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 0x7f8fd00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fcf7fe700 1 --2- 172.21.15.52:0/1856319196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd0154080 0x7f8fd00aac90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f8fd0084310 tx=0x7f8fc4009060).ready entity=mon.0 client_cookie=cdacfd4df9a38602 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fce7fc700 1 -- 172.21.15.52:0/1856319196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400b580 con 0x7f8fd0154080 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fce7fc700 1 -- 172.21.15.52:0/1856319196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc400b6e0 con 0x7f8fd0154080 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.417+0000 7f8fce7fc700 1 -- 172.21.15.52:0/1856319196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400ba60 con 0x7f8fd0154080 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 -- 172.21.15.52:0/1856319196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd0154080 msgr2=0x7f8fd00aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1856319196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd0154080 0x7f8fd00aac90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f8fd0084310 tx=0x7f8fc4009060).stop 2023-05-10T01:24:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 -- 172.21.15.52:0/1856319196 shutdown_connections 2023-05-10T01:24:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1856319196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd0154080 0x7f8fd00aac90 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1856319196 >> v2:172.21.15.172:3300/0 conn(0x7f8fd0154460 0x7f8fd00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 -- 172.21.15.52:0/1856319196 >> 172.21.15.52:0/1856319196 conn(0x7f8fd0067910 msgr2=0x7f8fd00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 -- 172.21.15.52:0/1856319196 shutdown_connections 2023-05-10T01:24:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.418+0000 7f8fd6241700 1 -- 172.21.15.52:0/1856319196 wait complete. 2023-05-10T01:24:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.419+0000 7f8fd6241700 1 Processor -- start 2023-05-10T01:24:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.419+0000 7f8fd6241700 1 -- start start 2023-05-10T01:24:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 0x7f8fd00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd0154460 0x7f8fd014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00aea80 con 0x7f8fd00aa140 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01511c0 con 0x7f8fd0154080 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fd6241700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0154c50 con 0x7f8fd0154460 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35660/0 (socket says 172.21.15.52:35660) 2023-05-10T01:24:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1983392428 learned_addr learned my addr 172.21.15.52:0/1983392428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcffff700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd0154460 0x7f8fd014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 0x7f8fd00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd0154460 msgr2=0x7f8fd014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd0154460 0x7f8fd014c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 msgr2=0x7f8fd00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 0x7f8fd00af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 -- 172.21.15.52:0/1983392428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40092a0 con 0x7f8fd00aa140 2023-05-10T01:24:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 0x7f8fd00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.420+0000 7f8fcf7fe700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f8fd006bb20 tx=0x7f8fc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.421+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400b850 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.421+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc400b9b0 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.421+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd00afcb0 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.421+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc401b660 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.421+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd00b01e0 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.422+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd0066720 con 0x7f8fd00aa140 2023-05-10T01:24:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.422+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 29) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f8fc402b070 con 0x7f8fd00aa140 2023-05-10T01:24:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.422+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f8fc407b610 con 0x7f8fd00aa140 2023-05-10T01:24:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.427+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fc404c970 con 0x7f8fd00aa140 2023-05-10T01:24:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:44.650+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8fd006bd30 con 0x7f8fd00aa140 2023-05-10T01:24:45.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.087+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f8fc4021030 con 0x7f8fd00aa140 2023-05-10T01:24:45.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.087+0000 7f8fb77fe700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 0x7f8fb0067930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.088+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 0x7f8fb0067930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.090+0000 7f8fceffd700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 0x7f8fb0067930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8fc0006fd0 tx=0x7f8fc0008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:45.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.276+0000 7f8fb77fe700 1 -- 172.21.15.52:0/1983392428 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fc4054440 con 0x7f8fd00aa140 2023-05-10T01:24:45.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 msgr2=0x7f8fb0067930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 0x7f8fb0067930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8fc0006fd0 tx=0x7f8fc0008040).stop 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 msgr2=0x7f8fd0156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f8fd006bb20 tx=0x7f8fc4017000).stop 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 shutdown_connections 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb00301b0 0x7f8fb0067930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd0154460 0x7f8fd014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fd00aa140 0x7f8fd0156db0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 --2- 172.21.15.52:0/1983392428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd0154080 0x7f8fd00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 >> 172.21.15.52:0/1983392428 conn(0x7f8fd0067910 msgr2=0x7f8fd00accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:45.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.278+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 shutdown_connections 2023-05-10T01:24:45.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.279+0000 7f8fd6241700 1 -- 172.21.15.52:0/1983392428 wait complete. 2023-05-10T01:24:45.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:24:45.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.422+0000 7f706631c700 1 Processor -- start 2023-05-10T01:24:45.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.422+0000 7f706631c700 1 -- start start 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f706631c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 0x7f70600c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f706631c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 0x7f7060154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f706631c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70600c6570 con 0x7f7060153ff0 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f706631c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70600c9110 con 0x7f70600c5bd0 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f706631c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600ca5b0 con 0x7f70601543d0 2023-05-10T01:24:45.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705ffff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7060153ff0 0x7f7060068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:47238/0 (socket says 172.21.15.52:47238) 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705ffff700 1 -- 172.21.15.52:0/3171439477 learned_addr learned my addr 172.21.15.52:0/3171439477 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f70648b9700 1 --2- 172.21.15.52:0/3171439477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 0x7f7060154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705f7fe700 1 --2- 172.21.15.52:0/3171439477 >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 0x7f70600c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705effd700 1 -- 172.21.15.52:0/3171439477 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652318137 0 0) 0x7f7050001160 con 0x7f7060153ff0 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705effd700 1 -- 172.21.15.52:0/3171439477 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f704c0033f0 con 0x7f7060153ff0 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f70648b9700 1 -- 172.21.15.52:0/3171439477 >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 msgr2=0x7f70600c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:45.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f70648b9700 1 --2- 172.21.15.52:0/3171439477 >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 0x7f70600c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f70648b9700 1 -- 172.21.15.52:0/3171439477 >> v1:172.21.15.172:6789/0 conn(0x7f7060153ff0 legacy=0x7f7060068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f70648b9700 1 -- 172.21.15.52:0/3171439477 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600c8820 con 0x7f70601543d0 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.423+0000 7f705f7fe700 1 --2- 172.21.15.52:0/3171439477 >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 0x7f70600c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f70648b9700 1 --2- 172.21.15.52:0/3171439477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 0x7f7060154840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7058009e60 tx=0x7f7058009780).ready entity=mon.2 client_cookie=f8b0239105214c24 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f705effd700 1 -- 172.21.15.52:0/3171439477 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800e070 con 0x7f70601543d0 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f705effd700 1 -- 172.21.15.52:0/3171439477 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705800bab0 con 0x7f70601543d0 2023-05-10T01:24:45.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f705effd700 1 -- 172.21.15.52:0/3171439477 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800be30 con 0x7f70601543d0 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 -- 172.21.15.52:0/3171439477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 msgr2=0x7f7060154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 --2- 172.21.15.52:0/3171439477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 0x7f7060154840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7058009e60 tx=0x7f7058009780).stop 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 -- 172.21.15.52:0/3171439477 shutdown_connections 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 --2- 172.21.15.52:0/3171439477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70601543d0 0x7f7060154840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 --2- 172.21.15.52:0/3171439477 >> v2:172.21.15.172:3300/0 conn(0x7f70600c5bd0 0x7f70600c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 -- 172.21.15.52:0/3171439477 >> 172.21.15.52:0/3171439477 conn(0x7f70600678d0 msgr2=0x7f70600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 -- 172.21.15.52:0/3171439477 shutdown_connections 2023-05-10T01:24:45.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.424+0000 7f706631c700 1 -- 172.21.15.52:0/3171439477 wait complete. 2023-05-10T01:24:45.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.425+0000 7f706631c700 1 Processor -- start 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 -- start start 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70600c5bd0 0x7f70600c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7060153ff0 0x7f70600ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c3e50 con 0x7f70601543d0 2023-05-10T01:24:45.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c3240 con 0x7f70600c5bd0 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.426+0000 7f706631c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c3520 con 0x7f7060153ff0 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35694/0 (socket says 172.21.15.52:35694) 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 -- 172.21.15.52:0/1232261990 learned_addr learned my addr 172.21.15.52:0/1232261990 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f705f7fe700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7060153ff0 0x7f70600ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f705ffff700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70600c5bd0 0x7f70600c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 -- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7060153ff0 msgr2=0x7f70600ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7060153ff0 0x7f70600ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 -- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70600c5bd0 msgr2=0x7f70600c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70600c5bd0 0x7f70600c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 -- 172.21.15.52:0/1232261990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540092a0 con 0x7f70601543d0 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f70648b9700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f70600ca6f0 tx=0x7f70600c9250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705801d630 con 0x7f70601543d0 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705801d790 con 0x7f70601543d0 2023-05-10T01:24:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705801db30 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7058009a20 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.427+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70600c3ae0 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.428+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600c4000 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.429+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 30) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f7058027460 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.429+0000 7f7047fff700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 0x7f70400611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.429+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f705807c010 con 0x7f70601543d0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.429+0000 7f705ffff700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 0x7f70400611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.430+0000 7f705ffff700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 0x7f70400611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f70500012c0 tx=0x7f7050009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:45.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.433+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70600c4000 con 0x7f70601543d0 2023-05-10T01:24:45.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:45.608+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7060066720 con 0x7f70601543d0 2023-05-10T01:24:46.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.282+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7058079d50 con 0x7f70601543d0 2023-05-10T01:24:46.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.523+0000 7f7047fff700 1 -- 172.21.15.52:0/1232261990 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f70580428f0 con 0x7f70601543d0 2023-05-10T01:24:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.527+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 msgr2=0x7f70400611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.527+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 0x7f70400611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f70500012c0 tx=0x7f7050009040).stop 2023-05-10T01:24:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.527+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 msgr2=0x7f70600aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.527+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f70600ca6f0 tx=0x7f70600c9250).stop 2023-05-10T01:24:46.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 shutdown_connections 2023-05-10T01:24:46.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f704005ecf0 0x7f70400611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70601543d0 0x7f70600aeaf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70600c5bd0 0x7f70600c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 --2- 172.21.15.52:0/1232261990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7060153ff0 0x7f70600ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 >> 172.21.15.52:0/1232261990 conn(0x7f70600678d0 msgr2=0x7f70600c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 shutdown_connections 2023-05-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.528+0000 7f706631c700 1 -- 172.21.15.52:0/1232261990 wait complete. 2023-05-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:24:46.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:24:46.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.671+0000 7f7154161700 1 Processor -- start 2023-05-10T01:24:46.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.671+0000 7f7154161700 1 -- start start 2023-05-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7154161700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f714c154080 0x7f714c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7154161700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f714c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7154161700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0c94c0 con 0x7f714c154460 2023-05-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7154161700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0cb7d0 con 0x7f714c154080 2023-05-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7154161700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c068a90 con 0x7f714c068150 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f71516fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f714c154460 0x7f714c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44716/0 (socket says 172.21.15.52:44716) 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f71516fc700 1 -- 172.21.15.52:0/1353749388 learned_addr learned my addr 172.21.15.52:0/1353749388 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f71526fe700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f714c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.672+0000 7f7151efd700 1 --2- 172.21.15.52:0/1353749388 >> v2:172.21.15.172:3300/0 conn(0x7f714c154080 0x7f714c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073353738 0 0) 0x7f714c0c94c0 con 0x7f714c154460 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71380033f0 con 0x7f714c154460 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3590641445 0 0) 0x7f71380033f0 con 0x7f714c154460 2023-05-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 msgr2=0x7f714c0685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f714c0685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 >> v2:172.21.15.172:3300/0 conn(0x7f714c154080 msgr2=0x7f714c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 --2- 172.21.15.52:0/1353749388 >> v2:172.21.15.172:3300/0 conn(0x7f714c154080 0x7f714c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0c88b0 con 0x7f714c154460 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7140001470 con 0x7f714c154460 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 >> v1:172.21.15.52:6789/0 conn(0x7f714c154460 legacy=0x7f714c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f71380038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f7138004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7138004b80 0x7f7138005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0cb7d0 con 0x7f7138003e10 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c068a90 con 0x7f7138004b80 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713800b8e0 con 0x7f714c068150 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f7138004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f7151efd700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f71380038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71526fe700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7138004b80 0x7f7138005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 -- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 msgr2=0x7f71380038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c068150 0x7f71380038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 -- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7138004b80 msgr2=0x7f7138005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7138004b80 0x7f7138005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 -- 172.21.15.52:0/1353749388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380033f0 con 0x7f7138003e10 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.673+0000 7f71516fc700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f7138004690 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f714000c240 tx=0x7f7140001e90).ready entity=mon.0 client_cookie=728720eb40e9c44c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140007a60 con 0x7f7138003e10 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000cad0 con 0x7f7138003e10 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7150efb700 1 -- 172.21.15.52:0/1353749388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000ce90 con 0x7f7138003e10 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 -- 172.21.15.52:0/1353749388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 msgr2=0x7f7138004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 --2- 172.21.15.52:0/1353749388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f7138004690 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f714000c240 tx=0x7f7140001e90).stop 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f71526fe700 1 -- 172.21.15.52:0/1353749388 reap_dead start 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 -- 172.21.15.52:0/1353749388 shutdown_connections 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 -- 172.21.15.52:0/1353749388 >> 172.21.15.52:0/1353749388 conn(0x7f714c067910 msgr2=0x7f714c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 -- 172.21.15.52:0/1353749388 shutdown_connections 2023-05-10T01:24:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.674+0000 7f7154161700 1 -- 172.21.15.52:0/1353749388 wait complete. 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.675+0000 7f7154161700 1 Processor -- start 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.675+0000 7f7154161700 1 -- start start 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f714c14f170 0x7f714c0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 0x7f714c0aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0aa5c0 con 0x7f7138003e10 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0c2b70 con 0x7f714c14f170 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7154161700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0c1cc0 con 0x7f714c14f5f0 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35710/0 (socket says 172.21.15.52:35710) 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 -- 172.21.15.52:0/3630581277 learned_addr learned my addr 172.21.15.52:0/3630581277 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f71516fc700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f714c14f170 0x7f714c0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f71526fe700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 0x7f714c0aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 -- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 msgr2=0x7f714c0aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 0x7f714c0aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 -- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f714c14f170 msgr2=0x7f714c0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.676+0000 7f7151efd700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f714c14f170 0x7f714c0a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7151efd700 1 -- 172.21.15.52:0/3630581277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c14ff30 con 0x7f7138003e10 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f71526fe700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 0x7f714c0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7151efd700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f7144011f80 tx=0x7f714400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:46.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400e040 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400f040 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c0c1f60 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144015450 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.677+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c0c2520 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.678+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c066720 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.678+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7144015800 con 0x7f7138003e10 2023-05-10T01:24:46.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.679+0000 7f7149ffb700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 0x7f712c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:46.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.679+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f714407adb0 con 0x7f7138003e10 2023-05-10T01:24:46.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.679+0000 7f71516fc700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 0x7f712c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:46.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.679+0000 7f71516fc700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 0x7f712c061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f714000c160 tx=0x7f7140015000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:46.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.683+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f714404c220 con 0x7f7138003e10 2023-05-10T01:24:46.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:46.856+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f714c06c340 con 0x7f7138003e10 2023-05-10T01:24:47.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.524+0000 7f7149ffb700 1 -- 172.21.15.52:0/3630581277 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f714404f840 con 0x7f7138003e10 2023-05-10T01:24:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 msgr2=0x7f712c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 0x7f712c061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f714000c160 tx=0x7f7140015000).stop 2023-05-10T01:24:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 msgr2=0x7f714c14fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f7144011f80 tx=0x7f714400b040).stop 2023-05-10T01:24:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 shutdown_connections 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f712c05ed90 0x7f712c061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f714c14f5f0 0x7f714c0aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7138003e10 0x7f714c14fa40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 --2- 172.21.15.52:0/3630581277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f714c14f170 0x7f714c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.529+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 >> 172.21.15.52:0/3630581277 conn(0x7f714c067910 msgr2=0x7f714c0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.530+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 shutdown_connections 2023-05-10T01:24:47.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.530+0000 7f7154161700 1 -- 172.21.15.52:0/3630581277 wait complete. 2023-05-10T01:24:47.534 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:24:47.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:24:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.669+0000 7ff3c6d3c700 1 Processor -- start 2023-05-10T01:24:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.669+0000 7ff3c6d3c700 1 -- start start 2023-05-10T01:24:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c6d3c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3c00bdf10 0x7ff3c00698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c6d3c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c005e750 con 0x7ff3c0153ba0 2023-05-10T01:24:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c6d3c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c0069ee0 con 0x7ff3c0153f80 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c6d3c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00bf530 con 0x7ff3c00bdf10 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5539700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3c00bdf10 0x7ff3c00698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5539700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3c00bdf10 0x7ff3c00698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35720/0 (socket says 172.21.15.52:35720) 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5539700 1 -- 172.21.15.52:0/3858503761 learned_addr learned my addr 172.21.15.52:0/3858503761 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5d3a700 1 --1- 172.21.15.52:0/3858503761 >> v1:172.21.15.52:6789/0 conn(0x7ff3c0153ba0 0x7ff3c00bd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44734/0 (socket says 172.21.15.52:44734) 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5539700 1 -- 172.21.15.52:0/3858503761 >> v1:172.21.15.172:6789/0 conn(0x7ff3c0153f80 legacy=0x7ff3c00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c5539700 1 -- 172.21.15.52:0/3858503761 >> v1:172.21.15.52:6789/0 conn(0x7ff3c0153ba0 legacy=0x7ff3c00bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.670+0000 7ff3c4d38700 1 -- 172.21.15.52:0/3858503761 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121583313 0 0) 0x7ff3c005e750 con 0x7ff3c0153ba0 2023-05-10T01:24:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c5539700 1 -- 172.21.15.52:0/3858503761 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0158450 con 0x7ff3c00bdf10 2023-05-10T01:24:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c5539700 1 --2- 172.21.15.52:0/3858503761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c00bdf10 0x7ff3c00698b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff3b0006fd0 tx=0x7ff3b00090f0).ready entity=mon.0 client_cookie=38620d4f7928449d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c4d38700 1 -- 172.21.15.52:0/3858503761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000b600 con 0x7ff3c00bdf10 2023-05-10T01:24:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c4d38700 1 -- 172.21.15.52:0/3858503761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000b760 con 0x7ff3c00bdf10 2023-05-10T01:24:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c4d38700 1 -- 172.21.15.52:0/3858503761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000bae0 con 0x7ff3c00bdf10 2023-05-10T01:24:47.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3858503761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c00bdf10 msgr2=0x7ff3c00698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3858503761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c00bdf10 0x7ff3c00698b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff3b0006fd0 tx=0x7ff3b00090f0).stop 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3858503761 shutdown_connections 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3858503761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c00bdf10 0x7ff3c00698b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3858503761 >> 172.21.15.52:0/3858503761 conn(0x7ff3c0062d70 msgr2=0x7ff3c005dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3858503761 shutdown_connections 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.671+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3858503761 wait complete. 2023-05-10T01:24:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.672+0000 7ff3c6d3c700 1 Processor -- start 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 -- start start 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3c00bdf10 0x7ff3c0142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c0153f80 0x7ff3c00c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00c5260 con 0x7ff3c0153ba0 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c01653f0 con 0x7ff3c0153f80 2023-05-10T01:24:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c6d3c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0156820 con 0x7ff3c00bdf10 2023-05-10T01:24:47.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c5539700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c5539700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35726/0 (socket says 172.21.15.52:35726) 2023-05-10T01:24:47.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.673+0000 7ff3c5539700 1 -- 172.21.15.52:0/3218500741 learned_addr learned my addr 172.21.15.52:0/3218500741 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:47.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5d3a700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3c00bdf10 0x7ff3c0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c653b700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c0153f80 0x7ff3c00c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 -- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3c00bdf10 msgr2=0x7ff3c0142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3c00bdf10 0x7ff3c0142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 -- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c0153f80 msgr2=0x7ff3c00c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c0153f80 0x7ff3c00c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 -- 172.21.15.52:0/3218500741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009370 con 0x7ff3c0153ba0 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c5539700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff3b0011000 tx=0x7ff3b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000bae0 con 0x7ff3c0153ba0 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0000c90 con 0x7ff3c0153ba0 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c0156b00 con 0x7ff3c0153ba0 2023-05-10T01:24:47.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b001c670 con 0x7ff3c0153ba0 2023-05-10T01:24:47.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.674+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c0156530 con 0x7ff3c0153ba0 2023-05-10T01:24:47.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.675+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c0047150 con 0x7ff3c0153ba0 2023-05-10T01:24:47.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.676+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff3b002c070 con 0x7ff3c0153ba0 2023-05-10T01:24:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.676+0000 7ff3adffb700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.676+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7ff3b007b800 con 0x7ff3c0153ba0 2023-05-10T01:24:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.676+0000 7ff3c5d3a700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.677+0000 7ff3c5d3a700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 0x7ff3a0061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3b8007fd0 tx=0x7ff3b8007dd0).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.680+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3b004ce10 con 0x7ff3c0153ba0 2023-05-10T01:24:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.853+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff3c0158730 con 0x7ff3c0153ba0 2023-05-10T01:24:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.857+0000 7ff3adffb700 1 -- 172.21.15.52:0/3218500741 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v12) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff3b002a070 con 0x7ff3c0153ba0 2023-05-10T01:24:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 msgr2=0x7ff3a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 0x7ff3a0061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3b8007fd0 tx=0x7ff3b8007dd0).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 msgr2=0x7ff3c00c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff3b0011000 tx=0x7ff3b0017000).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 shutdown_connections 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c0153f80 0x7ff3c00c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3c00bdf10 0x7ff3c0142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 --2- 172.21.15.52:0/3218500741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3c0153ba0 0x7ff3c00c4880 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 >> 172.21.15.52:0/3218500741 conn(0x7ff3c0062d70 msgr2=0x7ff3c00c3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 shutdown_connections 2023-05-10T01:24:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.859+0000 7ff3c6d3c700 1 -- 172.21.15.52:0/3218500741 wait complete. 2023-05-10T01:24:47.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:24:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.988+0000 7f7f0c206700 1 Processor -- start 2023-05-10T01:24:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.989+0000 7f7f0c206700 1 -- start start 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.989+0000 7f7f0c206700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f040aa200 0x7f7f040c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.989+0000 7f7f0c206700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040ca5f0 con 0x7f7f04153a90 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.989+0000 7f7f0c206700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f041545f0 con 0x7f7f040c5d20 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.989+0000 7f7f0c206700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040c8820 con 0x7f7f040aa200 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f040aa200 0x7f7f040c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f040aa200 0x7f7f040c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35736/0 (socket says 172.21.15.52:35736) 2023-05-10T01:24:47.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f0a7a3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7f04153a90 0x7f7f04153ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44750/0 (socket says 172.21.15.52:44750) 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 -- 172.21.15.52:0/2669820218 learned_addr learned my addr 172.21.15.52:0/2669820218 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 -- 172.21.15.52:0/2669820218 >> v1:172.21.15.172:6789/0 conn(0x7f7f040c5d20 legacy=0x7f7f04069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 -- 172.21.15.52:0/2669820218 >> v1:172.21.15.52:6789/0 conn(0x7f7f04153a90 legacy=0x7f7f04153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f08fa0700 1 -- 172.21.15.52:0/2669820218 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629543261 0 0) 0x7f7f040ca5f0 con 0x7f7f04153a90 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 -- 172.21.15.52:0/2669820218 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040c8b00 con 0x7f7f040aa200 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f097a1700 1 --2- 172.21.15.52:0/2669820218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f040aa200 0x7f7f040c6100 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7ef8006fd0 tx=0x7f7ef80090f0).ready entity=mon.0 client_cookie=921b6403c01b5692 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f08fa0700 1 -- 172.21.15.52:0/2669820218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800b600 con 0x7f7f040aa200 2023-05-10T01:24:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f08fa0700 1 -- 172.21.15.52:0/2669820218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef800b760 con 0x7f7f040aa200 2023-05-10T01:24:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.990+0000 7f7f08fa0700 1 -- 172.21.15.52:0/2669820218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800bae0 con 0x7f7f040aa200 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 -- 172.21.15.52:0/2669820218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f040aa200 msgr2=0x7f7f040c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 --2- 172.21.15.52:0/2669820218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f040aa200 0x7f7f040c6100 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7ef8006fd0 tx=0x7f7ef80090f0).stop 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 -- 172.21.15.52:0/2669820218 shutdown_connections 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 --2- 172.21.15.52:0/2669820218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f040aa200 0x7f7f040c6100 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 -- 172.21.15.52:0/2669820218 >> 172.21.15.52:0/2669820218 conn(0x7f7f040cb6f0 msgr2=0x7f7f040c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:47.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 -- 172.21.15.52:0/2669820218 shutdown_connections 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.991+0000 7f7f0c206700 1 -- 172.21.15.52:0/2669820218 wait complete. 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.992+0000 7f7f0c206700 1 Processor -- start 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.992+0000 7f7f0c206700 1 -- start start 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f040aa200 0x7f7f04148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f040c5d20 0x7f7f040afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04068b30 con 0x7f7f04153a90 2023-05-10T01:24:47.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040b08b0 con 0x7f7f040aa200 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040af3a0 con 0x7f7f040c5d20 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35742/0 (socket says 172.21.15.52:35742) 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 -- 172.21.15.52:0/3678736781 learned_addr learned my addr 172.21.15.52:0/3678736781 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f09fa2700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f040aa200 0x7f7f04148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f097a1700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f040c5d20 0x7f7f040afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 -- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f040c5d20 msgr2=0x7f7f040afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f040c5d20 0x7f7f040afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 -- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f040aa200 msgr2=0x7f7f04148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f040aa200 0x7f7f04148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 -- 172.21.15.52:0/3678736781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8009370 con 0x7f7f04153a90 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0a7a3700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7ef400c490 tx=0x7f7ef4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40070d0 con 0x7f7f04153a90 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4007230 con 0x7f7f04153a90 2023-05-10T01:24:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04148c70 con 0x7f7f04153a90 2023-05-10T01:24:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.993+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40056e0 con 0x7f7f04153a90 2023-05-10T01:24:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.994+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040aeb00 con 0x7f7f04153a90 2023-05-10T01:24:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.994+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04066720 con 0x7f7f04153a90 2023-05-10T01:24:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.995+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ef401a060 con 0x7f7f04153a90 2023-05-10T01:24:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.995+0000 7f7f01ffb700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 0x7f7ee4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.995+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7ef4079050 con 0x7f7f04153a90 2023-05-10T01:24:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.996+0000 7f7f09fa2700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 0x7f7ee4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:47.996+0000 7f7f09fa2700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 0x7f7ee4061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7efc004290 tx=0x7f7efc001560).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.000+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ef404a660 con 0x7f7f04153a90 2023-05-10T01:24:48.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.175+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7f040c8e10 con 0x7f7f04153a90 2023-05-10T01:24:48.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.178+0000 7f7f01ffb700 1 -- 172.21.15.52:0/3678736781 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ef404dc80 con 0x7f7f04153a90 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 msgr2=0x7f7ee4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 0x7f7ee4061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7efc004290 tx=0x7f7efc001560).stop 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 msgr2=0x7f7f040b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7ef400c490 tx=0x7f7ef4007e10).stop 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 shutdown_connections 2023-05-10T01:24:48.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7ee405ed90 0x7f7ee4061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f04153a90 0x7f7f040b03c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f040aa200 0x7f7f04148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 --2- 172.21.15.52:0/3678736781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f040c5d20 0x7f7f040afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 >> 172.21.15.52:0/3678736781 conn(0x7f7f040cb6f0 msgr2=0x7f7f040acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 shutdown_connections 2023-05-10T01:24:48.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.180+0000 7f7f0c206700 1 -- 172.21.15.52:0/3678736781 wait complete. 2023-05-10T01:24:48.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-05-10T01:24:48.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.308+0000 7f122f40e700 1 Processor -- start 2023-05-10T01:24:48.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.308+0000 7f122f40e700 1 -- start start 2023-05-10T01:24:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122f40e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f12280be4d0 0x7f1228064ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122f40e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12280bda00 con 0x7f12280654e0 2023-05-10T01:24:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122f40e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1228065950 con 0x7f1228138830 2023-05-10T01:24:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122f40e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1228068bd0 con 0x7f12280be4d0 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122d9ab700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f12280654e0 0x7f12280a7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44764/0 (socket says 172.21.15.52:44764) 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.309+0000 7f122d9ab700 1 -- 172.21.15.52:0/3319064706 learned_addr learned my addr 172.21.15.52:0/3319064706 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429662501 0 0) 0x7f12280bda00 con 0x7f12280654e0 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122c9a9700 1 --2- 172.21.15.52:0/3319064706 >> v2:172.21.15.172:3300/0 conn(0x7f12280be4d0 0x7f1228064ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12140033f0 con 0x7f12280654e0 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834327084 0 0) 0x7f12140033f0 con 0x7f12280654e0 2023-05-10T01:24:48.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 >> v2:172.21.15.172:3300/0 conn(0x7f12280be4d0 msgr2=0x7f1228064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 --2- 172.21.15.52:0/3319064706 >> v2:172.21.15.172:3300/0 conn(0x7f12280be4d0 0x7f1228064ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 >> v1:172.21.15.172:6789/0 conn(0x7f1228138830 legacy=0x7f1228066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228068eb0 con 0x7f12280654e0 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f12180017f0 con 0x7f12280654e0 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 >> v1:172.21.15.52:6789/0 conn(0x7f12280654e0 legacy=0x7f12280a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12140038e0 0x7f1214003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214004690 0x7f1214004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 0x7f121400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228068bd0 con 0x7f1214005000 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121400beb0 con 0x7f12140038e0 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121400c070 con 0x7f1214004690 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d9ab700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 0x7f121400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d1aa700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12140038e0 0x7f1214003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122c9a9700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214004690 0x7f1214004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d9ab700 1 -- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214004690 msgr2=0x7f1214004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d9ab700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214004690 0x7f1214004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d9ab700 1 -- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12140038e0 msgr2=0x7f1214003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.310+0000 7f122d9ab700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12140038e0 0x7f1214003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122d9ab700 1 -- 172.21.15.52:0/3319064706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140033f0 con 0x7f1214005000 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122d1aa700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12140038e0 0x7f1214003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122c9a9700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214004690 0x7f1214004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122d9ab700 1 -- 172.21.15.52:0/3319064706 reap_dead start 2023-05-10T01:24:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122d9ab700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 0x7f121400b8e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f121800c480 tx=0x7f121800c790).ready entity=mon.0 client_cookie=8e7b99ecef812334 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218002030 con 0x7f1214005000 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800ce20 con 0x7f1214005000 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f1227fff700 1 -- 172.21.15.52:0/3319064706 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218005d30 con 0x7f1214005000 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 -- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 msgr2=0x7f121400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 0x7f121400b8e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f121800c480 tx=0x7f121800c790).stop 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 -- 172.21.15.52:0/3319064706 shutdown_connections 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 --2- 172.21.15.52:0/3319064706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1214005000 0x7f121400b8e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 -- 172.21.15.52:0/3319064706 >> 172.21.15.52:0/3319064706 conn(0x7f12280c4420 msgr2=0x7f12280c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:48.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 -- 172.21.15.52:0/3319064706 shutdown_connections 2023-05-10T01:24:48.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.311+0000 7f122f40e700 1 -- 172.21.15.52:0/3319064706 wait complete. 2023-05-10T01:24:48.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.312+0000 7f122f40e700 1 Processor -- start 2023-05-10T01:24:48.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 -- start start 2023-05-10T01:24:48.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214005000 0x7f12280a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12280ab700 0x7f1228150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228167e50 con 0x7f1228167500 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280abeb0 con 0x7f12280ab700 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.313+0000 7f122f40e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280ac190 con 0x7f1214005000 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35762/0 (socket says 172.21.15.52:35762) 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 -- 172.21.15.52:0/15547807 learned_addr learned my addr 172.21.15.52:0/15547807 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d1aa700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214005000 0x7f12280a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122c9a9700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12280ab700 0x7f1228150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 -- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214005000 msgr2=0x7f12280a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214005000 0x7f12280a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 -- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12280ab700 msgr2=0x7f1228150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12280ab700 0x7f1228150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 -- 172.21.15.52:0/15547807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280ac470 con 0x7f1228167500 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122d9ab700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f1228064f80 tx=0x7f1218015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218002030 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218005e40 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228153640 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180017f0 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.314+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280abb80 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.315+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228153ae0 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.316+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f121801d070 con 0x7f1228167500 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.316+0000 7f12257fa700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 0x7f1208061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:48.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.316+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f121807ad40 con 0x7f1228167500 2023-05-10T01:24:48.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.316+0000 7f122d1aa700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 0x7f1208061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:48.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.317+0000 7f122d1aa700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 0x7f1208061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1220007fd0 tx=0x7f1220009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:48.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.320+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f121804c350 con 0x7f1228167500 2023-05-10T01:24:48.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:48.569+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f122806c340 con 0x7f1228167500 2023-05-10T01:24:49.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.526+0000 7f12257fa700 1 -- 172.21.15.52:0/15547807 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v546) v1 ==== 156+0+0 (secure 0 0 0) 0x7f121801a070 con 0x7f1228167500 2023-05-10T01:24:49.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 msgr2=0x7f1208061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 0x7f1208061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1220007fd0 tx=0x7f1220009040).stop 2023-05-10T01:24:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 msgr2=0x7f1228167960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f1228064f80 tx=0x7f1218015000).stop 2023-05-10T01:24:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 shutdown_connections 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f120805ed90 0x7f1208061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1228167500 0x7f1228167960 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1214005000 0x7f12280a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 --2- 172.21.15.52:0/15547807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12280ab700 0x7f1228150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 >> 172.21.15.52:0/15547807 conn(0x7f12280c4420 msgr2=0x7f12280c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 shutdown_connections 2023-05-10T01:24:49.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.529+0000 7f122f40e700 1 -- 172.21.15.52:0/15547807 wait complete. 2023-05-10T01:24:49.546 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-05-10T01:24:49.546 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-05-10T01:24:49.547 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:24:49.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-05-10T01:24:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.674+0000 7fa655592700 1 Processor -- start 2023-05-10T01:24:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.674+0000 7fa655592700 1 -- start start 2023-05-10T01:24:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa655592700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa6500c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa655592700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6500c0650 con 0x7fa650154540 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa655592700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6500bfd20 con 0x7fa650069da0 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa655592700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c0000 con 0x7fa650154160 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64e7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa650154540 0x7fa650069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44786/0 (socket says 172.21.15.52:44786) 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64e7fc700 1 -- 172.21.15.52:0/1354992227 learned_addr learned my addr 172.21.15.52:0/1354992227 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64effd700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa6500c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547781965 0 0) 0x7fa6500c0650 con 0x7fa650154540 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6300033f0 con 0x7fa650154540 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39639554 0 0) 0x7fa6500bfd20 con 0x7fa650069da0 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6500c0650 con 0x7fa650069da0 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870865045 0 0) 0x7fa6300033f0 con 0x7fa650154540 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 msgr2=0x7fa6500c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa6500c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 >> v1:172.21.15.172:6789/0 conn(0x7fa650069da0 legacy=0x7fa6500c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500c02e0 con 0x7fa650154540 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fa638001470 con 0x7fa650154540 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 >> v1:172.21.15.52:6789/0 conn(0x7fa650154540 legacy=0x7fa650069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa630003aa0 0x7fa630003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.675+0000 7fa64dffb700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630004690 0x7fa630004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa630005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c0000 con 0x7fa630003aa0 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63000b990 con 0x7fa630004690 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63000bb50 con 0x7fa650154160 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa630003aa0 0x7fa630003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64e7fc700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630004690 0x7fa630004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64f7fe700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa630005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 -- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 msgr2=0x7fa630005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650154160 0x7fa630005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 -- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630004690 msgr2=0x7fa630004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630004690 0x7fa630004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 -- 172.21.15.52:0/1354992227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300033f0 con 0x7fa630003aa0 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64effd700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa630003aa0 0x7fa630003ea0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fa648009a80 tx=0x7fa648009060).ready entity=mon.0 client_cookie=f0d5cf9c870ee1e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648009430 con 0x7fa630003aa0 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800e640 con 0x7fa630003aa0 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.676+0000 7fa64dffb700 1 -- 172.21.15.52:0/1354992227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800e9c0 con 0x7fa630003aa0 2023-05-10T01:24:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 -- 172.21.15.52:0/1354992227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa630003aa0 msgr2=0x7fa630003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 --2- 172.21.15.52:0/1354992227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa630003aa0 0x7fa630003ea0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fa648009a80 tx=0x7fa648009060).stop 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa64f7fe700 1 -- 172.21.15.52:0/1354992227 reap_dead start 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 -- 172.21.15.52:0/1354992227 shutdown_connections 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 -- 172.21.15.52:0/1354992227 >> 172.21.15.52:0/1354992227 conn(0x7fa6500cb6f0 msgr2=0x7fa6500c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 -- 172.21.15.52:0/1354992227 shutdown_connections 2023-05-10T01:24:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.677+0000 7fa655592700 1 -- 172.21.15.52:0/1354992227 wait complete. 2023-05-10T01:24:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.678+0000 7fa655592700 1 Processor -- start 2023-05-10T01:24:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.678+0000 7fa655592700 1 -- start start 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630003aa0 0x7fa650141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 0x7fa650068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa650068fb0 con 0x7fa650150650 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa650152140 con 0x7fa630003aa0 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa655592700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c37c0 con 0x7fa650150ad0 2023-05-10T01:24:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35778/0 (socket says 172.21.15.52:35778) 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 -- 172.21.15.52:0/1547194693 learned_addr learned my addr 172.21.15.52:0/1547194693 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64effd700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630003aa0 0x7fa650141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64f7fe700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 0x7fa650068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 -- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 msgr2=0x7fa650068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 0x7fa650068ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 -- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630003aa0 msgr2=0x7fa650141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630003aa0 0x7fa650141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 -- 172.21.15.52:0/1547194693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500c42b0 con 0x7fa650150650 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64f7fe700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 0x7fa650068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa64e7fc700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa650154920 tx=0x7fa638001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638004e40 con 0x7fa650150650 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.679+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800f870 con 0x7fa650150650 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.680+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa650152400 con 0x7fa650150650 2023-05-10T01:24:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.680+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800fbf0 con 0x7fa650150650 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.680+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6500c3cf0 con 0x7fa650150650 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.680+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6500666b0 con 0x7fa650150650 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.681+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa63801b030 con 0x7fa650150650 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.681+0000 7fa646ffd700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 0x7fa634061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.681+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa638079360 con 0x7fa650150650 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.681+0000 7fa64effd700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 0x7fa634061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.682+0000 7fa64effd700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 0x7fa634061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa648006d50 tx=0x7fa64801a000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.685+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa63804aa20 con 0x7fa650150650 2023-05-10T01:24:49.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:49.930+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fa650152590 con 0x7fa650150650 2023-05-10T01:24:50.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.530+0000 7fa646ffd700 1 -- 172.21.15.52:0/1547194693 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v547) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa638019030 con 0x7fa650150650 2023-05-10T01:24:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 msgr2=0x7fa634061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 0x7fa634061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa648006d50 tx=0x7fa64801a000).stop 2023-05-10T01:24:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 msgr2=0x7fa6500685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa650154920 tx=0x7fa638001e50).stop 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 shutdown_connections 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa63405ed90 0x7fa634061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa650150ad0 0x7fa650068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa630003aa0 0x7fa650141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 --2- 172.21.15.52:0/1547194693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa650150650 0x7fa6500685d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.532+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 >> 172.21.15.52:0/1547194693 conn(0x7fa6500cb6f0 msgr2=0x7fa6500c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:50.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.533+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 shutdown_connections 2023-05-10T01:24:50.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.533+0000 7fa655592700 1 -- 172.21.15.52:0/1547194693 wait complete. 2023-05-10T01:24:50.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:24:50.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.672+0000 7f0d4f86b700 1 Processor -- start 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 -- start start 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d481540d0 0x7f0d480bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480a7c80 con 0x7f0d480622a0 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d48067f50 con 0x7f0d481540d0 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.673+0000 7f0d4f86b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480a7ef0 con 0x7f0d48153cf0 2023-05-10T01:24:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:55422/0 (socket says 172.21.15.52:55422) 2023-05-10T01:24:50.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 -- 172.21.15.52:0/3868849691 learned_addr learned my addr 172.21.15.52:0/3868849691 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:50.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4ce06700 1 --2- 172.21.15.52:0/3868849691 >> v2:172.21.15.172:3300/0 conn(0x7f0d481540d0 0x7f0d480bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 -- 172.21.15.52:0/3868849691 >> v2:172.21.15.172:3300/0 conn(0x7f0d481540d0 msgr2=0x7f0d480bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:50.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 --2- 172.21.15.52:0/3868849691 >> v2:172.21.15.172:3300/0 conn(0x7f0d481540d0 0x7f0d480bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 -- 172.21.15.52:0/3868849691 >> v1:172.21.15.172:6789/0 conn(0x7f0d480622a0 legacy=0x7f0d48157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 -- 172.21.15.52:0/3868849691 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480a81d0 con 0x7f0d48153cf0 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d4d607700 1 --2- 172.21.15.52:0/3868849691 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0d40009f20 tx=0x7f0d40009840).ready entity=mon.2 client_cookie=1933859f26459a1c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d47fff700 1 -- 172.21.15.52:0/3868849691 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000e070 con 0x7f0d48153cf0 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d47fff700 1 -- 172.21.15.52:0/3868849691 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000b9d0 con 0x7f0d48153cf0 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.674+0000 7f0d47fff700 1 -- 172.21.15.52:0/3868849691 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000bd50 con 0x7f0d48153cf0 2023-05-10T01:24:50.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 -- 172.21.15.52:0/3868849691 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 msgr2=0x7f0d48063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/3868849691 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0d40009f20 tx=0x7f0d40009840).stop 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 -- 172.21.15.52:0/3868849691 shutdown_connections 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/3868849691 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d48153cf0 0x7f0d48063fa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/3868849691 >> v2:172.21.15.172:3300/0 conn(0x7f0d481540d0 0x7f0d480bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 -- 172.21.15.52:0/3868849691 >> 172.21.15.52:0/3868849691 conn(0x7f0d4805e810 msgr2=0x7f0d480c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 -- 172.21.15.52:0/3868849691 shutdown_connections 2023-05-10T01:24:50.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.675+0000 7f0d4f86b700 1 -- 172.21.15.52:0/3868849691 wait complete. 2023-05-10T01:24:50.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.676+0000 7f0d4f86b700 1 Processor -- start 2023-05-10T01:24:50.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.676+0000 7f0d4f86b700 1 -- start start 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480622a0 0x7f0d480ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d481540d0 0x7f0d480aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480ad4c0 con 0x7f0d48153cf0 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480ade40 con 0x7f0d481540d0 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4f86b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480a9f30 con 0x7f0d480622a0 2023-05-10T01:24:50.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4ce06700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4ce06700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35794/0 (socket says 172.21.15.52:35794) 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4ce06700 1 -- 172.21.15.52:0/4253201326 learned_addr learned my addr 172.21.15.52:0/4253201326 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4d607700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480622a0 0x7f0d480ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.677+0000 7f0d4de08700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d481540d0 0x7f0d480aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 -- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480622a0 msgr2=0x7f0d480ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480622a0 0x7f0d480ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 -- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d481540d0 msgr2=0x7f0d480aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d481540d0 0x7f0d480aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 -- 172.21.15.52:0/4253201326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009ae0 con 0x7f0d48153cf0 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4ce06700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f0d3c00e8d0 tx=0x7f0d3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012600 con 0x7f0d48153cf0 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c012760 con 0x7f0d48153cf0 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012ae0 con 0x7f0d48153cf0 2023-05-10T01:24:50.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48168a10 con 0x7f0d48153cf0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.678+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d480ad150 con 0x7f0d48153cf0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.679+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48158ad0 con 0x7f0d48153cf0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.679+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0d3c022070 con 0x7f0d48153cf0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.680+0000 7f0d457fa700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 0x7f0d28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.680+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f0d3c079c60 con 0x7f0d48153cf0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.680+0000 7f0d4d607700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 0x7f0d28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:50.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.680+0000 7f0d4d607700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 0x7f0d28061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0d4000b9a0 tx=0x7f0d40009840).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:50.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.684+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d3c04b270 con 0x7f0d48153cf0 2023-05-10T01:24:50.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.858+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d4806c340 con 0x7f0d48153cf0 2023-05-10T01:24:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.861+0000 7f0d457fa700 1 -- 172.21.15.52:0/4253201326 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d3c04e890 con 0x7f0d48153cf0 2023-05-10T01:24:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 msgr2=0x7f0d28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 0x7f0d28061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0d4000b9a0 tx=0x7f0d40009840).stop 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 msgr2=0x7f0d480a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f0d3c00e8d0 tx=0x7f0d3c009060).stop 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 shutdown_connections 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0d2805ed90 0x7f0d28061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d481540d0 0x7f0d480aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480622a0 0x7f0d480ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 --2- 172.21.15.52:0/4253201326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d48153cf0 0x7f0d480a9a40 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 >> 172.21.15.52:0/4253201326 conn(0x7f0d4805e810 msgr2=0x7f0d480c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 shutdown_connections 2023-05-10T01:24:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:50.863+0000 7f0d4f86b700 1 -- 172.21.15.52:0/4253201326 wait complete. 2023-05-10T01:24:50.877 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:24:50.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:50.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:24:50.937 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:24:51.024 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:24:51.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:51.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.139+0000 7f7feabd9700 1 Processor -- start 2023-05-10T01:24:51.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.139+0000 7f7feabd9700 1 -- start start 2023-05-10T01:24:51.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7feabd9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fe40c7ab0 0x7f7fe4153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7feabd9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe41588f0 con 0x7f7fe40c76d0 2023-05-10T01:24:51.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7feabd9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe4157ce0 con 0x7f7fe4153d00 2023-05-10T01:24:51.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7feabd9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe4157fc0 con 0x7f7fe40c7ab0 2023-05-10T01:24:51.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7fe9bd7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7fe40c76d0 0x7f7fe40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44816/0 (socket says 172.21.15.52:44816) 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7fe9bd7700 1 -- 172.21.15.52:0/2905892509 learned_addr learned my addr 172.21.15.52:0/2905892509 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7fe93d6700 1 --2- 172.21.15.52:0/2905892509 >> v2:172.21.15.172:3300/0 conn(0x7f7fe40c7ab0 0x7f7fe4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716018907 0 0) 0x7f7fe41588f0 con 0x7f7fe40c76d0 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.140+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd00033f0 con 0x7f7fe40c76d0 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208095233 0 0) 0x7f7fd00033f0 con 0x7f7fe40c76d0 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 >> v2:172.21.15.172:3300/0 conn(0x7f7fe40c7ab0 msgr2=0x7f7fe4153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:51.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 --2- 172.21.15.52:0/2905892509 >> v2:172.21.15.172:3300/0 conn(0x7f7fe40c7ab0 0x7f7fe4153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 >> v1:172.21.15.172:6789/0 conn(0x7f7fe4153d00 legacy=0x7f7fe40c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe41582a0 con 0x7f7fe40c76d0 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7fdc001470 con 0x7f7fe40c76d0 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 >> v1:172.21.15.52:6789/0 conn(0x7f7fe40c76d0 legacy=0x7f7fe40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fd00038e0 0x7f7fd0003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0004690 0x7f7fd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 0x7f7fd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4157fc0 con 0x7f7fd0005000 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd000beb0 con 0x7f7fd0004690 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd000c070 con 0x7f7fd00038e0 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 0x7f7fd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe93d6700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0004690 0x7f7fd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe9bd7700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fd00038e0 0x7f7fd0003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fd00038e0 msgr2=0x7f7fd0003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fd00038e0 0x7f7fd0003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0004690 msgr2=0x7f7fd0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0004690 0x7f7fd0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2905892509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00033f0 con 0x7f7fd0005000 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2905892509 reap_dead start 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 0x7f7fd000b8e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7fd4001f20 tx=0x7f7fd4007f10).ready entity=mon.0 client_cookie=10705e5940c364e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40017e0 con 0x7f7fd0005000 2023-05-10T01:24:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd400c6d0 con 0x7f7fd0005000 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.141+0000 7f7fe8bd5700 1 -- 172.21.15.52:0/2905892509 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd400ca50 con 0x7f7fd0005000 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 -- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 msgr2=0x7f7fd000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 0x7f7fd000b8e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7fd4001f20 tx=0x7f7fd4007f10).stop 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 -- 172.21.15.52:0/2905892509 shutdown_connections 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2905892509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fd0005000 0x7f7fd000b8e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 -- 172.21.15.52:0/2905892509 >> 172.21.15.52:0/2905892509 conn(0x7f7fe4068320 msgr2=0x7f7fe4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:51.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 -- 172.21.15.52:0/2905892509 shutdown_connections 2023-05-10T01:24:51.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.142+0000 7f7feabd9700 1 -- 172.21.15.52:0/2905892509 wait complete. 2023-05-10T01:24:51.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.143+0000 7f7feabd9700 1 Processor -- start 2023-05-10T01:24:51.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.143+0000 7f7feabd9700 1 -- start start 2023-05-10T01:24:51.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0005000 0x7f7fe40ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fe4157080 0x7f7fe414bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40c3a90 con 0x7f7fe40c3160 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4157500 con 0x7f7fd0005000 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7feabd9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40ae130 con 0x7f7fe4157080 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35816/0 (socket says 172.21.15.52:35816) 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2561945121 learned_addr learned my addr 172.21.15.52:0/2561945121 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fe93d6700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fe4157080 0x7f7fe414bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fe9bd7700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0005000 0x7f7fe40ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fe4157080 msgr2=0x7f7fe414bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fe4157080 0x7f7fe414bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0005000 msgr2=0x7f7fe40ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0005000 0x7f7fe40ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.144+0000 7f7fea3d8700 1 -- 172.21.15.52:0/2561945121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40ae410 con 0x7f7fe40c3160 2023-05-10T01:24:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7fea3d8700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f7fe4083fb0 tx=0x7f7fd4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40017e0 con 0x7f7fe40c3160 2023-05-10T01:24:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd400c840 con 0x7f7fe40c3160 2023-05-10T01:24:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe40ae6f0 con 0x7f7fe40c3160 2023-05-10T01:24:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd401e430 con 0x7f7fe40c3160 2023-05-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.145+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe414c460 con 0x7f7fe40c3160 2023-05-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.146+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4047150 con 0x7f7fe40c3160 2023-05-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.146+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7fd4003040 con 0x7f7fe40c3160 2023-05-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.146+0000 7f7fe1ffb700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 0x7f7fc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.147+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7fd407abb0 con 0x7f7fe40c3160 2023-05-10T01:24:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.147+0000 7f7fe9bd7700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 0x7f7fc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.147+0000 7f7fe9bd7700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 0x7f7fc4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7fdc001ed0 tx=0x7f7fe40c6b40).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.151+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7fd404c0b0 con 0x7f7fe40c3160 2023-05-10T01:24:51.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.364+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe40bfb80 con 0x7f7fe40c3160 2023-05-10T01:24:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.364+0000 7f7fe1ffb700 1 -- 172.21.15.52:0/2561945121 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7fd404f6d0 con 0x7f7fe40c3160 2023-05-10T01:24:51.367 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:51.368 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1243621091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1243621091},{"type":"v1","addr":"172.21.15.172:6836","nonce":1243621091}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3226276558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3226276558},{"type":"v1","addr":"172.21.15.52:6834","nonce":3226276558}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/272150139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":272150139},{"type":"v1","addr":"172.21.15.52:6835","nonce":272150139}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1465299437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1465299437},{"type":"v1","addr":"172.21.15.172:6837","nonce":1465299437}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[]} 2023-05-10T01:24:51.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 msgr2=0x7f7fc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 0x7f7fc4061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7fdc001ed0 tx=0x7f7fe40c6b40).stop 2023-05-10T01:24:51.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 msgr2=0x7f7fe40c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f7fe4083fb0 tx=0x7f7fd4017000).stop 2023-05-10T01:24:51.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 shutdown_connections 2023-05-10T01:24:51.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7fc405ed90 0x7f7fc4061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fe40c3160 0x7f7fe40c35a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0005000 0x7f7fe40ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 --2- 172.21.15.52:0/2561945121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fe4157080 0x7f7fe414bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 >> 172.21.15.52:0/2561945121 conn(0x7f7fe4068320 msgr2=0x7f7fe414cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:51.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 shutdown_connections 2023-05-10T01:24:51.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.366+0000 7f7feabd9700 1 -- 172.21.15.52:0/2561945121 wait complete. 2023-05-10T01:24:51.371 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 32 2023-05-10T01:24:51.380 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:24:51.381 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:24:51.381 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:24:51.381 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:51.382 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:24:51.382 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:24:51.382 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:24:51.382 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:51.383 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:24:51.383 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:24:51.383 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:24:51.383 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:51.383 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:24:51.384 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:24:51.384 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:24:51.384 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:24:51.391 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:24:51.392 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:24:51.393 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:24:51.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:24:51.394 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:24:51.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:24:51.395 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:24:51.396 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:24:51.434 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:24:51.434 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:51.435 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:24:51.436 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:51.438 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:24:51.439 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:24:51.439 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:51.439 DEBUG:teuthology.parallel:result is None 2023-05-10T01:24:51.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:24:51.507 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:24:51.508 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:24:51.517 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:24:51.517 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:24:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.562+0000 7fbf5ba7c700 1 Processor -- start 2023-05-10T01:24:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 -- start start 2023-05-10T01:24:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154160 0x7fbf540aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbf54154540 0x7fbf540a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf540aa1f0 0x7fbf540c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540ab1f0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540c08a0 con 0x7fbf54154540 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.563+0000 7fbf5ba7c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540bfc90 con 0x7fbf54154160 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf540aa1f0 0x7fbf540c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf540aa1f0 0x7fbf540c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35842/0 (socket says 172.21.15.52:35842) 2023-05-10T01:24:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 -- 172.21.15.52:0/2711933096 learned_addr learned my addr 172.21.15.52:0/2711933096 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf59017700 1 --2- 172.21.15.52:0/2711933096 >> v2:172.21.15.172:3300/0 conn(0x7fbf54154540 0x7fbf540a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf59818700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154160 0x7fbf540aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 -- 172.21.15.52:0/2711933096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154160 msgr2=0x7fbf540aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154160 0x7fbf540aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 -- 172.21.15.52:0/2711933096 >> v2:172.21.15.172:3300/0 conn(0x7fbf54154540 msgr2=0x7fbf540a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 --2- 172.21.15.52:0/2711933096 >> v2:172.21.15.172:3300/0 conn(0x7fbf54154540 0x7fbf540a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 -- 172.21.15.52:0/2711933096 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540bff70 con 0x7fbf540aa1f0 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf5a019700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c5ca0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fbf54082f90 tx=0x7fbf4c009840).ready entity=mon.0 client_cookie=c046fdb5685c4b09 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf58816700 1 -- 172.21.15.52:0/2711933096 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00e070 con 0x7fbf540aa1f0 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf58816700 1 -- 172.21.15.52:0/2711933096 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00b970 con 0x7fbf540aa1f0 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.564+0000 7fbf58816700 1 -- 172.21.15.52:0/2711933096 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00bcf0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/2711933096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf540aa1f0 msgr2=0x7fbf540c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c5ca0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fbf54082f90 tx=0x7fbf4c009840).stop 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/2711933096 shutdown_connections 2023-05-10T01:24:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c5ca0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/2711933096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154160 0x7fbf540aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/2711933096 >> v2:172.21.15.172:3300/0 conn(0x7fbf54154540 0x7fbf540a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/2711933096 >> 172.21.15.52:0/2711933096 conn(0x7fbf540cb6c0 msgr2=0x7fbf540c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:51.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/2711933096 shutdown_connections 2023-05-10T01:24:51.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.565+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/2711933096 wait complete. 2023-05-10T01:24:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.566+0000 7fbf5ba7c700 1 Processor -- start 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.566+0000 7fbf5ba7c700 1 -- start start 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154540 0x7fbf540c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540ae650 con 0x7fbf54154160 2023-05-10T01:24:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540af6e0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5ba7c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c33c0 con 0x7fbf54154540 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59017700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:34172/0 (socket says 172.21.15.52:34172) 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59017700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35850/0 (socket says 172.21.15.52:35850) 2023-05-10T01:24:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 -- 172.21.15.52:0/945696283 learned_addr learned my addr 172.21.15.52:0/945696283 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf5a019700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154540 0x7fbf540c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 -- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154540 msgr2=0x7fbf540c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154540 0x7fbf540c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 -- 172.21.15.52:0/945696283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 msgr2=0x7fbf540c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 -- 172.21.15.52:0/945696283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009ae0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59017700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.567+0000 7fbf59818700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fbf4800e950 tx=0x7fbf48009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.568+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48012600 con 0x7fbf540aa1f0 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.568+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48012760 con 0x7fbf540aa1f0 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.568+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf540af0b0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.568+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48012ae0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.568+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf540aeb80 con 0x7fbf540aa1f0 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.569+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf540666b0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.569+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbf48022070 con 0x7fbf540aa1f0 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.569+0000 7fbf45ffb700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 0x7fbf34061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.569+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fbf48079ec0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.569+0000 7fbf59017700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 0x7fbf34061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.570+0000 7fbf59017700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 0x7fbf34061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbf54154920 tx=0x7fbf50009060).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.574+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf4804b4d0 con 0x7fbf540aa1f0 2023-05-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:51.762+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbf5406c340 con 0x7fbf540aa1f0 2023-05-10T01:24:52.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.539+0000 7fbf45ffb700 1 -- 172.21.15.52:0/945696283 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbf48016070 con 0x7fbf540aa1f0 2023-05-10T01:24:52.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 msgr2=0x7fbf34061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 0x7fbf34061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbf54154920 tx=0x7fbf50009060).stop 2023-05-10T01:24:52.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 msgr2=0x7fbf540c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fbf4800e950 tx=0x7fbf48009060).stop 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 shutdown_connections 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbf3405ed60 0x7fbf34061220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf54154540 0x7fbf540c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf540aa1f0 0x7fbf540c2ed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.541+0000 7fbf5ba7c700 1 --2- 172.21.15.52:0/945696283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf54154160 0x7fbf540c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.542+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 >> 172.21.15.52:0/945696283 conn(0x7fbf540cb6c0 msgr2=0x7fbf540c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.542+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 shutdown_connections 2023-05-10T01:24:52.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.542+0000 7fbf5ba7c700 1 -- 172.21.15.52:0/945696283 wait complete. 2023-05-10T01:24:52.546 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:24:52.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:24:52.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.680+0000 7f4e93fff700 1 Processor -- start 2023-05-10T01:24:52.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.680+0000 7f4e93fff700 1 -- start start 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e940c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e93fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e940a9b60 0x7f4e940a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e93fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e941588f0 con 0x7f4e94153810 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e93fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e94157ce0 con 0x7f4e940a9b60 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e93fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94157fc0 con 0x7f4e940c76d0 2023-05-10T01:24:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e940a9b60 0x7f4e940a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e940a9b60 0x7f4e940a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35860/0 (socket says 172.21.15.52:35860) 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 -- 172.21.15.52:0/1801905972 learned_addr learned my addr 172.21.15.52:0/1801905972 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e92ffd700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e940c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 -- 172.21.15.52:0/1801905972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 msgr2=0x7f4e940c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e940c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 -- 172.21.15.52:0/1801905972 >> v1:172.21.15.172:6789/0 conn(0x7f4e94153810 legacy=0x7f4e94153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 -- 172.21.15.52:0/1801905972 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e941582a0 con 0x7f4e940a9b60 2023-05-10T01:24:52.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.681+0000 7f4e927fc700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e940a9b60 0x7f4e940a9fc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f4e7c006fd0 tx=0x7f4e7c0090f0).ready entity=mon.0 client_cookie=f8fdca28d7d33c64 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e91ffb700 1 -- 172.21.15.52:0/1801905972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b580 con 0x7f4e940a9b60 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e91ffb700 1 -- 172.21.15.52:0/1801905972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00b6e0 con 0x7f4e940a9b60 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e91ffb700 1 -- 172.21.15.52:0/1801905972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00ba60 con 0x7f4e940a9b60 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 -- 172.21.15.52:0/1801905972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e940a9b60 msgr2=0x7f4e940a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e940a9b60 0x7f4e940a9fc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f4e7c006fd0 tx=0x7f4e7c0090f0).stop 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 -- 172.21.15.52:0/1801905972 shutdown_connections 2023-05-10T01:24:52.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e940c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 --2- 172.21.15.52:0/1801905972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e940a9b60 0x7f4e940a9fc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 -- 172.21.15.52:0/1801905972 >> 172.21.15.52:0/1801905972 conn(0x7f4e94068320 msgr2=0x7f4e94068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 -- 172.21.15.52:0/1801905972 shutdown_connections 2023-05-10T01:24:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.682+0000 7f4e93fff700 1 -- 172.21.15.52:0/1801905972 wait complete. 2023-05-10T01:24:52.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.683+0000 7f4e93fff700 1 Processor -- start 2023-05-10T01:24:52.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.683+0000 7f4e93fff700 1 -- start start 2023-05-10T01:24:52.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e940a9b60 0x7f4e94152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e94164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94165580 con 0x7f4e94153810 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940adcc0 con 0x7f4e940a9b60 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e93fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94164a10 con 0x7f4e940c76d0 2023-05-10T01:24:52.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e937fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e937fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35870/0 (socket says 172.21.15.52:35870) 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e937fe700 1 -- 172.21.15.52:0/9841046 learned_addr learned my addr 172.21.15.52:0/9841046 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e92ffd700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e940a9b60 0x7f4e94152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.684+0000 7f4e927fc700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e94164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 -- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 msgr2=0x7f4e94164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e94164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 -- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e940a9b60 msgr2=0x7f4e94152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e940a9b60 0x7f4e94152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 -- 172.21.15.52:0/9841046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009370 con 0x7f4e94153810 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e937fe700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f4e84002230 tx=0x7f4e840015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400e4a0 con 0x7f4e94153810 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8400e600 con 0x7f4e94153810 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94164ce0 con 0x7f4e94153810 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400e980 con 0x7f4e94153810 2023-05-10T01:24:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.685+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e941652a0 con 0x7f4e94153810 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.686+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940ada90 con 0x7f4e94153810 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.686+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4e84019030 con 0x7f4e94153810 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.687+0000 7f4e8affd700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 0x7f4e78061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.687+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f4e84078e30 con 0x7f4e94153810 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.687+0000 7f4e92ffd700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 0x7f4e78061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:52.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.687+0000 7f4e92ffd700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 0x7f4e78061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4e9414dd10 tx=0x7f4e8c009060).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:52.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.691+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e840488f0 con 0x7f4e94153810 2023-05-10T01:24:52.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.932+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4e940ad630 con 0x7f4e94153810 2023-05-10T01:24:52.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.933+0000 7f4e8affd700 1 -- 172.21.15.52:0/9841046 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4e940ada90 con 0x7f4e94153810 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:24:52.936 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.937 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:52.938 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.939 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:24:52.940 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.941 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.942 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.943 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.943 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:24:52.943 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.944 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.945 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.946 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.947 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:24:52.949 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.950 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.951 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:24:52.952 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:52.953 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.954 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:24:52.955 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:24:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:52.958 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:24:52.959 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:24:52.960 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:24:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 msgr2=0x7f4e78061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 0x7f4e78061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4e9414dd10 tx=0x7f4e8c009060).stop 2023-05-10T01:24:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 msgr2=0x7f4e940aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f4e84002230 tx=0x7f4e840015e0).stop 2023-05-10T01:24:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 shutdown_connections 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4e7805ed90 0x7f4e78061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e94153810 0x7f4e940aeec0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e940a9b60 0x7f4e94152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 --2- 172.21.15.52:0/9841046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e940c76d0 0x7f4e94164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 >> 172.21.15.52:0/9841046 conn(0x7f4e94068320 msgr2=0x7f4e940ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 shutdown_connections 2023-05-10T01:24:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:52.934+0000 7f4e93fff700 1 -- 172.21.15.52:0/9841046 wait complete. 2023-05-10T01:24:52.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.078+0000 7fe3c677c700 1 Processor -- start 2023-05-10T01:24:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.078+0000 7fe3c677c700 1 -- start start 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3c677c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3c677c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3c00a9ed0 0x7fe3c0068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3c677c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c0155120 con 0x7fe3c00aa350 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3c677c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c00c55c0 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3c677c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00cb730 con 0x7fe3c0151fe0 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3c00a9ed0 0x7fe3c0068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3c00a9ed0 0x7fe3c0068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35876/0 (socket says 172.21.15.52:35876) 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/1557314237 learned_addr learned my addr 172.21.15.52:0/1557314237 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bffff700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/1557314237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 msgr2=0x7fe3c01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/1557314237 >> v1:172.21.15.172:6789/0 conn(0x7fe3c00aa350 legacy=0x7fe3c00bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/1557314237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00cba10 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3bf7fe700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c0068150 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fe3a8006fd0 tx=0x7fe3a80090f0).ready entity=mon.0 client_cookie=20ba85d3e8668e81 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3beffd700 1 -- 172.21.15.52:0/1557314237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800b600 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3beffd700 1 -- 172.21.15.52:0/1557314237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800b760 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.079+0000 7fe3beffd700 1 -- 172.21.15.52:0/1557314237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800bae0 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 -- 172.21.15.52:0/1557314237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00a9ed0 msgr2=0x7fe3c0068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c0068150 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fe3a8006fd0 tx=0x7fe3a80090f0).stop 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 -- 172.21.15.52:0/1557314237 shutdown_connections 2023-05-10T01:24:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 --2- 172.21.15.52:0/1557314237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c0068150 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 -- 172.21.15.52:0/1557314237 >> 172.21.15.52:0/1557314237 conn(0x7fe3c0067910 msgr2=0x7fe3c00cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 -- 172.21.15.52:0/1557314237 shutdown_connections 2023-05-10T01:24:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.080+0000 7fe3c677c700 1 -- 172.21.15.52:0/1557314237 wait complete. 2023-05-10T01:24:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.081+0000 7fe3c677c700 1 Processor -- start 2023-05-10T01:24:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.081+0000 7fe3c677c700 1 -- start start 2023-05-10T01:24:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00b0830 con 0x7fe3c00aa350 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00ca490 con 0x7fe3c00a9ed0 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c677c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0165620 con 0x7fe3c0151fe0 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35882/0 (socket says 172.21.15.52:35882) 2023-05-10T01:24:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/2735175631 learned_addr learned my addr 172.21.15.52:0/2735175631 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bffff700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3c4d19700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 msgr2=0x7fe3c00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3c00a9ed0 msgr2=0x7fe3c014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.082+0000 7fe3bf7fe700 1 -- 172.21.15.52:0/2735175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009370 con 0x7fe3c00aa350 2023-05-10T01:24:53.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3bf7fe700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fe3a8011000 tx=0x7fe3a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800bea0 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800b8d0 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c0165190 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a801b660 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.083+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c00ae130 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.084+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c00668b0 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.084+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3a800f070 con 0x7fe3c00aa350 2023-05-10T01:24:53.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.084+0000 7fe3b7fff700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 0x7fe3a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.085+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fe3a807aff0 con 0x7fe3c00aa350 2023-05-10T01:24:53.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.085+0000 7fe3bffff700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 0x7fe3a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.085+0000 7fe3bffff700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 0x7fe3a4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe3b000bbc0 tx=0x7fe3b0008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.089+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3c00668b0 con 0x7fe3c00aa350 2023-05-10T01:24:53.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.264+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c00666b0 con 0x7fe3c00aa350 2023-05-10T01:24:53.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.265+0000 7fe3b7fff700 1 -- 172.21.15.52:0/2735175631 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14212 (secure 0 0 0) 0x7fe3a8050210 con 0x7fe3c00aa350 2023-05-10T01:24:53.267 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:53.267 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":90,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:52.532124+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:53.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 msgr2=0x7fe3a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 0x7fe3a4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe3b000bbc0 tx=0x7fe3b0008040).stop 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 msgr2=0x7fe3c00c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fe3a8011000 tx=0x7fe3a8017000).stop 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 shutdown_connections 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3a405ed90 0x7fe3a4061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3c0151fe0 0x7fe3c00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3c00a9ed0 0x7fe3c014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 --2- 172.21.15.52:0/2735175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c00aa350 0x7fe3c00c9ab0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 >> 172.21.15.52:0/2735175631 conn(0x7fe3c0067910 msgr2=0x7fe3c0155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 shutdown_connections 2023-05-10T01:24:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.267+0000 7fe3c677c700 1 -- 172.21.15.52:0/2735175631 wait complete. 2023-05-10T01:24:53.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:24:53.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:24:53.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.399+0000 7fdd597f6700 1 Processor -- start 2023-05-10T01:24:53.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.399+0000 7fdd597f6700 1 -- start start 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd597f6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd54154460 0x7fdd540aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd597f6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540c94c0 con 0x7fdd54154080 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd597f6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540cb7d0 con 0x7fdd54068150 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd597f6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540c88b0 con 0x7fdd54154460 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd52ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdd54154080 0x7fdd540a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44904/0 (socket says 172.21.15.52:44904) 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd52ffd700 1 -- 172.21.15.52:0/596784026 learned_addr learned my addr 172.21.15.52:0/596784026 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:53.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd527fc700 1 --2- 172.21.15.52:0/596784026 >> v2:172.21.15.52:3300/0 conn(0x7fdd54154460 0x7fdd540aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd51ffb700 1 -- 172.21.15.52:0/596784026 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011259495 0 0) 0x7fdd540c94c0 con 0x7fdd54154080 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd51ffb700 1 -- 172.21.15.52:0/596784026 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd400033f0 con 0x7fdd54154080 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd527fc700 1 -- 172.21.15.52:0/596784026 >> v1:172.21.15.172:6789/0 conn(0x7fdd54068150 legacy=0x7fdd540c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd527fc700 1 -- 172.21.15.52:0/596784026 >> v1:172.21.15.52:6789/0 conn(0x7fdd54154080 legacy=0x7fdd540a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.400+0000 7fdd527fc700 1 -- 172.21.15.52:0/596784026 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540c8b90 con 0x7fdd54154460 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd527fc700 1 --2- 172.21.15.52:0/596784026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54154460 0x7fdd540aac90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fdd48009760 tx=0x7fdd48009060).ready entity=mon.0 client_cookie=fd033d1c4b391567 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd51ffb700 1 -- 172.21.15.52:0/596784026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800f510 con 0x7fdd54154460 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd51ffb700 1 -- 172.21.15.52:0/596784026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800f670 con 0x7fdd54154460 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd51ffb700 1 -- 172.21.15.52:0/596784026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800f9f0 con 0x7fdd54154460 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 -- 172.21.15.52:0/596784026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54154460 msgr2=0x7fdd540aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 --2- 172.21.15.52:0/596784026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54154460 0x7fdd540aac90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fdd48009760 tx=0x7fdd48009060).stop 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 -- 172.21.15.52:0/596784026 shutdown_connections 2023-05-10T01:24:53.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 --2- 172.21.15.52:0/596784026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54154460 0x7fdd540aac90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 -- 172.21.15.52:0/596784026 >> 172.21.15.52:0/596784026 conn(0x7fdd54067910 msgr2=0x7fdd540cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 -- 172.21.15.52:0/596784026 shutdown_connections 2023-05-10T01:24:53.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.401+0000 7fdd597f6700 1 -- 172.21.15.52:0/596784026 wait complete. 2023-05-10T01:24:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 Processor -- start 2023-05-10T01:24:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 -- start start 2023-05-10T01:24:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd54154080 0x7fdd540c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd54154460 0x7fdd540c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540c26a0 con 0x7fdd54068150 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54155ea0 con 0x7fdd54154080 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd597f6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5413c910 con 0x7fdd54154460 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd52ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.403+0000 7fdd52ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35894/0 (socket says 172.21.15.52:35894) 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 -- 172.21.15.52:0/3201841789 learned_addr learned my addr 172.21.15.52:0/3201841789 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd527fc700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd54154080 0x7fdd540c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd537fe700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd54154460 0x7fdd540c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 -- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd54154460 msgr2=0x7fdd540c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd54154460 0x7fdd540c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 -- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd54154080 msgr2=0x7fdd540c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd54154080 0x7fdd540c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 -- 172.21.15.52:0/3201841789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480092a0 con 0x7fdd54068150 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd52ffd700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fdd4c00c590 tx=0x7fdd4c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0072e0 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c007440 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54155290 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0057a0 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.404+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54155850 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.405+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd54066720 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.405+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdd4c01a060 con 0x7fdd54068150 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.406+0000 7fdd3affd700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 0x7fdd34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.406+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fdd4c0790c0 con 0x7fdd54068150 2023-05-10T01:24:53.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.406+0000 7fdd527fc700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 0x7fdd34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.406+0000 7fdd527fc700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 0x7fdd34061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fdd540abfc0 tx=0x7fdd48017000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.410+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd4c04a8b0 con 0x7fdd54068150 2023-05-10T01:24:53.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.581+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd5406c340 con 0x7fdd54068150 2023-05-10T01:24:53.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.582+0000 7fdd3affd700 1 -- 172.21.15.52:0/3201841789 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd4c018070 con 0x7fdd54068150 2023-05-10T01:24:53.584 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:24:53.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 msgr2=0x7fdd34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 0x7fdd34061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fdd540abfc0 tx=0x7fdd48017000).stop 2023-05-10T01:24:53.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 msgr2=0x7fdd5413c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fdd4c00c590 tx=0x7fdd4c007c80).stop 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 shutdown_connections 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdd3405ed90 0x7fdd34061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd54154460 0x7fdd540c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd54068150 0x7fdd5413c420 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 --2- 172.21.15.52:0/3201841789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd54154080 0x7fdd540c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 >> 172.21.15.52:0/3201841789 conn(0x7fdd54067910 msgr2=0x7fdd540ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 shutdown_connections 2023-05-10T01:24:53.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.583+0000 7fdd597f6700 1 -- 172.21.15.52:0/3201841789 wait complete. 2023-05-10T01:24:53.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:24:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.714+0000 7f96e6210700 1 Processor -- start 2023-05-10T01:24:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.714+0000 7f96e6210700 1 -- start start 2023-05-10T01:24:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96e6210700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 0x7f96e00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96e6210700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96e0068150 0x7f96e00685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96e6210700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00c94c0 con 0x7f96e0154460 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96e6210700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00cb7d0 con 0x7f96e0068150 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96e6210700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0068a90 con 0x7f96e0154080 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96dffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96e0068150 0x7f96e00685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96dffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96e0068150 0x7f96e00685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35906/0 (socket says 172.21.15.52:35906) 2023-05-10T01:24:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.715+0000 7f96dffff700 1 -- 172.21.15.52:0/1692471691 learned_addr learned my addr 172.21.15.52:0/1692471691 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96df7fe700 1 --2- 172.21.15.52:0/1692471691 >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 0x7f96e00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96dffff700 1 -- 172.21.15.52:0/1692471691 >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 msgr2=0x7f96e00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96dffff700 1 --2- 172.21.15.52:0/1692471691 >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 0x7f96e00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96dffff700 1 -- 172.21.15.52:0/1692471691 >> v1:172.21.15.172:6789/0 conn(0x7f96e0154460 legacy=0x7f96e00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96dffff700 1 -- 172.21.15.52:0/1692471691 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00c88b0 con 0x7f96e0068150 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96df7fe700 1 --2- 172.21.15.52:0/1692471691 >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 0x7f96e00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96dffff700 1 --2- 172.21.15.52:0/1692471691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e00685a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f96e006bd00 tx=0x7f96d8009840).ready entity=mon.0 client_cookie=c2862e586483c575 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96de7fc700 1 -- 172.21.15.52:0/1692471691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800e070 con 0x7f96e0068150 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96de7fc700 1 -- 172.21.15.52:0/1692471691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800ba10 con 0x7f96e0068150 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96de7fc700 1 -- 172.21.15.52:0/1692471691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800bd90 con 0x7f96e0068150 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 -- 172.21.15.52:0/1692471691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 msgr2=0x7f96e00685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 --2- 172.21.15.52:0/1692471691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e00685a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f96e006bd00 tx=0x7f96d8009840).stop 2023-05-10T01:24:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 -- 172.21.15.52:0/1692471691 shutdown_connections 2023-05-10T01:24:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 --2- 172.21.15.52:0/1692471691 >> v2:172.21.15.172:3300/0 conn(0x7f96e0154080 0x7f96e00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 --2- 172.21.15.52:0/1692471691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e00685a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 -- 172.21.15.52:0/1692471691 >> 172.21.15.52:0/1692471691 conn(0x7f96e0067910 msgr2=0x7f96e00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.716+0000 7f96e6210700 1 -- 172.21.15.52:0/1692471691 shutdown_connections 2023-05-10T01:24:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.717+0000 7f96e6210700 1 -- 172.21.15.52:0/1692471691 wait complete. 2023-05-10T01:24:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.718+0000 7f96e6210700 1 Processor -- start 2023-05-10T01:24:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.718+0000 7f96e6210700 1 -- start start 2023-05-10T01:24:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.718+0000 7f96e6210700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.718+0000 7f96e6210700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96e0154080 0x7f96e01672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.718+0000 7f96e6210700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96e0154460 0x7f96e01677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96e6210700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0167c90 con 0x7f96e0068150 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96e6210700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01553e0 con 0x7f96e0154080 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96e6210700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01556c0 con 0x7f96e0154460 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35908/0 (socket says 172.21.15.52:35908) 2023-05-10T01:24:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 -- 172.21.15.52:0/1459441204 learned_addr learned my addr 172.21.15.52:0/1459441204 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96deffd700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96e0154080 0x7f96e01672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96dffff700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96e0154460 0x7f96e01677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 -- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96e0154460 msgr2=0x7f96e01677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96e0154460 0x7f96e01677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 -- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96e0154080 msgr2=0x7f96e01672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96e0154080 0x7f96e01672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 -- 172.21.15.52:0/1459441204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009ae0 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96df7fe700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f96d000c880 tx=0x7f96d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0010580 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00106e0 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0010a60 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01559a0 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.719+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0155f60 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.720+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0066720 con 0x7f96e0068150 2023-05-10T01:24:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.721+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f96d001b460 con 0x7f96e0068150 2023-05-10T01:24:53.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.721+0000 7f96c77fe700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 0x7f96c0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:53.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.721+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f96d0079a90 con 0x7f96e0068150 2023-05-10T01:24:53.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.721+0000 7f96deffd700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 0x7f96c0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:53.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.722+0000 7f96deffd700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 0x7f96c0061280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f96d4006fd0 tx=0x7f96d4008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:53.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.725+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96d004b220 con 0x7f96e0068150 2023-05-10T01:24:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.898+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96e00c8b90 con 0x7f96e0068150 2023-05-10T01:24:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.898+0000 7f96c77fe700 1 -- 172.21.15.52:0/1459441204 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96d004e840 con 0x7f96e0068150 2023-05-10T01:24:53.901 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 msgr2=0x7f96c0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 0x7f96c0061280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f96d4006fd0 tx=0x7f96d4008040).stop 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 msgr2=0x7f96e0154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f96d000c880 tx=0x7f96d0008040).stop 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 shutdown_connections 2023-05-10T01:24:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f96c005edc0 0x7f96c0061280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96e0154460 0x7f96e01677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e0068150 0x7f96e0154bd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 --2- 172.21.15.52:0/1459441204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96e0154080 0x7f96e01672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 >> 172.21.15.52:0/1459441204 conn(0x7f96e0067910 msgr2=0x7f96e00afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 shutdown_connections 2023-05-10T01:24:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:53.900+0000 7f96e6210700 1 -- 172.21.15.52:0/1459441204 wait complete. 2023-05-10T01:24:53.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:24:54.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.029+0000 7f12902f3700 1 Processor -- start 2023-05-10T01:24:54.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.029+0000 7f12902f3700 1 -- start start 2023-05-10T01:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.030+0000 7f12902f3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1288153ea0 0x7f1288154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.030+0000 7f12902f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1288064ff0 0x7f1288065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.030+0000 7f12902f3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1288067550 con 0x7f1288068c60 2023-05-10T01:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.030+0000 7f12902f3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1288065960 con 0x7f1288153ea0 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.030+0000 7f12902f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12880bc9a0 con 0x7f1288064ff0 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1288153ea0 0x7f1288154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1288153ea0 0x7f1288154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35916/0 (socket says 172.21.15.52:35916) 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 -- 172.21.15.52:0/286916384 learned_addr learned my addr 172.21.15.52:0/286916384 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e890700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1288064ff0 0x7f1288065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 -- 172.21.15.52:0/286916384 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1288064ff0 msgr2=0x7f1288065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1288064ff0 0x7f1288065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 -- 172.21.15.52:0/286916384 >> v1:172.21.15.172:6789/0 conn(0x7f1288068c60 legacy=0x7f1288066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 -- 172.21.15.52:0/286916384 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880bcc80 con 0x7f1288153ea0 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128e08f700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288153ea0 0x7f1288154280 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f1280009f20 tx=0x7f1280009840).ready entity=mon.0 client_cookie=7110f4245bd6fc46 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128d08d700 1 -- 172.21.15.52:0/286916384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000e070 con 0x7f1288153ea0 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128d08d700 1 -- 172.21.15.52:0/286916384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000b9d0 con 0x7f1288153ea0 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.031+0000 7f128d08d700 1 -- 172.21.15.52:0/286916384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000bd50 con 0x7f1288153ea0 2023-05-10T01:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 -- 172.21.15.52:0/286916384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288153ea0 msgr2=0x7f1288154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288153ea0 0x7f1288154280 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f1280009f20 tx=0x7f1280009840).stop 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 -- 172.21.15.52:0/286916384 shutdown_connections 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1288064ff0 0x7f1288065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 --2- 172.21.15.52:0/286916384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288153ea0 0x7f1288154280 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 -- 172.21.15.52:0/286916384 >> 172.21.15.52:0/286916384 conn(0x7f12880c4420 msgr2=0x7f12880c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 -- 172.21.15.52:0/286916384 shutdown_connections 2023-05-10T01:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.032+0000 7f12902f3700 1 -- 172.21.15.52:0/286916384 wait complete. 2023-05-10T01:24:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.033+0000 7f12902f3700 1 Processor -- start 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.033+0000 7f12902f3700 1 -- start start 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 0x7f12880a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 0x7f12880a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880a8f30 con 0x7f1288064ff0 2023-05-10T01:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880a94b0 con 0x7f1288153ea0 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12880a8060 con 0x7f12880a9e30 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35918/0 (socket says 172.21.15.52:35918) 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 -- 172.21.15.52:0/470944583 learned_addr learned my addr 172.21.15.52:0/470944583 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128d88e700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 0x7f12880a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e890700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 0x7f12880a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 -- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 msgr2=0x7f12880a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 0x7f12880a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 -- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 msgr2=0x7f12880a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 0x7f12880a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 -- 172.21.15.52:0/470944583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280009ae0 con 0x7f1288064ff0 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128d88e700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 0x7f12880a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e890700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 0x7f12880a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f128e08f700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f128000b610 tx=0x7f1280009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000bb40 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000bca0 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128001d670 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12880a8340 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.034+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1288150c10 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.035+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12880a8560 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.036+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1280024030 con 0x7f1288064ff0 2023-05-10T01:24:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.036+0000 7f12867fc700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 0x7f1268061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.036+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f128007ac00 con 0x7f1288064ff0 2023-05-10T01:24:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.036+0000 7f128d88e700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 0x7f1268061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.037+0000 7f128d88e700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 0x7f1268061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f127c001730 tx=0x7f127c009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.040+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f128004c4a0 con 0x7f1288064ff0 2023-05-10T01:24:54.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.219+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f12880a9790 con 0x7f1288064ff0 2023-05-10T01:24:54.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.219+0000 7f12867fc700 1 -- 172.21.15.52:0/470944583 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1280022030 con 0x7f1288064ff0 2023-05-10T01:24:54.222 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:54.222 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:24:54.222 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:54.222 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:24:54.223 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:24:54.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 msgr2=0x7f1268061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 0x7f1268061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f127c001730 tx=0x7f127c009040).stop 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 msgr2=0x7f1288150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f128000b610 tx=0x7f1280009840).stop 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 shutdown_connections 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f126805ed90 0x7f1268061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12880a9e30 0x7f12880a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1288064ff0 0x7f1288150720 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 --2- 172.21.15.52:0/470944583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1288153ea0 0x7f12880a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 >> 172.21.15.52:0/470944583 conn(0x7f12880c4420 msgr2=0x7f12880ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 shutdown_connections 2023-05-10T01:24:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.221+0000 7f12902f3700 1 -- 172.21.15.52:0/470944583 wait complete. 2023-05-10T01:24:54.235 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:24:54.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:24:54.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.355+0000 7f53653e9700 1 Processor -- start 2023-05-10T01:24:54.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.355+0000 7f53653e9700 1 -- start start 2023-05-10T01:24:54.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f53653e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5360153ff0 0x7f5360068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f53653e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53600c62e0 0x7f53601543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f53653e9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600c9110 con 0x7f5360068640 2023-05-10T01:24:54.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f53653e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600ca5b0 con 0x7f53600c62e0 2023-05-10T01:24:54.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f53653e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600c8820 con 0x7f5360153ff0 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53600c62e0 0x7f53601543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53600c62e0 0x7f53601543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35926/0 (socket says 172.21.15.52:35926) 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 -- 172.21.15.52:0/4102710163 learned_addr learned my addr 172.21.15.52:0/4102710163 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535effd700 1 --2- 172.21.15.52:0/4102710163 >> v2:172.21.15.172:3300/0 conn(0x7f5360153ff0 0x7f5360068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 -- 172.21.15.52:0/4102710163 >> v2:172.21.15.172:3300/0 conn(0x7f5360153ff0 msgr2=0x7f5360068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 --2- 172.21.15.52:0/4102710163 >> v2:172.21.15.172:3300/0 conn(0x7f5360153ff0 0x7f5360068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 -- 172.21.15.52:0/4102710163 >> v1:172.21.15.172:6789/0 conn(0x7f5360068640 legacy=0x7f53600c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 -- 172.21.15.52:0/4102710163 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600c8ac0 con 0x7f53600c62e0 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.356+0000 7f535f7fe700 1 --2- 172.21.15.52:0/4102710163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53601543d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f5360060170 tx=0x7f53500090f0).ready entity=mon.0 client_cookie=c88681c6cb4d750e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f535dffb700 1 -- 172.21.15.52:0/4102710163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000b5a0 con 0x7f53600c62e0 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f535dffb700 1 -- 172.21.15.52:0/4102710163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000b700 con 0x7f53600c62e0 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f535dffb700 1 -- 172.21.15.52:0/4102710163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000ba80 con 0x7f53600c62e0 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 -- 172.21.15.52:0/4102710163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 msgr2=0x7f53601543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 --2- 172.21.15.52:0/4102710163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53601543d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f5360060170 tx=0x7f53500090f0).stop 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 -- 172.21.15.52:0/4102710163 shutdown_connections 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 --2- 172.21.15.52:0/4102710163 >> v2:172.21.15.172:3300/0 conn(0x7f5360153ff0 0x7f5360068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 --2- 172.21.15.52:0/4102710163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53601543d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 -- 172.21.15.52:0/4102710163 >> 172.21.15.52:0/4102710163 conn(0x7f53600678d0 msgr2=0x7f53600cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 -- 172.21.15.52:0/4102710163 shutdown_connections 2023-05-10T01:24:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.357+0000 7f53653e9700 1 -- 172.21.15.52:0/4102710163 wait complete. 2023-05-10T01:24:54.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.358+0000 7f53653e9700 1 Processor -- start 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.358+0000 7f53653e9700 1 -- start start 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360068640 0x7f53601483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 0x7f53600ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ad7a0 con 0x7f53600c62e0 2023-05-10T01:24:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360145380 con 0x7f5360068640 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f53653e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5360144ef0 con 0x7f5360153ff0 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f535e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f535e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35934/0 (socket says 172.21.15.52:35934) 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f535e7fc700 1 -- 172.21.15.52:0/1211247351 learned_addr learned my addr 172.21.15.52:0/1211247351 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f535effd700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360068640 0x7f53601483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.359+0000 7f535f7fe700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 0x7f53600ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 -- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 msgr2=0x7f53600ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 0x7f53600ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 -- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360068640 msgr2=0x7f53601483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360068640 0x7f53601483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 -- 172.21.15.52:0/1211247351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009370 con 0x7f53600c62e0 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535f7fe700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 0x7f53600ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f535e7fc700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f535400b4c0 tx=0x7f5354009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354012410 con 0x7f53600c62e0 2023-05-10T01:24:54.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53540125b0 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601488d0 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354012970 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.360+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53601445c0 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.361+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360066720 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.361+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f535400f030 con 0x7f53600c62e0 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.361+0000 7f5346ffd700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 0x7f5340061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.362+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f5354079490 con 0x7f53600c62e0 2023-05-10T01:24:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.362+0000 7f535effd700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 0x7f5340061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.362+0000 7f535effd700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 0x7f5340061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f535800f570 tx=0x7f5358007780).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.366+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f535404ac80 con 0x7f53600c62e0 2023-05-10T01:24:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.538+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f536006c340 con 0x7f53600c62e0 2023-05-10T01:24:54.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.627+0000 7f5346ffd700 1 -- 172.21.15.52:0/1211247351 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 152+0+0 (secure 0 0 0) 0x7f535404e2a0 con 0x7f53600c62e0 2023-05-10T01:24:54.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 msgr2=0x7f5340061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 0x7f5340061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f535800f570 tx=0x7f5358007780).stop 2023-05-10T01:24:54.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 msgr2=0x7f53600acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f535400b4c0 tx=0x7f5354009060).stop 2023-05-10T01:24:54.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 shutdown_connections 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f534005ed90 0x7f5340061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360153ff0 0x7f53600ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360068640 0x7f53601483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 --2- 172.21.15.52:0/1211247351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53600c62e0 0x7f53600acdc0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 >> 172.21.15.52:0/1211247351 conn(0x7f53600678d0 msgr2=0x7f53600c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 shutdown_connections 2023-05-10T01:24:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.630+0000 7f53653e9700 1 -- 172.21.15.52:0/1211247351 wait complete. 2023-05-10T01:24:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:24:54.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:24:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.770+0000 7f9a01300700 1 Processor -- start 2023-05-10T01:24:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.770+0000 7f9a01300700 1 -- start start 2023-05-10T01:24:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f9a01300700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99fc0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f9a01300700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99fc068150 0x7f99fc068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f9a01300700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0c94c0 con 0x7f99fc154460 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f9a01300700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0cb7d0 con 0x7f99fc068150 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f9a01300700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc068a60 con 0x7f99fc154080 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f99fa7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99fc154460 0x7f99fc0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44958/0 (socket says 172.21.15.52:44958) 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f99fa7fc700 1 -- 172.21.15.52:0/423340248 learned_addr learned my addr 172.21.15.52:0/423340248 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/423340248 >> v2:172.21.15.172:3300/0 conn(0x7f99fc068150 0x7f99fc068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f99faffd700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99fc0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.771+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966095846 0 0) 0x7f99fc0c94c0 con 0x7f99fc154460 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99dc0033f0 con 0x7f99fc154460 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354316644 0 0) 0x7f99dc0033f0 con 0x7f99fc154460 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 msgr2=0x7f99fc0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99fc0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 >> v2:172.21.15.172:3300/0 conn(0x7f99fc068150 msgr2=0x7f99fc068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 --2- 172.21.15.52:0/423340248 >> v2:172.21.15.172:3300/0 conn(0x7f99fc068150 0x7f99fc068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0c88b0 con 0x7f99fc154460 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f99e4001470 con 0x7f99fc154460 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 >> v1:172.21.15.52:6789/0 conn(0x7f99fc154460 legacy=0x7f99fc0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc0038e0 0x7f99dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99dc004b80 0x7f99dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0cb7d0 con 0x7f99dc004b80 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc068a60 con 0x7f99dc0038e0 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc00b8e0 con 0x7f99fc154080 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99dc004b80 0x7f99dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99faffd700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc0038e0 0x7f99dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fa7fc700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 -- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 msgr2=0x7f99dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc154080 0x7f99dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 -- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc0038e0 msgr2=0x7f99dc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc0038e0 0x7f99dc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 -- 172.21.15.52:0/423340248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0033f0 con 0x7f99dc004b80 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.772+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99dc004b80 0x7f99dc005000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f99ec00e210 tx=0x7f99ec00b040).ready entity=mon.0 client_cookie=6985d9107ec5e4c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec009ac0 con 0x7f99dc004b80 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00f040 con 0x7f99dc004b80 2023-05-10T01:24:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f99f9ffb700 1 -- 172.21.15.52:0/423340248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00ecd0 con 0x7f99dc004b80 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 -- 172.21.15.52:0/423340248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99dc004b80 msgr2=0x7f99dc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 --2- 172.21.15.52:0/423340248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99dc004b80 0x7f99dc005000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f99ec00e210 tx=0x7f99ec00b040).stop 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f99fb7fe700 1 -- 172.21.15.52:0/423340248 reap_dead start 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 -- 172.21.15.52:0/423340248 shutdown_connections 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 -- 172.21.15.52:0/423340248 >> 172.21.15.52:0/423340248 conn(0x7f99fc067910 msgr2=0x7f99fc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 -- 172.21.15.52:0/423340248 shutdown_connections 2023-05-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.773+0000 7f9a01300700 1 -- 172.21.15.52:0/423340248 wait complete. 2023-05-10T01:24:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.774+0000 7f9a01300700 1 Processor -- start 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 -- start start 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 0x7f99fc13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 0x7f99fc0aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0c41a0 con 0x7f99fc13dfb0 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc13eea0 con 0x7f99fc0c2c60 2023-05-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f9a01300700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0c3590 con 0x7f99fc13e390 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f99faffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f99faffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35952/0 (socket says 172.21.15.52:35952) 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f99faffd700 1 -- 172.21.15.52:0/3191952082 learned_addr learned my addr 172.21.15.52:0/3191952082 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 0x7f99fc0aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.775+0000 7f99fa7fc700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 0x7f99fc13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 -- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 msgr2=0x7f99fc13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 0x7f99fc13e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 -- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 msgr2=0x7f99fc0aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 0x7f99fc0aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 -- 172.21.15.52:0/3191952082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0c3870 con 0x7f99fc13dfb0 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99fb7fe700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 0x7f99fc0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99fa7fc700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 0x7f99fc13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99faffd700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f99f40119c0 tx=0x7f99f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400f8e0 con 0x7f99fc13dfb0 2023-05-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400fa40 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400fe00 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0c3b50 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.776+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0c30c0 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.777+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc0c4480 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.777+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f99f4024070 con 0x7f99fc13dfb0 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.778+0000 7f99f2ffd700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 0x7f99e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.778+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f99f407a580 con 0x7f99fc13dfb0 2023-05-10T01:24:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.778+0000 7f99fa7fc700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 0x7f99e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.779+0000 7f99fa7fc700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 0x7f99e0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f99fc0b0d80 tx=0x7f99e4009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.783+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f404bc00 con 0x7f99fc13dfb0 2023-05-10T01:24:54.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:54.956+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99fc0c3340 con 0x7f99fc13dfb0 2023-05-10T01:24:55.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.633+0000 7f99f2ffd700 1 -- 172.21.15.52:0/3191952082 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7f99f404f220 con 0x7f99fc13dfb0 2023-05-10T01:24:55.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.640+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 msgr2=0x7f99e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.640+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 0x7f99e0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f99fc0b0d80 tx=0x7f99e4009040).stop 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.640+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 msgr2=0x7f99fc0afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.640+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f99f40119c0 tx=0x7f99f4009060).stop 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 shutdown_connections 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f99e005ed90 0x7f99e0061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99fc0c2c60 0x7f99fc0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99fc13dfb0 0x7f99fc0afa60 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 --2- 172.21.15.52:0/3191952082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99fc13e390 0x7f99fc13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.641+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 >> 172.21.15.52:0/3191952082 conn(0x7f99fc067910 msgr2=0x7f99fc0ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.642+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 shutdown_connections 2023-05-10T01:24:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.643+0000 7f9a01300700 1 -- 172.21.15.52:0/3191952082 wait complete. 2023-05-10T01:24:55.662 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:24:55.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:24:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 Processor -- start 2023-05-10T01:24:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 -- start start 2023-05-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 0x7fb41014e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb410158dd0 con 0x7fb4100c2ec0 2023-05-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb410068bb0 con 0x7fb4100c32a0 2023-05-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.795+0000 7fb4150c8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100691e0 con 0x7fb4101586a0 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40ed9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb4100c2ec0 0x7fb4100a5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44976/0 (socket says 172.21.15.52:44976) 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40ed9d700 1 -- 172.21.15.52:0/4280975774 learned_addr learned my addr 172.21.15.52:0/4280975774 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40f59e700 1 --2- 172.21.15.52:0/4280975774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 0x7fb41014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583582177 0 0) 0x7fb410158dd0 con 0x7fb4100c2ec0 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f00033f0 con 0x7fb4100c2ec0 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543529322 0 0) 0x7fb410068bb0 con 0x7fb4100c32a0 2023-05-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb410158dd0 con 0x7fb4100c32a0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40f59e700 1 -- 172.21.15.52:0/4280975774 >> v1:172.21.15.172:6789/0 conn(0x7fb4100c32a0 legacy=0x7fb410157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2000315512 0 0) 0x7fb3f00033f0 con 0x7fb4100c2ec0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40f59e700 1 -- 172.21.15.52:0/4280975774 >> v1:172.21.15.52:6789/0 conn(0x7fb4100c2ec0 legacy=0x7fb4100a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40f59e700 1 -- 172.21.15.52:0/4280975774 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100a5df0 con 0x7fb4101586a0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40f59e700 1 --2- 172.21.15.52:0/4280975774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 0x7fb41014e160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb408009790 tx=0x7fb408009060).ready entity=mon.2 client_cookie=26d2444ad1ba8827 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.796+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400001470 con 0x7fb4101586a0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408011400 con 0x7fb4101586a0 2023-05-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb40dd9b700 1 -- 172.21.15.52:0/4280975774 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011780 con 0x7fb4101586a0 2023-05-10T01:24:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 -- 172.21.15.52:0/4280975774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 msgr2=0x7fb41014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 --2- 172.21.15.52:0/4280975774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 0x7fb41014e160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb408009790 tx=0x7fb408009060).stop 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 -- 172.21.15.52:0/4280975774 shutdown_connections 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 --2- 172.21.15.52:0/4280975774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4101586a0 0x7fb41014e160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 -- 172.21.15.52:0/4280975774 >> 172.21.15.52:0/4280975774 conn(0x7fb4100c6c90 msgr2=0x7fb4100c70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 -- 172.21.15.52:0/4280975774 shutdown_connections 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.797+0000 7fb4150c8700 1 -- 172.21.15.52:0/4280975774 wait complete. 2023-05-10T01:24:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.798+0000 7fb4150c8700 1 Processor -- start 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.798+0000 7fb4150c8700 1 -- start start 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4100c2ec0 0x7fb41015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4100c32a0 0x7fb4100644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb410159330 con 0x7fb4101586a0 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb410159610 con 0x7fb4100c32a0 2023-05-10T01:24:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb4150c8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101598f0 con 0x7fb4100c2ec0 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35970/0 (socket says 172.21.15.52:35970) 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 -- 172.21.15.52:0/2099292344 learned_addr learned my addr 172.21.15.52:0/2099292344 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40ed9d700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4100c2ec0 0x7fb41015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40e59c700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4100c32a0 0x7fb4100644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 -- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4100c2ec0 msgr2=0x7fb41015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4100c2ec0 0x7fb41015a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 -- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4100c32a0 msgr2=0x7fb4100644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4100c32a0 0x7fb4100644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.799+0000 7fb40f59e700 1 -- 172.21.15.52:0/2099292344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080092a0 con 0x7fb4101586a0 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb40f59e700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fb408010000 tx=0x7fb408016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408021070 con 0x7fb4101586a0 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408010a20 con 0x7fb4101586a0 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb410159bd0 con 0x7fb4101586a0 2023-05-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408010dc0 con 0x7fb4101586a0 2023-05-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.800+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb410158fe0 con 0x7fb4101586a0 2023-05-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.801+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41006c340 con 0x7fb4101586a0 2023-05-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.801+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb40800f070 con 0x7fb4101586a0 2023-05-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.802+0000 7fb406ffd700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 0x7fb3f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.802+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6285+0+0 (secure 0 0 0) 0x7fb40807ace0 con 0x7fb4101586a0 2023-05-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.802+0000 7fb40ed9d700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 0x7fb3f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.802+0000 7fb40ed9d700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 0x7fb3f4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb4000015a0 tx=0x7fb400000bc0).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:55.806+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb40804c1e0 con 0x7fb4101586a0 2023-05-10T01:24:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.027+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb4100a60d0 con 0x7fb4101586a0 2023-05-10T01:24:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.050+0000 7fb406ffd700 1 -- 172.21.15.52:0/2099292344 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb40804f800 con 0x7fb4101586a0 2023-05-10T01:24:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 msgr2=0x7fb3f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 0x7fb3f4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb4000015a0 tx=0x7fb400000bc0).stop 2023-05-10T01:24:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 msgr2=0x7fb4100a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fb408010000 tx=0x7fb408016000).stop 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 shutdown_connections 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb3f405ed90 0x7fb3f4061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4101586a0 0x7fb4100a8ea0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4100c2ec0 0x7fb41015a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 --2- 172.21.15.52:0/2099292344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4100c32a0 0x7fb4100644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 >> 172.21.15.52:0/2099292344 conn(0x7fb4100c6c90 msgr2=0x7fb4100bc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.054+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 shutdown_connections 2023-05-10T01:24:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.055+0000 7fb4150c8700 1 -- 172.21.15.52:0/2099292344 wait complete. 2023-05-10T01:24:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 11 and data pool 12 2023-05-10T01:24:56.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.188+0000 7f62cf3a3700 1 Processor -- start 2023-05-10T01:24:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.188+0000 7f62cf3a3700 1 -- start start 2023-05-10T01:24:56.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cf3a3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c8154540 0x7f62c8069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cf3a3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62c8069b80 0x7f62c80c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cf3a3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80c0650 con 0x7f62c8154160 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cf3a3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c8069fb0 con 0x7f62c8154540 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cf3a3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c80bfd20 con 0x7f62c8069b80 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c8154540 0x7f62c8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c8154540 0x7f62c8069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35992/0 (socket says 172.21.15.52:35992) 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 -- 172.21.15.52:0/2358448690 learned_addr learned my addr 172.21.15.52:0/2358448690 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:56.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cd940700 1 --2- 172.21.15.52:0/2358448690 >> v2:172.21.15.172:3300/0 conn(0x7f62c8069b80 0x7f62c80c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 -- 172.21.15.52:0/2358448690 >> v2:172.21.15.172:3300/0 conn(0x7f62c8069b80 msgr2=0x7f62c80c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 --2- 172.21.15.52:0/2358448690 >> v2:172.21.15.172:3300/0 conn(0x7f62c8069b80 0x7f62c80c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 -- 172.21.15.52:0/2358448690 >> v1:172.21.15.172:6789/0 conn(0x7f62c8154160 legacy=0x7f62c80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 -- 172.21.15.52:0/2358448690 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80c0000 con 0x7f62c8154540 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62cc93e700 1 --2- 172.21.15.52:0/2358448690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8154540 0x7f62c8069690 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f62c80c5200 tx=0x7f62bc0090f0).ready entity=mon.0 client_cookie=116c7de08dc697eb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62c7fff700 1 -- 172.21.15.52:0/2358448690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00b5a0 con 0x7f62c8154540 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62c7fff700 1 -- 172.21.15.52:0/2358448690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00b700 con 0x7f62c8154540 2023-05-10T01:24:56.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.189+0000 7f62c7fff700 1 -- 172.21.15.52:0/2358448690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00baa0 con 0x7f62c8154540 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 -- 172.21.15.52:0/2358448690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8154540 msgr2=0x7f62c8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/2358448690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8154540 0x7f62c8069690 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f62c80c5200 tx=0x7f62bc0090f0).stop 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 -- 172.21.15.52:0/2358448690 shutdown_connections 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/2358448690 >> v2:172.21.15.172:3300/0 conn(0x7f62c8069b80 0x7f62c80c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/2358448690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8154540 0x7f62c8069690 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 -- 172.21.15.52:0/2358448690 >> 172.21.15.52:0/2358448690 conn(0x7f62c80cb6f0 msgr2=0x7f62c80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 -- 172.21.15.52:0/2358448690 shutdown_connections 2023-05-10T01:24:56.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.190+0000 7f62cf3a3700 1 -- 172.21.15.52:0/2358448690 wait complete. 2023-05-10T01:24:56.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.191+0000 7f62cf3a3700 1 Processor -- start 2023-05-10T01:24:56.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.191+0000 7f62cf3a3700 1 -- start start 2023-05-10T01:24:56.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62c8154160 0x7f62c80c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 0x7f62c815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8164ae0 con 0x7f62c8069b80 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c4140 con 0x7f62c8154160 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cf3a3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c4420 con 0x7f62c8154540 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35996/0 (socket says 172.21.15.52:35996) 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 -- 172.21.15.52:0/4195805535 learned_addr learned my addr 172.21.15.52:0/4195805535 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cc93e700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62c8154160 0x7f62c80c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd940700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 0x7f62c815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 -- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 msgr2=0x7f62c815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 0x7f62c815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 -- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62c8154160 msgr2=0x7f62c80c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62c8154160 0x7f62c80c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd13f700 1 -- 172.21.15.52:0/4195805535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009370 con 0x7f62c8069b80 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.192+0000 7f62cd940700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 0x7f62c815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:24:56.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62cd13f700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f62c000c810 tx=0x7f62c00025e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0010510 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0010690 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c8164770 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0010a50 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.193+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c80af750 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.194+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c805e950 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.194+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f62c0010070 con 0x7f62c8069b80 2023-05-10T01:24:56.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.194+0000 7f62c57fa700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 0x7f62a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.195+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f62c0079a70 con 0x7f62c8069b80 2023-05-10T01:24:56.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.195+0000 7f62cc93e700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 0x7f62a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.195+0000 7f62cc93e700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 0x7f62a8061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f62c8154920 tx=0x7f62bc015000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.199+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62c805e950 con 0x7f62c8069b80 2023-05-10T01:24:56.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.373+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62c805e950 con 0x7f62c8069b80 2023-05-10T01:24:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.374+0000 7f62c57fa700 1 -- 172.21.15.52:0/4195805535 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17443 (secure 0 0 0) 0x7f62c805e950 con 0x7f62c8069b80 2023-05-10T01:24:56.377 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:56.377 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:56.027792+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:56.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 msgr2=0x7f62a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 0x7f62a8061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f62c8154920 tx=0x7f62bc015000).stop 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 msgr2=0x7f62c814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f62c000c810 tx=0x7f62c00025e0).stop 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 shutdown_connections 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f62a805ed90 0x7f62a8061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62c8154540 0x7f62c815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c8069b80 0x7f62c814cc30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 --2- 172.21.15.52:0/4195805535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62c8154160 0x7f62c80c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 >> 172.21.15.52:0/4195805535 conn(0x7f62c80cb6f0 msgr2=0x7f62c80aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 shutdown_connections 2023-05-10T01:24:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.376+0000 7f62cf3a3700 1 -- 172.21.15.52:0/4195805535 wait complete. 2023-05-10T01:24:56.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 Processor -- start 2023-05-10T01:24:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 -- start start 2023-05-10T01:24:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb87414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb874066e40 0x7fb874157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8740672a0 0x7fb874157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb874137460 con 0x7fb8740672a0 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740c3510 con 0x7fb874066e40 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.503+0000 7fb87a567700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb874158420 con 0x7fb87414e1f0 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8740672a0 0x7fb874157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8740672a0 0x7fb874157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36006/0 (socket says 172.21.15.52:36006) 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 -- 172.21.15.52:0/724438494 learned_addr learned my addr 172.21.15.52:0/724438494 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb8737fe700 1 --2- 172.21.15.52:0/724438494 >> v2:172.21.15.172:3300/0 conn(0x7fb874066e40 0x7fb874157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb873fff700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb87414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 -- 172.21.15.52:0/724438494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 msgr2=0x7fb87414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb87414e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 -- 172.21.15.52:0/724438494 >> v2:172.21.15.172:3300/0 conn(0x7fb874066e40 msgr2=0x7fb874157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 --2- 172.21.15.52:0/724438494 >> v2:172.21.15.172:3300/0 conn(0x7fb874066e40 0x7fb874157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 -- 172.21.15.52:0/724438494 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740683c0 con 0x7fb8740672a0 2023-05-10T01:24:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb878b04700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8740672a0 0x7fb874157f30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb874069fa0 tx=0x7fb86c009840).ready entity=mon.0 client_cookie=2778ce513a7fc233 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb872ffd700 1 -- 172.21.15.52:0/724438494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00e070 con 0x7fb8740672a0 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb872ffd700 1 -- 172.21.15.52:0/724438494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00b970 con 0x7fb8740672a0 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.504+0000 7fb872ffd700 1 -- 172.21.15.52:0/724438494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00bcf0 con 0x7fb8740672a0 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 -- 172.21.15.52:0/724438494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8740672a0 msgr2=0x7fb874157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8740672a0 0x7fb874157f30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb874069fa0 tx=0x7fb86c009840).stop 2023-05-10T01:24:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 -- 172.21.15.52:0/724438494 shutdown_connections 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8740672a0 0x7fb874157f30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 --2- 172.21.15.52:0/724438494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb87414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 --2- 172.21.15.52:0/724438494 >> v2:172.21.15.172:3300/0 conn(0x7fb874066e40 0x7fb874157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 -- 172.21.15.52:0/724438494 >> 172.21.15.52:0/724438494 conn(0x7fb8740c7bb0 msgr2=0x7fb8740c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 -- 172.21.15.52:0/724438494 shutdown_connections 2023-05-10T01:24:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.505+0000 7fb87a567700 1 -- 172.21.15.52:0/724438494 wait complete. 2023-05-10T01:24:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.506+0000 7fb87a567700 1 Processor -- start 2023-05-10T01:24:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.506+0000 7fb87a567700 1 -- start start 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8740672a0 0x7fb8740ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb874065cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87413a340 con 0x7fb874066e40 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740ab3d0 con 0x7fb8740672a0 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb87a567700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740ab640 con 0x7fb87414e1f0 2023-05-10T01:24:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36008/0 (socket says 172.21.15.52:36008) 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 -- 172.21.15.52:0/3574853769 learned_addr learned my addr 172.21.15.52:0/3574853769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb8737fe700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8740672a0 0x7fb8740ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb878b04700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb874065cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 -- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 msgr2=0x7fb874065cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb874065cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 -- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8740672a0 msgr2=0x7fb8740ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8740672a0 0x7fb8740ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.507+0000 7fb873fff700 1 -- 172.21.15.52:0/3574853769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009ae0 con 0x7fb874066e40 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb873fff700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb85c00e900 tx=0x7fb85c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012600 con 0x7fb874066e40 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c012760 con 0x7fb874066e40 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012ae0 con 0x7fb874066e40 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740ab920 con 0x7fb874066e40 2023-05-10T01:24:56.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.508+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8740abee0 con 0x7fb874066e40 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.509+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740ac100 con 0x7fb874066e40 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.509+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb85c022070 con 0x7fb874066e40 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.510+0000 7fb86bfff700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 0x7fb858061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.510+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb85c079e10 con 0x7fb874066e40 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.510+0000 7fb8737fe700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 0x7fb858061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.510+0000 7fb8737fe700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 0x7fb858061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb8740c4030 tx=0x7fb864009060).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.514+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb85c04b2a0 con 0x7fb874066e40 2023-05-10T01:24:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.689+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb87406c340 con 0x7fb874066e40 2023-05-10T01:24:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.690+0000 7fb86bfff700 1 -- 172.21.15.52:0/3574853769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17443 (secure 0 0 0) 0x7fb85c016020 con 0x7fb874066e40 2023-05-10T01:24:56.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:56.694 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:56.027792+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 msgr2=0x7fb858061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 0x7fb858061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb8740c4030 tx=0x7fb864009060).stop 2023-05-10T01:24:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 msgr2=0x7fb874135f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb85c00e900 tx=0x7fb85c009060).stop 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 shutdown_connections 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb85805ed90 0x7fb858061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87414e1f0 0x7fb874065cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb874066e40 0x7fb874135f90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 --2- 172.21.15.52:0/3574853769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8740672a0 0x7fb8740ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 >> 172.21.15.52:0/3574853769 conn(0x7fb8740c7bb0 msgr2=0x7fb874136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 shutdown_connections 2023-05-10T01:24:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.692+0000 7fb87a567700 1 -- 172.21.15.52:0/3574853769 wait complete. 2023-05-10T01:24:56.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:24:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.825+0000 7ff709f6c700 1 Processor -- start 2023-05-10T01:24:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.825+0000 7ff709f6c700 1 -- start start 2023-05-10T01:24:56.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff709f6c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7040c6080 0x7ff704154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff709f6c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040c9110 con 0x7ff704153ff0 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff709f6c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040ca5b0 con 0x7ff7040c5bd0 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff709f6c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040c8820 con 0x7ff7040c6080 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff703fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7040c6080 0x7ff704154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff7037fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff704153ff0 0x7ff704068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45032/0 (socket says 172.21.15.52:45032) 2023-05-10T01:24:56.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff7037fe700 1 -- 172.21.15.52:0/3114753609 learned_addr learned my addr 172.21.15.52:0/3114753609 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff703fff700 1 -- 172.21.15.52:0/3114753609 >> v1:172.21.15.172:6789/0 conn(0x7ff7040c5bd0 legacy=0x7ff7041543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff703fff700 1 -- 172.21.15.52:0/3114753609 >> v1:172.21.15.52:6789/0 conn(0x7ff704153ff0 legacy=0x7ff704068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff7027fc700 1 -- 172.21.15.52:0/3114753609 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038436715 0 0) 0x7ff7040c9110 con 0x7ff704153ff0 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.826+0000 7ff703fff700 1 -- 172.21.15.52:0/3114753609 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040c64f0 con 0x7ff7040c6080 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff703fff700 1 --2- 172.21.15.52:0/3114753609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7040c6080 0x7ff704154ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7ff6fc009e60 tx=0x7ff6fc009780).ready entity=mon.0 client_cookie=f444c4154c3b7b69 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff7027fc700 1 -- 172.21.15.52:0/3114753609 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00e070 con 0x7ff7040c6080 2023-05-10T01:24:56.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff7027fc700 1 -- 172.21.15.52:0/3114753609 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00bc30 con 0x7ff7040c6080 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff7027fc700 1 -- 172.21.15.52:0/3114753609 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc012410 con 0x7ff7040c6080 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 -- 172.21.15.52:0/3114753609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7040c6080 msgr2=0x7ff704154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 --2- 172.21.15.52:0/3114753609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7040c6080 0x7ff704154ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7ff6fc009e60 tx=0x7ff6fc009780).stop 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 -- 172.21.15.52:0/3114753609 shutdown_connections 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 --2- 172.21.15.52:0/3114753609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7040c6080 0x7ff704154ae0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 -- 172.21.15.52:0/3114753609 >> 172.21.15.52:0/3114753609 conn(0x7ff7040678d0 msgr2=0x7ff7040cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 -- 172.21.15.52:0/3114753609 shutdown_connections 2023-05-10T01:24:56.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.827+0000 7ff709f6c700 1 -- 172.21.15.52:0/3114753609 wait complete. 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 Processor -- start 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 -- start start 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7040c5bd0 0x7ff7041437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 0x7ff704156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704157340 con 0x7ff704153ff0 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704164520 con 0x7ff7040c6080 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff709f6c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040b0190 con 0x7ff7040c5bd0 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff703fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff703fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36026/0 (socket says 172.21.15.52:36026) 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.829+0000 7ff703fff700 1 -- 172.21.15.52:0/2570328322 learned_addr learned my addr 172.21.15.52:0/2570328322 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 -- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7040c5bd0 msgr2=0x7ff7041437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff7037fe700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7040c5bd0 0x7ff7041437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff702ffd700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 0x7ff704156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7040c5bd0 0x7ff7041437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 -- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 msgr2=0x7ff704156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 0x7ff704156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 -- 172.21.15.52:0/2570328322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009a20 con 0x7ff704153ff0 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff702ffd700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 0x7ff704156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff703fff700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7ff6fc0094c0 tx=0x7ff6fc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0064a0 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc006600 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040b0470 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0069a0 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.830+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040b0a30 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.831+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704066720 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.832+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff6fc01d630 con 0x7ff704153ff0 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.832+0000 7ff6eb7fe700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.832+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff6fc07c280 con 0x7ff704153ff0 2023-05-10T01:24:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.832+0000 7ff7037fe700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.833+0000 7ff7037fe700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff6f4000c00 tx=0x7ff6f4009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:56.836+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6fc04d710 con 0x7ff704153ff0 2023-05-10T01:24:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:57.058+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff70406c340 con 0x7ff704153ff0 2023-05-10T01:24:58.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.036+0000 7ff6eb7fe700 1 -- 172.21.15.52:0/2570328322 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff6fc050d30 con 0x7ff704153ff0 2023-05-10T01:24:58.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.038+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 msgr2=0x7ff6e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.038+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff6f4000c00 tx=0x7ff6f4009040).stop 2023-05-10T01:24:58.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.038+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 msgr2=0x7ff704156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.038+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7ff6fc0094c0 tx=0x7ff6fc009780).stop 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.038+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 shutdown_connections 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704153ff0 0x7ff704156e50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7040c5bd0 0x7ff7041437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 --2- 172.21.15.52:0/2570328322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7040c6080 0x7ff704156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 >> 172.21.15.52:0/2570328322 conn(0x7ff7040678d0 msgr2=0x7ff7040c0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 shutdown_connections 2023-05-10T01:24:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.039+0000 7ff709f6c700 1 -- 172.21.15.52:0/2570328322 wait complete. 2023-05-10T01:24:58.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:24:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.181+0000 7f70bb1df700 1 Processor -- start 2023-05-10T01:24:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.181+0000 7f70bb1df700 1 -- start start 2023-05-10T01:24:58.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70bb1df700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f70b4153f80 0x7f70b40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70bb1df700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b4155770 con 0x7f70b40c5cf0 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70bb1df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b406a130 con 0x7f70b4155370 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70bb1df700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b4069f50 con 0x7f70b4153f80 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70ba1dd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f70b4153f80 0x7f70b40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70b99dc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f70b40c5cf0 0x7f70b40c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45050/0 (socket says 172.21.15.52:45050) 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70b99dc700 1 -- 172.21.15.52:0/1054092321 learned_addr learned my addr 172.21.15.52:0/1054092321 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:58.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70ba1dd700 1 -- 172.21.15.52:0/1054092321 >> v1:172.21.15.172:6789/0 conn(0x7f70b4155370 legacy=0x7f70b40c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70ba1dd700 1 -- 172.21.15.52:0/1054092321 >> v1:172.21.15.52:6789/0 conn(0x7f70b40c5cf0 legacy=0x7f70b40c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70ba1dd700 1 -- 172.21.15.52:0/1054092321 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b406a410 con 0x7f70b4153f80 2023-05-10T01:24:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70ba1dd700 1 --2- 172.21.15.52:0/1054092321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b4153f80 0x7f70b40a9d10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f70b40aa7d0 tx=0x7f70ac009060).ready entity=mon.0 client_cookie=db0d706c326d760c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.182+0000 7f70b91db700 1 -- 172.21.15.52:0/1054092321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00f510 con 0x7f70b4153f80 2023-05-10T01:24:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70b91db700 1 -- 172.21.15.52:0/1054092321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac00f670 con 0x7f70b4153f80 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70b91db700 1 -- 172.21.15.52:0/1054092321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00f9f0 con 0x7f70b4153f80 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 -- 172.21.15.52:0/1054092321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b4153f80 msgr2=0x7f70b40a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 --2- 172.21.15.52:0/1054092321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b4153f80 0x7f70b40a9d10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f70b40aa7d0 tx=0x7f70ac009060).stop 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 -- 172.21.15.52:0/1054092321 shutdown_connections 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 --2- 172.21.15.52:0/1054092321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b4153f80 0x7f70b40a9d10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 -- 172.21.15.52:0/1054092321 >> 172.21.15.52:0/1054092321 conn(0x7f70b40cb5f0 msgr2=0x7f70b40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 -- 172.21.15.52:0/1054092321 shutdown_connections 2023-05-10T01:24:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.183+0000 7f70bb1df700 1 -- 172.21.15.52:0/1054092321 wait complete. 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.184+0000 7f70bb1df700 1 Processor -- start 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.184+0000 7f70bb1df700 1 -- start start 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70b4153f80 0x7f70b40a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4155370 0x7f70b4167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b414f160 con 0x7f70b40c5cf0 2023-05-10T01:24:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40c35c0 con 0x7f70b4155370 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70bb1df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40c3f60 con 0x7f70b4153f80 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36038/0 (socket says 172.21.15.52:36038) 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 -- 172.21.15.52:0/2837480339 learned_addr learned my addr 172.21.15.52:0/2837480339 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba9de700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4155370 0x7f70b4167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 -- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70b4153f80 msgr2=0x7f70b40a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70b4153f80 0x7f70b40a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 -- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4155370 msgr2=0x7f70b4167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4155370 0x7f70b4167820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 -- 172.21.15.52:0/2837480339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0092a0 con 0x7f70b40c5cf0 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.185+0000 7f70ba1dd700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f70ac011ed0 tx=0x7f70ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.186+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00f9f0 con 0x7f70b40c5cf0 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.186+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac01b410 con 0x7f70b40c5cf0 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.186+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40c29b0 con 0x7f70b40c5cf0 2023-05-10T01:24:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.186+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac01b7d0 con 0x7f70b40c5cf0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.186+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40c2f70 con 0x7f70b40c5cf0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.187+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b4083110 con 0x7f70b40c5cf0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.187+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f70ac02b070 con 0x7f70b40c5cf0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.187+0000 7f70b27fc700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 0x7f7094061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.187+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f70ac07b5c0 con 0x7f70b40c5cf0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.188+0000 7f70b99dc700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 0x7f7094061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.188+0000 7f70b99dc700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 0x7f7094061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f70a8007fd0 tx=0x7f70a8007d30).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:58.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.192+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70ac04ca50 con 0x7f70b40c5cf0 2023-05-10T01:24:58.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:58.412+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f70b4047150 con 0x7f70b40c5cf0 2023-05-10T01:24:58.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:24:58.957 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:24:59.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.040+0000 7f70b27fc700 1 -- 172.21.15.52:0/2837480339 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70ac0290c0 con 0x7f70b40c5cf0 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 msgr2=0x7f7094061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 0x7f7094061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f70a8007fd0 tx=0x7f70a8007d30).stop 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 msgr2=0x7f70b40c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f70ac011ed0 tx=0x7f70ac017000).stop 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 shutdown_connections 2023-05-10T01:24:59.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f709405ed90 0x7f7094061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4155370 0x7f70b4167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70b40c5cf0 0x7f70b40c3a70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 --2- 172.21.15.52:0/2837480339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70b4153f80 0x7f70b40a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 >> 172.21.15.52:0/2837480339 conn(0x7f70b40cb5f0 msgr2=0x7f70b40c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 shutdown_connections 2023-05-10T01:24:59.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.042+0000 7f70bb1df700 1 -- 172.21.15.52:0/2837480339 wait complete. 2023-05-10T01:24:59.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:24:59.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.216+0000 7f4c2856a700 1 Processor -- start 2023-05-10T01:24:59.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.216+0000 7f4c2856a700 1 -- start start 2023-05-10T01:24:59.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c20154160 0x7f4c200c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4c20154540 0x7f4c200c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20069690 0x7f4c20069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200c0650 con 0x7f4c20154160 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2006a010 con 0x7f4c20154540 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c2856a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200bfd20 con 0x7f4c20069690 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c26306700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c20154160 0x7f4c200c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c26306700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c20154160 0x7f4c200c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36044/0 (socket says 172.21.15.52:36044) 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c26306700 1 -- 172.21.15.52:0/399522445 learned_addr learned my addr 172.21.15.52:0/399522445 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.217+0000 7f4c25b05700 1 --2- 172.21.15.52:0/399522445 >> v2:172.21.15.172:3300/0 conn(0x7f4c20154540 0x7f4c200c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26b07700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20069690 0x7f4c20069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 -- 172.21.15.52:0/399522445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20069690 msgr2=0x7f4c20069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20069690 0x7f4c20069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 -- 172.21.15.52:0/399522445 >> v2:172.21.15.172:3300/0 conn(0x7f4c20154540 msgr2=0x7f4c200c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 --2- 172.21.15.52:0/399522445 >> v2:172.21.15.172:3300/0 conn(0x7f4c20154540 0x7f4c200c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 -- 172.21.15.52:0/399522445 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200c0000 con 0x7f4c20154160 2023-05-10T01:24:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c26306700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20154160 0x7f4c200c5c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f4c200844d0 tx=0x7f4c180090f0).ready entity=mon.0 client_cookie=663ce2feb5c7215 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c25304700 1 -- 172.21.15.52:0/399522445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800b600 con 0x7f4c20154160 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c25304700 1 -- 172.21.15.52:0/399522445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800b760 con 0x7f4c20154160 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c25304700 1 -- 172.21.15.52:0/399522445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800bb00 con 0x7f4c20154160 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 -- 172.21.15.52:0/399522445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20154160 msgr2=0x7f4c200c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20154160 0x7f4c200c5c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f4c200844d0 tx=0x7f4c180090f0).stop 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 -- 172.21.15.52:0/399522445 shutdown_connections 2023-05-10T01:24:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20069690 0x7f4c20069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 --2- 172.21.15.52:0/399522445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20154160 0x7f4c200c5c60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 --2- 172.21.15.52:0/399522445 >> v2:172.21.15.172:3300/0 conn(0x7f4c20154540 0x7f4c200c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 -- 172.21.15.52:0/399522445 >> 172.21.15.52:0/399522445 conn(0x7f4c200cb6f0 msgr2=0x7f4c200c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.218+0000 7f4c2856a700 1 -- 172.21.15.52:0/399522445 shutdown_connections 2023-05-10T01:24:59.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.219+0000 7f4c2856a700 1 -- 172.21.15.52:0/399522445 wait complete. 2023-05-10T01:24:59.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 Processor -- start 2023-05-10T01:24:59.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 -- start start 2023-05-10T01:24:59.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 0x7f4c200abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 0x7f4c200ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200ac7a0 con 0x7f4c20069690 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200c4bf0 con 0x7f4c20154160 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c2856a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20164950 con 0x7f4c20154540 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c26306700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c26306700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36052/0 (socket says 172.21.15.52:36052) 2023-05-10T01:24:59.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.220+0000 7f4c26306700 1 -- 172.21.15.52:0/2051927622 learned_addr learned my addr 172.21.15.52:0/2051927622 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c25b05700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 0x7f4c200abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26b07700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 0x7f4c200ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 -- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 msgr2=0x7f4c200ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 0x7f4c200ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 -- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 msgr2=0x7f4c200abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 0x7f4c200abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 -- 172.21.15.52:0/2051927622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18009370 con 0x7f4c20069690 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c25b05700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 0x7f4c200abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26b07700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 0x7f4c200ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c26306700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f4c18006fd0 tx=0x7f4c18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800b8d0 con 0x7f4c20069690 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800ba30 con 0x7f4c20069690 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20164c30 con 0x7f4c20069690 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c180246c0 con 0x7f4c20069690 2023-05-10T01:24:59.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.221+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c201651f0 con 0x7f4c20069690 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.222+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c200666b0 con 0x7f4c20069690 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.222+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4c1800f070 con 0x7f4c20069690 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.223+0000 7f4c1e7fc700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 0x7f4c00061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.223+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f4c1807b830 con 0x7f4c20069690 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.223+0000 7f4c25b05700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 0x7f4c00061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.223+0000 7f4c25b05700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 0x7f4c00061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c2014f110 tx=0x7f4c14008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.227+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c1804cd70 con 0x7f4c20069690 2023-05-10T01:24:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.442+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c2006c340 con 0x7f4c20069690 2023-05-10T01:24:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.443+0000 7f4c1e7fc700 1 -- 172.21.15.52:0/2051927622 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f4c18029070 con 0x7f4c20069690 2023-05-10T01:24:59.447 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:59.447 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:24:59.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.444+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 msgr2=0x7f4c00061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 0x7f4c00061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c2014f110 tx=0x7f4c14008040).stop 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 msgr2=0x7f4c20153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f4c18006fd0 tx=0x7f4c18017000).stop 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 shutdown_connections 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4c0005ed60 0x7f4c00061220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c20154540 0x7f4c200ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20069690 0x7f4c20153410 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 --2- 172.21.15.52:0/2051927622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c20154160 0x7f4c200abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 >> 172.21.15.52:0/2051927622 conn(0x7f4c200cb6f0 msgr2=0x7f4c200ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 shutdown_connections 2023-05-10T01:24:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.445+0000 7f4c2856a700 1 -- 172.21.15.52:0/2051927622 wait complete. 2023-05-10T01:24:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:24:59.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:24:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.574+0000 7fab009da700 1 Processor -- start 2023-05-10T01:24:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.574+0000 7fab009da700 1 -- start start 2023-05-10T01:24:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7fab009da700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7fab009da700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faafc0654e0 0x7faafc0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7fab009da700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc0bda00 con 0x7faafc138830 2023-05-10T01:24:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7fab009da700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc065970 con 0x7faafc0654e0 2023-05-10T01:24:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7fab009da700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc068bd0 con 0x7faafc0be4d0 2023-05-10T01:24:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faaf9d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faafc0654e0 0x7faafc0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faafc0654e0 0x7faafc0a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:34386/0 (socket says 172.21.15.52:34386) 2023-05-10T01:24:59.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faaf9d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:55694/0 (socket says 172.21.15.52:55694) 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 -- 172.21.15.52:0/3801274824 learned_addr learned my addr 172.21.15.52:0/3801274824 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 -- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 msgr2=0x7faafc064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 -- 172.21.15.52:0/3801274824 >> v1:172.21.15.172:6789/0 conn(0x7faafc138830 legacy=0x7faafc066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faafad9d700 1 -- 172.21.15.52:0/3801274824 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc068eb0 con 0x7faafc0654e0 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.575+0000 7faaf9d9b700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:59.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7faafad9d700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc0654e0 0x7faafc0a7610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7faaf4009f20 tx=0x7faaf4009840).ready entity=mon.1 client_cookie=433bd2ae8c1b7d81 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7faaf959a700 1 -- 172.21.15.52:0/3801274824 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400e070 con 0x7faafc0654e0 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7faaf959a700 1 -- 172.21.15.52:0/3801274824 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf400b9d0 con 0x7faafc0654e0 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7faaf959a700 1 -- 172.21.15.52:0/3801274824 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400bd50 con 0x7faafc0654e0 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 -- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc0654e0 msgr2=0x7faafc0a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc0654e0 0x7faafc0a7610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7faaf4009f20 tx=0x7faaf4009840).stop 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 -- 172.21.15.52:0/3801274824 shutdown_connections 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc0654e0 0x7faafc0a7610 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 --2- 172.21.15.52:0/3801274824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0be4d0 0x7faafc064ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 -- 172.21.15.52:0/3801274824 >> 172.21.15.52:0/3801274824 conn(0x7faafc0c4420 msgr2=0x7faafc0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 -- 172.21.15.52:0/3801274824 shutdown_connections 2023-05-10T01:24:59.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.576+0000 7fab009da700 1 -- 172.21.15.52:0/3801274824 wait complete. 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.577+0000 7fab009da700 1 Processor -- start 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.577+0000 7fab009da700 1 -- start start 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0654e0 0x7faafc0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 0x7faafc162890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc154250 con 0x7faafc0be4d0 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc162d80 con 0x7faafc138830 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7fab009da700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc153640 con 0x7faafc0654e0 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7faaf9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7faaf9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36068/0 (socket says 172.21.15.52:36068) 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7faaf9d9b700 1 -- 172.21.15.52:0/108884018 learned_addr learned my addr 172.21.15.52:0/108884018 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7faafad9d700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 0x7faafc162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.578+0000 7faafa59c700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0654e0 0x7faafc0a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 -- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0654e0 msgr2=0x7faafc0a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0654e0 0x7faafc0a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 -- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 msgr2=0x7faafc162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 0x7faafc162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 -- 172.21.15.52:0/108884018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00092a0 con 0x7faafc0be4d0 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faafad9d700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 0x7faafc162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaf9d9b700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7faaf000ea50 tx=0x7faaf0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000c640 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000c7a0 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4009ae0 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000cb20 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.579+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc153c00 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.580+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc0c1a70 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.580+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faaf0022070 con 0x7faafc0be4d0 2023-05-10T01:24:59.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.581+0000 7faaea7fc700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 0x7faad8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.581+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7faaf0079ff0 con 0x7faafc0be4d0 2023-05-10T01:24:59.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.581+0000 7faafa59c700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 0x7faad8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.581+0000 7faafa59c700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 0x7faad8061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7faafc0ab5a0 tx=0x7faaec009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.585+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faaf004b480 con 0x7faafc0be4d0 2023-05-10T01:24:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.760+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faafc063300 con 0x7faafc0be4d0 2023-05-10T01:24:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.761+0000 7faaea7fc700 1 -- 172.21.15.52:0/108884018 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17430 (secure 0 0 0) 0x7faaf004eaa0 con 0x7faafc0be4d0 2023-05-10T01:24:59.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:24:59.765 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":94,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:24:57.029927+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:24:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 msgr2=0x7faad8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 0x7faad8061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7faafc0ab5a0 tx=0x7faaec009040).stop 2023-05-10T01:24:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 msgr2=0x7faafc0c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7faaf000ea50 tx=0x7faaf0009060).stop 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 shutdown_connections 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faad805ed90 0x7faad8061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faafc138830 0x7faafc162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faafc0654e0 0x7faafc0a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 --2- 172.21.15.52:0/108884018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faafc0be4d0 0x7faafc0c1580 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 >> 172.21.15.52:0/108884018 conn(0x7faafc0c4420 msgr2=0x7faafc157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 shutdown_connections 2023-05-10T01:24:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.763+0000 7fab009da700 1 -- 172.21.15.52:0/108884018 wait complete. 2023-05-10T01:24:59.778 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:24:59.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:24:59.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.891+0000 7ff898ff9700 1 Processor -- start 2023-05-10T01:24:59.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.891+0000 7ff898ff9700 1 -- start start 2023-05-10T01:24:59.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff898ff9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff894154540 0x7ff894069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff898ff9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff8940c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff898ff9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940c0650 con 0x7ff894154160 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff898ff9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff894069ff0 con 0x7ff894154540 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff898ff9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940bfd20 con 0x7ff894069b80 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff89259c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff894154160 0x7ff8940c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45088/0 (socket says 172.21.15.52:45088) 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff89259c700 1 -- 172.21.15.52:0/2820138877 learned_addr learned my addr 172.21.15.52:0/2820138877 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:24:59.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.892+0000 7ff891d9b700 1 --2- 172.21.15.52:0/2820138877 >> v2:172.21.15.52:3300/0 conn(0x7ff894154540 0x7ff894069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff892d9d700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff8940c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff89159a700 1 -- 172.21.15.52:0/2820138877 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516647229 0 0) 0x7ff8940c0650 con 0x7ff894154160 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff89159a700 1 -- 172.21.15.52:0/2820138877 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8740033f0 con 0x7ff894154160 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff891d9b700 1 -- 172.21.15.52:0/2820138877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 msgr2=0x7ff8940c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff891d9b700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff8940c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff891d9b700 1 -- 172.21.15.52:0/2820138877 >> v1:172.21.15.52:6789/0 conn(0x7ff894154160 legacy=0x7ff8940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff891d9b700 1 -- 172.21.15.52:0/2820138877 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940c0000 con 0x7ff894154540 2023-05-10T01:24:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff891d9b700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154540 0x7ff894069690 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7ff87c009760 tx=0x7ff87c009060).ready entity=mon.0 client_cookie=eec16121f89e829 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff89159a700 1 -- 172.21.15.52:0/2820138877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0090d0 con 0x7ff894154540 2023-05-10T01:24:59.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff89159a700 1 -- 172.21.15.52:0/2820138877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00f510 con 0x7ff894154540 2023-05-10T01:24:59.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff89159a700 1 -- 172.21.15.52:0/2820138877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00f890 con 0x7ff894154540 2023-05-10T01:24:59.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 -- 172.21.15.52:0/2820138877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154540 msgr2=0x7ff894069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154540 0x7ff894069690 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7ff87c009760 tx=0x7ff87c009060).stop 2023-05-10T01:24:59.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 -- 172.21.15.52:0/2820138877 shutdown_connections 2023-05-10T01:24:59.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff8940c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 --2- 172.21.15.52:0/2820138877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154540 0x7ff894069690 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.893+0000 7ff898ff9700 1 -- 172.21.15.52:0/2820138877 >> 172.21.15.52:0/2820138877 conn(0x7ff8940cb6f0 msgr2=0x7ff8940c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.894+0000 7ff898ff9700 1 -- 172.21.15.52:0/2820138877 shutdown_connections 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.894+0000 7ff898ff9700 1 -- 172.21.15.52:0/2820138877 wait complete. 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 Processor -- start 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 -- start start 2023-05-10T01:24:59.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff894143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894154540 0x7ff8940afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b05b0 con 0x7ff894154160 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940c3210 con 0x7ff894154540 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff898ff9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940c3b20 con 0x7ff894069b80 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff891d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff891d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36080/0 (socket says 172.21.15.52:36080) 2023-05-10T01:24:59.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.895+0000 7ff891d9b700 1 -- 172.21.15.52:0/1626735370 learned_addr learned my addr 172.21.15.52:0/1626735370 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff892d9d700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894154540 0x7ff8940afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff89259c700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff894143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 -- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 msgr2=0x7ff894143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff894143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 -- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894154540 msgr2=0x7ff8940afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894154540 0x7ff8940afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:24:59.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 -- 172.21.15.52:0/1626735370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c0092a0 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff89259c700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff894143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff891d9b700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7ff894083050 tx=0x7ff87c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00f680 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00f7e0 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940c2870 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c01b690 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.896+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940c2e30 con 0x7ff894154160 2023-05-10T01:24:59.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.897+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8940c3350 con 0x7ff894154160 2023-05-10T01:24:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.897+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff87c02a070 con 0x7ff894154160 2023-05-10T01:24:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.898+0000 7ff88a7fc700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 0x7ff878061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:24:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.898+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff87c07b0e0 con 0x7ff894154160 2023-05-10T01:24:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.898+0000 7ff89259c700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 0x7ff878061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:24:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.898+0000 7ff89259c700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 0x7ff878061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff88c005750 tx=0x7ff88c009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:24:59.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:24:59.902+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff8940c3350 con 0x7ff894154160 2023-05-10T01:25:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.069+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8940c3350 con 0x7ff87805ed90 2023-05-10T01:25:00.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.080+0000 7ff88a7fc700 1 -- 172.21.15.52:0/1626735370 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352951 (secure 0 0 0) 0x7ff8940c3350 con 0x7ff87805ed90 2023-05-10T01:25:00.087 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 msgr2=0x7ff878061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 0x7ff878061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff88c005750 tx=0x7ff88c009040).stop 2023-05-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 msgr2=0x7ff8940c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7ff894083050 tx=0x7ff87c017000).stop 2023-05-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 shutdown_connections 2023-05-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff87805ed90 0x7ff878061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894154540 0x7ff8940afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff894069b80 0x7ff894143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 --2- 172.21.15.52:0/1626735370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff894154160 0x7ff8940c3630 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 >> 172.21.15.52:0/1626735370 conn(0x7ff8940cb6f0 msgr2=0x7ff8940ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 shutdown_connections 2023-05-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.084+0000 7ff898ff9700 1 -- 172.21.15.52:0/1626735370 wait complete. 2023-05-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:00.099 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:24:58.093428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":150716,"kb_used_data":8636,"kb_used_omap":0,"kb_used_meta":142016,"kb_avail":754824004,"statfs":{"total":773094113280,"available":772939780096,"internally_reserved":0,"allocated":8843264,"data_stored":4426489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145424384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10438,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.425449"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633045+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634130+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630239+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633217+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634919+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630197+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635263+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.639129+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633674+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635648+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629629+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636028+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635214+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629863+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.631833+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635547+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635943+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635042+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633384+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635215+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632964+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634364+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632062+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633107+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634123+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633874+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633802+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629516+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635805+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.638770+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633813+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632058+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633639+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635599+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629170+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636347+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633929+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629674+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632747+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633758+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635696+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629153+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635641+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633581+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636295+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637705+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636045+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632659+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629186+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.631767+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629201+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.342720+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:53.342720+0000","last_peered":"2023-05-10T01:24:53.342720+0000","last_clean":"2023-05-10T01:24:53.342720+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:53.342720+0000","last_undegraded":"2023-05-10T01:24:53.342720+0000","last_fullsized":"2023-05-10T01:24:53.342720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632257+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343084+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:53.343084+0000","last_peered":"2023-05-10T01:24:53.343084+0000","last_clean":"2023-05-10T01:24:53.343084+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:53.343084+0000","last_undegraded":"2023-05-10T01:24:53.343084+0000","last_fullsized":"2023-05-10T01:24:53.343084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.631894+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.095513+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:53.095513+0000","last_peered":"2023-05-10T01:24:53.095513+0000","last_clean":"2023-05-10T01:24:53.095513+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:53.095513+0000","last_undegraded":"2023-05-10T01:24:53.095513+0000","last_fullsized":"2023-05-10T01:24:53.095513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632000+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343113+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:53.343113+0000","last_peered":"2023-05-10T01:24:53.343113+0000","last_clean":"2023-05-10T01:24:53.343113+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:53.343113+0000","last_undegraded":"2023-05-10T01:24:53.343113+0000","last_fullsized":"2023-05-10T01:24:53.343113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343193+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:53.343193+0000","last_peered":"2023-05-10T01:24:53.343193+0000","last_clean":"2023-05-10T01:24:53.343193+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:53.343193+0000","last_undegraded":"2023-05-10T01:24:53.343193+0000","last_fullsized":"2023-05-10T01:24:53.343193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632485+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343220+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:53.343220+0000","last_peered":"2023-05-10T01:24:53.343220+0000","last_clean":"2023-05-10T01:24:53.343220+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:53.343220+0000","last_undegraded":"2023-05-10T01:24:53.343220+0000","last_fullsized":"2023-05-10T01:24:53.343220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.631795+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343158+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:53.343158+0000","last_peered":"2023-05-10T01:24:53.343158+0000","last_clean":"2023-05-10T01:24:53.343158+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:53.343158+0000","last_undegraded":"2023-05-10T01:24:53.343158+0000","last_fullsized":"2023-05-10T01:24:53.343158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635939+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.342726+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:53.342726+0000","last_peered":"2023-05-10T01:24:53.342726+0000","last_clean":"2023-05-10T01:24:53.342726+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:53.342726+0000","last_undegraded":"2023-05-10T01:24:53.342726+0000","last_fullsized":"2023-05-10T01:24:53.342726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632127+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:52.795226+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:52.795226+0000","last_peered":"2023-05-10T01:24:52.795226+0000","last_clean":"2023-05-10T01:24:52.795226+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:52.795226+0000","last_undegraded":"2023-05-10T01:24:52.795226+0000","last_fullsized":"2023-05-10T01:24:52.795226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17336,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354504,"statfs":{"total":96636764160,"available":96619012096,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.436}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16644,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355196,"statfs":{"total":96636764160,"available":96619720704,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.433},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.502}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20600,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":19520,"kb_avail":94351240,"statfs":{"total":96636764160,"available":96615669760,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19988480},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.373},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575028,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16376,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94355464,"statfs":{"total":96636764160,"available":96619995136,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.245},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.372}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.44900000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.81499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17732,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94354108,"statfs":{"total":96636764160,"available":96618606592,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.307},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24772,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94347068,"statfs":{"total":96636764160,"available":96611397632,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.307},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.35999999999999999}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.502}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16964,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354876,"statfs":{"total":96636764160,"available":96619393024,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20292,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":19200,"kb_avail":94351548,"statfs":{"total":96636764160,"available":96615985152,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19660800},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.495}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:00.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:00.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.252+0000 7f31622db700 1 Processor -- start 2023-05-10T01:25:00.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.252+0000 7f31622db700 1 -- start start 2023-05-10T01:25:00.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f31622db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f315c0c1090 0x7f315c0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f31622db700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c158960 con 0x7f315c154e40 2023-05-10T01:25:00.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f31622db700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c1552f0 con 0x7f315c0c7370 2023-05-10T01:25:00.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f31622db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c157d50 con 0x7f315c0c1090 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f315c0c1090 0x7f315c0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f315c0c1090 0x7f315c0ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36090/0 (socket says 172.21.15.52:36090) 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3160ad8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f315c154e40 0x7f315c0acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45104/0 (socket says 172.21.15.52:45104) 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 -- 172.21.15.52:0/3426800620 learned_addr learned my addr 172.21.15.52:0/3426800620 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 -- 172.21.15.52:0/3426800620 >> v1:172.21.15.172:6789/0 conn(0x7f315c0c7370 legacy=0x7f315c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 -- 172.21.15.52:0/3426800620 >> v1:172.21.15.52:6789/0 conn(0x7f315c154e40 legacy=0x7f315c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f315bfff700 1 -- 172.21.15.52:0/3426800620 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501031396 0 0) 0x7f315c158960 con 0x7f315c154e40 2023-05-10T01:25:00.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 -- 172.21.15.52:0/3426800620 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c158030 con 0x7f315c0c1090 2023-05-10T01:25:00.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.253+0000 7f3161ada700 1 --2- 172.21.15.52:0/3426800620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c0c1090 0x7f315c0ad250 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f315c158910 tx=0x7f314c0090f0).ready entity=mon.0 client_cookie=1cbac1235ed15de2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f315bfff700 1 -- 172.21.15.52:0/3426800620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00b600 con 0x7f315c0c1090 2023-05-10T01:25:00.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f315bfff700 1 -- 172.21.15.52:0/3426800620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00b760 con 0x7f315c0c1090 2023-05-10T01:25:00.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f315bfff700 1 -- 172.21.15.52:0/3426800620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00bae0 con 0x7f315c0c1090 2023-05-10T01:25:00.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 -- 172.21.15.52:0/3426800620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c0c1090 msgr2=0x7f315c0ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 --2- 172.21.15.52:0/3426800620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c0c1090 0x7f315c0ad250 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f315c158910 tx=0x7f314c0090f0).stop 2023-05-10T01:25:00.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 -- 172.21.15.52:0/3426800620 shutdown_connections 2023-05-10T01:25:00.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 --2- 172.21.15.52:0/3426800620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c0c1090 0x7f315c0ad250 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 -- 172.21.15.52:0/3426800620 >> 172.21.15.52:0/3426800620 conn(0x7f315c068320 msgr2=0x7f315c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 -- 172.21.15.52:0/3426800620 shutdown_connections 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.254+0000 7f31622db700 1 -- 172.21.15.52:0/3426800620 wait complete. 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.255+0000 7f31622db700 1 Processor -- start 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.255+0000 7f31622db700 1 -- start start 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f315c0c1090 0x7f315c0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f315c0c7370 0x7f315c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c9ac0 con 0x7f315c154e40 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c8eb0 con 0x7f315c0c1090 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31622db700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c9190 con 0x7f315c0c7370 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f3161ada700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f3161ada700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36096/0 (socket says 172.21.15.52:36096) 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f3161ada700 1 -- 172.21.15.52:0/2805523451 learned_addr learned my addr 172.21.15.52:0/2805523451 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:00.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f3160ad8700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f315c0c7370 0x7f315c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.256+0000 7f31612d9700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f315c0c1090 0x7f315c0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 -- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f315c0c7370 msgr2=0x7f315c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f315c0c7370 0x7f315c14fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 -- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f315c0c1090 msgr2=0x7f315c0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f315c0c1090 0x7f315c0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 -- 172.21.15.52:0/2805523451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009370 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f3161ada700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f315c154400 tx=0x7f314c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00bae0 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00bea0 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c01b640 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0c9470 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.257+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c150040 con 0x7f315c154e40 2023-05-10T01:25:00.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.258+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0c9c30 con 0x7f315c154e40 2023-05-10T01:25:00.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.258+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f314c02b070 con 0x7f315c154e40 2023-05-10T01:25:00.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.259+0000 7f31597fa700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 0x7f313c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.259+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f314c07b710 con 0x7f315c154e40 2023-05-10T01:25:00.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.259+0000 7f31612d9700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 0x7f313c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.259+0000 7f31612d9700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 0x7f313c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3154003900 tx=0x7f3154007d40).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.263+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f314c04cba0 con 0x7f315c154e40 2023-05-10T01:25:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.430+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f315c0bfb80 con 0x7f313c05ed90 2023-05-10T01:25:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.440+0000 7f31597fa700 1 -- 172.21.15.52:0/2805523451 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355961 (secure 0 0 0) 0x7f315c0bfb80 con 0x7f313c05ed90 2023-05-10T01:25:00.447 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:00.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.443+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 msgr2=0x7f313c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.443+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 0x7f313c061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3154003900 tx=0x7f3154007d40).stop 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.443+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 msgr2=0x7f315c0cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.443+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f315c154400 tx=0x7f314c017000).stop 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 shutdown_connections 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f313c05ed90 0x7f313c061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f315c154e40 0x7f315c0cafd0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f315c0c1090 0x7f315c0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 --2- 172.21.15.52:0/2805523451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f315c0c7370 0x7f315c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 >> 172.21.15.52:0/2805523451 conn(0x7f315c068320 msgr2=0x7f315c1538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 shutdown_connections 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.444+0000 7f31622db700 1 -- 172.21.15.52:0/2805523451 wait complete. 2023-05-10T01:25:00.451 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:00.459 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:00.093948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151376,"kb_used_data":8784,"kb_used_omap":0,"kb_used_meta":142528,"kb_avail":754823344,"statfs":{"total":773094113280,"available":772939104256,"internally_reserved":0,"allocated":8994816,"data_stored":4504595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145948672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10438,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.425449"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050574+0000","last_change":"2023-05-10T01:24:56.048111+0000","last_active":"2023-05-10T01:24:56.050574+0000","last_peered":"2023-05-10T01:24:56.050574+0000","last_clean":"2023-05-10T01:24:56.050574+0000","last_became_active":"2023-05-10T01:24:56.047583+0000","last_became_peered":"2023-05-10T01:24:56.047583+0000","last_unstale":"2023-05-10T01:24:56.050574+0000","last_undegraded":"2023-05-10T01:24:56.050574+0000","last_fullsized":"2023-05-10T01:24:56.050574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037524+0000","last_change":"2023-05-10T01:24:55.647532+0000","last_active":"2023-05-10T01:24:56.037524+0000","last_peered":"2023-05-10T01:24:56.037524+0000","last_clean":"2023-05-10T01:24:56.037524+0000","last_became_active":"2023-05-10T01:24:55.647238+0000","last_became_peered":"2023-05-10T01:24:55.647238+0000","last_unstale":"2023-05-10T01:24:56.037524+0000","last_undegraded":"2023-05-10T01:24:56.037524+0000","last_fullsized":"2023-05-10T01:24:56.037524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065020+0000","last_change":"2023-05-10T01:24:55.654314+0000","last_active":"2023-05-10T01:24:56.065020+0000","last_peered":"2023-05-10T01:24:56.065020+0000","last_clean":"2023-05-10T01:24:56.065020+0000","last_became_active":"2023-05-10T01:24:55.654046+0000","last_became_peered":"2023-05-10T01:24:55.654046+0000","last_unstale":"2023-05-10T01:24:56.065020+0000","last_undegraded":"2023-05-10T01:24:56.065020+0000","last_fullsized":"2023-05-10T01:24:56.065020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630239+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065494+0000","last_change":"2023-05-10T01:24:56.059027+0000","last_active":"2023-05-10T01:24:56.065494+0000","last_peered":"2023-05-10T01:24:56.065494+0000","last_clean":"2023-05-10T01:24:56.065494+0000","last_became_active":"2023-05-10T01:24:56.058584+0000","last_became_peered":"2023-05-10T01:24:56.058584+0000","last_unstale":"2023-05-10T01:24:56.065494+0000","last_undegraded":"2023-05-10T01:24:56.065494+0000","last_fullsized":"2023-05-10T01:24:56.065494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633217+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050134+0000","last_change":"2023-05-10T01:24:56.045422+0000","last_active":"2023-05-10T01:24:56.050134+0000","last_peered":"2023-05-10T01:24:56.050134+0000","last_clean":"2023-05-10T01:24:56.050134+0000","last_became_active":"2023-05-10T01:24:56.045185+0000","last_became_peered":"2023-05-10T01:24:56.045185+0000","last_unstale":"2023-05-10T01:24:56.050134+0000","last_undegraded":"2023-05-10T01:24:56.050134+0000","last_fullsized":"2023-05-10T01:24:56.050134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634919+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630197+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064611+0000","last_change":"2023-05-10T01:24:56.062117+0000","last_active":"2023-05-10T01:24:56.064611+0000","last_peered":"2023-05-10T01:24:56.064611+0000","last_clean":"2023-05-10T01:24:56.064611+0000","last_became_active":"2023-05-10T01:24:56.061816+0000","last_became_peered":"2023-05-10T01:24:56.061816+0000","last_unstale":"2023-05-10T01:24:56.064611+0000","last_undegraded":"2023-05-10T01:24:56.064611+0000","last_fullsized":"2023-05-10T01:24:56.064611+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635263+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050589+0000","last_change":"2023-05-10T01:24:56.048238+0000","last_active":"2023-05-10T01:24:56.050589+0000","last_peered":"2023-05-10T01:24:56.050589+0000","last_clean":"2023-05-10T01:24:56.050589+0000","last_became_active":"2023-05-10T01:24:56.047840+0000","last_became_peered":"2023-05-10T01:24:56.047840+0000","last_unstale":"2023-05-10T01:24:56.050589+0000","last_undegraded":"2023-05-10T01:24:56.050589+0000","last_fullsized":"2023-05-10T01:24:56.050589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.639129+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.068060+0000","last_change":"2023-05-10T01:24:55.659712+0000","last_active":"2023-05-10T01:24:56.068060+0000","last_peered":"2023-05-10T01:24:56.068060+0000","last_clean":"2023-05-10T01:24:56.068060+0000","last_became_active":"2023-05-10T01:24:55.659428+0000","last_became_peered":"2023-05-10T01:24:55.659428+0000","last_unstale":"2023-05-10T01:24:56.068060+0000","last_undegraded":"2023-05-10T01:24:56.068060+0000","last_fullsized":"2023-05-10T01:24:56.068060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046970+0000","last_change":"2023-05-10T01:24:55.663646+0000","last_active":"2023-05-10T01:24:56.046970+0000","last_peered":"2023-05-10T01:24:56.046970+0000","last_clean":"2023-05-10T01:24:56.046970+0000","last_became_active":"2023-05-10T01:24:55.663255+0000","last_became_peered":"2023-05-10T01:24:55.663255+0000","last_unstale":"2023-05-10T01:24:56.046970+0000","last_undegraded":"2023-05-10T01:24:56.046970+0000","last_fullsized":"2023-05-10T01:24:56.046970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050293+0000","last_change":"2023-05-10T01:24:56.046677+0000","last_active":"2023-05-10T01:24:56.050293+0000","last_peered":"2023-05-10T01:24:56.050293+0000","last_clean":"2023-05-10T01:24:56.050293+0000","last_became_active":"2023-05-10T01:24:56.046391+0000","last_became_peered":"2023-05-10T01:24:56.046391+0000","last_unstale":"2023-05-10T01:24:56.050293+0000","last_undegraded":"2023-05-10T01:24:56.050293+0000","last_fullsized":"2023-05-10T01:24:56.050293+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629629+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034505+0000","last_change":"2023-05-10T01:24:55.657750+0000","last_active":"2023-05-10T01:24:56.034505+0000","last_peered":"2023-05-10T01:24:56.034505+0000","last_clean":"2023-05-10T01:24:56.034505+0000","last_became_active":"2023-05-10T01:24:55.657454+0000","last_became_peered":"2023-05-10T01:24:55.657454+0000","last_unstale":"2023-05-10T01:24:56.034505+0000","last_undegraded":"2023-05-10T01:24:56.034505+0000","last_fullsized":"2023-05-10T01:24:56.034505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635214+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050280+0000","last_change":"2023-05-10T01:24:56.047827+0000","last_active":"2023-05-10T01:24:56.050280+0000","last_peered":"2023-05-10T01:24:56.050280+0000","last_clean":"2023-05-10T01:24:56.050280+0000","last_became_active":"2023-05-10T01:24:56.047615+0000","last_became_peered":"2023-05-10T01:24:56.047615+0000","last_unstale":"2023-05-10T01:24:56.050280+0000","last_undegraded":"2023-05-10T01:24:56.050280+0000","last_fullsized":"2023-05-10T01:24:56.050280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629863+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.044991+0000","last_change":"2023-05-10T01:24:55.654917+0000","last_active":"2023-05-10T01:24:56.044991+0000","last_peered":"2023-05-10T01:24:56.044991+0000","last_clean":"2023-05-10T01:24:56.044991+0000","last_became_active":"2023-05-10T01:24:55.654637+0000","last_became_peered":"2023-05-10T01:24:55.654637+0000","last_unstale":"2023-05-10T01:24:56.044991+0000","last_undegraded":"2023-05-10T01:24:56.044991+0000","last_fullsized":"2023-05-10T01:24:56.044991+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635547+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033317+0000","last_change":"2023-05-10T01:24:55.651999+0000","last_active":"2023-05-10T01:24:56.033317+0000","last_peered":"2023-05-10T01:24:56.033317+0000","last_clean":"2023-05-10T01:24:56.033317+0000","last_became_active":"2023-05-10T01:24:55.651696+0000","last_became_peered":"2023-05-10T01:24:55.651696+0000","last_unstale":"2023-05-10T01:24:56.033317+0000","last_undegraded":"2023-05-10T01:24:56.033317+0000","last_fullsized":"2023-05-10T01:24:56.033317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635042+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064476+0000","last_change":"2023-05-10T01:24:56.058603+0000","last_active":"2023-05-10T01:24:56.064476+0000","last_peered":"2023-05-10T01:24:56.064476+0000","last_clean":"2023-05-10T01:24:56.064476+0000","last_became_active":"2023-05-10T01:24:56.057445+0000","last_became_peered":"2023-05-10T01:24:56.057445+0000","last_unstale":"2023-05-10T01:24:56.064476+0000","last_undegraded":"2023-05-10T01:24:56.064476+0000","last_fullsized":"2023-05-10T01:24:56.064476+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633384+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065682+0000","last_change":"2023-05-10T01:24:56.063709+0000","last_active":"2023-05-10T01:24:56.065682+0000","last_peered":"2023-05-10T01:24:56.065682+0000","last_clean":"2023-05-10T01:24:56.065682+0000","last_became_active":"2023-05-10T01:24:56.063193+0000","last_became_peered":"2023-05-10T01:24:56.063193+0000","last_unstale":"2023-05-10T01:24:56.065682+0000","last_undegraded":"2023-05-10T01:24:56.065682+0000","last_fullsized":"2023-05-10T01:24:56.065682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635215+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632964+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061050+0000","last_change":"2023-05-10T01:24:56.058000+0000","last_active":"2023-05-10T01:24:56.061050+0000","last_peered":"2023-05-10T01:24:56.061050+0000","last_clean":"2023-05-10T01:24:56.061050+0000","last_became_active":"2023-05-10T01:24:56.057743+0000","last_became_peered":"2023-05-10T01:24:56.057743+0000","last_unstale":"2023-05-10T01:24:56.061050+0000","last_undegraded":"2023-05-10T01:24:56.061050+0000","last_fullsized":"2023-05-10T01:24:56.061050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634364+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037613+0000","last_change":"2023-05-10T01:24:55.646476+0000","last_active":"2023-05-10T01:24:56.037613+0000","last_peered":"2023-05-10T01:24:56.037613+0000","last_clean":"2023-05-10T01:24:56.037613+0000","last_became_active":"2023-05-10T01:24:55.645582+0000","last_became_peered":"2023-05-10T01:24:55.645582+0000","last_unstale":"2023-05-10T01:24:56.037613+0000","last_undegraded":"2023-05-10T01:24:56.037613+0000","last_fullsized":"2023-05-10T01:24:56.037613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047731+0000","last_change":"2023-05-10T01:24:56.043316+0000","last_active":"2023-05-10T01:24:56.047731+0000","last_peered":"2023-05-10T01:24:56.047731+0000","last_clean":"2023-05-10T01:24:56.047731+0000","last_became_active":"2023-05-10T01:24:56.043070+0000","last_became_peered":"2023-05-10T01:24:56.043070+0000","last_unstale":"2023-05-10T01:24:56.047731+0000","last_undegraded":"2023-05-10T01:24:56.047731+0000","last_fullsized":"2023-05-10T01:24:56.047731+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039184+0000","last_change":"2023-05-10T01:24:55.649801+0000","last_active":"2023-05-10T01:24:56.039184+0000","last_peered":"2023-05-10T01:24:56.039184+0000","last_clean":"2023-05-10T01:24:56.039184+0000","last_became_active":"2023-05-10T01:24:55.649477+0000","last_became_peered":"2023-05-10T01:24:55.649477+0000","last_unstale":"2023-05-10T01:24:56.039184+0000","last_undegraded":"2023-05-10T01:24:56.039184+0000","last_fullsized":"2023-05-10T01:24:56.039184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634123+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633874+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.059720+0000","last_change":"2023-05-10T01:24:56.057801+0000","last_active":"2023-05-10T01:24:56.059720+0000","last_peered":"2023-05-10T01:24:56.059720+0000","last_clean":"2023-05-10T01:24:56.059720+0000","last_became_active":"2023-05-10T01:24:56.057522+0000","last_became_peered":"2023-05-10T01:24:56.057522+0000","last_unstale":"2023-05-10T01:24:56.059720+0000","last_undegraded":"2023-05-10T01:24:56.059720+0000","last_fullsized":"2023-05-10T01:24:56.059720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633802+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062976+0000","last_change":"2023-05-10T01:24:56.058137+0000","last_active":"2023-05-10T01:24:56.062976+0000","last_peered":"2023-05-10T01:24:56.062976+0000","last_clean":"2023-05-10T01:24:56.062976+0000","last_became_active":"2023-05-10T01:24:56.057875+0000","last_became_peered":"2023-05-10T01:24:56.057875+0000","last_unstale":"2023-05-10T01:24:56.062976+0000","last_undegraded":"2023-05-10T01:24:56.062976+0000","last_fullsized":"2023-05-10T01:24:56.062976+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629516+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055527+0000","last_change":"2023-05-10T01:24:56.053505+0000","last_active":"2023-05-10T01:24:56.055527+0000","last_peered":"2023-05-10T01:24:56.055527+0000","last_clean":"2023-05-10T01:24:56.055527+0000","last_became_active":"2023-05-10T01:24:56.053233+0000","last_became_peered":"2023-05-10T01:24:56.053233+0000","last_unstale":"2023-05-10T01:24:56.055527+0000","last_undegraded":"2023-05-10T01:24:56.055527+0000","last_fullsized":"2023-05-10T01:24:56.055527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635805+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.638770+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633813+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050141+0000","last_change":"2023-05-10T01:24:56.047177+0000","last_active":"2023-05-10T01:24:56.050141+0000","last_peered":"2023-05-10T01:24:56.050141+0000","last_clean":"2023-05-10T01:24:56.050141+0000","last_became_active":"2023-05-10T01:24:56.046949+0000","last_became_peered":"2023-05-10T01:24:56.046949+0000","last_unstale":"2023-05-10T01:24:56.050141+0000","last_undegraded":"2023-05-10T01:24:56.050141+0000","last_fullsized":"2023-05-10T01:24:56.050141+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632058+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050278+0000","last_change":"2023-05-10T01:24:56.046565+0000","last_active":"2023-05-10T01:24:56.050278+0000","last_peered":"2023-05-10T01:24:56.050278+0000","last_clean":"2023-05-10T01:24:56.050278+0000","last_became_active":"2023-05-10T01:24:56.046141+0000","last_became_peered":"2023-05-10T01:24:56.046141+0000","last_unstale":"2023-05-10T01:24:56.050278+0000","last_undegraded":"2023-05-10T01:24:56.050278+0000","last_fullsized":"2023-05-10T01:24:56.050278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633639+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032918+0000","last_change":"2023-05-10T01:24:55.648375+0000","last_active":"2023-05-10T01:24:56.032918+0000","last_peered":"2023-05-10T01:24:56.032918+0000","last_clean":"2023-05-10T01:24:56.032918+0000","last_became_active":"2023-05-10T01:24:55.648061+0000","last_became_peered":"2023-05-10T01:24:55.648061+0000","last_unstale":"2023-05-10T01:24:56.032918+0000","last_undegraded":"2023-05-10T01:24:56.032918+0000","last_fullsized":"2023-05-10T01:24:56.032918+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629170+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050747+0000","last_change":"2023-05-10T01:24:56.049666+0000","last_active":"2023-05-10T01:24:56.050747+0000","last_peered":"2023-05-10T01:24:56.050747+0000","last_clean":"2023-05-10T01:24:56.050747+0000","last_became_active":"2023-05-10T01:24:56.049373+0000","last_became_peered":"2023-05-10T01:24:56.049373+0000","last_unstale":"2023-05-10T01:24:56.050747+0000","last_undegraded":"2023-05-10T01:24:56.050747+0000","last_fullsized":"2023-05-10T01:24:56.050747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636347+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633929+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065427+0000","last_change":"2023-05-10T01:24:56.063242+0000","last_active":"2023-05-10T01:24:56.065427+0000","last_peered":"2023-05-10T01:24:56.065427+0000","last_clean":"2023-05-10T01:24:56.065427+0000","last_became_active":"2023-05-10T01:24:56.062420+0000","last_became_peered":"2023-05-10T01:24:56.062420+0000","last_unstale":"2023-05-10T01:24:56.065427+0000","last_undegraded":"2023-05-10T01:24:56.065427+0000","last_fullsized":"2023-05-10T01:24:56.065427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629674+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065465+0000","last_change":"2023-05-10T01:24:56.060743+0000","last_active":"2023-05-10T01:24:56.065465+0000","last_peered":"2023-05-10T01:24:56.065465+0000","last_clean":"2023-05-10T01:24:56.065465+0000","last_became_active":"2023-05-10T01:24:56.060405+0000","last_became_peered":"2023-05-10T01:24:56.060405+0000","last_unstale":"2023-05-10T01:24:56.065465+0000","last_undegraded":"2023-05-10T01:24:56.065465+0000","last_fullsized":"2023-05-10T01:24:56.065465+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632747+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633758+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635696+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629153+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.054595+0000","last_change":"2023-05-10T01:24:55.651683+0000","last_active":"2023-05-10T01:24:56.054595+0000","last_peered":"2023-05-10T01:24:56.054595+0000","last_clean":"2023-05-10T01:24:56.054595+0000","last_became_active":"2023-05-10T01:24:55.651369+0000","last_became_peered":"2023-05-10T01:24:55.651369+0000","last_unstale":"2023-05-10T01:24:56.054595+0000","last_undegraded":"2023-05-10T01:24:56.054595+0000","last_fullsized":"2023-05-10T01:24:56.054595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633581+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032868+0000","last_change":"2023-05-10T01:24:55.657774+0000","last_active":"2023-05-10T01:24:56.032868+0000","last_peered":"2023-05-10T01:24:56.032868+0000","last_clean":"2023-05-10T01:24:56.032868+0000","last_became_active":"2023-05-10T01:24:55.657505+0000","last_became_peered":"2023-05-10T01:24:55.657505+0000","last_unstale":"2023-05-10T01:24:56.032868+0000","last_undegraded":"2023-05-10T01:24:56.032868+0000","last_fullsized":"2023-05-10T01:24:56.032868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637705+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050720+0000","last_change":"2023-05-10T01:24:56.048800+0000","last_active":"2023-05-10T01:24:56.050720+0000","last_peered":"2023-05-10T01:24:56.050720+0000","last_clean":"2023-05-10T01:24:56.050720+0000","last_became_active":"2023-05-10T01:24:56.048552+0000","last_became_peered":"2023-05-10T01:24:56.048552+0000","last_unstale":"2023-05-10T01:24:56.050720+0000","last_undegraded":"2023-05-10T01:24:56.050720+0000","last_fullsized":"2023-05-10T01:24:56.050720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636045+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632659+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629186+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063523+0000","last_change":"2023-05-10T01:24:56.058327+0000","last_active":"2023-05-10T01:24:56.063523+0000","last_peered":"2023-05-10T01:24:56.063523+0000","last_clean":"2023-05-10T01:24:56.063523+0000","last_became_active":"2023-05-10T01:24:56.057358+0000","last_became_peered":"2023-05-10T01:24:56.057358+0000","last_unstale":"2023-05-10T01:24:56.063523+0000","last_undegraded":"2023-05-10T01:24:56.063523+0000","last_fullsized":"2023-05-10T01:24:56.063523+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060280+0000","last_change":"2023-05-10T01:24:56.048343+0000","last_active":"2023-05-10T01:24:56.060280+0000","last_peered":"2023-05-10T01:24:56.060280+0000","last_clean":"2023-05-10T01:24:56.060280+0000","last_became_active":"2023-05-10T01:24:56.048071+0000","last_became_peered":"2023-05-10T01:24:56.048071+0000","last_unstale":"2023-05-10T01:24:56.060280+0000","last_undegraded":"2023-05-10T01:24:56.060280+0000","last_fullsized":"2023-05-10T01:24:56.060280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037538+0000","last_change":"2023-05-10T01:24:55.649514+0000","last_active":"2023-05-10T01:24:56.037538+0000","last_peered":"2023-05-10T01:24:56.037538+0000","last_clean":"2023-05-10T01:24:56.037538+0000","last_became_active":"2023-05-10T01:24:55.649230+0000","last_became_peered":"2023-05-10T01:24:55.649230+0000","last_unstale":"2023-05-10T01:24:56.037538+0000","last_undegraded":"2023-05-10T01:24:56.037538+0000","last_fullsized":"2023-05-10T01:24:56.037538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629201+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043824+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:56.043824+0000","last_peered":"2023-05-10T01:24:56.043824+0000","last_clean":"2023-05-10T01:24:56.043824+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:56.043824+0000","last_undegraded":"2023-05-10T01:24:56.043824+0000","last_fullsized":"2023-05-10T01:24:56.043824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064619+0000","last_change":"2023-05-10T01:24:56.060432+0000","last_active":"2023-05-10T01:24:56.064619+0000","last_peered":"2023-05-10T01:24:56.064619+0000","last_clean":"2023-05-10T01:24:56.064619+0000","last_became_active":"2023-05-10T01:24:56.060141+0000","last_became_peered":"2023-05-10T01:24:56.060141+0000","last_unstale":"2023-05-10T01:24:56.064619+0000","last_undegraded":"2023-05-10T01:24:56.064619+0000","last_fullsized":"2023-05-10T01:24:56.064619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062086+0000","last_change":"2023-05-10T01:24:55.646775+0000","last_active":"2023-05-10T01:24:56.062086+0000","last_peered":"2023-05-10T01:24:56.062086+0000","last_clean":"2023-05-10T01:24:56.062086+0000","last_became_active":"2023-05-10T01:24:55.646471+0000","last_became_peered":"2023-05-10T01:24:55.646471+0000","last_unstale":"2023-05-10T01:24:56.062086+0000","last_undegraded":"2023-05-10T01:24:56.062086+0000","last_fullsized":"2023-05-10T01:24:56.062086+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343084+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:53.343084+0000","last_peered":"2023-05-10T01:24:53.343084+0000","last_clean":"2023-05-10T01:24:53.343084+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:53.343084+0000","last_undegraded":"2023-05-10T01:24:53.343084+0000","last_fullsized":"2023-05-10T01:24:53.343084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042275+0000","last_change":"2023-05-10T01:24:55.652850+0000","last_active":"2023-05-10T01:24:56.042275+0000","last_peered":"2023-05-10T01:24:56.042275+0000","last_clean":"2023-05-10T01:24:56.042275+0000","last_became_active":"2023-05-10T01:24:55.652528+0000","last_became_peered":"2023-05-10T01:24:55.652528+0000","last_unstale":"2023-05-10T01:24:56.042275+0000","last_undegraded":"2023-05-10T01:24:56.042275+0000","last_fullsized":"2023-05-10T01:24:56.042275+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.095513+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:53.095513+0000","last_peered":"2023-05-10T01:24:53.095513+0000","last_clean":"2023-05-10T01:24:53.095513+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:53.095513+0000","last_undegraded":"2023-05-10T01:24:53.095513+0000","last_fullsized":"2023-05-10T01:24:53.095513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.041216+0000","last_change":"2023-05-10T01:24:55.652884+0000","last_active":"2023-05-10T01:24:56.041216+0000","last_peered":"2023-05-10T01:24:56.041216+0000","last_clean":"2023-05-10T01:24:56.041216+0000","last_became_active":"2023-05-10T01:24:55.652548+0000","last_became_peered":"2023-05-10T01:24:55.652548+0000","last_unstale":"2023-05-10T01:24:56.041216+0000","last_undegraded":"2023-05-10T01:24:56.041216+0000","last_fullsized":"2023-05-10T01:24:56.041216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343113+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:53.343113+0000","last_peered":"2023-05-10T01:24:53.343113+0000","last_clean":"2023-05-10T01:24:53.343113+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:53.343113+0000","last_undegraded":"2023-05-10T01:24:53.343113+0000","last_fullsized":"2023-05-10T01:24:53.343113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343193+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:53.343193+0000","last_peered":"2023-05-10T01:24:53.343193+0000","last_clean":"2023-05-10T01:24:53.343193+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:53.343193+0000","last_undegraded":"2023-05-10T01:24:53.343193+0000","last_fullsized":"2023-05-10T01:24:53.343193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045366+0000","last_change":"2023-05-10T01:24:56.043832+0000","last_active":"2023-05-10T01:24:56.045366+0000","last_peered":"2023-05-10T01:24:56.045366+0000","last_clean":"2023-05-10T01:24:56.045366+0000","last_became_active":"2023-05-10T01:24:56.043569+0000","last_became_peered":"2023-05-10T01:24:56.043569+0000","last_unstale":"2023-05-10T01:24:56.045366+0000","last_undegraded":"2023-05-10T01:24:56.045366+0000","last_fullsized":"2023-05-10T01:24:56.045366+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.036644+0000","last_change":"2023-05-10T01:24:55.653598+0000","last_active":"2023-05-10T01:24:56.036644+0000","last_peered":"2023-05-10T01:24:56.036644+0000","last_clean":"2023-05-10T01:24:56.036644+0000","last_became_active":"2023-05-10T01:24:55.653218+0000","last_became_peered":"2023-05-10T01:24:55.653218+0000","last_unstale":"2023-05-10T01:24:56.036644+0000","last_undegraded":"2023-05-10T01:24:56.036644+0000","last_fullsized":"2023-05-10T01:24:56.036644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343220+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:53.343220+0000","last_peered":"2023-05-10T01:24:53.343220+0000","last_clean":"2023-05-10T01:24:53.343220+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:53.343220+0000","last_undegraded":"2023-05-10T01:24:53.343220+0000","last_fullsized":"2023-05-10T01:24:53.343220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064382+0000","last_change":"2023-05-10T01:24:56.057487+0000","last_active":"2023-05-10T01:24:56.064382+0000","last_peered":"2023-05-10T01:24:56.064382+0000","last_clean":"2023-05-10T01:24:56.064382+0000","last_became_active":"2023-05-10T01:24:56.057170+0000","last_became_peered":"2023-05-10T01:24:56.057170+0000","last_unstale":"2023-05-10T01:24:56.064382+0000","last_undegraded":"2023-05-10T01:24:56.064382+0000","last_fullsized":"2023-05-10T01:24:56.064382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043736+0000","last_change":"2023-05-10T01:24:55.659797+0000","last_active":"2023-05-10T01:24:56.043736+0000","last_peered":"2023-05-10T01:24:56.043736+0000","last_clean":"2023-05-10T01:24:56.043736+0000","last_became_active":"2023-05-10T01:24:55.659374+0000","last_became_peered":"2023-05-10T01:24:55.659374+0000","last_unstale":"2023-05-10T01:24:56.043736+0000","last_undegraded":"2023-05-10T01:24:56.043736+0000","last_fullsized":"2023-05-10T01:24:56.043736+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343158+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:53.343158+0000","last_peered":"2023-05-10T01:24:53.343158+0000","last_clean":"2023-05-10T01:24:53.343158+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:53.343158+0000","last_undegraded":"2023-05-10T01:24:53.343158+0000","last_fullsized":"2023-05-10T01:24:53.343158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064683+0000","last_change":"2023-05-10T01:24:56.058212+0000","last_active":"2023-05-10T01:24:56.064683+0000","last_peered":"2023-05-10T01:24:56.064683+0000","last_clean":"2023-05-10T01:24:56.064683+0000","last_became_active":"2023-05-10T01:24:56.057943+0000","last_became_peered":"2023-05-10T01:24:56.057943+0000","last_unstale":"2023-05-10T01:24:56.064683+0000","last_undegraded":"2023-05-10T01:24:56.064683+0000","last_fullsized":"2023-05-10T01:24:56.064683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635939+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045083+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:56.045083+0000","last_peered":"2023-05-10T01:24:56.045083+0000","last_clean":"2023-05-10T01:24:56.045083+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:56.045083+0000","last_undegraded":"2023-05-10T01:24:56.045083+0000","last_fullsized":"2023-05-10T01:24:56.045083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632127+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:52.795226+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:52.795226+0000","last_peered":"2023-05-10T01:24:52.795226+0000","last_clean":"2023-05-10T01:24:52.795226+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:52.795226+0000","last_undegraded":"2023-05-10T01:24:52.795226+0000","last_fullsized":"2023-05-10T01:24:52.795226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17336,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354504,"statfs":{"total":96636764160,"available":96619012096,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.436}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16644,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355196,"statfs":{"total":96636764160,"available":96619720704,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.433},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.502}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20856,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":19712,"kb_avail":94350984,"statfs":{"total":96636764160,"available":96615407616,"internally_reserved":0,"allocated":1163264,"data_stored":578171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20185088},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.255}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16616,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355224,"statfs":{"total":96636764160,"available":96619749376,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.313}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.37}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.61199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17732,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94354108,"statfs":{"total":96636764160,"available":96618606592,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.307},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24936,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94346904,"statfs":{"total":96636764160,"available":96611229696,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.34200000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16964,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354876,"statfs":{"total":96636764160,"available":96619393024,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20292,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":19200,"kb_avail":94351548,"statfs":{"total":96636764160,"available":96615985152,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19660800},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.495}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:00.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:00.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.612+0000 7fdf8aafb700 1 Processor -- start 2023-05-10T01:25:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.612+0000 7fdf8aafb700 1 -- start start 2023-05-10T01:25:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf8aafb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 0x7fdf84069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf8aafb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf840c0650 con 0x7fdf84069b80 2023-05-10T01:25:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf8aafb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8406a010 con 0x7fdf84154160 2023-05-10T01:25:00.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf8aafb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840bfd20 con 0x7fdf84154540 2023-05-10T01:25:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf89098700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdf84069b80 0x7fdf840c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45120/0 (socket says 172.21.15.52:45120) 2023-05-10T01:25:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf89098700 1 -- 172.21.15.52:0/2467441912 learned_addr learned my addr 172.21.15.52:0/2467441912 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.613+0000 7fdf83fff700 1 --2- 172.21.15.52:0/2467441912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 0x7fdf84069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518466545 0 0) 0x7fdf840c0650 con 0x7fdf84069b80 2023-05-10T01:25:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf700033f0 con 0x7fdf84069b80 2023-05-10T01:25:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930565588 0 0) 0x7fdf8406a010 con 0x7fdf84154160 2023-05-10T01:25:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf840c0650 con 0x7fdf84154160 2023-05-10T01:25:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf83fff700 1 -- 172.21.15.52:0/2467441912 >> v1:172.21.15.172:6789/0 conn(0x7fdf84154160 legacy=0x7fdf840c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf83fff700 1 -- 172.21.15.52:0/2467441912 >> v1:172.21.15.52:6789/0 conn(0x7fdf84069b80 legacy=0x7fdf840c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf83fff700 1 -- 172.21.15.52:0/2467441912 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840c0000 con 0x7fdf84154540 2023-05-10T01:25:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf83fff700 1 --2- 172.21.15.52:0/2467441912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 0x7fdf84069690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdf78009790 tx=0x7fdf78009060).ready entity=mon.2 client_cookie=2351540c538516fe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800f510 con 0x7fdf84154540 2023-05-10T01:25:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800f670 con 0x7fdf84154540 2023-05-10T01:25:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.614+0000 7fdf837fe700 1 -- 172.21.15.52:0/2467441912 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800f9f0 con 0x7fdf84154540 2023-05-10T01:25:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2467441912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 msgr2=0x7fdf84069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2467441912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 0x7fdf84069690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdf78009790 tx=0x7fdf78009060).stop 2023-05-10T01:25:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2467441912 shutdown_connections 2023-05-10T01:25:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2467441912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154540 0x7fdf84069690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2467441912 >> 172.21.15.52:0/2467441912 conn(0x7fdf840cb740 msgr2=0x7fdf840c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2467441912 shutdown_connections 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.615+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2467441912 wait complete. 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.616+0000 7fdf8aafb700 1 Processor -- start 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.616+0000 7fdf8aafb700 1 -- start start 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154160 0x7fdf841528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf84154540 0x7fdf84152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84150ee0 con 0x7fdf84069b80 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84150310 con 0x7fdf84154540 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf841505b0 con 0x7fdf84154160 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36106/0 (socket says 172.21.15.52:36106) 2023-05-10T01:25:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 -- 172.21.15.52:0/2964938097 learned_addr learned my addr 172.21.15.52:0/2964938097 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf83fff700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154160 0x7fdf841528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf89098700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf84154540 0x7fdf84152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 -- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154160 msgr2=0x7fdf841528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154160 0x7fdf841528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 -- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf84154540 msgr2=0x7fdf84152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf84154540 0x7fdf84152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 -- 172.21.15.52:0/2964938097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780092a0 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf88897700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fdf7c00c810 tx=0x7fdf7c0026f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00a5c0 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00a720 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf84150890 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00aac0 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.617+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf840c4f70 con 0x7fdf84069b80 2023-05-10T01:25:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.618+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf840666b0 con 0x7fdf84069b80 2023-05-10T01:25:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.619+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf7c010070 con 0x7fdf84069b80 2023-05-10T01:25:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.619+0000 7fdf80ff9700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 0x7fdf64061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.619+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fdf7c079a80 con 0x7fdf84069b80 2023-05-10T01:25:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.619+0000 7fdf83fff700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 0x7fdf64061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.620+0000 7fdf83fff700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 0x7fdf64061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf84154920 tx=0x7fdf78017000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.623+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf7c04af10 con 0x7fdf84069b80 2023-05-10T01:25:00.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.790+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf84151020 con 0x7fdf6405ed90 2023-05-10T01:25:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.800+0000 7fdf80ff9700 1 -- 172.21.15.52:0/2964938097 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355961 (secure 0 0 0) 0x7fdf78000bc0 con 0x7fdf6405ed90 2023-05-10T01:25:00.808 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 msgr2=0x7fdf64061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 0x7fdf64061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf84154920 tx=0x7fdf78017000).stop 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 msgr2=0x7fdf8414ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fdf7c00c810 tx=0x7fdf7c0026f0).stop 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 shutdown_connections 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fdf6405ed90 0x7fdf64061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf84154540 0x7fdf84152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf84069b80 0x7fdf8414ea60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 --2- 172.21.15.52:0/2964938097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdf84154160 0x7fdf841528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:00.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 >> 172.21.15.52:0/2964938097 conn(0x7fdf840cb740 msgr2=0x7fdf840acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:00.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.803+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 shutdown_connections 2023-05-10T01:25:00.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:00.804+0000 7fdf8aafb700 1 -- 172.21.15.52:0/2964938097 wait complete. 2023-05-10T01:25:00.812 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:00.819 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:00.093948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151376,"kb_used_data":8784,"kb_used_omap":0,"kb_used_meta":142528,"kb_avail":754823344,"statfs":{"total":773094113280,"available":772939104256,"internally_reserved":0,"allocated":8994816,"data_stored":4504595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145948672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10438,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.425449"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050574+0000","last_change":"2023-05-10T01:24:56.048111+0000","last_active":"2023-05-10T01:24:56.050574+0000","last_peered":"2023-05-10T01:24:56.050574+0000","last_clean":"2023-05-10T01:24:56.050574+0000","last_became_active":"2023-05-10T01:24:56.047583+0000","last_became_peered":"2023-05-10T01:24:56.047583+0000","last_unstale":"2023-05-10T01:24:56.050574+0000","last_undegraded":"2023-05-10T01:24:56.050574+0000","last_fullsized":"2023-05-10T01:24:56.050574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037524+0000","last_change":"2023-05-10T01:24:55.647532+0000","last_active":"2023-05-10T01:24:56.037524+0000","last_peered":"2023-05-10T01:24:56.037524+0000","last_clean":"2023-05-10T01:24:56.037524+0000","last_became_active":"2023-05-10T01:24:55.647238+0000","last_became_peered":"2023-05-10T01:24:55.647238+0000","last_unstale":"2023-05-10T01:24:56.037524+0000","last_undegraded":"2023-05-10T01:24:56.037524+0000","last_fullsized":"2023-05-10T01:24:56.037524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065020+0000","last_change":"2023-05-10T01:24:55.654314+0000","last_active":"2023-05-10T01:24:56.065020+0000","last_peered":"2023-05-10T01:24:56.065020+0000","last_clean":"2023-05-10T01:24:56.065020+0000","last_became_active":"2023-05-10T01:24:55.654046+0000","last_became_peered":"2023-05-10T01:24:55.654046+0000","last_unstale":"2023-05-10T01:24:56.065020+0000","last_undegraded":"2023-05-10T01:24:56.065020+0000","last_fullsized":"2023-05-10T01:24:56.065020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630239+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065494+0000","last_change":"2023-05-10T01:24:56.059027+0000","last_active":"2023-05-10T01:24:56.065494+0000","last_peered":"2023-05-10T01:24:56.065494+0000","last_clean":"2023-05-10T01:24:56.065494+0000","last_became_active":"2023-05-10T01:24:56.058584+0000","last_became_peered":"2023-05-10T01:24:56.058584+0000","last_unstale":"2023-05-10T01:24:56.065494+0000","last_undegraded":"2023-05-10T01:24:56.065494+0000","last_fullsized":"2023-05-10T01:24:56.065494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633217+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050134+0000","last_change":"2023-05-10T01:24:56.045422+0000","last_active":"2023-05-10T01:24:56.050134+0000","last_peered":"2023-05-10T01:24:56.050134+0000","last_clean":"2023-05-10T01:24:56.050134+0000","last_became_active":"2023-05-10T01:24:56.045185+0000","last_became_peered":"2023-05-10T01:24:56.045185+0000","last_unstale":"2023-05-10T01:24:56.050134+0000","last_undegraded":"2023-05-10T01:24:56.050134+0000","last_fullsized":"2023-05-10T01:24:56.050134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634919+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630197+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064611+0000","last_change":"2023-05-10T01:24:56.062117+0000","last_active":"2023-05-10T01:24:56.064611+0000","last_peered":"2023-05-10T01:24:56.064611+0000","last_clean":"2023-05-10T01:24:56.064611+0000","last_became_active":"2023-05-10T01:24:56.061816+0000","last_became_peered":"2023-05-10T01:24:56.061816+0000","last_unstale":"2023-05-10T01:24:56.064611+0000","last_undegraded":"2023-05-10T01:24:56.064611+0000","last_fullsized":"2023-05-10T01:24:56.064611+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635263+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050589+0000","last_change":"2023-05-10T01:24:56.048238+0000","last_active":"2023-05-10T01:24:56.050589+0000","last_peered":"2023-05-10T01:24:56.050589+0000","last_clean":"2023-05-10T01:24:56.050589+0000","last_became_active":"2023-05-10T01:24:56.047840+0000","last_became_peered":"2023-05-10T01:24:56.047840+0000","last_unstale":"2023-05-10T01:24:56.050589+0000","last_undegraded":"2023-05-10T01:24:56.050589+0000","last_fullsized":"2023-05-10T01:24:56.050589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.639129+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.068060+0000","last_change":"2023-05-10T01:24:55.659712+0000","last_active":"2023-05-10T01:24:56.068060+0000","last_peered":"2023-05-10T01:24:56.068060+0000","last_clean":"2023-05-10T01:24:56.068060+0000","last_became_active":"2023-05-10T01:24:55.659428+0000","last_became_peered":"2023-05-10T01:24:55.659428+0000","last_unstale":"2023-05-10T01:24:56.068060+0000","last_undegraded":"2023-05-10T01:24:56.068060+0000","last_fullsized":"2023-05-10T01:24:56.068060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046970+0000","last_change":"2023-05-10T01:24:55.663646+0000","last_active":"2023-05-10T01:24:56.046970+0000","last_peered":"2023-05-10T01:24:56.046970+0000","last_clean":"2023-05-10T01:24:56.046970+0000","last_became_active":"2023-05-10T01:24:55.663255+0000","last_became_peered":"2023-05-10T01:24:55.663255+0000","last_unstale":"2023-05-10T01:24:56.046970+0000","last_undegraded":"2023-05-10T01:24:56.046970+0000","last_fullsized":"2023-05-10T01:24:56.046970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050293+0000","last_change":"2023-05-10T01:24:56.046677+0000","last_active":"2023-05-10T01:24:56.050293+0000","last_peered":"2023-05-10T01:24:56.050293+0000","last_clean":"2023-05-10T01:24:56.050293+0000","last_became_active":"2023-05-10T01:24:56.046391+0000","last_became_peered":"2023-05-10T01:24:56.046391+0000","last_unstale":"2023-05-10T01:24:56.050293+0000","last_undegraded":"2023-05-10T01:24:56.050293+0000","last_fullsized":"2023-05-10T01:24:56.050293+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629629+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034505+0000","last_change":"2023-05-10T01:24:55.657750+0000","last_active":"2023-05-10T01:24:56.034505+0000","last_peered":"2023-05-10T01:24:56.034505+0000","last_clean":"2023-05-10T01:24:56.034505+0000","last_became_active":"2023-05-10T01:24:55.657454+0000","last_became_peered":"2023-05-10T01:24:55.657454+0000","last_unstale":"2023-05-10T01:24:56.034505+0000","last_undegraded":"2023-05-10T01:24:56.034505+0000","last_fullsized":"2023-05-10T01:24:56.034505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635214+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050280+0000","last_change":"2023-05-10T01:24:56.047827+0000","last_active":"2023-05-10T01:24:56.050280+0000","last_peered":"2023-05-10T01:24:56.050280+0000","last_clean":"2023-05-10T01:24:56.050280+0000","last_became_active":"2023-05-10T01:24:56.047615+0000","last_became_peered":"2023-05-10T01:24:56.047615+0000","last_unstale":"2023-05-10T01:24:56.050280+0000","last_undegraded":"2023-05-10T01:24:56.050280+0000","last_fullsized":"2023-05-10T01:24:56.050280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629863+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.044991+0000","last_change":"2023-05-10T01:24:55.654917+0000","last_active":"2023-05-10T01:24:56.044991+0000","last_peered":"2023-05-10T01:24:56.044991+0000","last_clean":"2023-05-10T01:24:56.044991+0000","last_became_active":"2023-05-10T01:24:55.654637+0000","last_became_peered":"2023-05-10T01:24:55.654637+0000","last_unstale":"2023-05-10T01:24:56.044991+0000","last_undegraded":"2023-05-10T01:24:56.044991+0000","last_fullsized":"2023-05-10T01:24:56.044991+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635547+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033317+0000","last_change":"2023-05-10T01:24:55.651999+0000","last_active":"2023-05-10T01:24:56.033317+0000","last_peered":"2023-05-10T01:24:56.033317+0000","last_clean":"2023-05-10T01:24:56.033317+0000","last_became_active":"2023-05-10T01:24:55.651696+0000","last_became_peered":"2023-05-10T01:24:55.651696+0000","last_unstale":"2023-05-10T01:24:56.033317+0000","last_undegraded":"2023-05-10T01:24:56.033317+0000","last_fullsized":"2023-05-10T01:24:56.033317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635042+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064476+0000","last_change":"2023-05-10T01:24:56.058603+0000","last_active":"2023-05-10T01:24:56.064476+0000","last_peered":"2023-05-10T01:24:56.064476+0000","last_clean":"2023-05-10T01:24:56.064476+0000","last_became_active":"2023-05-10T01:24:56.057445+0000","last_became_peered":"2023-05-10T01:24:56.057445+0000","last_unstale":"2023-05-10T01:24:56.064476+0000","last_undegraded":"2023-05-10T01:24:56.064476+0000","last_fullsized":"2023-05-10T01:24:56.064476+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633384+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065682+0000","last_change":"2023-05-10T01:24:56.063709+0000","last_active":"2023-05-10T01:24:56.065682+0000","last_peered":"2023-05-10T01:24:56.065682+0000","last_clean":"2023-05-10T01:24:56.065682+0000","last_became_active":"2023-05-10T01:24:56.063193+0000","last_became_peered":"2023-05-10T01:24:56.063193+0000","last_unstale":"2023-05-10T01:24:56.065682+0000","last_undegraded":"2023-05-10T01:24:56.065682+0000","last_fullsized":"2023-05-10T01:24:56.065682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635215+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632964+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061050+0000","last_change":"2023-05-10T01:24:56.058000+0000","last_active":"2023-05-10T01:24:56.061050+0000","last_peered":"2023-05-10T01:24:56.061050+0000","last_clean":"2023-05-10T01:24:56.061050+0000","last_became_active":"2023-05-10T01:24:56.057743+0000","last_became_peered":"2023-05-10T01:24:56.057743+0000","last_unstale":"2023-05-10T01:24:56.061050+0000","last_undegraded":"2023-05-10T01:24:56.061050+0000","last_fullsized":"2023-05-10T01:24:56.061050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634364+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037613+0000","last_change":"2023-05-10T01:24:55.646476+0000","last_active":"2023-05-10T01:24:56.037613+0000","last_peered":"2023-05-10T01:24:56.037613+0000","last_clean":"2023-05-10T01:24:56.037613+0000","last_became_active":"2023-05-10T01:24:55.645582+0000","last_became_peered":"2023-05-10T01:24:55.645582+0000","last_unstale":"2023-05-10T01:24:56.037613+0000","last_undegraded":"2023-05-10T01:24:56.037613+0000","last_fullsized":"2023-05-10T01:24:56.037613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047731+0000","last_change":"2023-05-10T01:24:56.043316+0000","last_active":"2023-05-10T01:24:56.047731+0000","last_peered":"2023-05-10T01:24:56.047731+0000","last_clean":"2023-05-10T01:24:56.047731+0000","last_became_active":"2023-05-10T01:24:56.043070+0000","last_became_peered":"2023-05-10T01:24:56.043070+0000","last_unstale":"2023-05-10T01:24:56.047731+0000","last_undegraded":"2023-05-10T01:24:56.047731+0000","last_fullsized":"2023-05-10T01:24:56.047731+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039184+0000","last_change":"2023-05-10T01:24:55.649801+0000","last_active":"2023-05-10T01:24:56.039184+0000","last_peered":"2023-05-10T01:24:56.039184+0000","last_clean":"2023-05-10T01:24:56.039184+0000","last_became_active":"2023-05-10T01:24:55.649477+0000","last_became_peered":"2023-05-10T01:24:55.649477+0000","last_unstale":"2023-05-10T01:24:56.039184+0000","last_undegraded":"2023-05-10T01:24:56.039184+0000","last_fullsized":"2023-05-10T01:24:56.039184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634123+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633874+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.059720+0000","last_change":"2023-05-10T01:24:56.057801+0000","last_active":"2023-05-10T01:24:56.059720+0000","last_peered":"2023-05-10T01:24:56.059720+0000","last_clean":"2023-05-10T01:24:56.059720+0000","last_became_active":"2023-05-10T01:24:56.057522+0000","last_became_peered":"2023-05-10T01:24:56.057522+0000","last_unstale":"2023-05-10T01:24:56.059720+0000","last_undegraded":"2023-05-10T01:24:56.059720+0000","last_fullsized":"2023-05-10T01:24:56.059720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633802+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062976+0000","last_change":"2023-05-10T01:24:56.058137+0000","last_active":"2023-05-10T01:24:56.062976+0000","last_peered":"2023-05-10T01:24:56.062976+0000","last_clean":"2023-05-10T01:24:56.062976+0000","last_became_active":"2023-05-10T01:24:56.057875+0000","last_became_peered":"2023-05-10T01:24:56.057875+0000","last_unstale":"2023-05-10T01:24:56.062976+0000","last_undegraded":"2023-05-10T01:24:56.062976+0000","last_fullsized":"2023-05-10T01:24:56.062976+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629516+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055527+0000","last_change":"2023-05-10T01:24:56.053505+0000","last_active":"2023-05-10T01:24:56.055527+0000","last_peered":"2023-05-10T01:24:56.055527+0000","last_clean":"2023-05-10T01:24:56.055527+0000","last_became_active":"2023-05-10T01:24:56.053233+0000","last_became_peered":"2023-05-10T01:24:56.053233+0000","last_unstale":"2023-05-10T01:24:56.055527+0000","last_undegraded":"2023-05-10T01:24:56.055527+0000","last_fullsized":"2023-05-10T01:24:56.055527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635805+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.638770+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633813+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050141+0000","last_change":"2023-05-10T01:24:56.047177+0000","last_active":"2023-05-10T01:24:56.050141+0000","last_peered":"2023-05-10T01:24:56.050141+0000","last_clean":"2023-05-10T01:24:56.050141+0000","last_became_active":"2023-05-10T01:24:56.046949+0000","last_became_peered":"2023-05-10T01:24:56.046949+0000","last_unstale":"2023-05-10T01:24:56.050141+0000","last_undegraded":"2023-05-10T01:24:56.050141+0000","last_fullsized":"2023-05-10T01:24:56.050141+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632058+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050278+0000","last_change":"2023-05-10T01:24:56.046565+0000","last_active":"2023-05-10T01:24:56.050278+0000","last_peered":"2023-05-10T01:24:56.050278+0000","last_clean":"2023-05-10T01:24:56.050278+0000","last_became_active":"2023-05-10T01:24:56.046141+0000","last_became_peered":"2023-05-10T01:24:56.046141+0000","last_unstale":"2023-05-10T01:24:56.050278+0000","last_undegraded":"2023-05-10T01:24:56.050278+0000","last_fullsized":"2023-05-10T01:24:56.050278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633639+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032918+0000","last_change":"2023-05-10T01:24:55.648375+0000","last_active":"2023-05-10T01:24:56.032918+0000","last_peered":"2023-05-10T01:24:56.032918+0000","last_clean":"2023-05-10T01:24:56.032918+0000","last_became_active":"2023-05-10T01:24:55.648061+0000","last_became_peered":"2023-05-10T01:24:55.648061+0000","last_unstale":"2023-05-10T01:24:56.032918+0000","last_undegraded":"2023-05-10T01:24:56.032918+0000","last_fullsized":"2023-05-10T01:24:56.032918+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629170+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050747+0000","last_change":"2023-05-10T01:24:56.049666+0000","last_active":"2023-05-10T01:24:56.050747+0000","last_peered":"2023-05-10T01:24:56.050747+0000","last_clean":"2023-05-10T01:24:56.050747+0000","last_became_active":"2023-05-10T01:24:56.049373+0000","last_became_peered":"2023-05-10T01:24:56.049373+0000","last_unstale":"2023-05-10T01:24:56.050747+0000","last_undegraded":"2023-05-10T01:24:56.050747+0000","last_fullsized":"2023-05-10T01:24:56.050747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636347+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633929+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065427+0000","last_change":"2023-05-10T01:24:56.063242+0000","last_active":"2023-05-10T01:24:56.065427+0000","last_peered":"2023-05-10T01:24:56.065427+0000","last_clean":"2023-05-10T01:24:56.065427+0000","last_became_active":"2023-05-10T01:24:56.062420+0000","last_became_peered":"2023-05-10T01:24:56.062420+0000","last_unstale":"2023-05-10T01:24:56.065427+0000","last_undegraded":"2023-05-10T01:24:56.065427+0000","last_fullsized":"2023-05-10T01:24:56.065427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629674+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065465+0000","last_change":"2023-05-10T01:24:56.060743+0000","last_active":"2023-05-10T01:24:56.065465+0000","last_peered":"2023-05-10T01:24:56.065465+0000","last_clean":"2023-05-10T01:24:56.065465+0000","last_became_active":"2023-05-10T01:24:56.060405+0000","last_became_peered":"2023-05-10T01:24:56.060405+0000","last_unstale":"2023-05-10T01:24:56.065465+0000","last_undegraded":"2023-05-10T01:24:56.065465+0000","last_fullsized":"2023-05-10T01:24:56.065465+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632747+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633758+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635696+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629153+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.054595+0000","last_change":"2023-05-10T01:24:55.651683+0000","last_active":"2023-05-10T01:24:56.054595+0000","last_peered":"2023-05-10T01:24:56.054595+0000","last_clean":"2023-05-10T01:24:56.054595+0000","last_became_active":"2023-05-10T01:24:55.651369+0000","last_became_peered":"2023-05-10T01:24:55.651369+0000","last_unstale":"2023-05-10T01:24:56.054595+0000","last_undegraded":"2023-05-10T01:24:56.054595+0000","last_fullsized":"2023-05-10T01:24:56.054595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633581+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032868+0000","last_change":"2023-05-10T01:24:55.657774+0000","last_active":"2023-05-10T01:24:56.032868+0000","last_peered":"2023-05-10T01:24:56.032868+0000","last_clean":"2023-05-10T01:24:56.032868+0000","last_became_active":"2023-05-10T01:24:55.657505+0000","last_became_peered":"2023-05-10T01:24:55.657505+0000","last_unstale":"2023-05-10T01:24:56.032868+0000","last_undegraded":"2023-05-10T01:24:56.032868+0000","last_fullsized":"2023-05-10T01:24:56.032868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637705+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050720+0000","last_change":"2023-05-10T01:24:56.048800+0000","last_active":"2023-05-10T01:24:56.050720+0000","last_peered":"2023-05-10T01:24:56.050720+0000","last_clean":"2023-05-10T01:24:56.050720+0000","last_became_active":"2023-05-10T01:24:56.048552+0000","last_became_peered":"2023-05-10T01:24:56.048552+0000","last_unstale":"2023-05-10T01:24:56.050720+0000","last_undegraded":"2023-05-10T01:24:56.050720+0000","last_fullsized":"2023-05-10T01:24:56.050720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636045+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632659+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629186+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063523+0000","last_change":"2023-05-10T01:24:56.058327+0000","last_active":"2023-05-10T01:24:56.063523+0000","last_peered":"2023-05-10T01:24:56.063523+0000","last_clean":"2023-05-10T01:24:56.063523+0000","last_became_active":"2023-05-10T01:24:56.057358+0000","last_became_peered":"2023-05-10T01:24:56.057358+0000","last_unstale":"2023-05-10T01:24:56.063523+0000","last_undegraded":"2023-05-10T01:24:56.063523+0000","last_fullsized":"2023-05-10T01:24:56.063523+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060280+0000","last_change":"2023-05-10T01:24:56.048343+0000","last_active":"2023-05-10T01:24:56.060280+0000","last_peered":"2023-05-10T01:24:56.060280+0000","last_clean":"2023-05-10T01:24:56.060280+0000","last_became_active":"2023-05-10T01:24:56.048071+0000","last_became_peered":"2023-05-10T01:24:56.048071+0000","last_unstale":"2023-05-10T01:24:56.060280+0000","last_undegraded":"2023-05-10T01:24:56.060280+0000","last_fullsized":"2023-05-10T01:24:56.060280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037538+0000","last_change":"2023-05-10T01:24:55.649514+0000","last_active":"2023-05-10T01:24:56.037538+0000","last_peered":"2023-05-10T01:24:56.037538+0000","last_clean":"2023-05-10T01:24:56.037538+0000","last_became_active":"2023-05-10T01:24:55.649230+0000","last_became_peered":"2023-05-10T01:24:55.649230+0000","last_unstale":"2023-05-10T01:24:56.037538+0000","last_undegraded":"2023-05-10T01:24:56.037538+0000","last_fullsized":"2023-05-10T01:24:56.037538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629201+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043824+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:56.043824+0000","last_peered":"2023-05-10T01:24:56.043824+0000","last_clean":"2023-05-10T01:24:56.043824+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:56.043824+0000","last_undegraded":"2023-05-10T01:24:56.043824+0000","last_fullsized":"2023-05-10T01:24:56.043824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064619+0000","last_change":"2023-05-10T01:24:56.060432+0000","last_active":"2023-05-10T01:24:56.064619+0000","last_peered":"2023-05-10T01:24:56.064619+0000","last_clean":"2023-05-10T01:24:56.064619+0000","last_became_active":"2023-05-10T01:24:56.060141+0000","last_became_peered":"2023-05-10T01:24:56.060141+0000","last_unstale":"2023-05-10T01:24:56.064619+0000","last_undegraded":"2023-05-10T01:24:56.064619+0000","last_fullsized":"2023-05-10T01:24:56.064619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062086+0000","last_change":"2023-05-10T01:24:55.646775+0000","last_active":"2023-05-10T01:24:56.062086+0000","last_peered":"2023-05-10T01:24:56.062086+0000","last_clean":"2023-05-10T01:24:56.062086+0000","last_became_active":"2023-05-10T01:24:55.646471+0000","last_became_peered":"2023-05-10T01:24:55.646471+0000","last_unstale":"2023-05-10T01:24:56.062086+0000","last_undegraded":"2023-05-10T01:24:56.062086+0000","last_fullsized":"2023-05-10T01:24:56.062086+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343084+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:53.343084+0000","last_peered":"2023-05-10T01:24:53.343084+0000","last_clean":"2023-05-10T01:24:53.343084+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:53.343084+0000","last_undegraded":"2023-05-10T01:24:53.343084+0000","last_fullsized":"2023-05-10T01:24:53.343084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042275+0000","last_change":"2023-05-10T01:24:55.652850+0000","last_active":"2023-05-10T01:24:56.042275+0000","last_peered":"2023-05-10T01:24:56.042275+0000","last_clean":"2023-05-10T01:24:56.042275+0000","last_became_active":"2023-05-10T01:24:55.652528+0000","last_became_peered":"2023-05-10T01:24:55.652528+0000","last_unstale":"2023-05-10T01:24:56.042275+0000","last_undegraded":"2023-05-10T01:24:56.042275+0000","last_fullsized":"2023-05-10T01:24:56.042275+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.095513+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:53.095513+0000","last_peered":"2023-05-10T01:24:53.095513+0000","last_clean":"2023-05-10T01:24:53.095513+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:53.095513+0000","last_undegraded":"2023-05-10T01:24:53.095513+0000","last_fullsized":"2023-05-10T01:24:53.095513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.041216+0000","last_change":"2023-05-10T01:24:55.652884+0000","last_active":"2023-05-10T01:24:56.041216+0000","last_peered":"2023-05-10T01:24:56.041216+0000","last_clean":"2023-05-10T01:24:56.041216+0000","last_became_active":"2023-05-10T01:24:55.652548+0000","last_became_peered":"2023-05-10T01:24:55.652548+0000","last_unstale":"2023-05-10T01:24:56.041216+0000","last_undegraded":"2023-05-10T01:24:56.041216+0000","last_fullsized":"2023-05-10T01:24:56.041216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343113+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:53.343113+0000","last_peered":"2023-05-10T01:24:53.343113+0000","last_clean":"2023-05-10T01:24:53.343113+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:53.343113+0000","last_undegraded":"2023-05-10T01:24:53.343113+0000","last_fullsized":"2023-05-10T01:24:53.343113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343193+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:53.343193+0000","last_peered":"2023-05-10T01:24:53.343193+0000","last_clean":"2023-05-10T01:24:53.343193+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:53.343193+0000","last_undegraded":"2023-05-10T01:24:53.343193+0000","last_fullsized":"2023-05-10T01:24:53.343193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045366+0000","last_change":"2023-05-10T01:24:56.043832+0000","last_active":"2023-05-10T01:24:56.045366+0000","last_peered":"2023-05-10T01:24:56.045366+0000","last_clean":"2023-05-10T01:24:56.045366+0000","last_became_active":"2023-05-10T01:24:56.043569+0000","last_became_peered":"2023-05-10T01:24:56.043569+0000","last_unstale":"2023-05-10T01:24:56.045366+0000","last_undegraded":"2023-05-10T01:24:56.045366+0000","last_fullsized":"2023-05-10T01:24:56.045366+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.036644+0000","last_change":"2023-05-10T01:24:55.653598+0000","last_active":"2023-05-10T01:24:56.036644+0000","last_peered":"2023-05-10T01:24:56.036644+0000","last_clean":"2023-05-10T01:24:56.036644+0000","last_became_active":"2023-05-10T01:24:55.653218+0000","last_became_peered":"2023-05-10T01:24:55.653218+0000","last_unstale":"2023-05-10T01:24:56.036644+0000","last_undegraded":"2023-05-10T01:24:56.036644+0000","last_fullsized":"2023-05-10T01:24:56.036644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343220+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:53.343220+0000","last_peered":"2023-05-10T01:24:53.343220+0000","last_clean":"2023-05-10T01:24:53.343220+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:53.343220+0000","last_undegraded":"2023-05-10T01:24:53.343220+0000","last_fullsized":"2023-05-10T01:24:53.343220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064382+0000","last_change":"2023-05-10T01:24:56.057487+0000","last_active":"2023-05-10T01:24:56.064382+0000","last_peered":"2023-05-10T01:24:56.064382+0000","last_clean":"2023-05-10T01:24:56.064382+0000","last_became_active":"2023-05-10T01:24:56.057170+0000","last_became_peered":"2023-05-10T01:24:56.057170+0000","last_unstale":"2023-05-10T01:24:56.064382+0000","last_undegraded":"2023-05-10T01:24:56.064382+0000","last_fullsized":"2023-05-10T01:24:56.064382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043736+0000","last_change":"2023-05-10T01:24:55.659797+0000","last_active":"2023-05-10T01:24:56.043736+0000","last_peered":"2023-05-10T01:24:56.043736+0000","last_clean":"2023-05-10T01:24:56.043736+0000","last_became_active":"2023-05-10T01:24:55.659374+0000","last_became_peered":"2023-05-10T01:24:55.659374+0000","last_unstale":"2023-05-10T01:24:56.043736+0000","last_undegraded":"2023-05-10T01:24:56.043736+0000","last_fullsized":"2023-05-10T01:24:56.043736+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343158+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:53.343158+0000","last_peered":"2023-05-10T01:24:53.343158+0000","last_clean":"2023-05-10T01:24:53.343158+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:53.343158+0000","last_undegraded":"2023-05-10T01:24:53.343158+0000","last_fullsized":"2023-05-10T01:24:53.343158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064683+0000","last_change":"2023-05-10T01:24:56.058212+0000","last_active":"2023-05-10T01:24:56.064683+0000","last_peered":"2023-05-10T01:24:56.064683+0000","last_clean":"2023-05-10T01:24:56.064683+0000","last_became_active":"2023-05-10T01:24:56.057943+0000","last_became_peered":"2023-05-10T01:24:56.057943+0000","last_unstale":"2023-05-10T01:24:56.064683+0000","last_undegraded":"2023-05-10T01:24:56.064683+0000","last_fullsized":"2023-05-10T01:24:56.064683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635939+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045083+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:56.045083+0000","last_peered":"2023-05-10T01:24:56.045083+0000","last_clean":"2023-05-10T01:24:56.045083+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:56.045083+0000","last_undegraded":"2023-05-10T01:24:56.045083+0000","last_fullsized":"2023-05-10T01:24:56.045083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632127+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:52.795226+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:52.795226+0000","last_peered":"2023-05-10T01:24:52.795226+0000","last_clean":"2023-05-10T01:24:52.795226+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:52.795226+0000","last_undegraded":"2023-05-10T01:24:52.795226+0000","last_fullsized":"2023-05-10T01:24:52.795226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17336,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354504,"statfs":{"total":96636764160,"available":96619012096,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.436}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16644,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355196,"statfs":{"total":96636764160,"available":96619720704,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.433},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.502}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20856,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":19712,"kb_avail":94350984,"statfs":{"total":96636764160,"available":96615407616,"internally_reserved":0,"allocated":1163264,"data_stored":578171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20185088},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.255}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16616,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355224,"statfs":{"total":96636764160,"available":96619749376,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.313}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.37}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.61199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17732,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94354108,"statfs":{"total":96636764160,"available":96618606592,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.307},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24936,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94346904,"statfs":{"total":96636764160,"available":96611229696,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.34200000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16964,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354876,"statfs":{"total":96636764160,"available":96619393024,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20292,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":19200,"kb_avail":94351548,"statfs":{"total":96636764160,"available":96615985152,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19660800},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.495}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:00.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-05-10T01:25:00.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-05-10T01:25:00.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.636723+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-05-10T01:25:00.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-05-10T01:25:00.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632723+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-05-10T01:25:00.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-05-10T01:25:00.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-05-10T01:25:00.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.630239+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-05-10T01:25:00.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633217+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-05-10T01:25:00.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.634919+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-05-10T01:25:00.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-05-10T01:25:00.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635550+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-05-10T01:25:00.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-05-10T01:25:00.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.630197+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-05-10T01:25:00.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635263+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-05-10T01:25:00.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.639129+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-05-10T01:25:00.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-05-10T01:25:00.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-05-10T01:25:00.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629629+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-05-10T01:25:00.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-05-10T01:25:00.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-05-10T01:25:00.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635214+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-05-10T01:25:00.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629863+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-05-10T01:25:00.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-05-10T01:25:00.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-05-10T01:25:00.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635547+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-05-10T01:25:00.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-05-10T01:25:00.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-05-10T01:25:00.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635042+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-05-10T01:25:00.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633384+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-05-10T01:25:00.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.637187+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-05-10T01:25:00.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-05-10T01:25:00.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635215+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-05-10T01:25:00.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-05-10T01:25:00.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632964+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-05-10T01:25:00.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.634364+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-05-10T01:25:00.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-05-10T01:25:00.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632550+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-05-10T01:25:00.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-05-10T01:25:00.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-05-10T01:25:00.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.634123+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-05-10T01:25:00.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-05-10T01:25:00.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633874+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-05-10T01:25:00.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633802+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-05-10T01:25:00.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629516+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-05-10T01:25:00.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635805+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-05-10T01:25:00.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-05-10T01:25:00.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.638770+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-05-10T01:25:00.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-05-10T01:25:00.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633813+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-05-10T01:25:00.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632058+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-05-10T01:25:00.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633639+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-05-10T01:25:00.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-05-10T01:25:00.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-05-10T01:25:00.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629170+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-05-10T01:25:00.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.636347+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-05-10T01:25:00.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-05-10T01:25:00.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633929+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-05-10T01:25:00.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629674+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-05-10T01:25:00.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632747+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-05-10T01:25:00.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-05-10T01:25:00.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633758+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-05-10T01:25:00.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-05-10T01:25:00.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635696+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-05-10T01:25:00.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-05-10T01:25:00.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629153+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-05-10T01:25:00.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-05-10T01:25:00.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-05-10T01:25:00.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633581+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:25:00.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-05-10T01:25:00.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-05-10T01:25:00.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-05-10T01:25:00.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.637705+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-05-10T01:25:00.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.636045+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-05-10T01:25:00.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-05-10T01:25:00.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632659+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-05-10T01:25:00.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-05-10T01:25:00.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629186+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-05-10T01:25:00.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.633187+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:25:00.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-05-10T01:25:00.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-05-10T01:25:00.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.629201+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:25:00.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-05-10T01:25:00.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-05-10T01:25:00.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-05-10T01:25:00.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.635939+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:25:00.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-05-10T01:25:00.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:24:55.627026+0000', 'last_change': '2023-05-10T01:24:55.627026+0000', 'last_active': '2023-05-10T01:24:55.627026+0000', 'last_peered': '2023-05-10T01:24:55.627026+0000', 'last_clean': '2023-05-10T01:24:55.627026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:55.627026+0000', 'last_undegraded': '2023-05-10T01:24:55.627026+0000', 'last_fullsized': '2023-05-10T01:24:55.627026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:55.627026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:00.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-05-10T01:25:00.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:24:54.625067+0000', 'last_change': '2023-05-10T01:24:54.632127+0000', 'last_active': '2023-05-10T01:24:54.625067+0000', 'last_peered': '2023-05-10T01:24:54.625067+0000', 'last_clean': '2023-05-10T01:24:54.625067+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:24:54.625067+0000', 'last_undegraded': '2023-05-10T01:24:54.625067+0000', 'last_fullsized': '2023-05-10T01:24:54.625067+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'last_clean_scrub_stamp': '2023-05-10T01:24:54.625067+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:25:00.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:25:01.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.003+0000 7fb914838700 1 Processor -- start 2023-05-10T01:25:01.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.003+0000 7fb914838700 1 -- start start 2023-05-10T01:25:01.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb914838700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb910154e40 0x7fb9100acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb914838700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9100ad030 0x7fb91014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb914838700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb910158960 con 0x7fb9100c7370 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb914838700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9101552f0 con 0x7fb910154e40 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb914838700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb910157d50 con 0x7fb9100ad030 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90ed9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9100c7370 0x7fb9100c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45130/0 (socket says 172.21.15.52:45130) 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90ed9d700 1 -- 172.21.15.52:0/1060074906 learned_addr learned my addr 172.21.15.52:0/1060074906 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 --2- 172.21.15.52:0/1060074906 >> v2:172.21.15.172:3300/0 conn(0x7fb910154e40 0x7fb9100acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90f59e700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9100ad030 0x7fb91014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275712106 0 0) 0x7fb910158960 con 0x7fb9100c7370 2023-05-10T01:25:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f00033f0 con 0x7fb9100c7370 2023-05-10T01:25:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2902263572 0 0) 0x7fb8f00033f0 con 0x7fb9100c7370 2023-05-10T01:25:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 -- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9100ad030 msgr2=0x7fb91014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9100ad030 0x7fb91014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 -- 172.21.15.52:0/1060074906 >> v1:172.21.15.52:6789/0 conn(0x7fb9100c7370 legacy=0x7fb9100c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 -- 172.21.15.52:0/1060074906 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910158030 con 0x7fb910154e40 2023-05-10T01:25:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.004+0000 7fb90e59c700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb910154e40 0x7fb9100acb40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fb8f8009760 tx=0x7fb8f8009060).ready entity=mon.1 client_cookie=ec686d0f4601f7f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908001470 con 0x7fb910154e40 2023-05-10T01:25:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f8011400 con 0x7fb910154e40 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb90dd9b700 1 -- 172.21.15.52:0/1060074906 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8011780 con 0x7fb910154e40 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 -- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb910154e40 msgr2=0x7fb9100acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb910154e40 0x7fb9100acb40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fb8f8009760 tx=0x7fb8f8009060).stop 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 -- 172.21.15.52:0/1060074906 shutdown_connections 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9100ad030 0x7fb91014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 --2- 172.21.15.52:0/1060074906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb910154e40 0x7fb9100acb40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 -- 172.21.15.52:0/1060074906 >> 172.21.15.52:0/1060074906 conn(0x7fb910068320 msgr2=0x7fb910068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:01.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 -- 172.21.15.52:0/1060074906 shutdown_connections 2023-05-10T01:25:01.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.005+0000 7fb914838700 1 -- 172.21.15.52:0/1060074906 wait complete. 2023-05-10T01:25:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.006+0000 7fb914838700 1 Processor -- start 2023-05-10T01:25:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.006+0000 7fb914838700 1 -- start start 2023-05-10T01:25:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100ad030 0x7fb910164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 0x7fb9100c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100c44f0 con 0x7fb9100c7370 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100c4210 con 0x7fb9100ad030 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb914838700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb910164210 con 0x7fb910154e40 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36120/0 (socket says 172.21.15.52:36120) 2023-05-10T01:25:01.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb90e59c700 1 -- 172.21.15.52:0/3360639530 learned_addr learned my addr 172.21.15.52:0/3360639530 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb90ed9d700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100ad030 0x7fb910164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.007+0000 7fb90f59e700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 0x7fb9100c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 -- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 msgr2=0x7fb9100c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 0x7fb9100c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 -- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100ad030 msgr2=0x7fb910164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100ad030 0x7fb910164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 -- 172.21.15.52:0/3360639530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80092a0 con 0x7fb9100c7370 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90f59e700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 0x7fb9100c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb90e59c700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fb8f8009d50 tx=0x7fb8f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8010740 con 0x7fb9100c7370 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f80108a0 con 0x7fb9100c7370 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9101644f0 con 0x7fb9100c7370 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8010c60 con 0x7fb9100c7370 2023-05-10T01:25:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.008+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9100c3e90 con 0x7fb9100c7370 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.009+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb910047150 con 0x7fb9100c7370 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.009+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8f8024030 con 0x7fb9100c7370 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.010+0000 7fb906ffd700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 0x7fb8f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.010+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb8f807a820 con 0x7fb9100c7370 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.010+0000 7fb90ed9d700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 0x7fb8f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.010+0000 7fb90ed9d700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 0x7fb8f4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb9100cbb30 tx=0x7fb908001aa0).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.014+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8f804bcb0 con 0x7fb9100c7370 2023-05-10T01:25:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.253+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb9100bfb80 con 0x7fb9100c7370 2023-05-10T01:25:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.254+0000 7fb906ffd700 1 -- 172.21.15.52:0/3360639530 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7fb8f8022470 con 0x7fb9100c7370 2023-05-10T01:25:01.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:01.258 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":925,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":53},{"state_name":"creating+peering","count":46},{"state_name":"unknown","count":38}],"num_pgs":137,"num_pools":4,"num_objects":7,"data_bytes":892,"bytes_used":155009024,"bytes_avail":772939104256,"bytes_total":773094113280,"unknown_pgs_ratio":0.27737227082252502,"inactive_pgs_ratio":0.33576643466949463},"fsmap":{"epoch":38,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6666}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-05-10T01:23:14.899867+0000","services":{}},"progress_events":{}} 2023-05-10T01:25:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 msgr2=0x7fb8f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 0x7fb8f4061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb9100cbb30 tx=0x7fb908001aa0).stop 2023-05-10T01:25:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 msgr2=0x7fb91014c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fb8f8009d50 tx=0x7fb8f8016000).stop 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 shutdown_connections 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8f405ed90 0x7fb8f4061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb910154e40 0x7fb9100c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100ad030 0x7fb910164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 --2- 172.21.15.52:0/3360639530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100c7370 0x7fb91014c3c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 >> 172.21.15.52:0/3360639530 conn(0x7fb910068320 msgr2=0x7fb9100c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 shutdown_connections 2023-05-10T01:25:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.255+0000 7fb914838700 1 -- 172.21.15.52:0/3360639530 wait complete. 2023-05-10T01:25:01.270 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:25:01.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:01.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.383+0000 7fd2912f1700 1 Processor -- start 2023-05-10T01:25:01.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.383+0000 7fd2912f1700 1 -- start start 2023-05-10T01:25:01.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd2912f1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 0x7fd28c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd2912f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd2912f1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c158960 con 0x7fd28c0c7750 2023-05-10T01:25:01.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd2912f1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c155330 con 0x7fd28c0c7370 2023-05-10T01:25:01.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd2912f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c157d50 con 0x7fd28c0ad250 2023-05-10T01:25:01.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd28bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 0x7fd28c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:55766/0 (socket says 172.21.15.52:55766) 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 -- 172.21.15.52:0/3569900600 learned_addr learned my addr 172.21.15.52:0/3569900600 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 -- 172.21.15.52:0/3569900600 >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 msgr2=0x7fd28c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 --2- 172.21.15.52:0/3569900600 >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 0x7fd28c154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 -- 172.21.15.52:0/3569900600 >> v1:172.21.15.172:6789/0 conn(0x7fd28c0c7750 legacy=0x7fd28c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.384+0000 7fd290af0700 1 -- 172.21.15.52:0/3569900600 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0ad6b0 con 0x7fd28c0ad250 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd28bfff700 1 --2- 172.21.15.52:0/3569900600 >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 0x7fd28c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:01.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd290af0700 1 --2- 172.21.15.52:0/3569900600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd284009f20 tx=0x7fd284009840).ready entity=mon.2 client_cookie=43b8f140b6eb0a35 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd28affd700 1 -- 172.21.15.52:0/3569900600 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400e070 con 0x7fd28c0ad250 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd28affd700 1 -- 172.21.15.52:0/3569900600 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400b9d0 con 0x7fd28c0ad250 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd28affd700 1 -- 172.21.15.52:0/3569900600 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400bd50 con 0x7fd28c0ad250 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 -- 172.21.15.52:0/3569900600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 msgr2=0x7fd28c14dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 --2- 172.21.15.52:0/3569900600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd284009f20 tx=0x7fd284009840).stop 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 -- 172.21.15.52:0/3569900600 shutdown_connections 2023-05-10T01:25:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 --2- 172.21.15.52:0/3569900600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0ad250 0x7fd28c14dd60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 --2- 172.21.15.52:0/3569900600 >> v2:172.21.15.172:3300/0 conn(0x7fd28c0c7370 0x7fd28c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 -- 172.21.15.52:0/3569900600 >> 172.21.15.52:0/3569900600 conn(0x7fd28c068320 msgr2=0x7fd28c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 -- 172.21.15.52:0/3569900600 shutdown_connections 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.385+0000 7fd2912f1700 1 -- 172.21.15.52:0/3569900600 wait complete. 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.386+0000 7fd2912f1700 1 Processor -- start 2023-05-10T01:25:01.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 -- start start 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 0x7fd28c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0c7750 0x7fd28c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c4480 con 0x7fd28c0ad250 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0cb1a0 con 0x7fd28c0c7370 2023-05-10T01:25:01.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.387+0000 7fd2912f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c3610 con 0x7fd28c0c7750 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36132/0 (socket says 172.21.15.52:36132) 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 -- 172.21.15.52:0/2231888403 learned_addr learned my addr 172.21.15.52:0/2231888403 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd290af0700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0c7750 0x7fd28c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28b7fe700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 0x7fd28c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 -- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0c7750 msgr2=0x7fd28c0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0c7750 0x7fd28c0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 -- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 msgr2=0x7fd28c0ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 0x7fd28c0ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 -- 172.21.15.52:0/2231888403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0092a0 con 0x7fd28c0ad250 2023-05-10T01:25:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28b7fe700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 0x7fd28c0ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd28bfff700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fd27c00ea50 tx=0x7fd27c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00c850 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00c9b0 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd284009ae0 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00cd30 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.388+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c0c2fc0 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.389+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c047150 con 0x7fd28c0ad250 2023-05-10T01:25:01.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.390+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd27c022070 con 0x7fd28c0ad250 2023-05-10T01:25:01.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.390+0000 7fd283fff700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 0x7fd270061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:01.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.390+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fd27c07a070 con 0x7fd28c0ad250 2023-05-10T01:25:01.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.390+0000 7fd28b7fe700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 0x7fd270061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:01.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.391+0000 7fd28b7fe700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 0x7fd270061220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd28c0afd90 tx=0x7fd274009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:01.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.394+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd27c04b500 con 0x7fd28c0ad250 2023-05-10T01:25:01.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.565+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd28c158030 con 0x7fd27005ed60 2023-05-10T01:25:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.575+0000 7fd283fff700 1 -- 172.21.15.52:0/2231888403 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355961 (secure 0 0 0) 0x7fd28c158030 con 0x7fd27005ed60 2023-05-10T01:25:01.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 msgr2=0x7fd270061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 0x7fd270061220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd28c0afd90 tx=0x7fd274009040).stop 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 msgr2=0x7fd28c151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fd27c00ea50 tx=0x7fd27c009060).stop 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 shutdown_connections 2023-05-10T01:25:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd27005ed60 0x7fd270061220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd28c0c7750 0x7fd28c0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd28c0ad250 0x7fd28c151340 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 --2- 172.21.15.52:0/2231888403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd28c0c7370 0x7fd28c0ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 >> 172.21.15.52:0/2231888403 conn(0x7fd28c068320 msgr2=0x7fd28c0acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 shutdown_connections 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:01.578+0000 7fd2912f1700 1 -- 172.21.15.52:0/2231888403 wait complete. 2023-05-10T01:25:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:01.594 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:00.093948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151376,"kb_used_data":8784,"kb_used_omap":0,"kb_used_meta":142528,"kb_avail":754823344,"statfs":{"total":773094113280,"available":772939104256,"internally_reserved":0,"allocated":8994816,"data_stored":4504595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":145948672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10438,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.425449"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632723+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050574+0000","last_change":"2023-05-10T01:24:56.048111+0000","last_active":"2023-05-10T01:24:56.050574+0000","last_peered":"2023-05-10T01:24:56.050574+0000","last_clean":"2023-05-10T01:24:56.050574+0000","last_became_active":"2023-05-10T01:24:56.047583+0000","last_became_peered":"2023-05-10T01:24:56.047583+0000","last_unstale":"2023-05-10T01:24:56.050574+0000","last_undegraded":"2023-05-10T01:24:56.050574+0000","last_fullsized":"2023-05-10T01:24:56.050574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037524+0000","last_change":"2023-05-10T01:24:55.647532+0000","last_active":"2023-05-10T01:24:56.037524+0000","last_peered":"2023-05-10T01:24:56.037524+0000","last_clean":"2023-05-10T01:24:56.037524+0000","last_became_active":"2023-05-10T01:24:55.647238+0000","last_became_peered":"2023-05-10T01:24:55.647238+0000","last_unstale":"2023-05-10T01:24:56.037524+0000","last_undegraded":"2023-05-10T01:24:56.037524+0000","last_fullsized":"2023-05-10T01:24:56.037524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065020+0000","last_change":"2023-05-10T01:24:55.654314+0000","last_active":"2023-05-10T01:24:56.065020+0000","last_peered":"2023-05-10T01:24:56.065020+0000","last_clean":"2023-05-10T01:24:56.065020+0000","last_became_active":"2023-05-10T01:24:55.654046+0000","last_became_peered":"2023-05-10T01:24:55.654046+0000","last_unstale":"2023-05-10T01:24:56.065020+0000","last_undegraded":"2023-05-10T01:24:56.065020+0000","last_fullsized":"2023-05-10T01:24:56.065020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630239+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065494+0000","last_change":"2023-05-10T01:24:56.059027+0000","last_active":"2023-05-10T01:24:56.065494+0000","last_peered":"2023-05-10T01:24:56.065494+0000","last_clean":"2023-05-10T01:24:56.065494+0000","last_became_active":"2023-05-10T01:24:56.058584+0000","last_became_peered":"2023-05-10T01:24:56.058584+0000","last_unstale":"2023-05-10T01:24:56.065494+0000","last_undegraded":"2023-05-10T01:24:56.065494+0000","last_fullsized":"2023-05-10T01:24:56.065494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633217+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050134+0000","last_change":"2023-05-10T01:24:56.045422+0000","last_active":"2023-05-10T01:24:56.050134+0000","last_peered":"2023-05-10T01:24:56.050134+0000","last_clean":"2023-05-10T01:24:56.050134+0000","last_became_active":"2023-05-10T01:24:56.045185+0000","last_became_peered":"2023-05-10T01:24:56.045185+0000","last_unstale":"2023-05-10T01:24:56.050134+0000","last_undegraded":"2023-05-10T01:24:56.050134+0000","last_fullsized":"2023-05-10T01:24:56.050134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634919+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.630197+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064611+0000","last_change":"2023-05-10T01:24:56.062117+0000","last_active":"2023-05-10T01:24:56.064611+0000","last_peered":"2023-05-10T01:24:56.064611+0000","last_clean":"2023-05-10T01:24:56.064611+0000","last_became_active":"2023-05-10T01:24:56.061816+0000","last_became_peered":"2023-05-10T01:24:56.061816+0000","last_unstale":"2023-05-10T01:24:56.064611+0000","last_undegraded":"2023-05-10T01:24:56.064611+0000","last_fullsized":"2023-05-10T01:24:56.064611+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635263+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050589+0000","last_change":"2023-05-10T01:24:56.048238+0000","last_active":"2023-05-10T01:24:56.050589+0000","last_peered":"2023-05-10T01:24:56.050589+0000","last_clean":"2023-05-10T01:24:56.050589+0000","last_became_active":"2023-05-10T01:24:56.047840+0000","last_became_peered":"2023-05-10T01:24:56.047840+0000","last_unstale":"2023-05-10T01:24:56.050589+0000","last_undegraded":"2023-05-10T01:24:56.050589+0000","last_fullsized":"2023-05-10T01:24:56.050589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.639129+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.068060+0000","last_change":"2023-05-10T01:24:55.659712+0000","last_active":"2023-05-10T01:24:56.068060+0000","last_peered":"2023-05-10T01:24:56.068060+0000","last_clean":"2023-05-10T01:24:56.068060+0000","last_became_active":"2023-05-10T01:24:55.659428+0000","last_became_peered":"2023-05-10T01:24:55.659428+0000","last_unstale":"2023-05-10T01:24:56.068060+0000","last_undegraded":"2023-05-10T01:24:56.068060+0000","last_fullsized":"2023-05-10T01:24:56.068060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046970+0000","last_change":"2023-05-10T01:24:55.663646+0000","last_active":"2023-05-10T01:24:56.046970+0000","last_peered":"2023-05-10T01:24:56.046970+0000","last_clean":"2023-05-10T01:24:56.046970+0000","last_became_active":"2023-05-10T01:24:55.663255+0000","last_became_peered":"2023-05-10T01:24:55.663255+0000","last_unstale":"2023-05-10T01:24:56.046970+0000","last_undegraded":"2023-05-10T01:24:56.046970+0000","last_fullsized":"2023-05-10T01:24:56.046970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050293+0000","last_change":"2023-05-10T01:24:56.046677+0000","last_active":"2023-05-10T01:24:56.050293+0000","last_peered":"2023-05-10T01:24:56.050293+0000","last_clean":"2023-05-10T01:24:56.050293+0000","last_became_active":"2023-05-10T01:24:56.046391+0000","last_became_peered":"2023-05-10T01:24:56.046391+0000","last_unstale":"2023-05-10T01:24:56.050293+0000","last_undegraded":"2023-05-10T01:24:56.050293+0000","last_fullsized":"2023-05-10T01:24:56.050293+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629629+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034505+0000","last_change":"2023-05-10T01:24:55.657750+0000","last_active":"2023-05-10T01:24:56.034505+0000","last_peered":"2023-05-10T01:24:56.034505+0000","last_clean":"2023-05-10T01:24:56.034505+0000","last_became_active":"2023-05-10T01:24:55.657454+0000","last_became_peered":"2023-05-10T01:24:55.657454+0000","last_unstale":"2023-05-10T01:24:56.034505+0000","last_undegraded":"2023-05-10T01:24:56.034505+0000","last_fullsized":"2023-05-10T01:24:56.034505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635214+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050280+0000","last_change":"2023-05-10T01:24:56.047827+0000","last_active":"2023-05-10T01:24:56.050280+0000","last_peered":"2023-05-10T01:24:56.050280+0000","last_clean":"2023-05-10T01:24:56.050280+0000","last_became_active":"2023-05-10T01:24:56.047615+0000","last_became_peered":"2023-05-10T01:24:56.047615+0000","last_unstale":"2023-05-10T01:24:56.050280+0000","last_undegraded":"2023-05-10T01:24:56.050280+0000","last_fullsized":"2023-05-10T01:24:56.050280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629863+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.044991+0000","last_change":"2023-05-10T01:24:55.654917+0000","last_active":"2023-05-10T01:24:56.044991+0000","last_peered":"2023-05-10T01:24:56.044991+0000","last_clean":"2023-05-10T01:24:56.044991+0000","last_became_active":"2023-05-10T01:24:55.654637+0000","last_became_peered":"2023-05-10T01:24:55.654637+0000","last_unstale":"2023-05-10T01:24:56.044991+0000","last_undegraded":"2023-05-10T01:24:56.044991+0000","last_fullsized":"2023-05-10T01:24:56.044991+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635547+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033317+0000","last_change":"2023-05-10T01:24:55.651999+0000","last_active":"2023-05-10T01:24:56.033317+0000","last_peered":"2023-05-10T01:24:56.033317+0000","last_clean":"2023-05-10T01:24:56.033317+0000","last_became_active":"2023-05-10T01:24:55.651696+0000","last_became_peered":"2023-05-10T01:24:55.651696+0000","last_unstale":"2023-05-10T01:24:56.033317+0000","last_undegraded":"2023-05-10T01:24:56.033317+0000","last_fullsized":"2023-05-10T01:24:56.033317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635042+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064476+0000","last_change":"2023-05-10T01:24:56.058603+0000","last_active":"2023-05-10T01:24:56.064476+0000","last_peered":"2023-05-10T01:24:56.064476+0000","last_clean":"2023-05-10T01:24:56.064476+0000","last_became_active":"2023-05-10T01:24:56.057445+0000","last_became_peered":"2023-05-10T01:24:56.057445+0000","last_unstale":"2023-05-10T01:24:56.064476+0000","last_undegraded":"2023-05-10T01:24:56.064476+0000","last_fullsized":"2023-05-10T01:24:56.064476+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633384+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065682+0000","last_change":"2023-05-10T01:24:56.063709+0000","last_active":"2023-05-10T01:24:56.065682+0000","last_peered":"2023-05-10T01:24:56.065682+0000","last_clean":"2023-05-10T01:24:56.065682+0000","last_became_active":"2023-05-10T01:24:56.063193+0000","last_became_peered":"2023-05-10T01:24:56.063193+0000","last_unstale":"2023-05-10T01:24:56.065682+0000","last_undegraded":"2023-05-10T01:24:56.065682+0000","last_fullsized":"2023-05-10T01:24:56.065682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635215+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632964+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061050+0000","last_change":"2023-05-10T01:24:56.058000+0000","last_active":"2023-05-10T01:24:56.061050+0000","last_peered":"2023-05-10T01:24:56.061050+0000","last_clean":"2023-05-10T01:24:56.061050+0000","last_became_active":"2023-05-10T01:24:56.057743+0000","last_became_peered":"2023-05-10T01:24:56.057743+0000","last_unstale":"2023-05-10T01:24:56.061050+0000","last_undegraded":"2023-05-10T01:24:56.061050+0000","last_fullsized":"2023-05-10T01:24:56.061050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634364+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037613+0000","last_change":"2023-05-10T01:24:55.646476+0000","last_active":"2023-05-10T01:24:56.037613+0000","last_peered":"2023-05-10T01:24:56.037613+0000","last_clean":"2023-05-10T01:24:56.037613+0000","last_became_active":"2023-05-10T01:24:55.645582+0000","last_became_peered":"2023-05-10T01:24:55.645582+0000","last_unstale":"2023-05-10T01:24:56.037613+0000","last_undegraded":"2023-05-10T01:24:56.037613+0000","last_fullsized":"2023-05-10T01:24:56.037613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047731+0000","last_change":"2023-05-10T01:24:56.043316+0000","last_active":"2023-05-10T01:24:56.047731+0000","last_peered":"2023-05-10T01:24:56.047731+0000","last_clean":"2023-05-10T01:24:56.047731+0000","last_became_active":"2023-05-10T01:24:56.043070+0000","last_became_peered":"2023-05-10T01:24:56.043070+0000","last_unstale":"2023-05-10T01:24:56.047731+0000","last_undegraded":"2023-05-10T01:24:56.047731+0000","last_fullsized":"2023-05-10T01:24:56.047731+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632550+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039184+0000","last_change":"2023-05-10T01:24:55.649801+0000","last_active":"2023-05-10T01:24:56.039184+0000","last_peered":"2023-05-10T01:24:56.039184+0000","last_clean":"2023-05-10T01:24:56.039184+0000","last_became_active":"2023-05-10T01:24:55.649477+0000","last_became_peered":"2023-05-10T01:24:55.649477+0000","last_unstale":"2023-05-10T01:24:56.039184+0000","last_undegraded":"2023-05-10T01:24:56.039184+0000","last_fullsized":"2023-05-10T01:24:56.039184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.634123+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633874+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.059720+0000","last_change":"2023-05-10T01:24:56.057801+0000","last_active":"2023-05-10T01:24:56.059720+0000","last_peered":"2023-05-10T01:24:56.059720+0000","last_clean":"2023-05-10T01:24:56.059720+0000","last_became_active":"2023-05-10T01:24:56.057522+0000","last_became_peered":"2023-05-10T01:24:56.057522+0000","last_unstale":"2023-05-10T01:24:56.059720+0000","last_undegraded":"2023-05-10T01:24:56.059720+0000","last_fullsized":"2023-05-10T01:24:56.059720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633802+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062976+0000","last_change":"2023-05-10T01:24:56.058137+0000","last_active":"2023-05-10T01:24:56.062976+0000","last_peered":"2023-05-10T01:24:56.062976+0000","last_clean":"2023-05-10T01:24:56.062976+0000","last_became_active":"2023-05-10T01:24:56.057875+0000","last_became_peered":"2023-05-10T01:24:56.057875+0000","last_unstale":"2023-05-10T01:24:56.062976+0000","last_undegraded":"2023-05-10T01:24:56.062976+0000","last_fullsized":"2023-05-10T01:24:56.062976+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629516+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055527+0000","last_change":"2023-05-10T01:24:56.053505+0000","last_active":"2023-05-10T01:24:56.055527+0000","last_peered":"2023-05-10T01:24:56.055527+0000","last_clean":"2023-05-10T01:24:56.055527+0000","last_became_active":"2023-05-10T01:24:56.053233+0000","last_became_peered":"2023-05-10T01:24:56.053233+0000","last_unstale":"2023-05-10T01:24:56.055527+0000","last_undegraded":"2023-05-10T01:24:56.055527+0000","last_fullsized":"2023-05-10T01:24:56.055527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635805+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.638770+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633813+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050141+0000","last_change":"2023-05-10T01:24:56.047177+0000","last_active":"2023-05-10T01:24:56.050141+0000","last_peered":"2023-05-10T01:24:56.050141+0000","last_clean":"2023-05-10T01:24:56.050141+0000","last_became_active":"2023-05-10T01:24:56.046949+0000","last_became_peered":"2023-05-10T01:24:56.046949+0000","last_unstale":"2023-05-10T01:24:56.050141+0000","last_undegraded":"2023-05-10T01:24:56.050141+0000","last_fullsized":"2023-05-10T01:24:56.050141+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632058+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050278+0000","last_change":"2023-05-10T01:24:56.046565+0000","last_active":"2023-05-10T01:24:56.050278+0000","last_peered":"2023-05-10T01:24:56.050278+0000","last_clean":"2023-05-10T01:24:56.050278+0000","last_became_active":"2023-05-10T01:24:56.046141+0000","last_became_peered":"2023-05-10T01:24:56.046141+0000","last_unstale":"2023-05-10T01:24:56.050278+0000","last_undegraded":"2023-05-10T01:24:56.050278+0000","last_fullsized":"2023-05-10T01:24:56.050278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633639+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032918+0000","last_change":"2023-05-10T01:24:55.648375+0000","last_active":"2023-05-10T01:24:56.032918+0000","last_peered":"2023-05-10T01:24:56.032918+0000","last_clean":"2023-05-10T01:24:56.032918+0000","last_became_active":"2023-05-10T01:24:55.648061+0000","last_became_peered":"2023-05-10T01:24:55.648061+0000","last_unstale":"2023-05-10T01:24:56.032918+0000","last_undegraded":"2023-05-10T01:24:56.032918+0000","last_fullsized":"2023-05-10T01:24:56.032918+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629170+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050747+0000","last_change":"2023-05-10T01:24:56.049666+0000","last_active":"2023-05-10T01:24:56.050747+0000","last_peered":"2023-05-10T01:24:56.050747+0000","last_clean":"2023-05-10T01:24:56.050747+0000","last_became_active":"2023-05-10T01:24:56.049373+0000","last_became_peered":"2023-05-10T01:24:56.049373+0000","last_unstale":"2023-05-10T01:24:56.050747+0000","last_undegraded":"2023-05-10T01:24:56.050747+0000","last_fullsized":"2023-05-10T01:24:56.050747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636347+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633929+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065427+0000","last_change":"2023-05-10T01:24:56.063242+0000","last_active":"2023-05-10T01:24:56.065427+0000","last_peered":"2023-05-10T01:24:56.065427+0000","last_clean":"2023-05-10T01:24:56.065427+0000","last_became_active":"2023-05-10T01:24:56.062420+0000","last_became_peered":"2023-05-10T01:24:56.062420+0000","last_unstale":"2023-05-10T01:24:56.065427+0000","last_undegraded":"2023-05-10T01:24:56.065427+0000","last_fullsized":"2023-05-10T01:24:56.065427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629674+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065465+0000","last_change":"2023-05-10T01:24:56.060743+0000","last_active":"2023-05-10T01:24:56.065465+0000","last_peered":"2023-05-10T01:24:56.065465+0000","last_clean":"2023-05-10T01:24:56.065465+0000","last_became_active":"2023-05-10T01:24:56.060405+0000","last_became_peered":"2023-05-10T01:24:56.060405+0000","last_unstale":"2023-05-10T01:24:56.065465+0000","last_undegraded":"2023-05-10T01:24:56.065465+0000","last_fullsized":"2023-05-10T01:24:56.065465+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632747+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633758+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635696+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629153+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.054595+0000","last_change":"2023-05-10T01:24:55.651683+0000","last_active":"2023-05-10T01:24:56.054595+0000","last_peered":"2023-05-10T01:24:56.054595+0000","last_clean":"2023-05-10T01:24:56.054595+0000","last_became_active":"2023-05-10T01:24:55.651369+0000","last_became_peered":"2023-05-10T01:24:55.651369+0000","last_unstale":"2023-05-10T01:24:56.054595+0000","last_undegraded":"2023-05-10T01:24:56.054595+0000","last_fullsized":"2023-05-10T01:24:56.054595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633581+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032868+0000","last_change":"2023-05-10T01:24:55.657774+0000","last_active":"2023-05-10T01:24:56.032868+0000","last_peered":"2023-05-10T01:24:56.032868+0000","last_clean":"2023-05-10T01:24:56.032868+0000","last_became_active":"2023-05-10T01:24:55.657505+0000","last_became_peered":"2023-05-10T01:24:55.657505+0000","last_unstale":"2023-05-10T01:24:56.032868+0000","last_undegraded":"2023-05-10T01:24:56.032868+0000","last_fullsized":"2023-05-10T01:24:56.032868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.637705+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050720+0000","last_change":"2023-05-10T01:24:56.048800+0000","last_active":"2023-05-10T01:24:56.050720+0000","last_peered":"2023-05-10T01:24:56.050720+0000","last_clean":"2023-05-10T01:24:56.050720+0000","last_became_active":"2023-05-10T01:24:56.048552+0000","last_became_peered":"2023-05-10T01:24:56.048552+0000","last_unstale":"2023-05-10T01:24:56.050720+0000","last_undegraded":"2023-05-10T01:24:56.050720+0000","last_fullsized":"2023-05-10T01:24:56.050720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.636045+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632659+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629186+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063523+0000","last_change":"2023-05-10T01:24:56.058327+0000","last_active":"2023-05-10T01:24:56.063523+0000","last_peered":"2023-05-10T01:24:56.063523+0000","last_clean":"2023-05-10T01:24:56.063523+0000","last_became_active":"2023-05-10T01:24:56.057358+0000","last_became_peered":"2023-05-10T01:24:56.057358+0000","last_unstale":"2023-05-10T01:24:56.063523+0000","last_undegraded":"2023-05-10T01:24:56.063523+0000","last_fullsized":"2023-05-10T01:24:56.063523+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.633187+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060280+0000","last_change":"2023-05-10T01:24:56.048343+0000","last_active":"2023-05-10T01:24:56.060280+0000","last_peered":"2023-05-10T01:24:56.060280+0000","last_clean":"2023-05-10T01:24:56.060280+0000","last_became_active":"2023-05-10T01:24:56.048071+0000","last_became_peered":"2023-05-10T01:24:56.048071+0000","last_unstale":"2023-05-10T01:24:56.060280+0000","last_undegraded":"2023-05-10T01:24:56.060280+0000","last_fullsized":"2023-05-10T01:24:56.060280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037538+0000","last_change":"2023-05-10T01:24:55.649514+0000","last_active":"2023-05-10T01:24:56.037538+0000","last_peered":"2023-05-10T01:24:56.037538+0000","last_clean":"2023-05-10T01:24:56.037538+0000","last_became_active":"2023-05-10T01:24:55.649230+0000","last_became_peered":"2023-05-10T01:24:55.649230+0000","last_unstale":"2023-05-10T01:24:56.037538+0000","last_undegraded":"2023-05-10T01:24:56.037538+0000","last_fullsized":"2023-05-10T01:24:56.037538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.629201+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043824+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:56.043824+0000","last_peered":"2023-05-10T01:24:56.043824+0000","last_clean":"2023-05-10T01:24:56.043824+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:56.043824+0000","last_undegraded":"2023-05-10T01:24:56.043824+0000","last_fullsized":"2023-05-10T01:24:56.043824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064619+0000","last_change":"2023-05-10T01:24:56.060432+0000","last_active":"2023-05-10T01:24:56.064619+0000","last_peered":"2023-05-10T01:24:56.064619+0000","last_clean":"2023-05-10T01:24:56.064619+0000","last_became_active":"2023-05-10T01:24:56.060141+0000","last_became_peered":"2023-05-10T01:24:56.060141+0000","last_unstale":"2023-05-10T01:24:56.064619+0000","last_undegraded":"2023-05-10T01:24:56.064619+0000","last_fullsized":"2023-05-10T01:24:56.064619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062086+0000","last_change":"2023-05-10T01:24:55.646775+0000","last_active":"2023-05-10T01:24:56.062086+0000","last_peered":"2023-05-10T01:24:56.062086+0000","last_clean":"2023-05-10T01:24:56.062086+0000","last_became_active":"2023-05-10T01:24:55.646471+0000","last_became_peered":"2023-05-10T01:24:55.646471+0000","last_unstale":"2023-05-10T01:24:56.062086+0000","last_undegraded":"2023-05-10T01:24:56.062086+0000","last_fullsized":"2023-05-10T01:24:56.062086+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343084+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:53.343084+0000","last_peered":"2023-05-10T01:24:53.343084+0000","last_clean":"2023-05-10T01:24:53.343084+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:53.343084+0000","last_undegraded":"2023-05-10T01:24:53.343084+0000","last_fullsized":"2023-05-10T01:24:53.343084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042275+0000","last_change":"2023-05-10T01:24:55.652850+0000","last_active":"2023-05-10T01:24:56.042275+0000","last_peered":"2023-05-10T01:24:56.042275+0000","last_clean":"2023-05-10T01:24:56.042275+0000","last_became_active":"2023-05-10T01:24:55.652528+0000","last_became_peered":"2023-05-10T01:24:55.652528+0000","last_unstale":"2023-05-10T01:24:56.042275+0000","last_undegraded":"2023-05-10T01:24:56.042275+0000","last_fullsized":"2023-05-10T01:24:56.042275+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.095513+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:53.095513+0000","last_peered":"2023-05-10T01:24:53.095513+0000","last_clean":"2023-05-10T01:24:53.095513+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:53.095513+0000","last_undegraded":"2023-05-10T01:24:53.095513+0000","last_fullsized":"2023-05-10T01:24:53.095513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.041216+0000","last_change":"2023-05-10T01:24:55.652884+0000","last_active":"2023-05-10T01:24:56.041216+0000","last_peered":"2023-05-10T01:24:56.041216+0000","last_clean":"2023-05-10T01:24:56.041216+0000","last_became_active":"2023-05-10T01:24:55.652548+0000","last_became_peered":"2023-05-10T01:24:55.652548+0000","last_unstale":"2023-05-10T01:24:56.041216+0000","last_undegraded":"2023-05-10T01:24:56.041216+0000","last_fullsized":"2023-05-10T01:24:56.041216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343113+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:53.343113+0000","last_peered":"2023-05-10T01:24:53.343113+0000","last_clean":"2023-05-10T01:24:53.343113+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:53.343113+0000","last_undegraded":"2023-05-10T01:24:53.343113+0000","last_fullsized":"2023-05-10T01:24:53.343113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343193+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:53.343193+0000","last_peered":"2023-05-10T01:24:53.343193+0000","last_clean":"2023-05-10T01:24:53.343193+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:53.343193+0000","last_undegraded":"2023-05-10T01:24:53.343193+0000","last_fullsized":"2023-05-10T01:24:53.343193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045366+0000","last_change":"2023-05-10T01:24:56.043832+0000","last_active":"2023-05-10T01:24:56.045366+0000","last_peered":"2023-05-10T01:24:56.045366+0000","last_clean":"2023-05-10T01:24:56.045366+0000","last_became_active":"2023-05-10T01:24:56.043569+0000","last_became_peered":"2023-05-10T01:24:56.043569+0000","last_unstale":"2023-05-10T01:24:56.045366+0000","last_undegraded":"2023-05-10T01:24:56.045366+0000","last_fullsized":"2023-05-10T01:24:56.045366+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.036644+0000","last_change":"2023-05-10T01:24:55.653598+0000","last_active":"2023-05-10T01:24:56.036644+0000","last_peered":"2023-05-10T01:24:56.036644+0000","last_clean":"2023-05-10T01:24:56.036644+0000","last_became_active":"2023-05-10T01:24:55.653218+0000","last_became_peered":"2023-05-10T01:24:55.653218+0000","last_unstale":"2023-05-10T01:24:56.036644+0000","last_undegraded":"2023-05-10T01:24:56.036644+0000","last_fullsized":"2023-05-10T01:24:56.036644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343220+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:53.343220+0000","last_peered":"2023-05-10T01:24:53.343220+0000","last_clean":"2023-05-10T01:24:53.343220+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:53.343220+0000","last_undegraded":"2023-05-10T01:24:53.343220+0000","last_fullsized":"2023-05-10T01:24:53.343220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064382+0000","last_change":"2023-05-10T01:24:56.057487+0000","last_active":"2023-05-10T01:24:56.064382+0000","last_peered":"2023-05-10T01:24:56.064382+0000","last_clean":"2023-05-10T01:24:56.064382+0000","last_became_active":"2023-05-10T01:24:56.057170+0000","last_became_peered":"2023-05-10T01:24:56.057170+0000","last_unstale":"2023-05-10T01:24:56.064382+0000","last_undegraded":"2023-05-10T01:24:56.064382+0000","last_fullsized":"2023-05-10T01:24:56.064382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043736+0000","last_change":"2023-05-10T01:24:55.659797+0000","last_active":"2023-05-10T01:24:56.043736+0000","last_peered":"2023-05-10T01:24:56.043736+0000","last_clean":"2023-05-10T01:24:56.043736+0000","last_became_active":"2023-05-10T01:24:55.659374+0000","last_became_peered":"2023-05-10T01:24:55.659374+0000","last_unstale":"2023-05-10T01:24:56.043736+0000","last_undegraded":"2023-05-10T01:24:56.043736+0000","last_fullsized":"2023-05-10T01:24:56.043736+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:53.343158+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:53.343158+0000","last_peered":"2023-05-10T01:24:53.343158+0000","last_clean":"2023-05-10T01:24:53.343158+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:53.343158+0000","last_undegraded":"2023-05-10T01:24:53.343158+0000","last_fullsized":"2023-05-10T01:24:53.343158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064683+0000","last_change":"2023-05-10T01:24:56.058212+0000","last_active":"2023-05-10T01:24:56.064683+0000","last_peered":"2023-05-10T01:24:56.064683+0000","last_clean":"2023-05-10T01:24:56.064683+0000","last_became_active":"2023-05-10T01:24:56.057943+0000","last_became_peered":"2023-05-10T01:24:56.057943+0000","last_unstale":"2023-05-10T01:24:56.064683+0000","last_undegraded":"2023-05-10T01:24:56.064683+0000","last_fullsized":"2023-05-10T01:24:56.064683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.635939+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045083+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:56.045083+0000","last_peered":"2023-05-10T01:24:56.045083+0000","last_clean":"2023-05-10T01:24:56.045083+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:56.045083+0000","last_undegraded":"2023-05-10T01:24:56.045083+0000","last_fullsized":"2023-05-10T01:24:56.045083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:24:55.627026+0000","last_change":"2023-05-10T01:24:55.627026+0000","last_active":"2023-05-10T01:24:55.627026+0000","last_peered":"2023-05-10T01:24:55.627026+0000","last_clean":"2023-05-10T01:24:55.627026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:55.627026+0000","last_undegraded":"2023-05-10T01:24:55.627026+0000","last_fullsized":"2023-05-10T01:24:55.627026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:24:54.625067+0000","last_change":"2023-05-10T01:24:54.632127+0000","last_active":"2023-05-10T01:24:54.625067+0000","last_peered":"2023-05-10T01:24:54.625067+0000","last_clean":"2023-05-10T01:24:54.625067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:24:54.625067+0000","last_undegraded":"2023-05-10T01:24:54.625067+0000","last_fullsized":"2023-05-10T01:24:54.625067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-05-10T01:24:52.795226+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:52.795226+0000","last_peered":"2023-05-10T01:24:52.795226+0000","last_clean":"2023-05-10T01:24:52.795226+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:52.795226+0000","last_undegraded":"2023-05-10T01:24:52.795226+0000","last_fullsized":"2023-05-10T01:24:52.795226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17336,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":94354504,"statfs":{"total":96636764160,"available":96619012096,"internally_reserved":0,"allocated":1097728,"data_stored":549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.436}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.504},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575028,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16644,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15552,"kb_avail":94355196,"statfs":{"total":96636764160,"available":96619720704,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15925248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.433},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.502}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20856,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":19712,"kb_avail":94350984,"statfs":{"total":96636764160,"available":96615407616,"internally_reserved":0,"allocated":1163264,"data_stored":578171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20185088},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.255}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16616,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355224,"statfs":{"total":96636764160,"available":96619749376,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.313}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.37}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.61199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17732,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94354108,"statfs":{"total":96636764160,"available":96618606592,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.307},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.40300000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24936,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94346904,"statfs":{"total":96636764160,"available":96611229696,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.34200000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16964,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":15872,"kb_avail":94354876,"statfs":{"total":96636764160,"available":96619393024,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16252928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20292,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":19200,"kb_avail":94351548,"statfs":{"total":96636764160,"available":96615985152,"internally_reserved":0,"allocated":1110016,"data_stored":555743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19660800},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.495}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:01.868 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:25:01.865+0000 7fe12f80d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:25:04.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:04.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 Processor -- start 2023-05-10T01:25:04.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 -- start start 2023-05-10T01:25:04.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe5e4153ea0 0x7fe5e4154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 0x7fe5e4065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e4067550 con 0x7fe5e4068c60 2023-05-10T01:25:04.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e4065960 con 0x7fe5e4153ea0 2023-05-10T01:25:04.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.733+0000 7fe5e9a61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40bc9a0 con 0x7fe5e4064ff0 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e27fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5e4068c60 0x7fe5e4066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45160/0 (socket says 172.21.15.52:45160) 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e27fc700 1 -- 172.21.15.52:0/25717126 learned_addr learned my addr 172.21.15.52:0/25717126 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/25717126 >> v2:172.21.15.172:3300/0 conn(0x7fe5e4153ea0 0x7fe5e4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e37fe700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 0x7fe5e4065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377447021 0 0) 0x7fe5cc001490 con 0x7fe5e4068c60 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c40033f0 con 0x7fe5e4068c60 2023-05-10T01:25:04.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3897965758 0 0) 0x7fe5c40033f0 con 0x7fe5e4068c60 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 -- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 msgr2=0x7fe5e4065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 0x7fe5e4065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 -- 172.21.15.52:0/25717126 >> v1:172.21.15.52:6789/0 conn(0x7fe5e4068c60 legacy=0x7fe5e4066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 -- 172.21.15.52:0/25717126 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40bcc80 con 0x7fe5e4153ea0 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e37fe700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 0x7fe5e4065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:04.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.734+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4153ea0 0x7fe5e4154280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe5dc009760 tx=0x7fe5dc009060).ready entity=mon.1 client_cookie=d135e9a190269445 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:04.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc001980 con 0x7fe5e4153ea0 2023-05-10T01:25:04.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc011400 con 0x7fe5e4153ea0 2023-05-10T01:25:04.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e1ffb700 1 -- 172.21.15.52:0/25717126 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc011780 con 0x7fe5e4153ea0 2023-05-10T01:25:04.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 -- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4153ea0 msgr2=0x7fe5e4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4153ea0 0x7fe5e4154280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe5dc009760 tx=0x7fe5dc009060).stop 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 -- 172.21.15.52:0/25717126 shutdown_connections 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e4064ff0 0x7fe5e4065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/25717126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4153ea0 0x7fe5e4154280 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 -- 172.21.15.52:0/25717126 >> 172.21.15.52:0/25717126 conn(0x7fe5e40c4420 msgr2=0x7fe5e40c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 -- 172.21.15.52:0/25717126 shutdown_connections 2023-05-10T01:25:04.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.735+0000 7fe5e9a61700 1 -- 172.21.15.52:0/25717126 wait complete. 2023-05-10T01:25:04.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 Processor -- start 2023-05-10T01:25:04.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 -- start start 2023-05-10T01:25:04.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 0x7fe5e415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 0x7fe5e40a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40bf870 con 0x7fe5e4153ea0 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c1d80 con 0x7fe5e4064ff0 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.737+0000 7fe5e9a61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40bec60 con 0x7fe5e40c1900 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36148/0 (socket says 172.21.15.52:36148) 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 -- 172.21.15.52:0/3267514371 learned_addr learned my addr 172.21.15.52:0/3267514371 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:04.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e37fe700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 0x7fe5e40a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 0x7fe5e415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 -- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 msgr2=0x7fe5e40a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 0x7fe5e40a9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 -- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 msgr2=0x7fe5e415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 0x7fe5e415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 -- 172.21.15.52:0/3267514371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40092a0 con 0x7fe5e4153ea0 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 0x7fe5e415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:04.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e37fe700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 0x7fe5e40a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e27fc700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fe5cc00cb70 tx=0x7fe5cc0017d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc004c40 con 0x7fe5e4153ea0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc004da0 con 0x7fe5e4153ea0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc0092a0 con 0x7fe5e4153ea0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0073a0 con 0x7fe5e4153ea0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.738+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e40bf220 con 0x7fe5e4153ea0 2023-05-10T01:25:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.739+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e40bf9e0 con 0x7fe5e4153ea0 2023-05-10T01:25:04.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.740+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe5cc01b060 con 0x7fe5e4153ea0 2023-05-10T01:25:04.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.740+0000 7fe5daffd700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:04.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.740+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe5cc079a00 con 0x7fe5e4153ea0 2023-05-10T01:25:04.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.740+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:04.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.741+0000 7fe5e2ffd700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 0x7fe5c8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe5dc009760 tx=0x7fe5dc016000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:04.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.745+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5cc04ae90 con 0x7fe5e4153ea0 2023-05-10T01:25:04.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.913+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5e4067550 con 0x7fe5c805ed90 2023-05-10T01:25:04.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.924+0000 7fe5daffd700 1 -- 172.21.15.52:0/3267514371 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361403 (secure 0 0 0) 0x7fe5e4067550 con 0x7fe5c805ed90 2023-05-10T01:25:04.931 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:04.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 msgr2=0x7fe5c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 0x7fe5c8061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe5dc009760 tx=0x7fe5dc016000).stop 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 msgr2=0x7fe5e40c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fe5cc00cb70 tx=0x7fe5cc0017d0).stop 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 shutdown_connections 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe5c805ed90 0x7fe5c8061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5e40c1900 0x7fe5e40a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e4064ff0 0x7fe5e415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 --2- 172.21.15.52:0/3267514371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5e4153ea0 0x7fe5e40c1410 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:04.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 >> 172.21.15.52:0/3267514371 conn(0x7fe5e40c4420 msgr2=0x7fe5e40ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:04.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 shutdown_connections 2023-05-10T01:25:04.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:04.927+0000 7fe5e9a61700 1 -- 172.21.15.52:0/3267514371 wait complete. 2023-05-10T01:25:04.935 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:04.942 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:25:04.095234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":156544,"kb_used_data":9024,"kb_used_omap":0,"kb_used_meta":147456,"kb_avail":754818176,"statfs":{"total":773094113280,"available":772933812224,"internally_reserved":0,"allocated":9240576,"data_stored":4621388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":150994944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9024,"num_objects":-9,"num_object_clones":0,"num_object_copies":-18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-34,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426735"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055525+0000","last_change":"2023-05-10T01:24:56.052568+0000","last_active":"2023-05-10T01:24:56.055525+0000","last_peered":"2023-05-10T01:24:56.055525+0000","last_clean":"2023-05-10T01:24:56.055525+0000","last_became_active":"2023-05-10T01:24:56.052301+0000","last_became_peered":"2023-05-10T01:24:56.052301+0000","last_unstale":"2023-05-10T01:24:56.055525+0000","last_undegraded":"2023-05-10T01:24:56.055525+0000","last_fullsized":"2023-05-10T01:24:56.055525+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053362+0000","last_change":"2023-05-10T01:24:55.658438+0000","last_active":"2023-05-10T01:24:56.053362+0000","last_peered":"2023-05-10T01:24:56.053362+0000","last_clean":"2023-05-10T01:24:56.053362+0000","last_became_active":"2023-05-10T01:24:55.658163+0000","last_became_peered":"2023-05-10T01:24:55.658163+0000","last_unstale":"2023-05-10T01:24:56.053362+0000","last_undegraded":"2023-05-10T01:24:56.053362+0000","last_fullsized":"2023-05-10T01:24:56.053362+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055492+0000","last_change":"2023-05-10T01:24:56.050585+0000","last_active":"2023-05-10T01:24:56.055492+0000","last_peered":"2023-05-10T01:24:56.055492+0000","last_clean":"2023-05-10T01:24:56.055492+0000","last_became_active":"2023-05-10T01:24:56.050345+0000","last_became_peered":"2023-05-10T01:24:56.050345+0000","last_unstale":"2023-05-10T01:24:56.055492+0000","last_undegraded":"2023-05-10T01:24:56.055492+0000","last_fullsized":"2023-05-10T01:24:56.055492+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039879+0000","last_change":"2023-05-10T01:24:55.656567+0000","last_active":"2023-05-10T01:24:56.039879+0000","last_peered":"2023-05-10T01:24:56.039879+0000","last_clean":"2023-05-10T01:24:56.039879+0000","last_became_active":"2023-05-10T01:24:55.656297+0000","last_became_peered":"2023-05-10T01:24:55.656297+0000","last_unstale":"2023-05-10T01:24:56.039879+0000","last_undegraded":"2023-05-10T01:24:56.039879+0000","last_fullsized":"2023-05-10T01:24:56.039879+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050574+0000","last_change":"2023-05-10T01:24:56.048111+0000","last_active":"2023-05-10T01:24:56.050574+0000","last_peered":"2023-05-10T01:24:56.050574+0000","last_clean":"2023-05-10T01:24:56.050574+0000","last_became_active":"2023-05-10T01:24:56.047583+0000","last_became_peered":"2023-05-10T01:24:56.047583+0000","last_unstale":"2023-05-10T01:24:56.050574+0000","last_undegraded":"2023-05-10T01:24:56.050574+0000","last_fullsized":"2023-05-10T01:24:56.050574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037524+0000","last_change":"2023-05-10T01:24:55.647532+0000","last_active":"2023-05-10T01:24:56.037524+0000","last_peered":"2023-05-10T01:24:56.037524+0000","last_clean":"2023-05-10T01:24:56.037524+0000","last_became_active":"2023-05-10T01:24:55.647238+0000","last_became_peered":"2023-05-10T01:24:55.647238+0000","last_unstale":"2023-05-10T01:24:56.037524+0000","last_undegraded":"2023-05-10T01:24:56.037524+0000","last_fullsized":"2023-05-10T01:24:56.037524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055601+0000","last_change":"2023-05-10T01:24:56.054451+0000","last_active":"2023-05-10T01:24:56.055601+0000","last_peered":"2023-05-10T01:24:56.055601+0000","last_clean":"2023-05-10T01:24:56.055601+0000","last_became_active":"2023-05-10T01:24:56.054165+0000","last_became_peered":"2023-05-10T01:24:56.054165+0000","last_unstale":"2023-05-10T01:24:56.055601+0000","last_undegraded":"2023-05-10T01:24:56.055601+0000","last_fullsized":"2023-05-10T01:24:56.055601+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065020+0000","last_change":"2023-05-10T01:24:55.654314+0000","last_active":"2023-05-10T01:24:56.065020+0000","last_peered":"2023-05-10T01:24:56.065020+0000","last_clean":"2023-05-10T01:24:56.065020+0000","last_became_active":"2023-05-10T01:24:55.654046+0000","last_became_peered":"2023-05-10T01:24:55.654046+0000","last_unstale":"2023-05-10T01:24:56.065020+0000","last_undegraded":"2023-05-10T01:24:56.065020+0000","last_fullsized":"2023-05-10T01:24:56.065020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060671+0000","last_change":"2023-05-10T01:24:56.056912+0000","last_active":"2023-05-10T01:24:56.060671+0000","last_peered":"2023-05-10T01:24:56.060671+0000","last_clean":"2023-05-10T01:24:56.060671+0000","last_became_active":"2023-05-10T01:24:56.056572+0000","last_became_peered":"2023-05-10T01:24:56.056572+0000","last_unstale":"2023-05-10T01:24:56.060671+0000","last_undegraded":"2023-05-10T01:24:56.060671+0000","last_fullsized":"2023-05-10T01:24:56.060671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.054604+0000","last_change":"2023-05-10T01:24:55.657418+0000","last_active":"2023-05-10T01:24:56.054604+0000","last_peered":"2023-05-10T01:24:56.054604+0000","last_clean":"2023-05-10T01:24:56.054604+0000","last_became_active":"2023-05-10T01:24:55.657098+0000","last_became_peered":"2023-05-10T01:24:55.657098+0000","last_unstale":"2023-05-10T01:24:56.054604+0000","last_undegraded":"2023-05-10T01:24:56.054604+0000","last_fullsized":"2023-05-10T01:24:56.054604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065494+0000","last_change":"2023-05-10T01:24:56.059027+0000","last_active":"2023-05-10T01:24:56.065494+0000","last_peered":"2023-05-10T01:24:56.065494+0000","last_clean":"2023-05-10T01:24:56.065494+0000","last_became_active":"2023-05-10T01:24:56.058584+0000","last_became_peered":"2023-05-10T01:24:56.058584+0000","last_unstale":"2023-05-10T01:24:56.065494+0000","last_undegraded":"2023-05-10T01:24:56.065494+0000","last_fullsized":"2023-05-10T01:24:56.065494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045949+0000","last_change":"2023-05-10T01:24:55.653596+0000","last_active":"2023-05-10T01:24:56.045949+0000","last_peered":"2023-05-10T01:24:56.045949+0000","last_clean":"2023-05-10T01:24:56.045949+0000","last_became_active":"2023-05-10T01:24:55.653281+0000","last_became_peered":"2023-05-10T01:24:55.653281+0000","last_unstale":"2023-05-10T01:24:56.045949+0000","last_undegraded":"2023-05-10T01:24:56.045949+0000","last_fullsized":"2023-05-10T01:24:56.045949+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050134+0000","last_change":"2023-05-10T01:24:56.045422+0000","last_active":"2023-05-10T01:24:56.050134+0000","last_peered":"2023-05-10T01:24:56.050134+0000","last_clean":"2023-05-10T01:24:56.050134+0000","last_became_active":"2023-05-10T01:24:56.045185+0000","last_became_peered":"2023-05-10T01:24:56.045185+0000","last_unstale":"2023-05-10T01:24:56.050134+0000","last_undegraded":"2023-05-10T01:24:56.050134+0000","last_fullsized":"2023-05-10T01:24:56.050134+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046539+0000","last_change":"2023-05-10T01:24:55.654109+0000","last_active":"2023-05-10T01:24:56.046539+0000","last_peered":"2023-05-10T01:24:56.046539+0000","last_clean":"2023-05-10T01:24:56.046539+0000","last_became_active":"2023-05-10T01:24:55.653746+0000","last_became_peered":"2023-05-10T01:24:55.653746+0000","last_unstale":"2023-05-10T01:24:56.046539+0000","last_undegraded":"2023-05-10T01:24:56.046539+0000","last_fullsized":"2023-05-10T01:24:56.046539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053420+0000","last_change":"2023-05-10T01:24:56.048775+0000","last_active":"2023-05-10T01:24:56.053420+0000","last_peered":"2023-05-10T01:24:56.053420+0000","last_clean":"2023-05-10T01:24:56.053420+0000","last_became_active":"2023-05-10T01:24:56.048501+0000","last_became_peered":"2023-05-10T01:24:56.048501+0000","last_unstale":"2023-05-10T01:24:56.053420+0000","last_undegraded":"2023-05-10T01:24:56.053420+0000","last_fullsized":"2023-05-10T01:24:56.053420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042230+0000","last_change":"2023-05-10T01:24:55.648383+0000","last_active":"2023-05-10T01:24:56.042230+0000","last_peered":"2023-05-10T01:24:56.042230+0000","last_clean":"2023-05-10T01:24:56.042230+0000","last_became_active":"2023-05-10T01:24:55.648113+0000","last_became_peered":"2023-05-10T01:24:55.648113+0000","last_unstale":"2023-05-10T01:24:56.042230+0000","last_undegraded":"2023-05-10T01:24:56.042230+0000","last_fullsized":"2023-05-10T01:24:56.042230+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060650+0000","last_change":"2023-05-10T01:24:56.055671+0000","last_active":"2023-05-10T01:24:56.060650+0000","last_peered":"2023-05-10T01:24:56.060650+0000","last_clean":"2023-05-10T01:24:56.060650+0000","last_became_active":"2023-05-10T01:24:56.055393+0000","last_became_peered":"2023-05-10T01:24:56.055393+0000","last_unstale":"2023-05-10T01:24:56.060650+0000","last_undegraded":"2023-05-10T01:24:56.060650+0000","last_fullsized":"2023-05-10T01:24:56.060650+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042285+0000","last_change":"2023-05-10T01:24:55.657553+0000","last_active":"2023-05-10T01:24:56.042285+0000","last_peered":"2023-05-10T01:24:56.042285+0000","last_clean":"2023-05-10T01:24:56.042285+0000","last_became_active":"2023-05-10T01:24:55.657253+0000","last_became_peered":"2023-05-10T01:24:55.657253+0000","last_unstale":"2023-05-10T01:24:56.042285+0000","last_undegraded":"2023-05-10T01:24:56.042285+0000","last_fullsized":"2023-05-10T01:24:56.042285+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064611+0000","last_change":"2023-05-10T01:24:56.062117+0000","last_active":"2023-05-10T01:24:56.064611+0000","last_peered":"2023-05-10T01:24:56.064611+0000","last_clean":"2023-05-10T01:24:56.064611+0000","last_became_active":"2023-05-10T01:24:56.061816+0000","last_became_peered":"2023-05-10T01:24:56.061816+0000","last_unstale":"2023-05-10T01:24:56.064611+0000","last_undegraded":"2023-05-10T01:24:56.064611+0000","last_fullsized":"2023-05-10T01:24:56.064611+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034574+0000","last_change":"2023-05-10T01:24:55.659244+0000","last_active":"2023-05-10T01:24:56.034574+0000","last_peered":"2023-05-10T01:24:56.034574+0000","last_clean":"2023-05-10T01:24:56.034574+0000","last_became_active":"2023-05-10T01:24:55.658919+0000","last_became_peered":"2023-05-10T01:24:55.658919+0000","last_unstale":"2023-05-10T01:24:56.034574+0000","last_undegraded":"2023-05-10T01:24:56.034574+0000","last_fullsized":"2023-05-10T01:24:56.034574+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050589+0000","last_change":"2023-05-10T01:24:56.048238+0000","last_active":"2023-05-10T01:24:56.050589+0000","last_peered":"2023-05-10T01:24:56.050589+0000","last_clean":"2023-05-10T01:24:56.050589+0000","last_became_active":"2023-05-10T01:24:56.047840+0000","last_became_peered":"2023-05-10T01:24:56.047840+0000","last_unstale":"2023-05-10T01:24:56.050589+0000","last_undegraded":"2023-05-10T01:24:56.050589+0000","last_fullsized":"2023-05-10T01:24:56.050589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039881+0000","last_change":"2023-05-10T01:24:55.649111+0000","last_active":"2023-05-10T01:24:56.039881+0000","last_peered":"2023-05-10T01:24:56.039881+0000","last_clean":"2023-05-10T01:24:56.039881+0000","last_became_active":"2023-05-10T01:24:55.648778+0000","last_became_peered":"2023-05-10T01:24:55.648778+0000","last_unstale":"2023-05-10T01:24:56.039881+0000","last_undegraded":"2023-05-10T01:24:56.039881+0000","last_fullsized":"2023-05-10T01:24:56.039881+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064816+0000","last_change":"2023-05-10T01:24:56.061608+0000","last_active":"2023-05-10T01:24:56.064816+0000","last_peered":"2023-05-10T01:24:56.064816+0000","last_clean":"2023-05-10T01:24:56.064816+0000","last_became_active":"2023-05-10T01:24:56.060078+0000","last_became_peered":"2023-05-10T01:24:56.060078+0000","last_unstale":"2023-05-10T01:24:56.064816+0000","last_undegraded":"2023-05-10T01:24:56.064816+0000","last_fullsized":"2023-05-10T01:24:56.064816+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.068060+0000","last_change":"2023-05-10T01:24:55.659712+0000","last_active":"2023-05-10T01:24:56.068060+0000","last_peered":"2023-05-10T01:24:56.068060+0000","last_clean":"2023-05-10T01:24:56.068060+0000","last_became_active":"2023-05-10T01:24:55.659428+0000","last_became_peered":"2023-05-10T01:24:55.659428+0000","last_unstale":"2023-05-10T01:24:56.068060+0000","last_undegraded":"2023-05-10T01:24:56.068060+0000","last_fullsized":"2023-05-10T01:24:56.068060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060681+0000","last_change":"2023-05-10T01:24:56.057122+0000","last_active":"2023-05-10T01:24:56.060681+0000","last_peered":"2023-05-10T01:24:56.060681+0000","last_clean":"2023-05-10T01:24:56.060681+0000","last_became_active":"2023-05-10T01:24:56.056234+0000","last_became_peered":"2023-05-10T01:24:56.056234+0000","last_unstale":"2023-05-10T01:24:56.060681+0000","last_undegraded":"2023-05-10T01:24:56.060681+0000","last_fullsized":"2023-05-10T01:24:56.060681+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046970+0000","last_change":"2023-05-10T01:24:55.663646+0000","last_active":"2023-05-10T01:24:56.046970+0000","last_peered":"2023-05-10T01:24:56.046970+0000","last_clean":"2023-05-10T01:24:56.046970+0000","last_became_active":"2023-05-10T01:24:55.663255+0000","last_became_peered":"2023-05-10T01:24:55.663255+0000","last_unstale":"2023-05-10T01:24:56.046970+0000","last_undegraded":"2023-05-10T01:24:56.046970+0000","last_fullsized":"2023-05-10T01:24:56.046970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050293+0000","last_change":"2023-05-10T01:24:56.046677+0000","last_active":"2023-05-10T01:24:56.050293+0000","last_peered":"2023-05-10T01:24:56.050293+0000","last_clean":"2023-05-10T01:24:56.050293+0000","last_became_active":"2023-05-10T01:24:56.046391+0000","last_became_peered":"2023-05-10T01:24:56.046391+0000","last_unstale":"2023-05-10T01:24:56.050293+0000","last_undegraded":"2023-05-10T01:24:56.050293+0000","last_fullsized":"2023-05-10T01:24:56.050293+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039945+0000","last_change":"2023-05-10T01:24:55.663962+0000","last_active":"2023-05-10T01:24:56.039945+0000","last_peered":"2023-05-10T01:24:56.039945+0000","last_clean":"2023-05-10T01:24:56.039945+0000","last_became_active":"2023-05-10T01:24:55.663673+0000","last_became_peered":"2023-05-10T01:24:55.663673+0000","last_unstale":"2023-05-10T01:24:56.039945+0000","last_undegraded":"2023-05-10T01:24:56.039945+0000","last_fullsized":"2023-05-10T01:24:56.039945+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060606+0000","last_change":"2023-05-10T01:24:56.056477+0000","last_active":"2023-05-10T01:24:56.060606+0000","last_peered":"2023-05-10T01:24:56.060606+0000","last_clean":"2023-05-10T01:24:56.060606+0000","last_became_active":"2023-05-10T01:24:56.055861+0000","last_became_peered":"2023-05-10T01:24:56.055861+0000","last_unstale":"2023-05-10T01:24:56.060606+0000","last_undegraded":"2023-05-10T01:24:56.060606+0000","last_fullsized":"2023-05-10T01:24:56.060606+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034505+0000","last_change":"2023-05-10T01:24:55.657750+0000","last_active":"2023-05-10T01:24:56.034505+0000","last_peered":"2023-05-10T01:24:56.034505+0000","last_clean":"2023-05-10T01:24:56.034505+0000","last_became_active":"2023-05-10T01:24:55.657454+0000","last_became_peered":"2023-05-10T01:24:55.657454+0000","last_unstale":"2023-05-10T01:24:56.034505+0000","last_undegraded":"2023-05-10T01:24:56.034505+0000","last_fullsized":"2023-05-10T01:24:56.034505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062683+0000","last_change":"2023-05-10T01:24:56.058055+0000","last_active":"2023-05-10T01:24:56.062683+0000","last_peered":"2023-05-10T01:24:56.062683+0000","last_clean":"2023-05-10T01:24:56.062683+0000","last_became_active":"2023-05-10T01:24:56.057750+0000","last_became_peered":"2023-05-10T01:24:56.057750+0000","last_unstale":"2023-05-10T01:24:56.062683+0000","last_undegraded":"2023-05-10T01:24:56.062683+0000","last_fullsized":"2023-05-10T01:24:56.062683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055769+0000","last_change":"2023-05-10T01:24:55.658629+0000","last_active":"2023-05-10T01:24:56.055769+0000","last_peered":"2023-05-10T01:24:56.055769+0000","last_clean":"2023-05-10T01:24:56.055769+0000","last_became_active":"2023-05-10T01:24:55.658410+0000","last_became_peered":"2023-05-10T01:24:55.658410+0000","last_unstale":"2023-05-10T01:24:56.055769+0000","last_undegraded":"2023-05-10T01:24:56.055769+0000","last_fullsized":"2023-05-10T01:24:56.055769+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050280+0000","last_change":"2023-05-10T01:24:56.047827+0000","last_active":"2023-05-10T01:24:56.050280+0000","last_peered":"2023-05-10T01:24:56.050280+0000","last_clean":"2023-05-10T01:24:56.050280+0000","last_became_active":"2023-05-10T01:24:56.047615+0000","last_became_peered":"2023-05-10T01:24:56.047615+0000","last_unstale":"2023-05-10T01:24:56.050280+0000","last_undegraded":"2023-05-10T01:24:56.050280+0000","last_fullsized":"2023-05-10T01:24:56.050280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042405+0000","last_change":"2023-05-10T01:24:55.655722+0000","last_active":"2023-05-10T01:24:56.042405+0000","last_peered":"2023-05-10T01:24:56.042405+0000","last_clean":"2023-05-10T01:24:56.042405+0000","last_became_active":"2023-05-10T01:24:55.655406+0000","last_became_peered":"2023-05-10T01:24:55.655406+0000","last_unstale":"2023-05-10T01:24:56.042405+0000","last_undegraded":"2023-05-10T01:24:56.042405+0000","last_fullsized":"2023-05-10T01:24:56.042405+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060449+0000","last_change":"2023-05-10T01:24:56.056257+0000","last_active":"2023-05-10T01:24:56.060449+0000","last_peered":"2023-05-10T01:24:56.060449+0000","last_clean":"2023-05-10T01:24:56.060449+0000","last_became_active":"2023-05-10T01:24:56.055934+0000","last_became_peered":"2023-05-10T01:24:56.055934+0000","last_unstale":"2023-05-10T01:24:56.060449+0000","last_undegraded":"2023-05-10T01:24:56.060449+0000","last_fullsized":"2023-05-10T01:24:56.060449+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.044991+0000","last_change":"2023-05-10T01:24:55.654917+0000","last_active":"2023-05-10T01:24:56.044991+0000","last_peered":"2023-05-10T01:24:56.044991+0000","last_clean":"2023-05-10T01:24:56.044991+0000","last_became_active":"2023-05-10T01:24:55.654637+0000","last_became_peered":"2023-05-10T01:24:55.654637+0000","last_unstale":"2023-05-10T01:24:56.044991+0000","last_undegraded":"2023-05-10T01:24:56.044991+0000","last_fullsized":"2023-05-10T01:24:56.044991+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063891+0000","last_change":"2023-05-10T01:24:56.059598+0000","last_active":"2023-05-10T01:24:56.063891+0000","last_peered":"2023-05-10T01:24:56.063891+0000","last_clean":"2023-05-10T01:24:56.063891+0000","last_became_active":"2023-05-10T01:24:56.059331+0000","last_became_peered":"2023-05-10T01:24:56.059331+0000","last_unstale":"2023-05-10T01:24:56.063891+0000","last_undegraded":"2023-05-10T01:24:56.063891+0000","last_fullsized":"2023-05-10T01:24:56.063891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065855+0000","last_change":"2023-05-10T01:24:55.647540+0000","last_active":"2023-05-10T01:24:56.065855+0000","last_peered":"2023-05-10T01:24:56.065855+0000","last_clean":"2023-05-10T01:24:56.065855+0000","last_became_active":"2023-05-10T01:24:55.647197+0000","last_became_peered":"2023-05-10T01:24:55.647197+0000","last_unstale":"2023-05-10T01:24:56.065855+0000","last_undegraded":"2023-05-10T01:24:56.065855+0000","last_fullsized":"2023-05-10T01:24:56.065855+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065290+0000","last_change":"2023-05-10T01:24:56.061839+0000","last_active":"2023-05-10T01:24:56.065290+0000","last_peered":"2023-05-10T01:24:56.065290+0000","last_clean":"2023-05-10T01:24:56.065290+0000","last_became_active":"2023-05-10T01:24:56.061572+0000","last_became_peered":"2023-05-10T01:24:56.061572+0000","last_unstale":"2023-05-10T01:24:56.065290+0000","last_undegraded":"2023-05-10T01:24:56.065290+0000","last_fullsized":"2023-05-10T01:24:56.065290+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033317+0000","last_change":"2023-05-10T01:24:55.651999+0000","last_active":"2023-05-10T01:24:56.033317+0000","last_peered":"2023-05-10T01:24:56.033317+0000","last_clean":"2023-05-10T01:24:56.033317+0000","last_became_active":"2023-05-10T01:24:55.651696+0000","last_became_peered":"2023-05-10T01:24:55.651696+0000","last_unstale":"2023-05-10T01:24:56.033317+0000","last_undegraded":"2023-05-10T01:24:56.033317+0000","last_fullsized":"2023-05-10T01:24:56.033317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065230+0000","last_change":"2023-05-10T01:24:56.063549+0000","last_active":"2023-05-10T01:24:56.065230+0000","last_peered":"2023-05-10T01:24:56.065230+0000","last_clean":"2023-05-10T01:24:56.065230+0000","last_became_active":"2023-05-10T01:24:56.063240+0000","last_became_peered":"2023-05-10T01:24:56.063240+0000","last_unstale":"2023-05-10T01:24:56.065230+0000","last_undegraded":"2023-05-10T01:24:56.065230+0000","last_fullsized":"2023-05-10T01:24:56.065230+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047928+0000","last_change":"2023-05-10T01:24:55.650902+0000","last_active":"2023-05-10T01:24:56.047928+0000","last_peered":"2023-05-10T01:24:56.047928+0000","last_clean":"2023-05-10T01:24:56.047928+0000","last_became_active":"2023-05-10T01:24:55.650617+0000","last_became_peered":"2023-05-10T01:24:55.650617+0000","last_unstale":"2023-05-10T01:24:56.047928+0000","last_undegraded":"2023-05-10T01:24:56.047928+0000","last_fullsized":"2023-05-10T01:24:56.047928+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064476+0000","last_change":"2023-05-10T01:24:56.058603+0000","last_active":"2023-05-10T01:24:56.064476+0000","last_peered":"2023-05-10T01:24:56.064476+0000","last_clean":"2023-05-10T01:24:56.064476+0000","last_became_active":"2023-05-10T01:24:56.057445+0000","last_became_peered":"2023-05-10T01:24:56.057445+0000","last_unstale":"2023-05-10T01:24:56.064476+0000","last_undegraded":"2023-05-10T01:24:56.064476+0000","last_fullsized":"2023-05-10T01:24:56.064476+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033981+0000","last_change":"2023-05-10T01:24:55.659268+0000","last_active":"2023-05-10T01:24:56.033981+0000","last_peered":"2023-05-10T01:24:56.033981+0000","last_clean":"2023-05-10T01:24:56.033981+0000","last_became_active":"2023-05-10T01:24:55.658942+0000","last_became_peered":"2023-05-10T01:24:55.658942+0000","last_unstale":"2023-05-10T01:24:56.033981+0000","last_undegraded":"2023-05-10T01:24:56.033981+0000","last_fullsized":"2023-05-10T01:24:56.033981+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065682+0000","last_change":"2023-05-10T01:24:56.063709+0000","last_active":"2023-05-10T01:24:56.065682+0000","last_peered":"2023-05-10T01:24:56.065682+0000","last_clean":"2023-05-10T01:24:56.065682+0000","last_became_active":"2023-05-10T01:24:56.063193+0000","last_became_peered":"2023-05-10T01:24:56.063193+0000","last_unstale":"2023-05-10T01:24:56.065682+0000","last_undegraded":"2023-05-10T01:24:56.065682+0000","last_fullsized":"2023-05-10T01:24:56.065682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037864+0000","last_change":"2023-05-10T01:24:55.657222+0000","last_active":"2023-05-10T01:24:56.037864+0000","last_peered":"2023-05-10T01:24:56.037864+0000","last_clean":"2023-05-10T01:24:56.037864+0000","last_became_active":"2023-05-10T01:24:55.656957+0000","last_became_peered":"2023-05-10T01:24:55.656957+0000","last_unstale":"2023-05-10T01:24:56.037864+0000","last_undegraded":"2023-05-10T01:24:56.037864+0000","last_fullsized":"2023-05-10T01:24:56.037864+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055584+0000","last_change":"2023-05-10T01:24:56.054369+0000","last_active":"2023-05-10T01:24:56.055584+0000","last_peered":"2023-05-10T01:24:56.055584+0000","last_clean":"2023-05-10T01:24:56.055584+0000","last_became_active":"2023-05-10T01:24:56.054066+0000","last_became_peered":"2023-05-10T01:24:56.054066+0000","last_unstale":"2023-05-10T01:24:56.055584+0000","last_undegraded":"2023-05-10T01:24:56.055584+0000","last_fullsized":"2023-05-10T01:24:56.055584+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038428+0000","last_change":"2023-05-10T01:24:55.652359+0000","last_active":"2023-05-10T01:24:56.038428+0000","last_peered":"2023-05-10T01:24:56.038428+0000","last_clean":"2023-05-10T01:24:56.038428+0000","last_became_active":"2023-05-10T01:24:55.652063+0000","last_became_peered":"2023-05-10T01:24:55.652063+0000","last_unstale":"2023-05-10T01:24:56.038428+0000","last_undegraded":"2023-05-10T01:24:56.038428+0000","last_fullsized":"2023-05-10T01:24:56.038428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053870+0000","last_change":"2023-05-10T01:24:56.049578+0000","last_active":"2023-05-10T01:24:56.053870+0000","last_peered":"2023-05-10T01:24:56.053870+0000","last_clean":"2023-05-10T01:24:56.053870+0000","last_became_active":"2023-05-10T01:24:56.049206+0000","last_became_peered":"2023-05-10T01:24:56.049206+0000","last_unstale":"2023-05-10T01:24:56.053870+0000","last_undegraded":"2023-05-10T01:24:56.053870+0000","last_fullsized":"2023-05-10T01:24:56.053870+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033648+0000","last_change":"2023-05-10T01:24:55.648335+0000","last_active":"2023-05-10T01:24:56.033648+0000","last_peered":"2023-05-10T01:24:56.033648+0000","last_clean":"2023-05-10T01:24:56.033648+0000","last_became_active":"2023-05-10T01:24:55.648056+0000","last_became_peered":"2023-05-10T01:24:55.648056+0000","last_unstale":"2023-05-10T01:24:56.033648+0000","last_undegraded":"2023-05-10T01:24:56.033648+0000","last_fullsized":"2023-05-10T01:24:56.033648+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061050+0000","last_change":"2023-05-10T01:24:56.058000+0000","last_active":"2023-05-10T01:24:56.061050+0000","last_peered":"2023-05-10T01:24:56.061050+0000","last_clean":"2023-05-10T01:24:56.061050+0000","last_became_active":"2023-05-10T01:24:56.057743+0000","last_became_peered":"2023-05-10T01:24:56.057743+0000","last_unstale":"2023-05-10T01:24:56.061050+0000","last_undegraded":"2023-05-10T01:24:56.061050+0000","last_fullsized":"2023-05-10T01:24:56.061050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050226+0000","last_change":"2023-05-10T01:24:55.659969+0000","last_active":"2023-05-10T01:24:56.050226+0000","last_peered":"2023-05-10T01:24:56.050226+0000","last_clean":"2023-05-10T01:24:56.050226+0000","last_became_active":"2023-05-10T01:24:55.659704+0000","last_became_peered":"2023-05-10T01:24:55.659704+0000","last_unstale":"2023-05-10T01:24:56.050226+0000","last_undegraded":"2023-05-10T01:24:56.050226+0000","last_fullsized":"2023-05-10T01:24:56.050226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053195+0000","last_change":"2023-05-10T01:24:56.048280+0000","last_active":"2023-05-10T01:24:56.053195+0000","last_peered":"2023-05-10T01:24:56.053195+0000","last_clean":"2023-05-10T01:24:56.053195+0000","last_became_active":"2023-05-10T01:24:56.048010+0000","last_became_peered":"2023-05-10T01:24:56.048010+0000","last_unstale":"2023-05-10T01:24:56.053195+0000","last_undegraded":"2023-05-10T01:24:56.053195+0000","last_fullsized":"2023-05-10T01:24:56.053195+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037613+0000","last_change":"2023-05-10T01:24:55.646476+0000","last_active":"2023-05-10T01:24:56.037613+0000","last_peered":"2023-05-10T01:24:56.037613+0000","last_clean":"2023-05-10T01:24:56.037613+0000","last_became_active":"2023-05-10T01:24:55.645582+0000","last_became_peered":"2023-05-10T01:24:55.645582+0000","last_unstale":"2023-05-10T01:24:56.037613+0000","last_undegraded":"2023-05-10T01:24:56.037613+0000","last_fullsized":"2023-05-10T01:24:56.037613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047731+0000","last_change":"2023-05-10T01:24:56.043316+0000","last_active":"2023-05-10T01:24:56.047731+0000","last_peered":"2023-05-10T01:24:56.047731+0000","last_clean":"2023-05-10T01:24:56.047731+0000","last_became_active":"2023-05-10T01:24:56.043070+0000","last_became_peered":"2023-05-10T01:24:56.043070+0000","last_unstale":"2023-05-10T01:24:56.047731+0000","last_undegraded":"2023-05-10T01:24:56.047731+0000","last_fullsized":"2023-05-10T01:24:56.047731+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.033311+0000","last_change":"2023-05-10T01:24:55.659745+0000","last_active":"2023-05-10T01:24:56.033311+0000","last_peered":"2023-05-10T01:24:56.033311+0000","last_clean":"2023-05-10T01:24:56.033311+0000","last_became_active":"2023-05-10T01:24:55.659466+0000","last_became_peered":"2023-05-10T01:24:55.659466+0000","last_unstale":"2023-05-10T01:24:56.033311+0000","last_undegraded":"2023-05-10T01:24:56.033311+0000","last_fullsized":"2023-05-10T01:24:56.033311+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065249+0000","last_change":"2023-05-10T01:24:56.063980+0000","last_active":"2023-05-10T01:24:56.065249+0000","last_peered":"2023-05-10T01:24:56.065249+0000","last_clean":"2023-05-10T01:24:56.065249+0000","last_became_active":"2023-05-10T01:24:56.063676+0000","last_became_peered":"2023-05-10T01:24:56.063676+0000","last_unstale":"2023-05-10T01:24:56.065249+0000","last_undegraded":"2023-05-10T01:24:56.065249+0000","last_fullsized":"2023-05-10T01:24:56.065249+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039184+0000","last_change":"2023-05-10T01:24:55.649801+0000","last_active":"2023-05-10T01:24:56.039184+0000","last_peered":"2023-05-10T01:24:56.039184+0000","last_clean":"2023-05-10T01:24:56.039184+0000","last_became_active":"2023-05-10T01:24:55.649477+0000","last_became_peered":"2023-05-10T01:24:55.649477+0000","last_unstale":"2023-05-10T01:24:56.039184+0000","last_undegraded":"2023-05-10T01:24:56.039184+0000","last_fullsized":"2023-05-10T01:24:56.039184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060655+0000","last_change":"2023-05-10T01:24:56.055963+0000","last_active":"2023-05-10T01:24:56.060655+0000","last_peered":"2023-05-10T01:24:56.060655+0000","last_clean":"2023-05-10T01:24:56.060655+0000","last_became_active":"2023-05-10T01:24:56.055680+0000","last_became_peered":"2023-05-10T01:24:56.055680+0000","last_unstale":"2023-05-10T01:24:56.060655+0000","last_undegraded":"2023-05-10T01:24:56.060655+0000","last_fullsized":"2023-05-10T01:24:56.060655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046739+0000","last_change":"2023-05-10T01:24:55.658805+0000","last_active":"2023-05-10T01:24:56.046739+0000","last_peered":"2023-05-10T01:24:56.046739+0000","last_clean":"2023-05-10T01:24:56.046739+0000","last_became_active":"2023-05-10T01:24:55.658571+0000","last_became_peered":"2023-05-10T01:24:55.658571+0000","last_unstale":"2023-05-10T01:24:56.046739+0000","last_undegraded":"2023-05-10T01:24:56.046739+0000","last_fullsized":"2023-05-10T01:24:56.046739+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.058625+0000","last_change":"2023-05-10T01:24:56.052867+0000","last_active":"2023-05-10T01:24:56.058625+0000","last_peered":"2023-05-10T01:24:56.058625+0000","last_clean":"2023-05-10T01:24:56.058625+0000","last_became_active":"2023-05-10T01:24:56.052574+0000","last_became_peered":"2023-05-10T01:24:56.052574+0000","last_unstale":"2023-05-10T01:24:56.058625+0000","last_undegraded":"2023-05-10T01:24:56.058625+0000","last_fullsized":"2023-05-10T01:24:56.058625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046587+0000","last_change":"2023-05-10T01:24:55.659838+0000","last_active":"2023-05-10T01:24:56.046587+0000","last_peered":"2023-05-10T01:24:56.046587+0000","last_clean":"2023-05-10T01:24:56.046587+0000","last_became_active":"2023-05-10T01:24:55.659183+0000","last_became_peered":"2023-05-10T01:24:55.659183+0000","last_unstale":"2023-05-10T01:24:56.046587+0000","last_undegraded":"2023-05-10T01:24:56.046587+0000","last_fullsized":"2023-05-10T01:24:56.046587+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.059720+0000","last_change":"2023-05-10T01:24:56.057801+0000","last_active":"2023-05-10T01:24:56.059720+0000","last_peered":"2023-05-10T01:24:56.059720+0000","last_clean":"2023-05-10T01:24:56.059720+0000","last_became_active":"2023-05-10T01:24:56.057522+0000","last_became_peered":"2023-05-10T01:24:56.057522+0000","last_unstale":"2023-05-10T01:24:56.059720+0000","last_undegraded":"2023-05-10T01:24:56.059720+0000","last_fullsized":"2023-05-10T01:24:56.059720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042132+0000","last_change":"2023-05-10T01:24:55.654580+0000","last_active":"2023-05-10T01:24:56.042132+0000","last_peered":"2023-05-10T01:24:56.042132+0000","last_clean":"2023-05-10T01:24:56.042132+0000","last_became_active":"2023-05-10T01:24:55.653714+0000","last_became_peered":"2023-05-10T01:24:55.653714+0000","last_unstale":"2023-05-10T01:24:56.042132+0000","last_undegraded":"2023-05-10T01:24:56.042132+0000","last_fullsized":"2023-05-10T01:24:56.042132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062976+0000","last_change":"2023-05-10T01:24:56.058137+0000","last_active":"2023-05-10T01:24:56.062976+0000","last_peered":"2023-05-10T01:24:56.062976+0000","last_clean":"2023-05-10T01:24:56.062976+0000","last_became_active":"2023-05-10T01:24:56.057875+0000","last_became_peered":"2023-05-10T01:24:56.057875+0000","last_unstale":"2023-05-10T01:24:56.062976+0000","last_undegraded":"2023-05-10T01:24:56.062976+0000","last_fullsized":"2023-05-10T01:24:56.062976+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065258+0000","last_change":"2023-05-10T01:24:55.654729+0000","last_active":"2023-05-10T01:24:56.065258+0000","last_peered":"2023-05-10T01:24:56.065258+0000","last_clean":"2023-05-10T01:24:56.065258+0000","last_became_active":"2023-05-10T01:24:55.654157+0000","last_became_peered":"2023-05-10T01:24:55.654157+0000","last_unstale":"2023-05-10T01:24:56.065258+0000","last_undegraded":"2023-05-10T01:24:56.065258+0000","last_fullsized":"2023-05-10T01:24:56.065258+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055527+0000","last_change":"2023-05-10T01:24:56.053505+0000","last_active":"2023-05-10T01:24:56.055527+0000","last_peered":"2023-05-10T01:24:56.055527+0000","last_clean":"2023-05-10T01:24:56.055527+0000","last_became_active":"2023-05-10T01:24:56.053233+0000","last_became_peered":"2023-05-10T01:24:56.053233+0000","last_unstale":"2023-05-10T01:24:56.055527+0000","last_undegraded":"2023-05-10T01:24:56.055527+0000","last_fullsized":"2023-05-10T01:24:56.055527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053658+0000","last_change":"2023-05-10T01:24:55.660460+0000","last_active":"2023-05-10T01:24:56.053658+0000","last_peered":"2023-05-10T01:24:56.053658+0000","last_clean":"2023-05-10T01:24:56.053658+0000","last_became_active":"2023-05-10T01:24:55.660216+0000","last_became_peered":"2023-05-10T01:24:55.660216+0000","last_unstale":"2023-05-10T01:24:56.053658+0000","last_undegraded":"2023-05-10T01:24:56.053658+0000","last_fullsized":"2023-05-10T01:24:56.053658+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053976+0000","last_change":"2023-05-10T01:24:56.050033+0000","last_active":"2023-05-10T01:24:56.053976+0000","last_peered":"2023-05-10T01:24:56.053976+0000","last_clean":"2023-05-10T01:24:56.053976+0000","last_became_active":"2023-05-10T01:24:56.049686+0000","last_became_peered":"2023-05-10T01:24:56.049686+0000","last_unstale":"2023-05-10T01:24:56.053976+0000","last_undegraded":"2023-05-10T01:24:56.053976+0000","last_fullsized":"2023-05-10T01:24:56.053976+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053074+0000","last_change":"2023-05-10T01:24:55.648005+0000","last_active":"2023-05-10T01:24:56.053074+0000","last_peered":"2023-05-10T01:24:56.053074+0000","last_clean":"2023-05-10T01:24:56.053074+0000","last_became_active":"2023-05-10T01:24:55.647703+0000","last_became_peered":"2023-05-10T01:24:55.647703+0000","last_unstale":"2023-05-10T01:24:56.053074+0000","last_undegraded":"2023-05-10T01:24:56.053074+0000","last_fullsized":"2023-05-10T01:24:56.053074+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065277+0000","last_change":"2023-05-10T01:24:56.061756+0000","last_active":"2023-05-10T01:24:56.065277+0000","last_peered":"2023-05-10T01:24:56.065277+0000","last_clean":"2023-05-10T01:24:56.065277+0000","last_became_active":"2023-05-10T01:24:56.061491+0000","last_became_peered":"2023-05-10T01:24:56.061491+0000","last_unstale":"2023-05-10T01:24:56.065277+0000","last_undegraded":"2023-05-10T01:24:56.065277+0000","last_fullsized":"2023-05-10T01:24:56.065277+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038921+0000","last_change":"2023-05-10T01:24:55.651581+0000","last_active":"2023-05-10T01:24:56.038921+0000","last_peered":"2023-05-10T01:24:56.038921+0000","last_clean":"2023-05-10T01:24:56.038921+0000","last_became_active":"2023-05-10T01:24:55.651193+0000","last_became_peered":"2023-05-10T01:24:55.651193+0000","last_unstale":"2023-05-10T01:24:56.038921+0000","last_undegraded":"2023-05-10T01:24:56.038921+0000","last_fullsized":"2023-05-10T01:24:56.038921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050141+0000","last_change":"2023-05-10T01:24:56.047177+0000","last_active":"2023-05-10T01:24:56.050141+0000","last_peered":"2023-05-10T01:24:56.050141+0000","last_clean":"2023-05-10T01:24:56.050141+0000","last_became_active":"2023-05-10T01:24:56.046949+0000","last_became_peered":"2023-05-10T01:24:56.046949+0000","last_unstale":"2023-05-10T01:24:56.050141+0000","last_undegraded":"2023-05-10T01:24:56.050141+0000","last_fullsized":"2023-05-10T01:24:56.050141+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.034055+0000","last_change":"2023-05-10T01:24:55.649354+0000","last_active":"2023-05-10T01:24:56.034055+0000","last_peered":"2023-05-10T01:24:56.034055+0000","last_clean":"2023-05-10T01:24:56.034055+0000","last_became_active":"2023-05-10T01:24:55.649067+0000","last_became_peered":"2023-05-10T01:24:55.649067+0000","last_unstale":"2023-05-10T01:24:56.034055+0000","last_undegraded":"2023-05-10T01:24:56.034055+0000","last_fullsized":"2023-05-10T01:24:56.034055+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050278+0000","last_change":"2023-05-10T01:24:56.046565+0000","last_active":"2023-05-10T01:24:56.050278+0000","last_peered":"2023-05-10T01:24:56.050278+0000","last_clean":"2023-05-10T01:24:56.050278+0000","last_became_active":"2023-05-10T01:24:56.046141+0000","last_became_peered":"2023-05-10T01:24:56.046141+0000","last_unstale":"2023-05-10T01:24:56.050278+0000","last_undegraded":"2023-05-10T01:24:56.050278+0000","last_fullsized":"2023-05-10T01:24:56.050278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046857+0000","last_change":"2023-05-10T01:24:55.654294+0000","last_active":"2023-05-10T01:24:56.046857+0000","last_peered":"2023-05-10T01:24:56.046857+0000","last_clean":"2023-05-10T01:24:56.046857+0000","last_became_active":"2023-05-10T01:24:55.653993+0000","last_became_peered":"2023-05-10T01:24:55.653993+0000","last_unstale":"2023-05-10T01:24:56.046857+0000","last_undegraded":"2023-05-10T01:24:56.046857+0000","last_fullsized":"2023-05-10T01:24:56.046857+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053793+0000","last_change":"2023-05-10T01:24:56.046188+0000","last_active":"2023-05-10T01:24:56.053793+0000","last_peered":"2023-05-10T01:24:56.053793+0000","last_clean":"2023-05-10T01:24:56.053793+0000","last_became_active":"2023-05-10T01:24:56.045892+0000","last_became_peered":"2023-05-10T01:24:56.045892+0000","last_unstale":"2023-05-10T01:24:56.053793+0000","last_undegraded":"2023-05-10T01:24:56.053793+0000","last_fullsized":"2023-05-10T01:24:56.053793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032918+0000","last_change":"2023-05-10T01:24:55.648375+0000","last_active":"2023-05-10T01:24:56.032918+0000","last_peered":"2023-05-10T01:24:56.032918+0000","last_clean":"2023-05-10T01:24:56.032918+0000","last_became_active":"2023-05-10T01:24:55.648061+0000","last_became_peered":"2023-05-10T01:24:55.648061+0000","last_unstale":"2023-05-10T01:24:56.032918+0000","last_undegraded":"2023-05-10T01:24:56.032918+0000","last_fullsized":"2023-05-10T01:24:56.032918+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.056289+0000","last_change":"2023-05-10T01:24:56.047393+0000","last_active":"2023-05-10T01:24:56.056289+0000","last_peered":"2023-05-10T01:24:56.056289+0000","last_clean":"2023-05-10T01:24:56.056289+0000","last_became_active":"2023-05-10T01:24:56.047111+0000","last_became_peered":"2023-05-10T01:24:56.047111+0000","last_unstale":"2023-05-10T01:24:56.056289+0000","last_undegraded":"2023-05-10T01:24:56.056289+0000","last_fullsized":"2023-05-10T01:24:56.056289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039740+0000","last_change":"2023-05-10T01:24:55.655003+0000","last_active":"2023-05-10T01:24:56.039740+0000","last_peered":"2023-05-10T01:24:56.039740+0000","last_clean":"2023-05-10T01:24:56.039740+0000","last_became_active":"2023-05-10T01:24:55.654678+0000","last_became_peered":"2023-05-10T01:24:55.654678+0000","last_unstale":"2023-05-10T01:24:56.039740+0000","last_undegraded":"2023-05-10T01:24:56.039740+0000","last_fullsized":"2023-05-10T01:24:56.039740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050747+0000","last_change":"2023-05-10T01:24:56.049666+0000","last_active":"2023-05-10T01:24:56.050747+0000","last_peered":"2023-05-10T01:24:56.050747+0000","last_clean":"2023-05-10T01:24:56.050747+0000","last_became_active":"2023-05-10T01:24:56.049373+0000","last_became_peered":"2023-05-10T01:24:56.049373+0000","last_unstale":"2023-05-10T01:24:56.050747+0000","last_undegraded":"2023-05-10T01:24:56.050747+0000","last_fullsized":"2023-05-10T01:24:56.050747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.040856+0000","last_change":"2023-05-10T01:24:55.658895+0000","last_active":"2023-05-10T01:24:56.040856+0000","last_peered":"2023-05-10T01:24:56.040856+0000","last_clean":"2023-05-10T01:24:56.040856+0000","last_became_active":"2023-05-10T01:24:55.658664+0000","last_became_peered":"2023-05-10T01:24:55.658664+0000","last_unstale":"2023-05-10T01:24:56.040856+0000","last_undegraded":"2023-05-10T01:24:56.040856+0000","last_fullsized":"2023-05-10T01:24:56.040856+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.058659+0000","last_change":"2023-05-10T01:24:56.053072+0000","last_active":"2023-05-10T01:24:56.058659+0000","last_peered":"2023-05-10T01:24:56.058659+0000","last_clean":"2023-05-10T01:24:56.058659+0000","last_became_active":"2023-05-10T01:24:56.052602+0000","last_became_peered":"2023-05-10T01:24:56.052602+0000","last_unstale":"2023-05-10T01:24:56.058659+0000","last_undegraded":"2023-05-10T01:24:56.058659+0000","last_fullsized":"2023-05-10T01:24:56.058659+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050339+0000","last_change":"2023-05-10T01:24:55.656798+0000","last_active":"2023-05-10T01:24:56.050339+0000","last_peered":"2023-05-10T01:24:56.050339+0000","last_clean":"2023-05-10T01:24:56.050339+0000","last_became_active":"2023-05-10T01:24:55.656470+0000","last_became_peered":"2023-05-10T01:24:55.656470+0000","last_unstale":"2023-05-10T01:24:56.050339+0000","last_undegraded":"2023-05-10T01:24:56.050339+0000","last_fullsized":"2023-05-10T01:24:56.050339+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065427+0000","last_change":"2023-05-10T01:24:56.063242+0000","last_active":"2023-05-10T01:24:56.065427+0000","last_peered":"2023-05-10T01:24:56.065427+0000","last_clean":"2023-05-10T01:24:56.065427+0000","last_became_active":"2023-05-10T01:24:56.062420+0000","last_became_peered":"2023-05-10T01:24:56.062420+0000","last_unstale":"2023-05-10T01:24:56.065427+0000","last_undegraded":"2023-05-10T01:24:56.065427+0000","last_fullsized":"2023-05-10T01:24:56.065427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.066146+0000","last_change":"2023-05-10T01:24:55.659701+0000","last_active":"2023-05-10T01:24:56.066146+0000","last_peered":"2023-05-10T01:24:56.066146+0000","last_clean":"2023-05-10T01:24:56.066146+0000","last_became_active":"2023-05-10T01:24:55.658610+0000","last_became_peered":"2023-05-10T01:24:55.658610+0000","last_unstale":"2023-05-10T01:24:56.066146+0000","last_undegraded":"2023-05-10T01:24:56.066146+0000","last_fullsized":"2023-05-10T01:24:56.066146+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065465+0000","last_change":"2023-05-10T01:24:56.060743+0000","last_active":"2023-05-10T01:24:56.065465+0000","last_peered":"2023-05-10T01:24:56.065465+0000","last_clean":"2023-05-10T01:24:56.065465+0000","last_became_active":"2023-05-10T01:24:56.060405+0000","last_became_peered":"2023-05-10T01:24:56.060405+0000","last_unstale":"2023-05-10T01:24:56.065465+0000","last_undegraded":"2023-05-10T01:24:56.065465+0000","last_fullsized":"2023-05-10T01:24:56.065465+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053589+0000","last_change":"2023-05-10T01:24:55.653297+0000","last_active":"2023-05-10T01:24:56.053589+0000","last_peered":"2023-05-10T01:24:56.053589+0000","last_clean":"2023-05-10T01:24:56.053589+0000","last_became_active":"2023-05-10T01:24:55.652982+0000","last_became_peered":"2023-05-10T01:24:55.652982+0000","last_unstale":"2023-05-10T01:24:56.053589+0000","last_undegraded":"2023-05-10T01:24:56.053589+0000","last_fullsized":"2023-05-10T01:24:56.053589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.066671+0000","last_change":"2023-05-10T01:24:56.065996+0000","last_active":"2023-05-10T01:24:56.066671+0000","last_peered":"2023-05-10T01:24:56.066671+0000","last_clean":"2023-05-10T01:24:56.066671+0000","last_became_active":"2023-05-10T01:24:56.065743+0000","last_became_peered":"2023-05-10T01:24:56.065743+0000","last_unstale":"2023-05-10T01:24:56.066671+0000","last_undegraded":"2023-05-10T01:24:56.066671+0000","last_fullsized":"2023-05-10T01:24:56.066671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.058600+0000","last_change":"2023-05-10T01:24:55.653585+0000","last_active":"2023-05-10T01:24:56.058600+0000","last_peered":"2023-05-10T01:24:56.058600+0000","last_clean":"2023-05-10T01:24:56.058600+0000","last_became_active":"2023-05-10T01:24:55.653229+0000","last_became_peered":"2023-05-10T01:24:55.653229+0000","last_unstale":"2023-05-10T01:24:56.058600+0000","last_undegraded":"2023-05-10T01:24:56.058600+0000","last_fullsized":"2023-05-10T01:24:56.058600+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063060+0000","last_change":"2023-05-10T01:24:56.057865+0000","last_active":"2023-05-10T01:24:56.063060+0000","last_peered":"2023-05-10T01:24:56.063060+0000","last_clean":"2023-05-10T01:24:56.063060+0000","last_became_active":"2023-05-10T01:24:56.057565+0000","last_became_peered":"2023-05-10T01:24:56.057565+0000","last_unstale":"2023-05-10T01:24:56.063060+0000","last_undegraded":"2023-05-10T01:24:56.063060+0000","last_fullsized":"2023-05-10T01:24:56.063060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038359+0000","last_change":"2023-05-10T01:24:55.659554+0000","last_active":"2023-05-10T01:24:56.038359+0000","last_peered":"2023-05-10T01:24:56.038359+0000","last_clean":"2023-05-10T01:24:56.038359+0000","last_became_active":"2023-05-10T01:24:55.659297+0000","last_became_peered":"2023-05-10T01:24:55.659297+0000","last_unstale":"2023-05-10T01:24:56.038359+0000","last_undegraded":"2023-05-10T01:24:56.038359+0000","last_fullsized":"2023-05-10T01:24:56.038359+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055286+0000","last_change":"2023-05-10T01:24:56.049767+0000","last_active":"2023-05-10T01:24:56.055286+0000","last_peered":"2023-05-10T01:24:56.055286+0000","last_clean":"2023-05-10T01:24:56.055286+0000","last_became_active":"2023-05-10T01:24:56.048373+0000","last_became_peered":"2023-05-10T01:24:56.048373+0000","last_unstale":"2023-05-10T01:24:56.055286+0000","last_undegraded":"2023-05-10T01:24:56.055286+0000","last_fullsized":"2023-05-10T01:24:56.055286+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039908+0000","last_change":"2023-05-10T01:24:55.656174+0000","last_active":"2023-05-10T01:24:56.039908+0000","last_peered":"2023-05-10T01:24:56.039908+0000","last_clean":"2023-05-10T01:24:56.039908+0000","last_became_active":"2023-05-10T01:24:55.655351+0000","last_became_peered":"2023-05-10T01:24:55.655351+0000","last_unstale":"2023-05-10T01:24:56.039908+0000","last_undegraded":"2023-05-10T01:24:56.039908+0000","last_fullsized":"2023-05-10T01:24:56.039908+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063107+0000","last_change":"2023-05-10T01:24:56.058059+0000","last_active":"2023-05-10T01:24:56.063107+0000","last_peered":"2023-05-10T01:24:56.063107+0000","last_clean":"2023-05-10T01:24:56.063107+0000","last_became_active":"2023-05-10T01:24:56.057774+0000","last_became_peered":"2023-05-10T01:24:56.057774+0000","last_unstale":"2023-05-10T01:24:56.063107+0000","last_undegraded":"2023-05-10T01:24:56.063107+0000","last_fullsized":"2023-05-10T01:24:56.063107+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.054595+0000","last_change":"2023-05-10T01:24:55.651683+0000","last_active":"2023-05-10T01:24:56.054595+0000","last_peered":"2023-05-10T01:24:56.054595+0000","last_clean":"2023-05-10T01:24:56.054595+0000","last_became_active":"2023-05-10T01:24:55.651369+0000","last_became_peered":"2023-05-10T01:24:55.651369+0000","last_unstale":"2023-05-10T01:24:56.054595+0000","last_undegraded":"2023-05-10T01:24:56.054595+0000","last_fullsized":"2023-05-10T01:24:56.054595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053686+0000","last_change":"2023-05-10T01:24:56.048231+0000","last_active":"2023-05-10T01:24:56.053686+0000","last_peered":"2023-05-10T01:24:56.053686+0000","last_clean":"2023-05-10T01:24:56.053686+0000","last_became_active":"2023-05-10T01:24:56.048011+0000","last_became_peered":"2023-05-10T01:24:56.048011+0000","last_unstale":"2023-05-10T01:24:56.053686+0000","last_undegraded":"2023-05-10T01:24:56.053686+0000","last_fullsized":"2023-05-10T01:24:56.053686+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061131+0000","last_change":"2023-05-10T01:24:55.656606+0000","last_active":"2023-05-10T01:24:56.061131+0000","last_peered":"2023-05-10T01:24:56.061131+0000","last_clean":"2023-05-10T01:24:56.061131+0000","last_became_active":"2023-05-10T01:24:55.656337+0000","last_became_peered":"2023-05-10T01:24:55.656337+0000","last_unstale":"2023-05-10T01:24:56.061131+0000","last_undegraded":"2023-05-10T01:24:56.061131+0000","last_fullsized":"2023-05-10T01:24:56.061131+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063041+0000","last_change":"2023-05-10T01:24:56.057498+0000","last_active":"2023-05-10T01:24:56.063041+0000","last_peered":"2023-05-10T01:24:56.063041+0000","last_clean":"2023-05-10T01:24:56.063041+0000","last_became_active":"2023-05-10T01:24:56.057199+0000","last_became_peered":"2023-05-10T01:24:56.057199+0000","last_unstale":"2023-05-10T01:24:56.063041+0000","last_undegraded":"2023-05-10T01:24:56.063041+0000","last_fullsized":"2023-05-10T01:24:56.063041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.032868+0000","last_change":"2023-05-10T01:24:55.657774+0000","last_active":"2023-05-10T01:24:56.032868+0000","last_peered":"2023-05-10T01:24:56.032868+0000","last_clean":"2023-05-10T01:24:56.032868+0000","last_became_active":"2023-05-10T01:24:55.657505+0000","last_became_peered":"2023-05-10T01:24:55.657505+0000","last_unstale":"2023-05-10T01:24:56.032868+0000","last_undegraded":"2023-05-10T01:24:56.032868+0000","last_fullsized":"2023-05-10T01:24:56.032868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.053953+0000","last_change":"2023-05-10T01:24:56.049974+0000","last_active":"2023-05-10T01:24:56.053953+0000","last_peered":"2023-05-10T01:24:56.053953+0000","last_clean":"2023-05-10T01:24:56.053953+0000","last_became_active":"2023-05-10T01:24:56.049305+0000","last_became_peered":"2023-05-10T01:24:56.049305+0000","last_unstale":"2023-05-10T01:24:56.053953+0000","last_undegraded":"2023-05-10T01:24:56.053953+0000","last_fullsized":"2023-05-10T01:24:56.053953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039243+0000","last_change":"2023-05-10T01:24:55.657542+0000","last_active":"2023-05-10T01:24:56.039243+0000","last_peered":"2023-05-10T01:24:56.039243+0000","last_clean":"2023-05-10T01:24:56.039243+0000","last_became_active":"2023-05-10T01:24:55.657330+0000","last_became_peered":"2023-05-10T01:24:55.657330+0000","last_unstale":"2023-05-10T01:24:56.039243+0000","last_undegraded":"2023-05-10T01:24:56.039243+0000","last_fullsized":"2023-05-10T01:24:56.039243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.050720+0000","last_change":"2023-05-10T01:24:56.048800+0000","last_active":"2023-05-10T01:24:56.050720+0000","last_peered":"2023-05-10T01:24:56.050720+0000","last_clean":"2023-05-10T01:24:56.050720+0000","last_became_active":"2023-05-10T01:24:56.048552+0000","last_became_peered":"2023-05-10T01:24:56.048552+0000","last_unstale":"2023-05-10T01:24:56.050720+0000","last_undegraded":"2023-05-10T01:24:56.050720+0000","last_fullsized":"2023-05-10T01:24:56.050720+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038095+0000","last_change":"2023-05-10T01:24:55.652219+0000","last_active":"2023-05-10T01:24:56.038095+0000","last_peered":"2023-05-10T01:24:56.038095+0000","last_clean":"2023-05-10T01:24:56.038095+0000","last_became_active":"2023-05-10T01:24:55.651825+0000","last_became_peered":"2023-05-10T01:24:55.651825+0000","last_unstale":"2023-05-10T01:24:56.038095+0000","last_undegraded":"2023-05-10T01:24:56.038095+0000","last_fullsized":"2023-05-10T01:24:56.038095+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063015+0000","last_change":"2023-05-10T01:24:56.057202+0000","last_active":"2023-05-10T01:24:56.063015+0000","last_peered":"2023-05-10T01:24:56.063015+0000","last_clean":"2023-05-10T01:24:56.063015+0000","last_became_active":"2023-05-10T01:24:56.056899+0000","last_became_peered":"2023-05-10T01:24:56.056899+0000","last_unstale":"2023-05-10T01:24:56.063015+0000","last_undegraded":"2023-05-10T01:24:56.063015+0000","last_fullsized":"2023-05-10T01:24:56.063015+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039656+0000","last_change":"2023-05-10T01:24:55.652946+0000","last_active":"2023-05-10T01:24:56.039656+0000","last_peered":"2023-05-10T01:24:56.039656+0000","last_clean":"2023-05-10T01:24:56.039656+0000","last_became_active":"2023-05-10T01:24:55.650915+0000","last_became_peered":"2023-05-10T01:24:55.650915+0000","last_unstale":"2023-05-10T01:24:56.039656+0000","last_undegraded":"2023-05-10T01:24:56.039656+0000","last_fullsized":"2023-05-10T01:24:56.039656+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055462+0000","last_change":"2023-05-10T01:24:56.050519+0000","last_active":"2023-05-10T01:24:56.055462+0000","last_peered":"2023-05-10T01:24:56.055462+0000","last_clean":"2023-05-10T01:24:56.055462+0000","last_became_active":"2023-05-10T01:24:56.050212+0000","last_became_peered":"2023-05-10T01:24:56.050212+0000","last_unstale":"2023-05-10T01:24:56.055462+0000","last_undegraded":"2023-05-10T01:24:56.055462+0000","last_fullsized":"2023-05-10T01:24:56.055462+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.040008+0000","last_change":"2023-05-10T01:24:55.658627+0000","last_active":"2023-05-10T01:24:56.040008+0000","last_peered":"2023-05-10T01:24:56.040008+0000","last_clean":"2023-05-10T01:24:56.040008+0000","last_became_active":"2023-05-10T01:24:55.658262+0000","last_became_peered":"2023-05-10T01:24:55.658262+0000","last_unstale":"2023-05-10T01:24:56.040008+0000","last_undegraded":"2023-05-10T01:24:56.040008+0000","last_fullsized":"2023-05-10T01:24:56.040008+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.063523+0000","last_change":"2023-05-10T01:24:56.058327+0000","last_active":"2023-05-10T01:24:56.063523+0000","last_peered":"2023-05-10T01:24:56.063523+0000","last_clean":"2023-05-10T01:24:56.063523+0000","last_became_active":"2023-05-10T01:24:56.057358+0000","last_became_peered":"2023-05-10T01:24:56.057358+0000","last_unstale":"2023-05-10T01:24:56.063523+0000","last_undegraded":"2023-05-10T01:24:56.063523+0000","last_fullsized":"2023-05-10T01:24:56.063523+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.040669+0000","last_change":"2023-05-10T01:24:55.656538+0000","last_active":"2023-05-10T01:24:56.040669+0000","last_peered":"2023-05-10T01:24:56.040669+0000","last_clean":"2023-05-10T01:24:56.040669+0000","last_became_active":"2023-05-10T01:24:55.654100+0000","last_became_peered":"2023-05-10T01:24:55.654100+0000","last_unstale":"2023-05-10T01:24:56.040669+0000","last_undegraded":"2023-05-10T01:24:56.040669+0000","last_fullsized":"2023-05-10T01:24:56.040669+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060280+0000","last_change":"2023-05-10T01:24:56.048343+0000","last_active":"2023-05-10T01:24:56.060280+0000","last_peered":"2023-05-10T01:24:56.060280+0000","last_clean":"2023-05-10T01:24:56.060280+0000","last_became_active":"2023-05-10T01:24:56.048071+0000","last_became_peered":"2023-05-10T01:24:56.048071+0000","last_unstale":"2023-05-10T01:24:56.060280+0000","last_undegraded":"2023-05-10T01:24:56.060280+0000","last_fullsized":"2023-05-10T01:24:56.060280+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.037538+0000","last_change":"2023-05-10T01:24:55.649514+0000","last_active":"2023-05-10T01:24:56.037538+0000","last_peered":"2023-05-10T01:24:56.037538+0000","last_clean":"2023-05-10T01:24:56.037538+0000","last_became_active":"2023-05-10T01:24:55.649230+0000","last_became_peered":"2023-05-10T01:24:55.649230+0000","last_unstale":"2023-05-10T01:24:56.037538+0000","last_undegraded":"2023-05-10T01:24:56.037538+0000","last_fullsized":"2023-05-10T01:24:56.037538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.049742+0000","last_change":"2023-05-10T01:24:56.044096+0000","last_active":"2023-05-10T01:24:56.049742+0000","last_peered":"2023-05-10T01:24:56.049742+0000","last_clean":"2023-05-10T01:24:56.049742+0000","last_became_active":"2023-05-10T01:24:56.043868+0000","last_became_peered":"2023-05-10T01:24:56.043868+0000","last_unstale":"2023-05-10T01:24:56.049742+0000","last_undegraded":"2023-05-10T01:24:56.049742+0000","last_fullsized":"2023-05-10T01:24:56.049742+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043609+0000","last_change":"2023-05-10T01:24:55.655026+0000","last_active":"2023-05-10T01:24:56.043609+0000","last_peered":"2023-05-10T01:24:56.043609+0000","last_clean":"2023-05-10T01:24:56.043609+0000","last_became_active":"2023-05-10T01:24:55.654742+0000","last_became_peered":"2023-05-10T01:24:55.654742+0000","last_unstale":"2023-05-10T01:24:56.043609+0000","last_undegraded":"2023-05-10T01:24:56.043609+0000","last_fullsized":"2023-05-10T01:24:56.043609+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043824+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:24:56.043824+0000","last_peered":"2023-05-10T01:24:56.043824+0000","last_clean":"2023-05-10T01:24:56.043824+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:24:56.043824+0000","last_undegraded":"2023-05-10T01:24:56.043824+0000","last_fullsized":"2023-05-10T01:24:56.043824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064619+0000","last_change":"2023-05-10T01:24:56.060432+0000","last_active":"2023-05-10T01:24:56.064619+0000","last_peered":"2023-05-10T01:24:56.064619+0000","last_clean":"2023-05-10T01:24:56.064619+0000","last_became_active":"2023-05-10T01:24:56.060141+0000","last_became_peered":"2023-05-10T01:24:56.060141+0000","last_unstale":"2023-05-10T01:24:56.064619+0000","last_undegraded":"2023-05-10T01:24:56.064619+0000","last_fullsized":"2023-05-10T01:24:56.064619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.062086+0000","last_change":"2023-05-10T01:24:55.646775+0000","last_active":"2023-05-10T01:24:56.062086+0000","last_peered":"2023-05-10T01:24:56.062086+0000","last_clean":"2023-05-10T01:24:56.062086+0000","last_became_active":"2023-05-10T01:24:55.646471+0000","last_became_peered":"2023-05-10T01:24:55.646471+0000","last_unstale":"2023-05-10T01:24:56.062086+0000","last_undegraded":"2023-05-10T01:24:56.062086+0000","last_fullsized":"2023-05-10T01:24:56.062086+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.046946+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:24:56.046946+0000","last_peered":"2023-05-10T01:24:56.046946+0000","last_clean":"2023-05-10T01:24:56.046946+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:24:56.046946+0000","last_undegraded":"2023-05-10T01:24:56.046946+0000","last_fullsized":"2023-05-10T01:24:56.046946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060528+0000","last_change":"2023-05-10T01:24:56.055942+0000","last_active":"2023-05-10T01:24:56.060528+0000","last_peered":"2023-05-10T01:24:56.060528+0000","last_clean":"2023-05-10T01:24:56.060528+0000","last_became_active":"2023-05-10T01:24:56.055671+0000","last_became_peered":"2023-05-10T01:24:56.055671+0000","last_unstale":"2023-05-10T01:24:56.060528+0000","last_undegraded":"2023-05-10T01:24:56.060528+0000","last_fullsized":"2023-05-10T01:24:56.060528+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.042275+0000","last_change":"2023-05-10T01:24:55.652850+0000","last_active":"2023-05-10T01:24:56.042275+0000","last_peered":"2023-05-10T01:24:56.042275+0000","last_clean":"2023-05-10T01:24:56.042275+0000","last_became_active":"2023-05-10T01:24:55.652528+0000","last_became_peered":"2023-05-10T01:24:55.652528+0000","last_unstale":"2023-05-10T01:24:56.042275+0000","last_undegraded":"2023-05-10T01:24:56.042275+0000","last_fullsized":"2023-05-10T01:24:56.042275+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039989+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:24:56.039989+0000","last_peered":"2023-05-10T01:24:56.039989+0000","last_clean":"2023-05-10T01:24:56.039989+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:24:56.039989+0000","last_undegraded":"2023-05-10T01:24:56.039989+0000","last_fullsized":"2023-05-10T01:24:56.039989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.065415+0000","last_change":"2023-05-10T01:24:56.060440+0000","last_active":"2023-05-10T01:24:56.065415+0000","last_peered":"2023-05-10T01:24:56.065415+0000","last_clean":"2023-05-10T01:24:56.065415+0000","last_became_active":"2023-05-10T01:24:56.060088+0000","last_became_peered":"2023-05-10T01:24:56.060088+0000","last_unstale":"2023-05-10T01:24:56.065415+0000","last_undegraded":"2023-05-10T01:24:56.065415+0000","last_fullsized":"2023-05-10T01:24:56.065415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.041216+0000","last_change":"2023-05-10T01:24:55.652884+0000","last_active":"2023-05-10T01:24:56.041216+0000","last_peered":"2023-05-10T01:24:56.041216+0000","last_clean":"2023-05-10T01:24:56.041216+0000","last_became_active":"2023-05-10T01:24:55.652548+0000","last_became_peered":"2023-05-10T01:24:55.652548+0000","last_unstale":"2023-05-10T01:24:56.041216+0000","last_undegraded":"2023-05-10T01:24:56.041216+0000","last_fullsized":"2023-05-10T01:24:56.041216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.047278+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:24:56.047278+0000","last_peered":"2023-05-10T01:24:56.047278+0000","last_clean":"2023-05-10T01:24:56.047278+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:24:56.047278+0000","last_undegraded":"2023-05-10T01:24:56.047278+0000","last_fullsized":"2023-05-10T01:24:56.047278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038515+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:24:56.038515+0000","last_peered":"2023-05-10T01:24:56.038515+0000","last_clean":"2023-05-10T01:24:56.038515+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:24:56.038515+0000","last_undegraded":"2023-05-10T01:24:56.038515+0000","last_fullsized":"2023-05-10T01:24:56.038515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045366+0000","last_change":"2023-05-10T01:24:56.043832+0000","last_active":"2023-05-10T01:24:56.045366+0000","last_peered":"2023-05-10T01:24:56.045366+0000","last_clean":"2023-05-10T01:24:56.045366+0000","last_became_active":"2023-05-10T01:24:56.043569+0000","last_became_peered":"2023-05-10T01:24:56.043569+0000","last_unstale":"2023-05-10T01:24:56.045366+0000","last_undegraded":"2023-05-10T01:24:56.045366+0000","last_fullsized":"2023-05-10T01:24:56.045366+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.036644+0000","last_change":"2023-05-10T01:24:55.653598+0000","last_active":"2023-05-10T01:24:56.036644+0000","last_peered":"2023-05-10T01:24:56.036644+0000","last_clean":"2023-05-10T01:24:56.036644+0000","last_became_active":"2023-05-10T01:24:55.653218+0000","last_became_peered":"2023-05-10T01:24:55.653218+0000","last_unstale":"2023-05-10T01:24:56.036644+0000","last_undegraded":"2023-05-10T01:24:56.036644+0000","last_fullsized":"2023-05-10T01:24:56.036644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.038604+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:24:56.038604+0000","last_peered":"2023-05-10T01:24:56.038604+0000","last_clean":"2023-05-10T01:24:56.038604+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:24:56.038604+0000","last_undegraded":"2023-05-10T01:24:56.038604+0000","last_fullsized":"2023-05-10T01:24:56.038604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064382+0000","last_change":"2023-05-10T01:24:56.057487+0000","last_active":"2023-05-10T01:24:56.064382+0000","last_peered":"2023-05-10T01:24:56.064382+0000","last_clean":"2023-05-10T01:24:56.064382+0000","last_became_active":"2023-05-10T01:24:56.057170+0000","last_became_peered":"2023-05-10T01:24:56.057170+0000","last_unstale":"2023-05-10T01:24:56.064382+0000","last_undegraded":"2023-05-10T01:24:56.064382+0000","last_fullsized":"2023-05-10T01:24:56.064382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.043736+0000","last_change":"2023-05-10T01:24:55.659797+0000","last_active":"2023-05-10T01:24:56.043736+0000","last_peered":"2023-05-10T01:24:56.043736+0000","last_clean":"2023-05-10T01:24:56.043736+0000","last_became_active":"2023-05-10T01:24:55.659374+0000","last_became_peered":"2023-05-10T01:24:55.659374+0000","last_unstale":"2023-05-10T01:24:56.043736+0000","last_undegraded":"2023-05-10T01:24:56.043736+0000","last_fullsized":"2023-05-10T01:24:56.043736+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039142+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:24:56.039142+0000","last_peered":"2023-05-10T01:24:56.039142+0000","last_clean":"2023-05-10T01:24:56.039142+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:24:56.039142+0000","last_undegraded":"2023-05-10T01:24:56.039142+0000","last_fullsized":"2023-05-10T01:24:56.039142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.064683+0000","last_change":"2023-05-10T01:24:56.058212+0000","last_active":"2023-05-10T01:24:56.064683+0000","last_peered":"2023-05-10T01:24:56.064683+0000","last_clean":"2023-05-10T01:24:56.064683+0000","last_became_active":"2023-05-10T01:24:56.057943+0000","last_became_peered":"2023-05-10T01:24:56.057943+0000","last_unstale":"2023-05-10T01:24:56.064683+0000","last_undegraded":"2023-05-10T01:24:56.064683+0000","last_fullsized":"2023-05-10T01:24:56.064683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.060960+0000","last_change":"2023-05-10T01:24:55.650847+0000","last_active":"2023-05-10T01:24:56.060960+0000","last_peered":"2023-05-10T01:24:56.060960+0000","last_clean":"2023-05-10T01:24:56.060960+0000","last_became_active":"2023-05-10T01:24:55.650565+0000","last_became_peered":"2023-05-10T01:24:55.650565+0000","last_unstale":"2023-05-10T01:24:56.060960+0000","last_undegraded":"2023-05-10T01:24:56.060960+0000","last_fullsized":"2023-05-10T01:24:56.060960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.045083+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:24:56.045083+0000","last_peered":"2023-05-10T01:24:56.045083+0000","last_clean":"2023-05-10T01:24:56.045083+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:24:56.045083+0000","last_undegraded":"2023-05-10T01:24:56.045083+0000","last_fullsized":"2023-05-10T01:24:56.045083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.055548+0000","last_change":"2023-05-10T01:24:56.053725+0000","last_active":"2023-05-10T01:24:56.055548+0000","last_peered":"2023-05-10T01:24:56.055548+0000","last_clean":"2023-05-10T01:24:56.055548+0000","last_became_active":"2023-05-10T01:24:56.053482+0000","last_became_peered":"2023-05-10T01:24:56.053482+0000","last_unstale":"2023-05-10T01:24:56.055548+0000","last_undegraded":"2023-05-10T01:24:56.055548+0000","last_fullsized":"2023-05-10T01:24:56.055548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:55.627026+0000","last_clean_scrub_stamp":"2023-05-10T01:24:55.627026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.061629+0000","last_change":"2023-05-10T01:24:55.651557+0000","last_active":"2023-05-10T01:24:56.061629+0000","last_peered":"2023-05-10T01:24:56.061629+0000","last_clean":"2023-05-10T01:24:56.061629+0000","last_became_active":"2023-05-10T01:24:55.651285+0000","last_became_peered":"2023-05-10T01:24:55.651285+0000","last_unstale":"2023-05-10T01:24:56.061629+0000","last_undegraded":"2023-05-10T01:24:56.061629+0000","last_fullsized":"2023-05-10T01:24:56.061629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:24:54.625067+0000","last_clean_scrub_stamp":"2023-05-10T01:24:54.625067+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-05-10T01:24:56.039581+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:24:56.039581+0000","last_peered":"2023-05-10T01:24:56.039581+0000","last_clean":"2023-05-10T01:24:56.039581+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:24:56.039581+0000","last_undegraded":"2023-05-10T01:24:56.039581+0000","last_fullsized":"2023-05-10T01:24:56.039581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17584,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":16448,"kb_avail":94354256,"statfs":{"total":96636764160,"available":96618758144,"internally_reserved":0,"allocated":1155072,"data_stored":577673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16842752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.27000000000000002},"max":{"1min":0.80300000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.98199999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":3.016,"15min":3.016},"last":0.501},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.73199999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83499999999999996,"15min":0.93300000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.746,"15min":0.85899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58399999999999996}]},{"osd":4,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.31,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.53900000000000003,"5min":0.751,"15min":0.78000000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.37},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63600000000000001,"5min":0.84399999999999997,"15min":1.052},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66600000000000004,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed May 10 01:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.81399999999999995,"15min":0.95899999999999996},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16884,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94354956,"statfs":{"total":96636764160,"available":96619474944,"internally_reserved":0,"allocated":1159168,"data_stored":577811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.747,"15min":0.86199999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52300000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.90600000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.441,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86299999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.159},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":5,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.321},"last":0.42499999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20856,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":19712,"kb_avail":94350984,"statfs":{"total":96636764160,"available":96615407616,"internally_reserved":0,"allocated":1163264,"data_stored":578171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20185088},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.627,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.28199999999999997,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.68400000000000005,"15min":0.77800000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.35199999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.624,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.30399999999999999},"max":{"1min":0.60899999999999999,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.23400000000000001},"max":{"1min":0.57099999999999995,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.255}]},{"osd":4,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.92000000000000004,"15min":1.117},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.05},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":1.319},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.97799999999999998,"15min":1.079},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.51200000000000001,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.024,"15min":1.0960000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.439},"max":{"1min":0.88,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16616,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":15488,"kb_avail":94355224,"statfs":{"total":96636764160,"available":96619749376,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15859712},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.74199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.313}]},{"osd":2,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.44800000000000001},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.628,"15min":3.8370000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.441,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.73999999999999999,"15min":0.84099999999999997},"last":0.37}]},{"osd":3,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.85799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81399999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84299999999999997,"5min":0.93799999999999994,"15min":1.224},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40699999999999997},"max":{"1min":0.84499999999999997,"5min":0.91500000000000004,"15min":1.1559999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.42099999999999999},"max":{"1min":0.748,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed May 10 01:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.98599999999999999,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82399999999999995,"5min":1.353,"15min":1.353},"last":0.61199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22068,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":20928,"kb_avail":94349772,"statfs":{"total":96636764160,"available":96614166528,"internally_reserved":0,"allocated":1159168,"data_stored":578633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21430272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.59199999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.52900000000000003,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35299999999999998}]},{"osd":3,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41499999999999998,"15min":0.41599999999999998},"min":{"1min":0.309,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75},"last":0.33800000000000002}]},{"osd":4,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":1.012,"15min":1.012},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.44800000000000001}]},{"osd":5,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.91000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":0.91400000000000003,"15min":1.008},"last":0.435}]},{"osd":6,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.496}]},{"osd":7,"last update":"Wed May 10 01:24:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.091},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.44900000000000001},"max":{"1min":0.86199999999999999,"5min":0.94799999999999995,"15min":1.056},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24936,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94346904,"statfs":{"total":96636764160,"available":96611229696,"internally_reserved":0,"allocated":1146880,"data_stored":577097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.26200000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.56499999999999995,"5min":0.64900000000000002,"15min":0.65500000000000003},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.57999999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.66700000000000004,"15min":0.72999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.313,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.627,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65700000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82699999999999996,"5min":0.95499999999999996,"15min":1.0349999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.93300000000000005,"15min":1.0589999999999999},"last":0.34200000000000003}]},{"osd":5,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":1.27,"15min":1.27},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed May 10 01:24:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93000000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.875,"5min":1.1339999999999999,"15min":1.1579999999999999},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17140,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354700,"statfs":{"total":96636764160,"available":96619212800,"internally_reserved":0,"allocated":1159168,"data_stored":577775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45900000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.497},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":1.337,"15min":1.337},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.62},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.77000000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86599999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.434}]},{"osd":3,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.70099999999999996,"5min":0.748,"15min":0.83599999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.56699999999999995}]},{"osd":5,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46300000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68999999999999995,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.628},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.372,"15min":0.32800000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed May 10 01:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.0589999999999999},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20460,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":19328,"kb_avail":94351380,"statfs":{"total":96636764160,"available":96615813120,"internally_reserved":0,"allocated":1150976,"data_stored":577131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19791872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.47899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.746,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.62,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.46000000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.75600000000000001,"5min":1,"15min":1},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48699999999999999,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.51700000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.53000000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.46700000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85699999999999998,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.52300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81299999999999994,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":1.0620000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48499999999999999,"15min":0.498},"min":{"1min":0.373,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.495}]},{"osd":6,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":1.1120000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52100000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.78400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":1.1679999999999999},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:04.952 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:25:04.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:25:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.102+0000 7f66854f5700 1 Processor -- start 2023-05-10T01:25:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.102+0000 7f66854f5700 1 -- start start 2023-05-10T01:25:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f66854f5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66800aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f66854f5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66800c6100 0x7f6680069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f66854f5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6680154630 con 0x7f6680153a90 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f66854f5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800ca5f0 con 0x7f66800c6100 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f66854f5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c8820 con 0x7f66800c5d20 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6680153a90 0x7f6680153f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45172/0 (socket says 172.21.15.52:45172) 2023-05-10T01:25:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667f7fe700 1 -- 172.21.15.52:0/3449758796 learned_addr learned my addr 172.21.15.52:0/3449758796 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162370033 0 0) 0x7f6680154630 con 0x7f6680153a90 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667e7fc700 1 --2- 172.21.15.52:0/3449758796 >> v2:172.21.15.172:3300/0 conn(0x7f66800c6100 0x7f6680069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667effd700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66800aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66600033f0 con 0x7f6680153a90 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587115852 0 0) 0x7f66600033f0 con 0x7f6680153a90 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 msgr2=0x7f66800aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66800aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 >> v2:172.21.15.172:3300/0 conn(0x7f66800c6100 msgr2=0x7f6680069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 --2- 172.21.15.52:0/3449758796 >> v2:172.21.15.172:3300/0 conn(0x7f66800c6100 0x7f6680069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c8b00 con 0x7f6680153a90 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f6670001470 con 0x7f6680153a90 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 >> v1:172.21.15.52:6789/0 conn(0x7f6680153a90 legacy=0x7f6680153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66600038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6660003e10 0x7f6660004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6660004b80 0x7f6660005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800ca5f0 con 0x7f6660004b80 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c8820 con 0x7f6660003e10 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.103+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666000b910 con 0x7f66800c5d20 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6660004b80 0x7f6660005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667e7fc700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6660003e10 0x7f6660004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667effd700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66600038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 -- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 msgr2=0x7f66600038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66800c5d20 0x7f66600038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 -- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6660003e10 msgr2=0x7f6660004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6660003e10 0x7f6660004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 -- 172.21.15.52:0/3449758796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66600033f0 con 0x7f6660004b80 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667f7fe700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6660004b80 0x7f6660005000 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f667000c210 tx=0x7f66800c7050).ready entity=mon.0 client_cookie=ebfec3d715df655b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670007a60 con 0x7f6660004b80 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000ca80 con 0x7f6660004b80 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.104+0000 7f667dffb700 1 -- 172.21.15.52:0/3449758796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000ce00 con 0x7f6660004b80 2023-05-10T01:25:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 -- 172.21.15.52:0/3449758796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6660004b80 msgr2=0x7f6660005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 --2- 172.21.15.52:0/3449758796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6660004b80 0x7f6660005000 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f667000c210 tx=0x7f66800c7050).stop 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f667f7fe700 1 -- 172.21.15.52:0/3449758796 reap_dead start 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 -- 172.21.15.52:0/3449758796 shutdown_connections 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 -- 172.21.15.52:0/3449758796 >> 172.21.15.52:0/3449758796 conn(0x7f66800cb6f0 msgr2=0x7f66800c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 -- 172.21.15.52:0/3449758796 shutdown_connections 2023-05-10T01:25:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.105+0000 7f66854f5700 1 -- 172.21.15.52:0/3449758796 wait complete. 2023-05-10T01:25:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.106+0000 7f66854f5700 1 Processor -- start 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.106+0000 7f66854f5700 1 -- start start 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6680146970 0x7f66800c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66800c0120 0x7f6680157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c4db0 con 0x7f6680152910 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c4fa0 con 0x7f66800c0120 2023-05-10T01:25:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680157550 con 0x7f6680146970 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36168/0 (socket says 172.21.15.52:36168) 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 -- 172.21.15.52:0/2223760680 learned_addr learned my addr 172.21.15.52:0/2223760680 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667effd700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6680146970 0x7f66800c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667f7fe700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66800c0120 0x7f6680157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 -- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6680146970 msgr2=0x7f66800c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6680146970 0x7f66800c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 -- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66800c0120 msgr2=0x7f6680157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66800c0120 0x7f6680157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 -- 172.21.15.52:0/2223760680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c05a0 con 0x7f6680152910 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f667e7fc700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f66680109e0 tx=0x7f666800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668012610 con 0x7f6680152910 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668012770 con 0x7f6680152910 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668012af0 con 0x7f6680152910 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.107+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66801579e0 con 0x7f6680152910 2023-05-10T01:25:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.108+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6680156f00 con 0x7f6680152910 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.108+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6680066720 con 0x7f6680152910 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.109+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6668014470 con 0x7f6680152910 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.109+0000 7f6676ffd700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 0x7f6664061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.109+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f6668079f70 con 0x7f6680152910 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.109+0000 7f667effd700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 0x7f6664061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.110+0000 7f667effd700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 0x7f6664061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f66780094d0 tx=0x7f667800b040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.113+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66680a88f0 con 0x7f6680152910 2023-05-10T01:25:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.353+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f668006c340 con 0x7f6680152910 2023-05-10T01:25:05.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.357+0000 7f6676ffd700 1 -- 172.21.15.52:0/2223760680 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f666804edd0 con 0x7f6680152910 2023-05-10T01:25:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 msgr2=0x7f6664061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 0x7f6664061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f66780094d0 tx=0x7f667800b040).stop 2023-05-10T01:25:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 msgr2=0x7f66800bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f66680109e0 tx=0x7f666800b040).stop 2023-05-10T01:25:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 shutdown_connections 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f666405ed90 0x7f6664061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66800c0120 0x7f6680157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6680146970 0x7f66800c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 --2- 172.21.15.52:0/2223760680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6680152910 0x7f66800bfc30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 >> 172.21.15.52:0/2223760680 conn(0x7f66800cb6f0 msgr2=0x7f66800ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 shutdown_connections 2023-05-10T01:25:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.359+0000 7f66854f5700 1 -- 172.21.15.52:0/2223760680 wait complete. 2023-05-10T01:25:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:25:05.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.488+0000 7f1ad9aa6700 1 Processor -- start 2023-05-10T01:25:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.488+0000 7f1ad9aa6700 1 -- start start 2023-05-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad9aa6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ad4154160 0x7f1ad40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad9aa6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ad4154540 0x7f1ad40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad9aa6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40c0650 con 0x7f1ad4069690 2023-05-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad9aa6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40c1af0 con 0x7f1ad4154160 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad9aa6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40bfd20 con 0x7f1ad4154540 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ad4154160 0x7f1ad40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ad4069690 0x7f1ad4157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45194/0 (socket says 172.21.15.52:45194) 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad3fff700 1 -- 172.21.15.52:0/4054819846 learned_addr learned my addr 172.21.15.52:0/4054819846 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad2ffd700 1 --2- 172.21.15.52:0/4054819846 >> v2:172.21.15.172:3300/0 conn(0x7f1ad4154540 0x7f1ad40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4054819846 >> v2:172.21.15.172:3300/0 conn(0x7f1ad4154540 msgr2=0x7f1ad40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 --2- 172.21.15.52:0/4054819846 >> v2:172.21.15.172:3300/0 conn(0x7f1ad4154540 0x7f1ad40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4054819846 >> v1:172.21.15.52:6789/0 conn(0x7f1ad4069690 legacy=0x7f1ad4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad27fc700 1 -- 172.21.15.52:0/4054819846 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468311041 0 0) 0x7f1ad40c0650 con 0x7f1ad4069690 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4054819846 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40c0000 con 0x7f1ad4154160 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad37fe700 1 --2- 172.21.15.52:0/4054819846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4154160 0x7f1ad40c5c60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f1ad40844d0 tx=0x7f1ac4009060).ready entity=mon.0 client_cookie=47ddec85d62fff67 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad27fc700 1 -- 172.21.15.52:0/4054819846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40090d0 con 0x7f1ad4154160 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.489+0000 7f1ad27fc700 1 -- 172.21.15.52:0/4054819846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400b580 con 0x7f1ad4154160 2023-05-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad27fc700 1 -- 172.21.15.52:0/4054819846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400b900 con 0x7f1ad4154160 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4054819846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4154160 msgr2=0x7f1ad40c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4054819846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4154160 0x7f1ad40c5c60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f1ad40844d0 tx=0x7f1ac4009060).stop 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4054819846 shutdown_connections 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4054819846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4154160 0x7f1ad40c5c60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4054819846 >> v2:172.21.15.172:3300/0 conn(0x7f1ad4154540 0x7f1ad40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4054819846 >> 172.21.15.52:0/4054819846 conn(0x7f1ad40cb6f0 msgr2=0x7f1ad40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4054819846 shutdown_connections 2023-05-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.490+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4054819846 wait complete. 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.491+0000 7f1ad9aa6700 1 Processor -- start 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.491+0000 7f1ad9aa6700 1 -- start start 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ad4154160 0x7f1ad40c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad4154540 0x7f1ad40c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c9860 con 0x7f1ad4069690 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad413e0f0 con 0x7f1ad4154540 2023-05-10T01:25:05.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad9aa6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad413e3d0 con 0x7f1ad4154160 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36180/0 (socket says 172.21.15.52:36180) 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4059619759 learned_addr learned my addr 172.21.15.52:0/4059619759 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad2ffd700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ad4154160 0x7f1ad40c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad3fff700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad4154540 0x7f1ad40c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ad4154160 msgr2=0x7f1ad40c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ad4154160 0x7f1ad40c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad4154540 msgr2=0x7f1ad40c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad4154540 0x7f1ad40c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.492+0000 7f1ad37fe700 1 -- 172.21.15.52:0/4059619759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40092a0 con 0x7f1ad4069690 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1ad37fe700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f1ac4009f30 tx=0x7f1ac4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400b900 con 0x7f1ad4069690 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4000c90 con 0x7f1ad4069690 2023-05-10T01:25:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4155790 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac401b410 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.493+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41580d0 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.494+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad40666b0 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.494+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1ac402b070 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.494+0000 7f1acb7fe700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 0x7f1ab8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.495+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f1ac407b360 con 0x7f1ad4069690 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.495+0000 7f1ad2ffd700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 0x7f1ab8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.495+0000 7f1ad2ffd700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 0x7f1ab8061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1ad4154b80 tx=0x7f1abc008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:05.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.499+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ac404c7f0 con 0x7f1ad4069690 2023-05-10T01:25:05.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.717+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ad406c340 con 0x7f1ad4069690 2023-05-10T01:25:05.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.717+0000 7f1acb7fe700 1 -- 172.21.15.52:0/4059619759 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f1ac401f090 con 0x7f1ad4069690 2023-05-10T01:25:05.721 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:05.721 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:25:05.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 msgr2=0x7f1ab8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 0x7f1ab8061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1ad4154b80 tx=0x7f1abc008040).stop 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 msgr2=0x7f1ad41552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f1ac4009f30 tx=0x7f1ac4017000).stop 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 shutdown_connections 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f1ab805ed90 0x7f1ab8061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad4154540 0x7f1ad40c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad4069690 0x7f1ad41552a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 --2- 172.21.15.52:0/4059619759 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ad4154160 0x7f1ad40c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:05.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 >> 172.21.15.52:0/4059619759 conn(0x7f1ad40cb6f0 msgr2=0x7f1ad40abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:05.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 shutdown_connections 2023-05-10T01:25:05.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:05.719+0000 7f1ad9aa6700 1 -- 172.21.15.52:0/4059619759 wait complete. 2023-05-10T01:25:05.725 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:25:06.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:24:56.028119+0000', 'modified': '2023-05-10T01:24:59.036175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6666}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6666': {'gid': 6666, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/3577811350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 3577811350}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3577811350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:25:06.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:25:06.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-10T01:25:06.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.258+0000 7fa864a7c700 1 Processor -- start 2023-05-10T01:25:06.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.258+0000 7fa864a7c700 1 -- start start 2023-05-10T01:25:06.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.258+0000 7fa864a7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa8600aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa864a7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8600c5ca0 0x7fa8600c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa864a7c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600c08a0 con 0x7fa860154540 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa864a7c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600ab1f0 con 0x7fa8600c5ca0 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa864a7c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c6620 con 0x7fa860154160 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8600c5ca0 0x7fa8600c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85dd9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa860154540 0x7fa8600a9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45206/0 (socket says 172.21.15.52:45206) 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85dd9b700 1 -- 172.21.15.52:0/3197641095 learned_addr learned my addr 172.21.15.52:0/3197641095 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa8600aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3197641095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 msgr2=0x7fa8600aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa8600aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3197641095 >> v1:172.21.15.52:6789/0 conn(0x7fa860154540 legacy=0x7fa8600a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85d59a700 1 -- 172.21.15.52:0/3197641095 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26516745 0 0) 0x7fa8600c08a0 con 0x7fa860154540 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3197641095 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600bfc90 con 0x7fa8600c5ca0 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c6130 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fa850009e60 tx=0x7fa850009780).ready entity=mon.0 client_cookie=29f6784d40cfe24 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85d59a700 1 -- 172.21.15.52:0/3197641095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85000e070 con 0x7fa8600c5ca0 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85d59a700 1 -- 172.21.15.52:0/3197641095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85000bc30 con 0x7fa8600c5ca0 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.259+0000 7fa85d59a700 1 -- 172.21.15.52:0/3197641095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850012410 con 0x7fa8600c5ca0 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 -- 172.21.15.52:0/3197641095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8600c5ca0 msgr2=0x7fa8600c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c6130 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fa850009e60 tx=0x7fa850009780).stop 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 -- 172.21.15.52:0/3197641095 shutdown_connections 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c6130 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3197641095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa8600aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 -- 172.21.15.52:0/3197641095 >> 172.21.15.52:0/3197641095 conn(0x7fa8600cb6c0 msgr2=0x7fa8600c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 -- 172.21.15.52:0/3197641095 shutdown_connections 2023-05-10T01:25:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.260+0000 7fa864a7c700 1 -- 172.21.15.52:0/3197641095 wait complete. 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.261+0000 7fa864a7c700 1 Processor -- start 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.261+0000 7fa864a7c700 1 -- start start 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa860158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c4e00 con 0x7fa860154540 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c2bd0 con 0x7fa8600c5ca0 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860158840 con 0x7fa860154160 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36198/0 (socket says 172.21.15.52:36198) 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3879882927 learned_addr learned my addr 172.21.15.52:0/3879882927 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 msgr2=0x7fa860158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa860158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600c5ca0 msgr2=0x7fa8600c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 -- 172.21.15.52:0/3879882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009a20 con 0x7fa860154540 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa85000b6c0 tx=0x7fa850009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa8567fc700 1 -- 172.21.15.52:0/3879882927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85001c660 con 0x7fa860154540 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa8567fc700 1 -- 172.21.15.52:0/3879882927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85001c7c0 con 0x7fa860154540 2023-05-10T01:25:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600c41f0 con 0x7fa860154540 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa8567fc700 1 -- 172.21.15.52:0/3879882927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85001cb80 con 0x7fa860154540 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.262+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600c47b0 con 0x7fa860154540 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.264+0000 7fa8567fc700 1 -- 172.21.15.52:0/3879882927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa85001d420 con 0x7fa860154540 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.264+0000 7fa8567fc700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 0x7fa844061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.264+0000 7fa8567fc700 1 -- 172.21.15.52:0/3879882927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fa85007c1f0 con 0x7fa860154540 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.264+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 0x7fa844061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.265+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 0x7fa844061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa858006fd0 tx=0x7fa858008040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.266+0000 7fa87640eb80 1 Processor -- start 2023-05-10T01:25:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 -- start start 2023-05-10T01:25:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4ff8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f4fd1300 0x5641f4fcb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4f965e0 con 0x5641f501a480 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4f0d8a0 con 0x5641f4fd1300 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641f4f22900 con 0x5641f5015560 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa85dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa85dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36204/0 (socket says 172.21.15.52:36204) 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa85dd9b700 1 -- 172.21.15.52:0/365612076 learned_addr learned my addr 172.21.15.52:0/365612076 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f4fd1300 0x5641f4fcb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.267+0000 7fa85e59c700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4ff8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 -- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 msgr2=0x5641f4ff8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4ff8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 -- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f4fd1300 msgr2=0x5641f4fcb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f4fd1300 0x5641f4fcb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 -- 172.21.15.52:0/365612076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641f4dc5310 con 0x5641f501a480 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85e59c700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4ff8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa8600c5700 tx=0x7fa848007d50).ready entity=mon.0 client_cookie=33a7956bafe7ebdb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa83f7fe700 1 -- 172.21.15.52:0/365612076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848007320 con 0x5641f501a480 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa83f7fe700 1 -- 172.21.15.52:0/365612076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480074e0 con 0x5641f501a480 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.268+0000 7fa83f7fe700 1 -- 172.21.15.52:0/365612076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8480059b0 con 0x5641f501a480 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- 172.21.15.52:0/365612076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 msgr2=0x5641f5015940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fa8600c5700 tx=0x7fa848007d50).stop 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- 172.21.15.52:0/365612076 shutdown_connections 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f4fd1300 0x5641f4fcb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4ff8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 --2- 172.21.15.52:0/365612076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f501a480 0x5641f5015940 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- 172.21.15.52:0/365612076 >> 172.21.15.52:0/365612076 conn(0x5641f4d8de40 msgr2=0x5641f50199d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- 172.21.15.52:0/365612076 shutdown_connections 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- 172.21.15.52:0/365612076 wait complete. 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 -- start start 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.269+0000 7fa87640eb80 1 Processor -- start 2023-05-10T01:25:06.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ffbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f5011e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4ee9ed0 con 0x5641f4fd1300 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f5012c60 con 0x5641f5015560 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641f5010260 con 0x5641f501a480 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa87640eb80 10 client.0 ll_register_callbacks cb 0x5641f4f90200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36208/0 (socket says 172.21.15.52:36208) 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa85e59c700 1 -- 172.21.15.52:0/1516871567 learned_addr learned my addr 172.21.15.52:0/1516871567 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f5011e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.270+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ffbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 -- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 msgr2=0x5641f5011e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f5011e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 -- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 msgr2=0x5641f4ffbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ffbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 -- 172.21.15.52:0/1516871567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa848001060 con 0x5641f4fd1300 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f5011e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ffbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa85e59c700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa858013f00 tx=0x7fa858015040).ready entity=mon.0 client_cookie=125e87d2aed44ed7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858012e90 con 0x5641f4fd1300 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fa858020430 con 0x5641f4fd1300 2023-05-10T01:25:06.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641f4fc4460 con 0x5641f4fd1300 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa858020800 con 0x5641f4fd1300 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 10 client.6846 fetch_fsmap learned FSMap version 38 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5641f4f1b880 con 0x5641f4fd1300 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641f4fc4460 con 0x5641f4fd1300 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa858020960 con 0x5641f4fd1300 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 10 client.6846 fetch_fsmap finished waiting for FSMap version 38 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 10 client.6846 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-10T01:25:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 20 client.6846 populate_metadata read hostname 'smithi052' 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f4fcb2c0 0x5641f4fcb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 4 client.6846 mds_command: new command op to 6666 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.271+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 --> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641f4d89ca0 con 0x5641f4fcb2c0 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.272+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f4fcb2c0 0x5641f4fcb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.272+0000 7fa83cff9700 10 client.6846 ms_handle_connect on v2:172.21.15.52:6833/3577811350 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.272+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f4fcb2c0 0x5641f4fcb6a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4909de6029a6b944 server_cookie=ec64f7b2fff3f75c in_seq=0 out_seq=0 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa83cff9700 1 -- 172.21.15.52:0/1516871567 <== mds.0 v2:172.21.15.52:6833/3577811350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5641f4d89ca0 con 0x5641f4fcb2c0 2023-05-10T01:25:06.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa83cff9700 10 client.6846 handle_command_reply: tid=0 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 client.6846 shutdown 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 msgr2=0x5641f5029800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa858013f00 tx=0x7fa858015040).stop 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 shutdown_connections 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f4fcb2c0 0x5641f4fcb6a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f5011e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f5029800 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa83cff9700 0 client.6846 ms_handle_reset on v2:172.21.15.52:6833/3577811350 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 --2- 172.21.15.52:0/1516871567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ffbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 >> 172.21.15.52:0/1516871567 conn(0x5641f4d8de40 msgr2=0x5641f4fd0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 shutdown_connections 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 1 -- 172.21.15.52:0/1516871567 wait complete. 2023-05-10T01:25:06.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.273+0000 7fa87640eb80 20 client.6846 trim_cache size 0 max 16384 2023-05-10T01:25:06.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 Processor -- start 2023-05-10T01:25:06.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 -- start start 2023-05-10T01:25:06.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4fca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 0x5641f502f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4fd32f0 con 0x5641f4fd1300 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4fcd600 con 0x5641f501a480 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641f50194a0 con 0x5641f5015560 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36216/0 (socket says 172.21.15.52:36216) 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.290+0000 7fa85e59c700 1 -- 172.21.15.52:0/3388488675 learned_addr learned my addr 172.21.15.52:0/3388488675 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4fca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 0x5641f502f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 -- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 msgr2=0x5641f4fca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4fca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 -- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 msgr2=0x5641f502f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 0x5641f502f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 -- 172.21.15.52:0/3388488675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641f4f17070 con 0x5641f4fd1300 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 0x5641f502f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4fca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fa858013530 tx=0x7fa85801f000).ready entity=mon.0 client_cookie=3ac890281fbf24ce server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa83ffff700 1 -- 172.21.15.52:0/3388488675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858012a00 con 0x5641f4fd1300 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa83ffff700 1 -- 172.21.15.52:0/3388488675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858020430 con 0x5641f4fd1300 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa83ffff700 1 -- 172.21.15.52:0/3388488675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858020800 con 0x5641f4fd1300 2023-05-10T01:25:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa87640eb80 1 -- 172.21.15.52:0/3388488675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 msgr2=0x5641f4fcbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.291+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fa858013530 tx=0x7fa85801f000).stop 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 -- 172.21.15.52:0/3388488675 shutdown_connections 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f501a480 0x5641f502f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f4fcbcf0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3388488675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f5015560 0x5641f4fca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 -- 172.21.15.52:0/3388488675 >> 172.21.15.52:0/3388488675 conn(0x5641f4d8de40 msgr2=0x5641f4fcf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 -- 172.21.15.52:0/3388488675 shutdown_connections 2023-05-10T01:25:06.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 -- 172.21.15.52:0/3388488675 wait complete. 2023-05-10T01:25:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 -- start start 2023-05-10T01:25:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.292+0000 7fa87640eb80 1 Processor -- start 2023-05-10T01:25:06.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ff6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f4ff6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f4ff7470 con 0x5641f4fd1300 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f507c2f0 con 0x5641f5015560 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641f5033280 con 0x5641f501a480 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa87640eb80 10 client.0 ll_register_callbacks cb 0x5641f4f90200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36222/0 (socket says 172.21.15.52:36222) 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 -- 172.21.15.52:0/3781246828 learned_addr learned my addr 172.21.15.52:0/3781246828 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ff6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85ed9d700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f4ff6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 -- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 msgr2=0x5641f4ff6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f4ff6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 -- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 msgr2=0x5641f4ff6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ff6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.293+0000 7fa85e59c700 1 -- 172.21.15.52:0/3781246828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641f4f1b880 con 0x5641f4fd1300 2023-05-10T01:25:06.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa85e59c700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fa858008010 tx=0x7fa85802f000).ready entity=mon.0 client_cookie=ae17eeec9230d5a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580373f0 con 0x5641f4fd1300 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fa858037550 con 0x5641f4fd1300 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8480074e0 con 0x5641f4fd1300 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa858037920 con 0x5641f4fd1300 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 10 client.6852 fetch_fsmap learned FSMap version 38 2023-05-10T01:25:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5641f4f16dc0 con 0x5641f4fd1300 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480074e0 con 0x5641f4fd1300 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa858037a80 con 0x5641f4fd1300 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 10 client.6852 fetch_fsmap finished waiting for FSMap version 38 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 10 client.6852 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 20 client.6852 populate_metadata read hostname 'smithi052' 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f50107e0 0x5641f5010bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 4 client.6852 mds_command: new command op to 6666 tid=0[{"prefix": "status"}] 2023-05-10T01:25:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 --> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641f4dc0ca0 con 0x5641f50107e0 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.294+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f50107e0 0x5641f5010bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa83cff9700 10 client.6852 ms_handle_connect on v2:172.21.15.52:6833/3577811350 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa85dd9b700 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f50107e0 0x5641f5010bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b55f427d2c923803 server_cookie=ef8862bb87f64489 in_seq=0 out_seq=0 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa83cff9700 1 -- 172.21.15.52:0/3781246828 <== mds.0 v2:172.21.15.52:6833/3577811350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5641f4dc0ca0 con 0x5641f50107e0 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa83cff9700 10 client.6852 handle_command_reply: tid=0 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 client.6852 shutdown 2023-05-10T01:25:06.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 msgr2=0x5641f507a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fa858008010 tx=0x7fa85802f000).stop 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 shutdown_connections 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:6833/3577811350,v1:172.21.15.52:6835/3577811350] conn(0x5641f50107e0 0x5641f5010bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5641f501a480 0x5641f4ff6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641f4fd1300 0x5641f507a630 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 --2- 172.21.15.52:0/3781246828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641f5015560 0x5641f4ff6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa83cff9700 0 client.6852 ms_handle_reset on v2:172.21.15.52:6833/3577811350 2023-05-10T01:25:06.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 >> 172.21.15.52:0/3781246828 conn(0x5641f4d8de40 msgr2=0x5641f5019be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 shutdown_connections 2023-05-10T01:25:06.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 1 -- 172.21.15.52:0/3781246828 wait complete. 2023-05-10T01:25:06.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.295+0000 7fa87640eb80 20 client.6852 trim_cache size 0 max 16384 2023-05-10T01:25:06.310 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6666, 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.266644082999999, 2023-05-10T01:25:06.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 38, 2023-05-10T01:25:06.312 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 94, 2023-05-10T01:25:06.312 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 94, 2023-05-10T01:25:06.312 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 14.789008215999999 2023-05-10T01:25:06.312 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:25:06.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 msgr2=0x7fa844061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 0x7fa844061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa858006fd0 tx=0x7fa858008040).stop 2023-05-10T01:25:06.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 msgr2=0x7fa86014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fa85000b6c0 tx=0x7fa850009780).stop 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 shutdown_connections 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa84405ed60 0x7fa844061220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860154540 0x7fa86014c950 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600c5ca0 0x7fa8600c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 --2- 172.21.15.52:0/3879882927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa860154160 0x7fa860158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:06.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 >> 172.21.15.52:0/3879882927 conn(0x7fa8600cb6c0 msgr2=0x7fa8600c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 shutdown_connections 2023-05-10T01:25:06.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.296+0000 7fa864a7c700 1 -- 172.21.15.52:0/3879882927 wait complete. 2023-05-10T01:25:06.315 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:25:06.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.416+0000 7f53633f3700 1 Processor -- start 2023-05-10T01:25:06.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.416+0000 7f53633f3700 1 -- start start 2023-05-10T01:25:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f53633f3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f535c154190 0x7f535c0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f53633f3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0aaf30 con 0x7f535c0c5c40 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f53633f3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0c1440 con 0x7f535c153db0 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f53633f3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0c1720 con 0x7f535c154190 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f5361990700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f535c0c5c40 0x7f535c0ab3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45250/0 (socket says 172.21.15.52:45250) 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f5361990700 1 -- 172.21.15.52:0/3802113205 learned_addr learned my addr 172.21.15.52:0/3802113205 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f536098e700 1 --2- 172.21.15.52:0/3802113205 >> v2:172.21.15.172:3300/0 conn(0x7f535c154190 0x7f535c0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656366594 0 0) 0x7f535c0aaf30 con 0x7f535c0c5c40 2023-05-10T01:25:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53480033f0 con 0x7f535c0c5c40 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154690297 0 0) 0x7f53480033f0 con 0x7f535c0c5c40 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 >> v2:172.21.15.172:3300/0 conn(0x7f535c154190 msgr2=0x7f535c0635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 --2- 172.21.15.52:0/3802113205 >> v2:172.21.15.172:3300/0 conn(0x7f535c154190 0x7f535c0635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 >> v1:172.21.15.172:6789/0 conn(0x7f535c153db0 legacy=0x7f535c0c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0c1a00 con 0x7f535c0c5c40 2023-05-10T01:25:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f534c0017f0 con 0x7f535c0c5c40 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f536098e700 1 --2- 172.21.15.52:0/3802113205 >> v2:172.21.15.172:3300/0 conn(0x7f535c154190 0x7f535c0635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 >> v1:172.21.15.52:6789/0 conn(0x7f535c0c5c40 legacy=0x7f535c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53480038e0 0x7f5348003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348004690 0x7f5348004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 0x7f534800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.417+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0c1720 con 0x7f5348005000 2023-05-10T01:25:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534800bf60 con 0x7f53480038e0 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534800c0f0 con 0x7f5348004690 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 0x7f534800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f536118f700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53480038e0 0x7f5348003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f536098e700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348004690 0x7f5348004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 -- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348004690 msgr2=0x7f5348004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348004690 0x7f5348004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 -- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53480038e0 msgr2=0x7f5348003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53480038e0 0x7f5348003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 -- 172.21.15.52:0/3802113205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480033f0 con 0x7f5348005000 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 -- 172.21.15.52:0/3802113205 reap_dead start 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f5361990700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 0x7f534800b8e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f534c00c480 tx=0x7f534c00c790).ready entity=mon.0 client_cookie=ca26e50956752f72 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c002030 con 0x7f5348005000 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00ce20 con 0x7f5348005000 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.418+0000 7f535bfff700 1 -- 172.21.15.52:0/3802113205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c005d30 con 0x7f5348005000 2023-05-10T01:25:06.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 -- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 msgr2=0x7f534800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 0x7f534800b8e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f534c00c480 tx=0x7f534c00c790).stop 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 -- 172.21.15.52:0/3802113205 shutdown_connections 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 --2- 172.21.15.52:0/3802113205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5348005000 0x7f534800b8e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 -- 172.21.15.52:0/3802113205 >> 172.21.15.52:0/3802113205 conn(0x7f535c0cac90 msgr2=0x7f535c0cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 -- 172.21.15.52:0/3802113205 shutdown_connections 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.419+0000 7f53633f3700 1 -- 172.21.15.52:0/3802113205 wait complete. 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.420+0000 7f53633f3700 1 Processor -- start 2023-05-10T01:25:06.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.420+0000 7f53633f3700 1 -- start start 2023-05-10T01:25:06.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348005000 0x7f535c0c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c155210 0x7f535c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c155690 con 0x7f535c150430 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0adc20 con 0x7f535c155210 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53633f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0c3470 con 0x7f5348005000 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36246/0 (socket says 172.21.15.52:36246) 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 -- 172.21.15.52:0/2778931299 learned_addr learned my addr 172.21.15.52:0/2778931299 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f536098e700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c155210 0x7f535c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f536118f700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348005000 0x7f535c0c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 -- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348005000 msgr2=0x7f535c0c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348005000 0x7f535c0c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 -- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c155210 msgr2=0x7f535c0c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c155210 0x7f535c0c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 -- 172.21.15.52:0/2778931299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0c3750 con 0x7f535c150430 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f5361990700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f535c083ff0 tx=0x7f534c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.421+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c002030 con 0x7f535c150430 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.422+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0017b0 con 0x7f535c150430 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.422+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c005ea0 con 0x7f535c150430 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.422+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0c3a30 con 0x7f535c150430 2023-05-10T01:25:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.422+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c0c4b30 con 0x7f535c150430 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.422+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c05ef90 con 0x7f535c150430 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.423+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f534c01d070 con 0x7f535c150430 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.423+0000 7f53597fa700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 0x7f533c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.423+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f534c07ae30 con 0x7f535c150430 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.423+0000 7f536118f700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 0x7f533c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.424+0000 7f536118f700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 0x7f533c061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5354000c00 tx=0x7f5354009040).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:06.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.427+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f534c04c340 con 0x7f535c150430 2023-05-10T01:25:06.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.644+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f535c0add60 con 0x7f535c150430 2023-05-10T01:25:06.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.644+0000 7f53597fa700 1 -- 172.21.15.52:0/2778931299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f534c01a030 con 0x7f535c150430 2023-05-10T01:25:06.649 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:25:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 msgr2=0x7f533c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 0x7f533c061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5354000c00 tx=0x7f5354009040).stop 2023-05-10T01:25:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 msgr2=0x7f535c1508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f535c083ff0 tx=0x7f534c015000).stop 2023-05-10T01:25:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 shutdown_connections 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f533c05ed90 0x7f533c061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535c150430 0x7f535c1508b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5348005000 0x7f535c0c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 --2- 172.21.15.52:0/2778931299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c155210 0x7f535c0c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 >> 172.21.15.52:0/2778931299 conn(0x7f535c0cac90 msgr2=0x7f535c152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 shutdown_connections 2023-05-10T01:25:06.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:06.646+0000 7f53633f3700 1 -- 172.21.15.52:0/2778931299 wait complete. 2023-05-10T01:25:06.660 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:25:06.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:25:06.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:25:06.662 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:25:06.662 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:06.662 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:25:06.662 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:25:06.663 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:25:06.663 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:25:06.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.664 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:25:06.679 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:25:06.679 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:06.680 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41329sec preferred_lft 41329sec 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:06.681 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:25:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:25:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:06.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.684 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:25:06.742 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:25:06.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.744 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:25:06.799 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:25:06.799 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:25:06.799 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:25:06.799 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:25:06.799 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:25:06.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.800 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:25:06.800 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:25:06.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:25:06.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:25:06.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:25:06.802 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:25:06.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.900 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:25:06.914 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:25:06.914 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:25:06.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:25:06.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:25:06.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:06.979 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:07.033 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:25:07.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:07.112 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:07.113 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:25:07.154 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:07.154 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:25:07.156 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:25:07.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:07.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:07.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:25:07.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.374+0000 7f59b9ef0700 1 Processor -- start 2023-05-10T01:25:07.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.374+0000 7f59b9ef0700 1 -- start start 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b9ef0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59b4150cd0 0x7f59b4064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b9ef0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b40696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b9ef0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b40653e0 con 0x7f59b41510b0 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b9ef0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b40bda40 con 0x7f59b4150cd0 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b9ef0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40bdd20 con 0x7f59b40bd4d0 2023-05-10T01:25:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59b4150cd0 0x7f59b4064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59b4150cd0 0x7f59b4064ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36256/0 (socket says 172.21.15.52:36256) 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b37fe700 1 -- 172.21.15.52:0/814271153 learned_addr learned my addr 172.21.15.52:0/814271153 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b37fe700 1 -- 172.21.15.52:0/814271153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 msgr2=0x7f59b40696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.375+0000 7f59b37fe700 1 --2- 172.21.15.52:0/814271153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b40696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b37fe700 1 -- 172.21.15.52:0/814271153 >> v1:172.21.15.172:6789/0 conn(0x7f59b41510b0 legacy=0x7f59b4155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b37fe700 1 -- 172.21.15.52:0/814271153 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40be000 con 0x7f59b4150cd0 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b37fe700 1 --2- 172.21.15.52:0/814271153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b4150cd0 0x7f59b4064ef0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f59a4006fd0 tx=0x7f59a40090f0).ready entity=mon.0 client_cookie=664b83c4b6435579 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b27fc700 1 -- 172.21.15.52:0/814271153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400b600 con 0x7f59b4150cd0 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b27fc700 1 -- 172.21.15.52:0/814271153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400b760 con 0x7f59b4150cd0 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b27fc700 1 -- 172.21.15.52:0/814271153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400bae0 con 0x7f59b4150cd0 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 -- 172.21.15.52:0/814271153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b4150cd0 msgr2=0x7f59b4064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/814271153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b4150cd0 0x7f59b4064ef0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f59a4006fd0 tx=0x7f59a40090f0).stop 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 -- 172.21.15.52:0/814271153 shutdown_connections 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/814271153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b40696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:07.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/814271153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b4150cd0 0x7f59b4064ef0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 -- 172.21.15.52:0/814271153 >> 172.21.15.52:0/814271153 conn(0x7f59b4063620 msgr2=0x7f59b40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 -- 172.21.15.52:0/814271153 shutdown_connections 2023-05-10T01:25:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.376+0000 7f59b9ef0700 1 -- 172.21.15.52:0/814271153 wait complete. 2023-05-10T01:25:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 Processor -- start 2023-05-10T01:25:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 -- start start 2023-05-10T01:25:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 0x7f59b41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4152010 con 0x7f59b41510b0 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b41522f0 con 0x7f59b4150cd0 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.378+0000 7f59b9ef0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b41525d0 con 0x7f59b40bd4d0 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36266/0 (socket says 172.21.15.52:36266) 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 -- 172.21.15.52:0/297769206 learned_addr learned my addr 172.21.15.52:0/297769206 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b37fe700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b2ffd700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 0x7f59b41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 -- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 msgr2=0x7f59b41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 -- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 msgr2=0x7f59b41515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 0x7f59b41515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 -- 172.21.15.52:0/297769206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a4009370 con 0x7f59b41510b0 2023-05-10T01:25:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b2ffd700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 0x7f59b41515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b37fe700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b3fff700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f59ac00bc30 tx=0x7f59ac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00c7a0 con 0x7f59b41510b0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac010070 con 0x7f59b41510b0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b41528b0 con 0x7f59b41510b0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00c960 con 0x7f59b41510b0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.379+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b4140dc0 con 0x7f59b41510b0 2023-05-10T01:25:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.380+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b40c1c80 con 0x7f59b41510b0 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.380+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f59ac01c070 con 0x7f59b41510b0 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.381+0000 7f599b7fe700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 0x7f5994061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.381+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f59ac079410 con 0x7f59b41510b0 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.381+0000 7f59b37fe700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 0x7f5994061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.381+0000 7f59b37fe700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 0x7f5994061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f59b40bce30 tx=0x7f59a4017000).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.385+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59ac04a8a0 con 0x7f59b41510b0 2023-05-10T01:25:07.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.586+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f59b406c340 con 0x7f599405ed90 2023-05-10T01:25:07.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.588+0000 7f599b7fe700 1 -- 172.21.15.52:0/297769206 <== mgr.6130 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f59b406c340 con 0x7f599405ed90 2023-05-10T01:25:07.591 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:25:07.591 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:07.592 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:25:07.592 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:07.592 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:25:07.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 msgr2=0x7f5994061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 0x7f5994061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f59b40bce30 tx=0x7f59a4017000).stop 2023-05-10T01:25:07.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 msgr2=0x7f59b41538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f59ac00bc30 tx=0x7f59ac009840).stop 2023-05-10T01:25:07.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 shutdown_connections 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f599405ed90 0x7f5994061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b41510b0 0x7f59b41538f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59b40bd4d0 0x7f59b41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 --2- 172.21.15.52:0/297769206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59b4150cd0 0x7f59b41515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 >> 172.21.15.52:0/297769206 conn(0x7f59b4063620 msgr2=0x7f59b414a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 shutdown_connections 2023-05-10T01:25:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.589+0000 7f59b9ef0700 1 -- 172.21.15.52:0/297769206 wait complete. 2023-05-10T01:25:07.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:25:07.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.718+0000 7f37907db700 1 Processor -- start 2023-05-10T01:25:07.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.718+0000 7f37907db700 1 -- start start 2023-05-10T01:25:07.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f37907db700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f37880aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f37907db700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 0x7f37880685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f37907db700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880c94c0 con 0x7f3788154080 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f37907db700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37880cb7d0 con 0x7f3788068150 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f37907db700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788068ab0 con 0x7f3788154460 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f378ed78700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 0x7f37880685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f378dd76700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f37880aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f378ed78700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 0x7f37880685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:34596/0 (socket says 172.21.15.52:34596) 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.719+0000 7f378ed78700 1 -- 172.21.15.52:0/2739499560 learned_addr learned my addr 172.21.15.52:0/2739499560 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378dd76700 1 -- 172.21.15.52:0/2739499560 >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 msgr2=0x7f37880685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378dd76700 1 --2- 172.21.15.52:0/2739499560 >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 0x7f37880685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378dd76700 1 -- 172.21.15.52:0/2739499560 >> v1:172.21.15.172:6789/0 conn(0x7f3788154080 legacy=0x7f37880a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378dd76700 1 -- 172.21.15.52:0/2739499560 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880c88b0 con 0x7f3788154460 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378dd76700 1 --2- 172.21.15.52:0/2739499560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f37880aac90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f377c009760 tx=0x7f377c009060).ready entity=mon.2 client_cookie=aaed55de5b8e6a56 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378d575700 1 -- 172.21.15.52:0/2739499560 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00f510 con 0x7f3788154460 2023-05-10T01:25:07.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378d575700 1 -- 172.21.15.52:0/2739499560 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00f670 con 0x7f3788154460 2023-05-10T01:25:07.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.720+0000 7f378d575700 1 -- 172.21.15.52:0/2739499560 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00f9f0 con 0x7f3788154460 2023-05-10T01:25:07.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 -- 172.21.15.52:0/2739499560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 msgr2=0x7f37880aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 --2- 172.21.15.52:0/2739499560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f37880aac90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f377c009760 tx=0x7f377c009060).stop 2023-05-10T01:25:07.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 -- 172.21.15.52:0/2739499560 shutdown_connections 2023-05-10T01:25:07.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 --2- 172.21.15.52:0/2739499560 >> v2:172.21.15.172:3300/0 conn(0x7f3788068150 0x7f37880685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 --2- 172.21.15.52:0/2739499560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f37880aac90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 -- 172.21.15.52:0/2739499560 >> 172.21.15.52:0/2739499560 conn(0x7f3788067910 msgr2=0x7f37880cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 -- 172.21.15.52:0/2739499560 shutdown_connections 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.721+0000 7f37907db700 1 -- 172.21.15.52:0/2739499560 wait complete. 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.722+0000 7f37907db700 1 Processor -- start 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.722+0000 7f37907db700 1 -- start start 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3788068150 0x7f37881510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f378814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788150c20 con 0x7f3788154080 2023-05-10T01:25:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788150610 con 0x7f3788068150 2023-05-10T01:25:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788152620 con 0x7f3788154460 2023-05-10T01:25:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36278/0 (socket says 172.21.15.52:36278) 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 -- 172.21.15.52:0/1315577498 learned_addr learned my addr 172.21.15.52:0/1315577498 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378e577700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3788068150 0x7f37881510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378ed78700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f378814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 -- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 msgr2=0x7f378814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f378814e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 -- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3788068150 msgr2=0x7f37881510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3788068150 0x7f37881510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 -- 172.21.15.52:0/1315577498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0092a0 con 0x7f3788154080 2023-05-10T01:25:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f378dd76700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f377c009e00 tx=0x7f377c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00f7e0 con 0x7f3788154080 2023-05-10T01:25:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37881508b0 con 0x7f3788154080 2023-05-10T01:25:07.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00f940 con 0x7f3788154080 2023-05-10T01:25:07.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.723+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c01b660 con 0x7f3788154080 2023-05-10T01:25:07.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.724+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3788152900 con 0x7f3788154080 2023-05-10T01:25:07.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.724+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3788150dd0 con 0x7f3788154080 2023-05-10T01:25:07.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.725+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f377c02b070 con 0x7f3788154080 2023-05-10T01:25:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.725+0000 7f37867fc700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.725+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f377c07b4c0 con 0x7f3788154080 2023-05-10T01:25:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.725+0000 7f378e577700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.726+0000 7f378e577700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 0x7f3768061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3780004290 tx=0x7f3780001560).ready entity=mgr.6130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.729+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3788150dd0 con 0x7f3788154080 2023-05-10T01:25:07.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:07.954+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3788066720 con 0x7f3788154080 2023-05-10T01:25:08.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.537+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f377c00f070 con 0x7f3788154080 2023-05-10T01:25:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.539+0000 7f37867fc700 1 -- 172.21.15.52:0/1315577498 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7f377c041a20 con 0x7f3788154080 2023-05-10T01:25:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 msgr2=0x7f3768061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 0x7f3768061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3780004290 tx=0x7f3780001560).stop 2023-05-10T01:25:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 msgr2=0x7f3788151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f377c009e00 tx=0x7f377c017000).stop 2023-05-10T01:25:08.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 shutdown_connections 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f376805ed90 0x7f3768061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3788154460 0x7f378814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3788068150 0x7f37881510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 --2- 172.21.15.52:0/1315577498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788154080 0x7f3788151df0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 >> 172.21.15.52:0/1315577498 conn(0x7f3788067910 msgr2=0x7f37880ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 shutdown_connections 2023-05-10T01:25:08.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.541+0000 7f37907db700 1 -- 172.21.15.52:0/1315577498 wait complete. 2023-05-10T01:25:08.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:25:08.681 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:08.678+0000 7f37fde80680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:08.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.683+0000 7f5f5851e700 1 Processor -- start 2023-05-10T01:25:08.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.683+0000 7f5f5851e700 1 -- start start 2023-05-10T01:25:08.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f5851e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f50152210 0x7f5f500c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f5851e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f500a6670 0x7f5f500c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f5851e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5005e390 con 0x7f5f50151e30 2023-05-10T01:25:08.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f5851e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500c38d0 con 0x7f5f50152210 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f5851e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500c2400 con 0x7f5f500a6670 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f55ab9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f50152210 0x7f5f500c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f562ba700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5f50151e30 0x7f5f500bd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45326/0 (socket says 172.21.15.52:45326) 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f562ba700 1 -- 172.21.15.52:0/262778963 learned_addr learned my addr 172.21.15.52:0/262778963 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f56abb700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f500a6670 0x7f5f500c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f55ab9700 1 -- 172.21.15.52:0/262778963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f500a6670 msgr2=0x7f5f500c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:08.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f55ab9700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f500a6670 0x7f5f500c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f55ab9700 1 -- 172.21.15.52:0/262778963 >> v1:172.21.15.52:6789/0 conn(0x7f5f50151e30 legacy=0x7f5f500bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f552b8700 1 -- 172.21.15.52:0/262778963 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550324879 0 0) 0x7f5f5005e390 con 0x7f5f50151e30 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.684+0000 7f5f55ab9700 1 -- 172.21.15.52:0/262778963 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500bbfe0 con 0x7f5f50152210 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f55ab9700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f50152210 0x7f5f500c1a20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f5f4c009760 tx=0x7f5f4c009060).ready entity=mon.0 client_cookie=b964338add59d289 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f552b8700 1 -- 172.21.15.52:0/262778963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00f510 con 0x7f5f50152210 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f552b8700 1 -- 172.21.15.52:0/262778963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00f670 con 0x7f5f50152210 2023-05-10T01:25:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f552b8700 1 -- 172.21.15.52:0/262778963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00f9f0 con 0x7f5f50152210 2023-05-10T01:25:08.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 -- 172.21.15.52:0/262778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f50152210 msgr2=0x7f5f500c1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f50152210 0x7f5f500c1a20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f5f4c009760 tx=0x7f5f4c009060).stop 2023-05-10T01:25:08.692 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f4d01df1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:08.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 -- 172.21.15.52:0/262778963 shutdown_connections 2023-05-10T01:25:08.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f500a6670 0x7f5f500c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 --2- 172.21.15.52:0/262778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f50152210 0x7f5f500c1a20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 -- 172.21.15.52:0/262778963 >> 172.21.15.52:0/262778963 conn(0x7f5f500c45f0 msgr2=0x7f5f50066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:08.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.685+0000 7f5f5851e700 1 -- 172.21.15.52:0/262778963 shutdown_connections 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.686+0000 7f5f5851e700 1 -- 172.21.15.52:0/262778963 wait complete. 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 Processor -- start 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 -- start start 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f50151e30 0x7f5f50065f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 0x7f5f500a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a5480 con 0x7f5f500a6670 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a4870 con 0x7f5f50151e30 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f5851e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a4b50 con 0x7f5f50152210 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f562ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f562ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36312/0 (socket says 172.21.15.52:36312) 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.687+0000 7f5f562ba700 1 -- 172.21.15.52:0/4232564027 learned_addr learned my addr 172.21.15.52:0/4232564027 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f55ab9700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f50151e30 0x7f5f50065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:08.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f56abb700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 0x7f5f500a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 -- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 msgr2=0x7f5f500a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 0x7f5f500a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 -- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f50151e30 msgr2=0x7f5f50065f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f50151e30 0x7f5f50065f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 -- 172.21.15.52:0/4232564027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0092a0 con 0x7f5f500a6670 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f56abb700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 0x7f5f500a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f562ba700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f5f4000c4e0 tx=0x7f5f40007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:08.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400072e0 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40007440 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400057a0 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f500a4e30 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.688+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50142fc0 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.689+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f500a5760 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.690+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f5f40010070 con 0x7f5f500a6670 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.690+0000 7f5f3e7fc700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 0x7f5f300612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:08.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.690+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f5f40079320 con 0x7f5f500a6670 2023-05-10T01:25:08.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.690+0000 7f5f55ab9700 1 -- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 msgr2=0x7f5f300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:08.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.690+0000 7f5f55ab9700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 0x7f5f300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:08.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.694+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f4004a7b0 con 0x7f5f500a6670 2023-05-10T01:25:08.743 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:08.740+0000 7f37fde80680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:08.755 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:08.752+0000 7f4d01df1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:08.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.868+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5f50062fa0 con 0x7f5f500a6670 2023-05-10T01:25:08.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.872+0000 7f5f3e7fc700 1 -- 172.21.15.52:0/4232564027 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5f4004ddd0 con 0x7f5f500a6670 2023-05-10T01:25:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 msgr2=0x7f5f300612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 0x7f5f300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 msgr2=0x7f5f50142ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f5f4000c4e0 tx=0x7f5f40007c70).stop 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 shutdown_connections 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5f3005ede0 0x7f5f300612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f50152210 0x7f5f500a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f500a6670 0x7f5f50142ad0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 --2- 172.21.15.52:0/4232564027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f50151e30 0x7f5f50065f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 >> 172.21.15.52:0/4232564027 conn(0x7f5f500c45f0 msgr2=0x7f5f5014ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 shutdown_connections 2023-05-10T01:25:08.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:08.874+0000 7f5f5851e700 1 -- 172.21.15.52:0/4232564027 wait complete. 2023-05-10T01:25:08.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-10T01:25:09.011 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:09.008+0000 7f37fde80680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:09.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.010+0000 7f07eb59e700 1 Processor -- start 2023-05-10T01:25:09.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.010+0000 7f07eb59e700 1 -- start start 2023-05-10T01:25:09.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07eb59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f07ec062b30 0x7f07ec0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:09.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07eb59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec069430 con 0x7f07ec0698c0 2023-05-10T01:25:09.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07eb59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec069100 con 0x7f07ec062f10 2023-05-10T01:25:09.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07eb59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec065ba0 con 0x7f07ec062b30 2023-05-10T01:25:09.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ead9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f07ec0698c0 0x7f07ec0aaa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45366/0 (socket says 172.21.15.52:45366) 2023-05-10T01:25:09.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ead9d700 1 -- 172.21.15.52:0/910205424 learned_addr learned my addr 172.21.15.52:0/910205424 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:09.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ea59c700 1 --2- 172.21.15.52:0/910205424 >> v2:172.21.15.172:3300/0 conn(0x7f07ec062b30 0x7f07ec0aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:09.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710377315 0 0) 0x7f07ec069430 con 0x7f07ec0698c0 2023-05-10T01:25:09.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc0033f0 con 0x7f07ec0698c0 2023-05-10T01:25:09.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ea59c700 1 -- 172.21.15.52:0/910205424 >> v1:172.21.15.172:6789/0 conn(0x7f07ec062f10 legacy=0x7f07ec0a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:09.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747491892 0 0) 0x7f07ec069100 con 0x7f07ec062f10 2023-05-10T01:25:09.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ea59c700 1 -- 172.21.15.52:0/910205424 >> v1:172.21.15.52:6789/0 conn(0x7f07ec0698c0 legacy=0x7f07ec0aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:09.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ea59c700 1 -- 172.21.15.52:0/910205424 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec065e80 con 0x7f07ec062b30 2023-05-10T01:25:09.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.011+0000 7f07ea59c700 1 --2- 172.21.15.52:0/910205424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec0aa0f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f07dc009760 tx=0x7f07dc009060).ready entity=mon.1 client_cookie=25965155c912ed11 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:09.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00f510 con 0x7f07ec062b30 2023-05-10T01:25:09.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00f670 con 0x7f07ec062b30 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07e959a700 1 -- 172.21.15.52:0/910205424 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00f9f0 con 0x7f07ec062b30 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 -- 172.21.15.52:0/910205424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 msgr2=0x7f07ec0aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 --2- 172.21.15.52:0/910205424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec0aa0f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f07dc009760 tx=0x7f07dc009060).stop 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 -- 172.21.15.52:0/910205424 shutdown_connections 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 --2- 172.21.15.52:0/910205424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec0aa0f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 -- 172.21.15.52:0/910205424 >> 172.21.15.52:0/910205424 conn(0x7f07ec068a20 msgr2=0x7f07ec0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 -- 172.21.15.52:0/910205424 shutdown_connections 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.012+0000 7f07eb59e700 1 -- 172.21.15.52:0/910205424 wait complete. 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.013+0000 7f07eb59e700 1 Processor -- start 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.013+0000 7f07eb59e700 1 -- start start 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec062f10 0x7f07ec0a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07ec0698c0 0x7f07ec147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:09.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0a73e0 con 0x7f07ec062f10 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec167930 con 0x7f07ec062b30 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07eb59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec165190 con 0x7f07ec0698c0 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07e9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec062f10 0x7f07ec0a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07e9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec062f10 0x7f07ec0a6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36354/0 (socket says 172.21.15.52:36354) 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07e9d9b700 1 -- 172.21.15.52:0/2381846294 learned_addr learned my addr 172.21.15.52:0/2381846294 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:09.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.014+0000 7f07ead9d700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07ec0698c0 0x7f07ec147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07ec0698c0 msgr2=0x7f07ec147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07ec0698c0 0x7f07ec147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 msgr2=0x7f07ec145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07ec062b30 0x7f07ec145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0092a0 con 0x7f07ec062f10 2023-05-10T01:25:09.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e9d9b700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec062f10 0x7f07ec0a6ef0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f07d400c4e0 tx=0x7f07d4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400ce50 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400f470 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07eb59e700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec0a5370 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400f830 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.015+0000 7f07eb59e700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec0a4a50 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.016+0000 7f07eb59e700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec167ac0 con 0x7f07ec062f10 2023-05-10T01:25:09.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.016+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f07d4019030 con 0x7f07ec062f10 2023-05-10T01:25:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.017+0000 7f07e27fc700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.017+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f07d4078f80 con 0x7f07ec062f10 2023-05-10T01:25:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.017+0000 7f07ea59c700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.017+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:09.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.021+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07d40488f0 con 0x7f07ec062f10 2023-05-10T01:25:09.045 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:09.041+0000 7f4d01df1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:09.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.218+0000 7f07ea59c700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:09.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.218+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:09.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.221+0000 7f07eb59e700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f07ec047150 con 0x7f07d005ede0 2023-05-10T01:25:09.610 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:09.607+0000 7f37fde80680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.619+0000 7f07ea59c700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:09.619+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:25:09.681 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:09.678+0000 7f37fde80680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:09.702 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:09.699+0000 7f4d01df1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:09.770 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:09.767+0000 7f4d01df1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:09.864 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:09.861+0000 7f37fde80680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:09.963 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:09.959+0000 7f4d01df1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:10.274 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.271+0000 7f37fde80680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:10.374 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.371+0000 7f37fde80680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:10.396 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:10.393+0000 7f4d01df1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:10.420+0000 7f07ea59c700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:10.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:10.420+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:25:10.503 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:10.500+0000 7f4d01df1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:10.526 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.523+0000 7f37fde80680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:10.599 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.596+0000 7f37fde80680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:10.666 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:10.657+0000 7f4d01df1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:10.667 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.661+0000 7f37fde80680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:10.738 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:10.735+0000 7f4d01df1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:10.808 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:10.804+0000 7f4d01df1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:10.915 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:10.912+0000 7f37fde80680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:11.077 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:11.073+0000 7f4d01df1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:11.095 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:11.092+0000 7f37fde80680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:11.265 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:11.262+0000 7f4d01df1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:11.730 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:11.727+0000 7f37fde80680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:11.797 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:11.794+0000 7f37fde80680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:11.869 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:11.866+0000 7f37fde80680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:11.941 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:11.938+0000 7f4d01df1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:12.011 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.008+0000 7f37fde80680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:12.012 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.008+0000 7f4d01df1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:12.021+0000 7f07ea59c700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:12.022+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:25:12.081 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.078+0000 7f37fde80680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:12.091 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.088+0000 7f4d01df1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:12.193 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.190+0000 7f37fde80680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:12.242 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.238+0000 7f4d01df1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:12.298 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.295+0000 7f37fde80680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:12.315 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.311+0000 7f4d01df1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:12.433 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.430+0000 7f4d01df1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:12.545 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.541+0000 7f4d01df1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:12.582 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.580+0000 7f37fde80680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:12.650 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.648+0000 7f37fde80680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:12.717+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 33) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f07d4010070 con 0x7f07ec062f10 2023-05-10T01:25:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:12.717+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 msgr2=0x7f07d00612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:12.717+0000 7f07e27fc700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d00612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:12.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f377c662700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f377c662700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f377c662700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f3778e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f377c662700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f3778e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f377c662700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.782 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f3778e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.783 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f3778e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.783 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:12.778+0000 7f3778e5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:12.851 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.847+0000 7f4d01df1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:12.924 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:12.920+0000 7f4d01df1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.733+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f07d40770f0 con 0x7f07ec062f10 2023-05-10T01:25:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.733+0000 7f07e27fc700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.734+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f07ec047150 con 0x7f07d005ede0 2023-05-10T01:25:13.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.736+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.750+0000 7f07ea59c700 1 --2- 172.21.15.52:0/2381846294 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f07d005ede0 0x7f07d002fd40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f07dc009760 tx=0x7f07dc017000).ready entity=mgr.5936 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:13.755 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:13.752+0000 7f37ab90b700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-10T01:25:13.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.752+0000 7f07e27fc700 1 -- 172.21.15.52:0/2381846294 <== mgr.5936 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f07ec047150 con 0x7f07d005ede0 2023-05-10T01:25:13.757 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-10T01:25:13.761 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-10T01:25:13.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:25:13.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.886+0000 7efd3bfff700 1 Processor -- start 2023-05-10T01:25:13.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.886+0000 7efd3bfff700 1 -- start start 2023-05-10T01:25:13.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd3c0c1150 0x7efd3c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 0x7efd3c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3bfff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c0bfcb0 con 0x7efd3c157700 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3bfff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c06a990 con 0x7efd3c0c1150 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3bfff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c0aa400 con 0x7efd3c0c6090 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd3c0c1150 0x7efd3c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efd3c157700 0x7efd3c0a9cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45500/0 (socket says 172.21.15.52:45500) 2023-05-10T01:25:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd3c0c1150 0x7efd3c0c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36486/0 (socket says 172.21.15.52:36486) 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3affd700 1 -- 172.21.15.52:0/846112996 learned_addr learned my addr 172.21.15.52:0/846112996 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3b7fe700 1 --2- 172.21.15.52:0/846112996 >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 0x7efd3c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 -- 172.21.15.52:0/846112996 >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 msgr2=0x7efd3c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/846112996 >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 0x7efd3c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd39ffb700 1 -- 172.21.15.52:0/846112996 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609967027 0 0) 0x7efd3c0bfcb0 con 0x7efd3c157700 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 -- 172.21.15.52:0/846112996 >> v1:172.21.15.52:6789/0 conn(0x7efd3c157700 legacy=0x7efd3c0a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 -- 172.21.15.52:0/846112996 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c06a130 con 0x7efd3c0c1150 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3b7fe700 1 --2- 172.21.15.52:0/846112996 >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 0x7efd3c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/846112996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c0c5ba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7efd3c0841c0 tx=0x7efd30009060).ready entity=mon.0 client_cookie=2df3860865fbca64 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.887+0000 7efd39ffb700 1 -- 172.21.15.52:0/846112996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000b580 con 0x7efd3c0c1150 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd39ffb700 1 -- 172.21.15.52:0/846112996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000b6e0 con 0x7efd3c0c1150 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd39ffb700 1 -- 172.21.15.52:0/846112996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000ba60 con 0x7efd3c0c1150 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 -- 172.21.15.52:0/846112996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 msgr2=0x7efd3c0c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 --2- 172.21.15.52:0/846112996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c0c5ba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7efd3c0841c0 tx=0x7efd30009060).stop 2023-05-10T01:25:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 -- 172.21.15.52:0/846112996 shutdown_connections 2023-05-10T01:25:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 --2- 172.21.15.52:0/846112996 >> v2:172.21.15.172:3300/0 conn(0x7efd3c0c6090 0x7efd3c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 --2- 172.21.15.52:0/846112996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c0c5ba0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 -- 172.21.15.52:0/846112996 >> 172.21.15.52:0/846112996 conn(0x7efd3c0cb5f0 msgr2=0x7efd3c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 -- 172.21.15.52:0/846112996 shutdown_connections 2023-05-10T01:25:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.888+0000 7efd3bfff700 1 -- 172.21.15.52:0/846112996 wait complete. 2023-05-10T01:25:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.889+0000 7efd3bfff700 1 Processor -- start 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.889+0000 7efd3bfff700 1 -- start start 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 0x7efd3c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd3c157700 0x7efd3c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c154890 con 0x7efd3c0c1150 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c153c80 con 0x7efd3c0c6090 2023-05-10T01:25:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3bfff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c153f60 con 0x7efd3c157700 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36490/0 (socket says 172.21.15.52:36490) 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 -- 172.21.15.52:0/3054479654 learned_addr learned my addr 172.21.15.52:0/3054479654 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 0x7efd3c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3b7fe700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd3c157700 0x7efd3c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 -- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd3c157700 msgr2=0x7efd3c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd3c157700 0x7efd3c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 -- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 msgr2=0x7efd3c0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 0x7efd3c0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3affd700 1 -- 172.21.15.52:0/3054479654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300092a0 con 0x7efd3c0c1150 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.890+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 0x7efd3c0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd3affd700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7efd2c001eb0 tx=0x7efd2c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0072e0 con 0x7efd3c0c1150 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c007440 con 0x7efd3c0c1150 2023-05-10T01:25:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c154240 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0057a0 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.891+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c154d20 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.892+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c083110 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.892+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 34) v1 ==== 75179+0+0 (secure 0 0 0) 0x7efd2c01a060 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.892+0000 7efd22ffd700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 0x7efd1c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.893+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7efd2c079500 con 0x7efd3c0c1150 2023-05-10T01:25:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.893+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 0x7efd1c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.893+0000 7efd3a7fc700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 0x7efd1c061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efd30009fd0 tx=0x7efd30017000).ready entity=mgr.5936 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:13.897+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd2c04a880 con 0x7efd3c0c1150 2023-05-10T01:25:14.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.118+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7efd3c047150 con 0x7efd3c0c1150 2023-05-10T01:25:14.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.738+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7efd2c010070 con 0x7efd3c0c1150 2023-05-10T01:25:14.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.740+0000 7efd22ffd700 1 -- 172.21.15.52:0/3054479654 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7efd2c074840 con 0x7efd3c0c1150 2023-05-10T01:25:14.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 msgr2=0x7efd1c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 0x7efd1c061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efd30009fd0 tx=0x7efd30017000).stop 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 msgr2=0x7efd3c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7efd2c001eb0 tx=0x7efd2c007e90).stop 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 shutdown_connections 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efd1c05ed40 0x7efd1c061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd3c157700 0x7efd3c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd3c0c1150 0x7efd3c14cf80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 --2- 172.21.15.52:0/3054479654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd3c0c6090 0x7efd3c0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 >> 172.21.15.52:0/3054479654 conn(0x7efd3c0cb5f0 msgr2=0x7efd3c068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 shutdown_connections 2023-05-10T01:25:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:14.742+0000 7efd3bfff700 1 -- 172.21.15.52:0/3054479654 wait complete. 2023-05-10T01:25:14.762 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:25:14.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:25:14.794 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:25:14.822 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:25:14.823 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:25:14.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:14.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:14.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:25:14.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:14.869 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:25:14.886 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:14.883+0000 7fd36bfa7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:14.894 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:14.888+0000 7fa23326b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:14.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:14.947 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:14.944+0000 7fd36bfa7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:14.957 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:14.954+0000 7fa23326b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:15.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.063+0000 7f8b72cce700 1 Processor -- start 2023-05-10T01:25:15.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.063+0000 7f8b72cce700 1 -- start start 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b72cce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b6c153ea0 0x7f8b6c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b72cce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b72cce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c067550 con 0x7f8b6c068c60 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b72cce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c065960 con 0x7f8b6c153ea0 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b72cce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0bc9a0 con 0x7f8b6c064ff0 2023-05-10T01:25:15.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b6c153ea0 0x7f8b6c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b6bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8b6c068c60 0x7f8b6c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45564/0 (socket says 172.21.15.52:45564) 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b6bfff700 1 -- 172.21.15.52:0/2029357357 learned_addr learned my addr 172.21.15.52:0/2029357357 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b7126b700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 -- 172.21.15.52:0/2029357357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 msgr2=0x7f8b6c065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 -- 172.21.15.52:0/2029357357 >> v1:172.21.15.52:6789/0 conn(0x7f8b6c068c60 legacy=0x7f8b6c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b6b7fe700 1 -- 172.21.15.52:0/2029357357 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544380596 0 0) 0x7f8b58001110 con 0x7f8b6c068c60 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 -- 172.21.15.52:0/2029357357 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0bcc80 con 0x7f8b6c153ea0 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.064+0000 7f8b70a6a700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c154280 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f8b60009760 tx=0x7f8b60009060).ready entity=mon.0 client_cookie=f64dc1db7cb12abb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b6b7fe700 1 -- 172.21.15.52:0/2029357357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000f510 con 0x7f8b6c153ea0 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b6b7fe700 1 -- 172.21.15.52:0/2029357357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000f670 con 0x7f8b6c153ea0 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b6b7fe700 1 -- 172.21.15.52:0/2029357357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000f9f0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 -- 172.21.15.52:0/2029357357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 msgr2=0x7f8b6c154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c154280 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f8b60009760 tx=0x7f8b60009060).stop 2023-05-10T01:25:15.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 -- 172.21.15.52:0/2029357357 shutdown_connections 2023-05-10T01:25:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2029357357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c154280 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 -- 172.21.15.52:0/2029357357 >> 172.21.15.52:0/2029357357 conn(0x7f8b6c0c4420 msgr2=0x7f8b6c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 -- 172.21.15.52:0/2029357357 shutdown_connections 2023-05-10T01:25:15.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.065+0000 7f8b72cce700 1 -- 172.21.15.52:0/2029357357 wait complete. 2023-05-10T01:25:15.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.066+0000 7f8b72cce700 1 Processor -- start 2023-05-10T01:25:15.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.066+0000 7f8b72cce700 1 -- start start 2023-05-10T01:25:15.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c0a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c14db70 0x7f8b6c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0a92c0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0a7ce0 con 0x7f8b6c14db70 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b72cce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0a7fc0 con 0x7f8b6c064ff0 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b6bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b6bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36554/0 (socket says 172.21.15.52:36554) 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b6bfff700 1 -- 172.21.15.52:0/2903848709 learned_addr learned my addr 172.21.15.52:0/2903848709 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b70a6a700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c0a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.067+0000 7f8b7126b700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c14db70 0x7f8b6c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 msgr2=0x7f8b6c0a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c0a73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c14db70 msgr2=0x7f8b6c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c14db70 0x7f8b6c14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 -- 172.21.15.52:0/2903848709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600092a0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b6bfff700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8b5800c510 tx=0x7f8b58007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800ce80 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580072e0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c0a82a0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58007660 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.068+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c0a78d0 con 0x7f8b6c153ea0 2023-05-10T01:25:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.069+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c0a9470 con 0x7f8b6c153ea0 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.069+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f8b5801a060 con 0x7f8b6c153ea0 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.070+0000 7f8b68ff9700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 0x7f8b540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.070+0000 7f8b70a6a700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 msgr2=0x7f8b540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.070+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f8b58079310 con 0x7f8b6c153ea0 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.070+0000 7f8b70a6a700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 0x7f8b540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.074+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b6c0a9470 con 0x7f8b6c153ea0 2023-05-10T01:25:15.216 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:15.213+0000 7fd36bfa7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:15.247 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:15.243+0000 7fa23326b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:15.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.271+0000 7f8b70a6a700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 msgr2=0x7f8b540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:15.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.271+0000 7f8b70a6a700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 0x7f8b540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.290+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b6c067550 con 0x7f8b6c153ea0 2023-05-10T01:25:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.290+0000 7f8b68ff9700 1 -- 172.21.15.52:0/2903848709 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f8b6c067550 con 0x7f8b6c153ea0 2023-05-10T01:25:15.295 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:15.295 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:25:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 msgr2=0x7f8b540612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 0x7f8b540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 msgr2=0x7f8b6c14d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f8b5800c510 tx=0x7f8b58007ad0).stop 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 shutdown_connections 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8b5405ede0 0x7f8b540612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c14db70 0x7f8b6c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c064ff0 0x7f8b6c0a73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 --2- 172.21.15.52:0/2903848709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b6c153ea0 0x7f8b6c14d680 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.292+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 >> 172.21.15.52:0/2903848709 conn(0x7f8b6c0c4420 msgr2=0x7f8b6c0a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.293+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 shutdown_connections 2023-05-10T01:25:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.293+0000 7f8b72cce700 1 -- 172.21.15.52:0/2903848709 wait complete. 2023-05-10T01:25:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:25:15.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.463+0000 7feb6e7d0700 1 Processor -- start 2023-05-10T01:25:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.463+0000 7feb6e7d0700 1 -- start start 2023-05-10T01:25:15.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6e7d0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb680c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6e7d0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb68069da0 0x7feb680c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6e7d0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680c0650 con 0x7feb68154540 2023-05-10T01:25:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6e7d0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680c1af0 con 0x7feb68069da0 2023-05-10T01:25:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6e7d0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680bfd20 con 0x7feb68154160 2023-05-10T01:25:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb68069da0 0x7feb680c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb68069da0 0x7feb680c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36610/0 (socket says 172.21.15.52:36610) 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 -- 172.21.15.52:0/687203972 learned_addr learned my addr 172.21.15.52:0/687203972 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb67fff700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb680c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 -- 172.21.15.52:0/687203972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 msgr2=0x7feb680c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb680c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 -- 172.21.15.52:0/687203972 >> v1:172.21.15.172:6789/0 conn(0x7feb68154540 legacy=0x7feb68069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 -- 172.21.15.52:0/687203972 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680c0000 con 0x7feb68069da0 2023-05-10T01:25:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb6cd6d700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb680c6150 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7feb60009f20 tx=0x7feb60009840).ready entity=mon.0 client_cookie=695923a81104fade server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb66ffd700 1 -- 172.21.15.52:0/687203972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000e070 con 0x7feb68069da0 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb66ffd700 1 -- 172.21.15.52:0/687203972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000b9d0 con 0x7feb68069da0 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.464+0000 7feb66ffd700 1 -- 172.21.15.52:0/687203972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bd50 con 0x7feb68069da0 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 -- 172.21.15.52:0/687203972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 msgr2=0x7feb680c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb680c6150 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7feb60009f20 tx=0x7feb60009840).stop 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 -- 172.21.15.52:0/687203972 shutdown_connections 2023-05-10T01:25:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb680c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/687203972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb680c6150 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 -- 172.21.15.52:0/687203972 >> 172.21.15.52:0/687203972 conn(0x7feb680cb6f0 msgr2=0x7feb680c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 -- 172.21.15.52:0/687203972 shutdown_connections 2023-05-10T01:25:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.465+0000 7feb6e7d0700 1 -- 172.21.15.52:0/687203972 wait complete. 2023-05-10T01:25:15.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.466+0000 7feb6e7d0700 1 Processor -- start 2023-05-10T01:25:15.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.466+0000 7feb6e7d0700 1 -- start start 2023-05-10T01:25:15.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb6814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb68154540 0x7feb680ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68154af0 con 0x7feb68069da0 2023-05-10T01:25:15.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68154dd0 con 0x7feb68154540 2023-05-10T01:25:15.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6e7d0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb681550b0 con 0x7feb68154160 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb67fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb67fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36612/0 (socket says 172.21.15.52:36612) 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb67fff700 1 -- 172.21.15.52:0/4029363717 learned_addr learned my addr 172.21.15.52:0/4029363717 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb677fe700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb6814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.467+0000 7feb6cd6d700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb68154540 0x7feb680ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 -- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 msgr2=0x7feb6814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb6814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 -- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb68154540 msgr2=0x7feb680ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb68154540 0x7feb680ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 -- 172.21.15.52:0/4029363717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009ae0 con 0x7feb68069da0 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb67fff700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7feb5800e950 tx=0x7feb58009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58009530 con 0x7feb68069da0 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58012600 con 0x7feb68069da0 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb68157a80 con 0x7feb68069da0 2023-05-10T01:25:15.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58012980 con 0x7feb68069da0 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.468+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68158770 con 0x7feb68069da0 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.469+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68157fa0 con 0x7feb68069da0 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.470+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7feb58022070 con 0x7feb68069da0 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.470+0000 7feb4ffff700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 0x7feb480612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.470+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7feb5807a1c0 con 0x7feb68069da0 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.470+0000 7feb677fe700 1 -- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 msgr2=0x7feb480612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.470+0000 7feb677fe700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 0x7feb480612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:15.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.474+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb68157fa0 con 0x7feb68069da0 2023-05-10T01:25:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.649+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb68157fa0 con 0x7feb68069da0 2023-05-10T01:25:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.650+0000 7feb4ffff700 1 -- 172.21.15.52:0/4029363717 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17679 (secure 0 0 0) 0x7feb68157fa0 con 0x7feb68069da0 2023-05-10T01:25:15.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:15.654 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":95,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:12.662396+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2563192808":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6833/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:0/1367968119":"2023-05-11T01:25:12.662365+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 msgr2=0x7feb480612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 0x7feb480612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 msgr2=0x7feb68158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7feb5800e950 tx=0x7feb58009060).stop 2023-05-10T01:25:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 shutdown_connections 2023-05-10T01:25:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7feb4805ede0 0x7feb480612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb68154540 0x7feb680ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb68069da0 0x7feb68158280 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 --2- 172.21.15.52:0/4029363717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb68154160 0x7feb6814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 >> 172.21.15.52:0/4029363717 conn(0x7feb680cb6f0 msgr2=0x7feb6814d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 shutdown_connections 2023-05-10T01:25:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.652+0000 7feb6e7d0700 1 -- 172.21.15.52:0/4029363717 wait complete. 2023-05-10T01:25:15.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:24:54.574860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:24:54.992713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:25:15.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:25:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.788+0000 7f0ebfb19700 1 Processor -- start 2023-05-10T01:25:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 -- start start 2023-05-10T01:25:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150ba0 0x7f0eb8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0eb8150f80 0x7f0eb8068440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb8064e80 con 0x7f0eb80a6770 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb8068930 con 0x7f0eb8150f80 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.789+0000 7f0ebfb19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8065a00 con 0x7f0eb8150ba0 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0eb8150f80 0x7f0eb8068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0eb8150f80 0x7f0eb8068440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36622/0 (socket says 172.21.15.52:36622) 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/122029852 learned_addr learned my addr 172.21.15.52:0/122029852 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd8b5700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150ba0 0x7f0eb8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/122029852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150ba0 msgr2=0x7f0eb8067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150ba0 0x7f0eb8067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/122029852 >> v1:172.21.15.172:6789/0 conn(0x7f0eb80a6770 legacy=0x7f0eb8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/122029852 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80635a0 con 0x7f0eb8150f80 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebd0b4700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb8150f80 0x7f0eb8068440 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f0eb4006fd0 tx=0x7f0eb40090f0).ready entity=mon.0 client_cookie=c8316c6ba8c7b769 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebc8b3700 1 -- 172.21.15.52:0/122029852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400b600 con 0x7f0eb8150f80 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebc8b3700 1 -- 172.21.15.52:0/122029852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400b760 con 0x7f0eb8150f80 2023-05-10T01:25:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.790+0000 7f0ebc8b3700 1 -- 172.21.15.52:0/122029852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400bae0 con 0x7f0eb8150f80 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 -- 172.21.15.52:0/122029852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb8150f80 msgr2=0x7f0eb8068440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb8150f80 0x7f0eb8068440 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f0eb4006fd0 tx=0x7f0eb40090f0).stop 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 -- 172.21.15.52:0/122029852 shutdown_connections 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150ba0 0x7f0eb8067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/122029852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb8150f80 0x7f0eb8068440 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 -- 172.21.15.52:0/122029852 >> 172.21.15.52:0/122029852 conn(0x7f0eb80c8410 msgr2=0x7f0eb80c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 -- 172.21.15.52:0/122029852 shutdown_connections 2023-05-10T01:25:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.791+0000 7f0ebfb19700 1 -- 172.21.15.52:0/122029852 wait complete. 2023-05-10T01:25:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.793+0000 7f0ebfb19700 1 Processor -- start 2023-05-10T01:25:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.793+0000 7f0ebfb19700 1 -- start start 2023-05-10T01:25:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8150ba0 0x7f0eb80a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150f80 0x7f0eb81426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb814cf30 con 0x7f0eb80a6770 2023-05-10T01:25:15.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb814e8d0 con 0x7f0eb8150ba0 2023-05-10T01:25:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebfb19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb814ebb0 con 0x7f0eb8150f80 2023-05-10T01:25:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36626/0 (socket says 172.21.15.52:36626) 2023-05-10T01:25:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 -- 172.21.15.52:0/3236270586 learned_addr learned my addr 172.21.15.52:0/3236270586 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:15.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd0b4700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8150ba0 0x7f0eb80a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebe0b6700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150f80 0x7f0eb81426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150f80 msgr2=0x7f0eb81426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150f80 0x7f0eb81426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8150ba0 msgr2=0x7f0eb80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8150ba0 0x7f0eb80a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:15.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.794+0000 7f0ebd8b5700 1 -- 172.21.15.52:0/3236270586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009370 con 0x7f0eb80a6770 2023-05-10T01:25:15.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ebd8b5700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0ea800d890 tx=0x7f0ea8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:15.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8011590 con 0x7f0eb80a6770 2023-05-10T01:25:15.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80116f0 con 0x7f0eb80a6770 2023-05-10T01:25:15.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb814ee90 con 0x7f0eb80a6770 2023-05-10T01:25:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8011a70 con 0x7f0eb80a6770 2023-05-10T01:25:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.795+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb814f450 con 0x7f0eb80a6770 2023-05-10T01:25:15.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.796+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb806c340 con 0x7f0eb80a6770 2023-05-10T01:25:15.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.796+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0ea8012420 con 0x7f0eb80a6770 2023-05-10T01:25:15.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.797+0000 7f0ea5ffb700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 0x7f0e980612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:15.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.797+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 msgr2=0x7f0e980612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:15.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.797+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f0ea80798d0 con 0x7f0eb80a6770 2023-05-10T01:25:15.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.797+0000 7f0ebd0b4700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 0x7f0e980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:15.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.801+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ea804ab90 con 0x7f0eb80a6770 2023-05-10T01:25:15.819 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:15.816+0000 7fd36bfa7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:15.890 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:15.888+0000 7fd36bfa7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:15.914 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:15.910+0000 7fa23326b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:15.983 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:15.980+0000 7fa23326b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.998+0000 7f0ebd0b4700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 msgr2=0x7f0e980612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:15.998+0000 7f0ebd0b4700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 0x7f0e980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:16.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.021+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0eb80650d0 con 0x7f0eb80a6770 2023-05-10T01:25:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.021+0000 7f0ea5ffb700 1 -- 172.21.15.52:0/3236270586 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ea804e1b0 con 0x7f0eb80a6770 2023-05-10T01:25:16.025 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:25:16.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 msgr2=0x7f0e980612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:16.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 0x7f0e980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 msgr2=0x7f0eb814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0ea800d890 tx=0x7f0ea8008040).stop 2023-05-10T01:25:16.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 shutdown_connections 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0e9805ede0 0x7f0e980612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0eb8150f80 0x7f0eb81426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80a6770 0x7f0eb814e340 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 --2- 172.21.15.52:0/3236270586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8150ba0 0x7f0eb80a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 >> 172.21.15.52:0/3236270586 conn(0x7f0eb80c8410 msgr2=0x7f0eb80675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 shutdown_connections 2023-05-10T01:25:16.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.023+0000 7f0ebfb19700 1 -- 172.21.15.52:0/3236270586 wait complete. 2023-05-10T01:25:16.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:25:16.075 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.072+0000 7fd36bfa7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.158+0000 7f20c3c5b700 1 Processor -- start 2023-05-10T01:25:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.159+0000 7f20c3c5b700 1 -- start start 2023-05-10T01:25:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c3c5b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 0x7f20bc0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c3c5b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0c94c0 con 0x7f20bc154460 2023-05-10T01:25:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c3c5b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0cb7d0 con 0x7f20bc068150 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c3c5b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0c88b0 con 0x7f20bc154080 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c11f6700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20bc154460 0x7f20bc0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45698/0 (socket says 172.21.15.52:45698) 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c11f6700 1 -- 172.21.15.52:0/795044839 learned_addr learned my addr 172.21.15.52:0/795044839 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c19f7700 1 --2- 172.21.15.52:0/795044839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 0x7f20bc0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472272236 0 0) 0x7f20bc0c94c0 con 0x7f20bc154460 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a40033f0 con 0x7f20bc154460 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610514077 0 0) 0x7f20bc0cb7d0 con 0x7f20bc068150 2023-05-10T01:25:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc0c94c0 con 0x7f20bc068150 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c19f7700 1 -- 172.21.15.52:0/795044839 >> v1:172.21.15.172:6789/0 conn(0x7f20bc068150 legacy=0x7f20bc068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c19f7700 1 -- 172.21.15.52:0/795044839 >> v1:172.21.15.52:6789/0 conn(0x7f20bc154460 legacy=0x7f20bc0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c19f7700 1 -- 172.21.15.52:0/795044839 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0c8b90 con 0x7f20bc154080 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.160+0000 7f20c19f7700 1 --2- 172.21.15.52:0/795044839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 0x7f20bc0aac90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f20b8009790 tx=0x7f20b8009060).ready entity=mon.2 client_cookie=3d87cbb4c67f43bc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800f510 con 0x7f20bc154080 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800f670 con 0x7f20bc154080 2023-05-10T01:25:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c09f5700 1 -- 172.21.15.52:0/795044839 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800f9f0 con 0x7f20bc154080 2023-05-10T01:25:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 -- 172.21.15.52:0/795044839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 msgr2=0x7f20bc0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/795044839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 0x7f20bc0aac90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f20b8009790 tx=0x7f20b8009060).stop 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 -- 172.21.15.52:0/795044839 shutdown_connections 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/795044839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154080 0x7f20bc0aac90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 -- 172.21.15.52:0/795044839 >> 172.21.15.52:0/795044839 conn(0x7f20bc067910 msgr2=0x7f20bc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 -- 172.21.15.52:0/795044839 shutdown_connections 2023-05-10T01:25:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.161+0000 7f20c3c5b700 1 -- 172.21.15.52:0/795044839 wait complete. 2023-05-10T01:25:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.162+0000 7f20c3c5b700 1 Processor -- start 2023-05-10T01:25:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 -- start start 2023-05-10T01:25:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20bc154080 0x7f20bc14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154460 0x7f20bc153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc151cf0 con 0x7f20bc068150 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0afe10 con 0x7f20bc154080 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c3c5b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc151170 con 0x7f20bc154460 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c19f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c19f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36686/0 (socket says 172.21.15.52:36686) 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c19f7700 1 -- 172.21.15.52:0/2048842660 learned_addr learned my addr 172.21.15.52:0/2048842660 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c11f6700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20bc154080 0x7f20bc14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.163+0000 7f20c21f8700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154460 0x7f20bc153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 -- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154460 msgr2=0x7f20bc153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154460 0x7f20bc153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 -- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20bc154080 msgr2=0x7f20bc14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20bc154080 0x7f20bc14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 -- 172.21.15.52:0/2048842660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80092a0 con 0x7f20bc068150 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c19f7700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f20bc06bb20 tx=0x7f20b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801a6e0 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc151450 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b801a840 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801ac00 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.164+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc151a10 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.165+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc066720 con 0x7f20bc068150 2023-05-10T01:25:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.165+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f20b800f070 con 0x7f20bc068150 2023-05-10T01:25:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.166+0000 7f20a9ffb700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 0x7f209c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.166+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f20b807b100 con 0x7f20bc068150 2023-05-10T01:25:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.166+0000 7f20c11f6700 1 -- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 msgr2=0x7f209c0612d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.166+0000 7f20c11f6700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 0x7f209c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.170+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20b804c4a0 con 0x7f20bc068150 2023-05-10T01:25:16.182 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:16.178+0000 7fa23326b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:16.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.343+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20bc06bd30 con 0x7f20bc068150 2023-05-10T01:25:16.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.344+0000 7f20a9ffb700 1 -- 172.21.15.52:0/2048842660 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20b8028020 con 0x7f20bc068150 2023-05-10T01:25:16.347 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:25:16.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 msgr2=0x7f209c0612d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:16.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 0x7f209c0612d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 msgr2=0x7f20bc1644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f20bc06bb20 tx=0x7f20b8017000).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 shutdown_connections 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f209c05ee10 0x7f209c0612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20bc154460 0x7f20bc153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20bc068150 0x7f20bc1644e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 --2- 172.21.15.52:0/2048842660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20bc154080 0x7f20bc14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 >> 172.21.15.52:0/2048842660 conn(0x7f20bc067910 msgr2=0x7f20bc0acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 shutdown_connections 2023-05-10T01:25:16.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.346+0000 7f20c3c5b700 1 -- 172.21.15.52:0/2048842660 wait complete. 2023-05-10T01:25:16.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:25:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.482+0000 7f5326188700 1 Processor -- start 2023-05-10T01:25:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.482+0000 7f5326188700 1 -- start start 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f5326188700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 0x7f5320150370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f5326188700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53200bd800 0x7f5320153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f5326188700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200bc760 con 0x7f532014ff90 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f5326188700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532006a500 con 0x7f53200bd800 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f5326188700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200bca40 con 0x7f53200bc280 2023-05-10T01:25:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f531f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f532014ff90 0x7f5320069df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45710/0 (socket says 172.21.15.52:45710) 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f531f7fe700 1 -- 172.21.15.52:0/844443799 learned_addr learned my addr 172.21.15.52:0/844443799 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f531ffff700 1 --2- 172.21.15.52:0/844443799 >> v2:172.21.15.172:3300/0 conn(0x7f53200bd800 0x7f5320153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.483+0000 7f531effd700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 0x7f5320150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161324728 0 0) 0x7f53200bc760 con 0x7f532014ff90 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53000033f0 con 0x7f532014ff90 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411971966 0 0) 0x7f53000033f0 con 0x7f532014ff90 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531ffff700 1 -- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 msgr2=0x7f5320150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531ffff700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 0x7f5320150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531ffff700 1 -- 172.21.15.52:0/844443799 >> v1:172.21.15.52:6789/0 conn(0x7f532014ff90 legacy=0x7f5320069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531ffff700 1 -- 172.21.15.52:0/844443799 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200bcd20 con 0x7f53200bd800 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531effd700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 0x7f5320150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531ffff700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f5320153ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f5318009e60 tx=0x7f5318009780).ready entity=mon.1 client_cookie=a53c2bb68dc5bcef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531800e070 con 0x7f53200bd800 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531800b7a0 con 0x7f53200bd800 2023-05-10T01:25:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.484+0000 7f531e7fc700 1 -- 172.21.15.52:0/844443799 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308001470 con 0x7f53200bd800 2023-05-10T01:25:16.491 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.485+0000 7fd36bfa7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 -- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 msgr2=0x7f5320153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f5320153ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f5318009e60 tx=0x7f5318009780).stop 2023-05-10T01:25:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 -- 172.21.15.52:0/844443799 shutdown_connections 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f5320153ea0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 --2- 172.21.15.52:0/844443799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53200bc280 0x7f5320150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 -- 172.21.15.52:0/844443799 >> 172.21.15.52:0/844443799 conn(0x7f53200c4610 msgr2=0x7f5320066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 -- 172.21.15.52:0/844443799 shutdown_connections 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.485+0000 7f5326188700 1 -- 172.21.15.52:0/844443799 wait complete. 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.486+0000 7f5326188700 1 Processor -- start 2023-05-10T01:25:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.486+0000 7f5326188700 1 -- start start 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f53200a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f532014ff90 0x7f53200a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200a6a40 con 0x7f53200bc280 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200a72e0 con 0x7f53200bd800 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f5326188700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5320165ea0 con 0x7f532014ff90 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36700/0 (socket says 172.21.15.52:36700) 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 -- 172.21.15.52:0/516509264 learned_addr learned my addr 172.21.15.52:0/516509264 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531effd700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f53200a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531ffff700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f532014ff90 0x7f53200a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 -- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f532014ff90 msgr2=0x7f53200a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f532014ff90 0x7f53200a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 -- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 msgr2=0x7f53200a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f53200a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 -- 172.21.15.52:0/516509264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531000a440 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.487+0000 7f531f7fe700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f530800c840 tx=0x7f5308001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308007170 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080072d0 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318009a20 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080048c0 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53200a6f70 con 0x7f53200bc280 2023-05-10T01:25:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.488+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532006c340 con 0x7f53200bc280 2023-05-10T01:25:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.489+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f5308004c70 con 0x7f53200bc280 2023-05-10T01:25:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.489+0000 7f53177fe700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 0x7f53040612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.490+0000 7f531effd700 1 -- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 msgr2=0x7f53040612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.490+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f5308079980 con 0x7f53200bc280 2023-05-10T01:25:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.490+0000 7f531effd700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 0x7f53040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.494+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f530804aca0 con 0x7f53200bc280 2023-05-10T01:25:16.591 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.589+0000 7fd36bfa7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:16.622 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:16.619+0000 7fa23326b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.668+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53200bc060 con 0x7f53200bc280 2023-05-10T01:25:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.668+0000 7f53177fe700 1 -- 172.21.15.52:0/516509264 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f530804e2c0 con 0x7f53200bc280 2023-05-10T01:25:16.672 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:25:16.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.670+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 msgr2=0x7f53040612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:16.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.670+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 0x7f53040612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.670+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 msgr2=0x7f53200c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.670+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f530800c840 tx=0x7f5308001ab0).stop 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 shutdown_connections 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f530405ede0 0x7f53040612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f532014ff90 0x7f53200a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200bc280 0x7f53200c0570 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 --2- 172.21.15.52:0/516509264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200bd800 0x7f53200a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 >> 172.21.15.52:0/516509264 conn(0x7f53200c4610 msgr2=0x7f5320066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 shutdown_connections 2023-05-10T01:25:16.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.671+0000 7f5326188700 1 -- 172.21.15.52:0/516509264 wait complete. 2023-05-10T01:25:16.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:25:16.733 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:16.729+0000 7fa23326b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:16.744 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.741+0000 7fd36bfa7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.805+0000 7faf395ba700 1 Processor -- start 2023-05-10T01:25:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.805+0000 7faf395ba700 1 -- start start 2023-05-10T01:25:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf395ba700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf3414f980 0x7faf340c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf395ba700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf34152e30 0x7faf340c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf395ba700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf34063680 con 0x7faf340622a0 2023-05-10T01:25:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf395ba700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3414fd60 con 0x7faf3414f980 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf395ba700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340c52e0 con 0x7faf34152e30 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf32ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf3414f980 0x7faf340c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf337fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faf340622a0 0x7faf34063b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45728/0 (socket says 172.21.15.52:45728) 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf337fe700 1 -- 172.21.15.52:0/898434757 learned_addr learned my addr 172.21.15.52:0/898434757 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.806+0000 7faf327fc700 1 --2- 172.21.15.52:0/898434757 >> v2:172.21.15.172:3300/0 conn(0x7faf34152e30 0x7faf340c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf32ffd700 1 -- 172.21.15.52:0/898434757 >> v2:172.21.15.172:3300/0 conn(0x7faf34152e30 msgr2=0x7faf340c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf32ffd700 1 --2- 172.21.15.52:0/898434757 >> v2:172.21.15.172:3300/0 conn(0x7faf34152e30 0x7faf340c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf32ffd700 1 -- 172.21.15.52:0/898434757 >> v1:172.21.15.52:6789/0 conn(0x7faf340622a0 legacy=0x7faf34063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf31ffb700 1 -- 172.21.15.52:0/898434757 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644075837 0 0) 0x7faf34063680 con 0x7faf340622a0 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf32ffd700 1 -- 172.21.15.52:0/898434757 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340c5cd0 con 0x7faf3414f980 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf32ffd700 1 --2- 172.21.15.52:0/898434757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c4c70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7faf340c6590 tx=0x7faf24009060).ready entity=mon.0 client_cookie=3ce63e076c4c866f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf31ffb700 1 -- 172.21.15.52:0/898434757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400f510 con 0x7faf3414f980 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf31ffb700 1 -- 172.21.15.52:0/898434757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400f670 con 0x7faf3414f980 2023-05-10T01:25:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.807+0000 7faf31ffb700 1 -- 172.21.15.52:0/898434757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400f9f0 con 0x7faf3414f980 2023-05-10T01:25:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 -- 172.21.15.52:0/898434757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 msgr2=0x7faf340c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 --2- 172.21.15.52:0/898434757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c4c70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7faf340c6590 tx=0x7faf24009060).stop 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 -- 172.21.15.52:0/898434757 shutdown_connections 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 --2- 172.21.15.52:0/898434757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c4c70 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 --2- 172.21.15.52:0/898434757 >> v2:172.21.15.172:3300/0 conn(0x7faf34152e30 0x7faf340c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 -- 172.21.15.52:0/898434757 >> 172.21.15.52:0/898434757 conn(0x7faf3405e810 msgr2=0x7faf340c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 -- 172.21.15.52:0/898434757 shutdown_connections 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.808+0000 7faf395ba700 1 -- 172.21.15.52:0/898434757 wait complete. 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.809+0000 7faf395ba700 1 Processor -- start 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.809+0000 7faf395ba700 1 -- start start 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf340622a0 0x7faf34069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 0x7faf340c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340c0ae0 con 0x7faf3414f980 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340682c0 con 0x7faf34152e30 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf395ba700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34068550 con 0x7faf340622a0 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36716/0 (socket says 172.21.15.52:36716) 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 -- 172.21.15.52:0/1074964724 learned_addr learned my addr 172.21.15.52:0/1074964724 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf337fe700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 0x7faf340c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf32ffd700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf340622a0 0x7faf34069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 -- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf340622a0 msgr2=0x7faf34069260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf340622a0 0x7faf34069260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 -- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 msgr2=0x7faf340c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 0x7faf340c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 -- 172.21.15.52:0/1074964724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240092a0 con 0x7faf3414f980 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf337fe700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 0x7faf340c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.810+0000 7faf327fc700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7faf2800e900 tx=0x7faf28009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.811+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28012600 con 0x7faf3414f980 2023-05-10T01:25:16.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.811+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28012760 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.811+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340c0d40 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.811+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28012ae0 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.811+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf34068d60 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.812+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3406c340 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.812+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7faf28022070 con 0x7faf3414f980 2023-05-10T01:25:16.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.812+0000 7faf1affd700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 0x7faf140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:16.821 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.815+0000 7fd36bfa7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:16.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.813+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7faf2807a000 con 0x7faf3414f980 2023-05-10T01:25:16.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.813+0000 7faf32ffd700 1 -- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 msgr2=0x7faf140612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:16.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.813+0000 7faf32ffd700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 0x7faf140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:16.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.817+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf2804b320 con 0x7faf3414f980 2023-05-10T01:25:16.885 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:16.882+0000 7fd36bfa7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:16.897 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:16.893+0000 7fa23326b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:16.974 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:16.970+0000 7fa23326b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:16.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.992+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf340bf290 con 0x7faf3414f980 2023-05-10T01:25:16.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.992+0000 7faf1affd700 1 -- 172.21.15.52:0/1074964724 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf28016020 con 0x7faf3414f980 2023-05-10T01:25:16.997 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:25:16.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 msgr2=0x7faf140612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:16.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 0x7faf140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 msgr2=0x7faf340c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7faf2800e900 tx=0x7faf28009060).stop 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 shutdown_connections 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faf1405ede0 0x7faf140612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf34152e30 0x7faf340c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf340622a0 0x7faf34069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 --2- 172.21.15.52:0/1074964724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3414f980 0x7faf340c0100 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 >> 172.21.15.52:0/1074964724 conn(0x7faf3405e810 msgr2=0x7faf341516d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:16.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 shutdown_connections 2023-05-10T01:25:17.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:16.994+0000 7faf395ba700 1 -- 172.21.15.52:0/1074964724 wait complete. 2023-05-10T01:25:17.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:17.047 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:17.044+0000 7fa23326b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:17.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.124+0000 7ff7e7fff700 1 Processor -- start 2023-05-10T01:25:17.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.124+0000 7ff7e7fff700 1 -- start start 2023-05-10T01:25:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e7fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e81588f0 con 0x7ff7e8153810 2023-05-10T01:25:17.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e7fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e8157ce0 con 0x7ff7e80c76d0 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8157fc0 con 0x7ff7e80a9b60 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36722/0 (socket says 172.21.15.52:36722) 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/2281784675 learned_addr learned my addr 172.21.15.52:0/2281784675 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e67fc700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/2281784675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 msgr2=0x7ff7e80a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/2281784675 >> v1:172.21.15.172:6789/0 conn(0x7ff7e8153810 legacy=0x7ff7e8153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/2281784675 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e81582a0 con 0x7ff7e80c76d0 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.125+0000 7ff7e6ffd700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7ff7d8006fd0 tx=0x7ff7d80090f0).ready entity=mon.0 client_cookie=65568760924dc42 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e5ffb700 1 -- 172.21.15.52:0/2281784675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800b580 con 0x7ff7e80c76d0 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e5ffb700 1 -- 172.21.15.52:0/2281784675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800b6e0 con 0x7ff7e80c76d0 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e5ffb700 1 -- 172.21.15.52:0/2281784675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800ba60 con 0x7ff7e80c76d0 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 -- 172.21.15.52:0/2281784675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 msgr2=0x7ff7e80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7ff7d8006fd0 tx=0x7ff7d80090f0).stop 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 -- 172.21.15.52:0/2281784675 shutdown_connections 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80c7ab0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/2281784675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 -- 172.21.15.52:0/2281784675 >> 172.21.15.52:0/2281784675 conn(0x7ff7e8068320 msgr2=0x7ff7e8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 -- 172.21.15.52:0/2281784675 shutdown_connections 2023-05-10T01:25:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.126+0000 7ff7e7fff700 1 -- 172.21.15.52:0/2281784675 wait complete. 2023-05-10T01:25:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.127+0000 7ff7e7fff700 1 Processor -- start 2023-05-10T01:25:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.127+0000 7ff7e7fff700 1 -- start start 2023-05-10T01:25:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7e8153810 0x7ff7e8155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b0010 con 0x7ff7e80c76d0 2023-05-10T01:25:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80af440 con 0x7ff7e8153810 2023-05-10T01:25:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80af6e0 con 0x7ff7e80a9b60 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36728/0 (socket says 172.21.15.52:36728) 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e67fc700 1 -- 172.21.15.52:0/3147782205 learned_addr learned my addr 172.21.15.52:0/3147782205 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e77fe700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7e8153810 0x7ff7e8155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.128+0000 7ff7e6ffd700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 msgr2=0x7ff7e80c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7e8153810 msgr2=0x7ff7e8155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7e8153810 0x7ff7e8155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 -- 172.21.15.52:0/3147782205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009370 con 0x7ff7e80c76d0 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e67fc700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7ff7d000e950 tx=0x7ff7d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0009530 con 0x7ff7e80c76d0 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d0012600 con 0x7ff7e80c76d0 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0012980 con 0x7ff7e80c76d0 2023-05-10T01:25:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e80af9c0 con 0x7ff7e80c76d0 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.129+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e80c4130 con 0x7ff7e80c76d0 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.130+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e8047150 con 0x7ff7e80c76d0 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.130+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff7d0022070 con 0x7ff7e80c76d0 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.131+0000 7ff7deffd700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 0x7ff7cc061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.131+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7ff7d007a270 con 0x7ff7e80c76d0 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.131+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 msgr2=0x7ff7cc061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.131+0000 7ff7e6ffd700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 0x7ff7cc061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:17.140 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:17.135+0000 7fd36bfa7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.135+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7d004b590 con 0x7ff7e80c76d0 2023-05-10T01:25:17.320 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:17.317+0000 7fd36bfa7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:17.329 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:17.326+0000 7fa23326b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:17.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.332+0000 7ff7e6ffd700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 msgr2=0x7ff7cc061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:17.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.332+0000 7ff7e6ffd700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 0x7ff7cc061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:17.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.358+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e8158580 con 0x7ff7e80c76d0 2023-05-10T01:25:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.359+0000 7ff7deffd700 1 -- 172.21.15.52:0/3147782205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff7d004ebb0 con 0x7ff7e80c76d0 2023-05-10T01:25:17.363 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:17.363 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:25:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 msgr2=0x7ff7cc061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 0x7ff7cc061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 msgr2=0x7ff7e80b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7ff7d000e950 tx=0x7ff7d0009060).stop 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 shutdown_connections 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff7cc05edb0 0x7ff7cc061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:17.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7e8153810 0x7ff7e8155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7e80a9b60 0x7ff7e80c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 --2- 172.21.15.52:0/3147782205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7e80c76d0 0x7ff7e80b04a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 >> 172.21.15.52:0/3147782205 conn(0x7ff7e8068320 msgr2=0x7ff7e80c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:17.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 shutdown_connections 2023-05-10T01:25:17.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.361+0000 7ff7e7fff700 1 -- 172.21.15.52:0/3147782205 wait complete. 2023-05-10T01:25:17.367 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:25:17.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:17.521 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:17.518+0000 7fa23326b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:17.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.534+0000 7f3d36f01700 1 Processor -- start 2023-05-10T01:25:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.534+0000 7f3d36f01700 1 -- start start 2023-05-10T01:25:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d36f01700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3d30063e20 0x7f3d300bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d36f01700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d30062b00 con 0x7f3d30153d90 2023-05-10T01:25:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d36f01700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d30068330 con 0x7f3d30154170 2023-05-10T01:25:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d36f01700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d30068610 con 0x7f3d30063e20 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d34c9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d30153d90 0x7f3d30069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45752/0 (socket says 172.21.15.52:45752) 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d34c9d700 1 -- 172.21.15.52:0/1221464971 learned_addr learned my addr 172.21.15.52:0/1221464971 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.535+0000 7f3d3549e700 1 --2- 172.21.15.52:0/1221464971 >> v2:172.21.15.172:3300/0 conn(0x7f3d30063e20 0x7f3d300bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319257277 0 0) 0x7f3d30062b00 con 0x7f3d30153d90 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d140033f0 con 0x7f3d30153d90 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285820053 0 0) 0x7f3d140033f0 con 0x7f3d30153d90 2023-05-10T01:25:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d3549e700 1 -- 172.21.15.52:0/1221464971 >> v1:172.21.15.172:6789/0 conn(0x7f3d30154170 legacy=0x7f3d30063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d3549e700 1 -- 172.21.15.52:0/1221464971 >> v1:172.21.15.52:6789/0 conn(0x7f3d30153d90 legacy=0x7f3d30069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d3549e700 1 -- 172.21.15.52:0/1221464971 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300624b0 con 0x7f3d30063e20 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d3549e700 1 --2- 172.21.15.52:0/1221464971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30063e20 0x7f3d300bd9f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f3d28009e60 tx=0x7f3d28009780).ready entity=mon.1 client_cookie=aa179a59bed12608 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800e070 con 0x7f3d30063e20 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800b850 con 0x7f3d30063e20 2023-05-10T01:25:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.536+0000 7f3d2f7fe700 1 -- 172.21.15.52:0/1221464971 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24001470 con 0x7f3d30063e20 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 -- 172.21.15.52:0/1221464971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30063e20 msgr2=0x7f3d300bd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 --2- 172.21.15.52:0/1221464971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30063e20 0x7f3d300bd9f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f3d28009e60 tx=0x7f3d28009780).stop 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 -- 172.21.15.52:0/1221464971 shutdown_connections 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 --2- 172.21.15.52:0/1221464971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30063e20 0x7f3d300bd9f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 -- 172.21.15.52:0/1221464971 >> 172.21.15.52:0/1221464971 conn(0x7f3d300c8a90 msgr2=0x7f3d300c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 -- 172.21.15.52:0/1221464971 shutdown_connections 2023-05-10T01:25:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.537+0000 7f3d36f01700 1 -- 172.21.15.52:0/1221464971 wait complete. 2023-05-10T01:25:17.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.538+0000 7f3d36f01700 1 Processor -- start 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.538+0000 7f3d36f01700 1 -- start start 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d30063e20 0x7f3d30156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30154170 0x7f3d3014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d301574a0 con 0x7f3d30153d90 2023-05-10T01:25:17.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300c1af0 con 0x7f3d30154170 2023-05-10T01:25:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d36f01700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30158290 con 0x7f3d30063e20 2023-05-10T01:25:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36740/0 (socket says 172.21.15.52:36740) 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 -- 172.21.15.52:0/824477837 learned_addr learned my addr 172.21.15.52:0/824477837 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d34c9d700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d30063e20 0x7f3d30156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d3549e700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30154170 0x7f3d3014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 -- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d30063e20 msgr2=0x7f3d30156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d30063e20 0x7f3d30156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 -- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30154170 msgr2=0x7f3d3014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30154170 0x7f3d3014f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 -- 172.21.15.52:0/824477837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28009a20 con 0x7f3d30153d90 2023-05-10T01:25:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.539+0000 7f3d2ffff700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f3d1c00c510 tx=0x7f3d1c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00ce00 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c007020 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c0073e0 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d30157680 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d30157c40 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.540+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3006c340 con 0x7f3d30153d90 2023-05-10T01:25:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.541+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f3d1c010070 con 0x7f3d30153d90 2023-05-10T01:25:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.541+0000 7f3d2cff9700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 0x7f3d180612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.541+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f3d1c079700 con 0x7f3d30153d90 2023-05-10T01:25:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.541+0000 7f3d34c9d700 1 -- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 msgr2=0x7f3d180612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.541+0000 7f3d34c9d700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 0x7f3d180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.545+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d1c04aa20 con 0x7f3d30153d90 2023-05-10T01:25:17.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.719+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d300bf590 con 0x7f3d30153d90 2023-05-10T01:25:17.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.720+0000 7f3d2cff9700 1 -- 172.21.15.52:0/824477837 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17679 (secure 0 0 0) 0x7f3d1c04e040 con 0x7f3d30153d90 2023-05-10T01:25:17.724 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:17.724 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":95,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:12.662396+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2563192808":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6833/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:0/1367968119":"2023-05-11T01:25:12.662365+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:17.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 msgr2=0x7f3d180612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:17.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 0x7f3d180612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:17.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 msgr2=0x7f3d300c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f3d1c00c510 tx=0x7f3d1c007e00).stop 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 shutdown_connections 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3d1805ede0 0x7f3d180612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d30154170 0x7f3d3014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d30063e20 0x7f3d30156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 --2- 172.21.15.52:0/824477837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d30153d90 0x7f3d300c1600 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.722+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 >> 172.21.15.52:0/824477837 conn(0x7f3d300c8a90 msgr2=0x7f3d300c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.723+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 shutdown_connections 2023-05-10T01:25:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.723+0000 7f3d36f01700 1 -- 172.21.15.52:0/824477837 wait complete. 2023-05-10T01:25:17.739 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:25:17.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:17.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.853+0000 7fa90c8c2700 1 Processor -- start 2023-05-10T01:25:17.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.853+0000 7fa90c8c2700 1 -- start start 2023-05-10T01:25:17.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.854+0000 7fa90c8c2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 0x7fa9080c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.854+0000 7fa90c8c2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080c0650 con 0x7fa908069da0 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.854+0000 7fa90c8c2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080bfd20 con 0x7fa908154540 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.854+0000 7fa90c8c2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080c0000 con 0x7fa908154160 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa906d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa908069da0 0x7fa9080c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45784/0 (socket says 172.21.15.52:45784) 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa906d9d700 1 -- 172.21.15.52:0/1816245231 learned_addr learned my addr 172.21.15.52:0/1816245231 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:17.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90659c700 1 --2- 172.21.15.52:0/1816245231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 0x7fa9080c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721774320 0 0) 0x7fa9080c0650 con 0x7fa908069da0 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ec0033f0 con 0x7fa908069da0 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939836302 0 0) 0x7fa9080bfd20 con 0x7fa908154540 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9080c0650 con 0x7fa908154540 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90659c700 1 -- 172.21.15.52:0/1816245231 >> v1:172.21.15.172:6789/0 conn(0x7fa908154540 legacy=0x7fa908069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90659c700 1 -- 172.21.15.52:0/1816245231 >> v1:172.21.15.52:6789/0 conn(0x7fa908069da0 legacy=0x7fa9080c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90659c700 1 -- 172.21.15.52:0/1816245231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080c02e0 con 0x7fa908154160 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90659c700 1 --2- 172.21.15.52:0/1816245231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 0x7fa9080c5c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa8f8009790 tx=0x7fa8f8009060).ready entity=mon.2 client_cookie=65b5355f20b2bb08 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800f510 con 0x7fa908154160 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800f670 con 0x7fa908154160 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.855+0000 7fa90559a700 1 -- 172.21.15.52:0/1816245231 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800f9f0 con 0x7fa908154160 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 -- 172.21.15.52:0/1816245231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 msgr2=0x7fa9080c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/1816245231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 0x7fa9080c5c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa8f8009790 tx=0x7fa8f8009060).stop 2023-05-10T01:25:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 -- 172.21.15.52:0/1816245231 shutdown_connections 2023-05-10T01:25:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/1816245231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908154160 0x7fa9080c5c60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 -- 172.21.15.52:0/1816245231 >> 172.21.15.52:0/1816245231 conn(0x7fa9080cb740 msgr2=0x7fa9080c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 -- 172.21.15.52:0/1816245231 shutdown_connections 2023-05-10T01:25:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.856+0000 7fa90c8c2700 1 -- 172.21.15.52:0/1816245231 wait complete. 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.857+0000 7fa90c8c2700 1 Processor -- start 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.857+0000 7fa90c8c2700 1 -- start start 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908069da0 0x7fa9080a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa908154540 0x7fa9080aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080aa640 con 0x7fa908154160 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa908157ba0 con 0x7fa908154540 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90c8c2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081572b0 con 0x7fa908069da0 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa90659c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908069da0 0x7fa9080a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36772/0 (socket says 172.21.15.52:36772) 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 -- 172.21.15.52:0/428084185 learned_addr learned my addr 172.21.15.52:0/428084185 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:17.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa906d9d700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa908154540 0x7fa9080aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:17.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908069da0 msgr2=0x7fa9080a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908069da0 0x7fa9080a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa908154540 msgr2=0x7fa9080aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa908154540 0x7fa9080aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.858+0000 7fa905d9b700 1 -- 172.21.15.52:0/428084185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80092a0 con 0x7fa908154160 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa905d9b700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fa8fc00c3f0 tx=0x7fa8fc007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc012400 con 0x7fa908154160 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc012560 con 0x7fa908154160 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9080c4f10 con 0x7fa908154160 2023-05-10T01:25:17.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc012920 con 0x7fa908154160 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.859+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa908157830 con 0x7fa908154160 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.860+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9080666b0 con 0x7fa908154160 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.860+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fa8fc019030 con 0x7fa908154160 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.861+0000 7fa8f67fc700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 0x7fa8e40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.861+0000 7fa90659c700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 msgr2=0x7fa8e40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.861+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fa8fc0793a0 con 0x7fa908154160 2023-05-10T01:25:17.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.861+0000 7fa90659c700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 0x7fa8e40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:17.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:17.868+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8fc04a6c0 con 0x7fa908154160 2023-05-10T01:25:17.961 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:17.958+0000 7fd36bfa7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:18.028 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.025+0000 7fd36bfa7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:18.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.062+0000 7fa90659c700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 msgr2=0x7fa8e40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:18.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.062+0000 7fa90659c700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 0x7fa8e40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.088+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa90806c340 con 0x7fa908154160 2023-05-10T01:25:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.089+0000 7fa8f67fc700 1 -- 172.21.15.52:0/428084185 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fa8fc04dce0 con 0x7fa908154160 2023-05-10T01:25:18.092 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:18.093 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:25:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 msgr2=0x7fa8e40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 0x7fa8e40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 msgr2=0x7fa9080a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fa8fc00c3f0 tx=0x7fa8fc007bd0).stop 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 shutdown_connections 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8e405ede0 0x7fa8e40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa908154540 0x7fa9080aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa908069da0 0x7fa9080a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 --2- 172.21.15.52:0/428084185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908154160 0x7fa9080a9c60 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 >> 172.21.15.52:0/428084185 conn(0x7fa9080cb740 msgr2=0x7fa9080c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 shutdown_connections 2023-05-10T01:25:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.091+0000 7fa90c8c2700 1 -- 172.21.15.52:0/428084185 wait complete. 2023-05-10T01:25:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:25:18.100 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.098+0000 7fd36bfa7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:18.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:18.213 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.210+0000 7fa23326b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.224+0000 7fa250996700 1 Processor -- start 2023-05-10T01:25:18.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.224+0000 7fa250996700 1 -- start start 2023-05-10T01:25:18.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa250996700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 0x7fa24c064490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa250996700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa24c064980 0x7fa24c0bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa250996700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c0682a0 con 0x7fa24c0bd8c0 2023-05-10T01:25:18.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa250996700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c064df0 con 0x7fa24c064980 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa250996700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c068730 con 0x7fa24c152470 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa24c064980 0x7fa24c0bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa24c064980 0x7fa24c0bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36784/0 (socket says 172.21.15.52:36784) 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa24c0bd8c0 0x7fa24c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45796/0 (socket says 172.21.15.52:45796) 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 -- 172.21.15.52:0/3403921523 learned_addr learned my addr 172.21.15.52:0/3403921523 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24a59c700 1 --2- 172.21.15.52:0/3403921523 >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 0x7fa24c064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 -- 172.21.15.52:0/3403921523 >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 msgr2=0x7fa24c064490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 --2- 172.21.15.52:0/3403921523 >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 0x7fa24c064490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 -- 172.21.15.52:0/3403921523 >> v1:172.21.15.52:6789/0 conn(0x7fa24c0bd8c0 legacy=0x7fa24c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 -- 172.21.15.52:0/3403921523 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c067690 con 0x7fa24c064980 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24a59c700 1 --2- 172.21.15.52:0/3403921523 >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 0x7fa24c064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.225+0000 7fa24b59e700 1 --2- 172.21.15.52:0/3403921523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c0bbea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fa24c066c60 tx=0x7fa244009840).ready entity=mon.0 client_cookie=8fee8a552bbfdac0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa249d9b700 1 -- 172.21.15.52:0/3403921523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400e070 con 0x7fa24c064980 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa249d9b700 1 -- 172.21.15.52:0/3403921523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400ba50 con 0x7fa24c064980 2023-05-10T01:25:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa249d9b700 1 -- 172.21.15.52:0/3403921523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400bdd0 con 0x7fa24c064980 2023-05-10T01:25:18.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 -- 172.21.15.52:0/3403921523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 msgr2=0x7fa24c0bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 --2- 172.21.15.52:0/3403921523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c0bbea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fa24c066c60 tx=0x7fa244009840).stop 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 -- 172.21.15.52:0/3403921523 shutdown_connections 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 --2- 172.21.15.52:0/3403921523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c0bbea0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 --2- 172.21.15.52:0/3403921523 >> v2:172.21.15.172:3300/0 conn(0x7fa24c152470 0x7fa24c064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 -- 172.21.15.52:0/3403921523 >> 172.21.15.52:0/3403921523 conn(0x7fa24c069930 msgr2=0x7fa24c0c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 -- 172.21.15.52:0/3403921523 shutdown_connections 2023-05-10T01:25:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.226+0000 7fa250996700 1 -- 172.21.15.52:0/3403921523 wait complete. 2023-05-10T01:25:18.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.228+0000 7fa250996700 1 Processor -- start 2023-05-10T01:25:18.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.228+0000 7fa250996700 1 -- start start 2023-05-10T01:25:18.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa24c0bd8c0 0x7fa24c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 0x7fa24c0c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c162000 con 0x7fa24c064980 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c162270 con 0x7fa24c152470 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c165a50 con 0x7fa24c0bd8c0 2023-05-10T01:25:18.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36786/0 (socket says 172.21.15.52:36786) 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 -- 172.21.15.52:0/3964699867 learned_addr learned my addr 172.21.15.52:0/3964699867 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24a59c700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa24c0bd8c0 0x7fa24c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24b59e700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 0x7fa24c0c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa24c0bd8c0 msgr2=0x7fa24c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa24c0bd8c0 0x7fa24c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 msgr2=0x7fa24c0c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 0x7fa24c0c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 -- 172.21.15.52:0/3964699867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009ae0 con 0x7fa24c064980 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24b59e700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 0x7fa24c0c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa24ad9d700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fa240001eb0 tx=0x7fa240007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000ce40 con 0x7fa24c064980 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400072e0 con 0x7fa24c064980 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400056e0 con 0x7fa24c064980 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c1510b0 con 0x7fa24c064980 2023-05-10T01:25:18.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.230+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c165cd0 con 0x7fa24c064980 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fa240010070 con 0x7fa24c064980 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c047150 con 0x7fa24c064980 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa232ffd700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 0x7fa22c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa24a59c700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 msgr2=0x7fa22c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fa240079350 con 0x7fa24c064980 2023-05-10T01:25:18.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.232+0000 7fa24a59c700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 0x7fa22c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:18.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.236+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa24004a670 con 0x7fa24c064980 2023-05-10T01:25:18.245 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.242+0000 7fd36bfa7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:18.298 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.295+0000 7fa23326b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:18.315 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.312+0000 7fd36bfa7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:18.376 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.373+0000 7fa23326b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:18.427 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.423+0000 7fd36bfa7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:18.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.433+0000 7fa24a59c700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 msgr2=0x7fa22c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:18.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.433+0000 7fa24a59c700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 0x7fa22c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:18.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.472+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa24c0c3750 con 0x7fa24c064980 2023-05-10T01:25:18.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.472+0000 7fa232ffd700 1 -- 172.21.15.52:0/3964699867 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fa24004dc90 con 0x7fa24c064980 2023-05-10T01:25:18.476 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:18.476 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:24:56.028119+0000","modified":"2023-05-10T01:24:59.036175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3577811350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3577811350},{"type":"v1","addr":"172.21.15.52:6835","nonce":3577811350}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-05-10T01:25:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 msgr2=0x7fa22c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 0x7fa22c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 msgr2=0x7fa24c165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fa240001eb0 tx=0x7fa240007df0).stop 2023-05-10T01:25:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 shutdown_connections 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa22c05ede0 0x7fa22c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa24c152470 0x7fa24c0c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa24c064980 0x7fa24c165560 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 --2- 172.21.15.52:0/3964699867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa24c0bd8c0 0x7fa24c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 >> 172.21.15.52:0/3964699867 conn(0x7fa24c069930 msgr2=0x7fa24c1519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 shutdown_connections 2023-05-10T01:25:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.474+0000 7fa250996700 1 -- 172.21.15.52:0/3964699867 wait complete. 2023-05-10T01:25:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2023-05-10T01:25:18.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:18.532 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.529+0000 7fd36bfa7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:18.533 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.528+0000 7fa23326b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:18.606 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.603+0000 7fa23326b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:18.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.604+0000 7fbcdf92b700 1 Processor -- start 2023-05-10T01:25:18.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 -- start start 2023-05-10T01:25:18.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcd8154540 0x7fbcd8069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd80c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80c0650 con 0x7fbcd8154160 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd8069ff0 con 0x7fbcd8154540 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdf92b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80bfd20 con 0x7fbcd8069b80 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.605+0000 7fbcdcec6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcd8154540 0x7fbcd8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcd8154540 0x7fbcd8069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36798/0 (socket says 172.21.15.52:36798) 2023-05-10T01:25:18.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 -- 172.21.15.52:0/2654060 learned_addr learned my addr 172.21.15.52:0/2654060 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcddec8700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd80c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 -- 172.21.15.52:0/2654060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 msgr2=0x7fbcd80c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd80c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 -- 172.21.15.52:0/2654060 >> v1:172.21.15.172:6789/0 conn(0x7fbcd8154160 legacy=0x7fbcd80c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 -- 172.21.15.52:0/2654060 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80c0000 con 0x7fbcd8154540 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbcdcec6700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154540 0x7fbcd8069690 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fbccc006fd0 tx=0x7fbccc0090f0).ready entity=mon.0 client_cookie=a856942776d9c3c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbccbfff700 1 -- 172.21.15.52:0/2654060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00b580 con 0x7fbcd8154540 2023-05-10T01:25:18.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbccbfff700 1 -- 172.21.15.52:0/2654060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00b6e0 con 0x7fbcd8154540 2023-05-10T01:25:18.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.606+0000 7fbccbfff700 1 -- 172.21.15.52:0/2654060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00ba60 con 0x7fbcd8154540 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 -- 172.21.15.52:0/2654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154540 msgr2=0x7fbcd8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154540 0x7fbcd8069690 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fbccc006fd0 tx=0x7fbccc0090f0).stop 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 -- 172.21.15.52:0/2654060 shutdown_connections 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd80c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/2654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154540 0x7fbcd8069690 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 -- 172.21.15.52:0/2654060 >> 172.21.15.52:0/2654060 conn(0x7fbcd80cb740 msgr2=0x7fbcd80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 -- 172.21.15.52:0/2654060 shutdown_connections 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.607+0000 7fbcdf92b700 1 -- 172.21.15.52:0/2654060 wait complete. 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.608+0000 7fbcdf92b700 1 Processor -- start 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.608+0000 7fbcdf92b700 1 -- start start 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd8138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcd8154540 0x7fbcd8150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8150c80 con 0x7fbcd8154160 2023-05-10T01:25:18.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80aec10 con 0x7fbcd8154540 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdf92b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81532d0 con 0x7fbcd8069b80 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36804/0 (socket says 172.21.15.52:36804) 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 -- 172.21.15.52:0/703930158 learned_addr learned my addr 172.21.15.52:0/703930158 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcddec8700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcd8154540 0x7fbcd8150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdd6c7700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd8138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 -- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 msgr2=0x7fbcd8138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd8138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 -- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcd8154540 msgr2=0x7fbcd8150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcd8154540 0x7fbcd8150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 -- 172.21.15.52:0/703930158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc009370 con 0x7fbcd8154160 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.609+0000 7fbcdcec6700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fbccc011000 tx=0x7fbccc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc000bc0 con 0x7fbcd8154160 2023-05-10T01:25:18.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00b850 con 0x7fbcd8154160 2023-05-10T01:25:18.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd81535b0 con 0x7fbcd8154160 2023-05-10T01:25:18.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc000d20 con 0x7fbcd8154160 2023-05-10T01:25:18.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd80aee20 con 0x7fbcd8154160 2023-05-10T01:25:18.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.610+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd80666b0 con 0x7fbcd8154160 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.611+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fbccc02c070 con 0x7fbcd8154160 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.611+0000 7fbcc97fa700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 0x7fbcb80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.611+0000 7fbcdd6c7700 1 -- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 msgr2=0x7fbcb80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.611+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fbccc07ba60 con 0x7fbcd8154160 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.611+0000 7fbcdd6c7700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 0x7fbcb80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.615+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbccc04cd20 con 0x7fbcd8154160 2023-05-10T01:25:18.729 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.726+0000 7fa23326b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.795+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcd806c340 con 0x7fbcd8154160 2023-05-10T01:25:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.797+0000 7fbcc97fa700 1 -- 172.21.15.52:0/703930158 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17679 (secure 0 0 0) 0x7fbccc02a070 con 0x7fbcd8154160 2023-05-10T01:25:18.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:18.801 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":95,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:12.662396+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:24:54.574860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-05-10T01:24:54.992713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2563192808":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6833/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:12.662365+0000","172.21.15.172:0/1367968119":"2023-05-11T01:25:12.662365+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.798+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 msgr2=0x7fbcb80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.798+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 0x7fbcb80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 msgr2=0x7fbcd81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fbccc011000 tx=0x7fbccc017000).stop 2023-05-10T01:25:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 shutdown_connections 2023-05-10T01:25:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbcb805ede0 0x7fbcb80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcd8154540 0x7fbcd8150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcd8069b80 0x7fbcd8138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 --2- 172.21.15.52:0/703930158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcd8154160 0x7fbcd81502a0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 >> 172.21.15.52:0/703930158 conn(0x7fbcd80cb740 msgr2=0x7fbcd80c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 shutdown_connections 2023-05-10T01:25:18.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.799+0000 7fbcdf92b700 1 -- 172.21.15.52:0/703930158 wait complete. 2023-05-10T01:25:18.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:25:18.820 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.818+0000 7fd36bfa7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:18.844 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:18.840+0000 7fa23326b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:18.889 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:18.886+0000 7fd36bfa7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.966+0000 7f838362c700 1 Processor -- start 2023-05-10T01:25:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.966+0000 7f838362c700 1 -- start start 2023-05-10T01:25:18.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f838362c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f837c069da0 0x7f837c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f838362c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0c0650 con 0x7f837c154540 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f838362c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0c1af0 con 0x7f837c154160 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f838362c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0bfd20 con 0x7f837c069da0 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f8380bc7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f837c154540 0x7f837c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45826/0 (socket says 172.21.15.52:45826) 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f8380bc7700 1 -- 172.21.15.52:0/3679648091 learned_addr learned my addr 172.21.15.52:0/3679648091 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.967+0000 7f8381bc9700 1 --2- 172.21.15.52:0/3679648091 >> v2:172.21.15.52:3300/0 conn(0x7f837c069da0 0x7f837c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f836bfff700 1 -- 172.21.15.52:0/3679648091 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708642070 0 0) 0x7f837c0c0650 con 0x7f837c154540 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f836bfff700 1 -- 172.21.15.52:0/3679648091 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83640033f0 con 0x7f837c154540 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f8381bc9700 1 -- 172.21.15.52:0/3679648091 >> v1:172.21.15.172:6789/0 conn(0x7f837c154160 legacy=0x7f837c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f8381bc9700 1 -- 172.21.15.52:0/3679648091 >> v1:172.21.15.52:6789/0 conn(0x7f837c154540 legacy=0x7f837c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f8381bc9700 1 -- 172.21.15.52:0/3679648091 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0c0000 con 0x7f837c069da0 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f8381bc9700 1 --2- 172.21.15.52:0/3679648091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c069da0 0x7f837c15f1f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f8374009e60 tx=0x7f8374009780).ready entity=mon.0 client_cookie=31627c07abf0669f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f836bfff700 1 -- 172.21.15.52:0/3679648091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400e070 con 0x7f837c069da0 2023-05-10T01:25:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f836bfff700 1 -- 172.21.15.52:0/3679648091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400bb60 con 0x7f837c069da0 2023-05-10T01:25:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.968+0000 7f836bfff700 1 -- 172.21.15.52:0/3679648091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374012410 con 0x7f837c069da0 2023-05-10T01:25:18.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 -- 172.21.15.52:0/3679648091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c069da0 msgr2=0x7f837c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 --2- 172.21.15.52:0/3679648091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c069da0 0x7f837c15f1f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f8374009e60 tx=0x7f8374009780).stop 2023-05-10T01:25:18.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 -- 172.21.15.52:0/3679648091 shutdown_connections 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 --2- 172.21.15.52:0/3679648091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c069da0 0x7f837c15f1f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 -- 172.21.15.52:0/3679648091 >> 172.21.15.52:0/3679648091 conn(0x7f837c0cb740 msgr2=0x7f837c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 -- 172.21.15.52:0/3679648091 shutdown_connections 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.969+0000 7f838362c700 1 -- 172.21.15.52:0/3679648091 wait complete. 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.970+0000 7f838362c700 1 Processor -- start 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.970+0000 7f838362c700 1 -- start start 2023-05-10T01:25:18.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f837c069da0 0x7f837c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 0x7f837c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0ae020 con 0x7f837c154160 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0ae300 con 0x7f837c154540 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f838362c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0ae5e0 con 0x7f837c069da0 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36816/0 (socket says 172.21.15.52:36816) 2023-05-10T01:25:18.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 -- 172.21.15.52:0/161397766 learned_addr learned my addr 172.21.15.52:0/161397766 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8381bc9700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 0x7f837c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f83813c8700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f837c069da0 0x7f837c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f837c069da0 msgr2=0x7f837c148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f837c069da0 0x7f837c148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 msgr2=0x7f837c157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 0x7f837c157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8380bc7700 1 -- 172.21.15.52:0/161397766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009a20 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.971+0000 7f8381bc9700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 0x7f837c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f8380bc7700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f837800c420 tx=0x7f8378007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780070d0 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378007230 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c0ae8c0 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780075f0 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.972+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c0adc40 con 0x7f837c154160 2023-05-10T01:25:18.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.973+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c0af3a0 con 0x7f837c154160 2023-05-10T01:25:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.973+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 35) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f837801a060 con 0x7f837c154160 2023-05-10T01:25:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.974+0000 7f83697fa700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.974+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f8378079460 con 0x7f837c154160 2023-05-10T01:25:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.974+0000 7f83813c8700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 msgr2=0x7f835c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.974+0000 7f83813c8700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:18.978+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f837c0af3a0 con 0x7f837c154160 2023-05-10T01:25:19.151 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:19.148+0000 7fa23326b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:19.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.175+0000 7f83813c8700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 msgr2=0x7f835c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:19.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.175+0000 7f83813c8700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.200+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f837c0af3a0 con 0x7f837c154160 2023-05-10T01:25:19.227 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:19.223+0000 7fa23326b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.576+0000 7f83813c8700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 msgr2=0x7f835c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.576+0000 7f83813c8700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:25:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.748+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f8378010070 con 0x7f837c154160 2023-05-10T01:25:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.748+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 msgr2=0x7f835c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.748+0000 7f83697fa700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:19.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eb78b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eb78b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eb78b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.805 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eb78b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eb78b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eef92700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eef92700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eef92700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eef92700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.806 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:19.802+0000 7fd2eef92700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:19.808 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:25:19.804+0000 7fe12c006700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:25:19.808 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:25:19.804+0000 7fe12c006700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:25:19.808 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:25:19.804+0000 7fe12c006700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:25:19.811 INFO:tasks.ceph.mds.a.smithi052.stderr: -1162> 2023-05-10T01:25:01.865+0000 7fe12f80d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:25:19.812 INFO:tasks.ceph.mds.a.smithi052.stderr: -5> 2023-05-10T01:25:19.804+0000 7fe12c006700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:25:19.812 INFO:tasks.ceph.mds.a.smithi052.stderr: -4> 2023-05-10T01:25:19.804+0000 7fe12c006700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:25:19.813 INFO:tasks.ceph.mds.a.smithi052.stderr: -2> 2023-05-10T01:25:19.804+0000 7fe12c006700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:25:19.832 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:25:19.906 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:25:19.901+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:25:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.903+0000 7f83697fa700 1 -- 172.21.15.52:0/161397766 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8378075db0 con 0x7f837c154160 2023-05-10T01:25:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 msgr2=0x7f837c1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f837800c420 tx=0x7f8378007c50).stop 2023-05-10T01:25:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 shutdown_connections 2023-05-10T01:25:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f835c05ede0 0x7f835c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f837c154540 0x7f837c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f837c069da0 0x7f837c148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 --2- 172.21.15.52:0/161397766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c154160 0x7f837c1579e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 >> 172.21.15.52:0/161397766 conn(0x7f837c0cb740 msgr2=0x7f837c154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 shutdown_connections 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:19.906+0000 7f838362c700 1 -- 172.21.15.52:0/161397766 wait complete. 2023-05-10T01:25:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:25:19.922 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:25:20.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.040+0000 7fecb107d700 1 Processor -- start 2023-05-10T01:25:20.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.040+0000 7fecb107d700 1 -- start start 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecb107d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 0x7fecac154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecb107d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0bfbd0 con 0x7fecac0aade0 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecb107d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0c0750 con 0x7fecac0c65b0 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecb107d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac0aa3f0 con 0x7fecac153e30 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecab59e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fecac0aade0 0x7fecac0696b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45860/0 (socket says 172.21.15.52:45860) 2023-05-10T01:25:20.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecab59e700 1 -- 172.21.15.52:0/2562977291 learned_addr learned my addr 172.21.15.52:0/2562977291 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecaad9d700 1 --2- 172.21.15.52:0/2562977291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 0x7fecac154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450585426 0 0) 0x7fecac0bfbd0 con 0x7fecac0aade0 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec980033f0 con 0x7fecac0aade0 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473509976 0 0) 0x7fecac0c0750 con 0x7fecac0c65b0 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecac0bfbd0 con 0x7fecac0c65b0 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecaad9d700 1 -- 172.21.15.52:0/2562977291 >> v1:172.21.15.172:6789/0 conn(0x7fecac0c65b0 legacy=0x7fecac0a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecaad9d700 1 -- 172.21.15.52:0/2562977291 >> v1:172.21.15.52:6789/0 conn(0x7fecac0aade0 legacy=0x7fecac0696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309426207 0 0) 0x7fec980033f0 con 0x7fecac0aade0 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.041+0000 7fecaad9d700 1 -- 172.21.15.52:0/2562977291 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0bfe20 con 0x7fecac153e30 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecaad9d700 1 --2- 172.21.15.52:0/2562977291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 0x7fecac154210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fec9c009790 tx=0x7fec9c009060).ready entity=mon.2 client_cookie=61d1fa40b9c304ba server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40017f0 con 0x7fecac153e30 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0090d0 con 0x7fecac153e30 2023-05-10T01:25:20.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7feca9d9b700 1 -- 172.21.15.52:0/2562977291 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c011610 con 0x7fecac153e30 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 -- 172.21.15.52:0/2562977291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 msgr2=0x7fecac154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 --2- 172.21.15.52:0/2562977291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 0x7fecac154210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fec9c009790 tx=0x7fec9c009060).stop 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 -- 172.21.15.52:0/2562977291 shutdown_connections 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 --2- 172.21.15.52:0/2562977291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac153e30 0x7fecac154210 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 -- 172.21.15.52:0/2562977291 >> 172.21.15.52:0/2562977291 conn(0x7fecac0cb740 msgr2=0x7fecac0c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 -- 172.21.15.52:0/2562977291 shutdown_connections 2023-05-10T01:25:20.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.042+0000 7fecb107d700 1 -- 172.21.15.52:0/2562977291 wait complete. 2023-05-10T01:25:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 Processor -- start 2023-05-10T01:25:20.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 -- start start 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 0x7fecac0c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 0x7fecac0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac152320 con 0x7fecac153e30 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac14ee30 con 0x7fecac0aade0 2023-05-10T01:25:20.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.044+0000 7fecb107d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac1519f0 con 0x7fecac0c65b0 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaa59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 0x7fecac0c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecab59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 0x7fecac0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:35174/0 (socket says 172.21.15.52:35174) 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 -- 172.21.15.52:0/3077236467 learned_addr learned my addr 172.21.15.52:0/3077236467 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 -- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 msgr2=0x7fecac0c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 0x7fecac0c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 -- 172.21.15.52:0/3077236467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 msgr2=0x7fecac0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 0x7fecac0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 -- 172.21.15.52:0/3077236467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0092a0 con 0x7fecac0aade0 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaa59c700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 0x7fecac0c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecab59e700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 0x7fecac0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecaad9d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fec9c009d80 tx=0x7fec9c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:20.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c021070 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c006930 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac151cd0 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.045+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c01c880 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.046+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac151610 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.046+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac0666b0 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.047+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 36) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fec9c00f070 con 0x7fecac0aade0 2023-05-10T01:25:20.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.047+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6858+0+0 (secure 0 0 0) 0x7fec9c07aa80 con 0x7fecac0aade0 2023-05-10T01:25:20.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.052+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec9c04bde0 con 0x7fecac0aade0 2023-05-10T01:25:20.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.274+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fecac0c0100 con 0x7fecac0aade0 2023-05-10T01:25:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.755+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fec9c078740 con 0x7fecac0aade0 2023-05-10T01:25:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.756+0000 7fec92ffd700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 0x7fec8c067900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.756+0000 7fecaa59c700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 0x7fec8c067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.757+0000 7fecaa59c700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 0x7fec8c067900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7feca0007fd0 tx=0x7feca0007bd0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.906+0000 7fec92ffd700 1 -- 172.21.15.52:0/3077236467 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fec9c053840 con 0x7fecac0aade0 2023-05-10T01:25:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 msgr2=0x7fec8c067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 0x7fec8c067900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7feca0007fd0 tx=0x7feca0007bd0).stop 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 msgr2=0x7fecac14e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fec9c009d80 tx=0x7fec9c016000).stop 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 shutdown_connections 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fec8c030320 0x7fec8c067900 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecac153e30 0x7fecac0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecac0aade0 0x7fecac14e940 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 --2- 172.21.15.52:0/3077236467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0c65b0 0x7fecac0c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 >> 172.21.15.52:0/3077236467 conn(0x7fecac0cb740 msgr2=0x7fecac0c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 shutdown_connections 2023-05-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:20.908+0000 7fecb107d700 1 -- 172.21.15.52:0/3077236467 wait complete. 2023-05-10T01:25:20.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:25:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.050+0000 7fafce2a7700 1 Processor -- start 2023-05-10T01:25:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.050+0000 7fafce2a7700 1 -- start start 2023-05-10T01:25:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafce2a7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafc80c5d20 0x7fafc80aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafce2a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc80ca5f0 con 0x7fafc8153a90 2023-05-10T01:25:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafce2a7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc8154610 con 0x7fafc80c6100 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafce2a7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80c8820 con 0x7fafc80c5d20 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafcc844700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fafc8153a90 0x7fafc8153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45890/0 (socket says 172.21.15.52:45890) 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafcc844700 1 -- 172.21.15.52:0/617891941 learned_addr learned my addr 172.21.15.52:0/617891941 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227805848 0 0) 0x7fafc80ca5f0 con 0x7fafc8153a90 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc7fff700 1 --2- 172.21.15.52:0/617891941 >> v2:172.21.15.172:3300/0 conn(0x7fafc80c5d20 0x7fafc80aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa80033f0 con 0x7fafc8153a90 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393255497 0 0) 0x7fafa80033f0 con 0x7fafc8153a90 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 >> v2:172.21.15.172:3300/0 conn(0x7fafc80c5d20 msgr2=0x7fafc80aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 --2- 172.21.15.52:0/617891941 >> v2:172.21.15.172:3300/0 conn(0x7fafc80c5d20 0x7fafc80aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 >> v1:172.21.15.172:6789/0 conn(0x7fafc80c6100 legacy=0x7fafc8069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80c8b00 con 0x7fafc8153a90 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.051+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fafc00017f0 con 0x7fafc8153a90 2023-05-10T01:25:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 >> v1:172.21.15.52:6789/0 conn(0x7fafc8153a90 legacy=0x7fafc8153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafa8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8004690 0x7fafa8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafa8005000 0x7fafa800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c8820 con 0x7fafa80038e0 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800beb0 con 0x7fafa8004690 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800c070 con 0x7fafa8005000 2023-05-10T01:25:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafa8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafcc844700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafa8005000 0x7fafa800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc77fe700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8004690 0x7fafa8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 -- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafa8005000 msgr2=0x7fafa800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafa8005000 0x7fafa800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 -- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8004690 msgr2=0x7fafa8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8004690 0x7fafa8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 -- 172.21.15.52:0/617891941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80033f0 con 0x7fafa80038e0 2023-05-10T01:25:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafcc844700 1 -- 172.21.15.52:0/617891941 reap_dead start 2023-05-10T01:25:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc77fe700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8004690 0x7fafa8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc7fff700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafa8003d00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fafb0009a80 tx=0x7fafb0009060).ready entity=mon.0 client_cookie=dbd2cdadea32f045 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0009430 con 0x7fafa80038e0 2023-05-10T01:25:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000e640 con 0x7fafa80038e0 2023-05-10T01:25:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.052+0000 7fafc6ffd700 1 -- 172.21.15.52:0/617891941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000e9c0 con 0x7fafa80038e0 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 -- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 msgr2=0x7fafa8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafa8003d00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fafb0009a80 tx=0x7fafb0009060).stop 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 -- 172.21.15.52:0/617891941 shutdown_connections 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 --2- 172.21.15.52:0/617891941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafa8003d00 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 -- 172.21.15.52:0/617891941 >> 172.21.15.52:0/617891941 conn(0x7fafc80cb6f0 msgr2=0x7fafc80c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 -- 172.21.15.52:0/617891941 shutdown_connections 2023-05-10T01:25:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.053+0000 7fafce2a7700 1 -- 172.21.15.52:0/617891941 wait complete. 2023-05-10T01:25:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.054+0000 7fafce2a7700 1 Processor -- start 2023-05-10T01:25:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.054+0000 7fafce2a7700 1 -- start start 2023-05-10T01:25:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafc80c40f0 0x7fafc8146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 0x7fafc8159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c32e0 con 0x7fafa80038e0 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8159910 con 0x7fafc80c40f0 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafce2a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c2d20 con 0x7fafc8158fa0 2023-05-10T01:25:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36884/0 (socket says 172.21.15.52:36884) 2023-05-10T01:25:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 -- 172.21.15.52:0/1214130235 learned_addr learned my addr 172.21.15.52:0/1214130235 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc77fe700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafc80c40f0 0x7fafc8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafcc844700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 0x7fafc8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 -- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 msgr2=0x7fafc8159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 0x7fafc8159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 -- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafc80c40f0 msgr2=0x7fafc8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafc80c40f0 0x7fafc8146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 -- 172.21.15.52:0/1214130235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80c3000 con 0x7fafa80038e0 2023-05-10T01:25:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafcc844700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 0x7fafc8159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.055+0000 7fafc7fff700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fafb0006d50 tx=0x7fafb001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.056+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000ed70 con 0x7fafa80038e0 2023-05-10T01:25:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.056+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000e7b0 con 0x7fafa80038e0 2023-05-10T01:25:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.056+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0025440 con 0x7fafa80038e0 2023-05-10T01:25:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.056+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc8156c40 con 0x7fafa80038e0 2023-05-10T01:25:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.056+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc81645d0 con 0x7fafa80038e0 2023-05-10T01:25:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.057+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc8066720 con 0x7fafa80038e0 2023-05-10T01:25:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.057+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 37) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fafb002b020 con 0x7fafa80038e0 2023-05-10T01:25:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.057+0000 7fafbffff700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 0x7fafac0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.057+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6858+0+0 (secure 0 0 0) 0x7fafb007b440 con 0x7fafa80038e0 2023-05-10T01:25:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.058+0000 7fafc77fe700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 0x7fafac0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.058+0000 7fafc77fe700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 0x7fafac0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fafb8007fd0 tx=0x7fafb8009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.062+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafb004c8d0 con 0x7fafa80038e0 2023-05-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.233+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafc806c340 con 0x7fafa80038e0 2023-05-10T01:25:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.913+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fafb007b0c0 con 0x7fafa80038e0 2023-05-10T01:25:21.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.917+0000 7fafbffff700 1 -- 172.21.15.52:0/1214130235 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7fafb00425d0 con 0x7fafa80038e0 2023-05-10T01:25:21.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.921+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 msgr2=0x7fafac0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.921+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 0x7fafac0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fafb8007fd0 tx=0x7fafb8009040).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.921+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 msgr2=0x7fafc80c2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.921+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fafb0006d50 tx=0x7fafb001a000).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 shutdown_connections 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fafac05ecf0 0x7fafac0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fafc8158fa0 0x7fafc8159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafa80038e0 0x7fafc80c2690 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 --2- 172.21.15.52:0/1214130235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafc80c40f0 0x7fafc8146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:21.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 >> 172.21.15.52:0/1214130235 conn(0x7fafc80cb6f0 msgr2=0x7fafc8069610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 shutdown_connections 2023-05-10T01:25:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:21.922+0000 7fafce2a7700 1 -- 172.21.15.52:0/1214130235 wait complete. 2023-05-10T01:25:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:25:21.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:25:22.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.069+0000 7fa4cad64700 1 Processor -- start 2023-05-10T01:25:22.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.069+0000 7fa4cad64700 1 -- start start 2023-05-10T01:25:22.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4cad64700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4cad64700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4c4155370 0x7fa4c40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4cad64700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40c6660 con 0x7fa4c40c5cf0 2023-05-10T01:25:22.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4cad64700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c4069f50 con 0x7fa4c4155370 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4cad64700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c406a9d0 con 0x7fa4c4153f80 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c9561700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa4c40c5cf0 0x7fa4c40c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45908/0 (socket says 172.21.15.52:45908) 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c9561700 1 -- 172.21.15.52:0/54073143 learned_addr learned my addr 172.21.15.52:0/54073143 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c9d62700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 --2- 172.21.15.52:0/54073143 >> v2:172.21.15.172:3300/0 conn(0x7fa4c4155370 0x7fa4c40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523672928 0 0) 0x7fa4c40c6660 con 0x7fa4c40c5cf0 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b00033f0 con 0x7fa4c40c5cf0 2023-05-10T01:25:22.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 -- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 msgr2=0x7fa4c40a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c40a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122124108 0 0) 0x7fa4b00033f0 con 0x7fa4c40c5cf0 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 -- 172.21.15.52:0/54073143 >> v1:172.21.15.52:6789/0 conn(0x7fa4c40c5cf0 legacy=0x7fa4c40c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 -- 172.21.15.52:0/54073143 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c406a130 con 0x7fa4c4155370 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4c9d62700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c40a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.070+0000 7fa4ca563700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c4155370 0x7fa4c40c6170 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa4b4009760 tx=0x7fa4b4009060).ready entity=mon.1 client_cookie=a3c9e7f5aa1262a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8001470 con 0x7fa4c4155370 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4011400 con 0x7fa4c4155370 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4c8d60700 1 -- 172.21.15.52:0/54073143 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011780 con 0x7fa4c4155370 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 -- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c4155370 msgr2=0x7fa4c40c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c4155370 0x7fa4c40c6170 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa4b4009760 tx=0x7fa4b4009060).stop 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 -- 172.21.15.52:0/54073143 shutdown_connections 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c4155370 0x7fa4c40c6170 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 --2- 172.21.15.52:0/54073143 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c40a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 -- 172.21.15.52:0/54073143 >> 172.21.15.52:0/54073143 conn(0x7fa4c40cb5f0 msgr2=0x7fa4c40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 -- 172.21.15.52:0/54073143 shutdown_connections 2023-05-10T01:25:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.071+0000 7fa4cad64700 1 -- 172.21.15.52:0/54073143 wait complete. 2023-05-10T01:25:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.072+0000 7fa4cad64700 1 Processor -- start 2023-05-10T01:25:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.072+0000 7fa4cad64700 1 -- start start 2023-05-10T01:25:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c40c5cf0 0x7fa4c414d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c41675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c414d790 con 0x7fa4c4155370 2023-05-10T01:25:22.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4167f90 con 0x7fa4c40c5cf0 2023-05-10T01:25:22.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4cad64700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40c48c0 con 0x7fa4c4153f80 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36898/0 (socket says 172.21.15.52:36898) 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 -- 172.21.15.52:0/3947429724 learned_addr learned my addr 172.21.15.52:0/3947429724 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4c9d62700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c40c5cf0 0x7fa4c414d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4c9561700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c41675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 -- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 msgr2=0x7fa4c41675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c41675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 -- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c40c5cf0 msgr2=0x7fa4c414d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c40c5cf0 0x7fa4c414d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.073+0000 7fa4ca563700 1 -- 172.21.15.52:0/3947429724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009a20 con 0x7fa4c4155370 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4ca563700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fa4b4009d50 tx=0x7fa4b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4010a50 con 0x7fa4c4155370 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4010bb0 con 0x7fa4c4155370 2023-05-10T01:25:22.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b401d430 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b40092a0 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.074+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c40c28b0 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.075+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4083110 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.075+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa4b4024030 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.076+0000 7fa4c1ffb700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 0x7fa4a4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.076+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa4b407a950 con 0x7fa4c4155370 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.076+0000 7fa4c9d62700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 0x7fa4a4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:22.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.076+0000 7fa4c9d62700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 0x7fa4a4061220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa4bc009fd0 tx=0x7fa4bc00b040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:22.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.080+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4b404be70 con 0x7fa4c4155370 2023-05-10T01:25:22.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.253+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4c4047150 con 0x7fa4c4155370 2023-05-10T01:25:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.918+0000 7fa4c1ffb700 1 -- 172.21.15.52:0/3947429724 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4b4022070 con 0x7fa4c4155370 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 msgr2=0x7fa4a4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 0x7fa4a4061220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa4bc009fd0 tx=0x7fa4bc00b040).stop 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 msgr2=0x7fa4c4167aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fa4b4009d50 tx=0x7fa4b4016000).stop 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 shutdown_connections 2023-05-10T01:25:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa4a405ed60 0x7fa4a4061220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c4155370 0x7fa4c4167aa0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c40c5cf0 0x7fa4c414d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 --2- 172.21.15.52:0/3947429724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4c4153f80 0x7fa4c41675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 >> 172.21.15.52:0/3947429724 conn(0x7fa4c40cb5f0 msgr2=0x7fa4c40bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 shutdown_connections 2023-05-10T01:25:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:22.922+0000 7fa4cad64700 1 -- 172.21.15.52:0/3947429724 wait complete. 2023-05-10T01:25:22.928 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:25:22.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:25:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.064+0000 7f1404db8700 1 Processor -- start 2023-05-10T01:25:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.064+0000 7f1404db8700 1 -- start start 2023-05-10T01:25:23.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f1404db8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14000c5d20 0x7f14000aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f1404db8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14000c6100 0x7f1400069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f1404db8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1400154630 con 0x7f1400153a90 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f1404db8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14000ca5f0 con 0x7f14000c6100 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f1404db8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000c8820 con 0x7f14000c5d20 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14000c6100 0x7f1400069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14000c6100 0x7f1400069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36908/0 (socket says 172.21.15.52:36908) 2023-05-10T01:25:23.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1993098291 learned_addr learned my addr 172.21.15.52:0/1993098291 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fe59c700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14000c5d20 0x7f14000aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1993098291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14000c5d20 msgr2=0x7f14000aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14000c5d20 0x7f14000aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1993098291 >> v1:172.21.15.172:6789/0 conn(0x7f1400153a90 legacy=0x7f1400153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1993098291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000c8b00 con 0x7f14000c6100 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fdd9b700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f1400069fe0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f13f4006fd0 tx=0x7f13f40090f0).ready entity=mon.0 client_cookie=fb26d652f8ea40bf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fd59a700 1 -- 172.21.15.52:0/1993098291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400b580 con 0x7f14000c6100 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fd59a700 1 -- 172.21.15.52:0/1993098291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400b6e0 con 0x7f14000c6100 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.065+0000 7f13fd59a700 1 -- 172.21.15.52:0/1993098291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400ba60 con 0x7f14000c6100 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 -- 172.21.15.52:0/1993098291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 msgr2=0x7f1400069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f1400069fe0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f13f4006fd0 tx=0x7f13f40090f0).stop 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 -- 172.21.15.52:0/1993098291 shutdown_connections 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14000c5d20 0x7f14000aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 --2- 172.21.15.52:0/1993098291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f1400069fe0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 -- 172.21.15.52:0/1993098291 >> 172.21.15.52:0/1993098291 conn(0x7f14000cb6f0 msgr2=0x7f14000c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 -- 172.21.15.52:0/1993098291 shutdown_connections 2023-05-10T01:25:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.066+0000 7f1404db8700 1 -- 172.21.15.52:0/1993098291 wait complete. 2023-05-10T01:25:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.067+0000 7f1404db8700 1 Processor -- start 2023-05-10T01:25:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.067+0000 7f1404db8700 1 -- start start 2023-05-10T01:25:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14000c5d20 0x7f140014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1400153a90 0x7f14000c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000c4f40 con 0x7f14000c6100 2023-05-10T01:25:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000aeba0 con 0x7f14000c5d20 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f1404db8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000c46a0 con 0x7f1400153a90 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f13fdd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f13fdd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36914/0 (socket says 172.21.15.52:36914) 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f13fed9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1400153a90 0x7f14000c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1774282029 learned_addr learned my addr 172.21.15.52:0/1774282029 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.068+0000 7f13fe59c700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14000c5d20 0x7f140014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1400153a90 msgr2=0x7f14000c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1400153a90 0x7f14000c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14000c5d20 msgr2=0x7f140014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14000c5d20 0x7f140014be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 -- 172.21.15.52:0/1774282029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4009370 con 0x7f14000c6100 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13fdd9b700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f13f4009fd0 tx=0x7f13f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400b850 con 0x7f14000c6100 2023-05-10T01:25:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400b9b0 con 0x7f14000c6100 2023-05-10T01:25:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f401c670 con 0x7f14000c6100 2023-05-10T01:25:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14000c4980 con 0x7f14000c6100 2023-05-10T01:25:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.069+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140014c2f0 con 0x7f14000c6100 2023-05-10T01:25:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.071+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e0005120 con 0x7f14000c6100 2023-05-10T01:25:23.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.073+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f13f400f070 con 0x7f14000c6100 2023-05-10T01:25:23.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.073+0000 7f13ee7fc700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 0x7f13dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.073+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f13f407b570 con 0x7f14000c6100 2023-05-10T01:25:23.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.074+0000 7f13fe59c700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 0x7f13dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.076+0000 7f13fe59c700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 0x7f13dc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f13f8009c30 tx=0x7f13f8009060).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.081+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13f404ca70 con 0x7f14000c6100 2023-05-10T01:25:23.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.255+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f13e0005d70 con 0x7f14000c6100 2023-05-10T01:25:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.258+0000 7f13ee7fc700 1 -- 172.21.15.52:0/1774282029 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7f13f4050090 con 0x7f14000c6100 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 msgr2=0x7f13dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 0x7f13dc061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f13f8009c30 tx=0x7f13f8009060).stop 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 msgr2=0x7f14000adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f13f4009fd0 tx=0x7f13f4017000).stop 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 shutdown_connections 2023-05-10T01:25:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f13dc05ed90 0x7f13dc061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1400153a90 0x7f14000c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14000c5d20 0x7f140014be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 --2- 172.21.15.52:0/1774282029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14000c6100 0x7f14000adfe0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 >> 172.21.15.52:0/1774282029 conn(0x7f14000cb6f0 msgr2=0x7f14000ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 shutdown_connections 2023-05-10T01:25:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.260+0000 7f1404db8700 1 -- 172.21.15.52:0/1774282029 wait complete. 2023-05-10T01:25:23.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:25:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.390+0000 7f8567edf700 1 Processor -- start 2023-05-10T01:25:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.390+0000 7f8567edf700 1 -- start start 2023-05-10T01:25:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8567edf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85600c6100 0x7f85601541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8567edf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600ca5f0 con 0x7f85600c5d20 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8567edf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600c8820 con 0x7f85600aa200 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8567edf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600c6550 con 0x7f85600c6100 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f856647c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85600c6100 0x7f85601541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8565c7b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f85600c5d20 0x7f8560069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45934/0 (socket says 172.21.15.52:45934) 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.391+0000 7f8565c7b700 1 -- 172.21.15.52:0/2900938515 learned_addr learned my addr 172.21.15.52:0/2900938515 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f856647c700 1 -- 172.21.15.52:0/2900938515 >> v1:172.21.15.172:6789/0 conn(0x7f85600aa200 legacy=0x7f8560153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f856647c700 1 -- 172.21.15.52:0/2900938515 >> v1:172.21.15.52:6789/0 conn(0x7f85600c5d20 legacy=0x7f8560069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f856647c700 1 -- 172.21.15.52:0/2900938515 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600c8b00 con 0x7f85600c6100 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8564c79700 1 -- 172.21.15.52:0/2900938515 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91003444 0 0) 0x7f85600ca5f0 con 0x7f85600c5d20 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f856647c700 1 --2- 172.21.15.52:0/2900938515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85601541a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f8550009e60 tx=0x7f8550009780).ready entity=mon.0 client_cookie=265a3919414cf6dd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8564c79700 1 -- 172.21.15.52:0/2900938515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000e070 con 0x7f85600c6100 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8564c79700 1 -- 172.21.15.52:0/2900938515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855000bbf0 con 0x7f85600c6100 2023-05-10T01:25:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8564c79700 1 -- 172.21.15.52:0/2900938515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550012410 con 0x7f85600c6100 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8567edf700 1 -- 172.21.15.52:0/2900938515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 msgr2=0x7f85601541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8567edf700 1 --2- 172.21.15.52:0/2900938515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85601541a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f8550009e60 tx=0x7f8550009780).stop 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8567edf700 1 -- 172.21.15.52:0/2900938515 shutdown_connections 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8567edf700 1 --2- 172.21.15.52:0/2900938515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85601541a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.392+0000 7f8567edf700 1 -- 172.21.15.52:0/2900938515 >> 172.21.15.52:0/2900938515 conn(0x7f85600cb6f0 msgr2=0x7f85600c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.393+0000 7f8567edf700 1 -- 172.21.15.52:0/2900938515 shutdown_connections 2023-05-10T01:25:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.393+0000 7f8567edf700 1 -- 172.21.15.52:0/2900938515 wait complete. 2023-05-10T01:25:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 Processor -- start 2023-05-10T01:25:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 -- start start 2023-05-10T01:25:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85600aa200 0x7f85601417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85600c5d20 0x7f85600adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600ae5b0 con 0x7f85600c6100 2023-05-10T01:25:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c4d10 con 0x7f85600aa200 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f8567edf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600af620 con 0x7f85600c5d20 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f856647c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.394+0000 7f856647c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36928/0 (socket says 172.21.15.52:36928) 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 -- 172.21.15.52:0/3781556147 learned_addr learned my addr 172.21.15.52:0/3781556147 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f8565c7b700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85600aa200 0x7f85601417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856547a700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85600c5d20 0x7f85600adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 -- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85600c5d20 msgr2=0x7f85600adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85600c5d20 0x7f85600adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 -- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85600aa200 msgr2=0x7f85601417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85600aa200 0x7f85601417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 -- 172.21.15.52:0/3781556147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550009a20 con 0x7f85600c6100 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f856647c700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f8560083c40 tx=0x7f8550009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855001c660 con 0x7f85600c6100 2023-05-10T01:25:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855001c7c0 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560164250 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855001cb60 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.395+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85600aea90 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.396+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8560066720 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.397+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f855001d420 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.397+0000 7f855dffb700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 0x7f8540061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.397+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f855007bc90 con 0x7f85600c6100 2023-05-10T01:25:23.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.397+0000 7f8565c7b700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 0x7f8540061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.398+0000 7f8565c7b700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 0x7f8540061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f85580011e0 tx=0x7f8558007bb0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.401+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f855004d240 con 0x7f85600c6100 2023-05-10T01:25:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.575+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8560066720 con 0x7f85600c6100 2023-05-10T01:25:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.578+0000 7f855dffb700 1 -- 172.21.15.52:0/3781556147 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8550050860 con 0x7f85600c6100 2023-05-10T01:25:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 msgr2=0x7f8540061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 0x7f8540061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f85580011e0 tx=0x7f8558007bb0).stop 2023-05-10T01:25:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 msgr2=0x7f85600ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f8560083c40 tx=0x7f8550009780).stop 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 shutdown_connections 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f854005ed90 0x7f8540061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85600c6100 0x7f85600ae0c0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85600aa200 0x7f85601417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 --2- 172.21.15.52:0/3781556147 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85600c5d20 0x7f85600adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 >> 172.21.15.52:0/3781556147 conn(0x7f85600cb6f0 msgr2=0x7f85600acc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:23.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 shutdown_connections 2023-05-10T01:25:23.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.580+0000 7f8567edf700 1 -- 172.21.15.52:0/3781556147 wait complete. 2023-05-10T01:25:23.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-05-10T01:25:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.709+0000 7f776b59e700 1 Processor -- start 2023-05-10T01:25:23.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.709+0000 7f776b59e700 1 -- start start 2023-05-10T01:25:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f776c0c1090 0x7f776c0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776b59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c158960 con 0x7f776c0c7370 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c1552f0 con 0x7f776c154e40 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c157d50 con 0x7f776c0c1090 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f776c0c1090 0x7f776c0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776a59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f776c0c7370 0x7f776c0c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45948/0 (socket says 172.21.15.52:45948) 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.710+0000 7f776a59c700 1 -- 172.21.15.52:0/3736847662 learned_addr learned my addr 172.21.15.52:0/3736847662 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776ad9d700 1 -- 172.21.15.52:0/3736847662 >> v1:172.21.15.172:6789/0 conn(0x7f776c154e40 legacy=0x7f776c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776ad9d700 1 -- 172.21.15.52:0/3736847662 >> v1:172.21.15.52:6789/0 conn(0x7f776c0c7370 legacy=0x7f776c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776ad9d700 1 -- 172.21.15.52:0/3736847662 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c158030 con 0x7f776c0c1090 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776959a700 1 -- 172.21.15.52:0/3736847662 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122229593 0 0) 0x7f776c158960 con 0x7f776c0c7370 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776ad9d700 1 --2- 172.21.15.52:0/3736847662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c1090 0x7f776c0ad250 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f776c158910 tx=0x7f7764009780).ready entity=mon.0 client_cookie=47e534f8125d8808 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776959a700 1 -- 172.21.15.52:0/3736847662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400e070 con 0x7f776c0c1090 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776959a700 1 -- 172.21.15.52:0/3736847662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400bbf0 con 0x7f776c0c1090 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776959a700 1 -- 172.21.15.52:0/3736847662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764012410 con 0x7f776c0c1090 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776b59e700 1 -- 172.21.15.52:0/3736847662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c1090 msgr2=0x7f776c0ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776b59e700 1 --2- 172.21.15.52:0/3736847662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c1090 0x7f776c0ad250 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f776c158910 tx=0x7f7764009780).stop 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.711+0000 7f776b59e700 1 -- 172.21.15.52:0/3736847662 shutdown_connections 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.712+0000 7f776b59e700 1 --2- 172.21.15.52:0/3736847662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c1090 0x7f776c0ad250 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.712+0000 7f776b59e700 1 -- 172.21.15.52:0/3736847662 >> 172.21.15.52:0/3736847662 conn(0x7f776c068320 msgr2=0x7f776c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.712+0000 7f776b59e700 1 -- 172.21.15.52:0/3736847662 shutdown_connections 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.712+0000 7f776b59e700 1 -- 172.21.15.52:0/3736847662 wait complete. 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 Processor -- start 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 -- start start 2023-05-10T01:25:23.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f776c0c1090 0x7f776c163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 0x7f776c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0c8960 con 0x7f776c0c7370 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0c4a20 con 0x7f776c0c1090 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f776b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c1644d0 con 0x7f776c154e40 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.713+0000 7f7769d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36940/0 (socket says 172.21.15.52:36940) 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 -- 172.21.15.52:0/226848783 learned_addr learned my addr 172.21.15.52:0/226848783 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f776ad9d700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 0x7f776c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f776a59c700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f776c0c1090 0x7f776c163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 -- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 msgr2=0x7f776c068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 0x7f776c068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 -- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f776c0c1090 msgr2=0x7f776c163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f776c0c1090 0x7f776c163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:23.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 -- 172.21.15.52:0/226848783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009a20 con 0x7f776c0c7370 2023-05-10T01:25:23.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f776ad9d700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 0x7f776c068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:23.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f7769d9b700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f775400c440 tx=0x7f7754007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400f470 con 0x7f776c0c7370 2023-05-10T01:25:23.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775400f5f0 con 0x7f776c0c7370 2023-05-10T01:25:23.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c1647b0 con 0x7f776c0c7370 2023-05-10T01:25:23.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400f9b0 con 0x7f776c0c7370 2023-05-10T01:25:23.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.714+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c164d70 con 0x7f776c0c7370 2023-05-10T01:25:23.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.715+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c047150 con 0x7f776c0c7370 2023-05-10T01:25:23.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.716+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7754019030 con 0x7f776c0c7370 2023-05-10T01:25:23.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.716+0000 7f77627fc700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 0x7f7750061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:23.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.716+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7754078ee0 con 0x7f776c0c7370 2023-05-10T01:25:23.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.716+0000 7f776a59c700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 0x7f7750061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:23.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.716+0000 7f776a59c700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 0x7f7750061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f775c0011e0 tx=0x7f775c009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:23.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.720+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77540488f0 con 0x7f776c0c7370 2023-05-10T01:25:23.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:23.964+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f776c0bfb80 con 0x7f776c0c7370 2023-05-10T01:25:24.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.921+0000 7f77627fc700 1 -- 172.21.15.52:0/226848783 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v578) v1 ==== 166+0+0 (secure 0 0 0) 0x7f775404dfd0 con 0x7f776c0c7370 2023-05-10T01:25:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 msgr2=0x7f7750061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 0x7f7750061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f775c0011e0 tx=0x7f775c009040).stop 2023-05-10T01:25:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 msgr2=0x7f776c0c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f775400c440 tx=0x7f7754007de0).stop 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 shutdown_connections 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f775005ed90 0x7f7750061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f776c154e40 0x7f776c068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f776c0c1090 0x7f776c163ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 --2- 172.21.15.52:0/226848783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c0c7370 0x7f776c0c4530 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 >> 172.21.15.52:0/226848783 conn(0x7f776c068320 msgr2=0x7f776c0acac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 shutdown_connections 2023-05-10T01:25:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:24.924+0000 7f776b59e700 1 -- 172.21.15.52:0/226848783 wait complete. 2023-05-10T01:25:24.942 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-05-10T01:25:24.943 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-05-10T01:25:24.943 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:25:24.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-05-10T01:25:25.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.063+0000 7f31e1963700 1 Processor -- start 2023-05-10T01:25:25.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.063+0000 7f31e1963700 1 -- start start 2023-05-10T01:25:25.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31e1963700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31e1963700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31dc069da0 0x7f31dc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31e1963700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc0c0650 con 0x7f31dc154540 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31e1963700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0c1af0 con 0x7f31dc069da0 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31e1963700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0bfd20 con 0x7f31dc154160 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31db7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31dc069da0 0x7f31dc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31da7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f31dc154540 0x7f31dc069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45962/0 (socket says 172.21.15.52:45962) 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.064+0000 7f31da7fc700 1 -- 172.21.15.52:0/1023798195 learned_addr learned my addr 172.21.15.52:0/1023798195 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31daffd700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31db7fe700 1 -- 172.21.15.52:0/1023798195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 msgr2=0x7f31dc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31db7fe700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31db7fe700 1 -- 172.21.15.52:0/1023798195 >> v1:172.21.15.52:6789/0 conn(0x7f31dc154540 legacy=0x7f31dc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31db7fe700 1 -- 172.21.15.52:0/1023798195 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0c0000 con 0x7f31dc069da0 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31d9ffb700 1 -- 172.21.15.52:0/1023798195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534136660 0 0) 0x7f31dc0c0650 con 0x7f31dc154540 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31db7fe700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc0c6150 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f31cc009e60 tx=0x7f31cc009780).ready entity=mon.0 client_cookie=a538b911c91c2a39 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31d9ffb700 1 -- 172.21.15.52:0/1023798195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00e070 con 0x7f31dc069da0 2023-05-10T01:25:25.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31d9ffb700 1 -- 172.21.15.52:0/1023798195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00bb60 con 0x7f31dc069da0 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.065+0000 7f31d9ffb700 1 -- 172.21.15.52:0/1023798195 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc012410 con 0x7f31dc069da0 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 -- 172.21.15.52:0/1023798195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 msgr2=0x7f31dc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc0c6150 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f31cc009e60 tx=0x7f31cc009780).stop 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 -- 172.21.15.52:0/1023798195 shutdown_connections 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc0c6150 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 --2- 172.21.15.52:0/1023798195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 -- 172.21.15.52:0/1023798195 >> 172.21.15.52:0/1023798195 conn(0x7f31dc0cb6f0 msgr2=0x7f31dc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:25.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 -- 172.21.15.52:0/1023798195 shutdown_connections 2023-05-10T01:25:25.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.066+0000 7f31e1963700 1 -- 172.21.15.52:0/1023798195 wait complete. 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.067+0000 7f31e1963700 1 Processor -- start 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.067+0000 7f31e1963700 1 -- start start 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31dc154540 0x7f31dc145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0c29e0 con 0x7f31dc069da0 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc144e10 con 0x7f31dc154540 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0c1dd0 con 0x7f31dc154160 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36952/0 (socket says 172.21.15.52:36952) 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 -- 172.21.15.52:0/4192276450 learned_addr learned my addr 172.21.15.52:0/4192276450 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 -- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 msgr2=0x7f31dc1459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 -- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31dc154540 msgr2=0x7f31dc145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31db7fe700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31dc154540 0x7f31dc145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31dc154540 0x7f31dc145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 -- 172.21.15.52:0/4192276450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc009a20 con 0x7f31dc069da0 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31daffd700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f31d400e930 tx=0x7f31d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400eed0 con 0x7f31dc069da0 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400c850 con 0x7f31dc069da0 2023-05-10T01:25:25.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc0c20b0 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400cbd0 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.068+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc0c2670 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.069+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc0666b0 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.070+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f31d4022070 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.070+0000 7f31d2ffd700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 0x7f31c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.070+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f31d4079f30 con 0x7f31dc069da0 2023-05-10T01:25:25.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.070+0000 7f31da7fc700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 0x7f31c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:25.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.071+0000 7f31da7fc700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 0x7f31c0061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f31dc0c5020 tx=0x7f31c40079f0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:25.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.074+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31d40a88f0 con 0x7f31dc069da0 2023-05-10T01:25:25.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.318+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f31dc06c340 con 0x7f31dc069da0 2023-05-10T01:25:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.923+0000 7f31d2ffd700 1 -- 172.21.15.52:0/4192276450 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v579) v1 ==== 151+0+0 (secure 0 0 0) 0x7f31d4016070 con 0x7f31dc069da0 2023-05-10T01:25:25.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.925+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 msgr2=0x7f31c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.925+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 0x7f31c0061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f31dc0c5020 tx=0x7f31c40079f0).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.925+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 msgr2=0x7f31dc144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.925+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f31d400e930 tx=0x7f31d4009060).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 shutdown_connections 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31c005ed90 0x7f31c0061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31dc154540 0x7f31dc145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31dc069da0 0x7f31dc144920 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 --2- 172.21.15.52:0/4192276450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31dc154160 0x7f31dc1459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 >> 172.21.15.52:0/4192276450 conn(0x7f31dc0cb6f0 msgr2=0x7f31dc14f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:25.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 shutdown_connections 2023-05-10T01:25:25.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:25.926+0000 7f31e1963700 1 -- 172.21.15.52:0/4192276450 wait complete. 2023-05-10T01:25:25.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:25:26.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.066+0000 7ff70c5f3700 1 Processor -- start 2023-05-10T01:25:26.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.066+0000 7ff70c5f3700 1 -- start start 2023-05-10T01:25:26.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff70c5f3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff704154080 0x7ff7040aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff70c5f3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040c94c0 con 0x7ff704154460 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff70c5f3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040cb7d0 con 0x7ff704068150 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff70c5f3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040c88b0 con 0x7ff704154080 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff709b8e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff704154460 0x7ff7040a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45980/0 (socket says 172.21.15.52:45980) 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff70a38f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff704154080 0x7ff7040aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.067+0000 7ff709b8e700 1 -- 172.21.15.52:0/1541036237 learned_addr learned my addr 172.21.15.52:0/1541036237 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:26.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70a38f700 1 -- 172.21.15.52:0/1541036237 >> v1:172.21.15.172:6789/0 conn(0x7ff704068150 legacy=0x7ff7040c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70938d700 1 -- 172.21.15.52:0/1541036237 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811621155 0 0) 0x7ff7040c94c0 con 0x7ff704154460 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70a38f700 1 -- 172.21.15.52:0/1541036237 >> v1:172.21.15.52:6789/0 conn(0x7ff704154460 legacy=0x7ff7040a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70a38f700 1 -- 172.21.15.52:0/1541036237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040c8b90 con 0x7ff704154080 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70a38f700 1 --2- 172.21.15.52:0/1541036237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff7040aac90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ff6fc009e60 tx=0x7ff6fc009780).ready entity=mon.0 client_cookie=b5e380437e6865c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70938d700 1 -- 172.21.15.52:0/1541036237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00e070 con 0x7ff704154080 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70938d700 1 -- 172.21.15.52:0/1541036237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00bc30 con 0x7ff704154080 2023-05-10T01:25:26.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.068+0000 7ff70938d700 1 -- 172.21.15.52:0/1541036237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc012410 con 0x7ff704154080 2023-05-10T01:25:26.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1541036237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 msgr2=0x7ff7040aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1541036237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff7040aac90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ff6fc009e60 tx=0x7ff6fc009780).stop 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1541036237 shutdown_connections 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1541036237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff7040aac90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1541036237 >> 172.21.15.52:0/1541036237 conn(0x7ff704067910 msgr2=0x7ff7040cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1541036237 shutdown_connections 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.069+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1541036237 wait complete. 2023-05-10T01:25:26.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.070+0000 7ff70c5f3700 1 Processor -- start 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.070+0000 7ff70c5f3700 1 -- start start 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff704068150 0x7ff7040c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 0x7ff704156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040c3f20 con 0x7ff704154080 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040c1cc0 con 0x7ff704068150 2023-05-10T01:25:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040c4130 con 0x7ff704154460 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36968/0 (socket says 172.21.15.52:36968) 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 -- 172.21.15.52:0/1276850777 learned_addr learned my addr 172.21.15.52:0/1276850777 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70a38f700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff704068150 0x7ff7040c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70ab90700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 0x7ff704156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 -- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 msgr2=0x7ff704156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 0x7ff704156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 -- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff704068150 msgr2=0x7ff7040c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff704068150 0x7ff7040c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 -- 172.21.15.52:0/1276850777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc009a20 con 0x7ff704154080 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70ab90700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 0x7ff704156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff709b8e700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7ff6f800c490 tx=0x7ff6f8007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80072e0 con 0x7ff704154080 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8007440 con 0x7ff704154080 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80057a0 con 0x7ff704154080 2023-05-10T01:25:26.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040c4410 con 0x7ff704154080 2023-05-10T01:25:26.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.071+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040c21f0 con 0x7ff704154080 2023-05-10T01:25:26.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.072+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704068e40 con 0x7ff704154080 2023-05-10T01:25:26.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.073+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff6f8010070 con 0x7ff704154080 2023-05-10T01:25:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.073+0000 7ff7027fc700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.073+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7ff6f80790d0 con 0x7ff704154080 2023-05-10T01:25:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.073+0000 7ff70a38f700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.074+0000 7ff70a38f700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff6fc0099f0 tx=0x7ff6fc009780).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.077+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6f804a6e0 con 0x7ff704154080 2023-05-10T01:25:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.249+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff704066720 con 0x7ff704154080 2023-05-10T01:25:26.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.252+0000 7ff7027fc700 1 -- 172.21.15.52:0/1276850777 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6f804dd00 con 0x7ff704154080 2023-05-10T01:25:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 msgr2=0x7ff6e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff6fc0099f0 tx=0x7ff6fc009780).stop 2023-05-10T01:25:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 msgr2=0x7ff70414ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7ff6f800c490 tx=0x7ff6f8007e40).stop 2023-05-10T01:25:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 shutdown_connections 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff6e405ed90 0x7ff6e4061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff704154460 0x7ff704156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff704068150 0x7ff7040c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 --2- 172.21.15.52:0/1276850777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff704154080 0x7ff70414ecd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 >> 172.21.15.52:0/1276850777 conn(0x7ff704067910 msgr2=0x7ff704159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 shutdown_connections 2023-05-10T01:25:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.254+0000 7ff70c5f3700 1 -- 172.21.15.52:0/1276850777 wait complete. 2023-05-10T01:25:26.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:25:26.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:25:26.297 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:25:26.329 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:25:26.330 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:25:26.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.450+0000 7fbb75ce3700 1 Processor -- start 2023-05-10T01:25:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.450+0000 7fbb75ce3700 1 -- start start 2023-05-10T01:25:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb75ce3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 0x7fbb700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb75ce3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb75ce3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb700c0650 con 0x7fbb70069690 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb75ce3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700c1af0 con 0x7fbb70154160 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb75ce3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700bfd20 con 0x7fbb70154540 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbb70069690 0x7fbb70157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45994/0 (socket says 172.21.15.52:45994) 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6ffff700 1 -- 172.21.15.52:0/4043486360 learned_addr learned my addr 172.21.15.52:0/4043486360 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6f7fe700 1 --2- 172.21.15.52:0/4043486360 >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 0x7fbb700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6effd700 1 --2- 172.21.15.52:0/4043486360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223708731 0 0) 0x7fbb700c0650 con 0x7fbb70069690 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.451+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb5c0033f0 con 0x7fbb70069690 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6effd700 1 -- 172.21.15.52:0/4043486360 >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 msgr2=0x7fbb700c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6effd700 1 --2- 172.21.15.52:0/4043486360 >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 0x7fbb700c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6effd700 1 -- 172.21.15.52:0/4043486360 >> v1:172.21.15.52:6789/0 conn(0x7fbb70069690 legacy=0x7fbb70157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635644102 0 0) 0x7fbb5c0033f0 con 0x7fbb70069690 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6effd700 1 -- 172.21.15.52:0/4043486360 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700c0000 con 0x7fbb70154540 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6f7fe700 1 --2- 172.21.15.52:0/4043486360 >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 0x7fbb700c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:26.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6effd700 1 --2- 172.21.15.52:0/4043486360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700c6150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbb64009760 tx=0x7fbb64009060).ready entity=mon.2 client_cookie=bae6efc23374a2a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680017f0 con 0x7fbb70154540 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb640090d0 con 0x7fbb70154540 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb6e7fc700 1 -- 172.21.15.52:0/4043486360 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64011610 con 0x7fbb70154540 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb75ce3700 1 -- 172.21.15.52:0/4043486360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 msgr2=0x7fbb700c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.452+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/4043486360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700c6150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbb64009760 tx=0x7fbb64009060).stop 2023-05-10T01:25:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 -- 172.21.15.52:0/4043486360 shutdown_connections 2023-05-10T01:25:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/4043486360 >> v2:172.21.15.172:3300/0 conn(0x7fbb70154160 0x7fbb700c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/4043486360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700c6150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 -- 172.21.15.52:0/4043486360 >> 172.21.15.52:0/4043486360 conn(0x7fbb700cb6f0 msgr2=0x7fbb700c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 -- 172.21.15.52:0/4043486360 shutdown_connections 2023-05-10T01:25:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.453+0000 7fbb75ce3700 1 -- 172.21.15.52:0/4043486360 wait complete. 2023-05-10T01:25:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.454+0000 7fbb75ce3700 1 Processor -- start 2023-05-10T01:25:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.454+0000 7fbb75ce3700 1 -- start start 2023-05-10T01:25:26.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 0x7fbb70150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70150fd0 con 0x7fbb70069690 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70151590 con 0x7fbb70154160 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7014eea0 con 0x7fbb70154540 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36980/0 (socket says 172.21.15.52:36980) 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 -- 172.21.15.52:0/1657338221 learned_addr learned my addr 172.21.15.52:0/1657338221 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6ffff700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6effd700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 0x7fbb70150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 -- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 msgr2=0x7fbb700a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 -- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 msgr2=0x7fbb70150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 0x7fbb70150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 -- 172.21.15.52:0/1657338221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600092a0 con 0x7fbb70069690 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6effd700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 0x7fbb70150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6ffff700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb6f7fe700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7fbb6000ea20 tx=0x7fbb60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000c850 con 0x7fbb70069690 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6000c9b0 con 0x7fbb70069690 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb640092a0 con 0x7fbb70069690 2023-05-10T01:25:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000cd30 con 0x7fbb70069690 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.455+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb700aeda0 con 0x7fbb70069690 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.456+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb700afd70 con 0x7fbb70069690 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.457+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbb60022070 con 0x7fbb70069690 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.457+0000 7fbb577fe700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 0x7fbb50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.457+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fbb60079fa0 con 0x7fbb70069690 2023-05-10T01:25:26.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.457+0000 7fbb6effd700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 0x7fbb50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.457+0000 7fbb6effd700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 0x7fbb50061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbb70154920 tx=0x7fbb64016000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.461+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb6004b5b0 con 0x7fbb70069690 2023-05-10T01:25:26.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.680+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb700666b0 con 0x7fbb70069690 2023-05-10T01:25:26.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.680+0000 7fbb577fe700 1 -- 172.21.15.52:0/1657338221 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fbb6004ebd0 con 0x7fbb70069690 2023-05-10T01:25:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:26.684 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2335339207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2335339207},{"type":"v1","addr":"172.21.15.172:6836","nonce":2335339207}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5816,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1031490448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1031490448},{"type":"v1","addr":"172.21.15.172:6837","nonce":1031490448}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1962323422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1962323422},{"type":"v1","addr":"172.21.15.52:6834","nonce":1962323422}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7059,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4232701075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":4232701075},{"type":"v1","addr":"172.21.15.52:6835","nonce":4232701075}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[]} 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 msgr2=0x7fbb50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 0x7fbb50061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbb70154920 tx=0x7fbb64016000).stop 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 msgr2=0x7fbb700c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7fbb6000ea20 tx=0x7fbb60009060).stop 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 shutdown_connections 2023-05-10T01:25:26.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbb5005ed90 0x7fbb50061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb70154540 0x7fbb700a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb70069690 0x7fbb700c2a40 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 --2- 172.21.15.52:0/1657338221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb70154160 0x7fbb70150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 >> 172.21.15.52:0/1657338221 conn(0x7fbb700cb6f0 msgr2=0x7fbb700c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 shutdown_connections 2023-05-10T01:25:26.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.682+0000 7fbb75ce3700 1 -- 172.21.15.52:0/1657338221 wait complete. 2023-05-10T01:25:26.688 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 40 2023-05-10T01:25:26.698 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:25:26.698 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:25:26.698 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:25:26.699 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:25:26.699 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:25:26.699 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:25:26.699 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:25:26.699 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:25:26.700 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:25:26.700 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:25:26.700 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:25:26.700 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:25:26.701 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:25:26.701 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:25:26.701 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:25:26.702 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:25:26.708 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:25:26.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:25:26.710 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:25:26.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:25:26.711 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:25:26.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:25:26.712 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:25:26.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:25:26.750 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:25:26.751 DEBUG:teuthology.parallel:result is None 2023-05-10T01:25:26.752 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:25:26.752 DEBUG:teuthology.parallel:result is None 2023-05-10T01:25:26.754 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:25:26.755 DEBUG:teuthology.parallel:result is None 2023-05-10T01:25:26.755 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:25:26.756 DEBUG:teuthology.parallel:result is None 2023-05-10T01:25:26.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:25:26.825 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:25:26.826 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:25:26.840 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:25:26.840 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:25:26.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 Processor -- start 2023-05-10T01:25:26.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 -- start start 2023-05-10T01:25:26.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fc8063e20 0x7f8fc80bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc8062b00 con 0x7f8fc8154170 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc8068610 con 0x7f8fc8153d90 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.877+0000 7f8fcec8d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc80622a0 con 0x7f8fc8063e20 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcca29700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcca29700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37012/0 (socket says 172.21.15.52:37012) 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcca29700 1 -- 172.21.15.52:0/1850905680 learned_addr learned my addr 172.21.15.52:0/1850905680 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 --2- 172.21.15.52:0/1850905680 >> v2:172.21.15.172:3300/0 conn(0x7f8fc8063e20 0x7f8fc80bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 -- 172.21.15.52:0/1850905680 >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 msgr2=0x7f8fc8069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 --2- 172.21.15.52:0/1850905680 >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 -- 172.21.15.52:0/1850905680 >> v1:172.21.15.172:6789/0 conn(0x7f8fc8154170 legacy=0x7f8fc8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 -- 172.21.15.52:0/1850905680 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8068330 con 0x7f8fc8063e20 2023-05-10T01:25:26.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fc77fe700 1 -- 172.21.15.52:0/1850905680 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305567986 0 0) 0x7f8fc8062b00 con 0x7f8fc8154170 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcca29700 1 --2- 172.21.15.52:0/1850905680 >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fcd22a700 1 --2- 172.21.15.52:0/1850905680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8063e20 0x7f8fc80bd9f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f8fc80c9740 tx=0x7f8fc0009780).ready entity=mon.1 client_cookie=11e5146b65ab3d95 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fc77fe700 1 -- 172.21.15.52:0/1850905680 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000e070 con 0x7f8fc8063e20 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fc77fe700 1 -- 172.21.15.52:0/1850905680 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc000bb60 con 0x7f8fc8063e20 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.878+0000 7f8fc77fe700 1 -- 172.21.15.52:0/1850905680 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0012410 con 0x7f8fc8063e20 2023-05-10T01:25:26.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 -- 172.21.15.52:0/1850905680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8063e20 msgr2=0x7f8fc80bd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/1850905680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8063e20 0x7f8fc80bd9f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f8fc80c9740 tx=0x7f8fc0009780).stop 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 -- 172.21.15.52:0/1850905680 shutdown_connections 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/1850905680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8063e20 0x7f8fc80bd9f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/1850905680 >> v2:172.21.15.52:3300/0 conn(0x7f8fc8153d90 0x7f8fc8069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 -- 172.21.15.52:0/1850905680 >> 172.21.15.52:0/1850905680 conn(0x7f8fc80c8a90 msgr2=0x7f8fc80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 -- 172.21.15.52:0/1850905680 shutdown_connections 2023-05-10T01:25:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.879+0000 7f8fcec8d700 1 -- 172.21.15.52:0/1850905680 wait complete. 2023-05-10T01:25:26.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.880+0000 7f8fcec8d700 1 Processor -- start 2023-05-10T01:25:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.880+0000 7f8fcec8d700 1 -- start start 2023-05-10T01:25:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fc8153d90 0x7f8fc815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 0x7f8fc80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8159bb0 con 0x7f8fc8063e20 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8158fa0 con 0x7f8fc8154170 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcec8d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8159280 con 0x7f8fc8153d90 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37020/0 (socket says 172.21.15.52:37020) 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 -- 172.21.15.52:0/381836401 learned_addr learned my addr 172.21.15.52:0/381836401 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcd22a700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 0x7f8fc80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fc7fff700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fc8153d90 0x7f8fc815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 -- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fc8153d90 msgr2=0x7f8fc815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fc8153d90 0x7f8fc815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 -- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 msgr2=0x7f8fc80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 0x7f8fc80c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcca29700 1 -- 172.21.15.52:0/381836401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009370 con 0x7f8fc8063e20 2023-05-10T01:25:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.881+0000 7f8fcd22a700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 0x7f8fc80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fcca29700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8fbc00ea20 tx=0x7f8fbc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00c850 con 0x7f8fc8063e20 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00c9b0 con 0x7f8fc8063e20 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0009a20 con 0x7f8fc8063e20 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00cd30 con 0x7f8fc8063e20 2023-05-10T01:25:26.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.882+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc8159840 con 0x7f8fc8063e20 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.883+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc806c340 con 0x7f8fc8063e20 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.883+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8fbc022070 con 0x7f8fc8063e20 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.883+0000 7f8fc4ff9700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 0x7f8fb0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.884+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f8fbc07a050 con 0x7f8fc8063e20 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.884+0000 7f8fc7fff700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 0x7f8fb0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:26.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.884+0000 7f8fc7fff700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 0x7f8fb0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8fc8152c70 tx=0x7f8fb4009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:26.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:26.888+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fbc04b660 con 0x7f8fc8063e20 2023-05-10T01:25:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.076+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8fc8159e90 con 0x7f8fc8063e20 2023-05-10T01:25:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.930+0000 7f8fc4ff9700 1 -- 172.21.15.52:0/381836401 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8fbc016070 con 0x7f8fc8063e20 2023-05-10T01:25:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 msgr2=0x7f8fb0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 0x7f8fb0061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8fc8152c70 tx=0x7f8fb4009040).stop 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 msgr2=0x7f8fc8158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8fbc00ea20 tx=0x7f8fbc0090f0).stop 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 shutdown_connections 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8fb005ed90 0x7f8fb0061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fc8154170 0x7f8fc80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fc8063e20 0x7f8fc8158a00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 --2- 172.21.15.52:0/381836401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fc8153d90 0x7f8fc815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 >> 172.21.15.52:0/381836401 conn(0x7f8fc80c8a90 msgr2=0x7f8fc80acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 shutdown_connections 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:27.933+0000 7f8fcec8d700 1 -- 172.21.15.52:0/381836401 wait complete. 2023-05-10T01:25:27.938 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:25:27.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:25:28.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.071+0000 7f009bc58700 1 Processor -- start 2023-05-10T01:25:28.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.071+0000 7f009bc58700 1 -- start start 2023-05-10T01:25:28.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f009bc58700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0094153ea0 0x7f0094154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f009bc58700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 0x7f0094066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f009bc58700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940bc9a0 con 0x7f0094064ff0 2023-05-10T01:25:28.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f009bc58700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940bcc80 con 0x7f0094153ea0 2023-05-10T01:25:28.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f009bc58700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940bcf60 con 0x7f0094068c60 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f00999f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0094153ea0 0x7f0094154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f00999f4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0094153ea0 0x7f0094154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37030/0 (socket says 172.21.15.52:37030) 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f00999f4700 1 -- 172.21.15.52:0/1153135287 learned_addr learned my addr 172.21.15.52:0/1153135287 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.072+0000 7f00991f3700 1 --2- 172.21.15.52:0/1153135287 >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 0x7f0094066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00999f4700 1 -- 172.21.15.52:0/1153135287 >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 msgr2=0x7f0094066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00999f4700 1 --2- 172.21.15.52:0/1153135287 >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 0x7f0094066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00999f4700 1 -- 172.21.15.52:0/1153135287 >> v1:172.21.15.172:6789/0 conn(0x7f0094064ff0 legacy=0x7f00940622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00999f4700 1 -- 172.21.15.52:0/1153135287 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940bd240 con 0x7f0094153ea0 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00991f3700 1 --2- 172.21.15.52:0/1153135287 >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 0x7f0094066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00999f4700 1 --2- 172.21.15.52:0/1153135287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094153ea0 0x7f0094154280 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f0094064aa0 tx=0x7f008c009840).ready entity=mon.0 client_cookie=8e2990cfdd20a97e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00989f2700 1 -- 172.21.15.52:0/1153135287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00e070 con 0x7f0094153ea0 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00989f2700 1 -- 172.21.15.52:0/1153135287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c00ba50 con 0x7f0094153ea0 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f00989f2700 1 -- 172.21.15.52:0/1153135287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00bdd0 con 0x7f0094153ea0 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 -- 172.21.15.52:0/1153135287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094153ea0 msgr2=0x7f0094154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 --2- 172.21.15.52:0/1153135287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094153ea0 0x7f0094154280 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f0094064aa0 tx=0x7f008c009840).stop 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 -- 172.21.15.52:0/1153135287 shutdown_connections 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 --2- 172.21.15.52:0/1153135287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094153ea0 0x7f0094154280 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 --2- 172.21.15.52:0/1153135287 >> v2:172.21.15.172:3300/0 conn(0x7f0094068c60 0x7f0094066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.073+0000 7f009bc58700 1 -- 172.21.15.52:0/1153135287 >> 172.21.15.52:0/1153135287 conn(0x7f00940c4420 msgr2=0x7f00940c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.074+0000 7f009bc58700 1 -- 172.21.15.52:0/1153135287 shutdown_connections 2023-05-10T01:25:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.074+0000 7f009bc58700 1 -- 172.21.15.52:0/1153135287 wait complete. 2023-05-10T01:25:28.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 Processor -- start 2023-05-10T01:25:28.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 -- start start 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 0x7f00940a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 0x7f00940ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940a82c0 con 0x7f0094064ff0 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.075+0000 7f009bc58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940ad300 con 0x7f00940a73e0 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f009bc58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094157480 con 0x7f0094153ea0 2023-05-10T01:25:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37036/0 (socket says 172.21.15.52:37036) 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 -- 172.21.15.52:0/1147755238 learned_addr learned my addr 172.21.15.52:0/1147755238 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00991f3700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 0x7f00940a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f009a1f5700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 0x7f00940ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 -- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 msgr2=0x7f00940a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 0x7f00940a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 -- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 msgr2=0x7f00940ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 0x7f00940ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 -- 172.21.15.52:0/1147755238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009ae0 con 0x7f0094064ff0 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f009a1f5700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 0x7f00940ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00991f3700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 0x7f00940a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f00999f4700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f008c009fd0 tx=0x7f008c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00bbc0 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c00bd20 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c01c630 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094156870 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.076+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094156e30 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.077+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009406c340 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.078+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f008c01ca60 con 0x7f0094064ff0 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.078+0000 7f0081ffb700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 0x7f0074061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.078+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f008c07b220 con 0x7f0094064ff0 2023-05-10T01:25:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.078+0000 7f00991f3700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 0x7f0074061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.079+0000 7f00991f3700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 0x7f0074061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0084006d80 tx=0x7f0084008040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.082+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f008c04ca10 con 0x7f0094064ff0 2023-05-10T01:25:28.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.320+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00940bd520 con 0x7f0094064ff0 2023-05-10T01:25:28.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.321+0000 7f0081ffb700 1 -- 172.21.15.52:0/1147755238 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f008c050030 con 0x7f0094064ff0 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:25:28.325 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.326 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.327 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.328 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.328 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.328 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:25:28.328 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.329 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:25:28.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:25:28.331 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.332 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.333 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.335 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:25:28.336 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.337 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.338 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.339 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.341 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.342 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.343 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.344 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:25:28.345 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:25:28.346 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:25:28.348 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:25:28.349 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:25:28.350 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:25:28.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 msgr2=0x7f0074061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 0x7f0074061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0084006d80 tx=0x7f0084008040).stop 2023-05-10T01:25:28.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 msgr2=0x7f00940a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f008c009fd0 tx=0x7f008c009840).stop 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 shutdown_connections 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f007405ed90 0x7f0074061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00940a73e0 0x7f00940ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0094064ff0 0x7f00940a7dd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.322+0000 7f009bc58700 1 --2- 172.21.15.52:0/1147755238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0094153ea0 0x7f00940a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.323+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 >> 172.21.15.52:0/1147755238 conn(0x7f00940c4420 msgr2=0x7f00940a5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.323+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 shutdown_connections 2023-05-10T01:25:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.323+0000 7f009bc58700 1 -- 172.21.15.52:0/1147755238 wait complete. 2023-05-10T01:25:28.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.467+0000 7f02a3276700 1 Processor -- start 2023-05-10T01:25:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 -- start start 2023-05-10T01:25:28.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f029c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f029c069da0 0x7f029c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0c0650 con 0x7f029c154540 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0c1af0 con 0x7f029c069da0 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.468+0000 7f02a3276700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0bfd20 con 0x7f029c154160 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a0811700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f029c154540 0x7f029c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46062/0 (socket says 172.21.15.52:46062) 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a0811700 1 -- 172.21.15.52:0/2998408913 learned_addr learned my addr 172.21.15.52:0/2998408913 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:28.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a1813700 1 --2- 172.21.15.52:0/2998408913 >> v2:172.21.15.172:3300/0 conn(0x7f029c069da0 0x7f029c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a1012700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f029c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790845554 0 0) 0x7f029c0c0650 con 0x7f029c154540 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02880033f0 con 0x7f029c154540 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4118231784 0 0) 0x7f02880033f0 con 0x7f029c154540 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 msgr2=0x7f029c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f029c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 >> v2:172.21.15.172:3300/0 conn(0x7f029c069da0 msgr2=0x7f029c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 --2- 172.21.15.52:0/2998408913 >> v2:172.21.15.172:3300/0 conn(0x7f029c069da0 0x7f029c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0c0000 con 0x7f029c154540 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0290001470 con 0x7f029c154540 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a1813700 1 --2- 172.21.15.52:0/2998408913 >> v2:172.21.15.172:3300/0 conn(0x7f029c069da0 0x7f029c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 >> v1:172.21.15.52:6789/0 conn(0x7f029c154540 legacy=0x7f029c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f0288003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f0288004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0288004b80 0x7f0288005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0c1af0 con 0x7f02880038e0 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0bfd20 con 0x7f0288004b80 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028800b8e0 con 0x7f029c154160 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a1012700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f0288003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.469+0000 7f02a1813700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0288004b80 0x7f0288005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a0811700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f0288004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 -- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 msgr2=0x7f0288004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c154160 0x7f0288004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 -- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0288004b80 msgr2=0x7f0288005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0288004b80 0x7f0288005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 -- 172.21.15.52:0/2998408913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880033f0 con 0x7f02880038e0 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1813700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0288004b80 0x7f0288005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1012700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f0288003d00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f0294009a80 tx=0x7f0294009060).ready entity=mon.0 client_cookie=f02b7b73acc19260 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294009430 con 0x7f02880038e0 2023-05-10T01:25:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400e640 con 0x7f02880038e0 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f029bfff700 1 -- 172.21.15.52:0/2998408913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400e9c0 con 0x7f02880038e0 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a3276700 1 -- 172.21.15.52:0/2998408913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 msgr2=0x7f0288003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a3276700 1 --2- 172.21.15.52:0/2998408913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f0288003d00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f0294009a80 tx=0x7f0294009060).stop 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a1813700 1 -- 172.21.15.52:0/2998408913 reap_dead start 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a3276700 1 -- 172.21.15.52:0/2998408913 shutdown_connections 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.470+0000 7f02a3276700 1 -- 172.21.15.52:0/2998408913 >> 172.21.15.52:0/2998408913 conn(0x7f029c0cb740 msgr2=0x7f029c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.471+0000 7f02a3276700 1 -- 172.21.15.52:0/2998408913 shutdown_connections 2023-05-10T01:25:28.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.471+0000 7f02a3276700 1 -- 172.21.15.52:0/2998408913 wait complete. 2023-05-10T01:25:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 Processor -- start 2023-05-10T01:25:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 -- start start 2023-05-10T01:25:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c14fde0 0x7f029c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f029c153230 0x7f029c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c154950 con 0x7f02880038e0 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0afb60 con 0x7f029c153230 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.472+0000 7f02a3276700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0afe40 con 0x7f029c14fde0 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37056/0 (socket says 172.21.15.52:37056) 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 -- 172.21.15.52:0/957229076 learned_addr learned my addr 172.21.15.52:0/957229076 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1813700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f029c153230 0x7f029c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 -- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c14fde0 msgr2=0x7f029c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c14fde0 0x7f029c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 -- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f029c153230 msgr2=0x7f029c0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f029c153230 0x7f029c0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 -- 172.21.15.52:0/957229076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c154b60 con 0x7f02880038e0 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a1012700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0288004490 tx=0x7f029401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294000cb0 con 0x7f02880038e0 2023-05-10T01:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400e7b0 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294026690 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c154e40 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.473+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0af2e0 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.474+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0666b0 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.474+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f029402c020 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.475+0000 7f02997fa700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 0x7f027c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.475+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f029407b580 con 0x7f02880038e0 2023-05-10T01:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.475+0000 7f02a0811700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 0x7f027c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.475+0000 7f02a0811700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 0x7f027c061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f029c169130 tx=0x7f0290001080).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.479+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f029404cc60 con 0x7f02880038e0 2023-05-10T01:25:28.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.653+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f029c0af8f0 con 0x7f02880038e0 2023-05-10T01:25:28.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.654+0000 7f02997fa700 1 -- 172.21.15.52:0/957229076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+14213 (secure 0 0 0) 0x7f0294016020 con 0x7f02880038e0 2023-05-10T01:25:28.657 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:28.658 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":104,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:27.924445+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 msgr2=0x7f027c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 0x7f027c061220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f029c169130 tx=0x7f0290001080).stop 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 msgr2=0x7f029c14f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0288004490 tx=0x7f029401a000).stop 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 shutdown_connections 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f027c05ed60 0x7f027c061220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f029c153230 0x7f029c0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02880038e0 0x7f029c14f8f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 --2- 172.21.15.52:0/957229076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029c14fde0 0x7f029c152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.655+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 >> 172.21.15.52:0/957229076 conn(0x7f029c0cb740 msgr2=0x7f029c0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.656+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 shutdown_connections 2023-05-10T01:25:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.656+0000 7f02a3276700 1 -- 172.21.15.52:0/957229076 wait complete. 2023-05-10T01:25:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:25:28.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:25:28.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.789+0000 7f41353b6700 1 Processor -- start 2023-05-10T01:25:28.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.789+0000 7f41353b6700 1 -- start start 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f41353b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f413013dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f41353b6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41300bc590 0x7f41300a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f41353b6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300c18c0 con 0x7f4130069600 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f41353b6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4130069a80 con 0x7f41300bc590 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f41353b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300a6040 con 0x7f413013d7c0 2023-05-10T01:25:28.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412e7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4130069600 0x7f41300bbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46080/0 (socket says 172.21.15.52:46080) 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412e7fc700 1 -- 172.21.15.52:0/655309836 learned_addr learned my addr 172.21.15.52:0/655309836 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412effd700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f413013dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412f7fe700 1 --2- 172.21.15.52:0/655309836 >> v2:172.21.15.172:3300/0 conn(0x7f41300bc590 0x7f41300a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730633322 0 0) 0x7f41300c18c0 con 0x7f4130069600 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41100033f0 con 0x7f4130069600 2023-05-10T01:25:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164703060 0 0) 0x7f41100033f0 con 0x7f4130069600 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 msgr2=0x7f413013dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f413013dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.790+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 >> v2:172.21.15.172:3300/0 conn(0x7f41300bc590 msgr2=0x7f41300a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 --2- 172.21.15.52:0/655309836 >> v2:172.21.15.172:3300/0 conn(0x7f41300bc590 0x7f41300a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130069cd0 con 0x7f4130069600 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f41180015f0 con 0x7f4130069600 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 >> v1:172.21.15.52:6789/0 conn(0x7f4130069600 legacy=0x7f41300bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41100038e0 0x7f4110003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f4110004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4110004b80 0x7f4110005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130069a80 con 0x7f4110004b80 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300a6040 con 0x7f41100038e0 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411000b8e0 con 0x7f413013d7c0 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4110004b80 0x7f4110005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412effd700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41100038e0 0x7f4110003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412e7fc700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f4110004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 -- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 msgr2=0x7f4110004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f413013d7c0 0x7f4110004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 -- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41100038e0 msgr2=0x7f4110003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41100038e0 0x7f4110003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 -- 172.21.15.52:0/655309836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100033f0 con 0x7f4110004b80 2023-05-10T01:25:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412f7fe700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4110004b80 0x7f4110005000 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f41300bc990 tx=0x7f4120009060).ready entity=mon.0 client_cookie=96a0da78da4d7807 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120009e90 con 0x7f4110004b80 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120009430 con 0x7f4110004b80 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.791+0000 7f412dffb700 1 -- 172.21.15.52:0/655309836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000e850 con 0x7f4110004b80 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 -- 172.21.15.52:0/655309836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4110004b80 msgr2=0x7f4110005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 --2- 172.21.15.52:0/655309836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4110004b80 0x7f4110005000 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f41300bc990 tx=0x7f4120009060).stop 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f412f7fe700 1 -- 172.21.15.52:0/655309836 reap_dead start 2023-05-10T01:25:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 -- 172.21.15.52:0/655309836 shutdown_connections 2023-05-10T01:25:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 -- 172.21.15.52:0/655309836 >> 172.21.15.52:0/655309836 conn(0x7f41300c4440 msgr2=0x7f4130066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 -- 172.21.15.52:0/655309836 shutdown_connections 2023-05-10T01:25:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.792+0000 7f41353b6700 1 -- 172.21.15.52:0/655309836 wait complete. 2023-05-10T01:25:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.793+0000 7f41353b6700 1 Processor -- start 2023-05-10T01:25:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.793+0000 7f41353b6700 1 -- start start 2023-05-10T01:25:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41300a8f20 0x7f41300bef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41300a9300 0x7f41300a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300a73e0 con 0x7f41300a9780 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300c0310 con 0x7f41300a9300 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f41353b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300bf480 con 0x7f41300a8f20 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37078/0 (socket says 172.21.15.52:37078) 2023-05-10T01:25:28.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 -- 172.21.15.52:0/2651546275 learned_addr learned my addr 172.21.15.52:0/2651546275 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412effd700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41300a8f20 0x7f41300bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412e7fc700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41300a9300 0x7f41300a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 -- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41300a8f20 msgr2=0x7f41300bef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41300a8f20 0x7f41300bef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 -- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41300a9300 msgr2=0x7f41300a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41300a9300 0x7f41300a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 -- 172.21.15.52:0/2651546275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300bf700 con 0x7f41300a9780 2023-05-10T01:25:28.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.794+0000 7f412f7fe700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f412000e4b0 tx=0x7f412001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120009e90 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412001cbd0 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41300bf9e0 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120025440 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41300bffa0 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.795+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130069100 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.797+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f412002d070 con 0x7f41300a9780 2023-05-10T01:25:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.797+0000 7f4126ffd700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 0x7f4114061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:28.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.797+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f4120000e40 con 0x7f41300a9780 2023-05-10T01:25:28.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.797+0000 7f412effd700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 0x7f4114061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:28.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.798+0000 7f412effd700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 0x7f4114061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f41280094d0 tx=0x7f412800b040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:28.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.800+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f412004c6c0 con 0x7f41300a9780 2023-05-10T01:25:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.975+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f413005dfa0 con 0x7f41300a9780 2023-05-10T01:25:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.975+0000 7f4126ffd700 1 -- 172.21.15.52:0/2651546275 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7f412002b0b0 con 0x7f41300a9780 2023-05-10T01:25:28.979 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:25:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 msgr2=0x7f4114061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 0x7f4114061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f41280094d0 tx=0x7f412800b040).stop 2023-05-10T01:25:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 msgr2=0x7f41300a6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f412000e4b0 tx=0x7f412001a000).stop 2023-05-10T01:25:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 shutdown_connections 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f411405ed60 0x7f4114061220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41300a9780 0x7f41300a6ef0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41300a8f20 0x7f41300bef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 --2- 172.21.15.52:0/2651546275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41300a9300 0x7f41300a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 >> 172.21.15.52:0/2651546275 conn(0x7f41300c4440 msgr2=0x7f41300a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 shutdown_connections 2023-05-10T01:25:28.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:28.977+0000 7f41353b6700 1 -- 172.21.15.52:0/2651546275 wait complete. 2023-05-10T01:25:28.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:25:29.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:25:29.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:25:29.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.111+0000 7f993958e700 1 Processor -- start 2023-05-10T01:25:29.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.111+0000 7f993958e700 1 -- start start 2023-05-10T01:25:29.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f993958e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f99340c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f993958e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99340c61e0 0x7f9934154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f993958e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340c6650 con 0x7f9934153f80 2023-05-10T01:25:29.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f993958e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9934069f50 con 0x7f99340c61e0 2023-05-10T01:25:29.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f993958e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993406a9d0 con 0x7f99340c1150 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9933fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9934153f80 0x7f99340a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46098/0 (socket says 172.21.15.52:46098) 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9933fff700 1 -- 172.21.15.52:0/2890348428 learned_addr learned my addr 172.21.15.52:0/2890348428 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607717827 0 0) 0x7f99340c6650 con 0x7f9934153f80 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99200033f0 con 0x7f9934153f80 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9938d8d700 1 --2- 172.21.15.52:0/2890348428 >> v2:172.21.15.172:3300/0 conn(0x7f99340c61e0 0x7f9934154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f99337fe700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f99340c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726268742 0 0) 0x7f99200033f0 con 0x7f9934153f80 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 msgr2=0x7f99340c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f99340c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 >> v2:172.21.15.172:3300/0 conn(0x7f99340c61e0 msgr2=0x7f9934154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 --2- 172.21.15.52:0/2890348428 >> v2:172.21.15.172:3300/0 conn(0x7f99340c61e0 0x7f9934154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993406a130 con 0x7f9934153f80 2023-05-10T01:25:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f9924001470 con 0x7f9934153f80 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 >> v1:172.21.15.52:6789/0 conn(0x7f9934153f80 legacy=0x7f99340a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99200038e0 0x7f9920003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9920004690 0x7f9920004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f9920005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934069f50 con 0x7f9920004690 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200044b0 con 0x7f99200038e0 2023-05-10T01:25:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.112+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992000b910 con 0x7f99340c1150 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9920004690 0x7f9920004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f9933fff700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99200038e0 0x7f9920003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f9938d8d700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f9920005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 -- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 msgr2=0x7f9920005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99340c1150 0x7f9920005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 -- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99200038e0 msgr2=0x7f9920003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99200038e0 0x7f9920003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 -- 172.21.15.52:0/2890348428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200033f0 con 0x7f9920004690 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f99337fe700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9920004690 0x7f9920004b10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f9928009a60 tx=0x7f9928009060).ready entity=mon.0 client_cookie=4aa40d36062fc6c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928009ea0 con 0x7f9920004690 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9928009430 con 0x7f9920004690 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f9932ffd700 1 -- 172.21.15.52:0/2890348428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992800e870 con 0x7f9920004690 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.113+0000 7f993958e700 1 -- 172.21.15.52:0/2890348428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9920004690 msgr2=0x7f9920004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f993958e700 1 --2- 172.21.15.52:0/2890348428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9920004690 0x7f9920004b10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f9928009a60 tx=0x7f9928009060).stop 2023-05-10T01:25:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f9938d8d700 1 -- 172.21.15.52:0/2890348428 reap_dead start 2023-05-10T01:25:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f993958e700 1 -- 172.21.15.52:0/2890348428 shutdown_connections 2023-05-10T01:25:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f993958e700 1 -- 172.21.15.52:0/2890348428 >> 172.21.15.52:0/2890348428 conn(0x7f99340cb5f0 msgr2=0x7f99340c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f993958e700 1 -- 172.21.15.52:0/2890348428 shutdown_connections 2023-05-10T01:25:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.114+0000 7f993958e700 1 -- 172.21.15.52:0/2890348428 wait complete. 2023-05-10T01:25:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.115+0000 7f993958e700 1 Processor -- start 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.115+0000 7f993958e700 1 -- start start 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9920004690 0x7f993413c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993414f840 0x7f993414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993413c770 con 0x7f99340b0030 2023-05-10T01:25:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993414f080 con 0x7f993414f840 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340c2b10 con 0x7f9920004690 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37098/0 (socket says 172.21.15.52:37098) 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 -- 172.21.15.52:0/3995968786 learned_addr learned my addr 172.21.15.52:0/3995968786 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9933fff700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9920004690 0x7f993413c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f99337fe700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993414f840 0x7f993414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 -- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9920004690 msgr2=0x7f993413c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9920004690 0x7f993413c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 -- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993414f840 msgr2=0x7f993414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993414f840 0x7f993414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 -- 172.21.15.52:0/3995968786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99341501b0 con 0x7f99340b0030 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f9938d8d700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f992c009d70 tx=0x7f992c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00e040 con 0x7f99340b0030 2023-05-10T01:25:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00f040 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340c1f00 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00fda0 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.116+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340c24c0 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.117+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934083110 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.118+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f992c015660 con 0x7f99340b0030 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.118+0000 7f991bfff700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 0x7f9914061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.118+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f992c07a360 con 0x7f99340b0030 2023-05-10T01:25:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.118+0000 7f9933fff700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 0x7f9914061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.119+0000 7f9933fff700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 0x7f9914061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9924001d20 tx=0x7f9924001e90).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.122+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f992c04bb50 con 0x7f99340b0030 2023-05-10T01:25:29.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.292+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9934047150 con 0x7f99340b0030 2023-05-10T01:25:29.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.292+0000 7f991bfff700 1 -- 172.21.15.52:0/3995968786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7f992c04f170 con 0x7f99340b0030 2023-05-10T01:25:29.296 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:25:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 msgr2=0x7f9914061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 0x7f9914061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9924001d20 tx=0x7f9924001e90).stop 2023-05-10T01:25:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 msgr2=0x7f99340b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f992c009d70 tx=0x7f992c00b040).stop 2023-05-10T01:25:29.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 shutdown_connections 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f991405ed90 0x7f9914061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99340b0030 0x7f99340b0490 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9920004690 0x7f993413c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 --2- 172.21.15.52:0/3995968786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f993414f840 0x7f993414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 >> 172.21.15.52:0/3995968786 conn(0x7f99340cb5f0 msgr2=0x7f9934150960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 shutdown_connections 2023-05-10T01:25:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.294+0000 7f993958e700 1 -- 172.21.15.52:0/3995968786 wait complete. 2023-05-10T01:25:29.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:25:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.462+0000 7fa8fccb9700 1 Processor -- start 2023-05-10T01:25:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.462+0000 7fa8fccb9700 1 -- start start 2023-05-10T01:25:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8fccb9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8f8138690 0x7fa8f80c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8fccb9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 0x7fa8f80622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8fccb9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f80c37e0 con 0x7fa8f8062790 2023-05-10T01:25:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8fccb9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f8138a70 con 0x7fa8f8138690 2023-05-10T01:25:29.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8fccb9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80be3c0 con 0x7fa8f80c3090 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8f8138690 0x7fa8f80c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8f8138690 0x7fa8f80c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37102/0 (socket says 172.21.15.52:37102) 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 -- 172.21.15.52:0/1635112160 learned_addr learned my addr 172.21.15.52:0/1635112160 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f5d9b700 1 --2- 172.21.15.52:0/1635112160 >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 0x7fa8f80622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 -- 172.21.15.52:0/1635112160 >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 msgr2=0x7fa8f80622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 --2- 172.21.15.52:0/1635112160 >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 0x7fa8f80622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 -- 172.21.15.52:0/1635112160 >> v1:172.21.15.52:6789/0 conn(0x7fa8f8062790 legacy=0x7fa8f8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f659c700 1 -- 172.21.15.52:0/1635112160 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80bef80 con 0x7fa8f8138690 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.463+0000 7fa8f5d9b700 1 --2- 172.21.15.52:0/1635112160 >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 0x7fa8f80622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8f659c700 1 --2- 172.21.15.52:0/1635112160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8138690 0x7fa8f80c4eb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fa8f806bf80 tx=0x7fa8f00090f0).ready entity=mon.0 client_cookie=8c8a354b593b6607 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8f559a700 1 -- 172.21.15.52:0/1635112160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000b600 con 0x7fa8f8138690 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8f559a700 1 -- 172.21.15.52:0/1635112160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000b760 con 0x7fa8f8138690 2023-05-10T01:25:29.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8f559a700 1 -- 172.21.15.52:0/1635112160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000bae0 con 0x7fa8f8138690 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1635112160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8138690 msgr2=0x7fa8f80c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1635112160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8138690 0x7fa8f80c4eb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fa8f806bf80 tx=0x7fa8f00090f0).stop 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1635112160 shutdown_connections 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1635112160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8138690 0x7fa8f80c4eb0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1635112160 >> v2:172.21.15.172:3300/0 conn(0x7fa8f80c3090 0x7fa8f80622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1635112160 >> 172.21.15.52:0/1635112160 conn(0x7fa8f80c8a90 msgr2=0x7fa8f80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1635112160 shutdown_connections 2023-05-10T01:25:29.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.464+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1635112160 wait complete. 2023-05-10T01:25:29.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.465+0000 7fa8fccb9700 1 Processor -- start 2023-05-10T01:25:29.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.465+0000 7fa8fccb9700 1 -- start start 2023-05-10T01:25:29.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f80c3090 0x7fa8f80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8f8138690 0x7fa8f8150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80686b0 con 0x7fa8f8062790 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80adc70 con 0x7fa8f80c3090 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8fccb9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80adf50 con 0x7fa8f8138690 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37108/0 (socket says 172.21.15.52:37108) 2023-05-10T01:25:29.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.466+0000 7fa8f659c700 1 -- 172.21.15.52:0/1988061979 learned_addr learned my addr 172.21.15.52:0/1988061979 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 -- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8f8138690 msgr2=0x7fa8f8150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8f8138690 0x7fa8f8150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 -- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f80c3090 msgr2=0x7fa8f80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f5d9b700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f80c3090 0x7fa8f80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f80c3090 0x7fa8f80ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 -- 172.21.15.52:0/1988061979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0009370 con 0x7fa8f8062790 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8f659c700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fa8f8067b30 tx=0x7fa8f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000bae0 con 0x7fa8f8062790 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0000c90 con 0x7fa8f8062790 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f80ae230 con 0x7fa8f8062790 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f001b640 con 0x7fa8f8062790 2023-05-10T01:25:29.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.467+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f80ad8d0 con 0x7fa8f8062790 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.468+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f806c340 con 0x7fa8f8062790 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.468+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa8f000f070 con 0x7fa8f8062790 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.468+0000 7fa8e67fc700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 0x7fa8d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.469+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fa8f007ad90 con 0x7fa8f8062790 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.469+0000 7fa8f5d9b700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 0x7fa8d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.470+0000 7fa8f5d9b700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 0x7fa8d4061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa8f8157c20 tx=0x7fa8ec008040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.473+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8f004c580 con 0x7fa8f8062790 2023-05-10T01:25:29.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.647+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa8f81521b0 con 0x7fa8f8062790 2023-05-10T01:25:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.648+0000 7fa8e67fc700 1 -- 172.21.15.52:0/1988061979 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa8f001f020 con 0x7fa8f8062790 2023-05-10T01:25:29.651 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:29.652 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:25:29.653 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:25:29.653 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:29.653 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:25:29.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 msgr2=0x7fa8d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 0x7fa8d4061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa8f8157c20 tx=0x7fa8ec008040).stop 2023-05-10T01:25:29.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 msgr2=0x7fa8f8157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fa8f8067b30 tx=0x7fa8f0017000).stop 2023-05-10T01:25:29.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 shutdown_connections 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa8d405ed90 0x7fa8d4061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8f8138690 0x7fa8f8150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f8062790 0x7fa8f8157730 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 --2- 172.21.15.52:0/1988061979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f80c3090 0x7fa8f80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 >> 172.21.15.52:0/1988061979 conn(0x7fa8f80c8a90 msgr2=0x7fa8f8151640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 shutdown_connections 2023-05-10T01:25:29.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.649+0000 7fa8fccb9700 1 -- 172.21.15.52:0/1988061979 wait complete. 2023-05-10T01:25:29.664 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:25:29.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:25:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.783+0000 7fefe2823700 1 Processor -- start 2023-05-10T01:25:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.784+0000 7fefe2823700 1 -- start start 2023-05-10T01:25:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.784+0000 7fefe2823700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefdc153f80 0x7fefdc0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe2823700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc155370 0x7fefdc0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe2823700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0c6690 con 0x7fefdc0c5cf0 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe2823700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc069f50 con 0x7fefdc153f80 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe2823700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc06a9d0 con 0x7fefdc155370 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefdc153f80 0x7fefdc0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe2022700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc155370 0x7fefdc0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefdc153f80 0x7fefdc0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:35440/0 (socket says 172.21.15.52:35440) 2023-05-10T01:25:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 -- 172.21.15.52:0/532885720 learned_addr learned my addr 172.21.15.52:0/532885720 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1020700 1 --1- 172.21.15.52:0/532885720 >> v1:172.21.15.172:6789/0 conn(0x7fefdc0c5cf0 0x7fefdc0c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:48672/0 (socket says 172.21.15.52:48672) 2023-05-10T01:25:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 -- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc155370 msgr2=0x7fefdc0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 --2- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc155370 0x7fefdc0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 -- 172.21.15.52:0/532885720 >> v1:172.21.15.172:6789/0 conn(0x7fefdc0c5cf0 legacy=0x7fefdc0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe081f700 1 -- 172.21.15.52:0/532885720 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110943246 0 0) 0x7fefcc001110 con 0x7fefdc0c5cf0 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 -- 172.21.15.52:0/532885720 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc06a130 con 0x7fefdc153f80 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe1821700 1 --2- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0a9d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fefd8006fd0 tx=0x7fefd80090f0).ready entity=mon.1 client_cookie=2ce4b67a837e2042 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe081f700 1 -- 172.21.15.52:0/532885720 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800b580 con 0x7fefdc153f80 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.785+0000 7fefe081f700 1 -- 172.21.15.52:0/532885720 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800b6e0 con 0x7fefdc153f80 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe081f700 1 -- 172.21.15.52:0/532885720 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800ba60 con 0x7fefdc153f80 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 -- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 msgr2=0x7fefdc0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 --2- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0a9d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fefd8006fd0 tx=0x7fefd80090f0).stop 2023-05-10T01:25:29.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 -- 172.21.15.52:0/532885720 shutdown_connections 2023-05-10T01:25:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 --2- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc155370 0x7fefdc0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 --2- 172.21.15.52:0/532885720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0a9d10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 -- 172.21.15.52:0/532885720 >> 172.21.15.52:0/532885720 conn(0x7fefdc0cb5f0 msgr2=0x7fefdc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 -- 172.21.15.52:0/532885720 shutdown_connections 2023-05-10T01:25:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.786+0000 7fefe2823700 1 -- 172.21.15.52:0/532885720 wait complete. 2023-05-10T01:25:29.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.787+0000 7fefe2823700 1 Processor -- start 2023-05-10T01:25:29.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.787+0000 7fefe2823700 1 -- start start 2023-05-10T01:25:29.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 0x7fefdc14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0ade20 con 0x7fefdc155370 2023-05-10T01:25:29.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c3dc0 con 0x7fefdc153f80 2023-05-10T01:25:29.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2823700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c3490 con 0x7fefdc0c5cf0 2023-05-10T01:25:29.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37126/0 (socket says 172.21.15.52:37126) 2023-05-10T01:25:29.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 -- 172.21.15.52:0/2906156048 learned_addr learned my addr 172.21.15.52:0/2906156048 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:29.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe1020700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe1821700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 0x7fefdc14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 -- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 msgr2=0x7fefdc14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 0x7fefdc14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 -- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 msgr2=0x7fefdc0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.788+0000 7fefe2022700 1 -- 172.21.15.52:0/2906156048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8009370 con 0x7fefdc155370 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefe1821700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 0x7fefdc14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:29.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefe2022700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fefd4009e20 tx=0x7fefd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400cb50 con 0x7fefdc155370 2023-05-10T01:25:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400f040 con 0x7fefdc155370 2023-05-10T01:25:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0c3770 con 0x7fefdc155370 2023-05-10T01:25:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400cec0 con 0x7fefdc155370 2023-05-10T01:25:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.789+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc0adad0 con 0x7fefdc155370 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.790+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc083110 con 0x7fefdc155370 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.790+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fefd4013610 con 0x7fefdc155370 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.790+0000 7fefc9ffb700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 0x7fefbc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.791+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fefd407a1c0 con 0x7fefdc155370 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.791+0000 7fefe1821700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 0x7fefbc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.791+0000 7fefe1821700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 0x7fefbc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fefd8009fd0 tx=0x7fefd8017000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.795+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefd404ba30 con 0x7fefdc155370 2023-05-10T01:25:29.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:29.972+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fefdc047150 con 0x7fefdc155370 2023-05-10T01:25:30.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.941+0000 7fefc9ffb700 1 -- 172.21.15.52:0/2906156048 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v105) v1 ==== 152+0+0 (secure 0 0 0) 0x7fefd404f050 con 0x7fefdc155370 2023-05-10T01:25:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.945+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 msgr2=0x7fefbc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.945+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 0x7fefbc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fefd8009fd0 tx=0x7fefd8017000).stop 2023-05-10T01:25:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.945+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 msgr2=0x7fefdc0a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.945+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fefd4009e20 tx=0x7fefd400b040).stop 2023-05-10T01:25:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 shutdown_connections 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fefbc05ed90 0x7fefbc061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefdc155370 0x7fefdc0a18c0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefdc0c5cf0 0x7fefdc14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 --2- 172.21.15.52:0/2906156048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefdc153f80 0x7fefdc0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.946+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 >> 172.21.15.52:0/2906156048 conn(0x7fefdc0cb5f0 msgr2=0x7fefdc0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.949+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 shutdown_connections 2023-05-10T01:25:30.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:30.950+0000 7fefe2823700 1 -- 172.21.15.52:0/2906156048 wait complete. 2023-05-10T01:25:30.955 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:25:30.969 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:25:31.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.095+0000 7f43db132700 1 Processor -- start 2023-05-10T01:25:31.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.095+0000 7f43db132700 1 -- start start 2023-05-10T01:25:31.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43db132700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43d4154080 0x7f43d40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43db132700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40c94c0 con 0x7f43d4154460 2023-05-10T01:25:31.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43db132700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40cb7d0 con 0x7f43d4068150 2023-05-10T01:25:31.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43db132700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40c88b0 con 0x7f43d4154080 2023-05-10T01:25:31.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43d3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f43d4154460 0x7f43d40a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46146/0 (socket says 172.21.15.52:46146) 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43d3fff700 1 -- 172.21.15.52:0/860953836 learned_addr learned my addr 172.21.15.52:0/860953836 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43d8ece700 1 --2- 172.21.15.52:0/860953836 >> v2:172.21.15.172:3300/0 conn(0x7f43d4154080 0x7f43d40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143501894 0 0) 0x7f43d40c94c0 con 0x7f43d4154460 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.096+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b40033f0 con 0x7f43d4154460 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821673029 0 0) 0x7f43d40cb7d0 con 0x7f43d4068150 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d40c94c0 con 0x7f43d4068150 2023-05-10T01:25:31.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378475183 0 0) 0x7f43b40033f0 con 0x7f43d4154460 2023-05-10T01:25:31.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 >> v2:172.21.15.172:3300/0 conn(0x7f43d4154080 msgr2=0x7f43d40aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:31.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 --2- 172.21.15.52:0/860953836 >> v2:172.21.15.172:3300/0 conn(0x7f43d4154080 0x7f43d40aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 >> v1:172.21.15.172:6789/0 conn(0x7f43d4068150 legacy=0x7f43d40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40c8b90 con 0x7f43d4154460 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f43c40017f0 con 0x7f43d4154460 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 >> v1:172.21.15.52:6789/0 conn(0x7f43d4154460 legacy=0x7f43d40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43b4003ac0 0x7f43b4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4004690 0x7f43b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 0x7f43b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c88b0 con 0x7f43b4005000 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b400bf60 con 0x7f43b4004690 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b400c120 con 0x7f43b4003ac0 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d3fff700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4004690 0x7f43b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d8ece700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43b4003ac0 0x7f43b4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 0x7f43b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 -- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43b4003ac0 msgr2=0x7f43b4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43b4003ac0 0x7f43b4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 -- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4004690 msgr2=0x7f43b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4004690 0x7f43b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 -- 172.21.15.52:0/860953836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40033f0 con 0x7f43b4005000 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 -- 172.21.15.52:0/860953836 reap_dead start 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.097+0000 7f43d96cf700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 0x7f43b400b8e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f43bc001890 tx=0x7f43bc007bb0).ready entity=mon.0 client_cookie=1fdca1169c35b7fc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc007020 con 0x7f43b4005000 2023-05-10T01:25:31.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc007180 con 0x7f43b4005000 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43d37fe700 1 -- 172.21.15.52:0/860953836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc007500 con 0x7f43b4005000 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 -- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 msgr2=0x7f43b400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 0x7f43b400b8e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f43bc001890 tx=0x7f43bc007bb0).stop 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 -- 172.21.15.52:0/860953836 shutdown_connections 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 --2- 172.21.15.52:0/860953836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b4005000 0x7f43b400b8e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 -- 172.21.15.52:0/860953836 >> 172.21.15.52:0/860953836 conn(0x7f43d4067910 msgr2=0x7f43d40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:31.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 -- 172.21.15.52:0/860953836 shutdown_connections 2023-05-10T01:25:31.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.098+0000 7f43db132700 1 -- 172.21.15.52:0/860953836 wait complete. 2023-05-10T01:25:31.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.099+0000 7f43db132700 1 Processor -- start 2023-05-10T01:25:31.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 -- start start 2023-05-10T01:25:31.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 0x7f43d4155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 0x7f43d4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41562c0 con 0x7f43d40a9b70 2023-05-10T01:25:31.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41570c0 con 0x7f43b4005000 2023-05-10T01:25:31.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43db132700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40aa4e0 con 0x7f43d40c1fa0 2023-05-10T01:25:31.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43d96cf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43d96cf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37142/0 (socket says 172.21.15.52:37142) 2023-05-10T01:25:31.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.100+0000 7f43d96cf700 1 -- 172.21.15.52:0/2292128026 learned_addr learned my addr 172.21.15.52:0/2292128026 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:31.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d3fff700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 0x7f43d4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d8ece700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 0x7f43d4155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 -- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 msgr2=0x7f43d4142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 0x7f43d4142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 -- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 msgr2=0x7f43d4155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 0x7f43d4155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 -- 172.21.15.52:0/2292128026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40c2420 con 0x7f43d40a9b70 2023-05-10T01:25:31.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d3fff700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 0x7f43d4142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:31.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d8ece700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 0x7f43d4155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:31.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d96cf700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f43bc008fd0 tx=0x7f43bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:31.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc012610 con 0x7f43d40a9b70 2023-05-10T01:25:31.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc012770 con 0x7f43d40a9b70 2023-05-10T01:25:31.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc012b10 con 0x7f43d40a9b70 2023-05-10T01:25:31.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d41564b0 con 0x7f43d40a9b70 2023-05-10T01:25:31.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.101+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4156a70 con 0x7f43d40a9b70 2023-05-10T01:25:31.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.102+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4066720 con 0x7f43d40a9b70 2023-05-10T01:25:31.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.102+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f43bc01a070 con 0x7f43d40a9b70 2023-05-10T01:25:31.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.103+0000 7f43d0ff9700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 0x7f43b8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:31.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.103+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f43bc079f10 con 0x7f43d40a9b70 2023-05-10T01:25:31.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.103+0000 7f43d8ece700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 0x7f43b8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:31.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.104+0000 7f43d8ece700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 0x7f43b8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f43cc006d80 tx=0x7f43cc008040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:31.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.107+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43bc04b590 con 0x7f43d40a9b70 2023-05-10T01:25:31.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.284+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f43d4157250 con 0x7f43d40a9b70 2023-05-10T01:25:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.948+0000 7f43d0ff9700 1 -- 172.21.15.52:0/2292128026 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v106) v1 ==== 170+0+0 (secure 0 0 0) 0x7f43bc04ebb0 con 0x7f43d40a9b70 2023-05-10T01:25:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.958+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 msgr2=0x7f43b8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.958+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 0x7f43b8061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f43cc006d80 tx=0x7f43cc008040).stop 2023-05-10T01:25:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.958+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 msgr2=0x7f43d40a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.958+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f43bc008fd0 tx=0x7f43bc015000).stop 2023-05-10T01:25:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 shutdown_connections 2023-05-10T01:25:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f43b805ed90 0x7f43b8061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43d40a9b70 0x7f43d40a9ff0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b4005000 0x7f43d4155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 --2- 172.21.15.52:0/2292128026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d40c1fa0 0x7f43d4142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:31.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.961+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 >> 172.21.15.52:0/2292128026 conn(0x7f43d4067910 msgr2=0x7f43d40c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:31.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.964+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 shutdown_connections 2023-05-10T01:25:31.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:31.964+0000 7f43db132700 1 -- 172.21.15.52:0/2292128026 wait complete. 2023-05-10T01:25:31.971 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:25:31.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:25:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.111+0000 7f3b1707b700 1 Processor -- start 2023-05-10T01:25:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.111+0000 7f3b1707b700 1 -- start start 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1707b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 0x7f3b10154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1707b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b100a75a0 0x7f3b10065890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1707b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b10069a80 con 0x7f3b10153c40 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1707b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10069d60 con 0x7f3b100a75a0 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1707b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1006a040 con 0x7f3b100a4920 2023-05-10T01:25:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b100a75a0 0x7f3b10065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b100a75a0 0x7f3b10065890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37152/0 (socket says 172.21.15.52:37152) 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 -- 172.21.15.52:0/835229474 learned_addr learned my addr 172.21.15.52:0/835229474 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b15878700 1 --2- 172.21.15.52:0/835229474 >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 0x7f3b10154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 -- 172.21.15.52:0/835229474 >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 msgr2=0x7f3b10154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 --2- 172.21.15.52:0/835229474 >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 0x7f3b10154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 -- 172.21.15.52:0/835229474 >> v1:172.21.15.172:6789/0 conn(0x7f3b10153c40 legacy=0x7f3b100a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 -- 172.21.15.52:0/835229474 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10065090 con 0x7f3b100a75a0 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b15878700 1 --2- 172.21.15.52:0/835229474 >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 0x7f3b10154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.112+0000 7f3b1687a700 1 --2- 172.21.15.52:0/835229474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b100a75a0 0x7f3b10065890 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f3b100600b0 tx=0x7f3b08009840).ready entity=mon.0 client_cookie=bd600a626316376a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b15077700 1 -- 172.21.15.52:0/835229474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800e070 con 0x7f3b100a75a0 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b15077700 1 -- 172.21.15.52:0/835229474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800ba10 con 0x7f3b100a75a0 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b15077700 1 -- 172.21.15.52:0/835229474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800bd90 con 0x7f3b100a75a0 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 -- 172.21.15.52:0/835229474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b100a75a0 msgr2=0x7f3b10065890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 --2- 172.21.15.52:0/835229474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b100a75a0 0x7f3b10065890 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f3b100600b0 tx=0x7f3b08009840).stop 2023-05-10T01:25:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 -- 172.21.15.52:0/835229474 shutdown_connections 2023-05-10T01:25:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 --2- 172.21.15.52:0/835229474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b100a75a0 0x7f3b10065890 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 --2- 172.21.15.52:0/835229474 >> v2:172.21.15.172:3300/0 conn(0x7f3b100a4920 0x7f3b10154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 -- 172.21.15.52:0/835229474 >> 172.21.15.52:0/835229474 conn(0x7f3b10068a20 msgr2=0x7f3b100c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 -- 172.21.15.52:0/835229474 shutdown_connections 2023-05-10T01:25:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.113+0000 7f3b1707b700 1 -- 172.21.15.52:0/835229474 wait complete. 2023-05-10T01:25:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.114+0000 7f3b1707b700 1 Processor -- start 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.114+0000 7f3b1707b700 1 -- start start 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b100a4920 0x7f3b1014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 0x7f3b101558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1014c360 con 0x7f3b10153c40 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10164e50 con 0x7f3b100a75a0 2023-05-10T01:25:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1707b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10156280 con 0x7f3b100a4920 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37158/0 (socket says 172.21.15.52:37158) 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 -- 172.21.15.52:0/1163382441 learned_addr learned my addr 172.21.15.52:0/1163382441 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b15878700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 0x7f3b101558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b16079700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b100a4920 0x7f3b1014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 -- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b100a4920 msgr2=0x7f3b1014be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b100a4920 0x7f3b1014be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 -- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 msgr2=0x7f3b101558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 0x7f3b101558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 -- 172.21.15.52:0/1163382441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08009ae0 con 0x7f3b10153c40 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b15878700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 0x7f3b101558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.115+0000 7f3b1687a700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f3b08009540 tx=0x7f3b08009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.116+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080032d0 con 0x7f3b10153c40 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.116+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b080092e0 con 0x7f3b10153c40 2023-05-10T01:25:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.116+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10164800 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.116+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0801d640 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.116+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b10164470 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.117+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10164fe0 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.117+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b0801b040 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.118+0000 7f3afe7fc700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 0x7f3af0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.118+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6285+0+0 (secure 0 0 0) 0x7f3b0807c110 con 0x7f3b10153c40 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.118+0000 7f3b16079700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 0x7f3af0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.118+0000 7f3b16079700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 0x7f3af0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b0c0036e0 tx=0x7f3b0c009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.121+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b0804d690 con 0x7f3b10153c40 2023-05-10T01:25:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.340+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b10164fe0 con 0x7f3b10153c40 2023-05-10T01:25:32.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.347+0000 7f3afe7fc700 1 -- 172.21.15.52:0/1163382441 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3b08050cb0 con 0x7f3b10153c40 2023-05-10T01:25:32.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.357+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 msgr2=0x7f3af0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.357+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 0x7f3af0061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3b0c0036e0 tx=0x7f3b0c009040).stop 2023-05-10T01:25:32.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.357+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 msgr2=0x7f3b101588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.357+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f3b08009540 tx=0x7f3b08009840).stop 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 shutdown_connections 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3af005ed90 0x7f3af0061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b10153c40 0x7f3b101588c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b100a4920 0x7f3b1014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 --2- 172.21.15.52:0/1163382441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b100a75a0 0x7f3b101558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.358+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 >> 172.21.15.52:0/1163382441 conn(0x7f3b10068a20 msgr2=0x7f3b1014e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:32.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.362+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 shutdown_connections 2023-05-10T01:25:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.365+0000 7f3b1707b700 1 -- 172.21.15.52:0/1163382441 wait complete. 2023-05-10T01:25:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 13 and data pool 14 2023-05-10T01:25:32.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:32.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.497+0000 7f41584e6700 1 Processor -- start 2023-05-10T01:25:32.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.498+0000 7f41584e6700 1 -- start start 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.498+0000 7f41584e6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f415014e1f0 0x7f415014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f41584e6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500683c0 con 0x7f4150158150 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f41584e6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500be050 con 0x7f4150066e40 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f41584e6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4150137460 con 0x7f415014e1f0 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f415014e1f0 0x7f415014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f415014e1f0 0x7f415014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37162/0 (socket says 172.21.15.52:37162) 2023-05-10T01:25:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 -- 172.21.15.52:0/1538818241 learned_addr learned my addr 172.21.15.52:0/1538818241 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156a83700 1 --1- 172.21.15.52:0/1538818241 >> v1:172.21.15.52:6789/0 conn(0x7f4150158150 0x7f415015dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46180/0 (socket says 172.21.15.52:46180) 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 -- 172.21.15.52:0/1538818241 >> v1:172.21.15.172:6789/0 conn(0x7f4150066e40 legacy=0x7f4150157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 -- 172.21.15.52:0/1538818241 >> v1:172.21.15.52:6789/0 conn(0x7f4150158150 legacy=0x7f415015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 -- 172.21.15.52:0/1538818241 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500677b0 con 0x7f415014e1f0 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4156282700 1 --2- 172.21.15.52:0/1538818241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f415014e1f0 0x7f415014e5d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f4148009f20 tx=0x7f4148009840).ready entity=mon.0 client_cookie=60d02275fdce03a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4155280700 1 -- 172.21.15.52:0/1538818241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800e070 con 0x7f415014e1f0 2023-05-10T01:25:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4155280700 1 -- 172.21.15.52:0/1538818241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800ba40 con 0x7f415014e1f0 2023-05-10T01:25:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.499+0000 7f4155280700 1 -- 172.21.15.52:0/1538818241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800bdc0 con 0x7f415014e1f0 2023-05-10T01:25:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 -- 172.21.15.52:0/1538818241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f415014e1f0 msgr2=0x7f415014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 --2- 172.21.15.52:0/1538818241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f415014e1f0 0x7f415014e5d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f4148009f20 tx=0x7f4148009840).stop 2023-05-10T01:25:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 -- 172.21.15.52:0/1538818241 shutdown_connections 2023-05-10T01:25:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 --2- 172.21.15.52:0/1538818241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f415014e1f0 0x7f415014e5d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 -- 172.21.15.52:0/1538818241 >> 172.21.15.52:0/1538818241 conn(0x7f41500c7bb0 msgr2=0x7f41500c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 -- 172.21.15.52:0/1538818241 shutdown_connections 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.500+0000 7f41584e6700 1 -- 172.21.15.52:0/1538818241 wait complete. 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.501+0000 7f41584e6700 1 Processor -- start 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.501+0000 7f41584e6700 1 -- start start 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4150066e40 0x7f4150136960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 0x7f4150139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415013a1e0 con 0x7f4150158150 2023-05-10T01:25:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150137d50 con 0x7f415014e1f0 2023-05-10T01:25:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f41584e6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500ac7f0 con 0x7f4150066e40 2023-05-10T01:25:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37172/0 (socket says 172.21.15.52:37172) 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 -- 172.21.15.52:0/2650737998 learned_addr learned my addr 172.21.15.52:0/2650737998 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156282700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4150066e40 0x7f4150136960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4155a81700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 0x7f4150139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 -- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4150066e40 msgr2=0x7f4150136960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4150066e40 0x7f4150136960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 -- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 msgr2=0x7f4150139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 0x7f4150139800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 -- 172.21.15.52:0/2650737998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148009ae0 con 0x7f4150158150 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4155a81700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 0x7f4150139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f4156a83700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f414000c440 tx=0x7f4140007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.502+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400072e0 con 0x7f4150158150 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.503+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140007440 con 0x7f4150158150 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.503+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4150137720 con 0x7f4150158150 2023-05-10T01:25:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.503+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400058f0 con 0x7f4150158150 2023-05-10T01:25:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.503+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41501379e0 con 0x7f4150158150 2023-05-10T01:25:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.503+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500c6e30 con 0x7f4150158150 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.504+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4140010070 con 0x7f4150158150 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.504+0000 7f414e7fc700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 0x7f4130061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.504+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f4140079150 con 0x7f4150158150 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.505+0000 7f4156282700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 0x7f4130061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.505+0000 7f4156282700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 0x7f4130061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f414800ba10 tx=0x7f4148009840).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.509+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f414004a5e0 con 0x7f4150158150 2023-05-10T01:25:32.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.682+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f415006c340 con 0x7f4150158150 2023-05-10T01:25:32.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.683+0000 7f414e7fc700 1 -- 172.21.15.52:0/2650737998 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17454 (secure 0 0 0) 0x7f4140007e60 con 0x7f4150158150 2023-05-10T01:25:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:32.688 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":107,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:32.342102+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 msgr2=0x7f4130061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 0x7f4130061280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f414800ba10 tx=0x7f4148009840).stop 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 msgr2=0x7f4150139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f414000c440 tx=0x7f4140007dd0).stop 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 shutdown_connections 2023-05-10T01:25:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f413005edc0 0x7f4130061280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4150158150 0x7f4150139cf0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4150066e40 0x7f4150136960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 --2- 172.21.15.52:0/2650737998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415014e1f0 0x7f4150139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 >> 172.21.15.52:0/2650737998 conn(0x7f41500c7bb0 msgr2=0x7f41500bd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 shutdown_connections 2023-05-10T01:25:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.685+0000 7f41584e6700 1 -- 172.21.15.52:0/2650737998 wait complete. 2023-05-10T01:25:32.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.815+0000 7f17e0cf0700 1 Processor -- start 2023-05-10T01:25:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.815+0000 7f17e0cf0700 1 -- start start 2023-05-10T01:25:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17e0cf0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17dc154540 0x7f17dc069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17e0cf0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17e0cf0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0c0650 con 0x7f17dc154160 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17e0cf0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc069ff0 con 0x7f17dc154540 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17e0cf0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0bfd20 con 0x7f17dc069b80 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17d9d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17dc154540 0x7f17dc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17d9d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17dc154540 0x7f17dc069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37180/0 (socket says 172.21.15.52:37180) 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17d9d9b700 1 -- 172.21.15.52:0/2341519896 learned_addr learned my addr 172.21.15.52:0/2341519896 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.816+0000 7f17dad9d700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d9d9b700 1 -- 172.21.15.52:0/2341519896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 msgr2=0x7f17dc0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d9d9b700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d9d9b700 1 -- 172.21.15.52:0/2341519896 >> v1:172.21.15.52:6789/0 conn(0x7f17dc154160 legacy=0x7f17dc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d9d9b700 1 -- 172.21.15.52:0/2341519896 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0c0000 con 0x7f17dc154540 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d9d9b700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc069690 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f17c4006fd0 tx=0x7f17c40090f0).ready entity=mon.0 client_cookie=71f37f438a841124 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d959a700 1 -- 172.21.15.52:0/2341519896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400b600 con 0x7f17dc154540 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d959a700 1 -- 172.21.15.52:0/2341519896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c400b760 con 0x7f17dc154540 2023-05-10T01:25:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17d959a700 1 -- 172.21.15.52:0/2341519896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400bb00 con 0x7f17dc154540 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 -- 172.21.15.52:0/2341519896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 msgr2=0x7f17dc069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc069690 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f17c4006fd0 tx=0x7f17c40090f0).stop 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 -- 172.21.15.52:0/2341519896 shutdown_connections 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/2341519896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc069690 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 -- 172.21.15.52:0/2341519896 >> 172.21.15.52:0/2341519896 conn(0x7f17dc0cb6f0 msgr2=0x7f17dc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 -- 172.21.15.52:0/2341519896 shutdown_connections 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.817+0000 7f17e0cf0700 1 -- 172.21.15.52:0/2341519896 wait complete. 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 Processor -- start 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 -- start start 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17dc154160 0x7f17dc0af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0af5d0 con 0x7f17dc154540 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0b03e0 con 0x7f17dc154160 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17e0cf0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc147e90 con 0x7f17dc069b80 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17dad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17dad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37186/0 (socket says 172.21.15.52:37186) 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.819+0000 7f17dad9d700 1 -- 172.21.15.52:0/234249379 learned_addr learned my addr 172.21.15.52:0/234249379 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:32.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17d9d9b700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17dc154160 0x7f17dc0af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17da59c700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 -- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 msgr2=0x7f17dc0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 -- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17dc154160 msgr2=0x7f17dc0af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17dc154160 0x7f17dc0af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 -- 172.21.15.52:0/234249379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4009370 con 0x7f17dc154540 2023-05-10T01:25:32.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17dad9d700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f17cc009fa0 tx=0x7f17cc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00ed20 con 0x7f17dc154540 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00ee80 con 0x7f17dc154540 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc0af7d0 con 0x7f17dc154540 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc014610 con 0x7f17dc154540 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.820+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc0afd90 con 0x7f17dc154540 2023-05-10T01:25:32.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.821+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc0666b0 con 0x7f17dc154540 2023-05-10T01:25:32.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.822+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17cc01b030 con 0x7f17dc154540 2023-05-10T01:25:32.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.822+0000 7f17d27fc700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 0x7f17c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:32.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.822+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f17cc07a510 con 0x7f17dc154540 2023-05-10T01:25:32.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.822+0000 7f17da59c700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 0x7f17c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:32.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.823+0000 7f17da59c700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 0x7f17c0061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f17d4003750 tx=0x7f17d4009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:32.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:32.826+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17cc04ba20 con 0x7f17dc154540 2023-05-10T01:25:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.002+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17dc06c340 con 0x7f17dc154540 2023-05-10T01:25:33.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.003+0000 7f17d27fc700 1 -- 172.21.15.52:0/234249379 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17454 (secure 0 0 0) 0x7f17cc04f040 con 0x7f17dc154540 2023-05-10T01:25:33.007 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:33.007 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":107,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:32.342102+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 msgr2=0x7f17c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 0x7f17c0061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f17d4003750 tx=0x7f17d4009040).stop 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 msgr2=0x7f17dc146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f17cc009fa0 tx=0x7f17cc009900).stop 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 shutdown_connections 2023-05-10T01:25:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f17c005ed90 0x7f17c0061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17dc154540 0x7f17dc146a80 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17dc069b80 0x7f17dc0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 --2- 172.21.15.52:0/234249379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17dc154160 0x7f17dc0af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 >> 172.21.15.52:0/234249379 conn(0x7f17dc0cb6f0 msgr2=0x7f17dc0ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 shutdown_connections 2023-05-10T01:25:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.005+0000 7f17e0cf0700 1 -- 172.21.15.52:0/234249379 wait complete. 2023-05-10T01:25:33.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:25:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.137+0000 7f9c49810700 1 Processor -- start 2023-05-10T01:25:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.137+0000 7f9c49810700 1 -- start start 2023-05-10T01:25:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 0x7f9c440a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 0x7f9c440c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9c440c0140 0x7f9c440c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c44069f50 con 0x7f9c440c0140 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4406a9d0 con 0x7f9c44153f80 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c49810700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440c6660 con 0x7f9c440c5cf0 2023-05-10T01:25:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9c440c0140 0x7f9c440c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9c440c0140 0x7f9c440c0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37192/0 (socket says 172.21.15.52:37192) 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 -- 172.21.15.52:0/3904334877 learned_addr learned my addr 172.21.15.52:0/3904334877 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c43fff700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 0x7f9c440c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4880e700 1 --2- 172.21.15.52:0/3904334877 >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 0x7f9c440a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 -- 172.21.15.52:0/3904334877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 msgr2=0x7f9c440c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 0x7f9c440c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 -- 172.21.15.52:0/3904334877 >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 msgr2=0x7f9c440a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 --2- 172.21.15.52:0/3904334877 >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 0x7f9c440a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 -- 172.21.15.52:0/3904334877 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4406a130 con 0x7f9c440c0140 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4880e700 1 --2- 172.21.15.52:0/3904334877 >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 0x7f9c440a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c43fff700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 0x7f9c440c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c4900f700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c0140 0x7f9c440c0590 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f9c440caa30 tx=0x7f9c2c0090f0).ready entity=mon.0 client_cookie=e0b8cf2e87746796 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c437fe700 1 -- 172.21.15.52:0/3904334877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00b600 con 0x7f9c440c0140 2023-05-10T01:25:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c437fe700 1 -- 172.21.15.52:0/3904334877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c00b760 con 0x7f9c440c0140 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.138+0000 7f9c437fe700 1 -- 172.21.15.52:0/3904334877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00bae0 con 0x7f9c440c0140 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 -- 172.21.15.52:0/3904334877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c0140 msgr2=0x7f9c440c0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c0140 0x7f9c440c0590 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f9c440caa30 tx=0x7f9c2c0090f0).stop 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 -- 172.21.15.52:0/3904334877 shutdown_connections 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c0140 0x7f9c440c0590 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 --2- 172.21.15.52:0/3904334877 >> v2:172.21.15.172:3300/0 conn(0x7f9c44153f80 0x7f9c440a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 --2- 172.21.15.52:0/3904334877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c440c5cf0 0x7f9c440c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 -- 172.21.15.52:0/3904334877 >> 172.21.15.52:0/3904334877 conn(0x7f9c440cb5f0 msgr2=0x7f9c440c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:33.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 -- 172.21.15.52:0/3904334877 shutdown_connections 2023-05-10T01:25:33.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.139+0000 7f9c49810700 1 -- 172.21.15.52:0/3904334877 wait complete. 2023-05-10T01:25:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.140+0000 7f9c49810700 1 Processor -- start 2023-05-10T01:25:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.140+0000 7f9c49810700 1 -- start start 2023-05-10T01:25:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c440c0140 0x7f9c44151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c44153f80 0x7f9c440c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440c1670 con 0x7f9c440c5cf0 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44158370 con 0x7f9c440c0140 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c49810700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c441574b0 con 0x7f9c44153f80 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37198/0 (socket says 172.21.15.52:37198) 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 -- 172.21.15.52:0/738320173 learned_addr learned my addr 172.21.15.52:0/738320173 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c4880e700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c440c0140 0x7f9c44151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c4900f700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c44153f80 0x7f9c440c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 -- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c44153f80 msgr2=0x7f9c440c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c44153f80 0x7f9c440c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 -- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c440c0140 msgr2=0x7f9c44151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c440c0140 0x7f9c44151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 -- 172.21.15.52:0/738320173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009370 con 0x7f9c440c5cf0 2023-05-10T01:25:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.141+0000 7f9c43fff700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f9c3400c880 tx=0x7f9c34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.142+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34010580 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.142+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340106e0 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.142+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44157790 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.142+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34010a60 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.142+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c44158000 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.143+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c44083110 con 0x7f9c440c5cf0 2023-05-10T01:25:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.143+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9c3401b460 con 0x7f9c440c5cf0 2023-05-10T01:25:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.143+0000 7f9c40ff9700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 0x7f9c28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.144+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9c34079d50 con 0x7f9c440c5cf0 2023-05-10T01:25:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.144+0000 7f9c4880e700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 0x7f9c28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.144+0000 7f9c4880e700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 0x7f9c28061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9c3c00f600 tx=0x7f9c3c0077b0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.148+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c3404b180 con 0x7f9c440c5cf0 2023-05-10T01:25:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:33.367+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9c44158500 con 0x7f9c440c5cf0 2023-05-10T01:25:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.356+0000 7f9c40ff9700 1 -- 172.21.15.52:0/738320173 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9c3404e7a0 con 0x7f9c440c5cf0 2023-05-10T01:25:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 msgr2=0x7f9c28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 0x7f9c28061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9c3c00f600 tx=0x7f9c3c0077b0).stop 2023-05-10T01:25:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 msgr2=0x7f9c440c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f9c3400c880 tx=0x7f9c34008040).stop 2023-05-10T01:25:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 shutdown_connections 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9c2805ed90 0x7f9c28061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c44153f80 0x7f9c440c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c440c0140 0x7f9c44151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 --2- 172.21.15.52:0/738320173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c440c5cf0 0x7f9c440c0c90 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 >> 172.21.15.52:0/738320173 conn(0x7f9c440cb5f0 msgr2=0x7f9c44159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 shutdown_connections 2023-05-10T01:25:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.358+0000 7f9c49810700 1 -- 172.21.15.52:0/738320173 wait complete. 2023-05-10T01:25:34.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:25:34.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.499+0000 7f929d5dd700 1 Processor -- start 2023-05-10T01:25:34.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.499+0000 7f929d5dd700 1 -- start start 2023-05-10T01:25:34.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f929d5dd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9298154080 0x7f92980aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f929d5dd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 0x7f92980a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f929d5dd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980c94c0 con 0x7f92980aa140 2023-05-10T01:25:34.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f929d5dd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980aa590 con 0x7f9298154080 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f929d5dd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980cb7d0 con 0x7f9298154460 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f9296ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9298154080 0x7f92980aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f9296ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9298154080 0x7f92980aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37204/0 (socket says 172.21.15.52:37204) 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f9296ffd700 1 -- 172.21.15.52:0/381403618 learned_addr learned my addr 172.21.15.52:0/381403618 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f92967fc700 1 --2- 172.21.15.52:0/381403618 >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 0x7f92980a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.500+0000 7f9296ffd700 1 -- 172.21.15.52:0/381403618 >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 msgr2=0x7f92980a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:34.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9296ffd700 1 --2- 172.21.15.52:0/381403618 >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 0x7f92980a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9296ffd700 1 -- 172.21.15.52:0/381403618 >> v1:172.21.15.52:6789/0 conn(0x7f92980aa140 legacy=0x7f9298068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9296ffd700 1 -- 172.21.15.52:0/381403618 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980c88b0 con 0x7f9298154080 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9295ffb700 1 -- 172.21.15.52:0/381403618 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574526592 0 0) 0x7f92980c94c0 con 0x7f92980aa140 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f92967fc700 1 --2- 172.21.15.52:0/381403618 >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 0x7f92980a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9296ffd700 1 --2- 172.21.15.52:0/381403618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f92980aac90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f9298084310 tx=0x7f92900090f0).ready entity=mon.0 client_cookie=720ee0a615439f39 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9295ffb700 1 -- 172.21.15.52:0/381403618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000b600 con 0x7f9298154080 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9295ffb700 1 -- 172.21.15.52:0/381403618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000b760 con 0x7f9298154080 2023-05-10T01:25:34.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f9295ffb700 1 -- 172.21.15.52:0/381403618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000bae0 con 0x7f9298154080 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 -- 172.21.15.52:0/381403618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 msgr2=0x7f92980aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 --2- 172.21.15.52:0/381403618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f92980aac90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f9298084310 tx=0x7f92900090f0).stop 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 -- 172.21.15.52:0/381403618 shutdown_connections 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 --2- 172.21.15.52:0/381403618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f92980aac90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 --2- 172.21.15.52:0/381403618 >> v2:172.21.15.172:3300/0 conn(0x7f9298154460 0x7f92980a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 -- 172.21.15.52:0/381403618 >> 172.21.15.52:0/381403618 conn(0x7f9298067910 msgr2=0x7f92980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:34.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 -- 172.21.15.52:0/381403618 shutdown_connections 2023-05-10T01:25:34.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.501+0000 7f929d5dd700 1 -- 172.21.15.52:0/381403618 wait complete. 2023-05-10T01:25:34.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 Processor -- start 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 -- start start 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92980aa140 0x7f929814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9298154460 0x7f9298168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298168a60 con 0x7f9298154080 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980af8b0 con 0x7f92980aa140 2023-05-10T01:25:34.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.503+0000 7f929d5dd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9298153220 con 0x7f9298154460 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37206/0 (socket says 172.21.15.52:37206) 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 -- 172.21.15.52:0/3096939806 learned_addr learned my addr 172.21.15.52:0/3096939806 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 -- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9298154460 msgr2=0x7f9298168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9298154460 0x7f9298168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 -- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92980aa140 msgr2=0x7f929814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92980aa140 0x7f929814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 -- 172.21.15.52:0/3096939806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009370 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f92967fc700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f928000d890 tx=0x7f9280008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800125f0 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280012750 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980aefc0 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280012ad0 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.504+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980af540 con 0x7f9298154080 2023-05-10T01:25:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.505+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298066720 con 0x7f9298154080 2023-05-10T01:25:34.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.506+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9280013480 con 0x7f9298154080 2023-05-10T01:25:34.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.506+0000 7f928effd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 0x7f927c061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:34.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.506+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9280079b30 con 0x7f9298154080 2023-05-10T01:25:34.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.506+0000 7f9296ffd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 0x7f927c061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:34.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.507+0000 7f9296ffd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 0x7f927c061280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9290009fd0 tx=0x7f9290017000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:34.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.510+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f928004af60 con 0x7f9298154080 2023-05-10T01:25:34.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:34.729+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f929806c340 con 0x7f9298154080 2023-05-10T01:25:35.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.358+0000 7f928effd700 1 -- 172.21.15.52:0/3096939806 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f928004e580 con 0x7f9298154080 2023-05-10T01:25:35.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.360+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 msgr2=0x7f927c061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.360+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 0x7f927c061280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9290009fd0 tx=0x7f9290017000).stop 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.360+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 msgr2=0x7f9298152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.360+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f928000d890 tx=0x7f9280008040).stop 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 shutdown_connections 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f927c05edc0 0x7f927c061280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9298154460 0x7f9298168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92980aa140 0x7f929814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:35.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 --2- 172.21.15.52:0/3096939806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9298154080 0x7f9298152b90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 >> 172.21.15.52:0/3096939806 conn(0x7f9298067910 msgr2=0x7f929814e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:35.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 shutdown_connections 2023-05-10T01:25:35.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.361+0000 7f929d5dd700 1 -- 172.21.15.52:0/3096939806 wait complete. 2023-05-10T01:25:35.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:35.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.498+0000 7f523a153700 1 Processor -- start 2023-05-10T01:25:35.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.498+0000 7f523a153700 1 -- start start 2023-05-10T01:25:35.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f523a153700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5234154540 0x7f52340aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f523a153700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52340c5ca0 0x7f52340c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f523a153700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52340c6640 con 0x7f5234154160 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f523a153700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52340ab1f0 con 0x7f52340c5ca0 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f523a153700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52340c08a0 con 0x7f5234154540 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f52337fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5234154160 0x7f52340a9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46228/0 (socket says 172.21.15.52:46228) 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f52337fe700 1 -- 172.21.15.52:0/2412615175 learned_addr learned my addr 172.21.15.52:0/2412615175 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 --2- 172.21.15.52:0/2412615175 >> v2:172.21.15.52:3300/0 conn(0x7f52340c5ca0 0x7f52340c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 -- 172.21.15.52:0/2412615175 >> v2:172.21.15.172:3300/0 conn(0x7f5234154540 msgr2=0x7f52340aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 --2- 172.21.15.52:0/2412615175 >> v2:172.21.15.172:3300/0 conn(0x7f5234154540 0x7f52340aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 -- 172.21.15.52:0/2412615175 >> v1:172.21.15.52:6789/0 conn(0x7f5234154160 legacy=0x7f52340a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 -- 172.21.15.52:0/2412615175 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340bfc90 con 0x7f52340c5ca0 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f5233fff700 1 --2- 172.21.15.52:0/2412615175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52340c5ca0 0x7f52340c6150 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f523406a730 tx=0x7f5224009060).ready entity=mon.0 client_cookie=304a562bff97ab8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f52327fc700 1 -- 172.21.15.52:0/2412615175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400b580 con 0x7f52340c5ca0 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f52327fc700 1 -- 172.21.15.52:0/2412615175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400b6e0 con 0x7f52340c5ca0 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.499+0000 7f52327fc700 1 -- 172.21.15.52:0/2412615175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400ba60 con 0x7f52340c5ca0 2023-05-10T01:25:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 -- 172.21.15.52:0/2412615175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52340c5ca0 msgr2=0x7f52340c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 --2- 172.21.15.52:0/2412615175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52340c5ca0 0x7f52340c6150 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f523406a730 tx=0x7f5224009060).stop 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 -- 172.21.15.52:0/2412615175 shutdown_connections 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 --2- 172.21.15.52:0/2412615175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52340c5ca0 0x7f52340c6150 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 --2- 172.21.15.52:0/2412615175 >> v2:172.21.15.172:3300/0 conn(0x7f5234154540 0x7f52340aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 -- 172.21.15.52:0/2412615175 >> 172.21.15.52:0/2412615175 conn(0x7f52340cb6c0 msgr2=0x7f52340c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 -- 172.21.15.52:0/2412615175 shutdown_connections 2023-05-10T01:25:35.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.500+0000 7f523a153700 1 -- 172.21.15.52:0/2412615175 wait complete. 2023-05-10T01:25:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.501+0000 7f523a153700 1 Processor -- start 2023-05-10T01:25:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.501+0000 7f523a153700 1 -- start start 2023-05-10T01:25:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 0x7f5234144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5234154160 0x7f5234154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340c2030 con 0x7f5234154540 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52340c4060 con 0x7f52340c5ca0 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f523a153700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5234168bc0 con 0x7f5234154160 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37220/0 (socket says 172.21.15.52:37220) 2023-05-10T01:25:35.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 -- 172.21.15.52:0/2801224148 learned_addr learned my addr 172.21.15.52:0/2801224148 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5232ffd700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5234154160 0x7f5234154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f52337fe700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 0x7f5234144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 -- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5234154160 msgr2=0x7f5234154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5234154160 0x7f5234154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 -- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 msgr2=0x7f5234144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 0x7f5234144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f5233fff700 1 -- 172.21.15.52:0/2801224148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240092a0 con 0x7f5234154540 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.502+0000 7f52337fe700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 0x7f5234144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f5233fff700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5234084210 tx=0x7f5224017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400ba60 con 0x7f5234154540 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400be60 con 0x7f5234154540 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522401b620 con 0x7f5234154540 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52340c3a10 con 0x7f5234154540 2023-05-10T01:25:35.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.503+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234168ea0 con 0x7f5234154540 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.504+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52340c3870 con 0x7f5234154540 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.504+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f522400f070 con 0x7f5234154540 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.505+0000 7f522b7fe700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 0x7f5218061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.505+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f522407b350 con 0x7f5234154540 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.505+0000 7f52337fe700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 0x7f5218061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.505+0000 7f52337fe700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 0x7f5218061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f522c0016b0 tx=0x7f522c009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.509+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52340c3870 con 0x7f5234154540 2023-05-10T01:25:35.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.730+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52340c3870 con 0x7f5234154540 2023-05-10T01:25:35.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.730+0000 7f522b7fe700 1 -- 172.21.15.52:0/2801224148 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f52340c3870 con 0x7f5234154540 2023-05-10T01:25:35.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:35.735 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:25:35.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 msgr2=0x7f5218061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 0x7f5218061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f522c0016b0 tx=0x7f522c009040).stop 2023-05-10T01:25:35.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 msgr2=0x7f52340c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f5234084210 tx=0x7f5224017000).stop 2023-05-10T01:25:35.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 shutdown_connections 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f521805ed90 0x7f5218061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5234154540 0x7f52340c44f0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52340c5ca0 0x7f5234144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 --2- 172.21.15.52:0/2801224148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5234154160 0x7f5234154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 >> 172.21.15.52:0/2801224148 conn(0x7f52340cb6c0 msgr2=0x7f5234069690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 shutdown_connections 2023-05-10T01:25:35.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.732+0000 7f523a153700 1 -- 172.21.15.52:0/2801224148 wait complete. 2023-05-10T01:25:35.738 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:25:35.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:25:35.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.860+0000 7fe346dd4700 1 Processor -- start 2023-05-10T01:25:35.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.860+0000 7fe346dd4700 1 -- start start 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe346dd4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3400bf4e0 0x7fe340069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe346dd4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe340062950 con 0x7fe340063e20 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe346dd4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe340069fa0 con 0x7fe340154030 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe346dd4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe340154410 con 0x7fe3400bf4e0 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe33ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe340063e20 0x7fe3400bd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46242/0 (socket says 172.21.15.52:46242) 2023-05-10T01:25:35.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe33ffff700 1 -- 172.21.15.52:0/3554083716 learned_addr learned my addr 172.21.15.52:0/3554083716 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe345371700 1 --2- 172.21.15.52:0/3554083716 >> v2:172.21.15.172:3300/0 conn(0x7fe3400bf4e0 0x7fe340069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536118346 0 0) 0x7fe340062950 con 0x7fe340063e20 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3240033f0 con 0x7fe340063e20 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.861+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252821788 0 0) 0x7fe3240033f0 con 0x7fe340063e20 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 >> v2:172.21.15.172:3300/0 conn(0x7fe3400bf4e0 msgr2=0x7fe340069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:35.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 --2- 172.21.15.52:0/3554083716 >> v2:172.21.15.172:3300/0 conn(0x7fe3400bf4e0 0x7fe340069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 >> v1:172.21.15.172:6789/0 conn(0x7fe340154030 legacy=0x7fe340063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340062340 con 0x7fe340063e20 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fe32c001470 con 0x7fe340063e20 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 >> v1:172.21.15.52:6789/0 conn(0x7fe340063e20 legacy=0x7fe3400bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe324003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324004690 0x7fe324004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe324005000 0x7fe32400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32400be80 con 0x7fe3240038e0 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32400bff0 con 0x7fe324005000 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32400c1b0 con 0x7fe324004690 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe324003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe345371700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe324005000 0x7fe32400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33ffff700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324004690 0x7fe324004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 -- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324004690 msgr2=0x7fe324004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe324004690 0x7fe324004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 -- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe324005000 msgr2=0x7fe32400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe324005000 0x7fe32400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 -- 172.21.15.52:0/3554083716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240033f0 con 0x7fe3240038e0 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe345371700 1 -- 172.21.15.52:0/3554083716 reap_dead start 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe344b70700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe324003d00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fe334001730 tx=0x7fe334007bb0).ready entity=mon.0 client_cookie=ba3315e976fd9e2e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334007020 con 0x7fe3240038e0 2023-05-10T01:25:35.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334007180 con 0x7fe3240038e0 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.862+0000 7fe33f7fe700 1 -- 172.21.15.52:0/3554083716 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334007520 con 0x7fe3240038e0 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 -- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 msgr2=0x7fe324003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe324003d00 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fe334001730 tx=0x7fe334007bb0).stop 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 -- 172.21.15.52:0/3554083716 shutdown_connections 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 --2- 172.21.15.52:0/3554083716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe324003d00 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 -- 172.21.15.52:0/3554083716 >> 172.21.15.52:0/3554083716 conn(0x7fe3400c8a90 msgr2=0x7fe3400c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:35.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 -- 172.21.15.52:0/3554083716 shutdown_connections 2023-05-10T01:25:35.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.863+0000 7fe346dd4700 1 -- 172.21.15.52:0/3554083716 wait complete. 2023-05-10T01:25:35.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.864+0000 7fe346dd4700 1 Processor -- start 2023-05-10T01:25:35.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.864+0000 7fe346dd4700 1 -- start start 2023-05-10T01:25:35.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3401648a0 0x7fe3400a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 0x7fe3400a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34014ef00 con 0x7fe3240038e0 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400a8570 con 0x7fe3400aad00 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe346dd4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400a90b0 con 0x7fe3401648a0 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37236/0 (socket says 172.21.15.52:37236) 2023-05-10T01:25:35.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 -- 172.21.15.52:0/376939106 learned_addr learned my addr 172.21.15.52:0/376939106 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe345371700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 0x7fe3400a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe33ffff700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3401648a0 0x7fe3400a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 -- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3401648a0 msgr2=0x7fe3400a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3401648a0 0x7fe3400a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 -- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 msgr2=0x7fe3400a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 0x7fe3400a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:35.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 -- 172.21.15.52:0/376939106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340161570 con 0x7fe3240038e0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe345371700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 0x7fe3400a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.865+0000 7fe344b70700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fe334001d20 tx=0x7fe334015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.866+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334013460 con 0x7fe3240038e0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.866+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3340135c0 con 0x7fe3240038e0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.866+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334013980 con 0x7fe3240038e0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.866+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3400a8780 con 0x7fe3240038e0 2023-05-10T01:25:35.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.866+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3400a8d40 con 0x7fe3240038e0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.867+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340068720 con 0x7fe3240038e0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.867+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe334010030 con 0x7fe3240038e0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.867+0000 7fe33cff9700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 0x7fe328061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.867+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe33407a560 con 0x7fe3240038e0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.867+0000 7fe33ffff700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 0x7fe328061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.868+0000 7fe33ffff700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 0x7fe328061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe340157340 tx=0x7fe32c007040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:35.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:35.871+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe340068720 con 0x7fe3240038e0 2023-05-10T01:25:36.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.044+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe340068720 con 0x7fe3240038e0 2023-05-10T01:25:36.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.045+0000 7fe33cff9700 1 -- 172.21.15.52:0/376939106 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17441 (secure 0 0 0) 0x7fe340068720 con 0x7fe3240038e0 2023-05-10T01:25:36.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:36.050 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":108,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:33.344359+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:25:36.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 msgr2=0x7fe328061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 0x7fe328061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe340157340 tx=0x7fe32c007040).stop 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 msgr2=0x7fe340161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fe334001d20 tx=0x7fe334015000).stop 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 shutdown_connections 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe32805ed90 0x7fe328061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3400aad00 0x7fe3400a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3240038e0 0x7fe340161080 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 --2- 172.21.15.52:0/376939106 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3401648a0 0x7fe3400a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 >> 172.21.15.52:0/376939106 conn(0x7fe3400c8a90 msgr2=0x7fe3400bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 shutdown_connections 2023-05-10T01:25:36.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.047+0000 7fe346dd4700 1 -- 172.21.15.52:0/376939106 wait complete. 2023-05-10T01:25:36.062 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:25:36.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:36.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 Processor -- start 2023-05-10T01:25:36.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 -- start start 2023-05-10T01:25:36.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe200154160 0x7fe2000c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe2000c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000c0650 con 0x7fe200069690 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.176+0000 7fe2055a7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000c1af0 con 0x7fe200154160 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe2055a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000bfd20 con 0x7fe200154540 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1ff7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe200069690 0x7fe200157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46260/0 (socket says 172.21.15.52:46260) 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1ff7fe700 1 -- 172.21.15.52:0/3055605014 learned_addr learned my addr 172.21.15.52:0/3055605014 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408118040 0 0) 0x7fe2000c0650 con 0x7fe200069690 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fe7fc700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe2000c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e00033f0 con 0x7fe200069690 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1feffd700 1 --2- 172.21.15.52:0/3055605014 >> v2:172.21.15.172:3300/0 conn(0x7fe200154160 0x7fe2000c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829256474 0 0) 0x7fe1e00033f0 con 0x7fe200069690 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 msgr2=0x7fe2000c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe2000c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 >> v2:172.21.15.172:3300/0 conn(0x7fe200154160 msgr2=0x7fe2000c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 --2- 172.21.15.52:0/3055605014 >> v2:172.21.15.172:3300/0 conn(0x7fe200154160 0x7fe2000c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000c0000 con 0x7fe200069690 2023-05-10T01:25:36.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fe1f00017f0 con 0x7fe200069690 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 >> v1:172.21.15.52:6789/0 conn(0x7fe200069690 legacy=0x7fe200157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe1e00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0003e10 0x7fe1e0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe1e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000c1af0 con 0x7fe1e0004b80 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000bfd20 con 0x7fe1e0003e10 2023-05-10T01:25:36.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e000b8e0 con 0x7fe200154540 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.177+0000 7fe1ff7fe700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe1e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1fe7fc700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0003e10 0x7fe1e0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1feffd700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe1e00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 -- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 msgr2=0x7fe1e00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200154540 0x7fe1e00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 -- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0003e10 msgr2=0x7fe1e0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0003e10 0x7fe1e0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 -- 172.21.15.52:0/3055605014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00033f0 con 0x7fe1e0004b80 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe1e0005000 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fe1f000c560 tx=0x7fe1f0002210).ready entity=mon.0 client_cookie=3fdf1e9ba32971e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007de0 con 0x7fe1e0004b80 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000ce50 con 0x7fe1e0004b80 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1fdffb700 1 -- 172.21.15.52:0/3055605014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0005d30 con 0x7fe1e0004b80 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe2055a7700 1 -- 172.21.15.52:0/3055605014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 msgr2=0x7fe1e0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe2055a7700 1 --2- 172.21.15.52:0/3055605014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe1e0005000 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fe1f000c560 tx=0x7fe1f0002210).stop 2023-05-10T01:25:36.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.178+0000 7fe1ff7fe700 1 -- 172.21.15.52:0/3055605014 reap_dead start 2023-05-10T01:25:36.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.179+0000 7fe2055a7700 1 -- 172.21.15.52:0/3055605014 shutdown_connections 2023-05-10T01:25:36.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.179+0000 7fe2055a7700 1 -- 172.21.15.52:0/3055605014 >> 172.21.15.52:0/3055605014 conn(0x7fe2000cb6f0 msgr2=0x7fe2000c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.179+0000 7fe2055a7700 1 -- 172.21.15.52:0/3055605014 shutdown_connections 2023-05-10T01:25:36.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.179+0000 7fe2055a7700 1 -- 172.21.15.52:0/3055605014 wait complete. 2023-05-10T01:25:36.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.180+0000 7fe2055a7700 1 Processor -- start 2023-05-10T01:25:36.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.180+0000 7fe2055a7700 1 -- start start 2023-05-10T01:25:36.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe200151350 0x7fe2000a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200152430 0x7fe200152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000c20a0 con 0x7fe1e0004b80 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000c4a10 con 0x7fe200151350 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200152d80 con 0x7fe200152430 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37252/0 (socket says 172.21.15.52:37252) 2023-05-10T01:25:36.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 -- 172.21.15.52:0/1798330830 learned_addr learned my addr 172.21.15.52:0/1798330830 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1fe7fc700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe200151350 0x7fe2000a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1ff7fe700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200152430 0x7fe200152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 -- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200152430 msgr2=0x7fe200152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200152430 0x7fe200152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 -- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe200151350 msgr2=0x7fe2000a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe200151350 0x7fe2000a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 -- 172.21.15.52:0/1798330830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200164650 con 0x7fe1e0004b80 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1feffd700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7fe1f80119c0 tx=0x7fe1f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8013680 con 0x7fe1e0004b80 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80137e0 con 0x7fe1e0004b80 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20014e310 con 0x7fe1e0004b80 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8013b60 con 0x7fe1e0004b80 2023-05-10T01:25:36.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.181+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe200151b00 con 0x7fe1e0004b80 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.182+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2000c2380 con 0x7fe1e0004b80 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.183+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe1f8024070 con 0x7fe1e0004b80 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.183+0000 7fe1f6ffd700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 0x7fe1e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.183+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe1f807a570 con 0x7fe1e0004b80 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.183+0000 7fe1fe7fc700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 0x7fe1e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.184+0000 7fe1fe7fc700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 0x7fe1e4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe200151750 tx=0x7fe1e8009060).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.187+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1f804ba00 con 0x7fe1e0004b80 2023-05-10T01:25:36.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.354+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2000c21e0 con 0x7fe1e405ed90 2023-05-10T01:25:36.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.365+0000 7fe1f6ffd700 1 -- 172.21.15.52:0/1798330830 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357325 (secure 0 0 0) 0x7fe1e8019070 con 0x7fe1e405ed90 2023-05-10T01:25:36.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 msgr2=0x7fe1e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 0x7fe1e4061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe200151750 tx=0x7fe1e8009060).stop 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 msgr2=0x7fe20014de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7fe1f80119c0 tx=0x7fe1f8009060).stop 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 shutdown_connections 2023-05-10T01:25:36.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe1e405ed90 0x7fe1e4061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe200152430 0x7fe200152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e0004b80 0x7fe20014de20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 --2- 172.21.15.52:0/1798330830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe200151350 0x7fe2000a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 >> 172.21.15.52:0/1798330830 conn(0x7fe2000cb6f0 msgr2=0x7fe20014fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 shutdown_connections 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.369+0000 7fe2055a7700 1 -- 172.21.15.52:0/1798330830 wait complete. 2023-05-10T01:25:36.375 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:36.384 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:35.759626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":160084,"kb_used_data":10260,"kb_used_omap":0,"kb_used_meta":149760,"kb_avail":754814636,"statfs":{"total":773094113280,"available":772930187264,"internally_reserved":0,"allocated":10506240,"data_stored":5288695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":153354240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4753,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.161753"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374548+0000","last_change":"2023-05-10T01:25:32.373091+0000","last_active":"2023-05-10T01:25:32.374548+0000","last_peered":"2023-05-10T01:25:32.374548+0000","last_clean":"2023-05-10T01:25:32.374548+0000","last_became_active":"2023-05-10T01:25:32.372806+0000","last_became_peered":"2023-05-10T01:25:32.372806+0000","last_unstale":"2023-05-10T01:25:32.374548+0000","last_undegraded":"2023-05-10T01:25:32.374548+0000","last_fullsized":"2023-05-10T01:25:32.374548+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367714+0000","last_change":"2023-05-10T01:25:32.365148+0000","last_active":"2023-05-10T01:25:32.367714+0000","last_peered":"2023-05-10T01:25:32.367714+0000","last_clean":"2023-05-10T01:25:32.367714+0000","last_became_active":"2023-05-10T01:25:32.364846+0000","last_became_peered":"2023-05-10T01:25:32.364846+0000","last_unstale":"2023-05-10T01:25:32.367714+0000","last_undegraded":"2023-05-10T01:25:32.367714+0000","last_fullsized":"2023-05-10T01:25:32.367714+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349844+0000","last_change":"2023-05-10T01:25:31.973894+0000","last_active":"2023-05-10T01:25:32.349844+0000","last_peered":"2023-05-10T01:25:32.349844+0000","last_clean":"2023-05-10T01:25:32.349844+0000","last_became_active":"2023-05-10T01:25:31.973604+0000","last_became_peered":"2023-05-10T01:25:31.973604+0000","last_unstale":"2023-05-10T01:25:32.349844+0000","last_undegraded":"2023-05-10T01:25:32.349844+0000","last_fullsized":"2023-05-10T01:25:32.349844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362988+0000","last_change":"2023-05-10T01:25:32.361960+0000","last_active":"2023-05-10T01:25:32.362988+0000","last_peered":"2023-05-10T01:25:32.362988+0000","last_clean":"2023-05-10T01:25:32.362988+0000","last_became_active":"2023-05-10T01:25:32.361503+0000","last_became_peered":"2023-05-10T01:25:32.361503+0000","last_unstale":"2023-05-10T01:25:32.362988+0000","last_undegraded":"2023-05-10T01:25:32.362988+0000","last_fullsized":"2023-05-10T01:25:32.362988+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366401+0000","last_change":"2023-05-10T01:25:31.978897+0000","last_active":"2023-05-10T01:25:32.366401+0000","last_peered":"2023-05-10T01:25:32.366401+0000","last_clean":"2023-05-10T01:25:32.366401+0000","last_became_active":"2023-05-10T01:25:31.978566+0000","last_became_peered":"2023-05-10T01:25:31.978566+0000","last_unstale":"2023-05-10T01:25:32.366401+0000","last_undegraded":"2023-05-10T01:25:32.366401+0000","last_fullsized":"2023-05-10T01:25:32.366401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373604+0000","last_change":"2023-05-10T01:25:32.372259+0000","last_active":"2023-05-10T01:25:32.373604+0000","last_peered":"2023-05-10T01:25:32.373604+0000","last_clean":"2023-05-10T01:25:32.373604+0000","last_became_active":"2023-05-10T01:25:32.371998+0000","last_became_peered":"2023-05-10T01:25:32.371998+0000","last_unstale":"2023-05-10T01:25:32.373604+0000","last_undegraded":"2023-05-10T01:25:32.373604+0000","last_fullsized":"2023-05-10T01:25:32.373604+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368400+0000","last_change":"2023-05-10T01:25:31.968968+0000","last_active":"2023-05-10T01:25:32.368400+0000","last_peered":"2023-05-10T01:25:32.368400+0000","last_clean":"2023-05-10T01:25:32.368400+0000","last_became_active":"2023-05-10T01:25:31.968656+0000","last_became_peered":"2023-05-10T01:25:31.968656+0000","last_unstale":"2023-05-10T01:25:32.368400+0000","last_undegraded":"2023-05-10T01:25:32.368400+0000","last_fullsized":"2023-05-10T01:25:32.368400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366820+0000","last_change":"2023-05-10T01:25:32.363589+0000","last_active":"2023-05-10T01:25:32.366820+0000","last_peered":"2023-05-10T01:25:32.366820+0000","last_clean":"2023-05-10T01:25:32.366820+0000","last_became_active":"2023-05-10T01:25:32.362966+0000","last_became_peered":"2023-05-10T01:25:32.362966+0000","last_unstale":"2023-05-10T01:25:32.366820+0000","last_undegraded":"2023-05-10T01:25:32.366820+0000","last_fullsized":"2023-05-10T01:25:32.366820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353037+0000","last_change":"2023-05-10T01:25:31.972634+0000","last_active":"2023-05-10T01:25:32.353037+0000","last_peered":"2023-05-10T01:25:32.353037+0000","last_clean":"2023-05-10T01:25:32.353037+0000","last_became_active":"2023-05-10T01:25:31.972348+0000","last_became_peered":"2023-05-10T01:25:31.972348+0000","last_unstale":"2023-05-10T01:25:32.353037+0000","last_undegraded":"2023-05-10T01:25:32.353037+0000","last_fullsized":"2023-05-10T01:25:32.353037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376770+0000","last_change":"2023-05-10T01:25:32.371753+0000","last_active":"2023-05-10T01:25:32.376770+0000","last_peered":"2023-05-10T01:25:32.376770+0000","last_clean":"2023-05-10T01:25:32.376770+0000","last_became_active":"2023-05-10T01:25:32.370996+0000","last_became_peered":"2023-05-10T01:25:32.370996+0000","last_unstale":"2023-05-10T01:25:32.376770+0000","last_undegraded":"2023-05-10T01:25:32.376770+0000","last_fullsized":"2023-05-10T01:25:32.376770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363723+0000","last_change":"2023-05-10T01:25:32.361013+0000","last_active":"2023-05-10T01:25:32.363723+0000","last_peered":"2023-05-10T01:25:32.363723+0000","last_clean":"2023-05-10T01:25:32.363723+0000","last_became_active":"2023-05-10T01:25:32.360721+0000","last_became_peered":"2023-05-10T01:25:32.360721+0000","last_unstale":"2023-05-10T01:25:32.363723+0000","last_undegraded":"2023-05-10T01:25:32.363723+0000","last_fullsized":"2023-05-10T01:25:32.363723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372752+0000","last_change":"2023-05-10T01:25:32.367033+0000","last_active":"2023-05-10T01:25:32.372752+0000","last_peered":"2023-05-10T01:25:32.372752+0000","last_clean":"2023-05-10T01:25:32.372752+0000","last_became_active":"2023-05-10T01:25:32.366365+0000","last_became_peered":"2023-05-10T01:25:32.366365+0000","last_unstale":"2023-05-10T01:25:32.372752+0000","last_undegraded":"2023-05-10T01:25:32.372752+0000","last_fullsized":"2023-05-10T01:25:32.372752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363754+0000","last_change":"2023-05-10T01:25:32.360861+0000","last_active":"2023-05-10T01:25:32.363754+0000","last_peered":"2023-05-10T01:25:32.363754+0000","last_clean":"2023-05-10T01:25:32.363754+0000","last_became_active":"2023-05-10T01:25:32.360568+0000","last_became_peered":"2023-05-10T01:25:32.360568+0000","last_unstale":"2023-05-10T01:25:32.363754+0000","last_undegraded":"2023-05-10T01:25:32.363754+0000","last_fullsized":"2023-05-10T01:25:32.363754+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348836+0000","last_change":"2023-05-10T01:25:31.972948+0000","last_active":"2023-05-10T01:25:32.348836+0000","last_peered":"2023-05-10T01:25:32.348836+0000","last_clean":"2023-05-10T01:25:32.348836+0000","last_became_active":"2023-05-10T01:25:31.972633+0000","last_became_peered":"2023-05-10T01:25:31.972633+0000","last_unstale":"2023-05-10T01:25:32.348836+0000","last_undegraded":"2023-05-10T01:25:32.348836+0000","last_fullsized":"2023-05-10T01:25:32.348836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376702+0000","last_change":"2023-05-10T01:25:32.370331+0000","last_active":"2023-05-10T01:25:32.376702+0000","last_peered":"2023-05-10T01:25:32.376702+0000","last_clean":"2023-05-10T01:25:32.376702+0000","last_became_active":"2023-05-10T01:25:32.370062+0000","last_became_peered":"2023-05-10T01:25:32.370062+0000","last_unstale":"2023-05-10T01:25:32.376702+0000","last_undegraded":"2023-05-10T01:25:32.376702+0000","last_fullsized":"2023-05-10T01:25:32.376702+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365971+0000","last_change":"2023-05-10T01:25:32.360582+0000","last_active":"2023-05-10T01:25:32.365971+0000","last_peered":"2023-05-10T01:25:32.365971+0000","last_clean":"2023-05-10T01:25:32.365971+0000","last_became_active":"2023-05-10T01:25:32.360271+0000","last_became_peered":"2023-05-10T01:25:32.360271+0000","last_unstale":"2023-05-10T01:25:32.365971+0000","last_undegraded":"2023-05-10T01:25:32.365971+0000","last_fullsized":"2023-05-10T01:25:32.365971+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365249+0000","last_change":"2023-05-10T01:25:32.359531+0000","last_active":"2023-05-10T01:25:32.365249+0000","last_peered":"2023-05-10T01:25:32.365249+0000","last_clean":"2023-05-10T01:25:32.365249+0000","last_became_active":"2023-05-10T01:25:32.357544+0000","last_became_peered":"2023-05-10T01:25:32.357544+0000","last_unstale":"2023-05-10T01:25:32.365249+0000","last_undegraded":"2023-05-10T01:25:32.365249+0000","last_fullsized":"2023-05-10T01:25:32.365249+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353387+0000","last_change":"2023-05-10T01:25:31.979686+0000","last_active":"2023-05-10T01:25:32.353387+0000","last_peered":"2023-05-10T01:25:32.353387+0000","last_clean":"2023-05-10T01:25:32.353387+0000","last_became_active":"2023-05-10T01:25:31.978877+0000","last_became_peered":"2023-05-10T01:25:31.978877+0000","last_unstale":"2023-05-10T01:25:32.353387+0000","last_undegraded":"2023-05-10T01:25:32.353387+0000","last_fullsized":"2023-05-10T01:25:32.353387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368698+0000","last_change":"2023-05-10T01:25:32.364860+0000","last_active":"2023-05-10T01:25:32.368698+0000","last_peered":"2023-05-10T01:25:32.368698+0000","last_clean":"2023-05-10T01:25:32.368698+0000","last_became_active":"2023-05-10T01:25:32.364645+0000","last_became_peered":"2023-05-10T01:25:32.364645+0000","last_unstale":"2023-05-10T01:25:32.368698+0000","last_undegraded":"2023-05-10T01:25:32.368698+0000","last_fullsized":"2023-05-10T01:25:32.368698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352726+0000","last_change":"2023-05-10T01:25:31.964718+0000","last_active":"2023-05-10T01:25:32.352726+0000","last_peered":"2023-05-10T01:25:32.352726+0000","last_clean":"2023-05-10T01:25:32.352726+0000","last_became_active":"2023-05-10T01:25:31.964432+0000","last_became_peered":"2023-05-10T01:25:31.964432+0000","last_unstale":"2023-05-10T01:25:32.352726+0000","last_undegraded":"2023-05-10T01:25:32.352726+0000","last_fullsized":"2023-05-10T01:25:32.352726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373607+0000","last_change":"2023-05-10T01:25:32.372809+0000","last_active":"2023-05-10T01:25:32.373607+0000","last_peered":"2023-05-10T01:25:32.373607+0000","last_clean":"2023-05-10T01:25:32.373607+0000","last_became_active":"2023-05-10T01:25:32.372525+0000","last_became_peered":"2023-05-10T01:25:32.372525+0000","last_unstale":"2023-05-10T01:25:32.373607+0000","last_undegraded":"2023-05-10T01:25:32.373607+0000","last_fullsized":"2023-05-10T01:25:32.373607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371608+0000","last_change":"2023-05-10T01:25:31.964128+0000","last_active":"2023-05-10T01:25:32.371608+0000","last_peered":"2023-05-10T01:25:32.371608+0000","last_clean":"2023-05-10T01:25:32.371608+0000","last_became_active":"2023-05-10T01:25:31.963858+0000","last_became_peered":"2023-05-10T01:25:31.963858+0000","last_unstale":"2023-05-10T01:25:32.371608+0000","last_undegraded":"2023-05-10T01:25:32.371608+0000","last_fullsized":"2023-05-10T01:25:32.371608+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365321+0000","last_change":"2023-05-10T01:25:32.358660+0000","last_active":"2023-05-10T01:25:32.365321+0000","last_peered":"2023-05-10T01:25:32.365321+0000","last_clean":"2023-05-10T01:25:32.365321+0000","last_became_active":"2023-05-10T01:25:32.358335+0000","last_became_peered":"2023-05-10T01:25:32.358335+0000","last_unstale":"2023-05-10T01:25:32.365321+0000","last_undegraded":"2023-05-10T01:25:32.365321+0000","last_fullsized":"2023-05-10T01:25:32.365321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354715+0000","last_change":"2023-05-10T01:25:31.968051+0000","last_active":"2023-05-10T01:25:32.354715+0000","last_peered":"2023-05-10T01:25:32.354715+0000","last_clean":"2023-05-10T01:25:32.354715+0000","last_became_active":"2023-05-10T01:25:31.967744+0000","last_became_peered":"2023-05-10T01:25:31.967744+0000","last_unstale":"2023-05-10T01:25:32.354715+0000","last_undegraded":"2023-05-10T01:25:32.354715+0000","last_fullsized":"2023-05-10T01:25:32.354715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376381+0000","last_change":"2023-05-10T01:25:32.368882+0000","last_active":"2023-05-10T01:25:32.376381+0000","last_peered":"2023-05-10T01:25:32.376381+0000","last_clean":"2023-05-10T01:25:32.376381+0000","last_became_active":"2023-05-10T01:25:32.368593+0000","last_became_peered":"2023-05-10T01:25:32.368593+0000","last_unstale":"2023-05-10T01:25:32.376381+0000","last_undegraded":"2023-05-10T01:25:32.376381+0000","last_fullsized":"2023-05-10T01:25:32.376381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353740+0000","last_change":"2023-05-10T01:25:31.965170+0000","last_active":"2023-05-10T01:25:32.353740+0000","last_peered":"2023-05-10T01:25:32.353740+0000","last_clean":"2023-05-10T01:25:32.353740+0000","last_became_active":"2023-05-10T01:25:31.964889+0000","last_became_peered":"2023-05-10T01:25:31.964889+0000","last_unstale":"2023-05-10T01:25:32.353740+0000","last_undegraded":"2023-05-10T01:25:32.353740+0000","last_fullsized":"2023-05-10T01:25:32.353740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370701+0000","last_change":"2023-05-10T01:25:32.369797+0000","last_active":"2023-05-10T01:25:32.370701+0000","last_peered":"2023-05-10T01:25:32.370701+0000","last_clean":"2023-05-10T01:25:32.370701+0000","last_became_active":"2023-05-10T01:25:32.369393+0000","last_became_peered":"2023-05-10T01:25:32.369393+0000","last_unstale":"2023-05-10T01:25:32.370701+0000","last_undegraded":"2023-05-10T01:25:32.370701+0000","last_fullsized":"2023-05-10T01:25:32.370701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364256+0000","last_change":"2023-05-10T01:25:31.965803+0000","last_active":"2023-05-10T01:25:32.364256+0000","last_peered":"2023-05-10T01:25:32.364256+0000","last_clean":"2023-05-10T01:25:32.364256+0000","last_became_active":"2023-05-10T01:25:31.965495+0000","last_became_peered":"2023-05-10T01:25:31.965495+0000","last_unstale":"2023-05-10T01:25:32.364256+0000","last_undegraded":"2023-05-10T01:25:32.364256+0000","last_fullsized":"2023-05-10T01:25:32.364256+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365650+0000","last_change":"2023-05-10T01:25:32.361745+0000","last_active":"2023-05-10T01:25:32.365650+0000","last_peered":"2023-05-10T01:25:32.365650+0000","last_clean":"2023-05-10T01:25:32.365650+0000","last_became_active":"2023-05-10T01:25:32.361473+0000","last_became_peered":"2023-05-10T01:25:32.361473+0000","last_unstale":"2023-05-10T01:25:32.365650+0000","last_undegraded":"2023-05-10T01:25:32.365650+0000","last_fullsized":"2023-05-10T01:25:32.365650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354188+0000","last_change":"2023-05-10T01:25:31.972607+0000","last_active":"2023-05-10T01:25:32.354188+0000","last_peered":"2023-05-10T01:25:32.354188+0000","last_clean":"2023-05-10T01:25:32.354188+0000","last_became_active":"2023-05-10T01:25:31.972048+0000","last_became_peered":"2023-05-10T01:25:31.972048+0000","last_unstale":"2023-05-10T01:25:32.354188+0000","last_undegraded":"2023-05-10T01:25:32.354188+0000","last_fullsized":"2023-05-10T01:25:32.354188+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367027+0000","last_change":"2023-05-10T01:25:32.362548+0000","last_active":"2023-05-10T01:25:32.367027+0000","last_peered":"2023-05-10T01:25:32.367027+0000","last_clean":"2023-05-10T01:25:32.367027+0000","last_became_active":"2023-05-10T01:25:32.361461+0000","last_became_peered":"2023-05-10T01:25:32.361461+0000","last_unstale":"2023-05-10T01:25:32.367027+0000","last_undegraded":"2023-05-10T01:25:32.367027+0000","last_fullsized":"2023-05-10T01:25:32.367027+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365703+0000","last_change":"2023-05-10T01:25:31.969371+0000","last_active":"2023-05-10T01:25:32.365703+0000","last_peered":"2023-05-10T01:25:32.365703+0000","last_clean":"2023-05-10T01:25:32.365703+0000","last_became_active":"2023-05-10T01:25:31.969080+0000","last_became_peered":"2023-05-10T01:25:31.969080+0000","last_unstale":"2023-05-10T01:25:32.365703+0000","last_undegraded":"2023-05-10T01:25:32.365703+0000","last_fullsized":"2023-05-10T01:25:32.365703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350385+0000","last_change":"2023-05-10T01:25:31.974405+0000","last_active":"2023-05-10T01:25:32.350385+0000","last_peered":"2023-05-10T01:25:32.350385+0000","last_clean":"2023-05-10T01:25:32.350385+0000","last_became_active":"2023-05-10T01:25:31.974108+0000","last_became_peered":"2023-05-10T01:25:31.974108+0000","last_unstale":"2023-05-10T01:25:32.350385+0000","last_undegraded":"2023-05-10T01:25:32.350385+0000","last_fullsized":"2023-05-10T01:25:32.350385+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368717+0000","last_change":"2023-05-10T01:25:32.365374+0000","last_active":"2023-05-10T01:25:32.368717+0000","last_peered":"2023-05-10T01:25:32.368717+0000","last_clean":"2023-05-10T01:25:32.368717+0000","last_became_active":"2023-05-10T01:25:32.365088+0000","last_became_peered":"2023-05-10T01:25:32.365088+0000","last_unstale":"2023-05-10T01:25:32.368717+0000","last_undegraded":"2023-05-10T01:25:32.368717+0000","last_fullsized":"2023-05-10T01:25:32.368717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376819+0000","last_change":"2023-05-10T01:25:32.373347+0000","last_active":"2023-05-10T01:25:32.376819+0000","last_peered":"2023-05-10T01:25:32.376819+0000","last_clean":"2023-05-10T01:25:32.376819+0000","last_became_active":"2023-05-10T01:25:32.371753+0000","last_became_peered":"2023-05-10T01:25:32.371753+0000","last_unstale":"2023-05-10T01:25:32.376819+0000","last_undegraded":"2023-05-10T01:25:32.376819+0000","last_fullsized":"2023-05-10T01:25:32.376819+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353308+0000","last_change":"2023-05-10T01:25:31.969920+0000","last_active":"2023-05-10T01:25:32.353308+0000","last_peered":"2023-05-10T01:25:32.353308+0000","last_clean":"2023-05-10T01:25:32.353308+0000","last_became_active":"2023-05-10T01:25:31.969667+0000","last_became_peered":"2023-05-10T01:25:31.969667+0000","last_unstale":"2023-05-10T01:25:32.353308+0000","last_undegraded":"2023-05-10T01:25:32.353308+0000","last_fullsized":"2023-05-10T01:25:32.353308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365341+0000","last_change":"2023-05-10T01:25:32.360107+0000","last_active":"2023-05-10T01:25:32.365341+0000","last_peered":"2023-05-10T01:25:32.365341+0000","last_clean":"2023-05-10T01:25:32.365341+0000","last_became_active":"2023-05-10T01:25:32.359824+0000","last_became_peered":"2023-05-10T01:25:32.359824+0000","last_unstale":"2023-05-10T01:25:32.365341+0000","last_undegraded":"2023-05-10T01:25:32.365341+0000","last_fullsized":"2023-05-10T01:25:32.365341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349439+0000","last_change":"2023-05-10T01:25:31.976138+0000","last_active":"2023-05-10T01:25:32.349439+0000","last_peered":"2023-05-10T01:25:32.349439+0000","last_clean":"2023-05-10T01:25:32.349439+0000","last_became_active":"2023-05-10T01:25:31.975542+0000","last_became_peered":"2023-05-10T01:25:31.975542+0000","last_unstale":"2023-05-10T01:25:32.349439+0000","last_undegraded":"2023-05-10T01:25:32.349439+0000","last_fullsized":"2023-05-10T01:25:32.349439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374644+0000","last_change":"2023-05-10T01:25:32.373032+0000","last_active":"2023-05-10T01:25:32.374644+0000","last_peered":"2023-05-10T01:25:32.374644+0000","last_clean":"2023-05-10T01:25:32.374644+0000","last_became_active":"2023-05-10T01:25:32.372770+0000","last_became_peered":"2023-05-10T01:25:32.372770+0000","last_unstale":"2023-05-10T01:25:32.374644+0000","last_undegraded":"2023-05-10T01:25:32.374644+0000","last_fullsized":"2023-05-10T01:25:32.374644+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376335+0000","last_change":"2023-05-10T01:25:32.369001+0000","last_active":"2023-05-10T01:25:32.376335+0000","last_peered":"2023-05-10T01:25:32.376335+0000","last_clean":"2023-05-10T01:25:32.376335+0000","last_became_active":"2023-05-10T01:25:32.368656+0000","last_became_peered":"2023-05-10T01:25:32.368656+0000","last_unstale":"2023-05-10T01:25:32.376335+0000","last_undegraded":"2023-05-10T01:25:32.376335+0000","last_fullsized":"2023-05-10T01:25:32.376335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356938+0000","last_change":"2023-05-10T01:25:31.966263+0000","last_active":"2023-05-10T01:25:32.356938+0000","last_peered":"2023-05-10T01:25:32.356938+0000","last_clean":"2023-05-10T01:25:32.356938+0000","last_became_active":"2023-05-10T01:25:31.965960+0000","last_became_peered":"2023-05-10T01:25:31.965960+0000","last_unstale":"2023-05-10T01:25:32.356938+0000","last_undegraded":"2023-05-10T01:25:32.356938+0000","last_fullsized":"2023-05-10T01:25:32.356938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364429+0000","last_change":"2023-05-10T01:25:32.355599+0000","last_active":"2023-05-10T01:25:32.364429+0000","last_peered":"2023-05-10T01:25:32.364429+0000","last_clean":"2023-05-10T01:25:32.364429+0000","last_became_active":"2023-05-10T01:25:32.355323+0000","last_became_peered":"2023-05-10T01:25:32.355323+0000","last_unstale":"2023-05-10T01:25:32.364429+0000","last_undegraded":"2023-05-10T01:25:32.364429+0000","last_fullsized":"2023-05-10T01:25:32.364429+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349588+0000","last_change":"2023-05-10T01:25:31.975172+0000","last_active":"2023-05-10T01:25:32.349588+0000","last_peered":"2023-05-10T01:25:32.349588+0000","last_clean":"2023-05-10T01:25:32.349588+0000","last_became_active":"2023-05-10T01:25:31.974835+0000","last_became_peered":"2023-05-10T01:25:31.974835+0000","last_unstale":"2023-05-10T01:25:32.349588+0000","last_undegraded":"2023-05-10T01:25:32.349588+0000","last_fullsized":"2023-05-10T01:25:32.349588+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351477+0000","last_change":"2023-05-10T01:25:31.970025+0000","last_active":"2023-05-10T01:25:32.351477+0000","last_peered":"2023-05-10T01:25:32.351477+0000","last_clean":"2023-05-10T01:25:32.351477+0000","last_became_active":"2023-05-10T01:25:31.969551+0000","last_became_peered":"2023-05-10T01:25:31.969551+0000","last_unstale":"2023-05-10T01:25:32.351477+0000","last_undegraded":"2023-05-10T01:25:32.351477+0000","last_fullsized":"2023-05-10T01:25:32.351477+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376740+0000","last_change":"2023-05-10T01:25:32.369898+0000","last_active":"2023-05-10T01:25:32.376740+0000","last_peered":"2023-05-10T01:25:32.376740+0000","last_clean":"2023-05-10T01:25:32.376740+0000","last_became_active":"2023-05-10T01:25:32.369619+0000","last_became_peered":"2023-05-10T01:25:32.369619+0000","last_unstale":"2023-05-10T01:25:32.376740+0000","last_undegraded":"2023-05-10T01:25:32.376740+0000","last_fullsized":"2023-05-10T01:25:32.376740+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352932+0000","last_change":"2023-05-10T01:25:31.969673+0000","last_active":"2023-05-10T01:25:32.352932+0000","last_peered":"2023-05-10T01:25:32.352932+0000","last_clean":"2023-05-10T01:25:32.352932+0000","last_became_active":"2023-05-10T01:25:31.969390+0000","last_became_peered":"2023-05-10T01:25:31.969390+0000","last_unstale":"2023-05-10T01:25:32.352932+0000","last_undegraded":"2023-05-10T01:25:32.352932+0000","last_fullsized":"2023-05-10T01:25:32.352932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364760+0000","last_change":"2023-05-10T01:25:32.357255+0000","last_active":"2023-05-10T01:25:32.364760+0000","last_peered":"2023-05-10T01:25:32.364760+0000","last_clean":"2023-05-10T01:25:32.364760+0000","last_became_active":"2023-05-10T01:25:32.356612+0000","last_became_peered":"2023-05-10T01:25:32.356612+0000","last_unstale":"2023-05-10T01:25:32.364760+0000","last_undegraded":"2023-05-10T01:25:32.364760+0000","last_fullsized":"2023-05-10T01:25:32.364760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364316+0000","last_change":"2023-05-10T01:25:32.358354+0000","last_active":"2023-05-10T01:25:32.364316+0000","last_peered":"2023-05-10T01:25:32.364316+0000","last_clean":"2023-05-10T01:25:32.364316+0000","last_became_active":"2023-05-10T01:25:32.358100+0000","last_became_peered":"2023-05-10T01:25:32.358100+0000","last_unstale":"2023-05-10T01:25:32.364316+0000","last_undegraded":"2023-05-10T01:25:32.364316+0000","last_fullsized":"2023-05-10T01:25:32.364316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370725+0000","last_change":"2023-05-10T01:25:31.964658+0000","last_active":"2023-05-10T01:25:32.370725+0000","last_peered":"2023-05-10T01:25:32.370725+0000","last_clean":"2023-05-10T01:25:32.370725+0000","last_became_active":"2023-05-10T01:25:31.964396+0000","last_became_peered":"2023-05-10T01:25:31.964396+0000","last_unstale":"2023-05-10T01:25:32.370725+0000","last_undegraded":"2023-05-10T01:25:32.370725+0000","last_fullsized":"2023-05-10T01:25:32.370725+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373788+0000","last_change":"2023-05-10T01:25:32.372782+0000","last_active":"2023-05-10T01:25:32.373788+0000","last_peered":"2023-05-10T01:25:32.373788+0000","last_clean":"2023-05-10T01:25:32.373788+0000","last_became_active":"2023-05-10T01:25:32.372495+0000","last_became_peered":"2023-05-10T01:25:32.372495+0000","last_unstale":"2023-05-10T01:25:32.373788+0000","last_undegraded":"2023-05-10T01:25:32.373788+0000","last_fullsized":"2023-05-10T01:25:32.373788+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368627+0000","last_change":"2023-05-10T01:25:32.363765+0000","last_active":"2023-05-10T01:25:32.368627+0000","last_peered":"2023-05-10T01:25:32.368627+0000","last_clean":"2023-05-10T01:25:32.368627+0000","last_became_active":"2023-05-10T01:25:32.363478+0000","last_became_peered":"2023-05-10T01:25:32.363478+0000","last_unstale":"2023-05-10T01:25:32.368627+0000","last_undegraded":"2023-05-10T01:25:32.368627+0000","last_fullsized":"2023-05-10T01:25:32.368627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353472+0000","last_change":"2023-05-10T01:25:31.965616+0000","last_active":"2023-05-10T01:25:32.353472+0000","last_peered":"2023-05-10T01:25:32.353472+0000","last_clean":"2023-05-10T01:25:32.353472+0000","last_became_active":"2023-05-10T01:25:31.965290+0000","last_became_peered":"2023-05-10T01:25:31.965290+0000","last_unstale":"2023-05-10T01:25:32.353472+0000","last_undegraded":"2023-05-10T01:25:32.353472+0000","last_fullsized":"2023-05-10T01:25:32.353472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350534+0000","last_change":"2023-05-10T01:25:31.969840+0000","last_active":"2023-05-10T01:25:32.350534+0000","last_peered":"2023-05-10T01:25:32.350534+0000","last_clean":"2023-05-10T01:25:32.350534+0000","last_became_active":"2023-05-10T01:25:31.969152+0000","last_became_peered":"2023-05-10T01:25:31.969152+0000","last_unstale":"2023-05-10T01:25:32.350534+0000","last_undegraded":"2023-05-10T01:25:32.350534+0000","last_fullsized":"2023-05-10T01:25:32.350534+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366836+0000","last_change":"2023-05-10T01:25:32.363757+0000","last_active":"2023-05-10T01:25:32.366836+0000","last_peered":"2023-05-10T01:25:32.366836+0000","last_clean":"2023-05-10T01:25:32.366836+0000","last_became_active":"2023-05-10T01:25:32.363316+0000","last_became_peered":"2023-05-10T01:25:32.363316+0000","last_unstale":"2023-05-10T01:25:32.366836+0000","last_undegraded":"2023-05-10T01:25:32.366836+0000","last_fullsized":"2023-05-10T01:25:32.366836+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352830+0000","last_change":"2023-05-10T01:25:31.964677+0000","last_active":"2023-05-10T01:25:32.352830+0000","last_peered":"2023-05-10T01:25:32.352830+0000","last_clean":"2023-05-10T01:25:32.352830+0000","last_became_active":"2023-05-10T01:25:31.964357+0000","last_became_peered":"2023-05-10T01:25:31.964357+0000","last_unstale":"2023-05-10T01:25:32.352830+0000","last_undegraded":"2023-05-10T01:25:32.352830+0000","last_fullsized":"2023-05-10T01:25:32.352830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371284+0000","last_change":"2023-05-10T01:25:32.370504+0000","last_active":"2023-05-10T01:25:32.371284+0000","last_peered":"2023-05-10T01:25:32.371284+0000","last_clean":"2023-05-10T01:25:32.371284+0000","last_became_active":"2023-05-10T01:25:32.370218+0000","last_became_peered":"2023-05-10T01:25:32.370218+0000","last_unstale":"2023-05-10T01:25:32.371284+0000","last_undegraded":"2023-05-10T01:25:32.371284+0000","last_fullsized":"2023-05-10T01:25:32.371284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366998+0000","last_change":"2023-05-10T01:25:32.363317+0000","last_active":"2023-05-10T01:25:32.366998+0000","last_peered":"2023-05-10T01:25:32.366998+0000","last_clean":"2023-05-10T01:25:32.366998+0000","last_became_active":"2023-05-10T01:25:32.362892+0000","last_became_peered":"2023-05-10T01:25:32.362892+0000","last_unstale":"2023-05-10T01:25:32.366998+0000","last_undegraded":"2023-05-10T01:25:32.366998+0000","last_fullsized":"2023-05-10T01:25:32.366998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353420+0000","last_change":"2023-05-10T01:25:31.978033+0000","last_active":"2023-05-10T01:25:32.353420+0000","last_peered":"2023-05-10T01:25:32.353420+0000","last_clean":"2023-05-10T01:25:32.353420+0000","last_became_active":"2023-05-10T01:25:31.977683+0000","last_became_peered":"2023-05-10T01:25:31.977683+0000","last_unstale":"2023-05-10T01:25:32.353420+0000","last_undegraded":"2023-05-10T01:25:32.353420+0000","last_fullsized":"2023-05-10T01:25:32.353420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363570+0000","last_change":"2023-05-10T01:25:32.361937+0000","last_active":"2023-05-10T01:25:32.363570+0000","last_peered":"2023-05-10T01:25:32.363570+0000","last_clean":"2023-05-10T01:25:32.363570+0000","last_became_active":"2023-05-10T01:25:32.361656+0000","last_became_peered":"2023-05-10T01:25:32.361656+0000","last_unstale":"2023-05-10T01:25:32.363570+0000","last_undegraded":"2023-05-10T01:25:32.363570+0000","last_fullsized":"2023-05-10T01:25:32.363570+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.369356+0000","last_change":"2023-05-10T01:25:31.970229+0000","last_active":"2023-05-10T01:25:32.369356+0000","last_peered":"2023-05-10T01:25:32.369356+0000","last_clean":"2023-05-10T01:25:32.369356+0000","last_became_active":"2023-05-10T01:25:31.969792+0000","last_became_peered":"2023-05-10T01:25:31.969792+0000","last_unstale":"2023-05-10T01:25:32.369356+0000","last_undegraded":"2023-05-10T01:25:32.369356+0000","last_fullsized":"2023-05-10T01:25:32.369356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370768+0000","last_change":"2023-05-10T01:25:32.369554+0000","last_active":"2023-05-10T01:25:32.370768+0000","last_peered":"2023-05-10T01:25:32.370768+0000","last_clean":"2023-05-10T01:25:32.370768+0000","last_became_active":"2023-05-10T01:25:32.369128+0000","last_became_peered":"2023-05-10T01:25:32.369128+0000","last_unstale":"2023-05-10T01:25:32.370768+0000","last_undegraded":"2023-05-10T01:25:32.370768+0000","last_fullsized":"2023-05-10T01:25:32.370768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368771+0000","last_change":"2023-05-10T01:25:31.965952+0000","last_active":"2023-05-10T01:25:32.368771+0000","last_peered":"2023-05-10T01:25:32.368771+0000","last_clean":"2023-05-10T01:25:32.368771+0000","last_became_active":"2023-05-10T01:25:31.965197+0000","last_became_peered":"2023-05-10T01:25:31.965197+0000","last_unstale":"2023-05-10T01:25:32.368771+0000","last_undegraded":"2023-05-10T01:25:32.368771+0000","last_fullsized":"2023-05-10T01:25:32.368771+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373623+0000","last_change":"2023-05-10T01:25:32.372333+0000","last_active":"2023-05-10T01:25:32.373623+0000","last_peered":"2023-05-10T01:25:32.373623+0000","last_clean":"2023-05-10T01:25:32.373623+0000","last_became_active":"2023-05-10T01:25:32.372045+0000","last_became_peered":"2023-05-10T01:25:32.372045+0000","last_unstale":"2023-05-10T01:25:32.373623+0000","last_undegraded":"2023-05-10T01:25:32.373623+0000","last_fullsized":"2023-05-10T01:25:32.373623+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376801+0000","last_change":"2023-05-10T01:25:32.373164+0000","last_active":"2023-05-10T01:25:32.376801+0000","last_peered":"2023-05-10T01:25:32.376801+0000","last_clean":"2023-05-10T01:25:32.376801+0000","last_became_active":"2023-05-10T01:25:32.372876+0000","last_became_peered":"2023-05-10T01:25:32.372876+0000","last_unstale":"2023-05-10T01:25:32.376801+0000","last_undegraded":"2023-05-10T01:25:32.376801+0000","last_fullsized":"2023-05-10T01:25:32.376801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.346366+0000","last_change":"2023-05-10T01:25:31.963088+0000","last_active":"2023-05-10T01:25:32.346366+0000","last_peered":"2023-05-10T01:25:32.346366+0000","last_clean":"2023-05-10T01:25:32.346366+0000","last_became_active":"2023-05-10T01:25:31.962304+0000","last_became_peered":"2023-05-10T01:25:31.962304+0000","last_unstale":"2023-05-10T01:25:32.346366+0000","last_undegraded":"2023-05-10T01:25:32.346366+0000","last_fullsized":"2023-05-10T01:25:32.346366+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364353+0000","last_change":"2023-05-10T01:25:32.363444+0000","last_active":"2023-05-10T01:25:32.364353+0000","last_peered":"2023-05-10T01:25:32.364353+0000","last_clean":"2023-05-10T01:25:32.364353+0000","last_became_active":"2023-05-10T01:25:32.363205+0000","last_became_peered":"2023-05-10T01:25:32.363205+0000","last_unstale":"2023-05-10T01:25:32.364353+0000","last_undegraded":"2023-05-10T01:25:32.364353+0000","last_fullsized":"2023-05-10T01:25:32.364353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348946+0000","last_change":"2023-05-10T01:25:31.973667+0000","last_active":"2023-05-10T01:25:32.348946+0000","last_peered":"2023-05-10T01:25:32.348946+0000","last_clean":"2023-05-10T01:25:32.348946+0000","last_became_active":"2023-05-10T01:25:31.973364+0000","last_became_peered":"2023-05-10T01:25:31.973364+0000","last_unstale":"2023-05-10T01:25:32.348946+0000","last_undegraded":"2023-05-10T01:25:32.348946+0000","last_fullsized":"2023-05-10T01:25:32.348946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363667+0000","last_change":"2023-05-10T01:25:32.360888+0000","last_active":"2023-05-10T01:25:32.363667+0000","last_peered":"2023-05-10T01:25:32.363667+0000","last_clean":"2023-05-10T01:25:32.363667+0000","last_became_active":"2023-05-10T01:25:32.360630+0000","last_became_peered":"2023-05-10T01:25:32.360630+0000","last_unstale":"2023-05-10T01:25:32.363667+0000","last_undegraded":"2023-05-10T01:25:32.363667+0000","last_fullsized":"2023-05-10T01:25:32.363667+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365017+0000","last_change":"2023-05-10T01:25:31.973649+0000","last_active":"2023-05-10T01:25:32.365017+0000","last_peered":"2023-05-10T01:25:32.365017+0000","last_clean":"2023-05-10T01:25:32.365017+0000","last_became_active":"2023-05-10T01:25:31.973312+0000","last_became_peered":"2023-05-10T01:25:31.973312+0000","last_unstale":"2023-05-10T01:25:32.365017+0000","last_undegraded":"2023-05-10T01:25:32.365017+0000","last_fullsized":"2023-05-10T01:25:32.365017+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368792+0000","last_change":"2023-05-10T01:25:32.367931+0000","last_active":"2023-05-10T01:25:32.368792+0000","last_peered":"2023-05-10T01:25:32.368792+0000","last_clean":"2023-05-10T01:25:32.368792+0000","last_became_active":"2023-05-10T01:25:32.366029+0000","last_became_peered":"2023-05-10T01:25:32.366029+0000","last_unstale":"2023-05-10T01:25:32.368792+0000","last_undegraded":"2023-05-10T01:25:32.368792+0000","last_fullsized":"2023-05-10T01:25:32.368792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.355466+0000","last_change":"2023-05-10T01:25:31.959959+0000","last_active":"2023-05-10T01:25:32.355466+0000","last_peered":"2023-05-10T01:25:32.355466+0000","last_clean":"2023-05-10T01:25:32.355466+0000","last_became_active":"2023-05-10T01:25:31.959662+0000","last_became_peered":"2023-05-10T01:25:31.959662+0000","last_unstale":"2023-05-10T01:25:32.355466+0000","last_undegraded":"2023-05-10T01:25:32.355466+0000","last_fullsized":"2023-05-10T01:25:32.355466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364206+0000","last_change":"2023-05-10T01:25:32.358333+0000","last_active":"2023-05-10T01:25:32.364206+0000","last_peered":"2023-05-10T01:25:32.364206+0000","last_clean":"2023-05-10T01:25:32.364206+0000","last_became_active":"2023-05-10T01:25:32.357905+0000","last_became_peered":"2023-05-10T01:25:32.357905+0000","last_unstale":"2023-05-10T01:25:32.364206+0000","last_undegraded":"2023-05-10T01:25:32.364206+0000","last_fullsized":"2023-05-10T01:25:32.364206+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356826+0000","last_change":"2023-05-10T01:25:31.970051+0000","last_active":"2023-05-10T01:25:32.356826+0000","last_peered":"2023-05-10T01:25:32.356826+0000","last_clean":"2023-05-10T01:25:32.356826+0000","last_became_active":"2023-05-10T01:25:31.969424+0000","last_became_peered":"2023-05-10T01:25:31.969424+0000","last_unstale":"2023-05-10T01:25:32.356826+0000","last_undegraded":"2023-05-10T01:25:32.356826+0000","last_fullsized":"2023-05-10T01:25:32.356826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367302+0000","last_change":"2023-05-10T01:25:32.364606+0000","last_active":"2023-05-10T01:25:32.367302+0000","last_peered":"2023-05-10T01:25:32.367302+0000","last_clean":"2023-05-10T01:25:32.367302+0000","last_became_active":"2023-05-10T01:25:32.364291+0000","last_became_peered":"2023-05-10T01:25:32.364291+0000","last_unstale":"2023-05-10T01:25:32.367302+0000","last_undegraded":"2023-05-10T01:25:32.367302+0000","last_fullsized":"2023-05-10T01:25:32.367302+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.347325+0000","last_change":"2023-05-10T01:25:31.962288+0000","last_active":"2023-05-10T01:25:32.347325+0000","last_peered":"2023-05-10T01:25:32.347325+0000","last_clean":"2023-05-10T01:25:32.347325+0000","last_became_active":"2023-05-10T01:25:31.961985+0000","last_became_peered":"2023-05-10T01:25:31.961985+0000","last_unstale":"2023-05-10T01:25:32.347325+0000","last_undegraded":"2023-05-10T01:25:32.347325+0000","last_fullsized":"2023-05-10T01:25:32.347325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367599+0000","last_change":"2023-05-10T01:25:32.363926+0000","last_active":"2023-05-10T01:25:32.367599+0000","last_peered":"2023-05-10T01:25:32.367599+0000","last_clean":"2023-05-10T01:25:32.367599+0000","last_became_active":"2023-05-10T01:25:32.363672+0000","last_became_peered":"2023-05-10T01:25:32.363672+0000","last_unstale":"2023-05-10T01:25:32.367599+0000","last_undegraded":"2023-05-10T01:25:32.367599+0000","last_fullsized":"2023-05-10T01:25:32.367599+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364085+0000","last_change":"2023-05-10T01:25:32.356942+0000","last_active":"2023-05-10T01:25:32.364085+0000","last_peered":"2023-05-10T01:25:32.364085+0000","last_clean":"2023-05-10T01:25:32.364085+0000","last_became_active":"2023-05-10T01:25:32.356494+0000","last_became_peered":"2023-05-10T01:25:32.356494+0000","last_unstale":"2023-05-10T01:25:32.364085+0000","last_undegraded":"2023-05-10T01:25:32.364085+0000","last_fullsized":"2023-05-10T01:25:32.364085+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368781+0000","last_change":"2023-05-10T01:25:32.367401+0000","last_active":"2023-05-10T01:25:32.368781+0000","last_peered":"2023-05-10T01:25:32.368781+0000","last_clean":"2023-05-10T01:25:32.368781+0000","last_became_active":"2023-05-10T01:25:32.365781+0000","last_became_peered":"2023-05-10T01:25:32.365781+0000","last_unstale":"2023-05-10T01:25:32.368781+0000","last_undegraded":"2023-05-10T01:25:32.368781+0000","last_fullsized":"2023-05-10T01:25:32.368781+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351319+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:25:32.351319+0000","last_peered":"2023-05-10T01:25:32.351319+0000","last_clean":"2023-05-10T01:25:32.351319+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:25:32.351319+0000","last_undegraded":"2023-05-10T01:25:32.351319+0000","last_fullsized":"2023-05-10T01:25:32.351319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364856+0000","last_change":"2023-05-10T01:25:32.358939+0000","last_active":"2023-05-10T01:25:32.364856+0000","last_peered":"2023-05-10T01:25:32.364856+0000","last_clean":"2023-05-10T01:25:32.364856+0000","last_became_active":"2023-05-10T01:25:32.358631+0000","last_became_peered":"2023-05-10T01:25:32.358631+0000","last_unstale":"2023-05-10T01:25:32.364856+0000","last_undegraded":"2023-05-10T01:25:32.364856+0000","last_fullsized":"2023-05-10T01:25:32.364856+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356583+0000","last_change":"2023-05-10T01:25:31.967422+0000","last_active":"2023-05-10T01:25:32.356583+0000","last_peered":"2023-05-10T01:25:32.356583+0000","last_clean":"2023-05-10T01:25:32.356583+0000","last_became_active":"2023-05-10T01:25:31.967094+0000","last_became_peered":"2023-05-10T01:25:31.967094+0000","last_unstale":"2023-05-10T01:25:32.356583+0000","last_undegraded":"2023-05-10T01:25:32.356583+0000","last_fullsized":"2023-05-10T01:25:32.356583+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607157+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:25:27.607157+0000","last_peered":"2023-05-10T01:25:27.607157+0000","last_clean":"2023-05-10T01:25:27.607157+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:25:27.607157+0000","last_undegraded":"2023-05-10T01:25:27.607157+0000","last_fullsized":"2023-05-10T01:25:27.607157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353073+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:25:32.353073+0000","last_peered":"2023-05-10T01:25:32.353073+0000","last_clean":"2023-05-10T01:25:32.353073+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:25:32.353073+0000","last_undegraded":"2023-05-10T01:25:32.353073+0000","last_fullsized":"2023-05-10T01:25:32.353073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351244+0000","last_change":"2023-05-10T01:25:31.968267+0000","last_active":"2023-05-10T01:25:32.351244+0000","last_peered":"2023-05-10T01:25:32.351244+0000","last_clean":"2023-05-10T01:25:32.351244+0000","last_became_active":"2023-05-10T01:25:31.966814+0000","last_became_peered":"2023-05-10T01:25:31.966814+0000","last_unstale":"2023-05-10T01:25:32.351244+0000","last_undegraded":"2023-05-10T01:25:32.351244+0000","last_fullsized":"2023-05-10T01:25:32.351244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607129+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:25:27.607129+0000","last_peered":"2023-05-10T01:25:27.607129+0000","last_clean":"2023-05-10T01:25:27.607129+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:25:27.607129+0000","last_undegraded":"2023-05-10T01:25:27.607129+0000","last_fullsized":"2023-05-10T01:25:27.607129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607336+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:25:27.607336+0000","last_peered":"2023-05-10T01:25:27.607336+0000","last_clean":"2023-05-10T01:25:27.607336+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:25:27.607336+0000","last_undegraded":"2023-05-10T01:25:27.607336+0000","last_fullsized":"2023-05-10T01:25:27.607336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364782+0000","last_change":"2023-05-10T01:25:32.357437+0000","last_active":"2023-05-10T01:25:32.364782+0000","last_peered":"2023-05-10T01:25:32.364782+0000","last_clean":"2023-05-10T01:25:32.364782+0000","last_became_active":"2023-05-10T01:25:32.356962+0000","last_became_peered":"2023-05-10T01:25:32.356962+0000","last_unstale":"2023-05-10T01:25:32.364782+0000","last_undegraded":"2023-05-10T01:25:32.364782+0000","last_fullsized":"2023-05-10T01:25:32.364782+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607322+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:25:27.607322+0000","last_peered":"2023-05-10T01:25:27.607322+0000","last_clean":"2023-05-10T01:25:27.607322+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:25:27.607322+0000","last_undegraded":"2023-05-10T01:25:27.607322+0000","last_fullsized":"2023-05-10T01:25:27.607322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353491+0000","last_change":"2023-05-10T01:25:31.979873+0000","last_active":"2023-05-10T01:25:32.353491+0000","last_peered":"2023-05-10T01:25:32.353491+0000","last_clean":"2023-05-10T01:25:32.353491+0000","last_became_active":"2023-05-10T01:25:31.979377+0000","last_became_peered":"2023-05-10T01:25:31.979377+0000","last_unstale":"2023-05-10T01:25:32.353491+0000","last_undegraded":"2023-05-10T01:25:32.353491+0000","last_fullsized":"2023-05-10T01:25:32.353491+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607337+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:25:27.607337+0000","last_peered":"2023-05-10T01:25:27.607337+0000","last_clean":"2023-05-10T01:25:27.607337+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:25:27.607337+0000","last_undegraded":"2023-05-10T01:25:27.607337+0000","last_fullsized":"2023-05-10T01:25:27.607337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349006+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:25:32.349006+0000","last_peered":"2023-05-10T01:25:32.349006+0000","last_clean":"2023-05-10T01:25:32.349006+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:25:32.349006+0000","last_undegraded":"2023-05-10T01:25:32.349006+0000","last_fullsized":"2023-05-10T01:25:32.349006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364064+0000","last_change":"2023-05-10T01:25:32.356772+0000","last_active":"2023-05-10T01:25:32.364064+0000","last_peered":"2023-05-10T01:25:32.364064+0000","last_clean":"2023-05-10T01:25:32.364064+0000","last_became_active":"2023-05-10T01:25:32.356119+0000","last_became_peered":"2023-05-10T01:25:32.356119+0000","last_unstale":"2023-05-10T01:25:32.364064+0000","last_undegraded":"2023-05-10T01:25:32.364064+0000","last_fullsized":"2023-05-10T01:25:32.364064+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353407+0000","last_change":"2023-05-10T01:25:31.965743+0000","last_active":"2023-05-10T01:25:32.353407+0000","last_peered":"2023-05-10T01:25:32.353407+0000","last_clean":"2023-05-10T01:25:32.353407+0000","last_became_active":"2023-05-10T01:25:31.964905+0000","last_became_peered":"2023-05-10T01:25:31.964905+0000","last_unstale":"2023-05-10T01:25:32.353407+0000","last_undegraded":"2023-05-10T01:25:32.353407+0000","last_fullsized":"2023-05-10T01:25:32.353407+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607549+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:25:27.607549+0000","last_peered":"2023-05-10T01:25:27.607549+0000","last_clean":"2023-05-10T01:25:27.607549+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:25:27.607549+0000","last_undegraded":"2023-05-10T01:25:27.607549+0000","last_fullsized":"2023-05-10T01:25:27.607549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":74,"acting":74,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17832,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354008,"statfs":{"total":96636764160,"available":96618504192,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.79900000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98199999999999998},"last":0.63}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":3.016,"15min":3.016},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.93300000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.69399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.85899999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.753,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.436},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.751,"15min":0.78000000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":1.052},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.95899999999999996},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17192,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354648,"statfs":{"total":96636764160,"available":96619159552,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.753}]},{"osd":2,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":1.159},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.84799999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.321},"last":0.73599999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.88},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21464,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":20160,"kb_avail":94350376,"statfs":{"total":96636764160,"available":96614785024,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20643840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.22},"max":{"1min":0.39700000000000002,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":0.39200000000000002,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46600000000000003,"15min":0.48699999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.51800000000000002,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56699999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":0.92000000000000004,"15min":1.117},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.623,"15min":0.64300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78100000000000003,"5min":0.95299999999999996,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64100000000000001,"15min":0.65600000000000003},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":1.319},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76800000000000002,"5min":0.97799999999999998,"15min":1.079},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17132,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354708,"statfs":{"total":96636764160,"available":96619220992,"internally_reserved":0,"allocated":1347584,"data_stored":672059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.753}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22616,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":21312,"kb_avail":94349224,"statfs":{"total":96636764160,"available":96613605376,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21823488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.47099999999999997,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.50900000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.53100000000000003,"5min":0.63300000000000001,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.75},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":1.008},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.94199999999999995,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.94799999999999995,"15min":1.056},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25440,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346400,"statfs":{"total":96636764160,"available":96610713600,"internally_reserved":0,"allocated":1335296,"data_stored":672183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.378},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17696,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354144,"statfs":{"total":96636764160,"available":96618643456,"internally_reserved":0,"allocated":1335296,"data_stored":671865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20712,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":19456,"kb_avail":94351128,"statfs":{"total":96636764160,"available":96615555072,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19922944},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.80000000000000004}]},{"osd":1,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.64800000000000002,"5min":0.79800000000000004,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58599999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67300000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":1.0620000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:36.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:36.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.536+0000 7f83e355e700 1 Processor -- start 2023-05-10T01:25:36.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.536+0000 7f83e355e700 1 -- start start 2023-05-10T01:25:36.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e355e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83dc154540 0x7f83dc069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e355e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc0c0650 con 0x7f83dc069b80 2023-05-10T01:25:36.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e355e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc069fb0 con 0x7f83dc154160 2023-05-10T01:25:36.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e355e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0bfd20 con 0x7f83dc154540 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e1afb700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f83dc069b80 0x7f83dc0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46278/0 (socket says 172.21.15.52:46278) 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e1afb700 1 -- 172.21.15.52:0/2866218261 learned_addr learned my addr 172.21.15.52:0/2866218261 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83e0af9700 1 --2- 172.21.15.52:0/2866218261 >> v2:172.21.15.172:3300/0 conn(0x7f83dc154540 0x7f83dc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.537+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948757655 0 0) 0x7f83dc0c0650 con 0x7f83dc069b80 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c80033f0 con 0x7f83dc069b80 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 833872303 0 0) 0x7f83c80033f0 con 0x7f83dc069b80 2023-05-10T01:25:36.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 >> v2:172.21.15.172:3300/0 conn(0x7f83dc154540 msgr2=0x7f83dc069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 --2- 172.21.15.52:0/2866218261 >> v2:172.21.15.172:3300/0 conn(0x7f83dc154540 0x7f83dc069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 >> v1:172.21.15.172:6789/0 conn(0x7f83dc154160 legacy=0x7f83dc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0c0000 con 0x7f83dc069b80 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f83cc0017f0 con 0x7f83dc069b80 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 >> v1:172.21.15.52:6789/0 conn(0x7f83dc069b80 legacy=0x7f83dc0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8005000 0x7f83c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0bfd20 con 0x7f83c8004690 2023-05-10T01:25:36.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c800bf60 con 0x7f83c80038e0 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c800c0f0 con 0x7f83c8005000 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e12fa700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e1afb700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8005000 0x7f83c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 -- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8005000 msgr2=0x7f83c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8005000 0x7f83c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 -- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83c80038e0 msgr2=0x7f83c8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e1afb700 1 -- 172.21.15.52:0/2866218261 reap_dead start 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 -- 172.21.15.52:0/2866218261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80033f0 con 0x7f83c8004690 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.538+0000 7f83e0af9700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f83dc154920 tx=0x7f83d0009060).ready entity=mon.0 client_cookie=89a11cfd3a6a30d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0009e90 con 0x7f83c8004690 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0009430 con 0x7f83c8004690 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83dbfff700 1 -- 172.21.15.52:0/2866218261 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000e850 con 0x7f83c8004690 2023-05-10T01:25:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 -- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 msgr2=0x7f83c8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f83dc154920 tx=0x7f83d0009060).stop 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 -- 172.21.15.52:0/2866218261 shutdown_connections 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 --2- 172.21.15.52:0/2866218261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 -- 172.21.15.52:0/2866218261 >> 172.21.15.52:0/2866218261 conn(0x7f83dc0cb740 msgr2=0x7f83dc0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 -- 172.21.15.52:0/2866218261 shutdown_connections 2023-05-10T01:25:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.539+0000 7f83e355e700 1 -- 172.21.15.52:0/2866218261 wait complete. 2023-05-10T01:25:36.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.540+0000 7f83e355e700 1 Processor -- start 2023-05-10T01:25:36.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.540+0000 7f83e355e700 1 -- start start 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 0x7f83dc0c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 0x7f83dc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c2110 con 0x7f83dc14fe60 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c23f0 con 0x7f83dc14f9e0 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e355e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c26d0 con 0x7f83c8004690 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e1afb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e1afb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37276/0 (socket says 172.21.15.52:37276) 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.541+0000 7f83e1afb700 1 -- 172.21.15.52:0/3353878872 learned_addr learned my addr 172.21.15.52:0/3353878872 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e12fa700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 0x7f83dc0c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e0af9700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 0x7f83dc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 -- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 msgr2=0x7f83dc0c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 0x7f83dc0c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 -- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 msgr2=0x7f83dc1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 0x7f83dc1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 -- 172.21.15.52:0/3353878872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0c29b0 con 0x7f83dc14fe60 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e0af9700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 0x7f83dc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e12fa700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 0x7f83dc0c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e1afb700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f83dc083760 tx=0x7f83cc007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc001750 con 0x7f83dc14fe60 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00fa20 con 0x7f83dc14fe60 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc0c2c90 con 0x7f83dc14fe60 2023-05-10T01:25:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00fdc0 con 0x7f83dc14fe60 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.542+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc151be0 con 0x7f83dc14fe60 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.543+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc0666b0 con 0x7f83dc14fe60 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.543+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f83cc01b030 con 0x7f83dc14fe60 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.544+0000 7f83d97fa700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 0x7f83bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.544+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f83cc0798b0 con 0x7f83dc14fe60 2023-05-10T01:25:36.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.544+0000 7f83e12fa700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 0x7f83bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.544+0000 7f83e12fa700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 0x7f83bc061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f83dc0618d0 tx=0x7f83d4009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.548+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83cc04ace0 con 0x7f83dc14fe60 2023-05-10T01:25:36.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.716+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83dc0c36a0 con 0x7f83bc05ed90 2023-05-10T01:25:36.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.726+0000 7f83d97fa700 1 -- 172.21.15.52:0/3353878872 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357325 (secure 0 0 0) 0x7f83dc0c36a0 con 0x7f83bc05ed90 2023-05-10T01:25:36.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:36.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 msgr2=0x7f83bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 0x7f83bc061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f83dc0618d0 tx=0x7f83d4009040).stop 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 msgr2=0x7f83dc158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f83dc083760 tx=0x7f83cc007af0).stop 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 shutdown_connections 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f83bc05ed90 0x7f83bc061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83dc14fe60 0x7f83dc158eb0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83c8004690 0x7f83dc0c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 --2- 172.21.15.52:0/3353878872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc14f9e0 0x7f83dc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 >> 172.21.15.52:0/3353878872 conn(0x7f83dc0cb740 msgr2=0x7f83dc0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 shutdown_connections 2023-05-10T01:25:36.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.730+0000 7f83e355e700 1 -- 172.21.15.52:0/3353878872 wait complete. 2023-05-10T01:25:36.738 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:36.745 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:35.759626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":160084,"kb_used_data":10260,"kb_used_omap":0,"kb_used_meta":149760,"kb_avail":754814636,"statfs":{"total":773094113280,"available":772930187264,"internally_reserved":0,"allocated":10506240,"data_stored":5288695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":153354240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4753,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.161753"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374548+0000","last_change":"2023-05-10T01:25:32.373091+0000","last_active":"2023-05-10T01:25:32.374548+0000","last_peered":"2023-05-10T01:25:32.374548+0000","last_clean":"2023-05-10T01:25:32.374548+0000","last_became_active":"2023-05-10T01:25:32.372806+0000","last_became_peered":"2023-05-10T01:25:32.372806+0000","last_unstale":"2023-05-10T01:25:32.374548+0000","last_undegraded":"2023-05-10T01:25:32.374548+0000","last_fullsized":"2023-05-10T01:25:32.374548+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367714+0000","last_change":"2023-05-10T01:25:32.365148+0000","last_active":"2023-05-10T01:25:32.367714+0000","last_peered":"2023-05-10T01:25:32.367714+0000","last_clean":"2023-05-10T01:25:32.367714+0000","last_became_active":"2023-05-10T01:25:32.364846+0000","last_became_peered":"2023-05-10T01:25:32.364846+0000","last_unstale":"2023-05-10T01:25:32.367714+0000","last_undegraded":"2023-05-10T01:25:32.367714+0000","last_fullsized":"2023-05-10T01:25:32.367714+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349844+0000","last_change":"2023-05-10T01:25:31.973894+0000","last_active":"2023-05-10T01:25:32.349844+0000","last_peered":"2023-05-10T01:25:32.349844+0000","last_clean":"2023-05-10T01:25:32.349844+0000","last_became_active":"2023-05-10T01:25:31.973604+0000","last_became_peered":"2023-05-10T01:25:31.973604+0000","last_unstale":"2023-05-10T01:25:32.349844+0000","last_undegraded":"2023-05-10T01:25:32.349844+0000","last_fullsized":"2023-05-10T01:25:32.349844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362988+0000","last_change":"2023-05-10T01:25:32.361960+0000","last_active":"2023-05-10T01:25:32.362988+0000","last_peered":"2023-05-10T01:25:32.362988+0000","last_clean":"2023-05-10T01:25:32.362988+0000","last_became_active":"2023-05-10T01:25:32.361503+0000","last_became_peered":"2023-05-10T01:25:32.361503+0000","last_unstale":"2023-05-10T01:25:32.362988+0000","last_undegraded":"2023-05-10T01:25:32.362988+0000","last_fullsized":"2023-05-10T01:25:32.362988+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366401+0000","last_change":"2023-05-10T01:25:31.978897+0000","last_active":"2023-05-10T01:25:32.366401+0000","last_peered":"2023-05-10T01:25:32.366401+0000","last_clean":"2023-05-10T01:25:32.366401+0000","last_became_active":"2023-05-10T01:25:31.978566+0000","last_became_peered":"2023-05-10T01:25:31.978566+0000","last_unstale":"2023-05-10T01:25:32.366401+0000","last_undegraded":"2023-05-10T01:25:32.366401+0000","last_fullsized":"2023-05-10T01:25:32.366401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373604+0000","last_change":"2023-05-10T01:25:32.372259+0000","last_active":"2023-05-10T01:25:32.373604+0000","last_peered":"2023-05-10T01:25:32.373604+0000","last_clean":"2023-05-10T01:25:32.373604+0000","last_became_active":"2023-05-10T01:25:32.371998+0000","last_became_peered":"2023-05-10T01:25:32.371998+0000","last_unstale":"2023-05-10T01:25:32.373604+0000","last_undegraded":"2023-05-10T01:25:32.373604+0000","last_fullsized":"2023-05-10T01:25:32.373604+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368400+0000","last_change":"2023-05-10T01:25:31.968968+0000","last_active":"2023-05-10T01:25:32.368400+0000","last_peered":"2023-05-10T01:25:32.368400+0000","last_clean":"2023-05-10T01:25:32.368400+0000","last_became_active":"2023-05-10T01:25:31.968656+0000","last_became_peered":"2023-05-10T01:25:31.968656+0000","last_unstale":"2023-05-10T01:25:32.368400+0000","last_undegraded":"2023-05-10T01:25:32.368400+0000","last_fullsized":"2023-05-10T01:25:32.368400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366820+0000","last_change":"2023-05-10T01:25:32.363589+0000","last_active":"2023-05-10T01:25:32.366820+0000","last_peered":"2023-05-10T01:25:32.366820+0000","last_clean":"2023-05-10T01:25:32.366820+0000","last_became_active":"2023-05-10T01:25:32.362966+0000","last_became_peered":"2023-05-10T01:25:32.362966+0000","last_unstale":"2023-05-10T01:25:32.366820+0000","last_undegraded":"2023-05-10T01:25:32.366820+0000","last_fullsized":"2023-05-10T01:25:32.366820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353037+0000","last_change":"2023-05-10T01:25:31.972634+0000","last_active":"2023-05-10T01:25:32.353037+0000","last_peered":"2023-05-10T01:25:32.353037+0000","last_clean":"2023-05-10T01:25:32.353037+0000","last_became_active":"2023-05-10T01:25:31.972348+0000","last_became_peered":"2023-05-10T01:25:31.972348+0000","last_unstale":"2023-05-10T01:25:32.353037+0000","last_undegraded":"2023-05-10T01:25:32.353037+0000","last_fullsized":"2023-05-10T01:25:32.353037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376770+0000","last_change":"2023-05-10T01:25:32.371753+0000","last_active":"2023-05-10T01:25:32.376770+0000","last_peered":"2023-05-10T01:25:32.376770+0000","last_clean":"2023-05-10T01:25:32.376770+0000","last_became_active":"2023-05-10T01:25:32.370996+0000","last_became_peered":"2023-05-10T01:25:32.370996+0000","last_unstale":"2023-05-10T01:25:32.376770+0000","last_undegraded":"2023-05-10T01:25:32.376770+0000","last_fullsized":"2023-05-10T01:25:32.376770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363723+0000","last_change":"2023-05-10T01:25:32.361013+0000","last_active":"2023-05-10T01:25:32.363723+0000","last_peered":"2023-05-10T01:25:32.363723+0000","last_clean":"2023-05-10T01:25:32.363723+0000","last_became_active":"2023-05-10T01:25:32.360721+0000","last_became_peered":"2023-05-10T01:25:32.360721+0000","last_unstale":"2023-05-10T01:25:32.363723+0000","last_undegraded":"2023-05-10T01:25:32.363723+0000","last_fullsized":"2023-05-10T01:25:32.363723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372752+0000","last_change":"2023-05-10T01:25:32.367033+0000","last_active":"2023-05-10T01:25:32.372752+0000","last_peered":"2023-05-10T01:25:32.372752+0000","last_clean":"2023-05-10T01:25:32.372752+0000","last_became_active":"2023-05-10T01:25:32.366365+0000","last_became_peered":"2023-05-10T01:25:32.366365+0000","last_unstale":"2023-05-10T01:25:32.372752+0000","last_undegraded":"2023-05-10T01:25:32.372752+0000","last_fullsized":"2023-05-10T01:25:32.372752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363754+0000","last_change":"2023-05-10T01:25:32.360861+0000","last_active":"2023-05-10T01:25:32.363754+0000","last_peered":"2023-05-10T01:25:32.363754+0000","last_clean":"2023-05-10T01:25:32.363754+0000","last_became_active":"2023-05-10T01:25:32.360568+0000","last_became_peered":"2023-05-10T01:25:32.360568+0000","last_unstale":"2023-05-10T01:25:32.363754+0000","last_undegraded":"2023-05-10T01:25:32.363754+0000","last_fullsized":"2023-05-10T01:25:32.363754+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348836+0000","last_change":"2023-05-10T01:25:31.972948+0000","last_active":"2023-05-10T01:25:32.348836+0000","last_peered":"2023-05-10T01:25:32.348836+0000","last_clean":"2023-05-10T01:25:32.348836+0000","last_became_active":"2023-05-10T01:25:31.972633+0000","last_became_peered":"2023-05-10T01:25:31.972633+0000","last_unstale":"2023-05-10T01:25:32.348836+0000","last_undegraded":"2023-05-10T01:25:32.348836+0000","last_fullsized":"2023-05-10T01:25:32.348836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376702+0000","last_change":"2023-05-10T01:25:32.370331+0000","last_active":"2023-05-10T01:25:32.376702+0000","last_peered":"2023-05-10T01:25:32.376702+0000","last_clean":"2023-05-10T01:25:32.376702+0000","last_became_active":"2023-05-10T01:25:32.370062+0000","last_became_peered":"2023-05-10T01:25:32.370062+0000","last_unstale":"2023-05-10T01:25:32.376702+0000","last_undegraded":"2023-05-10T01:25:32.376702+0000","last_fullsized":"2023-05-10T01:25:32.376702+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365971+0000","last_change":"2023-05-10T01:25:32.360582+0000","last_active":"2023-05-10T01:25:32.365971+0000","last_peered":"2023-05-10T01:25:32.365971+0000","last_clean":"2023-05-10T01:25:32.365971+0000","last_became_active":"2023-05-10T01:25:32.360271+0000","last_became_peered":"2023-05-10T01:25:32.360271+0000","last_unstale":"2023-05-10T01:25:32.365971+0000","last_undegraded":"2023-05-10T01:25:32.365971+0000","last_fullsized":"2023-05-10T01:25:32.365971+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365249+0000","last_change":"2023-05-10T01:25:32.359531+0000","last_active":"2023-05-10T01:25:32.365249+0000","last_peered":"2023-05-10T01:25:32.365249+0000","last_clean":"2023-05-10T01:25:32.365249+0000","last_became_active":"2023-05-10T01:25:32.357544+0000","last_became_peered":"2023-05-10T01:25:32.357544+0000","last_unstale":"2023-05-10T01:25:32.365249+0000","last_undegraded":"2023-05-10T01:25:32.365249+0000","last_fullsized":"2023-05-10T01:25:32.365249+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353387+0000","last_change":"2023-05-10T01:25:31.979686+0000","last_active":"2023-05-10T01:25:32.353387+0000","last_peered":"2023-05-10T01:25:32.353387+0000","last_clean":"2023-05-10T01:25:32.353387+0000","last_became_active":"2023-05-10T01:25:31.978877+0000","last_became_peered":"2023-05-10T01:25:31.978877+0000","last_unstale":"2023-05-10T01:25:32.353387+0000","last_undegraded":"2023-05-10T01:25:32.353387+0000","last_fullsized":"2023-05-10T01:25:32.353387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368698+0000","last_change":"2023-05-10T01:25:32.364860+0000","last_active":"2023-05-10T01:25:32.368698+0000","last_peered":"2023-05-10T01:25:32.368698+0000","last_clean":"2023-05-10T01:25:32.368698+0000","last_became_active":"2023-05-10T01:25:32.364645+0000","last_became_peered":"2023-05-10T01:25:32.364645+0000","last_unstale":"2023-05-10T01:25:32.368698+0000","last_undegraded":"2023-05-10T01:25:32.368698+0000","last_fullsized":"2023-05-10T01:25:32.368698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352726+0000","last_change":"2023-05-10T01:25:31.964718+0000","last_active":"2023-05-10T01:25:32.352726+0000","last_peered":"2023-05-10T01:25:32.352726+0000","last_clean":"2023-05-10T01:25:32.352726+0000","last_became_active":"2023-05-10T01:25:31.964432+0000","last_became_peered":"2023-05-10T01:25:31.964432+0000","last_unstale":"2023-05-10T01:25:32.352726+0000","last_undegraded":"2023-05-10T01:25:32.352726+0000","last_fullsized":"2023-05-10T01:25:32.352726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373607+0000","last_change":"2023-05-10T01:25:32.372809+0000","last_active":"2023-05-10T01:25:32.373607+0000","last_peered":"2023-05-10T01:25:32.373607+0000","last_clean":"2023-05-10T01:25:32.373607+0000","last_became_active":"2023-05-10T01:25:32.372525+0000","last_became_peered":"2023-05-10T01:25:32.372525+0000","last_unstale":"2023-05-10T01:25:32.373607+0000","last_undegraded":"2023-05-10T01:25:32.373607+0000","last_fullsized":"2023-05-10T01:25:32.373607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371608+0000","last_change":"2023-05-10T01:25:31.964128+0000","last_active":"2023-05-10T01:25:32.371608+0000","last_peered":"2023-05-10T01:25:32.371608+0000","last_clean":"2023-05-10T01:25:32.371608+0000","last_became_active":"2023-05-10T01:25:31.963858+0000","last_became_peered":"2023-05-10T01:25:31.963858+0000","last_unstale":"2023-05-10T01:25:32.371608+0000","last_undegraded":"2023-05-10T01:25:32.371608+0000","last_fullsized":"2023-05-10T01:25:32.371608+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365321+0000","last_change":"2023-05-10T01:25:32.358660+0000","last_active":"2023-05-10T01:25:32.365321+0000","last_peered":"2023-05-10T01:25:32.365321+0000","last_clean":"2023-05-10T01:25:32.365321+0000","last_became_active":"2023-05-10T01:25:32.358335+0000","last_became_peered":"2023-05-10T01:25:32.358335+0000","last_unstale":"2023-05-10T01:25:32.365321+0000","last_undegraded":"2023-05-10T01:25:32.365321+0000","last_fullsized":"2023-05-10T01:25:32.365321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354715+0000","last_change":"2023-05-10T01:25:31.968051+0000","last_active":"2023-05-10T01:25:32.354715+0000","last_peered":"2023-05-10T01:25:32.354715+0000","last_clean":"2023-05-10T01:25:32.354715+0000","last_became_active":"2023-05-10T01:25:31.967744+0000","last_became_peered":"2023-05-10T01:25:31.967744+0000","last_unstale":"2023-05-10T01:25:32.354715+0000","last_undegraded":"2023-05-10T01:25:32.354715+0000","last_fullsized":"2023-05-10T01:25:32.354715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376381+0000","last_change":"2023-05-10T01:25:32.368882+0000","last_active":"2023-05-10T01:25:32.376381+0000","last_peered":"2023-05-10T01:25:32.376381+0000","last_clean":"2023-05-10T01:25:32.376381+0000","last_became_active":"2023-05-10T01:25:32.368593+0000","last_became_peered":"2023-05-10T01:25:32.368593+0000","last_unstale":"2023-05-10T01:25:32.376381+0000","last_undegraded":"2023-05-10T01:25:32.376381+0000","last_fullsized":"2023-05-10T01:25:32.376381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353740+0000","last_change":"2023-05-10T01:25:31.965170+0000","last_active":"2023-05-10T01:25:32.353740+0000","last_peered":"2023-05-10T01:25:32.353740+0000","last_clean":"2023-05-10T01:25:32.353740+0000","last_became_active":"2023-05-10T01:25:31.964889+0000","last_became_peered":"2023-05-10T01:25:31.964889+0000","last_unstale":"2023-05-10T01:25:32.353740+0000","last_undegraded":"2023-05-10T01:25:32.353740+0000","last_fullsized":"2023-05-10T01:25:32.353740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370701+0000","last_change":"2023-05-10T01:25:32.369797+0000","last_active":"2023-05-10T01:25:32.370701+0000","last_peered":"2023-05-10T01:25:32.370701+0000","last_clean":"2023-05-10T01:25:32.370701+0000","last_became_active":"2023-05-10T01:25:32.369393+0000","last_became_peered":"2023-05-10T01:25:32.369393+0000","last_unstale":"2023-05-10T01:25:32.370701+0000","last_undegraded":"2023-05-10T01:25:32.370701+0000","last_fullsized":"2023-05-10T01:25:32.370701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364256+0000","last_change":"2023-05-10T01:25:31.965803+0000","last_active":"2023-05-10T01:25:32.364256+0000","last_peered":"2023-05-10T01:25:32.364256+0000","last_clean":"2023-05-10T01:25:32.364256+0000","last_became_active":"2023-05-10T01:25:31.965495+0000","last_became_peered":"2023-05-10T01:25:31.965495+0000","last_unstale":"2023-05-10T01:25:32.364256+0000","last_undegraded":"2023-05-10T01:25:32.364256+0000","last_fullsized":"2023-05-10T01:25:32.364256+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365650+0000","last_change":"2023-05-10T01:25:32.361745+0000","last_active":"2023-05-10T01:25:32.365650+0000","last_peered":"2023-05-10T01:25:32.365650+0000","last_clean":"2023-05-10T01:25:32.365650+0000","last_became_active":"2023-05-10T01:25:32.361473+0000","last_became_peered":"2023-05-10T01:25:32.361473+0000","last_unstale":"2023-05-10T01:25:32.365650+0000","last_undegraded":"2023-05-10T01:25:32.365650+0000","last_fullsized":"2023-05-10T01:25:32.365650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354188+0000","last_change":"2023-05-10T01:25:31.972607+0000","last_active":"2023-05-10T01:25:32.354188+0000","last_peered":"2023-05-10T01:25:32.354188+0000","last_clean":"2023-05-10T01:25:32.354188+0000","last_became_active":"2023-05-10T01:25:31.972048+0000","last_became_peered":"2023-05-10T01:25:31.972048+0000","last_unstale":"2023-05-10T01:25:32.354188+0000","last_undegraded":"2023-05-10T01:25:32.354188+0000","last_fullsized":"2023-05-10T01:25:32.354188+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367027+0000","last_change":"2023-05-10T01:25:32.362548+0000","last_active":"2023-05-10T01:25:32.367027+0000","last_peered":"2023-05-10T01:25:32.367027+0000","last_clean":"2023-05-10T01:25:32.367027+0000","last_became_active":"2023-05-10T01:25:32.361461+0000","last_became_peered":"2023-05-10T01:25:32.361461+0000","last_unstale":"2023-05-10T01:25:32.367027+0000","last_undegraded":"2023-05-10T01:25:32.367027+0000","last_fullsized":"2023-05-10T01:25:32.367027+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365703+0000","last_change":"2023-05-10T01:25:31.969371+0000","last_active":"2023-05-10T01:25:32.365703+0000","last_peered":"2023-05-10T01:25:32.365703+0000","last_clean":"2023-05-10T01:25:32.365703+0000","last_became_active":"2023-05-10T01:25:31.969080+0000","last_became_peered":"2023-05-10T01:25:31.969080+0000","last_unstale":"2023-05-10T01:25:32.365703+0000","last_undegraded":"2023-05-10T01:25:32.365703+0000","last_fullsized":"2023-05-10T01:25:32.365703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350385+0000","last_change":"2023-05-10T01:25:31.974405+0000","last_active":"2023-05-10T01:25:32.350385+0000","last_peered":"2023-05-10T01:25:32.350385+0000","last_clean":"2023-05-10T01:25:32.350385+0000","last_became_active":"2023-05-10T01:25:31.974108+0000","last_became_peered":"2023-05-10T01:25:31.974108+0000","last_unstale":"2023-05-10T01:25:32.350385+0000","last_undegraded":"2023-05-10T01:25:32.350385+0000","last_fullsized":"2023-05-10T01:25:32.350385+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368717+0000","last_change":"2023-05-10T01:25:32.365374+0000","last_active":"2023-05-10T01:25:32.368717+0000","last_peered":"2023-05-10T01:25:32.368717+0000","last_clean":"2023-05-10T01:25:32.368717+0000","last_became_active":"2023-05-10T01:25:32.365088+0000","last_became_peered":"2023-05-10T01:25:32.365088+0000","last_unstale":"2023-05-10T01:25:32.368717+0000","last_undegraded":"2023-05-10T01:25:32.368717+0000","last_fullsized":"2023-05-10T01:25:32.368717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376819+0000","last_change":"2023-05-10T01:25:32.373347+0000","last_active":"2023-05-10T01:25:32.376819+0000","last_peered":"2023-05-10T01:25:32.376819+0000","last_clean":"2023-05-10T01:25:32.376819+0000","last_became_active":"2023-05-10T01:25:32.371753+0000","last_became_peered":"2023-05-10T01:25:32.371753+0000","last_unstale":"2023-05-10T01:25:32.376819+0000","last_undegraded":"2023-05-10T01:25:32.376819+0000","last_fullsized":"2023-05-10T01:25:32.376819+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353308+0000","last_change":"2023-05-10T01:25:31.969920+0000","last_active":"2023-05-10T01:25:32.353308+0000","last_peered":"2023-05-10T01:25:32.353308+0000","last_clean":"2023-05-10T01:25:32.353308+0000","last_became_active":"2023-05-10T01:25:31.969667+0000","last_became_peered":"2023-05-10T01:25:31.969667+0000","last_unstale":"2023-05-10T01:25:32.353308+0000","last_undegraded":"2023-05-10T01:25:32.353308+0000","last_fullsized":"2023-05-10T01:25:32.353308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365341+0000","last_change":"2023-05-10T01:25:32.360107+0000","last_active":"2023-05-10T01:25:32.365341+0000","last_peered":"2023-05-10T01:25:32.365341+0000","last_clean":"2023-05-10T01:25:32.365341+0000","last_became_active":"2023-05-10T01:25:32.359824+0000","last_became_peered":"2023-05-10T01:25:32.359824+0000","last_unstale":"2023-05-10T01:25:32.365341+0000","last_undegraded":"2023-05-10T01:25:32.365341+0000","last_fullsized":"2023-05-10T01:25:32.365341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349439+0000","last_change":"2023-05-10T01:25:31.976138+0000","last_active":"2023-05-10T01:25:32.349439+0000","last_peered":"2023-05-10T01:25:32.349439+0000","last_clean":"2023-05-10T01:25:32.349439+0000","last_became_active":"2023-05-10T01:25:31.975542+0000","last_became_peered":"2023-05-10T01:25:31.975542+0000","last_unstale":"2023-05-10T01:25:32.349439+0000","last_undegraded":"2023-05-10T01:25:32.349439+0000","last_fullsized":"2023-05-10T01:25:32.349439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374644+0000","last_change":"2023-05-10T01:25:32.373032+0000","last_active":"2023-05-10T01:25:32.374644+0000","last_peered":"2023-05-10T01:25:32.374644+0000","last_clean":"2023-05-10T01:25:32.374644+0000","last_became_active":"2023-05-10T01:25:32.372770+0000","last_became_peered":"2023-05-10T01:25:32.372770+0000","last_unstale":"2023-05-10T01:25:32.374644+0000","last_undegraded":"2023-05-10T01:25:32.374644+0000","last_fullsized":"2023-05-10T01:25:32.374644+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376335+0000","last_change":"2023-05-10T01:25:32.369001+0000","last_active":"2023-05-10T01:25:32.376335+0000","last_peered":"2023-05-10T01:25:32.376335+0000","last_clean":"2023-05-10T01:25:32.376335+0000","last_became_active":"2023-05-10T01:25:32.368656+0000","last_became_peered":"2023-05-10T01:25:32.368656+0000","last_unstale":"2023-05-10T01:25:32.376335+0000","last_undegraded":"2023-05-10T01:25:32.376335+0000","last_fullsized":"2023-05-10T01:25:32.376335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356938+0000","last_change":"2023-05-10T01:25:31.966263+0000","last_active":"2023-05-10T01:25:32.356938+0000","last_peered":"2023-05-10T01:25:32.356938+0000","last_clean":"2023-05-10T01:25:32.356938+0000","last_became_active":"2023-05-10T01:25:31.965960+0000","last_became_peered":"2023-05-10T01:25:31.965960+0000","last_unstale":"2023-05-10T01:25:32.356938+0000","last_undegraded":"2023-05-10T01:25:32.356938+0000","last_fullsized":"2023-05-10T01:25:32.356938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364429+0000","last_change":"2023-05-10T01:25:32.355599+0000","last_active":"2023-05-10T01:25:32.364429+0000","last_peered":"2023-05-10T01:25:32.364429+0000","last_clean":"2023-05-10T01:25:32.364429+0000","last_became_active":"2023-05-10T01:25:32.355323+0000","last_became_peered":"2023-05-10T01:25:32.355323+0000","last_unstale":"2023-05-10T01:25:32.364429+0000","last_undegraded":"2023-05-10T01:25:32.364429+0000","last_fullsized":"2023-05-10T01:25:32.364429+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349588+0000","last_change":"2023-05-10T01:25:31.975172+0000","last_active":"2023-05-10T01:25:32.349588+0000","last_peered":"2023-05-10T01:25:32.349588+0000","last_clean":"2023-05-10T01:25:32.349588+0000","last_became_active":"2023-05-10T01:25:31.974835+0000","last_became_peered":"2023-05-10T01:25:31.974835+0000","last_unstale":"2023-05-10T01:25:32.349588+0000","last_undegraded":"2023-05-10T01:25:32.349588+0000","last_fullsized":"2023-05-10T01:25:32.349588+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351477+0000","last_change":"2023-05-10T01:25:31.970025+0000","last_active":"2023-05-10T01:25:32.351477+0000","last_peered":"2023-05-10T01:25:32.351477+0000","last_clean":"2023-05-10T01:25:32.351477+0000","last_became_active":"2023-05-10T01:25:31.969551+0000","last_became_peered":"2023-05-10T01:25:31.969551+0000","last_unstale":"2023-05-10T01:25:32.351477+0000","last_undegraded":"2023-05-10T01:25:32.351477+0000","last_fullsized":"2023-05-10T01:25:32.351477+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376740+0000","last_change":"2023-05-10T01:25:32.369898+0000","last_active":"2023-05-10T01:25:32.376740+0000","last_peered":"2023-05-10T01:25:32.376740+0000","last_clean":"2023-05-10T01:25:32.376740+0000","last_became_active":"2023-05-10T01:25:32.369619+0000","last_became_peered":"2023-05-10T01:25:32.369619+0000","last_unstale":"2023-05-10T01:25:32.376740+0000","last_undegraded":"2023-05-10T01:25:32.376740+0000","last_fullsized":"2023-05-10T01:25:32.376740+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352932+0000","last_change":"2023-05-10T01:25:31.969673+0000","last_active":"2023-05-10T01:25:32.352932+0000","last_peered":"2023-05-10T01:25:32.352932+0000","last_clean":"2023-05-10T01:25:32.352932+0000","last_became_active":"2023-05-10T01:25:31.969390+0000","last_became_peered":"2023-05-10T01:25:31.969390+0000","last_unstale":"2023-05-10T01:25:32.352932+0000","last_undegraded":"2023-05-10T01:25:32.352932+0000","last_fullsized":"2023-05-10T01:25:32.352932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364760+0000","last_change":"2023-05-10T01:25:32.357255+0000","last_active":"2023-05-10T01:25:32.364760+0000","last_peered":"2023-05-10T01:25:32.364760+0000","last_clean":"2023-05-10T01:25:32.364760+0000","last_became_active":"2023-05-10T01:25:32.356612+0000","last_became_peered":"2023-05-10T01:25:32.356612+0000","last_unstale":"2023-05-10T01:25:32.364760+0000","last_undegraded":"2023-05-10T01:25:32.364760+0000","last_fullsized":"2023-05-10T01:25:32.364760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364316+0000","last_change":"2023-05-10T01:25:32.358354+0000","last_active":"2023-05-10T01:25:32.364316+0000","last_peered":"2023-05-10T01:25:32.364316+0000","last_clean":"2023-05-10T01:25:32.364316+0000","last_became_active":"2023-05-10T01:25:32.358100+0000","last_became_peered":"2023-05-10T01:25:32.358100+0000","last_unstale":"2023-05-10T01:25:32.364316+0000","last_undegraded":"2023-05-10T01:25:32.364316+0000","last_fullsized":"2023-05-10T01:25:32.364316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370725+0000","last_change":"2023-05-10T01:25:31.964658+0000","last_active":"2023-05-10T01:25:32.370725+0000","last_peered":"2023-05-10T01:25:32.370725+0000","last_clean":"2023-05-10T01:25:32.370725+0000","last_became_active":"2023-05-10T01:25:31.964396+0000","last_became_peered":"2023-05-10T01:25:31.964396+0000","last_unstale":"2023-05-10T01:25:32.370725+0000","last_undegraded":"2023-05-10T01:25:32.370725+0000","last_fullsized":"2023-05-10T01:25:32.370725+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373788+0000","last_change":"2023-05-10T01:25:32.372782+0000","last_active":"2023-05-10T01:25:32.373788+0000","last_peered":"2023-05-10T01:25:32.373788+0000","last_clean":"2023-05-10T01:25:32.373788+0000","last_became_active":"2023-05-10T01:25:32.372495+0000","last_became_peered":"2023-05-10T01:25:32.372495+0000","last_unstale":"2023-05-10T01:25:32.373788+0000","last_undegraded":"2023-05-10T01:25:32.373788+0000","last_fullsized":"2023-05-10T01:25:32.373788+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368627+0000","last_change":"2023-05-10T01:25:32.363765+0000","last_active":"2023-05-10T01:25:32.368627+0000","last_peered":"2023-05-10T01:25:32.368627+0000","last_clean":"2023-05-10T01:25:32.368627+0000","last_became_active":"2023-05-10T01:25:32.363478+0000","last_became_peered":"2023-05-10T01:25:32.363478+0000","last_unstale":"2023-05-10T01:25:32.368627+0000","last_undegraded":"2023-05-10T01:25:32.368627+0000","last_fullsized":"2023-05-10T01:25:32.368627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353472+0000","last_change":"2023-05-10T01:25:31.965616+0000","last_active":"2023-05-10T01:25:32.353472+0000","last_peered":"2023-05-10T01:25:32.353472+0000","last_clean":"2023-05-10T01:25:32.353472+0000","last_became_active":"2023-05-10T01:25:31.965290+0000","last_became_peered":"2023-05-10T01:25:31.965290+0000","last_unstale":"2023-05-10T01:25:32.353472+0000","last_undegraded":"2023-05-10T01:25:32.353472+0000","last_fullsized":"2023-05-10T01:25:32.353472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350534+0000","last_change":"2023-05-10T01:25:31.969840+0000","last_active":"2023-05-10T01:25:32.350534+0000","last_peered":"2023-05-10T01:25:32.350534+0000","last_clean":"2023-05-10T01:25:32.350534+0000","last_became_active":"2023-05-10T01:25:31.969152+0000","last_became_peered":"2023-05-10T01:25:31.969152+0000","last_unstale":"2023-05-10T01:25:32.350534+0000","last_undegraded":"2023-05-10T01:25:32.350534+0000","last_fullsized":"2023-05-10T01:25:32.350534+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366836+0000","last_change":"2023-05-10T01:25:32.363757+0000","last_active":"2023-05-10T01:25:32.366836+0000","last_peered":"2023-05-10T01:25:32.366836+0000","last_clean":"2023-05-10T01:25:32.366836+0000","last_became_active":"2023-05-10T01:25:32.363316+0000","last_became_peered":"2023-05-10T01:25:32.363316+0000","last_unstale":"2023-05-10T01:25:32.366836+0000","last_undegraded":"2023-05-10T01:25:32.366836+0000","last_fullsized":"2023-05-10T01:25:32.366836+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352830+0000","last_change":"2023-05-10T01:25:31.964677+0000","last_active":"2023-05-10T01:25:32.352830+0000","last_peered":"2023-05-10T01:25:32.352830+0000","last_clean":"2023-05-10T01:25:32.352830+0000","last_became_active":"2023-05-10T01:25:31.964357+0000","last_became_peered":"2023-05-10T01:25:31.964357+0000","last_unstale":"2023-05-10T01:25:32.352830+0000","last_undegraded":"2023-05-10T01:25:32.352830+0000","last_fullsized":"2023-05-10T01:25:32.352830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371284+0000","last_change":"2023-05-10T01:25:32.370504+0000","last_active":"2023-05-10T01:25:32.371284+0000","last_peered":"2023-05-10T01:25:32.371284+0000","last_clean":"2023-05-10T01:25:32.371284+0000","last_became_active":"2023-05-10T01:25:32.370218+0000","last_became_peered":"2023-05-10T01:25:32.370218+0000","last_unstale":"2023-05-10T01:25:32.371284+0000","last_undegraded":"2023-05-10T01:25:32.371284+0000","last_fullsized":"2023-05-10T01:25:32.371284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366998+0000","last_change":"2023-05-10T01:25:32.363317+0000","last_active":"2023-05-10T01:25:32.366998+0000","last_peered":"2023-05-10T01:25:32.366998+0000","last_clean":"2023-05-10T01:25:32.366998+0000","last_became_active":"2023-05-10T01:25:32.362892+0000","last_became_peered":"2023-05-10T01:25:32.362892+0000","last_unstale":"2023-05-10T01:25:32.366998+0000","last_undegraded":"2023-05-10T01:25:32.366998+0000","last_fullsized":"2023-05-10T01:25:32.366998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353420+0000","last_change":"2023-05-10T01:25:31.978033+0000","last_active":"2023-05-10T01:25:32.353420+0000","last_peered":"2023-05-10T01:25:32.353420+0000","last_clean":"2023-05-10T01:25:32.353420+0000","last_became_active":"2023-05-10T01:25:31.977683+0000","last_became_peered":"2023-05-10T01:25:31.977683+0000","last_unstale":"2023-05-10T01:25:32.353420+0000","last_undegraded":"2023-05-10T01:25:32.353420+0000","last_fullsized":"2023-05-10T01:25:32.353420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363570+0000","last_change":"2023-05-10T01:25:32.361937+0000","last_active":"2023-05-10T01:25:32.363570+0000","last_peered":"2023-05-10T01:25:32.363570+0000","last_clean":"2023-05-10T01:25:32.363570+0000","last_became_active":"2023-05-10T01:25:32.361656+0000","last_became_peered":"2023-05-10T01:25:32.361656+0000","last_unstale":"2023-05-10T01:25:32.363570+0000","last_undegraded":"2023-05-10T01:25:32.363570+0000","last_fullsized":"2023-05-10T01:25:32.363570+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.369356+0000","last_change":"2023-05-10T01:25:31.970229+0000","last_active":"2023-05-10T01:25:32.369356+0000","last_peered":"2023-05-10T01:25:32.369356+0000","last_clean":"2023-05-10T01:25:32.369356+0000","last_became_active":"2023-05-10T01:25:31.969792+0000","last_became_peered":"2023-05-10T01:25:31.969792+0000","last_unstale":"2023-05-10T01:25:32.369356+0000","last_undegraded":"2023-05-10T01:25:32.369356+0000","last_fullsized":"2023-05-10T01:25:32.369356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370768+0000","last_change":"2023-05-10T01:25:32.369554+0000","last_active":"2023-05-10T01:25:32.370768+0000","last_peered":"2023-05-10T01:25:32.370768+0000","last_clean":"2023-05-10T01:25:32.370768+0000","last_became_active":"2023-05-10T01:25:32.369128+0000","last_became_peered":"2023-05-10T01:25:32.369128+0000","last_unstale":"2023-05-10T01:25:32.370768+0000","last_undegraded":"2023-05-10T01:25:32.370768+0000","last_fullsized":"2023-05-10T01:25:32.370768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368771+0000","last_change":"2023-05-10T01:25:31.965952+0000","last_active":"2023-05-10T01:25:32.368771+0000","last_peered":"2023-05-10T01:25:32.368771+0000","last_clean":"2023-05-10T01:25:32.368771+0000","last_became_active":"2023-05-10T01:25:31.965197+0000","last_became_peered":"2023-05-10T01:25:31.965197+0000","last_unstale":"2023-05-10T01:25:32.368771+0000","last_undegraded":"2023-05-10T01:25:32.368771+0000","last_fullsized":"2023-05-10T01:25:32.368771+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373623+0000","last_change":"2023-05-10T01:25:32.372333+0000","last_active":"2023-05-10T01:25:32.373623+0000","last_peered":"2023-05-10T01:25:32.373623+0000","last_clean":"2023-05-10T01:25:32.373623+0000","last_became_active":"2023-05-10T01:25:32.372045+0000","last_became_peered":"2023-05-10T01:25:32.372045+0000","last_unstale":"2023-05-10T01:25:32.373623+0000","last_undegraded":"2023-05-10T01:25:32.373623+0000","last_fullsized":"2023-05-10T01:25:32.373623+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376801+0000","last_change":"2023-05-10T01:25:32.373164+0000","last_active":"2023-05-10T01:25:32.376801+0000","last_peered":"2023-05-10T01:25:32.376801+0000","last_clean":"2023-05-10T01:25:32.376801+0000","last_became_active":"2023-05-10T01:25:32.372876+0000","last_became_peered":"2023-05-10T01:25:32.372876+0000","last_unstale":"2023-05-10T01:25:32.376801+0000","last_undegraded":"2023-05-10T01:25:32.376801+0000","last_fullsized":"2023-05-10T01:25:32.376801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.346366+0000","last_change":"2023-05-10T01:25:31.963088+0000","last_active":"2023-05-10T01:25:32.346366+0000","last_peered":"2023-05-10T01:25:32.346366+0000","last_clean":"2023-05-10T01:25:32.346366+0000","last_became_active":"2023-05-10T01:25:31.962304+0000","last_became_peered":"2023-05-10T01:25:31.962304+0000","last_unstale":"2023-05-10T01:25:32.346366+0000","last_undegraded":"2023-05-10T01:25:32.346366+0000","last_fullsized":"2023-05-10T01:25:32.346366+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364353+0000","last_change":"2023-05-10T01:25:32.363444+0000","last_active":"2023-05-10T01:25:32.364353+0000","last_peered":"2023-05-10T01:25:32.364353+0000","last_clean":"2023-05-10T01:25:32.364353+0000","last_became_active":"2023-05-10T01:25:32.363205+0000","last_became_peered":"2023-05-10T01:25:32.363205+0000","last_unstale":"2023-05-10T01:25:32.364353+0000","last_undegraded":"2023-05-10T01:25:32.364353+0000","last_fullsized":"2023-05-10T01:25:32.364353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348946+0000","last_change":"2023-05-10T01:25:31.973667+0000","last_active":"2023-05-10T01:25:32.348946+0000","last_peered":"2023-05-10T01:25:32.348946+0000","last_clean":"2023-05-10T01:25:32.348946+0000","last_became_active":"2023-05-10T01:25:31.973364+0000","last_became_peered":"2023-05-10T01:25:31.973364+0000","last_unstale":"2023-05-10T01:25:32.348946+0000","last_undegraded":"2023-05-10T01:25:32.348946+0000","last_fullsized":"2023-05-10T01:25:32.348946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363667+0000","last_change":"2023-05-10T01:25:32.360888+0000","last_active":"2023-05-10T01:25:32.363667+0000","last_peered":"2023-05-10T01:25:32.363667+0000","last_clean":"2023-05-10T01:25:32.363667+0000","last_became_active":"2023-05-10T01:25:32.360630+0000","last_became_peered":"2023-05-10T01:25:32.360630+0000","last_unstale":"2023-05-10T01:25:32.363667+0000","last_undegraded":"2023-05-10T01:25:32.363667+0000","last_fullsized":"2023-05-10T01:25:32.363667+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365017+0000","last_change":"2023-05-10T01:25:31.973649+0000","last_active":"2023-05-10T01:25:32.365017+0000","last_peered":"2023-05-10T01:25:32.365017+0000","last_clean":"2023-05-10T01:25:32.365017+0000","last_became_active":"2023-05-10T01:25:31.973312+0000","last_became_peered":"2023-05-10T01:25:31.973312+0000","last_unstale":"2023-05-10T01:25:32.365017+0000","last_undegraded":"2023-05-10T01:25:32.365017+0000","last_fullsized":"2023-05-10T01:25:32.365017+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368792+0000","last_change":"2023-05-10T01:25:32.367931+0000","last_active":"2023-05-10T01:25:32.368792+0000","last_peered":"2023-05-10T01:25:32.368792+0000","last_clean":"2023-05-10T01:25:32.368792+0000","last_became_active":"2023-05-10T01:25:32.366029+0000","last_became_peered":"2023-05-10T01:25:32.366029+0000","last_unstale":"2023-05-10T01:25:32.368792+0000","last_undegraded":"2023-05-10T01:25:32.368792+0000","last_fullsized":"2023-05-10T01:25:32.368792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.355466+0000","last_change":"2023-05-10T01:25:31.959959+0000","last_active":"2023-05-10T01:25:32.355466+0000","last_peered":"2023-05-10T01:25:32.355466+0000","last_clean":"2023-05-10T01:25:32.355466+0000","last_became_active":"2023-05-10T01:25:31.959662+0000","last_became_peered":"2023-05-10T01:25:31.959662+0000","last_unstale":"2023-05-10T01:25:32.355466+0000","last_undegraded":"2023-05-10T01:25:32.355466+0000","last_fullsized":"2023-05-10T01:25:32.355466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364206+0000","last_change":"2023-05-10T01:25:32.358333+0000","last_active":"2023-05-10T01:25:32.364206+0000","last_peered":"2023-05-10T01:25:32.364206+0000","last_clean":"2023-05-10T01:25:32.364206+0000","last_became_active":"2023-05-10T01:25:32.357905+0000","last_became_peered":"2023-05-10T01:25:32.357905+0000","last_unstale":"2023-05-10T01:25:32.364206+0000","last_undegraded":"2023-05-10T01:25:32.364206+0000","last_fullsized":"2023-05-10T01:25:32.364206+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356826+0000","last_change":"2023-05-10T01:25:31.970051+0000","last_active":"2023-05-10T01:25:32.356826+0000","last_peered":"2023-05-10T01:25:32.356826+0000","last_clean":"2023-05-10T01:25:32.356826+0000","last_became_active":"2023-05-10T01:25:31.969424+0000","last_became_peered":"2023-05-10T01:25:31.969424+0000","last_unstale":"2023-05-10T01:25:32.356826+0000","last_undegraded":"2023-05-10T01:25:32.356826+0000","last_fullsized":"2023-05-10T01:25:32.356826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367302+0000","last_change":"2023-05-10T01:25:32.364606+0000","last_active":"2023-05-10T01:25:32.367302+0000","last_peered":"2023-05-10T01:25:32.367302+0000","last_clean":"2023-05-10T01:25:32.367302+0000","last_became_active":"2023-05-10T01:25:32.364291+0000","last_became_peered":"2023-05-10T01:25:32.364291+0000","last_unstale":"2023-05-10T01:25:32.367302+0000","last_undegraded":"2023-05-10T01:25:32.367302+0000","last_fullsized":"2023-05-10T01:25:32.367302+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.347325+0000","last_change":"2023-05-10T01:25:31.962288+0000","last_active":"2023-05-10T01:25:32.347325+0000","last_peered":"2023-05-10T01:25:32.347325+0000","last_clean":"2023-05-10T01:25:32.347325+0000","last_became_active":"2023-05-10T01:25:31.961985+0000","last_became_peered":"2023-05-10T01:25:31.961985+0000","last_unstale":"2023-05-10T01:25:32.347325+0000","last_undegraded":"2023-05-10T01:25:32.347325+0000","last_fullsized":"2023-05-10T01:25:32.347325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367599+0000","last_change":"2023-05-10T01:25:32.363926+0000","last_active":"2023-05-10T01:25:32.367599+0000","last_peered":"2023-05-10T01:25:32.367599+0000","last_clean":"2023-05-10T01:25:32.367599+0000","last_became_active":"2023-05-10T01:25:32.363672+0000","last_became_peered":"2023-05-10T01:25:32.363672+0000","last_unstale":"2023-05-10T01:25:32.367599+0000","last_undegraded":"2023-05-10T01:25:32.367599+0000","last_fullsized":"2023-05-10T01:25:32.367599+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364085+0000","last_change":"2023-05-10T01:25:32.356942+0000","last_active":"2023-05-10T01:25:32.364085+0000","last_peered":"2023-05-10T01:25:32.364085+0000","last_clean":"2023-05-10T01:25:32.364085+0000","last_became_active":"2023-05-10T01:25:32.356494+0000","last_became_peered":"2023-05-10T01:25:32.356494+0000","last_unstale":"2023-05-10T01:25:32.364085+0000","last_undegraded":"2023-05-10T01:25:32.364085+0000","last_fullsized":"2023-05-10T01:25:32.364085+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368781+0000","last_change":"2023-05-10T01:25:32.367401+0000","last_active":"2023-05-10T01:25:32.368781+0000","last_peered":"2023-05-10T01:25:32.368781+0000","last_clean":"2023-05-10T01:25:32.368781+0000","last_became_active":"2023-05-10T01:25:32.365781+0000","last_became_peered":"2023-05-10T01:25:32.365781+0000","last_unstale":"2023-05-10T01:25:32.368781+0000","last_undegraded":"2023-05-10T01:25:32.368781+0000","last_fullsized":"2023-05-10T01:25:32.368781+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351319+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:25:32.351319+0000","last_peered":"2023-05-10T01:25:32.351319+0000","last_clean":"2023-05-10T01:25:32.351319+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:25:32.351319+0000","last_undegraded":"2023-05-10T01:25:32.351319+0000","last_fullsized":"2023-05-10T01:25:32.351319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364856+0000","last_change":"2023-05-10T01:25:32.358939+0000","last_active":"2023-05-10T01:25:32.364856+0000","last_peered":"2023-05-10T01:25:32.364856+0000","last_clean":"2023-05-10T01:25:32.364856+0000","last_became_active":"2023-05-10T01:25:32.358631+0000","last_became_peered":"2023-05-10T01:25:32.358631+0000","last_unstale":"2023-05-10T01:25:32.364856+0000","last_undegraded":"2023-05-10T01:25:32.364856+0000","last_fullsized":"2023-05-10T01:25:32.364856+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356583+0000","last_change":"2023-05-10T01:25:31.967422+0000","last_active":"2023-05-10T01:25:32.356583+0000","last_peered":"2023-05-10T01:25:32.356583+0000","last_clean":"2023-05-10T01:25:32.356583+0000","last_became_active":"2023-05-10T01:25:31.967094+0000","last_became_peered":"2023-05-10T01:25:31.967094+0000","last_unstale":"2023-05-10T01:25:32.356583+0000","last_undegraded":"2023-05-10T01:25:32.356583+0000","last_fullsized":"2023-05-10T01:25:32.356583+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607157+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:25:27.607157+0000","last_peered":"2023-05-10T01:25:27.607157+0000","last_clean":"2023-05-10T01:25:27.607157+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:25:27.607157+0000","last_undegraded":"2023-05-10T01:25:27.607157+0000","last_fullsized":"2023-05-10T01:25:27.607157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353073+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:25:32.353073+0000","last_peered":"2023-05-10T01:25:32.353073+0000","last_clean":"2023-05-10T01:25:32.353073+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:25:32.353073+0000","last_undegraded":"2023-05-10T01:25:32.353073+0000","last_fullsized":"2023-05-10T01:25:32.353073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351244+0000","last_change":"2023-05-10T01:25:31.968267+0000","last_active":"2023-05-10T01:25:32.351244+0000","last_peered":"2023-05-10T01:25:32.351244+0000","last_clean":"2023-05-10T01:25:32.351244+0000","last_became_active":"2023-05-10T01:25:31.966814+0000","last_became_peered":"2023-05-10T01:25:31.966814+0000","last_unstale":"2023-05-10T01:25:32.351244+0000","last_undegraded":"2023-05-10T01:25:32.351244+0000","last_fullsized":"2023-05-10T01:25:32.351244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607129+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:25:27.607129+0000","last_peered":"2023-05-10T01:25:27.607129+0000","last_clean":"2023-05-10T01:25:27.607129+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:25:27.607129+0000","last_undegraded":"2023-05-10T01:25:27.607129+0000","last_fullsized":"2023-05-10T01:25:27.607129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607336+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:25:27.607336+0000","last_peered":"2023-05-10T01:25:27.607336+0000","last_clean":"2023-05-10T01:25:27.607336+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:25:27.607336+0000","last_undegraded":"2023-05-10T01:25:27.607336+0000","last_fullsized":"2023-05-10T01:25:27.607336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364782+0000","last_change":"2023-05-10T01:25:32.357437+0000","last_active":"2023-05-10T01:25:32.364782+0000","last_peered":"2023-05-10T01:25:32.364782+0000","last_clean":"2023-05-10T01:25:32.364782+0000","last_became_active":"2023-05-10T01:25:32.356962+0000","last_became_peered":"2023-05-10T01:25:32.356962+0000","last_unstale":"2023-05-10T01:25:32.364782+0000","last_undegraded":"2023-05-10T01:25:32.364782+0000","last_fullsized":"2023-05-10T01:25:32.364782+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607322+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:25:27.607322+0000","last_peered":"2023-05-10T01:25:27.607322+0000","last_clean":"2023-05-10T01:25:27.607322+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:25:27.607322+0000","last_undegraded":"2023-05-10T01:25:27.607322+0000","last_fullsized":"2023-05-10T01:25:27.607322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353491+0000","last_change":"2023-05-10T01:25:31.979873+0000","last_active":"2023-05-10T01:25:32.353491+0000","last_peered":"2023-05-10T01:25:32.353491+0000","last_clean":"2023-05-10T01:25:32.353491+0000","last_became_active":"2023-05-10T01:25:31.979377+0000","last_became_peered":"2023-05-10T01:25:31.979377+0000","last_unstale":"2023-05-10T01:25:32.353491+0000","last_undegraded":"2023-05-10T01:25:32.353491+0000","last_fullsized":"2023-05-10T01:25:32.353491+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607337+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:25:27.607337+0000","last_peered":"2023-05-10T01:25:27.607337+0000","last_clean":"2023-05-10T01:25:27.607337+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:25:27.607337+0000","last_undegraded":"2023-05-10T01:25:27.607337+0000","last_fullsized":"2023-05-10T01:25:27.607337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349006+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:25:32.349006+0000","last_peered":"2023-05-10T01:25:32.349006+0000","last_clean":"2023-05-10T01:25:32.349006+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:25:32.349006+0000","last_undegraded":"2023-05-10T01:25:32.349006+0000","last_fullsized":"2023-05-10T01:25:32.349006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364064+0000","last_change":"2023-05-10T01:25:32.356772+0000","last_active":"2023-05-10T01:25:32.364064+0000","last_peered":"2023-05-10T01:25:32.364064+0000","last_clean":"2023-05-10T01:25:32.364064+0000","last_became_active":"2023-05-10T01:25:32.356119+0000","last_became_peered":"2023-05-10T01:25:32.356119+0000","last_unstale":"2023-05-10T01:25:32.364064+0000","last_undegraded":"2023-05-10T01:25:32.364064+0000","last_fullsized":"2023-05-10T01:25:32.364064+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353407+0000","last_change":"2023-05-10T01:25:31.965743+0000","last_active":"2023-05-10T01:25:32.353407+0000","last_peered":"2023-05-10T01:25:32.353407+0000","last_clean":"2023-05-10T01:25:32.353407+0000","last_became_active":"2023-05-10T01:25:31.964905+0000","last_became_peered":"2023-05-10T01:25:31.964905+0000","last_unstale":"2023-05-10T01:25:32.353407+0000","last_undegraded":"2023-05-10T01:25:32.353407+0000","last_fullsized":"2023-05-10T01:25:32.353407+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607549+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:25:27.607549+0000","last_peered":"2023-05-10T01:25:27.607549+0000","last_clean":"2023-05-10T01:25:27.607549+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:25:27.607549+0000","last_undegraded":"2023-05-10T01:25:27.607549+0000","last_fullsized":"2023-05-10T01:25:27.607549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":74,"acting":74,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17832,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354008,"statfs":{"total":96636764160,"available":96618504192,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.79900000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98199999999999998},"last":0.63}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":3.016,"15min":3.016},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.93300000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.69399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.85899999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.753,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.436},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.751,"15min":0.78000000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":1.052},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.95899999999999996},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17192,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354648,"statfs":{"total":96636764160,"available":96619159552,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.753}]},{"osd":2,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":1.159},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.84799999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.321},"last":0.73599999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.88},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21464,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":20160,"kb_avail":94350376,"statfs":{"total":96636764160,"available":96614785024,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20643840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.22},"max":{"1min":0.39700000000000002,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":0.39200000000000002,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46600000000000003,"15min":0.48699999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.51800000000000002,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56699999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":0.92000000000000004,"15min":1.117},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.623,"15min":0.64300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78100000000000003,"5min":0.95299999999999996,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64100000000000001,"15min":0.65600000000000003},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":1.319},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76800000000000002,"5min":0.97799999999999998,"15min":1.079},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17132,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354708,"statfs":{"total":96636764160,"available":96619220992,"internally_reserved":0,"allocated":1347584,"data_stored":672059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.753}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22616,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":21312,"kb_avail":94349224,"statfs":{"total":96636764160,"available":96613605376,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21823488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.47099999999999997,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.50900000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.53100000000000003,"5min":0.63300000000000001,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.75},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":1.008},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.94199999999999995,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.94799999999999995,"15min":1.056},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25440,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346400,"statfs":{"total":96636764160,"available":96610713600,"internally_reserved":0,"allocated":1335296,"data_stored":672183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.378},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17696,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354144,"statfs":{"total":96636764160,"available":96618643456,"internally_reserved":0,"allocated":1335296,"data_stored":671865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20712,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":19456,"kb_avail":94351128,"statfs":{"total":96636764160,"available":96615555072,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19922944},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.80000000000000004}]},{"osd":1,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.64800000000000002,"5min":0.79800000000000004,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58599999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67300000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":1.0620000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:36.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:36.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.898+0000 7f82ae92f700 1 Processor -- start 2023-05-10T01:25:36.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.898+0000 7f82ae92f700 1 -- start start 2023-05-10T01:25:36.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae92f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80c76d0 0x7f82a80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae92f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82a8153f20 0x7f82a80a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae92f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a81588f0 con 0x7f82a80a9b60 2023-05-10T01:25:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae92f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a8157ce0 con 0x7f82a8153f20 2023-05-10T01:25:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae92f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8157fc0 con 0x7f82a80c76d0 2023-05-10T01:25:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82a8153f20 0x7f82a80a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f82a8153f20 0x7f82a80a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37282/0 (socket says 172.21.15.52:37282) 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 -- 172.21.15.52:0/3185047949 learned_addr learned my addr 172.21.15.52:0/3185047949 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ad92d700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80c76d0 0x7f82a80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 -- 172.21.15.52:0/3185047949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80c76d0 msgr2=0x7f82a80c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80c76d0 0x7f82a80c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 -- 172.21.15.52:0/3185047949 >> v1:172.21.15.52:6789/0 conn(0x7f82a80a9b60 legacy=0x7f82a8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 -- 172.21.15.52:0/3185047949 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a81582a0 con 0x7f82a8153f20 2023-05-10T01:25:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.899+0000 7f82ae12e700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a8153f20 0x7f82a80a9fc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f82a4006fd0 tx=0x7f82a40090f0).ready entity=mon.0 client_cookie=2e4f1e3b5f57e280 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ac92b700 1 -- 172.21.15.52:0/3185047949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400b580 con 0x7f82a8153f20 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ac92b700 1 -- 172.21.15.52:0/3185047949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a400b6e0 con 0x7f82a8153f20 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ac92b700 1 -- 172.21.15.52:0/3185047949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400ba60 con 0x7f82a8153f20 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 -- 172.21.15.52:0/3185047949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a8153f20 msgr2=0x7f82a80a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a8153f20 0x7f82a80a9fc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f82a4006fd0 tx=0x7f82a40090f0).stop 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 -- 172.21.15.52:0/3185047949 shutdown_connections 2023-05-10T01:25:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a8153f20 0x7f82a80a9fc0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 --2- 172.21.15.52:0/3185047949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80c76d0 0x7f82a80c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 -- 172.21.15.52:0/3185047949 >> 172.21.15.52:0/3185047949 conn(0x7f82a8068320 msgr2=0x7f82a8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 -- 172.21.15.52:0/3185047949 shutdown_connections 2023-05-10T01:25:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.900+0000 7f82ae92f700 1 -- 172.21.15.52:0/3185047949 wait complete. 2023-05-10T01:25:36.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.901+0000 7f82ae92f700 1 Processor -- start 2023-05-10T01:25:36.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.901+0000 7f82ae92f700 1 -- start start 2023-05-10T01:25:36.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80c76d0 0x7f82a814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 0x7f82a814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a814d190 con 0x7f82a80a9b60 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8164c40 con 0x7f82a80c76d0 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae92f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a81650d0 con 0x7f82a8153f20 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ad92d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ad92d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37286/0 (socket says 172.21.15.52:37286) 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ad92d700 1 -- 172.21.15.52:0/2769716715 learned_addr learned my addr 172.21.15.52:0/2769716715 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ae12e700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 0x7f82a814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.902+0000 7f82ad12c700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80c76d0 0x7f82a814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 -- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 msgr2=0x7f82a814cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 0x7f82a814cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 -- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80c76d0 msgr2=0x7f82a814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80c76d0 0x7f82a814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 -- 172.21.15.52:0/2769716715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009370 con 0x7f82a80a9b60 2023-05-10T01:25:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ae12e700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 0x7f82a814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ad92d700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f82a0009f10 tx=0x7f82a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000cc80 con 0x7f82a80a9b60 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000f040 con 0x7f82a80a9b60 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a8164310 con 0x7f82a80a9b60 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0013400 con 0x7f82a80a9b60 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.903+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a81648d0 con 0x7f82a80a9b60 2023-05-10T01:25:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.904+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f82a00137b0 con 0x7f82a80a9b60 2023-05-10T01:25:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.905+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a8164f20 con 0x7f82a80a9b60 2023-05-10T01:25:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.905+0000 7f8295ffb700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 0x7f8288061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.905+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f82a007a6f0 con 0x7f82a80a9b60 2023-05-10T01:25:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.905+0000 7f82ad12c700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 0x7f8288061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.905+0000 7f82ad12c700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 0x7f8288061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f82980036d0 tx=0x7f8298009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:36.909+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82a004bb80 con 0x7f82a80a9b60 2023-05-10T01:25:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.076+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82a8158580 con 0x7f828805ed90 2023-05-10T01:25:37.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.086+0000 7f8295ffb700 1 -- 172.21.15.52:0/2769716715 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357325 (secure 0 0 0) 0x7f82a8158580 con 0x7f828805ed90 2023-05-10T01:25:37.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:37.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 msgr2=0x7f8288061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 0x7f8288061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f82980036d0 tx=0x7f8298009040).stop 2023-05-10T01:25:37.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 msgr2=0x7f82a81476b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f82a0009f10 tx=0x7f82a000b040).stop 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 shutdown_connections 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f828805ed90 0x7f8288061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a8153f20 0x7f82a814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82a80a9b60 0x7f82a81476b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 --2- 172.21.15.52:0/2769716715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80c76d0 0x7f82a814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 >> 172.21.15.52:0/2769716715 conn(0x7f82a8068320 msgr2=0x7f82a80c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 shutdown_connections 2023-05-10T01:25:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.089+0000 7f82ae92f700 1 -- 172.21.15.52:0/2769716715 wait complete. 2023-05-10T01:25:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:37.104 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:25:35.759626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":160084,"kb_used_data":10260,"kb_used_omap":0,"kb_used_meta":149760,"kb_avail":754814636,"statfs":{"total":773094113280,"available":772930187264,"internally_reserved":0,"allocated":10506240,"data_stored":5288695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":153354240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4753,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.161753"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374548+0000","last_change":"2023-05-10T01:25:32.373091+0000","last_active":"2023-05-10T01:25:32.374548+0000","last_peered":"2023-05-10T01:25:32.374548+0000","last_clean":"2023-05-10T01:25:32.374548+0000","last_became_active":"2023-05-10T01:25:32.372806+0000","last_became_peered":"2023-05-10T01:25:32.372806+0000","last_unstale":"2023-05-10T01:25:32.374548+0000","last_undegraded":"2023-05-10T01:25:32.374548+0000","last_fullsized":"2023-05-10T01:25:32.374548+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367714+0000","last_change":"2023-05-10T01:25:32.365148+0000","last_active":"2023-05-10T01:25:32.367714+0000","last_peered":"2023-05-10T01:25:32.367714+0000","last_clean":"2023-05-10T01:25:32.367714+0000","last_became_active":"2023-05-10T01:25:32.364846+0000","last_became_peered":"2023-05-10T01:25:32.364846+0000","last_unstale":"2023-05-10T01:25:32.367714+0000","last_undegraded":"2023-05-10T01:25:32.367714+0000","last_fullsized":"2023-05-10T01:25:32.367714+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349844+0000","last_change":"2023-05-10T01:25:31.973894+0000","last_active":"2023-05-10T01:25:32.349844+0000","last_peered":"2023-05-10T01:25:32.349844+0000","last_clean":"2023-05-10T01:25:32.349844+0000","last_became_active":"2023-05-10T01:25:31.973604+0000","last_became_peered":"2023-05-10T01:25:31.973604+0000","last_unstale":"2023-05-10T01:25:32.349844+0000","last_undegraded":"2023-05-10T01:25:32.349844+0000","last_fullsized":"2023-05-10T01:25:32.349844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362988+0000","last_change":"2023-05-10T01:25:32.361960+0000","last_active":"2023-05-10T01:25:32.362988+0000","last_peered":"2023-05-10T01:25:32.362988+0000","last_clean":"2023-05-10T01:25:32.362988+0000","last_became_active":"2023-05-10T01:25:32.361503+0000","last_became_peered":"2023-05-10T01:25:32.361503+0000","last_unstale":"2023-05-10T01:25:32.362988+0000","last_undegraded":"2023-05-10T01:25:32.362988+0000","last_fullsized":"2023-05-10T01:25:32.362988+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366401+0000","last_change":"2023-05-10T01:25:31.978897+0000","last_active":"2023-05-10T01:25:32.366401+0000","last_peered":"2023-05-10T01:25:32.366401+0000","last_clean":"2023-05-10T01:25:32.366401+0000","last_became_active":"2023-05-10T01:25:31.978566+0000","last_became_peered":"2023-05-10T01:25:31.978566+0000","last_unstale":"2023-05-10T01:25:32.366401+0000","last_undegraded":"2023-05-10T01:25:32.366401+0000","last_fullsized":"2023-05-10T01:25:32.366401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373604+0000","last_change":"2023-05-10T01:25:32.372259+0000","last_active":"2023-05-10T01:25:32.373604+0000","last_peered":"2023-05-10T01:25:32.373604+0000","last_clean":"2023-05-10T01:25:32.373604+0000","last_became_active":"2023-05-10T01:25:32.371998+0000","last_became_peered":"2023-05-10T01:25:32.371998+0000","last_unstale":"2023-05-10T01:25:32.373604+0000","last_undegraded":"2023-05-10T01:25:32.373604+0000","last_fullsized":"2023-05-10T01:25:32.373604+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368400+0000","last_change":"2023-05-10T01:25:31.968968+0000","last_active":"2023-05-10T01:25:32.368400+0000","last_peered":"2023-05-10T01:25:32.368400+0000","last_clean":"2023-05-10T01:25:32.368400+0000","last_became_active":"2023-05-10T01:25:31.968656+0000","last_became_peered":"2023-05-10T01:25:31.968656+0000","last_unstale":"2023-05-10T01:25:32.368400+0000","last_undegraded":"2023-05-10T01:25:32.368400+0000","last_fullsized":"2023-05-10T01:25:32.368400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366820+0000","last_change":"2023-05-10T01:25:32.363589+0000","last_active":"2023-05-10T01:25:32.366820+0000","last_peered":"2023-05-10T01:25:32.366820+0000","last_clean":"2023-05-10T01:25:32.366820+0000","last_became_active":"2023-05-10T01:25:32.362966+0000","last_became_peered":"2023-05-10T01:25:32.362966+0000","last_unstale":"2023-05-10T01:25:32.366820+0000","last_undegraded":"2023-05-10T01:25:32.366820+0000","last_fullsized":"2023-05-10T01:25:32.366820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353037+0000","last_change":"2023-05-10T01:25:31.972634+0000","last_active":"2023-05-10T01:25:32.353037+0000","last_peered":"2023-05-10T01:25:32.353037+0000","last_clean":"2023-05-10T01:25:32.353037+0000","last_became_active":"2023-05-10T01:25:31.972348+0000","last_became_peered":"2023-05-10T01:25:31.972348+0000","last_unstale":"2023-05-10T01:25:32.353037+0000","last_undegraded":"2023-05-10T01:25:32.353037+0000","last_fullsized":"2023-05-10T01:25:32.353037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376770+0000","last_change":"2023-05-10T01:25:32.371753+0000","last_active":"2023-05-10T01:25:32.376770+0000","last_peered":"2023-05-10T01:25:32.376770+0000","last_clean":"2023-05-10T01:25:32.376770+0000","last_became_active":"2023-05-10T01:25:32.370996+0000","last_became_peered":"2023-05-10T01:25:32.370996+0000","last_unstale":"2023-05-10T01:25:32.376770+0000","last_undegraded":"2023-05-10T01:25:32.376770+0000","last_fullsized":"2023-05-10T01:25:32.376770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363723+0000","last_change":"2023-05-10T01:25:32.361013+0000","last_active":"2023-05-10T01:25:32.363723+0000","last_peered":"2023-05-10T01:25:32.363723+0000","last_clean":"2023-05-10T01:25:32.363723+0000","last_became_active":"2023-05-10T01:25:32.360721+0000","last_became_peered":"2023-05-10T01:25:32.360721+0000","last_unstale":"2023-05-10T01:25:32.363723+0000","last_undegraded":"2023-05-10T01:25:32.363723+0000","last_fullsized":"2023-05-10T01:25:32.363723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372752+0000","last_change":"2023-05-10T01:25:32.367033+0000","last_active":"2023-05-10T01:25:32.372752+0000","last_peered":"2023-05-10T01:25:32.372752+0000","last_clean":"2023-05-10T01:25:32.372752+0000","last_became_active":"2023-05-10T01:25:32.366365+0000","last_became_peered":"2023-05-10T01:25:32.366365+0000","last_unstale":"2023-05-10T01:25:32.372752+0000","last_undegraded":"2023-05-10T01:25:32.372752+0000","last_fullsized":"2023-05-10T01:25:32.372752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363754+0000","last_change":"2023-05-10T01:25:32.360861+0000","last_active":"2023-05-10T01:25:32.363754+0000","last_peered":"2023-05-10T01:25:32.363754+0000","last_clean":"2023-05-10T01:25:32.363754+0000","last_became_active":"2023-05-10T01:25:32.360568+0000","last_became_peered":"2023-05-10T01:25:32.360568+0000","last_unstale":"2023-05-10T01:25:32.363754+0000","last_undegraded":"2023-05-10T01:25:32.363754+0000","last_fullsized":"2023-05-10T01:25:32.363754+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348836+0000","last_change":"2023-05-10T01:25:31.972948+0000","last_active":"2023-05-10T01:25:32.348836+0000","last_peered":"2023-05-10T01:25:32.348836+0000","last_clean":"2023-05-10T01:25:32.348836+0000","last_became_active":"2023-05-10T01:25:31.972633+0000","last_became_peered":"2023-05-10T01:25:31.972633+0000","last_unstale":"2023-05-10T01:25:32.348836+0000","last_undegraded":"2023-05-10T01:25:32.348836+0000","last_fullsized":"2023-05-10T01:25:32.348836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376702+0000","last_change":"2023-05-10T01:25:32.370331+0000","last_active":"2023-05-10T01:25:32.376702+0000","last_peered":"2023-05-10T01:25:32.376702+0000","last_clean":"2023-05-10T01:25:32.376702+0000","last_became_active":"2023-05-10T01:25:32.370062+0000","last_became_peered":"2023-05-10T01:25:32.370062+0000","last_unstale":"2023-05-10T01:25:32.376702+0000","last_undegraded":"2023-05-10T01:25:32.376702+0000","last_fullsized":"2023-05-10T01:25:32.376702+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365971+0000","last_change":"2023-05-10T01:25:32.360582+0000","last_active":"2023-05-10T01:25:32.365971+0000","last_peered":"2023-05-10T01:25:32.365971+0000","last_clean":"2023-05-10T01:25:32.365971+0000","last_became_active":"2023-05-10T01:25:32.360271+0000","last_became_peered":"2023-05-10T01:25:32.360271+0000","last_unstale":"2023-05-10T01:25:32.365971+0000","last_undegraded":"2023-05-10T01:25:32.365971+0000","last_fullsized":"2023-05-10T01:25:32.365971+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365249+0000","last_change":"2023-05-10T01:25:32.359531+0000","last_active":"2023-05-10T01:25:32.365249+0000","last_peered":"2023-05-10T01:25:32.365249+0000","last_clean":"2023-05-10T01:25:32.365249+0000","last_became_active":"2023-05-10T01:25:32.357544+0000","last_became_peered":"2023-05-10T01:25:32.357544+0000","last_unstale":"2023-05-10T01:25:32.365249+0000","last_undegraded":"2023-05-10T01:25:32.365249+0000","last_fullsized":"2023-05-10T01:25:32.365249+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353387+0000","last_change":"2023-05-10T01:25:31.979686+0000","last_active":"2023-05-10T01:25:32.353387+0000","last_peered":"2023-05-10T01:25:32.353387+0000","last_clean":"2023-05-10T01:25:32.353387+0000","last_became_active":"2023-05-10T01:25:31.978877+0000","last_became_peered":"2023-05-10T01:25:31.978877+0000","last_unstale":"2023-05-10T01:25:32.353387+0000","last_undegraded":"2023-05-10T01:25:32.353387+0000","last_fullsized":"2023-05-10T01:25:32.353387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368698+0000","last_change":"2023-05-10T01:25:32.364860+0000","last_active":"2023-05-10T01:25:32.368698+0000","last_peered":"2023-05-10T01:25:32.368698+0000","last_clean":"2023-05-10T01:25:32.368698+0000","last_became_active":"2023-05-10T01:25:32.364645+0000","last_became_peered":"2023-05-10T01:25:32.364645+0000","last_unstale":"2023-05-10T01:25:32.368698+0000","last_undegraded":"2023-05-10T01:25:32.368698+0000","last_fullsized":"2023-05-10T01:25:32.368698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352726+0000","last_change":"2023-05-10T01:25:31.964718+0000","last_active":"2023-05-10T01:25:32.352726+0000","last_peered":"2023-05-10T01:25:32.352726+0000","last_clean":"2023-05-10T01:25:32.352726+0000","last_became_active":"2023-05-10T01:25:31.964432+0000","last_became_peered":"2023-05-10T01:25:31.964432+0000","last_unstale":"2023-05-10T01:25:32.352726+0000","last_undegraded":"2023-05-10T01:25:32.352726+0000","last_fullsized":"2023-05-10T01:25:32.352726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373607+0000","last_change":"2023-05-10T01:25:32.372809+0000","last_active":"2023-05-10T01:25:32.373607+0000","last_peered":"2023-05-10T01:25:32.373607+0000","last_clean":"2023-05-10T01:25:32.373607+0000","last_became_active":"2023-05-10T01:25:32.372525+0000","last_became_peered":"2023-05-10T01:25:32.372525+0000","last_unstale":"2023-05-10T01:25:32.373607+0000","last_undegraded":"2023-05-10T01:25:32.373607+0000","last_fullsized":"2023-05-10T01:25:32.373607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371608+0000","last_change":"2023-05-10T01:25:31.964128+0000","last_active":"2023-05-10T01:25:32.371608+0000","last_peered":"2023-05-10T01:25:32.371608+0000","last_clean":"2023-05-10T01:25:32.371608+0000","last_became_active":"2023-05-10T01:25:31.963858+0000","last_became_peered":"2023-05-10T01:25:31.963858+0000","last_unstale":"2023-05-10T01:25:32.371608+0000","last_undegraded":"2023-05-10T01:25:32.371608+0000","last_fullsized":"2023-05-10T01:25:32.371608+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365321+0000","last_change":"2023-05-10T01:25:32.358660+0000","last_active":"2023-05-10T01:25:32.365321+0000","last_peered":"2023-05-10T01:25:32.365321+0000","last_clean":"2023-05-10T01:25:32.365321+0000","last_became_active":"2023-05-10T01:25:32.358335+0000","last_became_peered":"2023-05-10T01:25:32.358335+0000","last_unstale":"2023-05-10T01:25:32.365321+0000","last_undegraded":"2023-05-10T01:25:32.365321+0000","last_fullsized":"2023-05-10T01:25:32.365321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354715+0000","last_change":"2023-05-10T01:25:31.968051+0000","last_active":"2023-05-10T01:25:32.354715+0000","last_peered":"2023-05-10T01:25:32.354715+0000","last_clean":"2023-05-10T01:25:32.354715+0000","last_became_active":"2023-05-10T01:25:31.967744+0000","last_became_peered":"2023-05-10T01:25:31.967744+0000","last_unstale":"2023-05-10T01:25:32.354715+0000","last_undegraded":"2023-05-10T01:25:32.354715+0000","last_fullsized":"2023-05-10T01:25:32.354715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376381+0000","last_change":"2023-05-10T01:25:32.368882+0000","last_active":"2023-05-10T01:25:32.376381+0000","last_peered":"2023-05-10T01:25:32.376381+0000","last_clean":"2023-05-10T01:25:32.376381+0000","last_became_active":"2023-05-10T01:25:32.368593+0000","last_became_peered":"2023-05-10T01:25:32.368593+0000","last_unstale":"2023-05-10T01:25:32.376381+0000","last_undegraded":"2023-05-10T01:25:32.376381+0000","last_fullsized":"2023-05-10T01:25:32.376381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353740+0000","last_change":"2023-05-10T01:25:31.965170+0000","last_active":"2023-05-10T01:25:32.353740+0000","last_peered":"2023-05-10T01:25:32.353740+0000","last_clean":"2023-05-10T01:25:32.353740+0000","last_became_active":"2023-05-10T01:25:31.964889+0000","last_became_peered":"2023-05-10T01:25:31.964889+0000","last_unstale":"2023-05-10T01:25:32.353740+0000","last_undegraded":"2023-05-10T01:25:32.353740+0000","last_fullsized":"2023-05-10T01:25:32.353740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370701+0000","last_change":"2023-05-10T01:25:32.369797+0000","last_active":"2023-05-10T01:25:32.370701+0000","last_peered":"2023-05-10T01:25:32.370701+0000","last_clean":"2023-05-10T01:25:32.370701+0000","last_became_active":"2023-05-10T01:25:32.369393+0000","last_became_peered":"2023-05-10T01:25:32.369393+0000","last_unstale":"2023-05-10T01:25:32.370701+0000","last_undegraded":"2023-05-10T01:25:32.370701+0000","last_fullsized":"2023-05-10T01:25:32.370701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364256+0000","last_change":"2023-05-10T01:25:31.965803+0000","last_active":"2023-05-10T01:25:32.364256+0000","last_peered":"2023-05-10T01:25:32.364256+0000","last_clean":"2023-05-10T01:25:32.364256+0000","last_became_active":"2023-05-10T01:25:31.965495+0000","last_became_peered":"2023-05-10T01:25:31.965495+0000","last_unstale":"2023-05-10T01:25:32.364256+0000","last_undegraded":"2023-05-10T01:25:32.364256+0000","last_fullsized":"2023-05-10T01:25:32.364256+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365650+0000","last_change":"2023-05-10T01:25:32.361745+0000","last_active":"2023-05-10T01:25:32.365650+0000","last_peered":"2023-05-10T01:25:32.365650+0000","last_clean":"2023-05-10T01:25:32.365650+0000","last_became_active":"2023-05-10T01:25:32.361473+0000","last_became_peered":"2023-05-10T01:25:32.361473+0000","last_unstale":"2023-05-10T01:25:32.365650+0000","last_undegraded":"2023-05-10T01:25:32.365650+0000","last_fullsized":"2023-05-10T01:25:32.365650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354188+0000","last_change":"2023-05-10T01:25:31.972607+0000","last_active":"2023-05-10T01:25:32.354188+0000","last_peered":"2023-05-10T01:25:32.354188+0000","last_clean":"2023-05-10T01:25:32.354188+0000","last_became_active":"2023-05-10T01:25:31.972048+0000","last_became_peered":"2023-05-10T01:25:31.972048+0000","last_unstale":"2023-05-10T01:25:32.354188+0000","last_undegraded":"2023-05-10T01:25:32.354188+0000","last_fullsized":"2023-05-10T01:25:32.354188+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367027+0000","last_change":"2023-05-10T01:25:32.362548+0000","last_active":"2023-05-10T01:25:32.367027+0000","last_peered":"2023-05-10T01:25:32.367027+0000","last_clean":"2023-05-10T01:25:32.367027+0000","last_became_active":"2023-05-10T01:25:32.361461+0000","last_became_peered":"2023-05-10T01:25:32.361461+0000","last_unstale":"2023-05-10T01:25:32.367027+0000","last_undegraded":"2023-05-10T01:25:32.367027+0000","last_fullsized":"2023-05-10T01:25:32.367027+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365703+0000","last_change":"2023-05-10T01:25:31.969371+0000","last_active":"2023-05-10T01:25:32.365703+0000","last_peered":"2023-05-10T01:25:32.365703+0000","last_clean":"2023-05-10T01:25:32.365703+0000","last_became_active":"2023-05-10T01:25:31.969080+0000","last_became_peered":"2023-05-10T01:25:31.969080+0000","last_unstale":"2023-05-10T01:25:32.365703+0000","last_undegraded":"2023-05-10T01:25:32.365703+0000","last_fullsized":"2023-05-10T01:25:32.365703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350385+0000","last_change":"2023-05-10T01:25:31.974405+0000","last_active":"2023-05-10T01:25:32.350385+0000","last_peered":"2023-05-10T01:25:32.350385+0000","last_clean":"2023-05-10T01:25:32.350385+0000","last_became_active":"2023-05-10T01:25:31.974108+0000","last_became_peered":"2023-05-10T01:25:31.974108+0000","last_unstale":"2023-05-10T01:25:32.350385+0000","last_undegraded":"2023-05-10T01:25:32.350385+0000","last_fullsized":"2023-05-10T01:25:32.350385+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368717+0000","last_change":"2023-05-10T01:25:32.365374+0000","last_active":"2023-05-10T01:25:32.368717+0000","last_peered":"2023-05-10T01:25:32.368717+0000","last_clean":"2023-05-10T01:25:32.368717+0000","last_became_active":"2023-05-10T01:25:32.365088+0000","last_became_peered":"2023-05-10T01:25:32.365088+0000","last_unstale":"2023-05-10T01:25:32.368717+0000","last_undegraded":"2023-05-10T01:25:32.368717+0000","last_fullsized":"2023-05-10T01:25:32.368717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376819+0000","last_change":"2023-05-10T01:25:32.373347+0000","last_active":"2023-05-10T01:25:32.376819+0000","last_peered":"2023-05-10T01:25:32.376819+0000","last_clean":"2023-05-10T01:25:32.376819+0000","last_became_active":"2023-05-10T01:25:32.371753+0000","last_became_peered":"2023-05-10T01:25:32.371753+0000","last_unstale":"2023-05-10T01:25:32.376819+0000","last_undegraded":"2023-05-10T01:25:32.376819+0000","last_fullsized":"2023-05-10T01:25:32.376819+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353308+0000","last_change":"2023-05-10T01:25:31.969920+0000","last_active":"2023-05-10T01:25:32.353308+0000","last_peered":"2023-05-10T01:25:32.353308+0000","last_clean":"2023-05-10T01:25:32.353308+0000","last_became_active":"2023-05-10T01:25:31.969667+0000","last_became_peered":"2023-05-10T01:25:31.969667+0000","last_unstale":"2023-05-10T01:25:32.353308+0000","last_undegraded":"2023-05-10T01:25:32.353308+0000","last_fullsized":"2023-05-10T01:25:32.353308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365341+0000","last_change":"2023-05-10T01:25:32.360107+0000","last_active":"2023-05-10T01:25:32.365341+0000","last_peered":"2023-05-10T01:25:32.365341+0000","last_clean":"2023-05-10T01:25:32.365341+0000","last_became_active":"2023-05-10T01:25:32.359824+0000","last_became_peered":"2023-05-10T01:25:32.359824+0000","last_unstale":"2023-05-10T01:25:32.365341+0000","last_undegraded":"2023-05-10T01:25:32.365341+0000","last_fullsized":"2023-05-10T01:25:32.365341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349439+0000","last_change":"2023-05-10T01:25:31.976138+0000","last_active":"2023-05-10T01:25:32.349439+0000","last_peered":"2023-05-10T01:25:32.349439+0000","last_clean":"2023-05-10T01:25:32.349439+0000","last_became_active":"2023-05-10T01:25:31.975542+0000","last_became_peered":"2023-05-10T01:25:31.975542+0000","last_unstale":"2023-05-10T01:25:32.349439+0000","last_undegraded":"2023-05-10T01:25:32.349439+0000","last_fullsized":"2023-05-10T01:25:32.349439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374644+0000","last_change":"2023-05-10T01:25:32.373032+0000","last_active":"2023-05-10T01:25:32.374644+0000","last_peered":"2023-05-10T01:25:32.374644+0000","last_clean":"2023-05-10T01:25:32.374644+0000","last_became_active":"2023-05-10T01:25:32.372770+0000","last_became_peered":"2023-05-10T01:25:32.372770+0000","last_unstale":"2023-05-10T01:25:32.374644+0000","last_undegraded":"2023-05-10T01:25:32.374644+0000","last_fullsized":"2023-05-10T01:25:32.374644+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376335+0000","last_change":"2023-05-10T01:25:32.369001+0000","last_active":"2023-05-10T01:25:32.376335+0000","last_peered":"2023-05-10T01:25:32.376335+0000","last_clean":"2023-05-10T01:25:32.376335+0000","last_became_active":"2023-05-10T01:25:32.368656+0000","last_became_peered":"2023-05-10T01:25:32.368656+0000","last_unstale":"2023-05-10T01:25:32.376335+0000","last_undegraded":"2023-05-10T01:25:32.376335+0000","last_fullsized":"2023-05-10T01:25:32.376335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356938+0000","last_change":"2023-05-10T01:25:31.966263+0000","last_active":"2023-05-10T01:25:32.356938+0000","last_peered":"2023-05-10T01:25:32.356938+0000","last_clean":"2023-05-10T01:25:32.356938+0000","last_became_active":"2023-05-10T01:25:31.965960+0000","last_became_peered":"2023-05-10T01:25:31.965960+0000","last_unstale":"2023-05-10T01:25:32.356938+0000","last_undegraded":"2023-05-10T01:25:32.356938+0000","last_fullsized":"2023-05-10T01:25:32.356938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364429+0000","last_change":"2023-05-10T01:25:32.355599+0000","last_active":"2023-05-10T01:25:32.364429+0000","last_peered":"2023-05-10T01:25:32.364429+0000","last_clean":"2023-05-10T01:25:32.364429+0000","last_became_active":"2023-05-10T01:25:32.355323+0000","last_became_peered":"2023-05-10T01:25:32.355323+0000","last_unstale":"2023-05-10T01:25:32.364429+0000","last_undegraded":"2023-05-10T01:25:32.364429+0000","last_fullsized":"2023-05-10T01:25:32.364429+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349588+0000","last_change":"2023-05-10T01:25:31.975172+0000","last_active":"2023-05-10T01:25:32.349588+0000","last_peered":"2023-05-10T01:25:32.349588+0000","last_clean":"2023-05-10T01:25:32.349588+0000","last_became_active":"2023-05-10T01:25:31.974835+0000","last_became_peered":"2023-05-10T01:25:31.974835+0000","last_unstale":"2023-05-10T01:25:32.349588+0000","last_undegraded":"2023-05-10T01:25:32.349588+0000","last_fullsized":"2023-05-10T01:25:32.349588+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351477+0000","last_change":"2023-05-10T01:25:31.970025+0000","last_active":"2023-05-10T01:25:32.351477+0000","last_peered":"2023-05-10T01:25:32.351477+0000","last_clean":"2023-05-10T01:25:32.351477+0000","last_became_active":"2023-05-10T01:25:31.969551+0000","last_became_peered":"2023-05-10T01:25:31.969551+0000","last_unstale":"2023-05-10T01:25:32.351477+0000","last_undegraded":"2023-05-10T01:25:32.351477+0000","last_fullsized":"2023-05-10T01:25:32.351477+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376740+0000","last_change":"2023-05-10T01:25:32.369898+0000","last_active":"2023-05-10T01:25:32.376740+0000","last_peered":"2023-05-10T01:25:32.376740+0000","last_clean":"2023-05-10T01:25:32.376740+0000","last_became_active":"2023-05-10T01:25:32.369619+0000","last_became_peered":"2023-05-10T01:25:32.369619+0000","last_unstale":"2023-05-10T01:25:32.376740+0000","last_undegraded":"2023-05-10T01:25:32.376740+0000","last_fullsized":"2023-05-10T01:25:32.376740+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352932+0000","last_change":"2023-05-10T01:25:31.969673+0000","last_active":"2023-05-10T01:25:32.352932+0000","last_peered":"2023-05-10T01:25:32.352932+0000","last_clean":"2023-05-10T01:25:32.352932+0000","last_became_active":"2023-05-10T01:25:31.969390+0000","last_became_peered":"2023-05-10T01:25:31.969390+0000","last_unstale":"2023-05-10T01:25:32.352932+0000","last_undegraded":"2023-05-10T01:25:32.352932+0000","last_fullsized":"2023-05-10T01:25:32.352932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364760+0000","last_change":"2023-05-10T01:25:32.357255+0000","last_active":"2023-05-10T01:25:32.364760+0000","last_peered":"2023-05-10T01:25:32.364760+0000","last_clean":"2023-05-10T01:25:32.364760+0000","last_became_active":"2023-05-10T01:25:32.356612+0000","last_became_peered":"2023-05-10T01:25:32.356612+0000","last_unstale":"2023-05-10T01:25:32.364760+0000","last_undegraded":"2023-05-10T01:25:32.364760+0000","last_fullsized":"2023-05-10T01:25:32.364760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364316+0000","last_change":"2023-05-10T01:25:32.358354+0000","last_active":"2023-05-10T01:25:32.364316+0000","last_peered":"2023-05-10T01:25:32.364316+0000","last_clean":"2023-05-10T01:25:32.364316+0000","last_became_active":"2023-05-10T01:25:32.358100+0000","last_became_peered":"2023-05-10T01:25:32.358100+0000","last_unstale":"2023-05-10T01:25:32.364316+0000","last_undegraded":"2023-05-10T01:25:32.364316+0000","last_fullsized":"2023-05-10T01:25:32.364316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370725+0000","last_change":"2023-05-10T01:25:31.964658+0000","last_active":"2023-05-10T01:25:32.370725+0000","last_peered":"2023-05-10T01:25:32.370725+0000","last_clean":"2023-05-10T01:25:32.370725+0000","last_became_active":"2023-05-10T01:25:31.964396+0000","last_became_peered":"2023-05-10T01:25:31.964396+0000","last_unstale":"2023-05-10T01:25:32.370725+0000","last_undegraded":"2023-05-10T01:25:32.370725+0000","last_fullsized":"2023-05-10T01:25:32.370725+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373788+0000","last_change":"2023-05-10T01:25:32.372782+0000","last_active":"2023-05-10T01:25:32.373788+0000","last_peered":"2023-05-10T01:25:32.373788+0000","last_clean":"2023-05-10T01:25:32.373788+0000","last_became_active":"2023-05-10T01:25:32.372495+0000","last_became_peered":"2023-05-10T01:25:32.372495+0000","last_unstale":"2023-05-10T01:25:32.373788+0000","last_undegraded":"2023-05-10T01:25:32.373788+0000","last_fullsized":"2023-05-10T01:25:32.373788+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368627+0000","last_change":"2023-05-10T01:25:32.363765+0000","last_active":"2023-05-10T01:25:32.368627+0000","last_peered":"2023-05-10T01:25:32.368627+0000","last_clean":"2023-05-10T01:25:32.368627+0000","last_became_active":"2023-05-10T01:25:32.363478+0000","last_became_peered":"2023-05-10T01:25:32.363478+0000","last_unstale":"2023-05-10T01:25:32.368627+0000","last_undegraded":"2023-05-10T01:25:32.368627+0000","last_fullsized":"2023-05-10T01:25:32.368627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353472+0000","last_change":"2023-05-10T01:25:31.965616+0000","last_active":"2023-05-10T01:25:32.353472+0000","last_peered":"2023-05-10T01:25:32.353472+0000","last_clean":"2023-05-10T01:25:32.353472+0000","last_became_active":"2023-05-10T01:25:31.965290+0000","last_became_peered":"2023-05-10T01:25:31.965290+0000","last_unstale":"2023-05-10T01:25:32.353472+0000","last_undegraded":"2023-05-10T01:25:32.353472+0000","last_fullsized":"2023-05-10T01:25:32.353472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350534+0000","last_change":"2023-05-10T01:25:31.969840+0000","last_active":"2023-05-10T01:25:32.350534+0000","last_peered":"2023-05-10T01:25:32.350534+0000","last_clean":"2023-05-10T01:25:32.350534+0000","last_became_active":"2023-05-10T01:25:31.969152+0000","last_became_peered":"2023-05-10T01:25:31.969152+0000","last_unstale":"2023-05-10T01:25:32.350534+0000","last_undegraded":"2023-05-10T01:25:32.350534+0000","last_fullsized":"2023-05-10T01:25:32.350534+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366836+0000","last_change":"2023-05-10T01:25:32.363757+0000","last_active":"2023-05-10T01:25:32.366836+0000","last_peered":"2023-05-10T01:25:32.366836+0000","last_clean":"2023-05-10T01:25:32.366836+0000","last_became_active":"2023-05-10T01:25:32.363316+0000","last_became_peered":"2023-05-10T01:25:32.363316+0000","last_unstale":"2023-05-10T01:25:32.366836+0000","last_undegraded":"2023-05-10T01:25:32.366836+0000","last_fullsized":"2023-05-10T01:25:32.366836+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352830+0000","last_change":"2023-05-10T01:25:31.964677+0000","last_active":"2023-05-10T01:25:32.352830+0000","last_peered":"2023-05-10T01:25:32.352830+0000","last_clean":"2023-05-10T01:25:32.352830+0000","last_became_active":"2023-05-10T01:25:31.964357+0000","last_became_peered":"2023-05-10T01:25:31.964357+0000","last_unstale":"2023-05-10T01:25:32.352830+0000","last_undegraded":"2023-05-10T01:25:32.352830+0000","last_fullsized":"2023-05-10T01:25:32.352830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371284+0000","last_change":"2023-05-10T01:25:32.370504+0000","last_active":"2023-05-10T01:25:32.371284+0000","last_peered":"2023-05-10T01:25:32.371284+0000","last_clean":"2023-05-10T01:25:32.371284+0000","last_became_active":"2023-05-10T01:25:32.370218+0000","last_became_peered":"2023-05-10T01:25:32.370218+0000","last_unstale":"2023-05-10T01:25:32.371284+0000","last_undegraded":"2023-05-10T01:25:32.371284+0000","last_fullsized":"2023-05-10T01:25:32.371284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366998+0000","last_change":"2023-05-10T01:25:32.363317+0000","last_active":"2023-05-10T01:25:32.366998+0000","last_peered":"2023-05-10T01:25:32.366998+0000","last_clean":"2023-05-10T01:25:32.366998+0000","last_became_active":"2023-05-10T01:25:32.362892+0000","last_became_peered":"2023-05-10T01:25:32.362892+0000","last_unstale":"2023-05-10T01:25:32.366998+0000","last_undegraded":"2023-05-10T01:25:32.366998+0000","last_fullsized":"2023-05-10T01:25:32.366998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353420+0000","last_change":"2023-05-10T01:25:31.978033+0000","last_active":"2023-05-10T01:25:32.353420+0000","last_peered":"2023-05-10T01:25:32.353420+0000","last_clean":"2023-05-10T01:25:32.353420+0000","last_became_active":"2023-05-10T01:25:31.977683+0000","last_became_peered":"2023-05-10T01:25:31.977683+0000","last_unstale":"2023-05-10T01:25:32.353420+0000","last_undegraded":"2023-05-10T01:25:32.353420+0000","last_fullsized":"2023-05-10T01:25:32.353420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363570+0000","last_change":"2023-05-10T01:25:32.361937+0000","last_active":"2023-05-10T01:25:32.363570+0000","last_peered":"2023-05-10T01:25:32.363570+0000","last_clean":"2023-05-10T01:25:32.363570+0000","last_became_active":"2023-05-10T01:25:32.361656+0000","last_became_peered":"2023-05-10T01:25:32.361656+0000","last_unstale":"2023-05-10T01:25:32.363570+0000","last_undegraded":"2023-05-10T01:25:32.363570+0000","last_fullsized":"2023-05-10T01:25:32.363570+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.369356+0000","last_change":"2023-05-10T01:25:31.970229+0000","last_active":"2023-05-10T01:25:32.369356+0000","last_peered":"2023-05-10T01:25:32.369356+0000","last_clean":"2023-05-10T01:25:32.369356+0000","last_became_active":"2023-05-10T01:25:31.969792+0000","last_became_peered":"2023-05-10T01:25:31.969792+0000","last_unstale":"2023-05-10T01:25:32.369356+0000","last_undegraded":"2023-05-10T01:25:32.369356+0000","last_fullsized":"2023-05-10T01:25:32.369356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370768+0000","last_change":"2023-05-10T01:25:32.369554+0000","last_active":"2023-05-10T01:25:32.370768+0000","last_peered":"2023-05-10T01:25:32.370768+0000","last_clean":"2023-05-10T01:25:32.370768+0000","last_became_active":"2023-05-10T01:25:32.369128+0000","last_became_peered":"2023-05-10T01:25:32.369128+0000","last_unstale":"2023-05-10T01:25:32.370768+0000","last_undegraded":"2023-05-10T01:25:32.370768+0000","last_fullsized":"2023-05-10T01:25:32.370768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368771+0000","last_change":"2023-05-10T01:25:31.965952+0000","last_active":"2023-05-10T01:25:32.368771+0000","last_peered":"2023-05-10T01:25:32.368771+0000","last_clean":"2023-05-10T01:25:32.368771+0000","last_became_active":"2023-05-10T01:25:31.965197+0000","last_became_peered":"2023-05-10T01:25:31.965197+0000","last_unstale":"2023-05-10T01:25:32.368771+0000","last_undegraded":"2023-05-10T01:25:32.368771+0000","last_fullsized":"2023-05-10T01:25:32.368771+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373623+0000","last_change":"2023-05-10T01:25:32.372333+0000","last_active":"2023-05-10T01:25:32.373623+0000","last_peered":"2023-05-10T01:25:32.373623+0000","last_clean":"2023-05-10T01:25:32.373623+0000","last_became_active":"2023-05-10T01:25:32.372045+0000","last_became_peered":"2023-05-10T01:25:32.372045+0000","last_unstale":"2023-05-10T01:25:32.373623+0000","last_undegraded":"2023-05-10T01:25:32.373623+0000","last_fullsized":"2023-05-10T01:25:32.373623+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376801+0000","last_change":"2023-05-10T01:25:32.373164+0000","last_active":"2023-05-10T01:25:32.376801+0000","last_peered":"2023-05-10T01:25:32.376801+0000","last_clean":"2023-05-10T01:25:32.376801+0000","last_became_active":"2023-05-10T01:25:32.372876+0000","last_became_peered":"2023-05-10T01:25:32.372876+0000","last_unstale":"2023-05-10T01:25:32.376801+0000","last_undegraded":"2023-05-10T01:25:32.376801+0000","last_fullsized":"2023-05-10T01:25:32.376801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.346366+0000","last_change":"2023-05-10T01:25:31.963088+0000","last_active":"2023-05-10T01:25:32.346366+0000","last_peered":"2023-05-10T01:25:32.346366+0000","last_clean":"2023-05-10T01:25:32.346366+0000","last_became_active":"2023-05-10T01:25:31.962304+0000","last_became_peered":"2023-05-10T01:25:31.962304+0000","last_unstale":"2023-05-10T01:25:32.346366+0000","last_undegraded":"2023-05-10T01:25:32.346366+0000","last_fullsized":"2023-05-10T01:25:32.346366+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364353+0000","last_change":"2023-05-10T01:25:32.363444+0000","last_active":"2023-05-10T01:25:32.364353+0000","last_peered":"2023-05-10T01:25:32.364353+0000","last_clean":"2023-05-10T01:25:32.364353+0000","last_became_active":"2023-05-10T01:25:32.363205+0000","last_became_peered":"2023-05-10T01:25:32.363205+0000","last_unstale":"2023-05-10T01:25:32.364353+0000","last_undegraded":"2023-05-10T01:25:32.364353+0000","last_fullsized":"2023-05-10T01:25:32.364353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348946+0000","last_change":"2023-05-10T01:25:31.973667+0000","last_active":"2023-05-10T01:25:32.348946+0000","last_peered":"2023-05-10T01:25:32.348946+0000","last_clean":"2023-05-10T01:25:32.348946+0000","last_became_active":"2023-05-10T01:25:31.973364+0000","last_became_peered":"2023-05-10T01:25:31.973364+0000","last_unstale":"2023-05-10T01:25:32.348946+0000","last_undegraded":"2023-05-10T01:25:32.348946+0000","last_fullsized":"2023-05-10T01:25:32.348946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363667+0000","last_change":"2023-05-10T01:25:32.360888+0000","last_active":"2023-05-10T01:25:32.363667+0000","last_peered":"2023-05-10T01:25:32.363667+0000","last_clean":"2023-05-10T01:25:32.363667+0000","last_became_active":"2023-05-10T01:25:32.360630+0000","last_became_peered":"2023-05-10T01:25:32.360630+0000","last_unstale":"2023-05-10T01:25:32.363667+0000","last_undegraded":"2023-05-10T01:25:32.363667+0000","last_fullsized":"2023-05-10T01:25:32.363667+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365017+0000","last_change":"2023-05-10T01:25:31.973649+0000","last_active":"2023-05-10T01:25:32.365017+0000","last_peered":"2023-05-10T01:25:32.365017+0000","last_clean":"2023-05-10T01:25:32.365017+0000","last_became_active":"2023-05-10T01:25:31.973312+0000","last_became_peered":"2023-05-10T01:25:31.973312+0000","last_unstale":"2023-05-10T01:25:32.365017+0000","last_undegraded":"2023-05-10T01:25:32.365017+0000","last_fullsized":"2023-05-10T01:25:32.365017+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368792+0000","last_change":"2023-05-10T01:25:32.367931+0000","last_active":"2023-05-10T01:25:32.368792+0000","last_peered":"2023-05-10T01:25:32.368792+0000","last_clean":"2023-05-10T01:25:32.368792+0000","last_became_active":"2023-05-10T01:25:32.366029+0000","last_became_peered":"2023-05-10T01:25:32.366029+0000","last_unstale":"2023-05-10T01:25:32.368792+0000","last_undegraded":"2023-05-10T01:25:32.368792+0000","last_fullsized":"2023-05-10T01:25:32.368792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.355466+0000","last_change":"2023-05-10T01:25:31.959959+0000","last_active":"2023-05-10T01:25:32.355466+0000","last_peered":"2023-05-10T01:25:32.355466+0000","last_clean":"2023-05-10T01:25:32.355466+0000","last_became_active":"2023-05-10T01:25:31.959662+0000","last_became_peered":"2023-05-10T01:25:31.959662+0000","last_unstale":"2023-05-10T01:25:32.355466+0000","last_undegraded":"2023-05-10T01:25:32.355466+0000","last_fullsized":"2023-05-10T01:25:32.355466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364206+0000","last_change":"2023-05-10T01:25:32.358333+0000","last_active":"2023-05-10T01:25:32.364206+0000","last_peered":"2023-05-10T01:25:32.364206+0000","last_clean":"2023-05-10T01:25:32.364206+0000","last_became_active":"2023-05-10T01:25:32.357905+0000","last_became_peered":"2023-05-10T01:25:32.357905+0000","last_unstale":"2023-05-10T01:25:32.364206+0000","last_undegraded":"2023-05-10T01:25:32.364206+0000","last_fullsized":"2023-05-10T01:25:32.364206+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356826+0000","last_change":"2023-05-10T01:25:31.970051+0000","last_active":"2023-05-10T01:25:32.356826+0000","last_peered":"2023-05-10T01:25:32.356826+0000","last_clean":"2023-05-10T01:25:32.356826+0000","last_became_active":"2023-05-10T01:25:31.969424+0000","last_became_peered":"2023-05-10T01:25:31.969424+0000","last_unstale":"2023-05-10T01:25:32.356826+0000","last_undegraded":"2023-05-10T01:25:32.356826+0000","last_fullsized":"2023-05-10T01:25:32.356826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367302+0000","last_change":"2023-05-10T01:25:32.364606+0000","last_active":"2023-05-10T01:25:32.367302+0000","last_peered":"2023-05-10T01:25:32.367302+0000","last_clean":"2023-05-10T01:25:32.367302+0000","last_became_active":"2023-05-10T01:25:32.364291+0000","last_became_peered":"2023-05-10T01:25:32.364291+0000","last_unstale":"2023-05-10T01:25:32.367302+0000","last_undegraded":"2023-05-10T01:25:32.367302+0000","last_fullsized":"2023-05-10T01:25:32.367302+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.347325+0000","last_change":"2023-05-10T01:25:31.962288+0000","last_active":"2023-05-10T01:25:32.347325+0000","last_peered":"2023-05-10T01:25:32.347325+0000","last_clean":"2023-05-10T01:25:32.347325+0000","last_became_active":"2023-05-10T01:25:31.961985+0000","last_became_peered":"2023-05-10T01:25:31.961985+0000","last_unstale":"2023-05-10T01:25:32.347325+0000","last_undegraded":"2023-05-10T01:25:32.347325+0000","last_fullsized":"2023-05-10T01:25:32.347325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367599+0000","last_change":"2023-05-10T01:25:32.363926+0000","last_active":"2023-05-10T01:25:32.367599+0000","last_peered":"2023-05-10T01:25:32.367599+0000","last_clean":"2023-05-10T01:25:32.367599+0000","last_became_active":"2023-05-10T01:25:32.363672+0000","last_became_peered":"2023-05-10T01:25:32.363672+0000","last_unstale":"2023-05-10T01:25:32.367599+0000","last_undegraded":"2023-05-10T01:25:32.367599+0000","last_fullsized":"2023-05-10T01:25:32.367599+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364085+0000","last_change":"2023-05-10T01:25:32.356942+0000","last_active":"2023-05-10T01:25:32.364085+0000","last_peered":"2023-05-10T01:25:32.364085+0000","last_clean":"2023-05-10T01:25:32.364085+0000","last_became_active":"2023-05-10T01:25:32.356494+0000","last_became_peered":"2023-05-10T01:25:32.356494+0000","last_unstale":"2023-05-10T01:25:32.364085+0000","last_undegraded":"2023-05-10T01:25:32.364085+0000","last_fullsized":"2023-05-10T01:25:32.364085+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368781+0000","last_change":"2023-05-10T01:25:32.367401+0000","last_active":"2023-05-10T01:25:32.368781+0000","last_peered":"2023-05-10T01:25:32.368781+0000","last_clean":"2023-05-10T01:25:32.368781+0000","last_became_active":"2023-05-10T01:25:32.365781+0000","last_became_peered":"2023-05-10T01:25:32.365781+0000","last_unstale":"2023-05-10T01:25:32.368781+0000","last_undegraded":"2023-05-10T01:25:32.368781+0000","last_fullsized":"2023-05-10T01:25:32.368781+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351319+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:25:32.351319+0000","last_peered":"2023-05-10T01:25:32.351319+0000","last_clean":"2023-05-10T01:25:32.351319+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:25:32.351319+0000","last_undegraded":"2023-05-10T01:25:32.351319+0000","last_fullsized":"2023-05-10T01:25:32.351319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364856+0000","last_change":"2023-05-10T01:25:32.358939+0000","last_active":"2023-05-10T01:25:32.364856+0000","last_peered":"2023-05-10T01:25:32.364856+0000","last_clean":"2023-05-10T01:25:32.364856+0000","last_became_active":"2023-05-10T01:25:32.358631+0000","last_became_peered":"2023-05-10T01:25:32.358631+0000","last_unstale":"2023-05-10T01:25:32.364856+0000","last_undegraded":"2023-05-10T01:25:32.364856+0000","last_fullsized":"2023-05-10T01:25:32.364856+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356583+0000","last_change":"2023-05-10T01:25:31.967422+0000","last_active":"2023-05-10T01:25:32.356583+0000","last_peered":"2023-05-10T01:25:32.356583+0000","last_clean":"2023-05-10T01:25:32.356583+0000","last_became_active":"2023-05-10T01:25:31.967094+0000","last_became_peered":"2023-05-10T01:25:31.967094+0000","last_unstale":"2023-05-10T01:25:32.356583+0000","last_undegraded":"2023-05-10T01:25:32.356583+0000","last_fullsized":"2023-05-10T01:25:32.356583+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607157+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:25:27.607157+0000","last_peered":"2023-05-10T01:25:27.607157+0000","last_clean":"2023-05-10T01:25:27.607157+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:25:27.607157+0000","last_undegraded":"2023-05-10T01:25:27.607157+0000","last_fullsized":"2023-05-10T01:25:27.607157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353073+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:25:32.353073+0000","last_peered":"2023-05-10T01:25:32.353073+0000","last_clean":"2023-05-10T01:25:32.353073+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:25:32.353073+0000","last_undegraded":"2023-05-10T01:25:32.353073+0000","last_fullsized":"2023-05-10T01:25:32.353073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351244+0000","last_change":"2023-05-10T01:25:31.968267+0000","last_active":"2023-05-10T01:25:32.351244+0000","last_peered":"2023-05-10T01:25:32.351244+0000","last_clean":"2023-05-10T01:25:32.351244+0000","last_became_active":"2023-05-10T01:25:31.966814+0000","last_became_peered":"2023-05-10T01:25:31.966814+0000","last_unstale":"2023-05-10T01:25:32.351244+0000","last_undegraded":"2023-05-10T01:25:32.351244+0000","last_fullsized":"2023-05-10T01:25:32.351244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607129+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:25:27.607129+0000","last_peered":"2023-05-10T01:25:27.607129+0000","last_clean":"2023-05-10T01:25:27.607129+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:25:27.607129+0000","last_undegraded":"2023-05-10T01:25:27.607129+0000","last_fullsized":"2023-05-10T01:25:27.607129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607336+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:25:27.607336+0000","last_peered":"2023-05-10T01:25:27.607336+0000","last_clean":"2023-05-10T01:25:27.607336+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:25:27.607336+0000","last_undegraded":"2023-05-10T01:25:27.607336+0000","last_fullsized":"2023-05-10T01:25:27.607336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364782+0000","last_change":"2023-05-10T01:25:32.357437+0000","last_active":"2023-05-10T01:25:32.364782+0000","last_peered":"2023-05-10T01:25:32.364782+0000","last_clean":"2023-05-10T01:25:32.364782+0000","last_became_active":"2023-05-10T01:25:32.356962+0000","last_became_peered":"2023-05-10T01:25:32.356962+0000","last_unstale":"2023-05-10T01:25:32.364782+0000","last_undegraded":"2023-05-10T01:25:32.364782+0000","last_fullsized":"2023-05-10T01:25:32.364782+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607322+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:25:27.607322+0000","last_peered":"2023-05-10T01:25:27.607322+0000","last_clean":"2023-05-10T01:25:27.607322+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:25:27.607322+0000","last_undegraded":"2023-05-10T01:25:27.607322+0000","last_fullsized":"2023-05-10T01:25:27.607322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353491+0000","last_change":"2023-05-10T01:25:31.979873+0000","last_active":"2023-05-10T01:25:32.353491+0000","last_peered":"2023-05-10T01:25:32.353491+0000","last_clean":"2023-05-10T01:25:32.353491+0000","last_became_active":"2023-05-10T01:25:31.979377+0000","last_became_peered":"2023-05-10T01:25:31.979377+0000","last_unstale":"2023-05-10T01:25:32.353491+0000","last_undegraded":"2023-05-10T01:25:32.353491+0000","last_fullsized":"2023-05-10T01:25:32.353491+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607337+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:25:27.607337+0000","last_peered":"2023-05-10T01:25:27.607337+0000","last_clean":"2023-05-10T01:25:27.607337+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:25:27.607337+0000","last_undegraded":"2023-05-10T01:25:27.607337+0000","last_fullsized":"2023-05-10T01:25:27.607337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:31.940887+0000","last_change":"2023-05-10T01:25:31.940887+0000","last_active":"2023-05-10T01:25:31.940887+0000","last_peered":"2023-05-10T01:25:31.940887+0000","last_clean":"2023-05-10T01:25:31.940887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:31.940887+0000","last_undegraded":"2023-05-10T01:25:31.940887+0000","last_fullsized":"2023-05-10T01:25:31.940887+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:25:30.935629+0000","last_change":"2023-05-10T01:25:30.935629+0000","last_active":"2023-05-10T01:25:30.935629+0000","last_peered":"2023-05-10T01:25:30.935629+0000","last_clean":"2023-05-10T01:25:30.935629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:25:30.935629+0000","last_undegraded":"2023-05-10T01:25:30.935629+0000","last_fullsized":"2023-05-10T01:25:30.935629+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349006+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:25:32.349006+0000","last_peered":"2023-05-10T01:25:32.349006+0000","last_clean":"2023-05-10T01:25:32.349006+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:25:32.349006+0000","last_undegraded":"2023-05-10T01:25:32.349006+0000","last_fullsized":"2023-05-10T01:25:32.349006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364064+0000","last_change":"2023-05-10T01:25:32.356772+0000","last_active":"2023-05-10T01:25:32.364064+0000","last_peered":"2023-05-10T01:25:32.364064+0000","last_clean":"2023-05-10T01:25:32.364064+0000","last_became_active":"2023-05-10T01:25:32.356119+0000","last_became_peered":"2023-05-10T01:25:32.356119+0000","last_unstale":"2023-05-10T01:25:32.364064+0000","last_undegraded":"2023-05-10T01:25:32.364064+0000","last_fullsized":"2023-05-10T01:25:32.364064+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353407+0000","last_change":"2023-05-10T01:25:31.965743+0000","last_active":"2023-05-10T01:25:32.353407+0000","last_peered":"2023-05-10T01:25:32.353407+0000","last_clean":"2023-05-10T01:25:32.353407+0000","last_became_active":"2023-05-10T01:25:31.964905+0000","last_became_peered":"2023-05-10T01:25:31.964905+0000","last_unstale":"2023-05-10T01:25:32.353407+0000","last_undegraded":"2023-05-10T01:25:32.353407+0000","last_fullsized":"2023-05-10T01:25:32.353407+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-05-10T01:25:27.607549+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:25:27.607549+0000","last_peered":"2023-05-10T01:25:27.607549+0000","last_clean":"2023-05-10T01:25:27.607549+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:25:27.607549+0000","last_undegraded":"2023-05-10T01:25:27.607549+0000","last_fullsized":"2023-05-10T01:25:27.607549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":804,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":74,"acting":74,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17832,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94354008,"statfs":{"total":96636764160,"available":96618504192,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.79900000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98199999999999998},"last":0.63}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":3.016,"15min":3.016},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.93300000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.69399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.85899999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.753,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79300000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.436},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.751,"15min":0.78000000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":1.052},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.95899999999999996},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17192,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":15936,"kb_avail":94354648,"statfs":{"total":96636764160,"available":96619159552,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16318464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.753}]},{"osd":2,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":1.159},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.84799999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.321},"last":0.73599999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.88},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21464,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":20160,"kb_avail":94350376,"statfs":{"total":96636764160,"available":96614785024,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20643840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.22},"max":{"1min":0.39700000000000002,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":0.39200000000000002,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46600000000000003,"15min":0.48699999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.51800000000000002,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56699999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":0.92000000000000004,"15min":1.117},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.623,"15min":0.64300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78100000000000003,"5min":0.95299999999999996,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64100000000000001,"15min":0.65600000000000003},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":1.319},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76800000000000002,"5min":0.97799999999999998,"15min":1.079},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17132,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354708,"statfs":{"total":96636764160,"available":96619220992,"internally_reserved":0,"allocated":1347584,"data_stored":672059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.753}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22616,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":21312,"kb_avail":94349224,"statfs":{"total":96636764160,"available":96613605376,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21823488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.47099999999999997,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.50900000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.53100000000000003,"5min":0.63300000000000001,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.75},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":1.008},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.94199999999999995,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.94799999999999995,"15min":1.056},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25440,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346400,"statfs":{"total":96636764160,"available":96610713600,"internally_reserved":0,"allocated":1335296,"data_stored":672183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.378},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17696,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354144,"statfs":{"total":96636764160,"available":96618643456,"internally_reserved":0,"allocated":1335296,"data_stored":671865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20712,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":19456,"kb_avail":94351128,"statfs":{"total":96636764160,"available":96615555072,"internally_reserved":0,"allocated":1277952,"data_stored":643382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19922944},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.80000000000000004}]},{"osd":1,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.64800000000000002,"5min":0.79800000000000004,"15min":0.82899999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58599999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67300000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":1.0620000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:37.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-05-10T01:25:37.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-05-10T01:25:37.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-05-10T01:25:37.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-05-10T01:25:37.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-05-10T01:25:37.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-05-10T01:25:37.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-05-10T01:25:37.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-05-10T01:25:37.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-05-10T01:25:37.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-05-10T01:25:37.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-05-10T01:25:37.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-05-10T01:25:37.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-05-10T01:25:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-05-10T01:25:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-05-10T01:25:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-05-10T01:25:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-05-10T01:25:37.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-05-10T01:25:37.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-05-10T01:25:37.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-05-10T01:25:37.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-05-10T01:25:37.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-05-10T01:25:37.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-05-10T01:25:37.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-05-10T01:25:37.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-05-10T01:25:37.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-05-10T01:25:37.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-05-10T01:25:37.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-05-10T01:25:37.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-05-10T01:25:37.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-05-10T01:25:37.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-05-10T01:25:37.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-05-10T01:25:37.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-05-10T01:25:37.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-05-10T01:25:37.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-05-10T01:25:37.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-05-10T01:25:37.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-05-10T01:25:37.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-05-10T01:25:37.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-05-10T01:25:37.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-05-10T01:25:37.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-05-10T01:25:37.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-05-10T01:25:37.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:31.940887+0000', 'last_change': '2023-05-10T01:25:31.940887+0000', 'last_active': '2023-05-10T01:25:31.940887+0000', 'last_peered': '2023-05-10T01:25:31.940887+0000', 'last_clean': '2023-05-10T01:25:31.940887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:31.940887+0000', 'last_undegraded': '2023-05-10T01:25:31.940887+0000', 'last_fullsized': '2023-05-10T01:25:31.940887+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:31.940887+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-05-10T01:25:37.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:25:30.935629+0000', 'last_change': '2023-05-10T01:25:30.935629+0000', 'last_active': '2023-05-10T01:25:30.935629+0000', 'last_peered': '2023-05-10T01:25:30.935629+0000', 'last_clean': '2023-05-10T01:25:30.935629+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:25:30.935629+0000', 'last_undegraded': '2023-05-10T01:25:30.935629+0000', 'last_fullsized': '2023-05-10T01:25:30.935629+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'last_clean_scrub_stamp': '2023-05-10T01:25:30.935629+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:25:37.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:25:37.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.348+0000 7f4b512ab700 1 Processor -- start 2023-05-10T01:25:37.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.348+0000 7f4b512ab700 1 -- start start 2023-05-10T01:25:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b512ab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b4c154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b512ab700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b4c069e50 0x7f4b4c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b512ab700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0c6030 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b512ab700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c85c0 con 0x7f4b4c069e50 2023-05-10T01:25:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b512ab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c5740 con 0x7f4b4c1542a0 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b4a7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4b4c0a9e90 0x7f4b4c069740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46314/0 (socket says 172.21.15.52:46314) 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b4a7fc700 1 -- 172.21.15.52:0/1828268417 learned_addr learned my addr 172.21.15.52:0/1828268417 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b4affd700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b4c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b4b7fe700 1 --2- 172.21.15.52:0/1828268417 >> v2:172.21.15.172:3300/0 conn(0x7f4b4c069e50 0x7f4b4c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666042082 0 0) 0x7f4b4c0c6030 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b380033f0 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709633177 0 0) 0x7f4b380033f0 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 msgr2=0x7f4b4c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b4c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 >> v2:172.21.15.172:3300/0 conn(0x7f4b4c069e50 msgr2=0x7f4b4c0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 --2- 172.21.15.52:0/1828268417 >> v2:172.21.15.172:3300/0 conn(0x7f4b4c069e50 0x7f4b4c0c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0c8310 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f4b40001470 con 0x7f4b4c0a9e90 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.349+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 >> v1:172.21.15.52:6789/0 conn(0x7f4b4c0a9e90 legacy=0x7f4b4c069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b38003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b38004690 0x7f4b38004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b38005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c85c0 con 0x7f4b380038e0 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c5740 con 0x7f4b38004690 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3800b8e0 con 0x7f4b4c1542a0 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b38003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4a7fc700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b38004690 0x7f4b38004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4b7fe700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b38005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 -- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 msgr2=0x7f4b38005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c1542a0 0x7f4b38005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 -- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b38004690 msgr2=0x7f4b38004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b38004690 0x7f4b38004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 -- 172.21.15.52:0/1828268417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380033f0 con 0x7f4b380038e0 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b4affd700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b38003d00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f4b4400e1c0 tx=0x7f4b4400b040).ready entity=mon.0 client_cookie=91f6bc5273b3089d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44009ac0 con 0x7f4b380038e0 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400f040 con 0x7f4b380038e0 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.350+0000 7f4b49ffb700 1 -- 172.21.15.52:0/1828268417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400eca0 con 0x7f4b380038e0 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 -- 172.21.15.52:0/1828268417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 msgr2=0x7f4b38003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 --2- 172.21.15.52:0/1828268417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b38003d00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f4b4400e1c0 tx=0x7f4b4400b040).stop 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b4b7fe700 1 -- 172.21.15.52:0/1828268417 reap_dead start 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 -- 172.21.15.52:0/1828268417 shutdown_connections 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 -- 172.21.15.52:0/1828268417 >> 172.21.15.52:0/1828268417 conn(0x7f4b4c0cb740 msgr2=0x7f4b4c0c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:37.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 -- 172.21.15.52:0/1828268417 shutdown_connections 2023-05-10T01:25:37.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.351+0000 7f4b512ab700 1 -- 172.21.15.52:0/1828268417 wait complete. 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.352+0000 7f4b512ab700 1 Processor -- start 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.352+0000 7f4b512ab700 1 -- start start 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 0x7f4b4c1489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c0b0190 0x7f4b4c0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c4780 con 0x7f4b380038e0 2023-05-10T01:25:37.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0b0b00 con 0x7f4b4c164310 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c3b70 con 0x7f4b4c0b0190 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37306/0 (socket says 172.21.15.52:37306) 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 -- 172.21.15.52:0/4192335897 learned_addr learned my addr 172.21.15.52:0/4192335897 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4a7fc700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 0x7f4b4c1489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4b7fe700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c0b0190 0x7f4b4c0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 -- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c0b0190 msgr2=0x7f4b4c0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c0b0190 0x7f4b4c0b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 -- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 msgr2=0x7f4b4c1489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 0x7f4b4c1489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 -- 172.21.15.52:0/4192335897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0c3e50 con 0x7f4b380038e0 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4a7fc700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 0x7f4b4c1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b4affd700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f4b44013ab0 tx=0x7f4b4401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44027420 con 0x7f4b380038e0 2023-05-10T01:25:37.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44027580 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0c4130 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.353+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44027730 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.354+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0c37d0 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.354+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c0ca9f0 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.355+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4b4402e070 con 0x7f4b380038e0 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.355+0000 7f4b32ffd700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 0x7f4b2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.355+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f4b4407bf40 con 0x7f4b380038e0 2023-05-10T01:25:37.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.356+0000 7f4b4a7fc700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 0x7f4b2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.356+0000 7f4b4a7fc700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 0x7f4b2c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4b40001620 tx=0x7f4b40009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.359+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b440aa8f0 con 0x7f4b380038e0 2023-05-10T01:25:37.538 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:25:37.535+0000 7fe524327700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:25:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.600+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4b4c0c4a60 con 0x7f4b380038e0 2023-05-10T01:25:37.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.600+0000 7f4b32ffd700 1 -- 172.21.15.52:0/4192335897 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1026 (secure 0 0 0) 0x7f4b4402c070 con 0x7f4b380038e0 2023-05-10T01:25:37.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:37.604 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":962,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"unknown","count":43}],"num_pgs":137,"num_pools":4,"num_objects":10,"data_bytes":804,"bytes_used":163926016,"bytes_avail":772930187264,"bytes_total":773094113280,"unknown_pgs_ratio":0.31386861205101013},"fsmap":{"epoch":46,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7146}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-05-10T01:23:14.899867+0000","services":{}},"progress_events":{}} 2023-05-10T01:25:37.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 msgr2=0x7f4b2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 0x7f4b2c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4b40001620 tx=0x7f4b40009040).stop 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 msgr2=0x7f4b4c1502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f4b44013ab0 tx=0x7f4b4401a000).stop 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 shutdown_connections 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4b2c05ed90 0x7f4b2c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b4c0b0190 0x7f4b4c0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b380038e0 0x7f4b4c1502b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 --2- 172.21.15.52:0/4192335897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b4c164310 0x7f4b4c1489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 >> 172.21.15.52:0/4192335897 conn(0x7f4b4c0cb740 msgr2=0x7f4b4c0c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:37.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 shutdown_connections 2023-05-10T01:25:37.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.602+0000 7f4b512ab700 1 -- 172.21.15.52:0/4192335897 wait complete. 2023-05-10T01:25:37.617 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:25:37.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:37.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.731+0000 7f6ee1e61700 1 Processor -- start 2023-05-10T01:25:37.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.731+0000 7f6ee1e61700 1 -- start start 2023-05-10T01:25:37.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6ee1e61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6edc069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6ee1e61700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6edc063e20 0x7f6edc0bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6ee1e61700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc062b00 con 0x7f6edc154170 2023-05-10T01:25:37.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6ee1e61700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc068610 con 0x7f6edc063e20 2023-05-10T01:25:37.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6ee1e61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0622a0 con 0x7f6edc153d90 2023-05-10T01:25:37.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6edaffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6edc154170 0x7f6edc063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46332/0 (socket says 172.21.15.52:46332) 2023-05-10T01:25:37.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.732+0000 7f6edaffd700 1 -- 172.21.15.52:0/2666279687 learned_addr learned my addr 172.21.15.52:0/2666279687 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:37.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edbfff700 1 --2- 172.21.15.52:0/2666279687 >> v2:172.21.15.172:3300/0 conn(0x7f6edc063e20 0x7f6edc0bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edb7fe700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6edc069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694270821 0 0) 0x7f6edc062b00 con 0x7f6edc154170 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec80033f0 con 0x7f6edc154170 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978343070 0 0) 0x7f6ec80033f0 con 0x7f6edc154170 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 msgr2=0x7f6edc069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6edc069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 >> v2:172.21.15.172:3300/0 conn(0x7f6edc063e20 msgr2=0x7f6edc0bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 --2- 172.21.15.52:0/2666279687 >> v2:172.21.15.172:3300/0 conn(0x7f6edc063e20 0x7f6edc0bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc068330 con 0x7f6edc154170 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f6ed0001470 con 0x7f6edc154170 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 >> v1:172.21.15.52:6789/0 conn(0x7f6edc154170 legacy=0x7f6edc063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6ec80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8003e10 0x7f6ec8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8004b80 0x7f6ec8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc068610 con 0x7f6ec8003e10 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0622a0 con 0x7f6ec8004b80 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec800b8e0 con 0x7f6edc153d90 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8003e10 0x7f6ec8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edb7fe700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6ec80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edbfff700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8004b80 0x7f6ec8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 -- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 msgr2=0x7f6ec80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc153d90 0x7f6ec80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 -- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8004b80 msgr2=0x7f6ec8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8004b80 0x7f6ec8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.733+0000 7f6edaffd700 1 -- 172.21.15.52:0/2666279687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80033f0 con 0x7f6ec8003e10 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6edaffd700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8003e10 0x7f6ec8004690 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6edc065240 tx=0x7f6ed00077c0).ready entity=mon.0 client_cookie=7220ec76d686fcb6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000ca70 con 0x7f6ec8003e10 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000cbd0 con 0x7f6ec8003e10 2023-05-10T01:25:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6eda7fc700 1 -- 172.21.15.52:0/2666279687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00070d0 con 0x7f6ec8003e10 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 -- 172.21.15.52:0/2666279687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8003e10 msgr2=0x7f6ec8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/2666279687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8003e10 0x7f6ec8004690 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6edc065240 tx=0x7f6ed00077c0).stop 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6edbfff700 1 -- 172.21.15.52:0/2666279687 reap_dead start 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 -- 172.21.15.52:0/2666279687 shutdown_connections 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 -- 172.21.15.52:0/2666279687 >> 172.21.15.52:0/2666279687 conn(0x7f6edc0c8a90 msgr2=0x7f6edc0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 -- 172.21.15.52:0/2666279687 shutdown_connections 2023-05-10T01:25:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.734+0000 7f6ee1e61700 1 -- 172.21.15.52:0/2666279687 wait complete. 2023-05-10T01:25:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 Processor -- start 2023-05-10T01:25:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 -- start start 2023-05-10T01:25:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8003e10 0x7f6edc150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc0c2a40 0x7f6edc0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c33b0 con 0x7f6edc0c54c0 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c5e10 con 0x7f6ec8003e10 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6ee1e61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c3590 con 0x7f6edc0c2a40 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37330/0 (socket says 172.21.15.52:37330) 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.736+0000 7f6edbfff700 1 -- 172.21.15.52:0/3631161601 learned_addr learned my addr 172.21.15.52:0/3631161601 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 -- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc0c2a40 msgr2=0x7f6edc0c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc0c2a40 0x7f6edc0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edb7fe700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8003e10 0x7f6edc150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 -- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8003e10 msgr2=0x7f6edc150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8003e10 0x7f6edc150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 -- 172.21.15.52:0/3631161601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0c3870 con 0x7f6edc0c54c0 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6edbfff700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6ed40094d0 tx=0x7f6ed400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400e040 con 0x7f6edc0c54c0 2023-05-10T01:25:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400f040 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0c3b50 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400fe20 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.737+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc151240 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.738+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc0c4160 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.738+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6ed4015660 con 0x7f6edc0c54c0 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.739+0000 7f6ec37fe700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:37.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.739+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f6ed407a8c0 con 0x7f6edc0c54c0 2023-05-10T01:25:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.739+0000 7f6edb7fe700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.739+0000 7f6edb7fe700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 0x7f6ebc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6ecc009270 tx=0x7f6ecc008040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.743+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ed404bd50 con 0x7f6edc0c54c0 2023-05-10T01:25:37.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.911+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6edc06c340 con 0x7f6ebc05ed90 2023-05-10T01:25:37.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.922+0000 7f6ec37fe700 1 -- 172.21.15.52:0/3631161601 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361447 (secure 0 0 0) 0x7f6edc06c340 con 0x7f6ebc05ed90 2023-05-10T01:25:37.929 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:37.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 msgr2=0x7f6ebc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 0x7f6ebc061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6ecc009270 tx=0x7f6ecc008040).stop 2023-05-10T01:25:37.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 msgr2=0x7f6edc0c5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:37.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f6ed40094d0 tx=0x7f6ed400b040).stop 2023-05-10T01:25:37.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 shutdown_connections 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6ebc05ed90 0x7f6ebc061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6edc0c54c0 0x7f6edc0c5920 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ec8003e10 0x7f6edc150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 --2- 172.21.15.52:0/3631161601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6edc0c2a40 0x7f6edc0c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 >> 172.21.15.52:0/3631161601 conn(0x7f6edc0c8a90 msgr2=0x7f6edc0aafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 shutdown_connections 2023-05-10T01:25:37.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:37.925+0000 7f6ee1e61700 1 -- 172.21.15.52:0/3631161601 wait complete. 2023-05-10T01:25:37.933 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:37.940 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-10T01:25:37.760203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":227,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":160768,"kb_used_data":10432,"kb_used_omap":0,"kb_used_meta":150272,"kb_avail":754813952,"statfs":{"total":773094113280,"available":772929486848,"internally_reserved":0,"allocated":10682368,"data_stored":5374380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":153878528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3251,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-31,"num_write_kb":-12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.162331"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374548+0000","last_change":"2023-05-10T01:25:32.373091+0000","last_active":"2023-05-10T01:25:32.374548+0000","last_peered":"2023-05-10T01:25:32.374548+0000","last_clean":"2023-05-10T01:25:32.374548+0000","last_became_active":"2023-05-10T01:25:32.372806+0000","last_became_peered":"2023-05-10T01:25:32.372806+0000","last_unstale":"2023-05-10T01:25:32.374548+0000","last_undegraded":"2023-05-10T01:25:32.374548+0000","last_fullsized":"2023-05-10T01:25:32.374548+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373351+0000","last_change":"2023-05-10T01:25:31.965910+0000","last_active":"2023-05-10T01:25:32.373351+0000","last_peered":"2023-05-10T01:25:32.373351+0000","last_clean":"2023-05-10T01:25:32.373351+0000","last_became_active":"2023-05-10T01:25:31.964214+0000","last_became_peered":"2023-05-10T01:25:31.964214+0000","last_unstale":"2023-05-10T01:25:32.373351+0000","last_undegraded":"2023-05-10T01:25:32.373351+0000","last_fullsized":"2023-05-10T01:25:32.373351+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367714+0000","last_change":"2023-05-10T01:25:32.365148+0000","last_active":"2023-05-10T01:25:32.367714+0000","last_peered":"2023-05-10T01:25:32.367714+0000","last_clean":"2023-05-10T01:25:32.367714+0000","last_became_active":"2023-05-10T01:25:32.364846+0000","last_became_peered":"2023-05-10T01:25:32.364846+0000","last_unstale":"2023-05-10T01:25:32.367714+0000","last_undegraded":"2023-05-10T01:25:32.367714+0000","last_fullsized":"2023-05-10T01:25:32.367714+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349844+0000","last_change":"2023-05-10T01:25:31.973894+0000","last_active":"2023-05-10T01:25:32.349844+0000","last_peered":"2023-05-10T01:25:32.349844+0000","last_clean":"2023-05-10T01:25:32.349844+0000","last_became_active":"2023-05-10T01:25:31.973604+0000","last_became_peered":"2023-05-10T01:25:31.973604+0000","last_unstale":"2023-05-10T01:25:32.349844+0000","last_undegraded":"2023-05-10T01:25:32.349844+0000","last_fullsized":"2023-05-10T01:25:32.349844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376167+0000","last_change":"2023-05-10T01:25:32.368981+0000","last_active":"2023-05-10T01:25:32.376167+0000","last_peered":"2023-05-10T01:25:32.376167+0000","last_clean":"2023-05-10T01:25:32.376167+0000","last_became_active":"2023-05-10T01:25:32.368559+0000","last_became_peered":"2023-05-10T01:25:32.368559+0000","last_unstale":"2023-05-10T01:25:32.376167+0000","last_undegraded":"2023-05-10T01:25:32.376167+0000","last_fullsized":"2023-05-10T01:25:32.376167+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354908+0000","last_change":"2023-05-10T01:25:31.969011+0000","last_active":"2023-05-10T01:25:32.354908+0000","last_peered":"2023-05-10T01:25:32.354908+0000","last_clean":"2023-05-10T01:25:32.354908+0000","last_became_active":"2023-05-10T01:25:31.968698+0000","last_became_peered":"2023-05-10T01:25:31.968698+0000","last_unstale":"2023-05-10T01:25:32.354908+0000","last_undegraded":"2023-05-10T01:25:32.354908+0000","last_fullsized":"2023-05-10T01:25:32.354908+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362988+0000","last_change":"2023-05-10T01:25:32.361960+0000","last_active":"2023-05-10T01:25:32.362988+0000","last_peered":"2023-05-10T01:25:32.362988+0000","last_clean":"2023-05-10T01:25:32.362988+0000","last_became_active":"2023-05-10T01:25:32.361503+0000","last_became_peered":"2023-05-10T01:25:32.361503+0000","last_unstale":"2023-05-10T01:25:32.362988+0000","last_undegraded":"2023-05-10T01:25:32.362988+0000","last_fullsized":"2023-05-10T01:25:32.362988+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366401+0000","last_change":"2023-05-10T01:25:31.978897+0000","last_active":"2023-05-10T01:25:32.366401+0000","last_peered":"2023-05-10T01:25:32.366401+0000","last_clean":"2023-05-10T01:25:32.366401+0000","last_became_active":"2023-05-10T01:25:31.978566+0000","last_became_peered":"2023-05-10T01:25:31.978566+0000","last_unstale":"2023-05-10T01:25:32.366401+0000","last_undegraded":"2023-05-10T01:25:32.366401+0000","last_fullsized":"2023-05-10T01:25:32.366401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373604+0000","last_change":"2023-05-10T01:25:32.372259+0000","last_active":"2023-05-10T01:25:32.373604+0000","last_peered":"2023-05-10T01:25:32.373604+0000","last_clean":"2023-05-10T01:25:32.373604+0000","last_became_active":"2023-05-10T01:25:32.371998+0000","last_became_peered":"2023-05-10T01:25:32.371998+0000","last_unstale":"2023-05-10T01:25:32.373604+0000","last_undegraded":"2023-05-10T01:25:32.373604+0000","last_fullsized":"2023-05-10T01:25:32.373604+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368400+0000","last_change":"2023-05-10T01:25:31.968968+0000","last_active":"2023-05-10T01:25:32.368400+0000","last_peered":"2023-05-10T01:25:32.368400+0000","last_clean":"2023-05-10T01:25:32.368400+0000","last_became_active":"2023-05-10T01:25:31.968656+0000","last_became_peered":"2023-05-10T01:25:31.968656+0000","last_unstale":"2023-05-10T01:25:32.368400+0000","last_undegraded":"2023-05-10T01:25:32.368400+0000","last_fullsized":"2023-05-10T01:25:32.368400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374895+0000","last_change":"2023-05-10T01:25:32.370871+0000","last_active":"2023-05-10T01:25:32.374895+0000","last_peered":"2023-05-10T01:25:32.374895+0000","last_clean":"2023-05-10T01:25:32.374895+0000","last_became_active":"2023-05-10T01:25:32.370555+0000","last_became_peered":"2023-05-10T01:25:32.370555+0000","last_unstale":"2023-05-10T01:25:32.374895+0000","last_undegraded":"2023-05-10T01:25:32.374895+0000","last_fullsized":"2023-05-10T01:25:32.374895+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368991+0000","last_change":"2023-05-10T01:25:31.968714+0000","last_active":"2023-05-10T01:25:32.368991+0000","last_peered":"2023-05-10T01:25:32.368991+0000","last_clean":"2023-05-10T01:25:32.368991+0000","last_became_active":"2023-05-10T01:25:31.968444+0000","last_became_peered":"2023-05-10T01:25:31.968444+0000","last_unstale":"2023-05-10T01:25:32.368991+0000","last_undegraded":"2023-05-10T01:25:32.368991+0000","last_fullsized":"2023-05-10T01:25:32.368991+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366820+0000","last_change":"2023-05-10T01:25:32.363589+0000","last_active":"2023-05-10T01:25:32.366820+0000","last_peered":"2023-05-10T01:25:32.366820+0000","last_clean":"2023-05-10T01:25:32.366820+0000","last_became_active":"2023-05-10T01:25:32.362966+0000","last_became_peered":"2023-05-10T01:25:32.362966+0000","last_unstale":"2023-05-10T01:25:32.366820+0000","last_undegraded":"2023-05-10T01:25:32.366820+0000","last_fullsized":"2023-05-10T01:25:32.366820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353037+0000","last_change":"2023-05-10T01:25:31.972634+0000","last_active":"2023-05-10T01:25:32.353037+0000","last_peered":"2023-05-10T01:25:32.353037+0000","last_clean":"2023-05-10T01:25:32.353037+0000","last_became_active":"2023-05-10T01:25:31.972348+0000","last_became_peered":"2023-05-10T01:25:31.972348+0000","last_unstale":"2023-05-10T01:25:32.353037+0000","last_undegraded":"2023-05-10T01:25:32.353037+0000","last_fullsized":"2023-05-10T01:25:32.353037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376770+0000","last_change":"2023-05-10T01:25:32.371753+0000","last_active":"2023-05-10T01:25:32.376770+0000","last_peered":"2023-05-10T01:25:32.376770+0000","last_clean":"2023-05-10T01:25:32.376770+0000","last_became_active":"2023-05-10T01:25:32.370996+0000","last_became_peered":"2023-05-10T01:25:32.370996+0000","last_unstale":"2023-05-10T01:25:32.376770+0000","last_undegraded":"2023-05-10T01:25:32.376770+0000","last_fullsized":"2023-05-10T01:25:32.376770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356970+0000","last_change":"2023-05-10T01:25:31.975967+0000","last_active":"2023-05-10T01:25:32.356970+0000","last_peered":"2023-05-10T01:25:32.356970+0000","last_clean":"2023-05-10T01:25:32.356970+0000","last_became_active":"2023-05-10T01:25:31.975602+0000","last_became_peered":"2023-05-10T01:25:31.975602+0000","last_unstale":"2023-05-10T01:25:32.356970+0000","last_undegraded":"2023-05-10T01:25:32.356970+0000","last_fullsized":"2023-05-10T01:25:32.356970+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363723+0000","last_change":"2023-05-10T01:25:32.361013+0000","last_active":"2023-05-10T01:25:32.363723+0000","last_peered":"2023-05-10T01:25:32.363723+0000","last_clean":"2023-05-10T01:25:32.363723+0000","last_became_active":"2023-05-10T01:25:32.360721+0000","last_became_peered":"2023-05-10T01:25:32.360721+0000","last_unstale":"2023-05-10T01:25:32.363723+0000","last_undegraded":"2023-05-10T01:25:32.363723+0000","last_fullsized":"2023-05-10T01:25:32.363723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362236+0000","last_change":"2023-05-10T01:25:31.969866+0000","last_active":"2023-05-10T01:25:32.362236+0000","last_peered":"2023-05-10T01:25:32.362236+0000","last_clean":"2023-05-10T01:25:32.362236+0000","last_became_active":"2023-05-10T01:25:31.969569+0000","last_became_peered":"2023-05-10T01:25:31.969569+0000","last_unstale":"2023-05-10T01:25:32.362236+0000","last_undegraded":"2023-05-10T01:25:32.362236+0000","last_fullsized":"2023-05-10T01:25:32.362236+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372752+0000","last_change":"2023-05-10T01:25:32.367033+0000","last_active":"2023-05-10T01:25:32.372752+0000","last_peered":"2023-05-10T01:25:32.372752+0000","last_clean":"2023-05-10T01:25:32.372752+0000","last_became_active":"2023-05-10T01:25:32.366365+0000","last_became_peered":"2023-05-10T01:25:32.366365+0000","last_unstale":"2023-05-10T01:25:32.372752+0000","last_undegraded":"2023-05-10T01:25:32.372752+0000","last_fullsized":"2023-05-10T01:25:32.372752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358765+0000","last_change":"2023-05-10T01:25:31.978807+0000","last_active":"2023-05-10T01:25:32.358765+0000","last_peered":"2023-05-10T01:25:32.358765+0000","last_clean":"2023-05-10T01:25:32.358765+0000","last_became_active":"2023-05-10T01:25:31.978558+0000","last_became_peered":"2023-05-10T01:25:31.978558+0000","last_unstale":"2023-05-10T01:25:32.358765+0000","last_undegraded":"2023-05-10T01:25:32.358765+0000","last_fullsized":"2023-05-10T01:25:32.358765+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363754+0000","last_change":"2023-05-10T01:25:32.360861+0000","last_active":"2023-05-10T01:25:32.363754+0000","last_peered":"2023-05-10T01:25:32.363754+0000","last_clean":"2023-05-10T01:25:32.363754+0000","last_became_active":"2023-05-10T01:25:32.360568+0000","last_became_peered":"2023-05-10T01:25:32.360568+0000","last_unstale":"2023-05-10T01:25:32.363754+0000","last_undegraded":"2023-05-10T01:25:32.363754+0000","last_fullsized":"2023-05-10T01:25:32.363754+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348836+0000","last_change":"2023-05-10T01:25:31.972948+0000","last_active":"2023-05-10T01:25:32.348836+0000","last_peered":"2023-05-10T01:25:32.348836+0000","last_clean":"2023-05-10T01:25:32.348836+0000","last_became_active":"2023-05-10T01:25:31.972633+0000","last_became_peered":"2023-05-10T01:25:31.972633+0000","last_unstale":"2023-05-10T01:25:32.348836+0000","last_undegraded":"2023-05-10T01:25:32.348836+0000","last_fullsized":"2023-05-10T01:25:32.348836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376702+0000","last_change":"2023-05-10T01:25:32.370331+0000","last_active":"2023-05-10T01:25:32.376702+0000","last_peered":"2023-05-10T01:25:32.376702+0000","last_clean":"2023-05-10T01:25:32.376702+0000","last_became_active":"2023-05-10T01:25:32.370062+0000","last_became_peered":"2023-05-10T01:25:32.370062+0000","last_unstale":"2023-05-10T01:25:32.376702+0000","last_undegraded":"2023-05-10T01:25:32.376702+0000","last_fullsized":"2023-05-10T01:25:32.376702+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379617+0000","last_change":"2023-05-10T01:25:31.972847+0000","last_active":"2023-05-10T01:25:32.379617+0000","last_peered":"2023-05-10T01:25:32.379617+0000","last_clean":"2023-05-10T01:25:32.379617+0000","last_became_active":"2023-05-10T01:25:31.972602+0000","last_became_peered":"2023-05-10T01:25:31.972602+0000","last_unstale":"2023-05-10T01:25:32.379617+0000","last_undegraded":"2023-05-10T01:25:32.379617+0000","last_fullsized":"2023-05-10T01:25:32.379617+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365971+0000","last_change":"2023-05-10T01:25:32.360582+0000","last_active":"2023-05-10T01:25:32.365971+0000","last_peered":"2023-05-10T01:25:32.365971+0000","last_clean":"2023-05-10T01:25:32.365971+0000","last_became_active":"2023-05-10T01:25:32.360271+0000","last_became_peered":"2023-05-10T01:25:32.360271+0000","last_unstale":"2023-05-10T01:25:32.365971+0000","last_undegraded":"2023-05-10T01:25:32.365971+0000","last_fullsized":"2023-05-10T01:25:32.365971+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371039+0000","last_change":"2023-05-10T01:25:31.970446+0000","last_active":"2023-05-10T01:25:32.371039+0000","last_peered":"2023-05-10T01:25:32.371039+0000","last_clean":"2023-05-10T01:25:32.371039+0000","last_became_active":"2023-05-10T01:25:31.970161+0000","last_became_peered":"2023-05-10T01:25:31.970161+0000","last_unstale":"2023-05-10T01:25:32.371039+0000","last_undegraded":"2023-05-10T01:25:32.371039+0000","last_fullsized":"2023-05-10T01:25:32.371039+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365249+0000","last_change":"2023-05-10T01:25:32.359531+0000","last_active":"2023-05-10T01:25:32.365249+0000","last_peered":"2023-05-10T01:25:32.365249+0000","last_clean":"2023-05-10T01:25:32.365249+0000","last_became_active":"2023-05-10T01:25:32.357544+0000","last_became_peered":"2023-05-10T01:25:32.357544+0000","last_unstale":"2023-05-10T01:25:32.365249+0000","last_undegraded":"2023-05-10T01:25:32.365249+0000","last_fullsized":"2023-05-10T01:25:32.365249+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353387+0000","last_change":"2023-05-10T01:25:31.979686+0000","last_active":"2023-05-10T01:25:32.353387+0000","last_peered":"2023-05-10T01:25:32.353387+0000","last_clean":"2023-05-10T01:25:32.353387+0000","last_became_active":"2023-05-10T01:25:31.978877+0000","last_became_peered":"2023-05-10T01:25:31.978877+0000","last_unstale":"2023-05-10T01:25:32.353387+0000","last_undegraded":"2023-05-10T01:25:32.353387+0000","last_fullsized":"2023-05-10T01:25:32.353387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368698+0000","last_change":"2023-05-10T01:25:32.364860+0000","last_active":"2023-05-10T01:25:32.368698+0000","last_peered":"2023-05-10T01:25:32.368698+0000","last_clean":"2023-05-10T01:25:32.368698+0000","last_became_active":"2023-05-10T01:25:32.364645+0000","last_became_peered":"2023-05-10T01:25:32.364645+0000","last_unstale":"2023-05-10T01:25:32.368698+0000","last_undegraded":"2023-05-10T01:25:32.368698+0000","last_fullsized":"2023-05-10T01:25:32.368698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352726+0000","last_change":"2023-05-10T01:25:31.964718+0000","last_active":"2023-05-10T01:25:32.352726+0000","last_peered":"2023-05-10T01:25:32.352726+0000","last_clean":"2023-05-10T01:25:32.352726+0000","last_became_active":"2023-05-10T01:25:31.964432+0000","last_became_peered":"2023-05-10T01:25:31.964432+0000","last_unstale":"2023-05-10T01:25:32.352726+0000","last_undegraded":"2023-05-10T01:25:32.352726+0000","last_fullsized":"2023-05-10T01:25:32.352726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373607+0000","last_change":"2023-05-10T01:25:32.372809+0000","last_active":"2023-05-10T01:25:32.373607+0000","last_peered":"2023-05-10T01:25:32.373607+0000","last_clean":"2023-05-10T01:25:32.373607+0000","last_became_active":"2023-05-10T01:25:32.372525+0000","last_became_peered":"2023-05-10T01:25:32.372525+0000","last_unstale":"2023-05-10T01:25:32.373607+0000","last_undegraded":"2023-05-10T01:25:32.373607+0000","last_fullsized":"2023-05-10T01:25:32.373607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371608+0000","last_change":"2023-05-10T01:25:31.964128+0000","last_active":"2023-05-10T01:25:32.371608+0000","last_peered":"2023-05-10T01:25:32.371608+0000","last_clean":"2023-05-10T01:25:32.371608+0000","last_became_active":"2023-05-10T01:25:31.963858+0000","last_became_peered":"2023-05-10T01:25:31.963858+0000","last_unstale":"2023-05-10T01:25:32.371608+0000","last_undegraded":"2023-05-10T01:25:32.371608+0000","last_fullsized":"2023-05-10T01:25:32.371608+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365321+0000","last_change":"2023-05-10T01:25:32.358660+0000","last_active":"2023-05-10T01:25:32.365321+0000","last_peered":"2023-05-10T01:25:32.365321+0000","last_clean":"2023-05-10T01:25:32.365321+0000","last_became_active":"2023-05-10T01:25:32.358335+0000","last_became_peered":"2023-05-10T01:25:32.358335+0000","last_unstale":"2023-05-10T01:25:32.365321+0000","last_undegraded":"2023-05-10T01:25:32.365321+0000","last_fullsized":"2023-05-10T01:25:32.365321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354715+0000","last_change":"2023-05-10T01:25:31.968051+0000","last_active":"2023-05-10T01:25:32.354715+0000","last_peered":"2023-05-10T01:25:32.354715+0000","last_clean":"2023-05-10T01:25:32.354715+0000","last_became_active":"2023-05-10T01:25:31.967744+0000","last_became_peered":"2023-05-10T01:25:31.967744+0000","last_unstale":"2023-05-10T01:25:32.354715+0000","last_undegraded":"2023-05-10T01:25:32.354715+0000","last_fullsized":"2023-05-10T01:25:32.354715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376381+0000","last_change":"2023-05-10T01:25:32.368882+0000","last_active":"2023-05-10T01:25:32.376381+0000","last_peered":"2023-05-10T01:25:32.376381+0000","last_clean":"2023-05-10T01:25:32.376381+0000","last_became_active":"2023-05-10T01:25:32.368593+0000","last_became_peered":"2023-05-10T01:25:32.368593+0000","last_unstale":"2023-05-10T01:25:32.376381+0000","last_undegraded":"2023-05-10T01:25:32.376381+0000","last_fullsized":"2023-05-10T01:25:32.376381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353740+0000","last_change":"2023-05-10T01:25:31.965170+0000","last_active":"2023-05-10T01:25:32.353740+0000","last_peered":"2023-05-10T01:25:32.353740+0000","last_clean":"2023-05-10T01:25:32.353740+0000","last_became_active":"2023-05-10T01:25:31.964889+0000","last_became_peered":"2023-05-10T01:25:31.964889+0000","last_unstale":"2023-05-10T01:25:32.353740+0000","last_undegraded":"2023-05-10T01:25:32.353740+0000","last_fullsized":"2023-05-10T01:25:32.353740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370701+0000","last_change":"2023-05-10T01:25:32.369797+0000","last_active":"2023-05-10T01:25:32.370701+0000","last_peered":"2023-05-10T01:25:32.370701+0000","last_clean":"2023-05-10T01:25:32.370701+0000","last_became_active":"2023-05-10T01:25:32.369393+0000","last_became_peered":"2023-05-10T01:25:32.369393+0000","last_unstale":"2023-05-10T01:25:32.370701+0000","last_undegraded":"2023-05-10T01:25:32.370701+0000","last_fullsized":"2023-05-10T01:25:32.370701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364256+0000","last_change":"2023-05-10T01:25:31.965803+0000","last_active":"2023-05-10T01:25:32.364256+0000","last_peered":"2023-05-10T01:25:32.364256+0000","last_clean":"2023-05-10T01:25:32.364256+0000","last_became_active":"2023-05-10T01:25:31.965495+0000","last_became_peered":"2023-05-10T01:25:31.965495+0000","last_unstale":"2023-05-10T01:25:32.364256+0000","last_undegraded":"2023-05-10T01:25:32.364256+0000","last_fullsized":"2023-05-10T01:25:32.364256+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365650+0000","last_change":"2023-05-10T01:25:32.361745+0000","last_active":"2023-05-10T01:25:32.365650+0000","last_peered":"2023-05-10T01:25:32.365650+0000","last_clean":"2023-05-10T01:25:32.365650+0000","last_became_active":"2023-05-10T01:25:32.361473+0000","last_became_peered":"2023-05-10T01:25:32.361473+0000","last_unstale":"2023-05-10T01:25:32.365650+0000","last_undegraded":"2023-05-10T01:25:32.365650+0000","last_fullsized":"2023-05-10T01:25:32.365650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354188+0000","last_change":"2023-05-10T01:25:31.972607+0000","last_active":"2023-05-10T01:25:32.354188+0000","last_peered":"2023-05-10T01:25:32.354188+0000","last_clean":"2023-05-10T01:25:32.354188+0000","last_became_active":"2023-05-10T01:25:31.972048+0000","last_became_peered":"2023-05-10T01:25:31.972048+0000","last_unstale":"2023-05-10T01:25:32.354188+0000","last_undegraded":"2023-05-10T01:25:32.354188+0000","last_fullsized":"2023-05-10T01:25:32.354188+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367027+0000","last_change":"2023-05-10T01:25:32.362548+0000","last_active":"2023-05-10T01:25:32.367027+0000","last_peered":"2023-05-10T01:25:32.367027+0000","last_clean":"2023-05-10T01:25:32.367027+0000","last_became_active":"2023-05-10T01:25:32.361461+0000","last_became_peered":"2023-05-10T01:25:32.361461+0000","last_unstale":"2023-05-10T01:25:32.367027+0000","last_undegraded":"2023-05-10T01:25:32.367027+0000","last_fullsized":"2023-05-10T01:25:32.367027+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365703+0000","last_change":"2023-05-10T01:25:31.969371+0000","last_active":"2023-05-10T01:25:32.365703+0000","last_peered":"2023-05-10T01:25:32.365703+0000","last_clean":"2023-05-10T01:25:32.365703+0000","last_became_active":"2023-05-10T01:25:31.969080+0000","last_became_peered":"2023-05-10T01:25:31.969080+0000","last_unstale":"2023-05-10T01:25:32.365703+0000","last_undegraded":"2023-05-10T01:25:32.365703+0000","last_fullsized":"2023-05-10T01:25:32.365703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379359+0000","last_change":"2023-05-10T01:25:32.371134+0000","last_active":"2023-05-10T01:25:32.379359+0000","last_peered":"2023-05-10T01:25:32.379359+0000","last_clean":"2023-05-10T01:25:32.379359+0000","last_became_active":"2023-05-10T01:25:32.370711+0000","last_became_peered":"2023-05-10T01:25:32.370711+0000","last_unstale":"2023-05-10T01:25:32.379359+0000","last_undegraded":"2023-05-10T01:25:32.379359+0000","last_fullsized":"2023-05-10T01:25:32.379359+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350385+0000","last_change":"2023-05-10T01:25:31.974405+0000","last_active":"2023-05-10T01:25:32.350385+0000","last_peered":"2023-05-10T01:25:32.350385+0000","last_clean":"2023-05-10T01:25:32.350385+0000","last_became_active":"2023-05-10T01:25:31.974108+0000","last_became_peered":"2023-05-10T01:25:31.974108+0000","last_unstale":"2023-05-10T01:25:32.350385+0000","last_undegraded":"2023-05-10T01:25:32.350385+0000","last_fullsized":"2023-05-10T01:25:32.350385+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368717+0000","last_change":"2023-05-10T01:25:32.365374+0000","last_active":"2023-05-10T01:25:32.368717+0000","last_peered":"2023-05-10T01:25:32.368717+0000","last_clean":"2023-05-10T01:25:32.368717+0000","last_became_active":"2023-05-10T01:25:32.365088+0000","last_became_peered":"2023-05-10T01:25:32.365088+0000","last_unstale":"2023-05-10T01:25:32.368717+0000","last_undegraded":"2023-05-10T01:25:32.368717+0000","last_fullsized":"2023-05-10T01:25:32.368717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360684+0000","last_change":"2023-05-10T01:25:31.969657+0000","last_active":"2023-05-10T01:25:32.360684+0000","last_peered":"2023-05-10T01:25:32.360684+0000","last_clean":"2023-05-10T01:25:32.360684+0000","last_became_active":"2023-05-10T01:25:31.968950+0000","last_became_peered":"2023-05-10T01:25:31.968950+0000","last_unstale":"2023-05-10T01:25:32.360684+0000","last_undegraded":"2023-05-10T01:25:32.360684+0000","last_fullsized":"2023-05-10T01:25:32.360684+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376819+0000","last_change":"2023-05-10T01:25:32.373347+0000","last_active":"2023-05-10T01:25:32.376819+0000","last_peered":"2023-05-10T01:25:32.376819+0000","last_clean":"2023-05-10T01:25:32.376819+0000","last_became_active":"2023-05-10T01:25:32.371753+0000","last_became_peered":"2023-05-10T01:25:32.371753+0000","last_unstale":"2023-05-10T01:25:32.376819+0000","last_undegraded":"2023-05-10T01:25:32.376819+0000","last_fullsized":"2023-05-10T01:25:32.376819+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353308+0000","last_change":"2023-05-10T01:25:31.969920+0000","last_active":"2023-05-10T01:25:32.353308+0000","last_peered":"2023-05-10T01:25:32.353308+0000","last_clean":"2023-05-10T01:25:32.353308+0000","last_became_active":"2023-05-10T01:25:31.969667+0000","last_became_peered":"2023-05-10T01:25:31.969667+0000","last_unstale":"2023-05-10T01:25:32.353308+0000","last_undegraded":"2023-05-10T01:25:32.353308+0000","last_fullsized":"2023-05-10T01:25:32.353308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365341+0000","last_change":"2023-05-10T01:25:32.360107+0000","last_active":"2023-05-10T01:25:32.365341+0000","last_peered":"2023-05-10T01:25:32.365341+0000","last_clean":"2023-05-10T01:25:32.365341+0000","last_became_active":"2023-05-10T01:25:32.359824+0000","last_became_peered":"2023-05-10T01:25:32.359824+0000","last_unstale":"2023-05-10T01:25:32.365341+0000","last_undegraded":"2023-05-10T01:25:32.365341+0000","last_fullsized":"2023-05-10T01:25:32.365341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349439+0000","last_change":"2023-05-10T01:25:31.976138+0000","last_active":"2023-05-10T01:25:32.349439+0000","last_peered":"2023-05-10T01:25:32.349439+0000","last_clean":"2023-05-10T01:25:32.349439+0000","last_became_active":"2023-05-10T01:25:31.975542+0000","last_became_peered":"2023-05-10T01:25:31.975542+0000","last_unstale":"2023-05-10T01:25:32.349439+0000","last_undegraded":"2023-05-10T01:25:32.349439+0000","last_fullsized":"2023-05-10T01:25:32.349439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374644+0000","last_change":"2023-05-10T01:25:32.373032+0000","last_active":"2023-05-10T01:25:32.374644+0000","last_peered":"2023-05-10T01:25:32.374644+0000","last_clean":"2023-05-10T01:25:32.374644+0000","last_became_active":"2023-05-10T01:25:32.372770+0000","last_became_peered":"2023-05-10T01:25:32.372770+0000","last_unstale":"2023-05-10T01:25:32.374644+0000","last_undegraded":"2023-05-10T01:25:32.374644+0000","last_fullsized":"2023-05-10T01:25:32.374644+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354848+0000","last_change":"2023-05-10T01:25:31.975996+0000","last_active":"2023-05-10T01:25:32.354848+0000","last_peered":"2023-05-10T01:25:32.354848+0000","last_clean":"2023-05-10T01:25:32.354848+0000","last_became_active":"2023-05-10T01:25:31.975657+0000","last_became_peered":"2023-05-10T01:25:31.975657+0000","last_unstale":"2023-05-10T01:25:32.354848+0000","last_undegraded":"2023-05-10T01:25:32.354848+0000","last_fullsized":"2023-05-10T01:25:32.354848+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376335+0000","last_change":"2023-05-10T01:25:32.369001+0000","last_active":"2023-05-10T01:25:32.376335+0000","last_peered":"2023-05-10T01:25:32.376335+0000","last_clean":"2023-05-10T01:25:32.376335+0000","last_became_active":"2023-05-10T01:25:32.368656+0000","last_became_peered":"2023-05-10T01:25:32.368656+0000","last_unstale":"2023-05-10T01:25:32.376335+0000","last_undegraded":"2023-05-10T01:25:32.376335+0000","last_fullsized":"2023-05-10T01:25:32.376335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356938+0000","last_change":"2023-05-10T01:25:31.966263+0000","last_active":"2023-05-10T01:25:32.356938+0000","last_peered":"2023-05-10T01:25:32.356938+0000","last_clean":"2023-05-10T01:25:32.356938+0000","last_became_active":"2023-05-10T01:25:31.965960+0000","last_became_peered":"2023-05-10T01:25:31.965960+0000","last_unstale":"2023-05-10T01:25:32.356938+0000","last_undegraded":"2023-05-10T01:25:32.356938+0000","last_fullsized":"2023-05-10T01:25:32.356938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376347+0000","last_change":"2023-05-10T01:25:32.370819+0000","last_active":"2023-05-10T01:25:32.376347+0000","last_peered":"2023-05-10T01:25:32.376347+0000","last_clean":"2023-05-10T01:25:32.376347+0000","last_became_active":"2023-05-10T01:25:32.370546+0000","last_became_peered":"2023-05-10T01:25:32.370546+0000","last_unstale":"2023-05-10T01:25:32.376347+0000","last_undegraded":"2023-05-10T01:25:32.376347+0000","last_fullsized":"2023-05-10T01:25:32.376347+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365404+0000","last_change":"2023-05-10T01:25:31.964631+0000","last_active":"2023-05-10T01:25:32.365404+0000","last_peered":"2023-05-10T01:25:32.365404+0000","last_clean":"2023-05-10T01:25:32.365404+0000","last_became_active":"2023-05-10T01:25:31.964245+0000","last_became_peered":"2023-05-10T01:25:31.964245+0000","last_unstale":"2023-05-10T01:25:32.365404+0000","last_undegraded":"2023-05-10T01:25:32.365404+0000","last_fullsized":"2023-05-10T01:25:32.365404+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364429+0000","last_change":"2023-05-10T01:25:32.355599+0000","last_active":"2023-05-10T01:25:32.364429+0000","last_peered":"2023-05-10T01:25:32.364429+0000","last_clean":"2023-05-10T01:25:32.364429+0000","last_became_active":"2023-05-10T01:25:32.355323+0000","last_became_peered":"2023-05-10T01:25:32.355323+0000","last_unstale":"2023-05-10T01:25:32.364429+0000","last_undegraded":"2023-05-10T01:25:32.364429+0000","last_fullsized":"2023-05-10T01:25:32.364429+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349588+0000","last_change":"2023-05-10T01:25:31.975172+0000","last_active":"2023-05-10T01:25:32.349588+0000","last_peered":"2023-05-10T01:25:32.349588+0000","last_clean":"2023-05-10T01:25:32.349588+0000","last_became_active":"2023-05-10T01:25:31.974835+0000","last_became_peered":"2023-05-10T01:25:31.974835+0000","last_unstale":"2023-05-10T01:25:32.349588+0000","last_undegraded":"2023-05-10T01:25:32.349588+0000","last_fullsized":"2023-05-10T01:25:32.349588+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376179+0000","last_change":"2023-05-10T01:25:32.369364+0000","last_active":"2023-05-10T01:25:32.376179+0000","last_peered":"2023-05-10T01:25:32.376179+0000","last_clean":"2023-05-10T01:25:32.376179+0000","last_became_active":"2023-05-10T01:25:32.369073+0000","last_became_peered":"2023-05-10T01:25:32.369073+0000","last_unstale":"2023-05-10T01:25:32.376179+0000","last_undegraded":"2023-05-10T01:25:32.376179+0000","last_fullsized":"2023-05-10T01:25:32.376179+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351477+0000","last_change":"2023-05-10T01:25:31.970025+0000","last_active":"2023-05-10T01:25:32.351477+0000","last_peered":"2023-05-10T01:25:32.351477+0000","last_clean":"2023-05-10T01:25:32.351477+0000","last_became_active":"2023-05-10T01:25:31.969551+0000","last_became_peered":"2023-05-10T01:25:31.969551+0000","last_unstale":"2023-05-10T01:25:32.351477+0000","last_undegraded":"2023-05-10T01:25:32.351477+0000","last_fullsized":"2023-05-10T01:25:32.351477+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376740+0000","last_change":"2023-05-10T01:25:32.369898+0000","last_active":"2023-05-10T01:25:32.376740+0000","last_peered":"2023-05-10T01:25:32.376740+0000","last_clean":"2023-05-10T01:25:32.376740+0000","last_became_active":"2023-05-10T01:25:32.369619+0000","last_became_peered":"2023-05-10T01:25:32.369619+0000","last_unstale":"2023-05-10T01:25:32.376740+0000","last_undegraded":"2023-05-10T01:25:32.376740+0000","last_fullsized":"2023-05-10T01:25:32.376740+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352932+0000","last_change":"2023-05-10T01:25:31.969673+0000","last_active":"2023-05-10T01:25:32.352932+0000","last_peered":"2023-05-10T01:25:32.352932+0000","last_clean":"2023-05-10T01:25:32.352932+0000","last_became_active":"2023-05-10T01:25:31.969390+0000","last_became_peered":"2023-05-10T01:25:31.969390+0000","last_unstale":"2023-05-10T01:25:32.352932+0000","last_undegraded":"2023-05-10T01:25:32.352932+0000","last_fullsized":"2023-05-10T01:25:32.352932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376511+0000","last_change":"2023-05-10T01:25:32.371772+0000","last_active":"2023-05-10T01:25:32.376511+0000","last_peered":"2023-05-10T01:25:32.376511+0000","last_clean":"2023-05-10T01:25:32.376511+0000","last_became_active":"2023-05-10T01:25:32.371294+0000","last_became_peered":"2023-05-10T01:25:32.371294+0000","last_unstale":"2023-05-10T01:25:32.376511+0000","last_undegraded":"2023-05-10T01:25:32.376511+0000","last_fullsized":"2023-05-10T01:25:32.376511+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358497+0000","last_change":"2023-05-10T01:25:31.977602+0000","last_active":"2023-05-10T01:25:32.358497+0000","last_peered":"2023-05-10T01:25:32.358497+0000","last_clean":"2023-05-10T01:25:32.358497+0000","last_became_active":"2023-05-10T01:25:31.977318+0000","last_became_peered":"2023-05-10T01:25:31.977318+0000","last_unstale":"2023-05-10T01:25:32.358497+0000","last_undegraded":"2023-05-10T01:25:32.358497+0000","last_fullsized":"2023-05-10T01:25:32.358497+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364760+0000","last_change":"2023-05-10T01:25:32.357255+0000","last_active":"2023-05-10T01:25:32.364760+0000","last_peered":"2023-05-10T01:25:32.364760+0000","last_clean":"2023-05-10T01:25:32.364760+0000","last_became_active":"2023-05-10T01:25:32.356612+0000","last_became_peered":"2023-05-10T01:25:32.356612+0000","last_unstale":"2023-05-10T01:25:32.364760+0000","last_undegraded":"2023-05-10T01:25:32.364760+0000","last_fullsized":"2023-05-10T01:25:32.364760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370591+0000","last_change":"2023-05-10T01:25:31.970847+0000","last_active":"2023-05-10T01:25:32.370591+0000","last_peered":"2023-05-10T01:25:32.370591+0000","last_clean":"2023-05-10T01:25:32.370591+0000","last_became_active":"2023-05-10T01:25:31.970405+0000","last_became_peered":"2023-05-10T01:25:31.970405+0000","last_unstale":"2023-05-10T01:25:32.370591+0000","last_undegraded":"2023-05-10T01:25:32.370591+0000","last_fullsized":"2023-05-10T01:25:32.370591+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364316+0000","last_change":"2023-05-10T01:25:32.358354+0000","last_active":"2023-05-10T01:25:32.364316+0000","last_peered":"2023-05-10T01:25:32.364316+0000","last_clean":"2023-05-10T01:25:32.364316+0000","last_became_active":"2023-05-10T01:25:32.358100+0000","last_became_peered":"2023-05-10T01:25:32.358100+0000","last_unstale":"2023-05-10T01:25:32.364316+0000","last_undegraded":"2023-05-10T01:25:32.364316+0000","last_fullsized":"2023-05-10T01:25:32.364316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370725+0000","last_change":"2023-05-10T01:25:31.964658+0000","last_active":"2023-05-10T01:25:32.370725+0000","last_peered":"2023-05-10T01:25:32.370725+0000","last_clean":"2023-05-10T01:25:32.370725+0000","last_became_active":"2023-05-10T01:25:31.964396+0000","last_became_peered":"2023-05-10T01:25:31.964396+0000","last_unstale":"2023-05-10T01:25:32.370725+0000","last_undegraded":"2023-05-10T01:25:32.370725+0000","last_fullsized":"2023-05-10T01:25:32.370725+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374492+0000","last_change":"2023-05-10T01:25:32.364797+0000","last_active":"2023-05-10T01:25:32.374492+0000","last_peered":"2023-05-10T01:25:32.374492+0000","last_clean":"2023-05-10T01:25:32.374492+0000","last_became_active":"2023-05-10T01:25:32.364521+0000","last_became_peered":"2023-05-10T01:25:32.364521+0000","last_unstale":"2023-05-10T01:25:32.374492+0000","last_undegraded":"2023-05-10T01:25:32.374492+0000","last_fullsized":"2023-05-10T01:25:32.374492+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374401+0000","last_change":"2023-05-10T01:25:31.979334+0000","last_active":"2023-05-10T01:25:32.374401+0000","last_peered":"2023-05-10T01:25:32.374401+0000","last_clean":"2023-05-10T01:25:32.374401+0000","last_became_active":"2023-05-10T01:25:31.979046+0000","last_became_peered":"2023-05-10T01:25:31.979046+0000","last_unstale":"2023-05-10T01:25:32.374401+0000","last_undegraded":"2023-05-10T01:25:32.374401+0000","last_fullsized":"2023-05-10T01:25:32.374401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373788+0000","last_change":"2023-05-10T01:25:32.372782+0000","last_active":"2023-05-10T01:25:32.373788+0000","last_peered":"2023-05-10T01:25:32.373788+0000","last_clean":"2023-05-10T01:25:32.373788+0000","last_became_active":"2023-05-10T01:25:32.372495+0000","last_became_peered":"2023-05-10T01:25:32.372495+0000","last_unstale":"2023-05-10T01:25:32.373788+0000","last_undegraded":"2023-05-10T01:25:32.373788+0000","last_fullsized":"2023-05-10T01:25:32.373788+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365277+0000","last_change":"2023-05-10T01:25:31.976181+0000","last_active":"2023-05-10T01:25:32.365277+0000","last_peered":"2023-05-10T01:25:32.365277+0000","last_clean":"2023-05-10T01:25:32.365277+0000","last_became_active":"2023-05-10T01:25:31.975819+0000","last_became_peered":"2023-05-10T01:25:31.975819+0000","last_unstale":"2023-05-10T01:25:32.365277+0000","last_undegraded":"2023-05-10T01:25:32.365277+0000","last_fullsized":"2023-05-10T01:25:32.365277+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368627+0000","last_change":"2023-05-10T01:25:32.363765+0000","last_active":"2023-05-10T01:25:32.368627+0000","last_peered":"2023-05-10T01:25:32.368627+0000","last_clean":"2023-05-10T01:25:32.368627+0000","last_became_active":"2023-05-10T01:25:32.363478+0000","last_became_peered":"2023-05-10T01:25:32.363478+0000","last_unstale":"2023-05-10T01:25:32.368627+0000","last_undegraded":"2023-05-10T01:25:32.368627+0000","last_fullsized":"2023-05-10T01:25:32.368627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353472+0000","last_change":"2023-05-10T01:25:31.965616+0000","last_active":"2023-05-10T01:25:32.353472+0000","last_peered":"2023-05-10T01:25:32.353472+0000","last_clean":"2023-05-10T01:25:32.353472+0000","last_became_active":"2023-05-10T01:25:31.965290+0000","last_became_peered":"2023-05-10T01:25:31.965290+0000","last_unstale":"2023-05-10T01:25:32.353472+0000","last_undegraded":"2023-05-10T01:25:32.353472+0000","last_fullsized":"2023-05-10T01:25:32.353472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376337+0000","last_change":"2023-05-10T01:25:32.371473+0000","last_active":"2023-05-10T01:25:32.376337+0000","last_peered":"2023-05-10T01:25:32.376337+0000","last_clean":"2023-05-10T01:25:32.376337+0000","last_became_active":"2023-05-10T01:25:32.370626+0000","last_became_peered":"2023-05-10T01:25:32.370626+0000","last_unstale":"2023-05-10T01:25:32.376337+0000","last_undegraded":"2023-05-10T01:25:32.376337+0000","last_fullsized":"2023-05-10T01:25:32.376337+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350534+0000","last_change":"2023-05-10T01:25:31.969840+0000","last_active":"2023-05-10T01:25:32.350534+0000","last_peered":"2023-05-10T01:25:32.350534+0000","last_clean":"2023-05-10T01:25:32.350534+0000","last_became_active":"2023-05-10T01:25:31.969152+0000","last_became_peered":"2023-05-10T01:25:31.969152+0000","last_unstale":"2023-05-10T01:25:32.350534+0000","last_undegraded":"2023-05-10T01:25:32.350534+0000","last_fullsized":"2023-05-10T01:25:32.350534+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366836+0000","last_change":"2023-05-10T01:25:32.363757+0000","last_active":"2023-05-10T01:25:32.366836+0000","last_peered":"2023-05-10T01:25:32.366836+0000","last_clean":"2023-05-10T01:25:32.366836+0000","last_became_active":"2023-05-10T01:25:32.363316+0000","last_became_peered":"2023-05-10T01:25:32.363316+0000","last_unstale":"2023-05-10T01:25:32.366836+0000","last_undegraded":"2023-05-10T01:25:32.366836+0000","last_fullsized":"2023-05-10T01:25:32.366836+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352830+0000","last_change":"2023-05-10T01:25:31.964677+0000","last_active":"2023-05-10T01:25:32.352830+0000","last_peered":"2023-05-10T01:25:32.352830+0000","last_clean":"2023-05-10T01:25:32.352830+0000","last_became_active":"2023-05-10T01:25:31.964357+0000","last_became_peered":"2023-05-10T01:25:31.964357+0000","last_unstale":"2023-05-10T01:25:32.352830+0000","last_undegraded":"2023-05-10T01:25:32.352830+0000","last_fullsized":"2023-05-10T01:25:32.352830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371284+0000","last_change":"2023-05-10T01:25:32.370504+0000","last_active":"2023-05-10T01:25:32.371284+0000","last_peered":"2023-05-10T01:25:32.371284+0000","last_clean":"2023-05-10T01:25:32.371284+0000","last_became_active":"2023-05-10T01:25:32.370218+0000","last_became_peered":"2023-05-10T01:25:32.370218+0000","last_unstale":"2023-05-10T01:25:32.371284+0000","last_undegraded":"2023-05-10T01:25:32.371284+0000","last_fullsized":"2023-05-10T01:25:32.371284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360756+0000","last_change":"2023-05-10T01:25:31.971175+0000","last_active":"2023-05-10T01:25:32.360756+0000","last_peered":"2023-05-10T01:25:32.360756+0000","last_clean":"2023-05-10T01:25:32.360756+0000","last_became_active":"2023-05-10T01:25:31.970883+0000","last_became_peered":"2023-05-10T01:25:31.970883+0000","last_unstale":"2023-05-10T01:25:32.360756+0000","last_undegraded":"2023-05-10T01:25:32.360756+0000","last_fullsized":"2023-05-10T01:25:32.360756+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366998+0000","last_change":"2023-05-10T01:25:32.363317+0000","last_active":"2023-05-10T01:25:32.366998+0000","last_peered":"2023-05-10T01:25:32.366998+0000","last_clean":"2023-05-10T01:25:32.366998+0000","last_became_active":"2023-05-10T01:25:32.362892+0000","last_became_peered":"2023-05-10T01:25:32.362892+0000","last_unstale":"2023-05-10T01:25:32.366998+0000","last_undegraded":"2023-05-10T01:25:32.366998+0000","last_fullsized":"2023-05-10T01:25:32.366998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362291+0000","last_change":"2023-05-10T01:25:31.969313+0000","last_active":"2023-05-10T01:25:32.362291+0000","last_peered":"2023-05-10T01:25:32.362291+0000","last_clean":"2023-05-10T01:25:32.362291+0000","last_became_active":"2023-05-10T01:25:31.969042+0000","last_became_peered":"2023-05-10T01:25:31.969042+0000","last_unstale":"2023-05-10T01:25:32.362291+0000","last_undegraded":"2023-05-10T01:25:32.362291+0000","last_fullsized":"2023-05-10T01:25:32.362291+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374508+0000","last_change":"2023-05-10T01:25:32.370843+0000","last_active":"2023-05-10T01:25:32.374508+0000","last_peered":"2023-05-10T01:25:32.374508+0000","last_clean":"2023-05-10T01:25:32.374508+0000","last_became_active":"2023-05-10T01:25:32.370531+0000","last_became_peered":"2023-05-10T01:25:32.370531+0000","last_unstale":"2023-05-10T01:25:32.374508+0000","last_undegraded":"2023-05-10T01:25:32.374508+0000","last_fullsized":"2023-05-10T01:25:32.374508+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353420+0000","last_change":"2023-05-10T01:25:31.978033+0000","last_active":"2023-05-10T01:25:32.353420+0000","last_peered":"2023-05-10T01:25:32.353420+0000","last_clean":"2023-05-10T01:25:32.353420+0000","last_became_active":"2023-05-10T01:25:31.977683+0000","last_became_peered":"2023-05-10T01:25:31.977683+0000","last_unstale":"2023-05-10T01:25:32.353420+0000","last_undegraded":"2023-05-10T01:25:32.353420+0000","last_fullsized":"2023-05-10T01:25:32.353420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363570+0000","last_change":"2023-05-10T01:25:32.361937+0000","last_active":"2023-05-10T01:25:32.363570+0000","last_peered":"2023-05-10T01:25:32.363570+0000","last_clean":"2023-05-10T01:25:32.363570+0000","last_became_active":"2023-05-10T01:25:32.361656+0000","last_became_peered":"2023-05-10T01:25:32.361656+0000","last_unstale":"2023-05-10T01:25:32.363570+0000","last_undegraded":"2023-05-10T01:25:32.363570+0000","last_fullsized":"2023-05-10T01:25:32.363570+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.369356+0000","last_change":"2023-05-10T01:25:31.970229+0000","last_active":"2023-05-10T01:25:32.369356+0000","last_peered":"2023-05-10T01:25:32.369356+0000","last_clean":"2023-05-10T01:25:32.369356+0000","last_became_active":"2023-05-10T01:25:31.969792+0000","last_became_peered":"2023-05-10T01:25:31.969792+0000","last_unstale":"2023-05-10T01:25:32.369356+0000","last_undegraded":"2023-05-10T01:25:32.369356+0000","last_fullsized":"2023-05-10T01:25:32.369356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370768+0000","last_change":"2023-05-10T01:25:32.369554+0000","last_active":"2023-05-10T01:25:32.370768+0000","last_peered":"2023-05-10T01:25:32.370768+0000","last_clean":"2023-05-10T01:25:32.370768+0000","last_became_active":"2023-05-10T01:25:32.369128+0000","last_became_peered":"2023-05-10T01:25:32.369128+0000","last_unstale":"2023-05-10T01:25:32.370768+0000","last_undegraded":"2023-05-10T01:25:32.370768+0000","last_fullsized":"2023-05-10T01:25:32.370768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368771+0000","last_change":"2023-05-10T01:25:31.965952+0000","last_active":"2023-05-10T01:25:32.368771+0000","last_peered":"2023-05-10T01:25:32.368771+0000","last_clean":"2023-05-10T01:25:32.368771+0000","last_became_active":"2023-05-10T01:25:31.965197+0000","last_became_peered":"2023-05-10T01:25:31.965197+0000","last_unstale":"2023-05-10T01:25:32.368771+0000","last_undegraded":"2023-05-10T01:25:32.368771+0000","last_fullsized":"2023-05-10T01:25:32.368771+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373623+0000","last_change":"2023-05-10T01:25:32.372333+0000","last_active":"2023-05-10T01:25:32.373623+0000","last_peered":"2023-05-10T01:25:32.373623+0000","last_clean":"2023-05-10T01:25:32.373623+0000","last_became_active":"2023-05-10T01:25:32.372045+0000","last_became_peered":"2023-05-10T01:25:32.372045+0000","last_unstale":"2023-05-10T01:25:32.373623+0000","last_undegraded":"2023-05-10T01:25:32.373623+0000","last_fullsized":"2023-05-10T01:25:32.373623+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372282+0000","last_change":"2023-05-10T01:25:31.971185+0000","last_active":"2023-05-10T01:25:32.372282+0000","last_peered":"2023-05-10T01:25:32.372282+0000","last_clean":"2023-05-10T01:25:32.372282+0000","last_became_active":"2023-05-10T01:25:31.970905+0000","last_became_peered":"2023-05-10T01:25:31.970905+0000","last_unstale":"2023-05-10T01:25:32.372282+0000","last_undegraded":"2023-05-10T01:25:32.372282+0000","last_fullsized":"2023-05-10T01:25:32.372282+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376801+0000","last_change":"2023-05-10T01:25:32.373164+0000","last_active":"2023-05-10T01:25:32.376801+0000","last_peered":"2023-05-10T01:25:32.376801+0000","last_clean":"2023-05-10T01:25:32.376801+0000","last_became_active":"2023-05-10T01:25:32.372876+0000","last_became_peered":"2023-05-10T01:25:32.372876+0000","last_unstale":"2023-05-10T01:25:32.376801+0000","last_undegraded":"2023-05-10T01:25:32.376801+0000","last_fullsized":"2023-05-10T01:25:32.376801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.346366+0000","last_change":"2023-05-10T01:25:31.963088+0000","last_active":"2023-05-10T01:25:32.346366+0000","last_peered":"2023-05-10T01:25:32.346366+0000","last_clean":"2023-05-10T01:25:32.346366+0000","last_became_active":"2023-05-10T01:25:31.962304+0000","last_became_peered":"2023-05-10T01:25:31.962304+0000","last_unstale":"2023-05-10T01:25:32.346366+0000","last_undegraded":"2023-05-10T01:25:32.346366+0000","last_fullsized":"2023-05-10T01:25:32.346366+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364353+0000","last_change":"2023-05-10T01:25:32.363444+0000","last_active":"2023-05-10T01:25:32.364353+0000","last_peered":"2023-05-10T01:25:32.364353+0000","last_clean":"2023-05-10T01:25:32.364353+0000","last_became_active":"2023-05-10T01:25:32.363205+0000","last_became_peered":"2023-05-10T01:25:32.363205+0000","last_unstale":"2023-05-10T01:25:32.364353+0000","last_undegraded":"2023-05-10T01:25:32.364353+0000","last_fullsized":"2023-05-10T01:25:32.364353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348946+0000","last_change":"2023-05-10T01:25:31.973667+0000","last_active":"2023-05-10T01:25:32.348946+0000","last_peered":"2023-05-10T01:25:32.348946+0000","last_clean":"2023-05-10T01:25:32.348946+0000","last_became_active":"2023-05-10T01:25:31.973364+0000","last_became_peered":"2023-05-10T01:25:31.973364+0000","last_unstale":"2023-05-10T01:25:32.348946+0000","last_undegraded":"2023-05-10T01:25:32.348946+0000","last_fullsized":"2023-05-10T01:25:32.348946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363667+0000","last_change":"2023-05-10T01:25:32.360888+0000","last_active":"2023-05-10T01:25:32.363667+0000","last_peered":"2023-05-10T01:25:32.363667+0000","last_clean":"2023-05-10T01:25:32.363667+0000","last_became_active":"2023-05-10T01:25:32.360630+0000","last_became_peered":"2023-05-10T01:25:32.360630+0000","last_unstale":"2023-05-10T01:25:32.363667+0000","last_undegraded":"2023-05-10T01:25:32.363667+0000","last_fullsized":"2023-05-10T01:25:32.363667+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365017+0000","last_change":"2023-05-10T01:25:31.973649+0000","last_active":"2023-05-10T01:25:32.365017+0000","last_peered":"2023-05-10T01:25:32.365017+0000","last_clean":"2023-05-10T01:25:32.365017+0000","last_became_active":"2023-05-10T01:25:31.973312+0000","last_became_peered":"2023-05-10T01:25:31.973312+0000","last_unstale":"2023-05-10T01:25:32.365017+0000","last_undegraded":"2023-05-10T01:25:32.365017+0000","last_fullsized":"2023-05-10T01:25:32.365017+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379544+0000","last_change":"2023-05-10T01:25:32.375938+0000","last_active":"2023-05-10T01:25:32.379544+0000","last_peered":"2023-05-10T01:25:32.379544+0000","last_clean":"2023-05-10T01:25:32.379544+0000","last_became_active":"2023-05-10T01:25:32.375643+0000","last_became_peered":"2023-05-10T01:25:32.375643+0000","last_unstale":"2023-05-10T01:25:32.379544+0000","last_undegraded":"2023-05-10T01:25:32.379544+0000","last_fullsized":"2023-05-10T01:25:32.379544+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371043+0000","last_change":"2023-05-10T01:25:31.964890+0000","last_active":"2023-05-10T01:25:32.371043+0000","last_peered":"2023-05-10T01:25:32.371043+0000","last_clean":"2023-05-10T01:25:32.371043+0000","last_became_active":"2023-05-10T01:25:31.964639+0000","last_became_peered":"2023-05-10T01:25:31.964639+0000","last_unstale":"2023-05-10T01:25:32.371043+0000","last_undegraded":"2023-05-10T01:25:32.371043+0000","last_fullsized":"2023-05-10T01:25:32.371043+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368792+0000","last_change":"2023-05-10T01:25:32.367931+0000","last_active":"2023-05-10T01:25:32.368792+0000","last_peered":"2023-05-10T01:25:32.368792+0000","last_clean":"2023-05-10T01:25:32.368792+0000","last_became_active":"2023-05-10T01:25:32.366029+0000","last_became_peered":"2023-05-10T01:25:32.366029+0000","last_unstale":"2023-05-10T01:25:32.368792+0000","last_undegraded":"2023-05-10T01:25:32.368792+0000","last_fullsized":"2023-05-10T01:25:32.368792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.355466+0000","last_change":"2023-05-10T01:25:31.959959+0000","last_active":"2023-05-10T01:25:32.355466+0000","last_peered":"2023-05-10T01:25:32.355466+0000","last_clean":"2023-05-10T01:25:32.355466+0000","last_became_active":"2023-05-10T01:25:31.959662+0000","last_became_peered":"2023-05-10T01:25:31.959662+0000","last_unstale":"2023-05-10T01:25:32.355466+0000","last_undegraded":"2023-05-10T01:25:32.355466+0000","last_fullsized":"2023-05-10T01:25:32.355466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364206+0000","last_change":"2023-05-10T01:25:32.358333+0000","last_active":"2023-05-10T01:25:32.364206+0000","last_peered":"2023-05-10T01:25:32.364206+0000","last_clean":"2023-05-10T01:25:32.364206+0000","last_became_active":"2023-05-10T01:25:32.357905+0000","last_became_peered":"2023-05-10T01:25:32.357905+0000","last_unstale":"2023-05-10T01:25:32.364206+0000","last_undegraded":"2023-05-10T01:25:32.364206+0000","last_fullsized":"2023-05-10T01:25:32.364206+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356826+0000","last_change":"2023-05-10T01:25:31.970051+0000","last_active":"2023-05-10T01:25:32.356826+0000","last_peered":"2023-05-10T01:25:32.356826+0000","last_clean":"2023-05-10T01:25:32.356826+0000","last_became_active":"2023-05-10T01:25:31.969424+0000","last_became_peered":"2023-05-10T01:25:31.969424+0000","last_unstale":"2023-05-10T01:25:32.356826+0000","last_undegraded":"2023-05-10T01:25:32.356826+0000","last_fullsized":"2023-05-10T01:25:32.356826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372549+0000","last_change":"2023-05-10T01:25:32.363105+0000","last_active":"2023-05-10T01:25:32.372549+0000","last_peered":"2023-05-10T01:25:32.372549+0000","last_clean":"2023-05-10T01:25:32.372549+0000","last_became_active":"2023-05-10T01:25:32.362820+0000","last_became_peered":"2023-05-10T01:25:32.362820+0000","last_unstale":"2023-05-10T01:25:32.372549+0000","last_undegraded":"2023-05-10T01:25:32.372549+0000","last_fullsized":"2023-05-10T01:25:32.372549+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365166+0000","last_change":"2023-05-10T01:25:31.970658+0000","last_active":"2023-05-10T01:25:32.365166+0000","last_peered":"2023-05-10T01:25:32.365166+0000","last_clean":"2023-05-10T01:25:32.365166+0000","last_became_active":"2023-05-10T01:25:31.970357+0000","last_became_peered":"2023-05-10T01:25:31.970357+0000","last_unstale":"2023-05-10T01:25:32.365166+0000","last_undegraded":"2023-05-10T01:25:32.365166+0000","last_fullsized":"2023-05-10T01:25:32.365166+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367302+0000","last_change":"2023-05-10T01:25:32.364606+0000","last_active":"2023-05-10T01:25:32.367302+0000","last_peered":"2023-05-10T01:25:32.367302+0000","last_clean":"2023-05-10T01:25:32.367302+0000","last_became_active":"2023-05-10T01:25:32.364291+0000","last_became_peered":"2023-05-10T01:25:32.364291+0000","last_unstale":"2023-05-10T01:25:32.367302+0000","last_undegraded":"2023-05-10T01:25:32.367302+0000","last_fullsized":"2023-05-10T01:25:32.367302+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.347325+0000","last_change":"2023-05-10T01:25:31.962288+0000","last_active":"2023-05-10T01:25:32.347325+0000","last_peered":"2023-05-10T01:25:32.347325+0000","last_clean":"2023-05-10T01:25:32.347325+0000","last_became_active":"2023-05-10T01:25:31.961985+0000","last_became_peered":"2023-05-10T01:25:31.961985+0000","last_unstale":"2023-05-10T01:25:32.347325+0000","last_undegraded":"2023-05-10T01:25:32.347325+0000","last_fullsized":"2023-05-10T01:25:32.347325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367599+0000","last_change":"2023-05-10T01:25:32.363926+0000","last_active":"2023-05-10T01:25:32.367599+0000","last_peered":"2023-05-10T01:25:32.367599+0000","last_clean":"2023-05-10T01:25:32.367599+0000","last_became_active":"2023-05-10T01:25:32.363672+0000","last_became_peered":"2023-05-10T01:25:32.363672+0000","last_unstale":"2023-05-10T01:25:32.367599+0000","last_undegraded":"2023-05-10T01:25:32.367599+0000","last_fullsized":"2023-05-10T01:25:32.367599+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358392+0000","last_change":"2023-05-10T01:25:31.965600+0000","last_active":"2023-05-10T01:25:32.358392+0000","last_peered":"2023-05-10T01:25:32.358392+0000","last_clean":"2023-05-10T01:25:32.358392+0000","last_became_active":"2023-05-10T01:25:31.965287+0000","last_became_peered":"2023-05-10T01:25:31.965287+0000","last_unstale":"2023-05-10T01:25:32.358392+0000","last_undegraded":"2023-05-10T01:25:32.358392+0000","last_fullsized":"2023-05-10T01:25:32.358392+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376220+0000","last_change":"2023-05-10T01:25:32.370280+0000","last_active":"2023-05-10T01:25:32.376220+0000","last_peered":"2023-05-10T01:25:32.376220+0000","last_clean":"2023-05-10T01:25:32.376220+0000","last_became_active":"2023-05-10T01:25:32.369720+0000","last_became_peered":"2023-05-10T01:25:32.369720+0000","last_unstale":"2023-05-10T01:25:32.376220+0000","last_undegraded":"2023-05-10T01:25:32.376220+0000","last_fullsized":"2023-05-10T01:25:32.376220+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360801+0000","last_change":"2023-05-10T01:25:31.969829+0000","last_active":"2023-05-10T01:25:32.360801+0000","last_peered":"2023-05-10T01:25:32.360801+0000","last_clean":"2023-05-10T01:25:32.360801+0000","last_became_active":"2023-05-10T01:25:31.969388+0000","last_became_peered":"2023-05-10T01:25:31.969388+0000","last_unstale":"2023-05-10T01:25:32.360801+0000","last_undegraded":"2023-05-10T01:25:32.360801+0000","last_fullsized":"2023-05-10T01:25:32.360801+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364085+0000","last_change":"2023-05-10T01:25:32.356942+0000","last_active":"2023-05-10T01:25:32.364085+0000","last_peered":"2023-05-10T01:25:32.364085+0000","last_clean":"2023-05-10T01:25:32.364085+0000","last_became_active":"2023-05-10T01:25:32.356494+0000","last_became_peered":"2023-05-10T01:25:32.356494+0000","last_unstale":"2023-05-10T01:25:32.364085+0000","last_undegraded":"2023-05-10T01:25:32.364085+0000","last_fullsized":"2023-05-10T01:25:32.364085+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360874+0000","last_change":"2023-05-10T01:25:31.976216+0000","last_active":"2023-05-10T01:25:32.360874+0000","last_peered":"2023-05-10T01:25:32.360874+0000","last_clean":"2023-05-10T01:25:32.360874+0000","last_became_active":"2023-05-10T01:25:31.975898+0000","last_became_peered":"2023-05-10T01:25:31.975898+0000","last_unstale":"2023-05-10T01:25:32.360874+0000","last_undegraded":"2023-05-10T01:25:32.360874+0000","last_fullsized":"2023-05-10T01:25:32.360874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368781+0000","last_change":"2023-05-10T01:25:32.367401+0000","last_active":"2023-05-10T01:25:32.368781+0000","last_peered":"2023-05-10T01:25:32.368781+0000","last_clean":"2023-05-10T01:25:32.368781+0000","last_became_active":"2023-05-10T01:25:32.365781+0000","last_became_peered":"2023-05-10T01:25:32.365781+0000","last_unstale":"2023-05-10T01:25:32.368781+0000","last_undegraded":"2023-05-10T01:25:32.368781+0000","last_fullsized":"2023-05-10T01:25:32.368781+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368291+0000","last_change":"2023-05-10T01:25:31.965962+0000","last_active":"2023-05-10T01:25:32.368291+0000","last_peered":"2023-05-10T01:25:32.368291+0000","last_clean":"2023-05-10T01:25:32.368291+0000","last_became_active":"2023-05-10T01:25:31.965097+0000","last_became_peered":"2023-05-10T01:25:31.965097+0000","last_unstale":"2023-05-10T01:25:32.368291+0000","last_undegraded":"2023-05-10T01:25:32.368291+0000","last_fullsized":"2023-05-10T01:25:32.368291+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351319+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:25:32.351319+0000","last_peered":"2023-05-10T01:25:32.351319+0000","last_clean":"2023-05-10T01:25:32.351319+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:25:32.351319+0000","last_undegraded":"2023-05-10T01:25:32.351319+0000","last_fullsized":"2023-05-10T01:25:32.351319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364856+0000","last_change":"2023-05-10T01:25:32.358939+0000","last_active":"2023-05-10T01:25:32.364856+0000","last_peered":"2023-05-10T01:25:32.364856+0000","last_clean":"2023-05-10T01:25:32.364856+0000","last_became_active":"2023-05-10T01:25:32.358631+0000","last_became_peered":"2023-05-10T01:25:32.358631+0000","last_unstale":"2023-05-10T01:25:32.364856+0000","last_undegraded":"2023-05-10T01:25:32.364856+0000","last_fullsized":"2023-05-10T01:25:32.364856+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356583+0000","last_change":"2023-05-10T01:25:31.967422+0000","last_active":"2023-05-10T01:25:32.356583+0000","last_peered":"2023-05-10T01:25:32.356583+0000","last_clean":"2023-05-10T01:25:32.356583+0000","last_became_active":"2023-05-10T01:25:31.967094+0000","last_became_peered":"2023-05-10T01:25:31.967094+0000","last_unstale":"2023-05-10T01:25:32.356583+0000","last_undegraded":"2023-05-10T01:25:32.356583+0000","last_fullsized":"2023-05-10T01:25:32.356583+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358483+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:25:32.358483+0000","last_peered":"2023-05-10T01:25:32.358483+0000","last_clean":"2023-05-10T01:25:32.358483+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:25:32.358483+0000","last_undegraded":"2023-05-10T01:25:32.358483+0000","last_fullsized":"2023-05-10T01:25:32.358483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376307+0000","last_change":"2023-05-10T01:25:32.371317+0000","last_active":"2023-05-10T01:25:32.376307+0000","last_peered":"2023-05-10T01:25:32.376307+0000","last_clean":"2023-05-10T01:25:32.376307+0000","last_became_active":"2023-05-10T01:25:32.371021+0000","last_became_peered":"2023-05-10T01:25:32.371021+0000","last_unstale":"2023-05-10T01:25:32.376307+0000","last_undegraded":"2023-05-10T01:25:32.376307+0000","last_fullsized":"2023-05-10T01:25:32.376307+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374431+0000","last_change":"2023-05-10T01:25:31.965809+0000","last_active":"2023-05-10T01:25:32.374431+0000","last_peered":"2023-05-10T01:25:32.374431+0000","last_clean":"2023-05-10T01:25:32.374431+0000","last_became_active":"2023-05-10T01:25:31.965539+0000","last_became_peered":"2023-05-10T01:25:31.965539+0000","last_unstale":"2023-05-10T01:25:32.374431+0000","last_undegraded":"2023-05-10T01:25:32.374431+0000","last_fullsized":"2023-05-10T01:25:32.374431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353073+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:25:32.353073+0000","last_peered":"2023-05-10T01:25:32.353073+0000","last_clean":"2023-05-10T01:25:32.353073+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:25:32.353073+0000","last_undegraded":"2023-05-10T01:25:32.353073+0000","last_fullsized":"2023-05-10T01:25:32.353073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376504+0000","last_change":"2023-05-10T01:25:32.371444+0000","last_active":"2023-05-10T01:25:32.376504+0000","last_peered":"2023-05-10T01:25:32.376504+0000","last_clean":"2023-05-10T01:25:32.376504+0000","last_became_active":"2023-05-10T01:25:32.371202+0000","last_became_peered":"2023-05-10T01:25:32.371202+0000","last_unstale":"2023-05-10T01:25:32.376504+0000","last_undegraded":"2023-05-10T01:25:32.376504+0000","last_fullsized":"2023-05-10T01:25:32.376504+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351244+0000","last_change":"2023-05-10T01:25:31.968267+0000","last_active":"2023-05-10T01:25:32.351244+0000","last_peered":"2023-05-10T01:25:32.351244+0000","last_clean":"2023-05-10T01:25:32.351244+0000","last_became_active":"2023-05-10T01:25:31.966814+0000","last_became_peered":"2023-05-10T01:25:31.966814+0000","last_unstale":"2023-05-10T01:25:32.351244+0000","last_undegraded":"2023-05-10T01:25:32.351244+0000","last_fullsized":"2023-05-10T01:25:32.351244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356452+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:25:32.356452+0000","last_peered":"2023-05-10T01:25:32.356452+0000","last_clean":"2023-05-10T01:25:32.356452+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:25:32.356452+0000","last_undegraded":"2023-05-10T01:25:32.356452+0000","last_fullsized":"2023-05-10T01:25:32.356452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360971+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:25:32.360971+0000","last_peered":"2023-05-10T01:25:32.360971+0000","last_clean":"2023-05-10T01:25:32.360971+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:25:32.360971+0000","last_undegraded":"2023-05-10T01:25:32.360971+0000","last_fullsized":"2023-05-10T01:25:32.360971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364782+0000","last_change":"2023-05-10T01:25:32.357437+0000","last_active":"2023-05-10T01:25:32.364782+0000","last_peered":"2023-05-10T01:25:32.364782+0000","last_clean":"2023-05-10T01:25:32.364782+0000","last_became_active":"2023-05-10T01:25:32.356962+0000","last_became_peered":"2023-05-10T01:25:32.356962+0000","last_unstale":"2023-05-10T01:25:32.364782+0000","last_undegraded":"2023-05-10T01:25:32.364782+0000","last_fullsized":"2023-05-10T01:25:32.364782+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.375422+0000","last_change":"2023-05-10T01:25:31.972380+0000","last_active":"2023-05-10T01:25:32.375422+0000","last_peered":"2023-05-10T01:25:32.375422+0000","last_clean":"2023-05-10T01:25:32.375422+0000","last_became_active":"2023-05-10T01:25:31.972009+0000","last_became_peered":"2023-05-10T01:25:31.972009+0000","last_unstale":"2023-05-10T01:25:32.375422+0000","last_undegraded":"2023-05-10T01:25:32.375422+0000","last_fullsized":"2023-05-10T01:25:32.375422+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.361053+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:25:32.361053+0000","last_peered":"2023-05-10T01:25:32.361053+0000","last_clean":"2023-05-10T01:25:32.361053+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:25:32.361053+0000","last_undegraded":"2023-05-10T01:25:32.361053+0000","last_fullsized":"2023-05-10T01:25:32.361053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376137+0000","last_change":"2023-05-10T01:25:32.368865+0000","last_active":"2023-05-10T01:25:32.376137+0000","last_peered":"2023-05-10T01:25:32.376137+0000","last_clean":"2023-05-10T01:25:32.376137+0000","last_became_active":"2023-05-10T01:25:32.368504+0000","last_became_peered":"2023-05-10T01:25:32.368504+0000","last_unstale":"2023-05-10T01:25:32.376137+0000","last_undegraded":"2023-05-10T01:25:32.376137+0000","last_fullsized":"2023-05-10T01:25:32.376137+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353491+0000","last_change":"2023-05-10T01:25:31.979873+0000","last_active":"2023-05-10T01:25:32.353491+0000","last_peered":"2023-05-10T01:25:32.353491+0000","last_clean":"2023-05-10T01:25:32.353491+0000","last_became_active":"2023-05-10T01:25:31.979377+0000","last_became_peered":"2023-05-10T01:25:31.979377+0000","last_unstale":"2023-05-10T01:25:32.353491+0000","last_undegraded":"2023-05-10T01:25:32.353491+0000","last_fullsized":"2023-05-10T01:25:32.353491+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.361540+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:25:32.361540+0000","last_peered":"2023-05-10T01:25:32.361540+0000","last_clean":"2023-05-10T01:25:32.361540+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:25:32.361540+0000","last_undegraded":"2023-05-10T01:25:32.361540+0000","last_fullsized":"2023-05-10T01:25:32.361540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372982+0000","last_change":"2023-05-10T01:25:32.367629+0000","last_active":"2023-05-10T01:25:32.372982+0000","last_peered":"2023-05-10T01:25:32.372982+0000","last_clean":"2023-05-10T01:25:32.372982+0000","last_became_active":"2023-05-10T01:25:32.367320+0000","last_became_peered":"2023-05-10T01:25:32.367320+0000","last_unstale":"2023-05-10T01:25:32.372982+0000","last_undegraded":"2023-05-10T01:25:32.372982+0000","last_fullsized":"2023-05-10T01:25:32.372982+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360590+0000","last_change":"2023-05-10T01:25:31.969985+0000","last_active":"2023-05-10T01:25:32.360590+0000","last_peered":"2023-05-10T01:25:32.360590+0000","last_clean":"2023-05-10T01:25:32.360590+0000","last_became_active":"2023-05-10T01:25:31.969682+0000","last_became_peered":"2023-05-10T01:25:31.969682+0000","last_unstale":"2023-05-10T01:25:32.360590+0000","last_undegraded":"2023-05-10T01:25:32.360590+0000","last_fullsized":"2023-05-10T01:25:32.360590+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349006+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:25:32.349006+0000","last_peered":"2023-05-10T01:25:32.349006+0000","last_clean":"2023-05-10T01:25:32.349006+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:25:32.349006+0000","last_undegraded":"2023-05-10T01:25:32.349006+0000","last_fullsized":"2023-05-10T01:25:32.349006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364064+0000","last_change":"2023-05-10T01:25:32.356772+0000","last_active":"2023-05-10T01:25:32.364064+0000","last_peered":"2023-05-10T01:25:32.364064+0000","last_clean":"2023-05-10T01:25:32.364064+0000","last_became_active":"2023-05-10T01:25:32.356119+0000","last_became_peered":"2023-05-10T01:25:32.356119+0000","last_unstale":"2023-05-10T01:25:32.364064+0000","last_undegraded":"2023-05-10T01:25:32.364064+0000","last_fullsized":"2023-05-10T01:25:32.364064+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353407+0000","last_change":"2023-05-10T01:25:31.965743+0000","last_active":"2023-05-10T01:25:32.353407+0000","last_peered":"2023-05-10T01:25:32.353407+0000","last_clean":"2023-05-10T01:25:32.353407+0000","last_became_active":"2023-05-10T01:25:31.964905+0000","last_became_peered":"2023-05-10T01:25:31.964905+0000","last_unstale":"2023-05-10T01:25:32.353407+0000","last_undegraded":"2023-05-10T01:25:32.353407+0000","last_fullsized":"2023-05-10T01:25:32.353407+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362359+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:25:32.362359+0000","last_peered":"2023-05-10T01:25:32.362359+0000","last_clean":"2023-05-10T01:25:32.362359+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:25:32.362359+0000","last_undegraded":"2023-05-10T01:25:32.362359+0000","last_fullsized":"2023-05-10T01:25:32.362359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18080,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353760,"statfs":{"total":96636764160,"available":96618250240,"internally_reserved":0,"allocated":1335296,"data_stored":671277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.79900000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98199999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":3.016,"15min":3.016},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.93300000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.69399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.85899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.753,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.436},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.751,"15min":0.78000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":1.052},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.95899999999999996},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17452,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354388,"statfs":{"total":96636764160,"available":96618893312,"internally_reserved":0,"allocated":1347584,"data_stored":673333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.745},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":1.159},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.321},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21464,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":20160,"kb_avail":94350376,"statfs":{"total":96636764160,"available":96614785024,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20643840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.22},"max":{"1min":0.39700000000000002,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":0.39200000000000002,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46600000000000003,"15min":0.48699999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.51800000000000002,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56699999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":0.92000000000000004,"15min":1.117},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.623,"15min":0.64300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78100000000000003,"5min":0.95299999999999996,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64100000000000001,"15min":0.65600000000000003},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":1.319},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76800000000000002,"5min":0.97799999999999998,"15min":1.079},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17132,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354708,"statfs":{"total":96636764160,"available":96619220992,"internally_reserved":0,"allocated":1347584,"data_stored":672059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.753}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22616,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":21312,"kb_avail":94349224,"statfs":{"total":96636764160,"available":96613605376,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21823488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.47099999999999997,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.50900000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.53100000000000003,"5min":0.63300000000000001,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.75},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":1.008},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.94199999999999995,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.94799999999999995,"15min":1.056},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25440,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346400,"statfs":{"total":96636764160,"available":96610713600,"internally_reserved":0,"allocated":1335296,"data_stored":672183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.378},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17696,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354144,"statfs":{"total":96636764160,"available":96618643456,"internally_reserved":0,"allocated":1335296,"data_stored":671865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20888,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":94350952,"statfs":{"total":96636764160,"available":96615374848,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.64800000000000002,"5min":0.79800000000000004,"15min":0.82899999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58599999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.51500000000000001}]},{"osd":3,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67300000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":1.0620000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42499999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:40.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:25:41.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.076+0000 7f5081530700 1 Processor -- start 2023-05-10T01:25:41.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.076+0000 7f5081530700 1 -- start start 2023-05-10T01:25:41.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f5081530700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f507c154160 0x7f507c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f5081530700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f5081530700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0c0650 con 0x7f507c154540 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f5081530700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c0c1af0 con 0x7f507c154160 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f5081530700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0bfd20 con 0x7f507c069da0 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f507c154160 0x7f507c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f507c154160 0x7f507c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:35658/0 (socket says 172.21.15.52:35658) 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:56972/0 (socket says 172.21.15.52:56972) 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507affd700 1 -- 172.21.15.52:0/2645987120 learned_addr learned my addr 172.21.15.52:0/2645987120 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.077+0000 7f507a7fc700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f507c154540 0x7f507c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:48892/0 (socket says 172.21.15.52:48892) 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507affd700 1 -- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 msgr2=0x7f507c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507affd700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507affd700 1 -- 172.21.15.52:0/2645987120 >> v1:172.21.15.172:6789/0 conn(0x7f507c154540 legacy=0x7f507c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507affd700 1 -- 172.21.15.52:0/2645987120 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0c0000 con 0x7f507c154160 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f5079ffb700 1 -- 172.21.15.52:0/2645987120 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091473770 0 0) 0x7f507c0c0650 con 0x7f507c154540 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507b7fe700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f507affd700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154160 0x7f507c0c5c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5074006fd0 tx=0x7f50740090f0).ready entity=mon.1 client_cookie=362a83616985998b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f5079ffb700 1 -- 172.21.15.52:0/2645987120 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400b580 con 0x7f507c154160 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f5079ffb700 1 -- 172.21.15.52:0/2645987120 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400b6e0 con 0x7f507c154160 2023-05-10T01:25:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.078+0000 7f5079ffb700 1 -- 172.21.15.52:0/2645987120 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400ba80 con 0x7f507c154160 2023-05-10T01:25:41.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 -- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154160 msgr2=0x7f507c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154160 0x7f507c0c5c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5074006fd0 tx=0x7f50740090f0).stop 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 -- 172.21.15.52:0/2645987120 shutdown_connections 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c069da0 0x7f507c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 --2- 172.21.15.52:0/2645987120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154160 0x7f507c0c5c60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 -- 172.21.15.52:0/2645987120 >> 172.21.15.52:0/2645987120 conn(0x7f507c0cb6f0 msgr2=0x7f507c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 -- 172.21.15.52:0/2645987120 shutdown_connections 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.079+0000 7f5081530700 1 -- 172.21.15.52:0/2645987120 wait complete. 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.080+0000 7f5081530700 1 Processor -- start 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.080+0000 7f5081530700 1 -- start start 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 0x7f507c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154540 0x7f507c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c140f90 con 0x7f507c069da0 2023-05-10T01:25:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0addc0 con 0x7f507c154540 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f5081530700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0ae0a0 con 0x7f507c154160 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37340/0 (socket says 172.21.15.52:37340) 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 -- 172.21.15.52:0/1713425909 learned_addr learned my addr 172.21.15.52:0/1713425909 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507b7fe700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154540 0x7f507c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507a7fc700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 0x7f507c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 -- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 msgr2=0x7f507c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 0x7f507c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 -- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154540 msgr2=0x7f507c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154540 0x7f507c0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 -- 172.21.15.52:0/1713425909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009a20 con 0x7f507c069da0 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507a7fc700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 0x7f507c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.081+0000 7f507affd700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f507c083050 tx=0x7f5074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.082+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400b850 con 0x7f507c069da0 2023-05-10T01:25:41.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.082+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400b9b0 con 0x7f507c069da0 2023-05-10T01:25:41.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.082+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5074009370 con 0x7f507c069da0 2023-05-10T01:25:41.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.082+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507401c670 con 0x7f507c069da0 2023-05-10T01:25:41.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.082+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c0ae660 con 0x7f507c069da0 2023-05-10T01:25:41.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.083+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c0af530 con 0x7f507c069da0 2023-05-10T01:25:41.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.083+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f507402b070 con 0x7f507c069da0 2023-05-10T01:25:41.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.084+0000 7f5072ffd700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 0x7f5060061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.084+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f507407bb20 con 0x7f507c069da0 2023-05-10T01:25:41.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.084+0000 7f507a7fc700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 0x7f5060061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.084+0000 7f507a7fc700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 0x7f5060061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f507c0b08a0 tx=0x7f5064007cb0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.087+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f507404d030 con 0x7f507c069da0 2023-05-10T01:25:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.258+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f507c0666b0 con 0x7f506005ed90 2023-05-10T01:25:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.269+0000 7f5072ffd700 1 -- 172.21.15.52:0/1713425909 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361447 (secure 0 0 0) 0x7f507c0666b0 con 0x7f506005ed90 2023-05-10T01:25:41.275 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 msgr2=0x7f5060061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 0x7f5060061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f507c0b08a0 tx=0x7f5064007cb0).stop 2023-05-10T01:25:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 msgr2=0x7f507c140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f507c083050 tx=0x7f5074017000).stop 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 shutdown_connections 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f506005ed90 0x7f5060061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f507c154540 0x7f507c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c069da0 0x7f507c140aa0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 --2- 172.21.15.52:0/1713425909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f507c154160 0x7f507c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 >> 172.21.15.52:0/1713425909 conn(0x7f507c0cb6f0 msgr2=0x7f507c068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:41.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 shutdown_connections 2023-05-10T01:25:41.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.272+0000 7f5081530700 1 -- 172.21.15.52:0/1713425909 wait complete. 2023-05-10T01:25:41.279 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:25:41.286 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:25:39.760797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":227,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":160768,"kb_used_data":10432,"kb_used_omap":0,"kb_used_meta":150272,"kb_avail":754813952,"statfs":{"total":773094113280,"available":772929486848,"internally_reserved":0,"allocated":10682368,"data_stored":5374380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":153878528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3251,"num_objects":-11,"num_object_clones":0,"num_object_copies":-22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-31,"num_write_kb":-12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162924"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374548+0000","last_change":"2023-05-10T01:25:32.373091+0000","last_active":"2023-05-10T01:25:32.374548+0000","last_peered":"2023-05-10T01:25:32.374548+0000","last_clean":"2023-05-10T01:25:32.374548+0000","last_became_active":"2023-05-10T01:25:32.372806+0000","last_became_peered":"2023-05-10T01:25:32.372806+0000","last_unstale":"2023-05-10T01:25:32.374548+0000","last_undegraded":"2023-05-10T01:25:32.374548+0000","last_fullsized":"2023-05-10T01:25:32.374548+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373351+0000","last_change":"2023-05-10T01:25:31.965910+0000","last_active":"2023-05-10T01:25:32.373351+0000","last_peered":"2023-05-10T01:25:32.373351+0000","last_clean":"2023-05-10T01:25:32.373351+0000","last_became_active":"2023-05-10T01:25:31.964214+0000","last_became_peered":"2023-05-10T01:25:31.964214+0000","last_unstale":"2023-05-10T01:25:32.373351+0000","last_undegraded":"2023-05-10T01:25:32.373351+0000","last_fullsized":"2023-05-10T01:25:32.373351+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367714+0000","last_change":"2023-05-10T01:25:32.365148+0000","last_active":"2023-05-10T01:25:32.367714+0000","last_peered":"2023-05-10T01:25:32.367714+0000","last_clean":"2023-05-10T01:25:32.367714+0000","last_became_active":"2023-05-10T01:25:32.364846+0000","last_became_peered":"2023-05-10T01:25:32.364846+0000","last_unstale":"2023-05-10T01:25:32.367714+0000","last_undegraded":"2023-05-10T01:25:32.367714+0000","last_fullsized":"2023-05-10T01:25:32.367714+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349844+0000","last_change":"2023-05-10T01:25:31.973894+0000","last_active":"2023-05-10T01:25:32.349844+0000","last_peered":"2023-05-10T01:25:32.349844+0000","last_clean":"2023-05-10T01:25:32.349844+0000","last_became_active":"2023-05-10T01:25:31.973604+0000","last_became_peered":"2023-05-10T01:25:31.973604+0000","last_unstale":"2023-05-10T01:25:32.349844+0000","last_undegraded":"2023-05-10T01:25:32.349844+0000","last_fullsized":"2023-05-10T01:25:32.349844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376167+0000","last_change":"2023-05-10T01:25:32.368981+0000","last_active":"2023-05-10T01:25:32.376167+0000","last_peered":"2023-05-10T01:25:32.376167+0000","last_clean":"2023-05-10T01:25:32.376167+0000","last_became_active":"2023-05-10T01:25:32.368559+0000","last_became_peered":"2023-05-10T01:25:32.368559+0000","last_unstale":"2023-05-10T01:25:32.376167+0000","last_undegraded":"2023-05-10T01:25:32.376167+0000","last_fullsized":"2023-05-10T01:25:32.376167+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354908+0000","last_change":"2023-05-10T01:25:31.969011+0000","last_active":"2023-05-10T01:25:32.354908+0000","last_peered":"2023-05-10T01:25:32.354908+0000","last_clean":"2023-05-10T01:25:32.354908+0000","last_became_active":"2023-05-10T01:25:31.968698+0000","last_became_peered":"2023-05-10T01:25:31.968698+0000","last_unstale":"2023-05-10T01:25:32.354908+0000","last_undegraded":"2023-05-10T01:25:32.354908+0000","last_fullsized":"2023-05-10T01:25:32.354908+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362988+0000","last_change":"2023-05-10T01:25:32.361960+0000","last_active":"2023-05-10T01:25:32.362988+0000","last_peered":"2023-05-10T01:25:32.362988+0000","last_clean":"2023-05-10T01:25:32.362988+0000","last_became_active":"2023-05-10T01:25:32.361503+0000","last_became_peered":"2023-05-10T01:25:32.361503+0000","last_unstale":"2023-05-10T01:25:32.362988+0000","last_undegraded":"2023-05-10T01:25:32.362988+0000","last_fullsized":"2023-05-10T01:25:32.362988+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366401+0000","last_change":"2023-05-10T01:25:31.978897+0000","last_active":"2023-05-10T01:25:32.366401+0000","last_peered":"2023-05-10T01:25:32.366401+0000","last_clean":"2023-05-10T01:25:32.366401+0000","last_became_active":"2023-05-10T01:25:31.978566+0000","last_became_peered":"2023-05-10T01:25:31.978566+0000","last_unstale":"2023-05-10T01:25:32.366401+0000","last_undegraded":"2023-05-10T01:25:32.366401+0000","last_fullsized":"2023-05-10T01:25:32.366401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373604+0000","last_change":"2023-05-10T01:25:32.372259+0000","last_active":"2023-05-10T01:25:32.373604+0000","last_peered":"2023-05-10T01:25:32.373604+0000","last_clean":"2023-05-10T01:25:32.373604+0000","last_became_active":"2023-05-10T01:25:32.371998+0000","last_became_peered":"2023-05-10T01:25:32.371998+0000","last_unstale":"2023-05-10T01:25:32.373604+0000","last_undegraded":"2023-05-10T01:25:32.373604+0000","last_fullsized":"2023-05-10T01:25:32.373604+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368400+0000","last_change":"2023-05-10T01:25:31.968968+0000","last_active":"2023-05-10T01:25:32.368400+0000","last_peered":"2023-05-10T01:25:32.368400+0000","last_clean":"2023-05-10T01:25:32.368400+0000","last_became_active":"2023-05-10T01:25:31.968656+0000","last_became_peered":"2023-05-10T01:25:31.968656+0000","last_unstale":"2023-05-10T01:25:32.368400+0000","last_undegraded":"2023-05-10T01:25:32.368400+0000","last_fullsized":"2023-05-10T01:25:32.368400+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374895+0000","last_change":"2023-05-10T01:25:32.370871+0000","last_active":"2023-05-10T01:25:32.374895+0000","last_peered":"2023-05-10T01:25:32.374895+0000","last_clean":"2023-05-10T01:25:32.374895+0000","last_became_active":"2023-05-10T01:25:32.370555+0000","last_became_peered":"2023-05-10T01:25:32.370555+0000","last_unstale":"2023-05-10T01:25:32.374895+0000","last_undegraded":"2023-05-10T01:25:32.374895+0000","last_fullsized":"2023-05-10T01:25:32.374895+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368991+0000","last_change":"2023-05-10T01:25:31.968714+0000","last_active":"2023-05-10T01:25:32.368991+0000","last_peered":"2023-05-10T01:25:32.368991+0000","last_clean":"2023-05-10T01:25:32.368991+0000","last_became_active":"2023-05-10T01:25:31.968444+0000","last_became_peered":"2023-05-10T01:25:31.968444+0000","last_unstale":"2023-05-10T01:25:32.368991+0000","last_undegraded":"2023-05-10T01:25:32.368991+0000","last_fullsized":"2023-05-10T01:25:32.368991+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366820+0000","last_change":"2023-05-10T01:25:32.363589+0000","last_active":"2023-05-10T01:25:32.366820+0000","last_peered":"2023-05-10T01:25:32.366820+0000","last_clean":"2023-05-10T01:25:32.366820+0000","last_became_active":"2023-05-10T01:25:32.362966+0000","last_became_peered":"2023-05-10T01:25:32.362966+0000","last_unstale":"2023-05-10T01:25:32.366820+0000","last_undegraded":"2023-05-10T01:25:32.366820+0000","last_fullsized":"2023-05-10T01:25:32.366820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353037+0000","last_change":"2023-05-10T01:25:31.972634+0000","last_active":"2023-05-10T01:25:32.353037+0000","last_peered":"2023-05-10T01:25:32.353037+0000","last_clean":"2023-05-10T01:25:32.353037+0000","last_became_active":"2023-05-10T01:25:31.972348+0000","last_became_peered":"2023-05-10T01:25:31.972348+0000","last_unstale":"2023-05-10T01:25:32.353037+0000","last_undegraded":"2023-05-10T01:25:32.353037+0000","last_fullsized":"2023-05-10T01:25:32.353037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376770+0000","last_change":"2023-05-10T01:25:32.371753+0000","last_active":"2023-05-10T01:25:32.376770+0000","last_peered":"2023-05-10T01:25:32.376770+0000","last_clean":"2023-05-10T01:25:32.376770+0000","last_became_active":"2023-05-10T01:25:32.370996+0000","last_became_peered":"2023-05-10T01:25:32.370996+0000","last_unstale":"2023-05-10T01:25:32.376770+0000","last_undegraded":"2023-05-10T01:25:32.376770+0000","last_fullsized":"2023-05-10T01:25:32.376770+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356970+0000","last_change":"2023-05-10T01:25:31.975967+0000","last_active":"2023-05-10T01:25:32.356970+0000","last_peered":"2023-05-10T01:25:32.356970+0000","last_clean":"2023-05-10T01:25:32.356970+0000","last_became_active":"2023-05-10T01:25:31.975602+0000","last_became_peered":"2023-05-10T01:25:31.975602+0000","last_unstale":"2023-05-10T01:25:32.356970+0000","last_undegraded":"2023-05-10T01:25:32.356970+0000","last_fullsized":"2023-05-10T01:25:32.356970+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363723+0000","last_change":"2023-05-10T01:25:32.361013+0000","last_active":"2023-05-10T01:25:32.363723+0000","last_peered":"2023-05-10T01:25:32.363723+0000","last_clean":"2023-05-10T01:25:32.363723+0000","last_became_active":"2023-05-10T01:25:32.360721+0000","last_became_peered":"2023-05-10T01:25:32.360721+0000","last_unstale":"2023-05-10T01:25:32.363723+0000","last_undegraded":"2023-05-10T01:25:32.363723+0000","last_fullsized":"2023-05-10T01:25:32.363723+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362236+0000","last_change":"2023-05-10T01:25:31.969866+0000","last_active":"2023-05-10T01:25:32.362236+0000","last_peered":"2023-05-10T01:25:32.362236+0000","last_clean":"2023-05-10T01:25:32.362236+0000","last_became_active":"2023-05-10T01:25:31.969569+0000","last_became_peered":"2023-05-10T01:25:31.969569+0000","last_unstale":"2023-05-10T01:25:32.362236+0000","last_undegraded":"2023-05-10T01:25:32.362236+0000","last_fullsized":"2023-05-10T01:25:32.362236+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372752+0000","last_change":"2023-05-10T01:25:32.367033+0000","last_active":"2023-05-10T01:25:32.372752+0000","last_peered":"2023-05-10T01:25:32.372752+0000","last_clean":"2023-05-10T01:25:32.372752+0000","last_became_active":"2023-05-10T01:25:32.366365+0000","last_became_peered":"2023-05-10T01:25:32.366365+0000","last_unstale":"2023-05-10T01:25:32.372752+0000","last_undegraded":"2023-05-10T01:25:32.372752+0000","last_fullsized":"2023-05-10T01:25:32.372752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358765+0000","last_change":"2023-05-10T01:25:31.978807+0000","last_active":"2023-05-10T01:25:32.358765+0000","last_peered":"2023-05-10T01:25:32.358765+0000","last_clean":"2023-05-10T01:25:32.358765+0000","last_became_active":"2023-05-10T01:25:31.978558+0000","last_became_peered":"2023-05-10T01:25:31.978558+0000","last_unstale":"2023-05-10T01:25:32.358765+0000","last_undegraded":"2023-05-10T01:25:32.358765+0000","last_fullsized":"2023-05-10T01:25:32.358765+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363754+0000","last_change":"2023-05-10T01:25:32.360861+0000","last_active":"2023-05-10T01:25:32.363754+0000","last_peered":"2023-05-10T01:25:32.363754+0000","last_clean":"2023-05-10T01:25:32.363754+0000","last_became_active":"2023-05-10T01:25:32.360568+0000","last_became_peered":"2023-05-10T01:25:32.360568+0000","last_unstale":"2023-05-10T01:25:32.363754+0000","last_undegraded":"2023-05-10T01:25:32.363754+0000","last_fullsized":"2023-05-10T01:25:32.363754+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348836+0000","last_change":"2023-05-10T01:25:31.972948+0000","last_active":"2023-05-10T01:25:32.348836+0000","last_peered":"2023-05-10T01:25:32.348836+0000","last_clean":"2023-05-10T01:25:32.348836+0000","last_became_active":"2023-05-10T01:25:31.972633+0000","last_became_peered":"2023-05-10T01:25:31.972633+0000","last_unstale":"2023-05-10T01:25:32.348836+0000","last_undegraded":"2023-05-10T01:25:32.348836+0000","last_fullsized":"2023-05-10T01:25:32.348836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376702+0000","last_change":"2023-05-10T01:25:32.370331+0000","last_active":"2023-05-10T01:25:32.376702+0000","last_peered":"2023-05-10T01:25:32.376702+0000","last_clean":"2023-05-10T01:25:32.376702+0000","last_became_active":"2023-05-10T01:25:32.370062+0000","last_became_peered":"2023-05-10T01:25:32.370062+0000","last_unstale":"2023-05-10T01:25:32.376702+0000","last_undegraded":"2023-05-10T01:25:32.376702+0000","last_fullsized":"2023-05-10T01:25:32.376702+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379617+0000","last_change":"2023-05-10T01:25:31.972847+0000","last_active":"2023-05-10T01:25:32.379617+0000","last_peered":"2023-05-10T01:25:32.379617+0000","last_clean":"2023-05-10T01:25:32.379617+0000","last_became_active":"2023-05-10T01:25:31.972602+0000","last_became_peered":"2023-05-10T01:25:31.972602+0000","last_unstale":"2023-05-10T01:25:32.379617+0000","last_undegraded":"2023-05-10T01:25:32.379617+0000","last_fullsized":"2023-05-10T01:25:32.379617+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365971+0000","last_change":"2023-05-10T01:25:32.360582+0000","last_active":"2023-05-10T01:25:32.365971+0000","last_peered":"2023-05-10T01:25:32.365971+0000","last_clean":"2023-05-10T01:25:32.365971+0000","last_became_active":"2023-05-10T01:25:32.360271+0000","last_became_peered":"2023-05-10T01:25:32.360271+0000","last_unstale":"2023-05-10T01:25:32.365971+0000","last_undegraded":"2023-05-10T01:25:32.365971+0000","last_fullsized":"2023-05-10T01:25:32.365971+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371039+0000","last_change":"2023-05-10T01:25:31.970446+0000","last_active":"2023-05-10T01:25:32.371039+0000","last_peered":"2023-05-10T01:25:32.371039+0000","last_clean":"2023-05-10T01:25:32.371039+0000","last_became_active":"2023-05-10T01:25:31.970161+0000","last_became_peered":"2023-05-10T01:25:31.970161+0000","last_unstale":"2023-05-10T01:25:32.371039+0000","last_undegraded":"2023-05-10T01:25:32.371039+0000","last_fullsized":"2023-05-10T01:25:32.371039+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365249+0000","last_change":"2023-05-10T01:25:32.359531+0000","last_active":"2023-05-10T01:25:32.365249+0000","last_peered":"2023-05-10T01:25:32.365249+0000","last_clean":"2023-05-10T01:25:32.365249+0000","last_became_active":"2023-05-10T01:25:32.357544+0000","last_became_peered":"2023-05-10T01:25:32.357544+0000","last_unstale":"2023-05-10T01:25:32.365249+0000","last_undegraded":"2023-05-10T01:25:32.365249+0000","last_fullsized":"2023-05-10T01:25:32.365249+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353387+0000","last_change":"2023-05-10T01:25:31.979686+0000","last_active":"2023-05-10T01:25:32.353387+0000","last_peered":"2023-05-10T01:25:32.353387+0000","last_clean":"2023-05-10T01:25:32.353387+0000","last_became_active":"2023-05-10T01:25:31.978877+0000","last_became_peered":"2023-05-10T01:25:31.978877+0000","last_unstale":"2023-05-10T01:25:32.353387+0000","last_undegraded":"2023-05-10T01:25:32.353387+0000","last_fullsized":"2023-05-10T01:25:32.353387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368698+0000","last_change":"2023-05-10T01:25:32.364860+0000","last_active":"2023-05-10T01:25:32.368698+0000","last_peered":"2023-05-10T01:25:32.368698+0000","last_clean":"2023-05-10T01:25:32.368698+0000","last_became_active":"2023-05-10T01:25:32.364645+0000","last_became_peered":"2023-05-10T01:25:32.364645+0000","last_unstale":"2023-05-10T01:25:32.368698+0000","last_undegraded":"2023-05-10T01:25:32.368698+0000","last_fullsized":"2023-05-10T01:25:32.368698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352726+0000","last_change":"2023-05-10T01:25:31.964718+0000","last_active":"2023-05-10T01:25:32.352726+0000","last_peered":"2023-05-10T01:25:32.352726+0000","last_clean":"2023-05-10T01:25:32.352726+0000","last_became_active":"2023-05-10T01:25:31.964432+0000","last_became_peered":"2023-05-10T01:25:31.964432+0000","last_unstale":"2023-05-10T01:25:32.352726+0000","last_undegraded":"2023-05-10T01:25:32.352726+0000","last_fullsized":"2023-05-10T01:25:32.352726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373607+0000","last_change":"2023-05-10T01:25:32.372809+0000","last_active":"2023-05-10T01:25:32.373607+0000","last_peered":"2023-05-10T01:25:32.373607+0000","last_clean":"2023-05-10T01:25:32.373607+0000","last_became_active":"2023-05-10T01:25:32.372525+0000","last_became_peered":"2023-05-10T01:25:32.372525+0000","last_unstale":"2023-05-10T01:25:32.373607+0000","last_undegraded":"2023-05-10T01:25:32.373607+0000","last_fullsized":"2023-05-10T01:25:32.373607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371608+0000","last_change":"2023-05-10T01:25:31.964128+0000","last_active":"2023-05-10T01:25:32.371608+0000","last_peered":"2023-05-10T01:25:32.371608+0000","last_clean":"2023-05-10T01:25:32.371608+0000","last_became_active":"2023-05-10T01:25:31.963858+0000","last_became_peered":"2023-05-10T01:25:31.963858+0000","last_unstale":"2023-05-10T01:25:32.371608+0000","last_undegraded":"2023-05-10T01:25:32.371608+0000","last_fullsized":"2023-05-10T01:25:32.371608+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365321+0000","last_change":"2023-05-10T01:25:32.358660+0000","last_active":"2023-05-10T01:25:32.365321+0000","last_peered":"2023-05-10T01:25:32.365321+0000","last_clean":"2023-05-10T01:25:32.365321+0000","last_became_active":"2023-05-10T01:25:32.358335+0000","last_became_peered":"2023-05-10T01:25:32.358335+0000","last_unstale":"2023-05-10T01:25:32.365321+0000","last_undegraded":"2023-05-10T01:25:32.365321+0000","last_fullsized":"2023-05-10T01:25:32.365321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354715+0000","last_change":"2023-05-10T01:25:31.968051+0000","last_active":"2023-05-10T01:25:32.354715+0000","last_peered":"2023-05-10T01:25:32.354715+0000","last_clean":"2023-05-10T01:25:32.354715+0000","last_became_active":"2023-05-10T01:25:31.967744+0000","last_became_peered":"2023-05-10T01:25:31.967744+0000","last_unstale":"2023-05-10T01:25:32.354715+0000","last_undegraded":"2023-05-10T01:25:32.354715+0000","last_fullsized":"2023-05-10T01:25:32.354715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376381+0000","last_change":"2023-05-10T01:25:32.368882+0000","last_active":"2023-05-10T01:25:32.376381+0000","last_peered":"2023-05-10T01:25:32.376381+0000","last_clean":"2023-05-10T01:25:32.376381+0000","last_became_active":"2023-05-10T01:25:32.368593+0000","last_became_peered":"2023-05-10T01:25:32.368593+0000","last_unstale":"2023-05-10T01:25:32.376381+0000","last_undegraded":"2023-05-10T01:25:32.376381+0000","last_fullsized":"2023-05-10T01:25:32.376381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353740+0000","last_change":"2023-05-10T01:25:31.965170+0000","last_active":"2023-05-10T01:25:32.353740+0000","last_peered":"2023-05-10T01:25:32.353740+0000","last_clean":"2023-05-10T01:25:32.353740+0000","last_became_active":"2023-05-10T01:25:31.964889+0000","last_became_peered":"2023-05-10T01:25:31.964889+0000","last_unstale":"2023-05-10T01:25:32.353740+0000","last_undegraded":"2023-05-10T01:25:32.353740+0000","last_fullsized":"2023-05-10T01:25:32.353740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370701+0000","last_change":"2023-05-10T01:25:32.369797+0000","last_active":"2023-05-10T01:25:32.370701+0000","last_peered":"2023-05-10T01:25:32.370701+0000","last_clean":"2023-05-10T01:25:32.370701+0000","last_became_active":"2023-05-10T01:25:32.369393+0000","last_became_peered":"2023-05-10T01:25:32.369393+0000","last_unstale":"2023-05-10T01:25:32.370701+0000","last_undegraded":"2023-05-10T01:25:32.370701+0000","last_fullsized":"2023-05-10T01:25:32.370701+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364256+0000","last_change":"2023-05-10T01:25:31.965803+0000","last_active":"2023-05-10T01:25:32.364256+0000","last_peered":"2023-05-10T01:25:32.364256+0000","last_clean":"2023-05-10T01:25:32.364256+0000","last_became_active":"2023-05-10T01:25:31.965495+0000","last_became_peered":"2023-05-10T01:25:31.965495+0000","last_unstale":"2023-05-10T01:25:32.364256+0000","last_undegraded":"2023-05-10T01:25:32.364256+0000","last_fullsized":"2023-05-10T01:25:32.364256+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365650+0000","last_change":"2023-05-10T01:25:32.361745+0000","last_active":"2023-05-10T01:25:32.365650+0000","last_peered":"2023-05-10T01:25:32.365650+0000","last_clean":"2023-05-10T01:25:32.365650+0000","last_became_active":"2023-05-10T01:25:32.361473+0000","last_became_peered":"2023-05-10T01:25:32.361473+0000","last_unstale":"2023-05-10T01:25:32.365650+0000","last_undegraded":"2023-05-10T01:25:32.365650+0000","last_fullsized":"2023-05-10T01:25:32.365650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354188+0000","last_change":"2023-05-10T01:25:31.972607+0000","last_active":"2023-05-10T01:25:32.354188+0000","last_peered":"2023-05-10T01:25:32.354188+0000","last_clean":"2023-05-10T01:25:32.354188+0000","last_became_active":"2023-05-10T01:25:31.972048+0000","last_became_peered":"2023-05-10T01:25:31.972048+0000","last_unstale":"2023-05-10T01:25:32.354188+0000","last_undegraded":"2023-05-10T01:25:32.354188+0000","last_fullsized":"2023-05-10T01:25:32.354188+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367027+0000","last_change":"2023-05-10T01:25:32.362548+0000","last_active":"2023-05-10T01:25:32.367027+0000","last_peered":"2023-05-10T01:25:32.367027+0000","last_clean":"2023-05-10T01:25:32.367027+0000","last_became_active":"2023-05-10T01:25:32.361461+0000","last_became_peered":"2023-05-10T01:25:32.361461+0000","last_unstale":"2023-05-10T01:25:32.367027+0000","last_undegraded":"2023-05-10T01:25:32.367027+0000","last_fullsized":"2023-05-10T01:25:32.367027+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365703+0000","last_change":"2023-05-10T01:25:31.969371+0000","last_active":"2023-05-10T01:25:32.365703+0000","last_peered":"2023-05-10T01:25:32.365703+0000","last_clean":"2023-05-10T01:25:32.365703+0000","last_became_active":"2023-05-10T01:25:31.969080+0000","last_became_peered":"2023-05-10T01:25:31.969080+0000","last_unstale":"2023-05-10T01:25:32.365703+0000","last_undegraded":"2023-05-10T01:25:32.365703+0000","last_fullsized":"2023-05-10T01:25:32.365703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379359+0000","last_change":"2023-05-10T01:25:32.371134+0000","last_active":"2023-05-10T01:25:32.379359+0000","last_peered":"2023-05-10T01:25:32.379359+0000","last_clean":"2023-05-10T01:25:32.379359+0000","last_became_active":"2023-05-10T01:25:32.370711+0000","last_became_peered":"2023-05-10T01:25:32.370711+0000","last_unstale":"2023-05-10T01:25:32.379359+0000","last_undegraded":"2023-05-10T01:25:32.379359+0000","last_fullsized":"2023-05-10T01:25:32.379359+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350385+0000","last_change":"2023-05-10T01:25:31.974405+0000","last_active":"2023-05-10T01:25:32.350385+0000","last_peered":"2023-05-10T01:25:32.350385+0000","last_clean":"2023-05-10T01:25:32.350385+0000","last_became_active":"2023-05-10T01:25:31.974108+0000","last_became_peered":"2023-05-10T01:25:31.974108+0000","last_unstale":"2023-05-10T01:25:32.350385+0000","last_undegraded":"2023-05-10T01:25:32.350385+0000","last_fullsized":"2023-05-10T01:25:32.350385+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368717+0000","last_change":"2023-05-10T01:25:32.365374+0000","last_active":"2023-05-10T01:25:32.368717+0000","last_peered":"2023-05-10T01:25:32.368717+0000","last_clean":"2023-05-10T01:25:32.368717+0000","last_became_active":"2023-05-10T01:25:32.365088+0000","last_became_peered":"2023-05-10T01:25:32.365088+0000","last_unstale":"2023-05-10T01:25:32.368717+0000","last_undegraded":"2023-05-10T01:25:32.368717+0000","last_fullsized":"2023-05-10T01:25:32.368717+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360684+0000","last_change":"2023-05-10T01:25:31.969657+0000","last_active":"2023-05-10T01:25:32.360684+0000","last_peered":"2023-05-10T01:25:32.360684+0000","last_clean":"2023-05-10T01:25:32.360684+0000","last_became_active":"2023-05-10T01:25:31.968950+0000","last_became_peered":"2023-05-10T01:25:31.968950+0000","last_unstale":"2023-05-10T01:25:32.360684+0000","last_undegraded":"2023-05-10T01:25:32.360684+0000","last_fullsized":"2023-05-10T01:25:32.360684+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376819+0000","last_change":"2023-05-10T01:25:32.373347+0000","last_active":"2023-05-10T01:25:32.376819+0000","last_peered":"2023-05-10T01:25:32.376819+0000","last_clean":"2023-05-10T01:25:32.376819+0000","last_became_active":"2023-05-10T01:25:32.371753+0000","last_became_peered":"2023-05-10T01:25:32.371753+0000","last_unstale":"2023-05-10T01:25:32.376819+0000","last_undegraded":"2023-05-10T01:25:32.376819+0000","last_fullsized":"2023-05-10T01:25:32.376819+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353308+0000","last_change":"2023-05-10T01:25:31.969920+0000","last_active":"2023-05-10T01:25:32.353308+0000","last_peered":"2023-05-10T01:25:32.353308+0000","last_clean":"2023-05-10T01:25:32.353308+0000","last_became_active":"2023-05-10T01:25:31.969667+0000","last_became_peered":"2023-05-10T01:25:31.969667+0000","last_unstale":"2023-05-10T01:25:32.353308+0000","last_undegraded":"2023-05-10T01:25:32.353308+0000","last_fullsized":"2023-05-10T01:25:32.353308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365341+0000","last_change":"2023-05-10T01:25:32.360107+0000","last_active":"2023-05-10T01:25:32.365341+0000","last_peered":"2023-05-10T01:25:32.365341+0000","last_clean":"2023-05-10T01:25:32.365341+0000","last_became_active":"2023-05-10T01:25:32.359824+0000","last_became_peered":"2023-05-10T01:25:32.359824+0000","last_unstale":"2023-05-10T01:25:32.365341+0000","last_undegraded":"2023-05-10T01:25:32.365341+0000","last_fullsized":"2023-05-10T01:25:32.365341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349439+0000","last_change":"2023-05-10T01:25:31.976138+0000","last_active":"2023-05-10T01:25:32.349439+0000","last_peered":"2023-05-10T01:25:32.349439+0000","last_clean":"2023-05-10T01:25:32.349439+0000","last_became_active":"2023-05-10T01:25:31.975542+0000","last_became_peered":"2023-05-10T01:25:31.975542+0000","last_unstale":"2023-05-10T01:25:32.349439+0000","last_undegraded":"2023-05-10T01:25:32.349439+0000","last_fullsized":"2023-05-10T01:25:32.349439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374644+0000","last_change":"2023-05-10T01:25:32.373032+0000","last_active":"2023-05-10T01:25:32.374644+0000","last_peered":"2023-05-10T01:25:32.374644+0000","last_clean":"2023-05-10T01:25:32.374644+0000","last_became_active":"2023-05-10T01:25:32.372770+0000","last_became_peered":"2023-05-10T01:25:32.372770+0000","last_unstale":"2023-05-10T01:25:32.374644+0000","last_undegraded":"2023-05-10T01:25:32.374644+0000","last_fullsized":"2023-05-10T01:25:32.374644+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.354848+0000","last_change":"2023-05-10T01:25:31.975996+0000","last_active":"2023-05-10T01:25:32.354848+0000","last_peered":"2023-05-10T01:25:32.354848+0000","last_clean":"2023-05-10T01:25:32.354848+0000","last_became_active":"2023-05-10T01:25:31.975657+0000","last_became_peered":"2023-05-10T01:25:31.975657+0000","last_unstale":"2023-05-10T01:25:32.354848+0000","last_undegraded":"2023-05-10T01:25:32.354848+0000","last_fullsized":"2023-05-10T01:25:32.354848+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376335+0000","last_change":"2023-05-10T01:25:32.369001+0000","last_active":"2023-05-10T01:25:32.376335+0000","last_peered":"2023-05-10T01:25:32.376335+0000","last_clean":"2023-05-10T01:25:32.376335+0000","last_became_active":"2023-05-10T01:25:32.368656+0000","last_became_peered":"2023-05-10T01:25:32.368656+0000","last_unstale":"2023-05-10T01:25:32.376335+0000","last_undegraded":"2023-05-10T01:25:32.376335+0000","last_fullsized":"2023-05-10T01:25:32.376335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356938+0000","last_change":"2023-05-10T01:25:31.966263+0000","last_active":"2023-05-10T01:25:32.356938+0000","last_peered":"2023-05-10T01:25:32.356938+0000","last_clean":"2023-05-10T01:25:32.356938+0000","last_became_active":"2023-05-10T01:25:31.965960+0000","last_became_peered":"2023-05-10T01:25:31.965960+0000","last_unstale":"2023-05-10T01:25:32.356938+0000","last_undegraded":"2023-05-10T01:25:32.356938+0000","last_fullsized":"2023-05-10T01:25:32.356938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376347+0000","last_change":"2023-05-10T01:25:32.370819+0000","last_active":"2023-05-10T01:25:32.376347+0000","last_peered":"2023-05-10T01:25:32.376347+0000","last_clean":"2023-05-10T01:25:32.376347+0000","last_became_active":"2023-05-10T01:25:32.370546+0000","last_became_peered":"2023-05-10T01:25:32.370546+0000","last_unstale":"2023-05-10T01:25:32.376347+0000","last_undegraded":"2023-05-10T01:25:32.376347+0000","last_fullsized":"2023-05-10T01:25:32.376347+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365404+0000","last_change":"2023-05-10T01:25:31.964631+0000","last_active":"2023-05-10T01:25:32.365404+0000","last_peered":"2023-05-10T01:25:32.365404+0000","last_clean":"2023-05-10T01:25:32.365404+0000","last_became_active":"2023-05-10T01:25:31.964245+0000","last_became_peered":"2023-05-10T01:25:31.964245+0000","last_unstale":"2023-05-10T01:25:32.365404+0000","last_undegraded":"2023-05-10T01:25:32.365404+0000","last_fullsized":"2023-05-10T01:25:32.365404+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364429+0000","last_change":"2023-05-10T01:25:32.355599+0000","last_active":"2023-05-10T01:25:32.364429+0000","last_peered":"2023-05-10T01:25:32.364429+0000","last_clean":"2023-05-10T01:25:32.364429+0000","last_became_active":"2023-05-10T01:25:32.355323+0000","last_became_peered":"2023-05-10T01:25:32.355323+0000","last_unstale":"2023-05-10T01:25:32.364429+0000","last_undegraded":"2023-05-10T01:25:32.364429+0000","last_fullsized":"2023-05-10T01:25:32.364429+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349588+0000","last_change":"2023-05-10T01:25:31.975172+0000","last_active":"2023-05-10T01:25:32.349588+0000","last_peered":"2023-05-10T01:25:32.349588+0000","last_clean":"2023-05-10T01:25:32.349588+0000","last_became_active":"2023-05-10T01:25:31.974835+0000","last_became_peered":"2023-05-10T01:25:31.974835+0000","last_unstale":"2023-05-10T01:25:32.349588+0000","last_undegraded":"2023-05-10T01:25:32.349588+0000","last_fullsized":"2023-05-10T01:25:32.349588+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376179+0000","last_change":"2023-05-10T01:25:32.369364+0000","last_active":"2023-05-10T01:25:32.376179+0000","last_peered":"2023-05-10T01:25:32.376179+0000","last_clean":"2023-05-10T01:25:32.376179+0000","last_became_active":"2023-05-10T01:25:32.369073+0000","last_became_peered":"2023-05-10T01:25:32.369073+0000","last_unstale":"2023-05-10T01:25:32.376179+0000","last_undegraded":"2023-05-10T01:25:32.376179+0000","last_fullsized":"2023-05-10T01:25:32.376179+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351477+0000","last_change":"2023-05-10T01:25:31.970025+0000","last_active":"2023-05-10T01:25:32.351477+0000","last_peered":"2023-05-10T01:25:32.351477+0000","last_clean":"2023-05-10T01:25:32.351477+0000","last_became_active":"2023-05-10T01:25:31.969551+0000","last_became_peered":"2023-05-10T01:25:31.969551+0000","last_unstale":"2023-05-10T01:25:32.351477+0000","last_undegraded":"2023-05-10T01:25:32.351477+0000","last_fullsized":"2023-05-10T01:25:32.351477+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376740+0000","last_change":"2023-05-10T01:25:32.369898+0000","last_active":"2023-05-10T01:25:32.376740+0000","last_peered":"2023-05-10T01:25:32.376740+0000","last_clean":"2023-05-10T01:25:32.376740+0000","last_became_active":"2023-05-10T01:25:32.369619+0000","last_became_peered":"2023-05-10T01:25:32.369619+0000","last_unstale":"2023-05-10T01:25:32.376740+0000","last_undegraded":"2023-05-10T01:25:32.376740+0000","last_fullsized":"2023-05-10T01:25:32.376740+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352932+0000","last_change":"2023-05-10T01:25:31.969673+0000","last_active":"2023-05-10T01:25:32.352932+0000","last_peered":"2023-05-10T01:25:32.352932+0000","last_clean":"2023-05-10T01:25:32.352932+0000","last_became_active":"2023-05-10T01:25:31.969390+0000","last_became_peered":"2023-05-10T01:25:31.969390+0000","last_unstale":"2023-05-10T01:25:32.352932+0000","last_undegraded":"2023-05-10T01:25:32.352932+0000","last_fullsized":"2023-05-10T01:25:32.352932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376511+0000","last_change":"2023-05-10T01:25:32.371772+0000","last_active":"2023-05-10T01:25:32.376511+0000","last_peered":"2023-05-10T01:25:32.376511+0000","last_clean":"2023-05-10T01:25:32.376511+0000","last_became_active":"2023-05-10T01:25:32.371294+0000","last_became_peered":"2023-05-10T01:25:32.371294+0000","last_unstale":"2023-05-10T01:25:32.376511+0000","last_undegraded":"2023-05-10T01:25:32.376511+0000","last_fullsized":"2023-05-10T01:25:32.376511+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358497+0000","last_change":"2023-05-10T01:25:31.977602+0000","last_active":"2023-05-10T01:25:32.358497+0000","last_peered":"2023-05-10T01:25:32.358497+0000","last_clean":"2023-05-10T01:25:32.358497+0000","last_became_active":"2023-05-10T01:25:31.977318+0000","last_became_peered":"2023-05-10T01:25:31.977318+0000","last_unstale":"2023-05-10T01:25:32.358497+0000","last_undegraded":"2023-05-10T01:25:32.358497+0000","last_fullsized":"2023-05-10T01:25:32.358497+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364760+0000","last_change":"2023-05-10T01:25:32.357255+0000","last_active":"2023-05-10T01:25:32.364760+0000","last_peered":"2023-05-10T01:25:32.364760+0000","last_clean":"2023-05-10T01:25:32.364760+0000","last_became_active":"2023-05-10T01:25:32.356612+0000","last_became_peered":"2023-05-10T01:25:32.356612+0000","last_unstale":"2023-05-10T01:25:32.364760+0000","last_undegraded":"2023-05-10T01:25:32.364760+0000","last_fullsized":"2023-05-10T01:25:32.364760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370591+0000","last_change":"2023-05-10T01:25:31.970847+0000","last_active":"2023-05-10T01:25:32.370591+0000","last_peered":"2023-05-10T01:25:32.370591+0000","last_clean":"2023-05-10T01:25:32.370591+0000","last_became_active":"2023-05-10T01:25:31.970405+0000","last_became_peered":"2023-05-10T01:25:31.970405+0000","last_unstale":"2023-05-10T01:25:32.370591+0000","last_undegraded":"2023-05-10T01:25:32.370591+0000","last_fullsized":"2023-05-10T01:25:32.370591+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364316+0000","last_change":"2023-05-10T01:25:32.358354+0000","last_active":"2023-05-10T01:25:32.364316+0000","last_peered":"2023-05-10T01:25:32.364316+0000","last_clean":"2023-05-10T01:25:32.364316+0000","last_became_active":"2023-05-10T01:25:32.358100+0000","last_became_peered":"2023-05-10T01:25:32.358100+0000","last_unstale":"2023-05-10T01:25:32.364316+0000","last_undegraded":"2023-05-10T01:25:32.364316+0000","last_fullsized":"2023-05-10T01:25:32.364316+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370725+0000","last_change":"2023-05-10T01:25:31.964658+0000","last_active":"2023-05-10T01:25:32.370725+0000","last_peered":"2023-05-10T01:25:32.370725+0000","last_clean":"2023-05-10T01:25:32.370725+0000","last_became_active":"2023-05-10T01:25:31.964396+0000","last_became_peered":"2023-05-10T01:25:31.964396+0000","last_unstale":"2023-05-10T01:25:32.370725+0000","last_undegraded":"2023-05-10T01:25:32.370725+0000","last_fullsized":"2023-05-10T01:25:32.370725+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374492+0000","last_change":"2023-05-10T01:25:32.364797+0000","last_active":"2023-05-10T01:25:32.374492+0000","last_peered":"2023-05-10T01:25:32.374492+0000","last_clean":"2023-05-10T01:25:32.374492+0000","last_became_active":"2023-05-10T01:25:32.364521+0000","last_became_peered":"2023-05-10T01:25:32.364521+0000","last_unstale":"2023-05-10T01:25:32.374492+0000","last_undegraded":"2023-05-10T01:25:32.374492+0000","last_fullsized":"2023-05-10T01:25:32.374492+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374401+0000","last_change":"2023-05-10T01:25:31.979334+0000","last_active":"2023-05-10T01:25:32.374401+0000","last_peered":"2023-05-10T01:25:32.374401+0000","last_clean":"2023-05-10T01:25:32.374401+0000","last_became_active":"2023-05-10T01:25:31.979046+0000","last_became_peered":"2023-05-10T01:25:31.979046+0000","last_unstale":"2023-05-10T01:25:32.374401+0000","last_undegraded":"2023-05-10T01:25:32.374401+0000","last_fullsized":"2023-05-10T01:25:32.374401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373788+0000","last_change":"2023-05-10T01:25:32.372782+0000","last_active":"2023-05-10T01:25:32.373788+0000","last_peered":"2023-05-10T01:25:32.373788+0000","last_clean":"2023-05-10T01:25:32.373788+0000","last_became_active":"2023-05-10T01:25:32.372495+0000","last_became_peered":"2023-05-10T01:25:32.372495+0000","last_unstale":"2023-05-10T01:25:32.373788+0000","last_undegraded":"2023-05-10T01:25:32.373788+0000","last_fullsized":"2023-05-10T01:25:32.373788+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365277+0000","last_change":"2023-05-10T01:25:31.976181+0000","last_active":"2023-05-10T01:25:32.365277+0000","last_peered":"2023-05-10T01:25:32.365277+0000","last_clean":"2023-05-10T01:25:32.365277+0000","last_became_active":"2023-05-10T01:25:31.975819+0000","last_became_peered":"2023-05-10T01:25:31.975819+0000","last_unstale":"2023-05-10T01:25:32.365277+0000","last_undegraded":"2023-05-10T01:25:32.365277+0000","last_fullsized":"2023-05-10T01:25:32.365277+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368627+0000","last_change":"2023-05-10T01:25:32.363765+0000","last_active":"2023-05-10T01:25:32.368627+0000","last_peered":"2023-05-10T01:25:32.368627+0000","last_clean":"2023-05-10T01:25:32.368627+0000","last_became_active":"2023-05-10T01:25:32.363478+0000","last_became_peered":"2023-05-10T01:25:32.363478+0000","last_unstale":"2023-05-10T01:25:32.368627+0000","last_undegraded":"2023-05-10T01:25:32.368627+0000","last_fullsized":"2023-05-10T01:25:32.368627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353472+0000","last_change":"2023-05-10T01:25:31.965616+0000","last_active":"2023-05-10T01:25:32.353472+0000","last_peered":"2023-05-10T01:25:32.353472+0000","last_clean":"2023-05-10T01:25:32.353472+0000","last_became_active":"2023-05-10T01:25:31.965290+0000","last_became_peered":"2023-05-10T01:25:31.965290+0000","last_unstale":"2023-05-10T01:25:32.353472+0000","last_undegraded":"2023-05-10T01:25:32.353472+0000","last_fullsized":"2023-05-10T01:25:32.353472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376337+0000","last_change":"2023-05-10T01:25:32.371473+0000","last_active":"2023-05-10T01:25:32.376337+0000","last_peered":"2023-05-10T01:25:32.376337+0000","last_clean":"2023-05-10T01:25:32.376337+0000","last_became_active":"2023-05-10T01:25:32.370626+0000","last_became_peered":"2023-05-10T01:25:32.370626+0000","last_unstale":"2023-05-10T01:25:32.376337+0000","last_undegraded":"2023-05-10T01:25:32.376337+0000","last_fullsized":"2023-05-10T01:25:32.376337+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.350534+0000","last_change":"2023-05-10T01:25:31.969840+0000","last_active":"2023-05-10T01:25:32.350534+0000","last_peered":"2023-05-10T01:25:32.350534+0000","last_clean":"2023-05-10T01:25:32.350534+0000","last_became_active":"2023-05-10T01:25:31.969152+0000","last_became_peered":"2023-05-10T01:25:31.969152+0000","last_unstale":"2023-05-10T01:25:32.350534+0000","last_undegraded":"2023-05-10T01:25:32.350534+0000","last_fullsized":"2023-05-10T01:25:32.350534+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366836+0000","last_change":"2023-05-10T01:25:32.363757+0000","last_active":"2023-05-10T01:25:32.366836+0000","last_peered":"2023-05-10T01:25:32.366836+0000","last_clean":"2023-05-10T01:25:32.366836+0000","last_became_active":"2023-05-10T01:25:32.363316+0000","last_became_peered":"2023-05-10T01:25:32.363316+0000","last_unstale":"2023-05-10T01:25:32.366836+0000","last_undegraded":"2023-05-10T01:25:32.366836+0000","last_fullsized":"2023-05-10T01:25:32.366836+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.352830+0000","last_change":"2023-05-10T01:25:31.964677+0000","last_active":"2023-05-10T01:25:32.352830+0000","last_peered":"2023-05-10T01:25:32.352830+0000","last_clean":"2023-05-10T01:25:32.352830+0000","last_became_active":"2023-05-10T01:25:31.964357+0000","last_became_peered":"2023-05-10T01:25:31.964357+0000","last_unstale":"2023-05-10T01:25:32.352830+0000","last_undegraded":"2023-05-10T01:25:32.352830+0000","last_fullsized":"2023-05-10T01:25:32.352830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371284+0000","last_change":"2023-05-10T01:25:32.370504+0000","last_active":"2023-05-10T01:25:32.371284+0000","last_peered":"2023-05-10T01:25:32.371284+0000","last_clean":"2023-05-10T01:25:32.371284+0000","last_became_active":"2023-05-10T01:25:32.370218+0000","last_became_peered":"2023-05-10T01:25:32.370218+0000","last_unstale":"2023-05-10T01:25:32.371284+0000","last_undegraded":"2023-05-10T01:25:32.371284+0000","last_fullsized":"2023-05-10T01:25:32.371284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360756+0000","last_change":"2023-05-10T01:25:31.971175+0000","last_active":"2023-05-10T01:25:32.360756+0000","last_peered":"2023-05-10T01:25:32.360756+0000","last_clean":"2023-05-10T01:25:32.360756+0000","last_became_active":"2023-05-10T01:25:31.970883+0000","last_became_peered":"2023-05-10T01:25:31.970883+0000","last_unstale":"2023-05-10T01:25:32.360756+0000","last_undegraded":"2023-05-10T01:25:32.360756+0000","last_fullsized":"2023-05-10T01:25:32.360756+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.366998+0000","last_change":"2023-05-10T01:25:32.363317+0000","last_active":"2023-05-10T01:25:32.366998+0000","last_peered":"2023-05-10T01:25:32.366998+0000","last_clean":"2023-05-10T01:25:32.366998+0000","last_became_active":"2023-05-10T01:25:32.362892+0000","last_became_peered":"2023-05-10T01:25:32.362892+0000","last_unstale":"2023-05-10T01:25:32.366998+0000","last_undegraded":"2023-05-10T01:25:32.366998+0000","last_fullsized":"2023-05-10T01:25:32.366998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362291+0000","last_change":"2023-05-10T01:25:31.969313+0000","last_active":"2023-05-10T01:25:32.362291+0000","last_peered":"2023-05-10T01:25:32.362291+0000","last_clean":"2023-05-10T01:25:32.362291+0000","last_became_active":"2023-05-10T01:25:31.969042+0000","last_became_peered":"2023-05-10T01:25:31.969042+0000","last_unstale":"2023-05-10T01:25:32.362291+0000","last_undegraded":"2023-05-10T01:25:32.362291+0000","last_fullsized":"2023-05-10T01:25:32.362291+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374508+0000","last_change":"2023-05-10T01:25:32.370843+0000","last_active":"2023-05-10T01:25:32.374508+0000","last_peered":"2023-05-10T01:25:32.374508+0000","last_clean":"2023-05-10T01:25:32.374508+0000","last_became_active":"2023-05-10T01:25:32.370531+0000","last_became_peered":"2023-05-10T01:25:32.370531+0000","last_unstale":"2023-05-10T01:25:32.374508+0000","last_undegraded":"2023-05-10T01:25:32.374508+0000","last_fullsized":"2023-05-10T01:25:32.374508+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353420+0000","last_change":"2023-05-10T01:25:31.978033+0000","last_active":"2023-05-10T01:25:32.353420+0000","last_peered":"2023-05-10T01:25:32.353420+0000","last_clean":"2023-05-10T01:25:32.353420+0000","last_became_active":"2023-05-10T01:25:31.977683+0000","last_became_peered":"2023-05-10T01:25:31.977683+0000","last_unstale":"2023-05-10T01:25:32.353420+0000","last_undegraded":"2023-05-10T01:25:32.353420+0000","last_fullsized":"2023-05-10T01:25:32.353420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363570+0000","last_change":"2023-05-10T01:25:32.361937+0000","last_active":"2023-05-10T01:25:32.363570+0000","last_peered":"2023-05-10T01:25:32.363570+0000","last_clean":"2023-05-10T01:25:32.363570+0000","last_became_active":"2023-05-10T01:25:32.361656+0000","last_became_peered":"2023-05-10T01:25:32.361656+0000","last_unstale":"2023-05-10T01:25:32.363570+0000","last_undegraded":"2023-05-10T01:25:32.363570+0000","last_fullsized":"2023-05-10T01:25:32.363570+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.369356+0000","last_change":"2023-05-10T01:25:31.970229+0000","last_active":"2023-05-10T01:25:32.369356+0000","last_peered":"2023-05-10T01:25:32.369356+0000","last_clean":"2023-05-10T01:25:32.369356+0000","last_became_active":"2023-05-10T01:25:31.969792+0000","last_became_peered":"2023-05-10T01:25:31.969792+0000","last_unstale":"2023-05-10T01:25:32.369356+0000","last_undegraded":"2023-05-10T01:25:32.369356+0000","last_fullsized":"2023-05-10T01:25:32.369356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.370768+0000","last_change":"2023-05-10T01:25:32.369554+0000","last_active":"2023-05-10T01:25:32.370768+0000","last_peered":"2023-05-10T01:25:32.370768+0000","last_clean":"2023-05-10T01:25:32.370768+0000","last_became_active":"2023-05-10T01:25:32.369128+0000","last_became_peered":"2023-05-10T01:25:32.369128+0000","last_unstale":"2023-05-10T01:25:32.370768+0000","last_undegraded":"2023-05-10T01:25:32.370768+0000","last_fullsized":"2023-05-10T01:25:32.370768+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368771+0000","last_change":"2023-05-10T01:25:31.965952+0000","last_active":"2023-05-10T01:25:32.368771+0000","last_peered":"2023-05-10T01:25:32.368771+0000","last_clean":"2023-05-10T01:25:32.368771+0000","last_became_active":"2023-05-10T01:25:31.965197+0000","last_became_peered":"2023-05-10T01:25:31.965197+0000","last_unstale":"2023-05-10T01:25:32.368771+0000","last_undegraded":"2023-05-10T01:25:32.368771+0000","last_fullsized":"2023-05-10T01:25:32.368771+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.373623+0000","last_change":"2023-05-10T01:25:32.372333+0000","last_active":"2023-05-10T01:25:32.373623+0000","last_peered":"2023-05-10T01:25:32.373623+0000","last_clean":"2023-05-10T01:25:32.373623+0000","last_became_active":"2023-05-10T01:25:32.372045+0000","last_became_peered":"2023-05-10T01:25:32.372045+0000","last_unstale":"2023-05-10T01:25:32.373623+0000","last_undegraded":"2023-05-10T01:25:32.373623+0000","last_fullsized":"2023-05-10T01:25:32.373623+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372282+0000","last_change":"2023-05-10T01:25:31.971185+0000","last_active":"2023-05-10T01:25:32.372282+0000","last_peered":"2023-05-10T01:25:32.372282+0000","last_clean":"2023-05-10T01:25:32.372282+0000","last_became_active":"2023-05-10T01:25:31.970905+0000","last_became_peered":"2023-05-10T01:25:31.970905+0000","last_unstale":"2023-05-10T01:25:32.372282+0000","last_undegraded":"2023-05-10T01:25:32.372282+0000","last_fullsized":"2023-05-10T01:25:32.372282+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376801+0000","last_change":"2023-05-10T01:25:32.373164+0000","last_active":"2023-05-10T01:25:32.376801+0000","last_peered":"2023-05-10T01:25:32.376801+0000","last_clean":"2023-05-10T01:25:32.376801+0000","last_became_active":"2023-05-10T01:25:32.372876+0000","last_became_peered":"2023-05-10T01:25:32.372876+0000","last_unstale":"2023-05-10T01:25:32.376801+0000","last_undegraded":"2023-05-10T01:25:32.376801+0000","last_fullsized":"2023-05-10T01:25:32.376801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.346366+0000","last_change":"2023-05-10T01:25:31.963088+0000","last_active":"2023-05-10T01:25:32.346366+0000","last_peered":"2023-05-10T01:25:32.346366+0000","last_clean":"2023-05-10T01:25:32.346366+0000","last_became_active":"2023-05-10T01:25:31.962304+0000","last_became_peered":"2023-05-10T01:25:31.962304+0000","last_unstale":"2023-05-10T01:25:32.346366+0000","last_undegraded":"2023-05-10T01:25:32.346366+0000","last_fullsized":"2023-05-10T01:25:32.346366+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364353+0000","last_change":"2023-05-10T01:25:32.363444+0000","last_active":"2023-05-10T01:25:32.364353+0000","last_peered":"2023-05-10T01:25:32.364353+0000","last_clean":"2023-05-10T01:25:32.364353+0000","last_became_active":"2023-05-10T01:25:32.363205+0000","last_became_peered":"2023-05-10T01:25:32.363205+0000","last_unstale":"2023-05-10T01:25:32.364353+0000","last_undegraded":"2023-05-10T01:25:32.364353+0000","last_fullsized":"2023-05-10T01:25:32.364353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.348946+0000","last_change":"2023-05-10T01:25:31.973667+0000","last_active":"2023-05-10T01:25:32.348946+0000","last_peered":"2023-05-10T01:25:32.348946+0000","last_clean":"2023-05-10T01:25:32.348946+0000","last_became_active":"2023-05-10T01:25:31.973364+0000","last_became_peered":"2023-05-10T01:25:31.973364+0000","last_unstale":"2023-05-10T01:25:32.348946+0000","last_undegraded":"2023-05-10T01:25:32.348946+0000","last_fullsized":"2023-05-10T01:25:32.348946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.363667+0000","last_change":"2023-05-10T01:25:32.360888+0000","last_active":"2023-05-10T01:25:32.363667+0000","last_peered":"2023-05-10T01:25:32.363667+0000","last_clean":"2023-05-10T01:25:32.363667+0000","last_became_active":"2023-05-10T01:25:32.360630+0000","last_became_peered":"2023-05-10T01:25:32.360630+0000","last_unstale":"2023-05-10T01:25:32.363667+0000","last_undegraded":"2023-05-10T01:25:32.363667+0000","last_fullsized":"2023-05-10T01:25:32.363667+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365017+0000","last_change":"2023-05-10T01:25:31.973649+0000","last_active":"2023-05-10T01:25:32.365017+0000","last_peered":"2023-05-10T01:25:32.365017+0000","last_clean":"2023-05-10T01:25:32.365017+0000","last_became_active":"2023-05-10T01:25:31.973312+0000","last_became_peered":"2023-05-10T01:25:31.973312+0000","last_unstale":"2023-05-10T01:25:32.365017+0000","last_undegraded":"2023-05-10T01:25:32.365017+0000","last_fullsized":"2023-05-10T01:25:32.365017+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.379544+0000","last_change":"2023-05-10T01:25:32.375938+0000","last_active":"2023-05-10T01:25:32.379544+0000","last_peered":"2023-05-10T01:25:32.379544+0000","last_clean":"2023-05-10T01:25:32.379544+0000","last_became_active":"2023-05-10T01:25:32.375643+0000","last_became_peered":"2023-05-10T01:25:32.375643+0000","last_unstale":"2023-05-10T01:25:32.379544+0000","last_undegraded":"2023-05-10T01:25:32.379544+0000","last_fullsized":"2023-05-10T01:25:32.379544+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.371043+0000","last_change":"2023-05-10T01:25:31.964890+0000","last_active":"2023-05-10T01:25:32.371043+0000","last_peered":"2023-05-10T01:25:32.371043+0000","last_clean":"2023-05-10T01:25:32.371043+0000","last_became_active":"2023-05-10T01:25:31.964639+0000","last_became_peered":"2023-05-10T01:25:31.964639+0000","last_unstale":"2023-05-10T01:25:32.371043+0000","last_undegraded":"2023-05-10T01:25:32.371043+0000","last_fullsized":"2023-05-10T01:25:32.371043+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368792+0000","last_change":"2023-05-10T01:25:32.367931+0000","last_active":"2023-05-10T01:25:32.368792+0000","last_peered":"2023-05-10T01:25:32.368792+0000","last_clean":"2023-05-10T01:25:32.368792+0000","last_became_active":"2023-05-10T01:25:32.366029+0000","last_became_peered":"2023-05-10T01:25:32.366029+0000","last_unstale":"2023-05-10T01:25:32.368792+0000","last_undegraded":"2023-05-10T01:25:32.368792+0000","last_fullsized":"2023-05-10T01:25:32.368792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.355466+0000","last_change":"2023-05-10T01:25:31.959959+0000","last_active":"2023-05-10T01:25:32.355466+0000","last_peered":"2023-05-10T01:25:32.355466+0000","last_clean":"2023-05-10T01:25:32.355466+0000","last_became_active":"2023-05-10T01:25:31.959662+0000","last_became_peered":"2023-05-10T01:25:31.959662+0000","last_unstale":"2023-05-10T01:25:32.355466+0000","last_undegraded":"2023-05-10T01:25:32.355466+0000","last_fullsized":"2023-05-10T01:25:32.355466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364206+0000","last_change":"2023-05-10T01:25:32.358333+0000","last_active":"2023-05-10T01:25:32.364206+0000","last_peered":"2023-05-10T01:25:32.364206+0000","last_clean":"2023-05-10T01:25:32.364206+0000","last_became_active":"2023-05-10T01:25:32.357905+0000","last_became_peered":"2023-05-10T01:25:32.357905+0000","last_unstale":"2023-05-10T01:25:32.364206+0000","last_undegraded":"2023-05-10T01:25:32.364206+0000","last_fullsized":"2023-05-10T01:25:32.364206+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356826+0000","last_change":"2023-05-10T01:25:31.970051+0000","last_active":"2023-05-10T01:25:32.356826+0000","last_peered":"2023-05-10T01:25:32.356826+0000","last_clean":"2023-05-10T01:25:32.356826+0000","last_became_active":"2023-05-10T01:25:31.969424+0000","last_became_peered":"2023-05-10T01:25:31.969424+0000","last_unstale":"2023-05-10T01:25:32.356826+0000","last_undegraded":"2023-05-10T01:25:32.356826+0000","last_fullsized":"2023-05-10T01:25:32.356826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372549+0000","last_change":"2023-05-10T01:25:32.363105+0000","last_active":"2023-05-10T01:25:32.372549+0000","last_peered":"2023-05-10T01:25:32.372549+0000","last_clean":"2023-05-10T01:25:32.372549+0000","last_became_active":"2023-05-10T01:25:32.362820+0000","last_became_peered":"2023-05-10T01:25:32.362820+0000","last_unstale":"2023-05-10T01:25:32.372549+0000","last_undegraded":"2023-05-10T01:25:32.372549+0000","last_fullsized":"2023-05-10T01:25:32.372549+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.365166+0000","last_change":"2023-05-10T01:25:31.970658+0000","last_active":"2023-05-10T01:25:32.365166+0000","last_peered":"2023-05-10T01:25:32.365166+0000","last_clean":"2023-05-10T01:25:32.365166+0000","last_became_active":"2023-05-10T01:25:31.970357+0000","last_became_peered":"2023-05-10T01:25:31.970357+0000","last_unstale":"2023-05-10T01:25:32.365166+0000","last_undegraded":"2023-05-10T01:25:32.365166+0000","last_fullsized":"2023-05-10T01:25:32.365166+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367302+0000","last_change":"2023-05-10T01:25:32.364606+0000","last_active":"2023-05-10T01:25:32.367302+0000","last_peered":"2023-05-10T01:25:32.367302+0000","last_clean":"2023-05-10T01:25:32.367302+0000","last_became_active":"2023-05-10T01:25:32.364291+0000","last_became_peered":"2023-05-10T01:25:32.364291+0000","last_unstale":"2023-05-10T01:25:32.367302+0000","last_undegraded":"2023-05-10T01:25:32.367302+0000","last_fullsized":"2023-05-10T01:25:32.367302+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.347325+0000","last_change":"2023-05-10T01:25:31.962288+0000","last_active":"2023-05-10T01:25:32.347325+0000","last_peered":"2023-05-10T01:25:32.347325+0000","last_clean":"2023-05-10T01:25:32.347325+0000","last_became_active":"2023-05-10T01:25:31.961985+0000","last_became_peered":"2023-05-10T01:25:31.961985+0000","last_unstale":"2023-05-10T01:25:32.347325+0000","last_undegraded":"2023-05-10T01:25:32.347325+0000","last_fullsized":"2023-05-10T01:25:32.347325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.367599+0000","last_change":"2023-05-10T01:25:32.363926+0000","last_active":"2023-05-10T01:25:32.367599+0000","last_peered":"2023-05-10T01:25:32.367599+0000","last_clean":"2023-05-10T01:25:32.367599+0000","last_became_active":"2023-05-10T01:25:32.363672+0000","last_became_peered":"2023-05-10T01:25:32.363672+0000","last_unstale":"2023-05-10T01:25:32.367599+0000","last_undegraded":"2023-05-10T01:25:32.367599+0000","last_fullsized":"2023-05-10T01:25:32.367599+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358392+0000","last_change":"2023-05-10T01:25:31.965600+0000","last_active":"2023-05-10T01:25:32.358392+0000","last_peered":"2023-05-10T01:25:32.358392+0000","last_clean":"2023-05-10T01:25:32.358392+0000","last_became_active":"2023-05-10T01:25:31.965287+0000","last_became_peered":"2023-05-10T01:25:31.965287+0000","last_unstale":"2023-05-10T01:25:32.358392+0000","last_undegraded":"2023-05-10T01:25:32.358392+0000","last_fullsized":"2023-05-10T01:25:32.358392+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376220+0000","last_change":"2023-05-10T01:25:32.370280+0000","last_active":"2023-05-10T01:25:32.376220+0000","last_peered":"2023-05-10T01:25:32.376220+0000","last_clean":"2023-05-10T01:25:32.376220+0000","last_became_active":"2023-05-10T01:25:32.369720+0000","last_became_peered":"2023-05-10T01:25:32.369720+0000","last_unstale":"2023-05-10T01:25:32.376220+0000","last_undegraded":"2023-05-10T01:25:32.376220+0000","last_fullsized":"2023-05-10T01:25:32.376220+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360801+0000","last_change":"2023-05-10T01:25:31.969829+0000","last_active":"2023-05-10T01:25:32.360801+0000","last_peered":"2023-05-10T01:25:32.360801+0000","last_clean":"2023-05-10T01:25:32.360801+0000","last_became_active":"2023-05-10T01:25:31.969388+0000","last_became_peered":"2023-05-10T01:25:31.969388+0000","last_unstale":"2023-05-10T01:25:32.360801+0000","last_undegraded":"2023-05-10T01:25:32.360801+0000","last_fullsized":"2023-05-10T01:25:32.360801+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364085+0000","last_change":"2023-05-10T01:25:32.356942+0000","last_active":"2023-05-10T01:25:32.364085+0000","last_peered":"2023-05-10T01:25:32.364085+0000","last_clean":"2023-05-10T01:25:32.364085+0000","last_became_active":"2023-05-10T01:25:32.356494+0000","last_became_peered":"2023-05-10T01:25:32.356494+0000","last_unstale":"2023-05-10T01:25:32.364085+0000","last_undegraded":"2023-05-10T01:25:32.364085+0000","last_fullsized":"2023-05-10T01:25:32.364085+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360874+0000","last_change":"2023-05-10T01:25:31.976216+0000","last_active":"2023-05-10T01:25:32.360874+0000","last_peered":"2023-05-10T01:25:32.360874+0000","last_clean":"2023-05-10T01:25:32.360874+0000","last_became_active":"2023-05-10T01:25:31.975898+0000","last_became_peered":"2023-05-10T01:25:31.975898+0000","last_unstale":"2023-05-10T01:25:32.360874+0000","last_undegraded":"2023-05-10T01:25:32.360874+0000","last_fullsized":"2023-05-10T01:25:32.360874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368781+0000","last_change":"2023-05-10T01:25:32.367401+0000","last_active":"2023-05-10T01:25:32.368781+0000","last_peered":"2023-05-10T01:25:32.368781+0000","last_clean":"2023-05-10T01:25:32.368781+0000","last_became_active":"2023-05-10T01:25:32.365781+0000","last_became_peered":"2023-05-10T01:25:32.365781+0000","last_unstale":"2023-05-10T01:25:32.368781+0000","last_undegraded":"2023-05-10T01:25:32.368781+0000","last_fullsized":"2023-05-10T01:25:32.368781+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.368291+0000","last_change":"2023-05-10T01:25:31.965962+0000","last_active":"2023-05-10T01:25:32.368291+0000","last_peered":"2023-05-10T01:25:32.368291+0000","last_clean":"2023-05-10T01:25:32.368291+0000","last_became_active":"2023-05-10T01:25:31.965097+0000","last_became_peered":"2023-05-10T01:25:31.965097+0000","last_unstale":"2023-05-10T01:25:32.368291+0000","last_undegraded":"2023-05-10T01:25:32.368291+0000","last_fullsized":"2023-05-10T01:25:32.368291+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351319+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:25:32.351319+0000","last_peered":"2023-05-10T01:25:32.351319+0000","last_clean":"2023-05-10T01:25:32.351319+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:25:32.351319+0000","last_undegraded":"2023-05-10T01:25:32.351319+0000","last_fullsized":"2023-05-10T01:25:32.351319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364856+0000","last_change":"2023-05-10T01:25:32.358939+0000","last_active":"2023-05-10T01:25:32.364856+0000","last_peered":"2023-05-10T01:25:32.364856+0000","last_clean":"2023-05-10T01:25:32.364856+0000","last_became_active":"2023-05-10T01:25:32.358631+0000","last_became_peered":"2023-05-10T01:25:32.358631+0000","last_unstale":"2023-05-10T01:25:32.364856+0000","last_undegraded":"2023-05-10T01:25:32.364856+0000","last_fullsized":"2023-05-10T01:25:32.364856+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356583+0000","last_change":"2023-05-10T01:25:31.967422+0000","last_active":"2023-05-10T01:25:32.356583+0000","last_peered":"2023-05-10T01:25:32.356583+0000","last_clean":"2023-05-10T01:25:32.356583+0000","last_became_active":"2023-05-10T01:25:31.967094+0000","last_became_peered":"2023-05-10T01:25:31.967094+0000","last_unstale":"2023-05-10T01:25:32.356583+0000","last_undegraded":"2023-05-10T01:25:32.356583+0000","last_fullsized":"2023-05-10T01:25:32.356583+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.358483+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:25:32.358483+0000","last_peered":"2023-05-10T01:25:32.358483+0000","last_clean":"2023-05-10T01:25:32.358483+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:25:32.358483+0000","last_undegraded":"2023-05-10T01:25:32.358483+0000","last_fullsized":"2023-05-10T01:25:32.358483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376307+0000","last_change":"2023-05-10T01:25:32.371317+0000","last_active":"2023-05-10T01:25:32.376307+0000","last_peered":"2023-05-10T01:25:32.376307+0000","last_clean":"2023-05-10T01:25:32.376307+0000","last_became_active":"2023-05-10T01:25:32.371021+0000","last_became_peered":"2023-05-10T01:25:32.371021+0000","last_unstale":"2023-05-10T01:25:32.376307+0000","last_undegraded":"2023-05-10T01:25:32.376307+0000","last_fullsized":"2023-05-10T01:25:32.376307+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.374431+0000","last_change":"2023-05-10T01:25:31.965809+0000","last_active":"2023-05-10T01:25:32.374431+0000","last_peered":"2023-05-10T01:25:32.374431+0000","last_clean":"2023-05-10T01:25:32.374431+0000","last_became_active":"2023-05-10T01:25:31.965539+0000","last_became_peered":"2023-05-10T01:25:31.965539+0000","last_unstale":"2023-05-10T01:25:32.374431+0000","last_undegraded":"2023-05-10T01:25:32.374431+0000","last_fullsized":"2023-05-10T01:25:32.374431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353073+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:25:32.353073+0000","last_peered":"2023-05-10T01:25:32.353073+0000","last_clean":"2023-05-10T01:25:32.353073+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:25:32.353073+0000","last_undegraded":"2023-05-10T01:25:32.353073+0000","last_fullsized":"2023-05-10T01:25:32.353073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376504+0000","last_change":"2023-05-10T01:25:32.371444+0000","last_active":"2023-05-10T01:25:32.376504+0000","last_peered":"2023-05-10T01:25:32.376504+0000","last_clean":"2023-05-10T01:25:32.376504+0000","last_became_active":"2023-05-10T01:25:32.371202+0000","last_became_peered":"2023-05-10T01:25:32.371202+0000","last_unstale":"2023-05-10T01:25:32.376504+0000","last_undegraded":"2023-05-10T01:25:32.376504+0000","last_fullsized":"2023-05-10T01:25:32.376504+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.351244+0000","last_change":"2023-05-10T01:25:31.968267+0000","last_active":"2023-05-10T01:25:32.351244+0000","last_peered":"2023-05-10T01:25:32.351244+0000","last_clean":"2023-05-10T01:25:32.351244+0000","last_became_active":"2023-05-10T01:25:31.966814+0000","last_became_peered":"2023-05-10T01:25:31.966814+0000","last_unstale":"2023-05-10T01:25:32.351244+0000","last_undegraded":"2023-05-10T01:25:32.351244+0000","last_fullsized":"2023-05-10T01:25:32.351244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.356452+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:25:32.356452+0000","last_peered":"2023-05-10T01:25:32.356452+0000","last_clean":"2023-05-10T01:25:32.356452+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:25:32.356452+0000","last_undegraded":"2023-05-10T01:25:32.356452+0000","last_fullsized":"2023-05-10T01:25:32.356452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360971+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:25:32.360971+0000","last_peered":"2023-05-10T01:25:32.360971+0000","last_clean":"2023-05-10T01:25:32.360971+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:25:32.360971+0000","last_undegraded":"2023-05-10T01:25:32.360971+0000","last_fullsized":"2023-05-10T01:25:32.360971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364782+0000","last_change":"2023-05-10T01:25:32.357437+0000","last_active":"2023-05-10T01:25:32.364782+0000","last_peered":"2023-05-10T01:25:32.364782+0000","last_clean":"2023-05-10T01:25:32.364782+0000","last_became_active":"2023-05-10T01:25:32.356962+0000","last_became_peered":"2023-05-10T01:25:32.356962+0000","last_unstale":"2023-05-10T01:25:32.364782+0000","last_undegraded":"2023-05-10T01:25:32.364782+0000","last_fullsized":"2023-05-10T01:25:32.364782+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.375422+0000","last_change":"2023-05-10T01:25:31.972380+0000","last_active":"2023-05-10T01:25:32.375422+0000","last_peered":"2023-05-10T01:25:32.375422+0000","last_clean":"2023-05-10T01:25:32.375422+0000","last_became_active":"2023-05-10T01:25:31.972009+0000","last_became_peered":"2023-05-10T01:25:31.972009+0000","last_unstale":"2023-05-10T01:25:32.375422+0000","last_undegraded":"2023-05-10T01:25:32.375422+0000","last_fullsized":"2023-05-10T01:25:32.375422+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.361053+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:25:32.361053+0000","last_peered":"2023-05-10T01:25:32.361053+0000","last_clean":"2023-05-10T01:25:32.361053+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:25:32.361053+0000","last_undegraded":"2023-05-10T01:25:32.361053+0000","last_fullsized":"2023-05-10T01:25:32.361053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.376137+0000","last_change":"2023-05-10T01:25:32.368865+0000","last_active":"2023-05-10T01:25:32.376137+0000","last_peered":"2023-05-10T01:25:32.376137+0000","last_clean":"2023-05-10T01:25:32.376137+0000","last_became_active":"2023-05-10T01:25:32.368504+0000","last_became_peered":"2023-05-10T01:25:32.368504+0000","last_unstale":"2023-05-10T01:25:32.376137+0000","last_undegraded":"2023-05-10T01:25:32.376137+0000","last_fullsized":"2023-05-10T01:25:32.376137+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353491+0000","last_change":"2023-05-10T01:25:31.979873+0000","last_active":"2023-05-10T01:25:32.353491+0000","last_peered":"2023-05-10T01:25:32.353491+0000","last_clean":"2023-05-10T01:25:32.353491+0000","last_became_active":"2023-05-10T01:25:31.979377+0000","last_became_peered":"2023-05-10T01:25:31.979377+0000","last_unstale":"2023-05-10T01:25:32.353491+0000","last_undegraded":"2023-05-10T01:25:32.353491+0000","last_fullsized":"2023-05-10T01:25:32.353491+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.361540+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:25:32.361540+0000","last_peered":"2023-05-10T01:25:32.361540+0000","last_clean":"2023-05-10T01:25:32.361540+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:25:32.361540+0000","last_undegraded":"2023-05-10T01:25:32.361540+0000","last_fullsized":"2023-05-10T01:25:32.361540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.372982+0000","last_change":"2023-05-10T01:25:32.367629+0000","last_active":"2023-05-10T01:25:32.372982+0000","last_peered":"2023-05-10T01:25:32.372982+0000","last_clean":"2023-05-10T01:25:32.372982+0000","last_became_active":"2023-05-10T01:25:32.367320+0000","last_became_peered":"2023-05-10T01:25:32.367320+0000","last_unstale":"2023-05-10T01:25:32.372982+0000","last_undegraded":"2023-05-10T01:25:32.372982+0000","last_fullsized":"2023-05-10T01:25:32.372982+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.360590+0000","last_change":"2023-05-10T01:25:31.969985+0000","last_active":"2023-05-10T01:25:32.360590+0000","last_peered":"2023-05-10T01:25:32.360590+0000","last_clean":"2023-05-10T01:25:32.360590+0000","last_became_active":"2023-05-10T01:25:31.969682+0000","last_became_peered":"2023-05-10T01:25:31.969682+0000","last_unstale":"2023-05-10T01:25:32.360590+0000","last_undegraded":"2023-05-10T01:25:32.360590+0000","last_fullsized":"2023-05-10T01:25:32.360590+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.349006+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:25:32.349006+0000","last_peered":"2023-05-10T01:25:32.349006+0000","last_clean":"2023-05-10T01:25:32.349006+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:25:32.349006+0000","last_undegraded":"2023-05-10T01:25:32.349006+0000","last_fullsized":"2023-05-10T01:25:32.349006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.364064+0000","last_change":"2023-05-10T01:25:32.356772+0000","last_active":"2023-05-10T01:25:32.364064+0000","last_peered":"2023-05-10T01:25:32.364064+0000","last_clean":"2023-05-10T01:25:32.364064+0000","last_became_active":"2023-05-10T01:25:32.356119+0000","last_became_peered":"2023-05-10T01:25:32.356119+0000","last_unstale":"2023-05-10T01:25:32.364064+0000","last_undegraded":"2023-05-10T01:25:32.364064+0000","last_fullsized":"2023-05-10T01:25:32.364064+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:31.940887+0000","last_clean_scrub_stamp":"2023-05-10T01:25:31.940887+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.353407+0000","last_change":"2023-05-10T01:25:31.965743+0000","last_active":"2023-05-10T01:25:32.353407+0000","last_peered":"2023-05-10T01:25:32.353407+0000","last_clean":"2023-05-10T01:25:32.353407+0000","last_became_active":"2023-05-10T01:25:31.964905+0000","last_became_peered":"2023-05-10T01:25:31.964905+0000","last_unstale":"2023-05-10T01:25:32.353407+0000","last_undegraded":"2023-05-10T01:25:32.353407+0000","last_fullsized":"2023-05-10T01:25:32.353407+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:25:30.935629+0000","last_clean_scrub_stamp":"2023-05-10T01:25:30.935629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-05-10T01:25:32.362359+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:25:32.362359+0000","last_peered":"2023-05-10T01:25:32.362359+0000","last_clean":"2023-05-10T01:25:32.362359+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:25:32.362359+0000","last_undegraded":"2023-05-10T01:25:32.362359+0000","last_fullsized":"2023-05-10T01:25:32.362359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18080,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353760,"statfs":{"total":96636764160,"available":96618250240,"internally_reserved":0,"allocated":1335296,"data_stored":671277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.79900000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.98199999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.36399999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":3.016,"15min":3.016},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.93300000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.374,"15min":0.374},"max":{"1min":0.69399999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.85899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.753,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.436},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.751,"15min":0.78000000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.83399999999999996,"15min":0.90400000000000003},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":1.052},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51900000000000002,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76500000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.88200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.95899999999999996},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17452,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94354388,"statfs":{"total":96636764160,"available":96618893312,"internally_reserved":0,"allocated":1347584,"data_stored":673333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.745},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":1.1000000000000001,"15min":1.1160000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.28799999999999998},"max":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":1.159},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.379,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.321},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.88100000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21464,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":20160,"kb_avail":94350376,"statfs":{"total":96636764160,"available":96614785024,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20643840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.22},"max":{"1min":0.39700000000000002,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.22700000000000001},"max":{"1min":0.39200000000000002,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40799999999999997,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59099999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46600000000000003,"15min":0.48699999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.30399999999999999},"max":{"1min":0.51800000000000002,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56699999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.23400000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.71499999999999997},"last":0.27300000000000002}]},{"osd":4,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":0.81499999999999995,"5min":0.92000000000000004,"15min":1.117},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.623,"15min":0.64300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78100000000000003,"5min":0.95299999999999996,"15min":1.05},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.40200000000000002},"max":{"1min":0.76100000000000001,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.64100000000000001,"15min":0.65600000000000003},"min":{"1min":0.46700000000000003,"5min":0.442,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.93000000000000005,"15min":1.319},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66800000000000004,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76800000000000002,"5min":0.97799999999999998,"15min":1.079},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed May 10 01:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85699999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77800000000000002,"5min":0.90600000000000003,"15min":1.3600000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17132,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354708,"statfs":{"total":96636764160,"available":96619220992,"internally_reserved":0,"allocated":1347584,"data_stored":672059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.753}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69699999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22616,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":21312,"kb_avail":94349224,"statfs":{"total":96636764160,"available":96613605376,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21823488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.47099999999999997,"5min":0.60899999999999999,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.245},"max":{"1min":0.50900000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.247},"max":{"1min":0.53100000000000003,"5min":0.63300000000000001,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40799999999999997,"15min":0.41699999999999998},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.22},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.75},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.3320000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":1.008},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.93300000000000005,"15min":0.98799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.76100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 10 01:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.94199999999999995,"15min":1.091},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78500000000000003,"5min":0.94799999999999995,"15min":1.056},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25440,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94346400,"statfs":{"total":96636764160,"available":96610713600,"internally_reserved":0,"allocated":1335296,"data_stored":672183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.313},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.378},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17696,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354144,"statfs":{"total":96636764160,"available":96618643456,"internally_reserved":0,"allocated":1335296,"data_stored":671865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20888,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":94350952,"statfs":{"total":96636764160,"available":96615374848,"internally_reserved":0,"allocated":1327104,"data_stored":671221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.32800000000000001},"max":{"1min":0.64800000000000002,"5min":0.79800000000000004,"15min":0.82899999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.505}]},{"osd":2,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58599999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.51500000000000001}]},{"osd":3,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67300000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73399999999999999,"5min":0.83799999999999997,"15min":1.0620000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.81799999999999995,"15min":0.82799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.76500000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.372,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.1120000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42499999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:25:41.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:25:41.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:25:41.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.447+0000 7fd064e5f700 1 Processor -- start 2023-05-10T01:25:41.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.447+0000 7fd064e5f700 1 -- start start 2023-05-10T01:25:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd064e5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd0601542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd064e5f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd060062cb0 0x7fd060066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd064e5f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd060155860 con 0x7fd060153ed0 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd064e5f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd060067330 con 0x7fd060062cb0 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd064e5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd060155660 con 0x7fd0600be270 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd060153ed0 0x7fd0600bdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46364/0 (socket says 172.21.15.52:46364) 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05e59c700 1 -- 172.21.15.52:0/540000569 learned_addr learned my addr 172.21.15.52:0/540000569 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05ed9d700 1 --2- 172.21.15.52:0/540000569 >> v2:172.21.15.172:3300/0 conn(0x7fd060062cb0 0x7fd060066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05dd9b700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd0601542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373177488 0 0) 0x7fd060155860 con 0x7fd060153ed0 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0400033f0 con 0x7fd060153ed0 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816206999 0 0) 0x7fd0400033f0 con 0x7fd060153ed0 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 msgr2=0x7fd0601542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd0601542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 >> v2:172.21.15.172:3300/0 conn(0x7fd060062cb0 msgr2=0x7fd060066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 --2- 172.21.15.52:0/540000569 >> v2:172.21.15.172:3300/0 conn(0x7fd060062cb0 0x7fd060066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060063110 con 0x7fd060153ed0 2023-05-10T01:25:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd0580017f0 con 0x7fd060153ed0 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 >> v1:172.21.15.52:6789/0 conn(0x7fd060153ed0 legacy=0x7fd0600bdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.448+0000 7fd05d59a700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd040003910 0x7fd040003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd040004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd040004b80 0x7fd040005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060067330 con 0x7fd040003910 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060155660 con 0x7fd040004b80 2023-05-10T01:25:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04000b8e0 con 0x7fd0600be270 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd040003910 0x7fd040003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05ed9d700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd040004b80 0x7fd040005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05dd9b700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd040004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 -- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 msgr2=0x7fd040004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0600be270 0x7fd040004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 -- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd040004b80 msgr2=0x7fd040005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd040004b80 0x7fd040005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 -- 172.21.15.52:0/540000569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400033f0 con 0x7fd040003910 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05e59c700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd040003910 0x7fd040003d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fd05800c480 tx=0x7fd05800c790).ready entity=mon.0 client_cookie=f369be0178cf7cc0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058002030 con 0x7fd040003910 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800ce20 con 0x7fd040003910 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.449+0000 7fd05d59a700 1 -- 172.21.15.52:0/540000569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058005d30 con 0x7fd040003910 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 -- 172.21.15.52:0/540000569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd040003910 msgr2=0x7fd040003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 --2- 172.21.15.52:0/540000569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd040003910 0x7fd040003d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fd05800c480 tx=0x7fd05800c790).stop 2023-05-10T01:25:41.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd05ed9d700 1 -- 172.21.15.52:0/540000569 reap_dead start 2023-05-10T01:25:41.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 -- 172.21.15.52:0/540000569 shutdown_connections 2023-05-10T01:25:41.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 -- 172.21.15.52:0/540000569 >> 172.21.15.52:0/540000569 conn(0x7fd0600c8410 msgr2=0x7fd0600c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:41.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 -- 172.21.15.52:0/540000569 shutdown_connections 2023-05-10T01:25:41.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.450+0000 7fd064e5f700 1 -- 172.21.15.52:0/540000569 wait complete. 2023-05-10T01:25:41.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.451+0000 7fd064e5f700 1 Processor -- start 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.451+0000 7fd064e5f700 1 -- start start 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd040003910 0x7fd060163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 0x7fd060167330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600a8230 con 0x7fd0600ab300 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060163c00 con 0x7fd0601528b0 2023-05-10T01:25:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd060152d30 con 0x7fd040003910 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37360/0 (socket says 172.21.15.52:37360) 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd040003910 0x7fd060163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 -- 172.21.15.52:0/2366263031 learned_addr learned my addr 172.21.15.52:0/2366263031 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05ed9d700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 0x7fd060167330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 -- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd040003910 msgr2=0x7fd060163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd040003910 0x7fd060163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 -- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 msgr2=0x7fd060167330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 0x7fd060167330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 -- 172.21.15.52:0/2366263031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600a7620 con 0x7fd0600ab300 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05ed9d700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 0x7fd060167330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd05dd9b700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fd048011a50 tx=0x7fd048009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800f940 con 0x7fd0600ab300 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04800faa0 con 0x7fd0600ab300 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800fe20 con 0x7fd0600ab300 2023-05-10T01:25:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600a7900 con 0x7fd0600ab300 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.452+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600a7ec0 con 0x7fd0600ab300 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.453+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600ac440 con 0x7fd0600ab300 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.454+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd048024070 con 0x7fd0600ab300 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.454+0000 7fd0567fc700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.454+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fd04807a670 con 0x7fd0600ab300 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.454+0000 7fd05e59c700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.454+0000 7fd05e59c700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 0x7fd044061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd05800c7d0 tx=0x7fd058015000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.458+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0600ac440 con 0x7fd0600ab300 2023-05-10T01:25:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.699+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd0600ac440 con 0x7fd0600ab300 2023-05-10T01:25:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.703+0000 7fd0567fc700 1 -- 172.21.15.52:0/2366263031 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd0600ac440 con 0x7fd0600ab300 2023-05-10T01:25:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 msgr2=0x7fd044061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 0x7fd044061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd05800c7d0 tx=0x7fd058015000).stop 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 msgr2=0x7fd0601523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fd048011a50 tx=0x7fd048009060).stop 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 shutdown_connections 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0601528b0 0x7fd060167330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd040003910 0x7fd060163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 --2- 172.21.15.52:0/2366263031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0600ab300 0x7fd0601523c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 >> 172.21.15.52:0/2366263031 conn(0x7fd0600c8410 msgr2=0x7fd060064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 shutdown_connections 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.705+0000 7fd064e5f700 1 -- 172.21.15.52:0/2366263031 wait complete. 2023-05-10T01:25:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:25:41.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:25:41.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.833+0000 7f6770181700 1 Processor -- start 2023-05-10T01:25:41.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.833+0000 7f6770181700 1 -- start start 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f6770181700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f676815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f6770181700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680c0650 con 0x7f6768154540 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f6770181700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680c1af0 con 0x7f6768154160 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f6770181700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67680bfd20 con 0x7f6768069da0 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f676d71c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6768154540 0x7f6768069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46384/0 (socket says 172.21.15.52:46384) 2023-05-10T01:25:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f676d71c700 1 -- 172.21.15.52:0/2472313929 learned_addr learned my addr 172.21.15.52:0/2472313929 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f676e71e700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f676815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.834+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228384287 0 0) 0x7f67680c0650 con 0x7f6768154540 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67540033f0 con 0x7f6768154540 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222925998 0 0) 0x7f67540033f0 con 0x7f6768154540 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 msgr2=0x7f676815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f676815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 >> v1:172.21.15.172:6789/0 conn(0x7f6768154160 legacy=0x7f67680c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680c0000 con 0x7f6768154540 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f675c001470 con 0x7f6768154540 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 >> v1:172.21.15.52:6789/0 conn(0x7f6768154540 legacy=0x7f6768069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6754003910 0x7f6754003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f6754004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754004b80 0x7f6754005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67680bfd20 con 0x7f6754004b80 2023-05-10T01:25:41.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675400b910 con 0x7f6754003910 2023-05-10T01:25:41.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675400bad0 con 0x7f6768069da0 2023-05-10T01:25:41.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754004b80 0x7f6754005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676df1d700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6754003910 0x7f6754003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676d71c700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f6754004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 -- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 msgr2=0x7f6754004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6768069da0 0x7f6754004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 -- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6754003910 msgr2=0x7f6754003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6754003910 0x7f6754003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 -- 172.21.15.52:0/2472313929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540033f0 con 0x7f6754004b80 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.835+0000 7f676e71e700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754004b80 0x7f6754005000 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f67680c5220 tx=0x7f675800b040).ready entity=mon.0 client_cookie=bdfeb67843033869 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758009ac0 con 0x7f6754004b80 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675800f040 con 0x7f6754004b80 2023-05-10T01:25:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f676cf1b700 1 -- 172.21.15.52:0/2472313929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800eca0 con 0x7f6754004b80 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 -- 172.21.15.52:0/2472313929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754004b80 msgr2=0x7f6754005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 --2- 172.21.15.52:0/2472313929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6754004b80 0x7f6754005000 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f67680c5220 tx=0x7f675800b040).stop 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f676e71e700 1 -- 172.21.15.52:0/2472313929 reap_dead start 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 -- 172.21.15.52:0/2472313929 shutdown_connections 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 -- 172.21.15.52:0/2472313929 >> 172.21.15.52:0/2472313929 conn(0x7f67680cb740 msgr2=0x7f67680c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 -- 172.21.15.52:0/2472313929 shutdown_connections 2023-05-10T01:25:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.836+0000 7f6770181700 1 -- 172.21.15.52:0/2472313929 wait complete. 2023-05-10T01:25:41.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.837+0000 7f6770181700 1 Processor -- start 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.837+0000 7f6770181700 1 -- start start 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6754004b80 0x7f6768153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67680c33d0 0x7f6768164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67680c3e00 con 0x7f6768153820 2023-05-10T01:25:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67680a1be0 con 0x7f67680c33d0 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f6770181700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67680c1e40 con 0x7f6754004b80 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37380/0 (socket says 172.21.15.52:37380) 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 -- 172.21.15.52:0/3864672453 learned_addr learned my addr 172.21.15.52:0/3864672453 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676e71e700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67680c33d0 0x7f6768164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676df1d700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6754004b80 0x7f6768153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 -- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6754004b80 msgr2=0x7f6768153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6754004b80 0x7f6768153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 -- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67680c33d0 msgr2=0x7f6768164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67680c33d0 0x7f6768164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.838+0000 7f676d71c700 1 -- 172.21.15.52:0/3864672453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680c2120 con 0x7f6768153820 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f676d71c700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f675c0049e0 tx=0x7f675c001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c000f70 con 0x7f6768153820 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00f750 con 0x7f6768153820 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67680c2400 con 0x7f6768153820 2023-05-10T01:25:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00fad0 con 0x7f6768153820 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.839+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67680c2a40 con 0x7f6768153820 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.840+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67680666b0 con 0x7f6768153820 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.840+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f675c01c360 con 0x7f6768153820 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.841+0000 7f6765ffb700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 0x7f6748061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.841+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f675c0795a0 con 0x7f6768153820 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.841+0000 7f676df1d700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 0x7f6748061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.841+0000 7f676df1d700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 0x7f6748061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6760007fd0 tx=0x7f6760007bb0).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:41.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:41.845+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f675c04a8c0 con 0x7f6768153820 2023-05-10T01:25:42.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.063+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67680c2bd0 con 0x7f6768153820 2023-05-10T01:25:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.063+0000 7f6765ffb700 1 -- 172.21.15.52:0/3864672453 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f675c019020 con 0x7f6768153820 2023-05-10T01:25:42.066 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:42.067 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.065+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 msgr2=0x7f6748061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.065+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 0x7f6748061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6760007fd0 tx=0x7f6760007bb0).stop 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 msgr2=0x7f67680c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f675c0049e0 tx=0x7f675c001e50).stop 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 shutdown_connections 2023-05-10T01:25:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f674805ed90 0x7f6748061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67680c33d0 0x7f6768164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6754004b80 0x7f6768153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 --2- 172.21.15.52:0/3864672453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6768153820 0x7f67680c2ee0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 >> 172.21.15.52:0/3864672453 conn(0x7f67680cb740 msgr2=0x7f67680abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 shutdown_connections 2023-05-10T01:25:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.066+0000 7f6770181700 1 -- 172.21.15.52:0/3864672453 wait complete. 2023-05-10T01:25:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:25:42.482 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:25:32.342428+0000', 'modified': '2023-05-10T01:25:35.355946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7146}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7146': {'gid': 7146, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/1857645329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6835', 'nonce': 1857645329}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 1857645329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:25:42.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:25:42.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-10T01:25:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.602+0000 7f17b987f700 1 Processor -- start 2023-05-10T01:25:42.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.602+0000 7f17b987f700 1 -- start start 2023-05-10T01:25:42.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b987f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17b4154200 0x7f17b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b987f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b406a910 con 0x7f17b4069740 2023-05-10T01:25:42.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b987f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b40bfa20 con 0x7f17b40aab30 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b987f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40c65e0 con 0x7f17b4154200 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b887d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f17b4069740 0x7f17b40c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46402/0 (socket says 172.21.15.52:46402) 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b887d700 1 -- 172.21.15.52:0/3431167793 learned_addr learned my addr 172.21.15.52:0/3431167793 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b907e700 1 --2- 172.21.15.52:0/3431167793 >> v2:172.21.15.52:3300/0 conn(0x7f17b4154200 0x7f17b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b907e700 1 -- 172.21.15.52:0/3431167793 >> v1:172.21.15.172:6789/0 conn(0x7f17b40aab30 legacy=0x7f17b4153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b907e700 1 -- 172.21.15.52:0/3431167793 >> v1:172.21.15.52:6789/0 conn(0x7f17b4069740 legacy=0x7f17b40c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b907e700 1 -- 172.21.15.52:0/3431167793 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40bfc70 con 0x7f17b4154200 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b907e700 1 --2- 172.21.15.52:0/3431167793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b4154200 0x7f17b4069b20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f17ac009e60 tx=0x7f17ac009780).ready entity=mon.0 client_cookie=e6d7d069aa0bf9eb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b37fe700 1 -- 172.21.15.52:0/3431167793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00e070 con 0x7f17b4154200 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b37fe700 1 -- 172.21.15.52:0/3431167793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac00bbf0 con 0x7f17b4154200 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.603+0000 7f17b37fe700 1 -- 172.21.15.52:0/3431167793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac012410 con 0x7f17b4154200 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 -- 172.21.15.52:0/3431167793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b4154200 msgr2=0x7f17b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 --2- 172.21.15.52:0/3431167793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b4154200 0x7f17b4069b20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f17ac009e60 tx=0x7f17ac009780).stop 2023-05-10T01:25:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 -- 172.21.15.52:0/3431167793 shutdown_connections 2023-05-10T01:25:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 --2- 172.21.15.52:0/3431167793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b4154200 0x7f17b4069b20 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 -- 172.21.15.52:0/3431167793 >> 172.21.15.52:0/3431167793 conn(0x7f17b40cb540 msgr2=0x7f17b40c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 -- 172.21.15.52:0/3431167793 shutdown_connections 2023-05-10T01:25:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.604+0000 7f17b987f700 1 -- 172.21.15.52:0/3431167793 wait complete. 2023-05-10T01:25:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.605+0000 7f17b987f700 1 Processor -- start 2023-05-10T01:25:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.605+0000 7f17b987f700 1 -- start start 2023-05-10T01:25:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b4069740 0x7f17b4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 0x7f17b414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4151860 con 0x7f17b40aab30 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4152680 con 0x7f17b4069740 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b987f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b41534d0 con 0x7f17b4154200 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37396/0 (socket says 172.21.15.52:37396) 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 -- 172.21.15.52:0/1395743901 learned_addr learned my addr 172.21.15.52:0/1395743901 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b887d700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b4069740 0x7f17b4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b907e700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 0x7f17b414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 -- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 msgr2=0x7f17b414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 0x7f17b414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 -- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b4069740 msgr2=0x7f17b4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b4069740 0x7f17b4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 -- 172.21.15.52:0/1395743901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac009a20 con 0x7f17b40aab30 2023-05-10T01:25:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b907e700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 0x7f17b414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.606+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f17a000c4c0 tx=0x7f17a0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.607+0000 7f17b0ff9700 1 -- 172.21.15.52:0/1395743901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000ce80 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.607+0000 7f17b0ff9700 1 -- 172.21.15.52:0/1395743901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000f470 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.607+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b4151a70 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.607+0000 7f17b0ff9700 1 -- 172.21.15.52:0/1395743901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000f810 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.607+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b4152030 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.608+0000 7f17b0ff9700 1 -- 172.21.15.52:0/1395743901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f17a0019030 con 0x7f17b40aab30 2023-05-10T01:25:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.608+0000 7f17b0ff9700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 0x7f179c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.608+0000 7f17b0ff9700 1 -- 172.21.15.52:0/1395743901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f17a0079040 con 0x7f17b40aab30 2023-05-10T01:25:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.608+0000 7f17b887d700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 0x7f179c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.609+0000 7f17b887d700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 0x7f179c061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f17a8007fd0 tx=0x7f17a8009040).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.610+0000 7f17cc473b80 1 Processor -- start 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.610+0000 7f17cc473b80 1 -- start start 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbbfca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbbd49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbb9a5e0 con 0x556dbbbcf450 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbb118a0 con 0x556dbbc1d210 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dbbb26900 con 0x556dbbbd45e0 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37404/0 (socket says 172.21.15.52:37404) 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 -- 172.21.15.52:0/3135891096 learned_addr learned my addr 172.21.15.52:0/3135891096 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b3fff700 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbbd49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b887d700 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbbfca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 -- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 msgr2=0x556dbbbfca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbbfca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 -- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 msgr2=0x556dbbbd49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbbd49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 -- 172.21.15.52:0/3135891096 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbb9c9310 con 0x556dbbbcf450 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.611+0000 7f17b907e700 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f17ac00b6c0 tx=0x7f17ac009780).ready entity=mon.0 client_cookie=993eeefa007d6b00 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f1795ffb700 1 -- 172.21.15.52:0/3135891096 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0127c0 con 0x556dbbbcf450 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f1795ffb700 1 -- 172.21.15.52:0/3135891096 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac012920 con 0x556dbbbcf450 2023-05-10T01:25:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f1795ffb700 1 -- 172.21.15.52:0/3135891096 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac012ca0 con 0x556dbbbcf450 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 -- 172.21.15.52:0/3135891096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 msgr2=0x556dbbbcf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f17ac00b6c0 tx=0x7f17ac009780).stop 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 -- 172.21.15.52:0/3135891096 shutdown_connections 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbbcf8d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbbfca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 --2- 172.21.15.52:0/3135891096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbbd49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 -- 172.21.15.52:0/3135891096 >> 172.21.15.52:0/3135891096 conn(0x556dbb991e40 msgr2=0x556dbbc1d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 -- 172.21.15.52:0/3135891096 shutdown_connections 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.612+0000 7f17cc473b80 1 -- 172.21.15.52:0/3135891096 wait complete. 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.613+0000 7f17cc473b80 1 -- start start 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.613+0000 7f17cc473b80 1 Processor -- start 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbbfa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbaeded0 con 0x556dbbc1d210 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbc29740 con 0x556dbbbd45e0 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dbbc02310 con 0x556dbbbcf450 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17cc473b80 10 client.0 ll_register_callbacks cb 0x556dbbb943c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37408/0 (socket says 172.21.15.52:37408) 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 -- 172.21.15.52:0/2016905025 learned_addr learned my addr 172.21.15.52:0/2016905025 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b887d700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbbfa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b3fff700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 -- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 msgr2=0x556dbbbfa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbbfa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 -- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 msgr2=0x556dbbc28cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 -- 172.21.15.52:0/2016905025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40bfc70 con 0x556dbbc1d210 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f17b907e700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f17ac009430 tx=0x7f17ac01f000).ready entity=mon.0 client_cookie=5ca408233795ea63 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.614+0000 7f178effd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0032d0 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f17ac01e820 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dbbbcc7e0 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ac01ebf0 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 10 client.7314 fetch_fsmap learned FSMap version 46 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x556dbbb1f880 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556dbbbcc7e0 con 0x556dbbc1d210 2023-05-10T01:25:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f17ac02f3e0 con 0x556dbbc1d210 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 10 client.7314 fetch_fsmap finished waiting for FSMap version 46 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 10 client.7314 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 20 client.7314 populate_metadata read hostname 'smithi052' 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbbfae90 0x556dbbc291b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 4 client.7314 mds_command: new command op to 7146 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 --> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dbb98dca0 con 0x556dbbbfae90 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.615+0000 7f17b887d700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbbfae90 0x556dbbc291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.616+0000 7f178effd700 10 client.7314 ms_handle_connect on v2:172.21.15.172:6835/1857645329 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.616+0000 7f17b887d700 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbbfae90 0x556dbbc291b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fb764db339f92476 server_cookie=ee2383000250a468 in_seq=0 out_seq=0 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.616+0000 7f178effd700 1 -- 172.21.15.52:0/2016905025 <== mds.0 v2:172.21.15.172:6835/1857645329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x556dbb98dca0 con 0x556dbbbfae90 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.616+0000 7f178effd700 10 client.7314 handle_command_reply: tid=0 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.616+0000 7f17cc473b80 1 client.7314 shutdown 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 msgr2=0x556dbbc15d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f17ac009430 tx=0x7f17ac01f000).stop 2023-05-10T01:25:42.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 shutdown_connections 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbbfae90 0x556dbbc291b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbc15d90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbbfa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 --2- 172.21.15.52:0/2016905025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f178effd700 0 client.7314 ms_handle_reset on v2:172.21.15.172:6835/1857645329 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 >> 172.21.15.52:0/2016905025 conn(0x556dbb991e40 msgr2=0x556dbbbd56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 shutdown_connections 2023-05-10T01:25:42.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 1 -- 172.21.15.52:0/2016905025 wait complete. 2023-05-10T01:25:42.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.617+0000 7f17cc473b80 20 client.7314 trim_cache size 0 max 16384 2023-05-10T01:25:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.633+0000 7f17cc473b80 1 Processor -- start 2023-05-10T01:25:42.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.633+0000 7f17cc473b80 1 -- start start 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbc19590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbbd5be0 con 0x556dbbc1d210 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbbfa0d0 con 0x556dbbbd45e0 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dbbc01d90 con 0x556dbbbcf450 2023-05-10T01:25:42.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37418/0 (socket says 172.21.15.52:37418) 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 -- 172.21.15.52:0/4118501516 learned_addr learned my addr 172.21.15.52:0/4118501516 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b887d700 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbc19590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b3fff700 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 -- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 msgr2=0x556dbbc19590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbc19590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 -- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 msgr2=0x556dbbc28d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.634+0000 7f17b907e700 1 -- 172.21.15.52:0/4118501516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dbbb1b070 con 0x556dbbc1d210 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17b907e700 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f17ac00be90 tx=0x7f17ac028040).ready entity=mon.0 client_cookie=2e40241bb1053530 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17967fc700 1 -- 172.21.15.52:0/4118501516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac012dc0 con 0x556dbbc1d210 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17967fc700 1 -- 172.21.15.52:0/4118501516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac0096f0 con 0x556dbbc1d210 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17967fc700 1 -- 172.21.15.52:0/4118501516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac01e820 con 0x556dbbc1d210 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 -- 172.21.15.52:0/4118501516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 msgr2=0x556dbbbfa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f17ac00be90 tx=0x7f17ac028040).stop 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 -- 172.21.15.52:0/4118501516 shutdown_connections 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbc1d210 0x556dbbbfa660 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbcf450 0x556dbbc19590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 --2- 172.21.15.52:0/4118501516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbbd45e0 0x556dbbc28d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 -- 172.21.15.52:0/4118501516 >> 172.21.15.52:0/4118501516 conn(0x556dbb991e40 msgr2=0x556dbbbfc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 -- 172.21.15.52:0/4118501516 shutdown_connections 2023-05-10T01:25:42.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.635+0000 7f17cc473b80 1 -- 172.21.15.52:0/4118501516 wait complete. 2023-05-10T01:25:42.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.636+0000 7f17cc473b80 1 -- start start 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.636+0000 7f17cc473b80 1 Processor -- start 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbc1cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbc31e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbc7f0d0 con 0x556dbbbcf450 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dbbbcfae0 con 0x556dbbc1d210 2023-05-10T01:25:42.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dbbc1cfb0 con 0x556dbbbd45e0 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 10 client.0 ll_register_callbacks cb 0x556dbbb943c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37420/0 (socket says 172.21.15.52:37420) 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 -- 172.21.15.52:0/1211060526 learned_addr learned my addr 172.21.15.52:0/1211060526 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbc1cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b907e700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbc31e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 -- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 msgr2=0x556dbbc1cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbc1cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 -- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 msgr2=0x556dbbc31e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbc31e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 -- 172.21.15.52:0/1211060526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dbbb1f880 con 0x556dbbbcf450 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b907e700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbc31e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17b887d700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f17a8001ed0 tx=0x7f17a8016040).ready entity=mon.0 client_cookie=78019adf82b8e672 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f178effd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8005240 con 0x556dbbbcf450 2023-05-10T01:25:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f17a8024d90 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.637+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17ac012920 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17a80055b0 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 10 client.7320 fetch_fsmap learned FSMap version 46 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x556dbbb1adc0 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac012920 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f17a8026720 con 0x556dbbbcf450 2023-05-10T01:25:42.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 10 client.7320 fetch_fsmap finished waiting for FSMap version 46 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 10 client.7320 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 20 client.7320 populate_metadata read hostname 'smithi052' 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbc32760 0x556dbbc7d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 4 client.7320 mds_command: new command op to 7146 tid=0[{"prefix": "status"}] 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 --> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556dbb9c4ca0 con 0x556dbbc32760 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbc32760 0x556dbbc7d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f178effd700 10 client.7320 ms_handle_connect on v2:172.21.15.172:6835/1857645329 2023-05-10T01:25:42.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.638+0000 7f17b3fff700 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbc32760 0x556dbbc7d9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=be81477d38f6b361 server_cookie=199e53e6ecb3d1b4 in_seq=0 out_seq=0 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f178effd700 1 -- 172.21.15.52:0/1211060526 <== mds.0 v2:172.21.15.172:6835/1857645329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x556dbb9c4ca0 con 0x556dbbc32760 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f178effd700 10 client.7320 handle_command_reply: tid=0 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 client.7320 shutdown 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 msgr2=0x556dbbc1c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f17a8001ed0 tx=0x7f17a8016040).stop 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 shutdown_connections 2023-05-10T01:25:42.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556dbbc1d210 0x556dbbc31e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:6835/1857645329,v1:172.21.15.172:6837/1857645329] conn(0x556dbbc32760 0x556dbbc7d9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556dbbbcf450 0x556dbbc1c5d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 --2- 172.21.15.52:0/1211060526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556dbbbd45e0 0x556dbbc1cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f178effd700 0 client.7320 ms_handle_reset on v2:172.21.15.172:6835/1857645329 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 >> 172.21.15.52:0/1211060526 conn(0x556dbb991e40 msgr2=0x556dbbc14de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 shutdown_connections 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 1 -- 172.21.15.52:0/1211060526 wait complete. 2023-05-10T01:25:42.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17cc473b80 20 client.7320 trim_cache size 0 max 16384 2023-05-10T01:25:42.652 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:25:42.652 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:25:42.652 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:25:42.652 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7146, 2023-05-10T01:25:42.652 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.294787255999999, 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 46, 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 108, 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 108, 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.799720444 2023-05-10T01:25:42.653 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 msgr2=0x7f179c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 0x7f179c061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f17a8007fd0 tx=0x7f17a8009040).stop 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 msgr2=0x7f17b4147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f17a000c4c0 tx=0x7f17a0007db0).stop 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 shutdown_connections 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f179c05ed60 0x7f179c061220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17b4154200 0x7f17b414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b4069740 0x7f17b4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 --2- 172.21.15.52:0/1395743901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17b40aab30 0x7f17b4147d30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 >> 172.21.15.52:0/1395743901 conn(0x7f17b40cb540 msgr2=0x7f17b40c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.639+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 shutdown_connections 2023-05-10T01:25:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.640+0000 7f17b987f700 1 -- 172.21.15.52:0/1395743901 wait complete. 2023-05-10T01:25:42.656 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:25:42.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.759+0000 7f461a3e9700 1 Processor -- start 2023-05-10T01:25:42.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.759+0000 7f461a3e9700 1 -- start start 2023-05-10T01:25:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f461a3e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f461414f7e0 0x7f4614152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f461a3e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bd9d0 0x7f46140bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f461a3e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46140bca20 con 0x7f46140bc570 2023-05-10T01:25:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f461a3e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46140632e0 con 0x7f461414f7e0 2023-05-10T01:25:42.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f461a3e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140685d0 con 0x7f46140bd9d0 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f461414f7e0 0x7f4614152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f461414f7e0 0x7f4614152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37428/0 (socket says 172.21.15.52:37428) 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 -- 172.21.15.52:0/2312876987 learned_addr learned my addr 172.21.15.52:0/2312876987 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f46137fe700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bd9d0 0x7f46140bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 -- 172.21.15.52:0/2312876987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bd9d0 msgr2=0x7f46140bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bd9d0 0x7f46140bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 -- 172.21.15.52:0/2312876987 >> v1:172.21.15.52:6789/0 conn(0x7f46140bc570 legacy=0x7f4614155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 -- 172.21.15.52:0/2312876987 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614068870 con 0x7f461414f7e0 2023-05-10T01:25:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.760+0000 7f4613fff700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614152bb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4604006fd0 tx=0x7f46040090f0).ready entity=mon.0 client_cookie=bad22c5b8d7671c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f4612ffd700 1 -- 172.21.15.52:0/2312876987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460400b580 con 0x7f461414f7e0 2023-05-10T01:25:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f4612ffd700 1 -- 172.21.15.52:0/2312876987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460400b6e0 con 0x7f461414f7e0 2023-05-10T01:25:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f4612ffd700 1 -- 172.21.15.52:0/2312876987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460400ba60 con 0x7f461414f7e0 2023-05-10T01:25:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 -- 172.21.15.52:0/2312876987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 msgr2=0x7f4614152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614152bb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f4604006fd0 tx=0x7f46040090f0).stop 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 -- 172.21.15.52:0/2312876987 shutdown_connections 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614152bb0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 --2- 172.21.15.52:0/2312876987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bd9d0 0x7f46140bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 -- 172.21.15.52:0/2312876987 >> 172.21.15.52:0/2312876987 conn(0x7f4614066060 msgr2=0x7f4614066470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 -- 172.21.15.52:0/2312876987 shutdown_connections 2023-05-10T01:25:42.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.761+0000 7f461a3e9700 1 -- 172.21.15.52:0/2312876987 wait complete. 2023-05-10T01:25:42.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.762+0000 7f461a3e9700 1 Processor -- start 2023-05-10T01:25:42.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 -- start start 2023-05-10T01:25:42.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 0x7f46140ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 0x7f46140be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140acc50 con 0x7f461414f7e0 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140be6b0 con 0x7f46140bd9d0 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f461a3e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140bea80 con 0x7f46140bc570 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f4618986700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f4618986700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37438/0 (socket says 172.21.15.52:37438) 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.763+0000 7f4618986700 1 -- 172.21.15.52:0/962936045 learned_addr learned my addr 172.21.15.52:0/962936045 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4613fff700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 0x7f46140ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f46137fe700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 0x7f46140be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 -- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 msgr2=0x7f46140ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 0x7f46140ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 -- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 msgr2=0x7f46140be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 0x7f46140be1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 -- 172.21.15.52:0/962936045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4604009370 con 0x7f461414f7e0 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4613fff700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 0x7f46140ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f46137fe700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 0x7f46140be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f4618986700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f460c002230 tx=0x7f460c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c010510 con 0x7f461414f7e0 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c010670 con 0x7f461414f7e0 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c0109f0 con 0x7f461414f7e0 2023-05-10T01:25:42.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46140ad140 con 0x7f461414f7e0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.764+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46140becd0 con 0x7f461414f7e0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.765+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46140aa190 con 0x7f461414f7e0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.765+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f460c010070 con 0x7f461414f7e0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.766+0000 7f45fbfff700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 0x7f45f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.766+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f460c0797e0 con 0x7f461414f7e0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.766+0000 7f4613fff700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 0x7f45f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:42.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.766+0000 7f4613fff700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 0x7f45f4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4604009fd0 tx=0x7f4604017000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:42.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.770+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46140aa190 con 0x7f461414f7e0 2023-05-10T01:25:42.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.986+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f461405ef90 con 0x7f461414f7e0 2023-05-10T01:25:42.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.987+0000 7f45fbfff700 1 -- 172.21.15.52:0/962936045 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f460c04ac70 con 0x7f461414f7e0 2023-05-10T01:25:42.990 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:25:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.988+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 msgr2=0x7f45f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.988+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 0x7f45f4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4604009fd0 tx=0x7f4604017000).stop 2023-05-10T01:25:42.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 msgr2=0x7f4614153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f460c002230 tx=0x7f460c0015e0).stop 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 shutdown_connections 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f45f405ed90 0x7f45f4061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f461414f7e0 0x7f4614153d40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46140bc570 0x7f46140ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 --2- 172.21.15.52:0/962936045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46140bd9d0 0x7f46140be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 >> 172.21.15.52:0/962936045 conn(0x7f4614066060 msgr2=0x7f46140c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 shutdown_connections 2023-05-10T01:25:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:42.989+0000 7f461a3e9700 1 -- 172.21.15.52:0/962936045 wait complete. 2023-05-10T01:25:43.002 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:25:43.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:25:43.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:25:43.003 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:25:43.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:43.004 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:25:43.004 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:25:43.004 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:25:43.004 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:25:43.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.005 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:25:43.021 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:25:43.021 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:25:43.022 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:25:43.022 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.022 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:25:43.023 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.023 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:43.023 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:43.023 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:25:43.023 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:43.024 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:25:43.024 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41293sec preferred_lft 41293sec 2023-05-10T01:25:43.024 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:25:43.024 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.024 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:43.025 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:43.025 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:25:43.025 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:43.025 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:25:43.025 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:25:43.026 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:25:43.027 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:25:43.027 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.027 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:25:43.027 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:25:43.027 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:25:43.028 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:25:43.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.028 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:25:43.084 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:25:43.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.086 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:25:43.142 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:25:43.142 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:25:43.142 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:25:43.143 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:25:43.143 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:25:43.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.144 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:25:43.144 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:25:43.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:25:43.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:25:43.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:25:43.145 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:25:43.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.242 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:25:43.258 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:25:43.258 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:25:43.258 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:25:43.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:25:43.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.323 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:43.377 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:25:43.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:43.456 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:43.457 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:25:43.500 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:25:43.500 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:25:43.502 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:25:43.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:25:43.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:25:43.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:25:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.722+0000 7ff02c0b5700 1 Processor -- start 2023-05-10T01:25:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.722+0000 7ff02c0b5700 1 -- start start 2023-05-10T01:25:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02c0b5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff024154540 0x7ff024069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02c0b5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff024069b80 0x7ff0240c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02c0b5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240c0650 con 0x7ff024154160 2023-05-10T01:25:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02c0b5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff024069fb0 con 0x7ff024154540 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02c0b5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240bfd20 con 0x7ff024069b80 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff029650700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff024154540 0x7ff024069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff029650700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff024154540 0x7ff024069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37450/0 (socket says 172.21.15.52:37450) 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff029650700 1 -- 172.21.15.52:0/2337456882 learned_addr learned my addr 172.21.15.52:0/2337456882 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.723+0000 7ff02a652700 1 --2- 172.21.15.52:0/2337456882 >> v2:172.21.15.172:3300/0 conn(0x7ff024069b80 0x7ff0240c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff029650700 1 -- 172.21.15.52:0/2337456882 >> v2:172.21.15.172:3300/0 conn(0x7ff024069b80 msgr2=0x7ff0240c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff029650700 1 --2- 172.21.15.52:0/2337456882 >> v2:172.21.15.172:3300/0 conn(0x7ff024069b80 0x7ff0240c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff029650700 1 -- 172.21.15.52:0/2337456882 >> v1:172.21.15.172:6789/0 conn(0x7ff024154160 legacy=0x7ff0240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff029650700 1 -- 172.21.15.52:0/2337456882 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240c0000 con 0x7ff024154540 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff029650700 1 --2- 172.21.15.52:0/2337456882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024154540 0x7ff024069690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff0240c5200 tx=0x7ff0180090f0).ready entity=mon.0 client_cookie=6f0e79b20276fd9d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff028e4f700 1 -- 172.21.15.52:0/2337456882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800b600 con 0x7ff024154540 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff028e4f700 1 -- 172.21.15.52:0/2337456882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800b760 con 0x7ff024154540 2023-05-10T01:25:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff028e4f700 1 -- 172.21.15.52:0/2337456882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800bb00 con 0x7ff024154540 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 -- 172.21.15.52:0/2337456882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024154540 msgr2=0x7ff024069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/2337456882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024154540 0x7ff024069690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff0240c5200 tx=0x7ff0180090f0).stop 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 -- 172.21.15.52:0/2337456882 shutdown_connections 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/2337456882 >> v2:172.21.15.172:3300/0 conn(0x7ff024069b80 0x7ff0240c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/2337456882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024154540 0x7ff024069690 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 -- 172.21.15.52:0/2337456882 >> 172.21.15.52:0/2337456882 conn(0x7ff0240cb6f0 msgr2=0x7ff0240c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:43.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 -- 172.21.15.52:0/2337456882 shutdown_connections 2023-05-10T01:25:43.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.724+0000 7ff02c0b5700 1 -- 172.21.15.52:0/2337456882 wait complete. 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 Processor -- start 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 -- start start 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 0x7ff0240c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff024154540 0x7ff0240ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240ca620 con 0x7ff024069b80 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c3a20 con 0x7ff024154160 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff02c0b5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c3eb0 con 0x7ff024154540 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff029e51700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff029e51700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37452/0 (socket says 172.21.15.52:37452) 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.726+0000 7ff029e51700 1 -- 172.21.15.52:0/4143348776 learned_addr learned my addr 172.21.15.52:0/4143348776 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029650700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 0x7ff0240c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 -- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff024154540 msgr2=0x7ff0240ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff024154540 0x7ff0240ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 -- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 msgr2=0x7ff0240c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 0x7ff0240c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 -- 172.21.15.52:0/4143348776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018009370 con 0x7ff024069b80 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029650700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 0x7ff0240c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff029e51700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7ff01c00c440 tx=0x7ff01c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00f470 con 0x7ff024069b80 2023-05-10T01:25:43.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00f5d0 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240c2e10 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00f970 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.727+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0240c33d0 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.728+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0240666b0 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.729+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff01c019030 con 0x7ff024069b80 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.729+0000 7ff021ffb700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 0x7ff004061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.729+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff01c079010 con 0x7ff024069b80 2023-05-10T01:25:43.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.729+0000 7ff029650700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 0x7ff004061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:43.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.730+0000 7ff029650700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 0x7ff004061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff024154920 tx=0x7ff018017000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:43.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.733+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff01c0488f0 con 0x7ff024069b80 2023-05-10T01:25:43.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.933+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff02406c340 con 0x7ff00405ed90 2023-05-10T01:25:43.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.935+0000 7ff021ffb700 1 -- 172.21.15.52:0/4143348776 <== mgr.5987 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff02406c340 con 0x7ff00405ed90 2023-05-10T01:25:43.938 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:25:43.938 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:25:43.938 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:25:43.938 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:25:43.939 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:25:43.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 msgr2=0x7ff004061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 0x7ff004061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff024154920 tx=0x7ff018017000).stop 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 msgr2=0x7ff0241581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7ff01c00c440 tx=0x7ff01c007dc0).stop 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 shutdown_connections 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff00405ed90 0x7ff004061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff024154540 0x7ff0240ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff024069b80 0x7ff0241581d0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 --2- 172.21.15.52:0/4143348776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024154160 0x7ff0240c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.937+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 >> 172.21.15.52:0/4143348776 conn(0x7ff0240cb6f0 msgr2=0x7ff0240aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.938+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 shutdown_connections 2023-05-10T01:25:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:43.938+0000 7ff02c0b5700 1 -- 172.21.15.52:0/4143348776 wait complete. 2023-05-10T01:25:43.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:25:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.068+0000 7fb8c106e700 1 Processor -- start 2023-05-10T01:25:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.068+0000 7fb8c106e700 1 -- start start 2023-05-10T01:25:44.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8c106e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8bc153f80 0x7fb8bc0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8c106e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc155770 con 0x7fb8bc0c5cf0 2023-05-10T01:25:44.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8c106e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc06a130 con 0x7fb8bc155370 2023-05-10T01:25:44.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8c106e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc069f50 con 0x7fb8bc153f80 2023-05-10T01:25:44.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8bc153f80 0x7fb8bc0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8bc153f80 0x7fb8bc0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37460/0 (socket says 172.21.15.52:37460) 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 -- 172.21.15.52:0/4010358245 learned_addr learned my addr 172.21.15.52:0/4010358245 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 -- 172.21.15.52:0/4010358245 >> v1:172.21.15.172:6789/0 conn(0x7fb8bc155370 legacy=0x7fb8bc0c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 -- 172.21.15.52:0/4010358245 >> v1:172.21.15.52:6789/0 conn(0x7fb8bc0c5cf0 legacy=0x7fb8bc0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 -- 172.21.15.52:0/4010358245 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc06a410 con 0x7fb8bc153f80 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8bbfff700 1 --2- 172.21.15.52:0/4010358245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc153f80 0x7fb8bc0a9d10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fb8bc0aa7d0 tx=0x7fb8ac0090f0).ready entity=mon.0 client_cookie=24b1a6298364bfa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:44.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8baffd700 1 -- 172.21.15.52:0/4010358245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00b5a0 con 0x7fb8bc153f80 2023-05-10T01:25:44.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8baffd700 1 -- 172.21.15.52:0/4010358245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac00b700 con 0x7fb8bc153f80 2023-05-10T01:25:44.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.069+0000 7fb8baffd700 1 -- 172.21.15.52:0/4010358245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00ba80 con 0x7fb8bc153f80 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 -- 172.21.15.52:0/4010358245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc153f80 msgr2=0x7fb8bc0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 --2- 172.21.15.52:0/4010358245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc153f80 0x7fb8bc0a9d10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fb8bc0aa7d0 tx=0x7fb8ac0090f0).stop 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 -- 172.21.15.52:0/4010358245 shutdown_connections 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 --2- 172.21.15.52:0/4010358245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc153f80 0x7fb8bc0a9d10 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 -- 172.21.15.52:0/4010358245 >> 172.21.15.52:0/4010358245 conn(0x7fb8bc0cb5f0 msgr2=0x7fb8bc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:44.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 -- 172.21.15.52:0/4010358245 shutdown_connections 2023-05-10T01:25:44.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.070+0000 7fb8c106e700 1 -- 172.21.15.52:0/4010358245 wait complete. 2023-05-10T01:25:44.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.071+0000 7fb8c106e700 1 Processor -- start 2023-05-10T01:25:44.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.071+0000 7fb8c106e700 1 -- start start 2023-05-10T01:25:44.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8bc0c5cf0 0x7fb8bc0ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8bc153f80 0x7fb8bc0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c2670 con 0x7fb8bc155370 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c2950 con 0x7fb8bc0c5cf0 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c106e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c2c30 con 0x7fb8bc153f80 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37468/0 (socket says 172.21.15.52:37468) 2023-05-10T01:25:44.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 -- 172.21.15.52:0/1066554570 learned_addr learned my addr 172.21.15.52:0/1066554570 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 -- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8bc153f80 msgr2=0x7fb8bc0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8bc153f80 0x7fb8bc0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 -- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8bc0c5cf0 msgr2=0x7fb8bc0ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8bbfff700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8bc0c5cf0 0x7fb8bc0ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8bc0c5cf0 0x7fb8bc0ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.072+0000 7fb8c086d700 1 -- 172.21.15.52:0/1066554570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009370 con 0x7fb8bc155370 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8c086d700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fb8b400b810 tx=0x7fb8b4009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:44.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400d5a0 con 0x7fb8bc155370 2023-05-10T01:25:44.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b400d740 con 0x7fb8bc155370 2023-05-10T01:25:44.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc0c2f10 con 0x7fb8bc155370 2023-05-10T01:25:44.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400db00 con 0x7fb8bc155370 2023-05-10T01:25:44.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.073+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc0ac7d0 con 0x7fb8bc155370 2023-05-10T01:25:44.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.074+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc0c3430 con 0x7fb8bc155370 2023-05-10T01:25:44.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.074+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 38) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8b4019460 con 0x7fb8bc155370 2023-05-10T01:25:44.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.074+0000 7fb8b3fff700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 0x7fb8a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.074+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb8b4079e00 con 0x7fb8bc155370 2023-05-10T01:25:44.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.075+0000 7fb8bbfff700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 0x7fb8a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.075+0000 7fb8bbfff700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 0x7fb8a0061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8bc0aa7d0 tx=0x7fb8ac015000).ready entity=mgr.5987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:44.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.078+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8bc0c3430 con 0x7fb8bc155370 2023-05-10T01:25:44.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.297+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb8bc0c3430 con 0x7fb8bc155370 2023-05-10T01:25:44.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.767+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fb8b4077bf0 con 0x7fb8bc155370 2023-05-10T01:25:44.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.768+0000 7fb8b3fff700 1 -- 172.21.15.52:0/1066554570 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb8b4072e50 con 0x7fb8bc155370 2023-05-10T01:25:44.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.770+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 msgr2=0x7fb8a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.770+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 0x7fb8a0061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8bc0aa7d0 tx=0x7fb8ac015000).stop 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 msgr2=0x7fb8bc1389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fb8b400b810 tx=0x7fb8b4009270).stop 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 shutdown_connections 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8a005ed60 0x7fb8a0061220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8bc155370 0x7fb8bc1389a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8bc0c5cf0 0x7fb8bc0ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 --2- 172.21.15.52:0/1066554570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8bc153f80 0x7fb8bc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:44.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 >> 172.21.15.52:0/1066554570 conn(0x7fb8bc0cb5f0 msgr2=0x7fb8bc152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:44.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 shutdown_connections 2023-05-10T01:25:44.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.771+0000 7fb8c106e700 1 -- 172.21.15.52:0/1066554570 wait complete. 2023-05-10T01:25:44.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:25:44.910 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:44.908+0000 7f8fe0c80680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:44.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.909+0000 7f6d7759e700 1 Processor -- start 2023-05-10T01:25:44.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.909+0000 7f6d7759e700 1 -- start start 2023-05-10T01:25:44.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.910+0000 7f6d7759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.910+0000 7f6d7759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 0x7f6d7815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.910+0000 7f6d7759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d78068150 con 0x7f6d78152e80 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.910+0000 7f6d7759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d78067330 con 0x7f6d78064c80 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.910+0000 7f6d7759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78153300 con 0x7f6d7814c6f0 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d76d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 0x7f6d7815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d76d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 0x7f6d7815bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:35826/0 (socket says 172.21.15.52:35826) 2023-05-10T01:25:44.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:57138/0 (socket says 172.21.15.52:57138) 2023-05-10T01:25:44.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d76d9d700 1 -- 172.21.15.52:0/884099495 learned_addr learned my addr 172.21.15.52:0/884099495 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d75d9b700 1 --1- 172.21.15.52:0/884099495 >> v1:172.21.15.172:6789/0 conn(0x7f6d78152e80 0x7f6d78064570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:49058/0 (socket says 172.21.15.52:49058) 2023-05-10T01:25:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 -- 172.21.15.52:0/884099495 >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 msgr2=0x7f6d7815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 --2- 172.21.15.52:0/884099495 >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 0x7f6d7815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 -- 172.21.15.52:0/884099495 >> v1:172.21.15.172:6789/0 conn(0x7f6d78152e80 legacy=0x7f6d78064570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 -- 172.21.15.52:0/884099495 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78067540 con 0x7f6d7814c6f0 2023-05-10T01:25:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7659c700 1 --2- 172.21.15.52:0/884099495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6d68009760 tx=0x7f6d68009060).ready entity=mon.2 client_cookie=bfcb7e2092602a77 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7559a700 1 -- 172.21.15.52:0/884099495 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800f510 con 0x7f6d7814c6f0 2023-05-10T01:25:44.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7559a700 1 -- 172.21.15.52:0/884099495 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6800f670 con 0x7f6d7814c6f0 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.911+0000 7f6d7559a700 1 -- 172.21.15.52:0/884099495 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800f9f0 con 0x7f6d7814c6f0 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 -- 172.21.15.52:0/884099495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 msgr2=0x7f6d78066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 --2- 172.21.15.52:0/884099495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6d68009760 tx=0x7f6d68009060).stop 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 -- 172.21.15.52:0/884099495 shutdown_connections 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 --2- 172.21.15.52:0/884099495 >> v2:172.21.15.172:3300/0 conn(0x7f6d78064c80 0x7f6d7815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 --2- 172.21.15.52:0/884099495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d7814c6f0 0x7f6d78066e40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 -- 172.21.15.52:0/884099495 >> 172.21.15.52:0/884099495 conn(0x7f6d780c7a70 msgr2=0x7f6d780c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:44.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 -- 172.21.15.52:0/884099495 shutdown_connections 2023-05-10T01:25:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.912+0000 7f6d7759e700 1 -- 172.21.15.52:0/884099495 wait complete. 2023-05-10T01:25:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.913+0000 7f6d7759e700 1 Processor -- start 2023-05-10T01:25:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.913+0000 7f6d7759e700 1 -- start start 2023-05-10T01:25:44.922 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f8228d48680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:25:44.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 0x7f6d78135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d7814c6f0 0x7f6d781349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c2210 con 0x7f6d78152e80 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78134e90 con 0x7f6d7814c6f0 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780a8d60 con 0x7f6d78064c80 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7659c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 0x7f6d78135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37510/0 (socket says 172.21.15.52:37510) 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 -- 172.21.15.52:0/2134415260 learned_addr learned my addr 172.21.15.52:0/2134415260 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d75d9b700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d7814c6f0 0x7f6d781349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 -- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 msgr2=0x7f6d78135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 0x7f6d78135b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 -- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d7814c6f0 msgr2=0x7f6d781349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d7814c6f0 0x7f6d781349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d76d9d700 1 -- 172.21.15.52:0/2134415260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680092a0 con 0x7f6d78152e80 2023-05-10T01:25:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.914+0000 7f6d7659c700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 0x7f6d78135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d76d9d700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f6d70009d30 tx=0x7f6d7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70009e90 con 0x7f6d78152e80 2023-05-10T01:25:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7000f040 con 0x7f6d78152e80 2023-05-10T01:25:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000cac0 con 0x7f6d78152e80 2023-05-10T01:25:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d780c1600 con 0x7f6d78152e80 2023-05-10T01:25:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.915+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780c1bc0 con 0x7f6d78152e80 2023-05-10T01:25:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78047150 con 0x7f6d78152e80 2023-05-10T01:25:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f6d70014410 con 0x7f6d78152e80 2023-05-10T01:25:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d667fc700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 0x7f6d540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f6d70079d70 con 0x7f6d78152e80 2023-05-10T01:25:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d7659c700 1 -- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 msgr2=0x7f6d540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.916+0000 7f6d7659c700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 0x7f6d540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:44.920+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d700498f0 con 0x7f6d78152e80 2023-05-10T01:25:44.974 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:44.971+0000 7f8fe0c80680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:44.983 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:44.980+0000 7f8228d48680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:25:45.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.094+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6d780c2350 con 0x7f6d78152e80 2023-05-10T01:25:45.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.099+0000 7f6d667fc700 1 -- 172.21.15.52:0/2134415260 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6d7004b1a0 con 0x7f6d78152e80 2023-05-10T01:25:45.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 msgr2=0x7f6d540612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:45.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 0x7f6d540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 msgr2=0x7f6d780bd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f6d70009d30 tx=0x7f6d7000b040).stop 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 shutdown_connections 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d5405ede0 0x7f6d540612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d78152e80 0x7f6d780bd040 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d78064c80 0x7f6d78135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 --2- 172.21.15.52:0/2134415260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d7814c6f0 0x7f6d781349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 >> 172.21.15.52:0/2134415260 conn(0x7f6d780c7a70 msgr2=0x7f6d78155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 shutdown_connections 2023-05-10T01:25:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.101+0000 7f6d7759e700 1 -- 172.21.15.52:0/2134415260 wait complete. 2023-05-10T01:25:45.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:45.116 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:25:45.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-10T01:25:45.248 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:45.245+0000 7f8fe0c80680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:45.274 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:45.271+0000 7f8228d48680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:25:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.308+0000 7f0b647a4700 1 Processor -- start 2023-05-10T01:25:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.308+0000 7f0b647a4700 1 -- start start 2023-05-10T01:25:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.309+0000 7f0b647a4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0b5c154110 0x7f0b5c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.309+0000 7f0b647a4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0c6310 con 0x7f0b5c0cb410 2023-05-10T01:25:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.309+0000 7f0b647a4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c1550e0 con 0x7f0b5c155570 2023-05-10T01:25:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.309+0000 7f0b647a4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c6830 con 0x7f0b5c154110 2023-05-10T01:25:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b61d3f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0b5c0cb410 0x7f0b5c0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46568/0 (socket says 172.21.15.52:46568) 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2543847428 learned_addr learned my addr 172.21.15.52:0/2543847428 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b62540700 1 --2- 172.21.15.52:0/2543847428 >> v2:172.21.15.172:3300/0 conn(0x7f0b5c154110 0x7f0b5c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253498946 0 0) 0x7f0b4c001110 con 0x7f0b5c0cb410 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b440033f0 con 0x7f0b5c0cb410 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851231902 0 0) 0x7f0b440033f0 con 0x7f0b5c0cb410 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 >> v2:172.21.15.172:3300/0 conn(0x7f0b5c154110 msgr2=0x7f0b5c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 --2- 172.21.15.52:0/2543847428 >> v2:172.21.15.172:3300/0 conn(0x7f0b5c154110 0x7f0b5c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 >> v1:172.21.15.172:6789/0 conn(0x7f0b5c155570 legacy=0x7f0b5c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0c6550 con 0x7f0b5c0cb410 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0b4c001600 con 0x7f0b5c0cb410 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b62540700 1 --2- 172.21.15.52:0/2543847428 >> v2:172.21.15.172:3300/0 conn(0x7f0b5c154110 0x7f0b5c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 >> v1:172.21.15.52:6789/0 conn(0x7f0b5c0cb410 legacy=0x7f0b5c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b440038e0 0x7f0b44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44005000 0x7f0b4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c6830 con 0x7f0b44004690 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400beb0 con 0x7f0b44005000 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400c070 con 0x7f0b440038e0 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b62540700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b440038e0 0x7f0b44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.310+0000 7f0b62d41700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44005000 0x7f0b4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b440038e0 msgr2=0x7f0b44003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:45.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b440038e0 0x7f0b44003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44005000 msgr2=0x7f0b4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44005000 0x7f0b4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2543847428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440033f0 con 0x7f0b44004690 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b62d41700 1 -- 172.21.15.52:0/2543847428 reap_dead start 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b44004b10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f0b4c00c390 tx=0x7f0b4c0078d0).ready entity=mon.0 client_cookie=5ab6e09d4dcee9ad server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00cc60 con 0x7f0b44004690 2023-05-10T01:25:45.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00cdc0 con 0x7f0b44004690 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b6153e700 1 -- 172.21.15.52:0/2543847428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c007320 con 0x7f0b44004690 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b647a4700 1 -- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 msgr2=0x7f0b44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.311+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b44004b10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f0b4c00c390 tx=0x7f0b4c0078d0).stop 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.312+0000 7f0b647a4700 1 -- 172.21.15.52:0/2543847428 shutdown_connections 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.312+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2543847428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b44004b10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.312+0000 7f0b647a4700 1 -- 172.21.15.52:0/2543847428 >> 172.21.15.52:0/2543847428 conn(0x7f0b5c0678d0 msgr2=0x7f0b5c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:45.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.312+0000 7f0b647a4700 1 -- 172.21.15.52:0/2543847428 shutdown_connections 2023-05-10T01:25:45.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.312+0000 7f0b647a4700 1 -- 172.21.15.52:0/2543847428 wait complete. 2023-05-10T01:25:45.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.313+0000 7f0b647a4700 1 Processor -- start 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.313+0000 7f0b647a4700 1 -- start start 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.313+0000 7f0b647a4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.313+0000 7f0b647a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b5c0aa240 0x7f0b5c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 0x7f0b5c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0aa6c0 con 0x7f0b44004690 2023-05-10T01:25:45.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c14d240 con 0x7f0b5c0aa240 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0ac5b0 con 0x7f0b5c14dad0 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37564/0 (socket says 172.21.15.52:37564) 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 -- 172.21.15.52:0/2490456832 learned_addr learned my addr 172.21.15.52:0/2490456832 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b5c0aa240 0x7f0b5c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62d41700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 0x7f0b5c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:45.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 msgr2=0x7f0b5c158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 0x7f0b5c158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b5c0aa240 msgr2=0x7f0b5c0af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b5c0aa240 0x7f0b5c0af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0adbb0 con 0x7f0b44004690 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62d41700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 0x7f0b5c158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b62540700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f0b58011d70 tx=0x7f0b58006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800fac0 con 0x7f0b44004690 2023-05-10T01:25:45.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800fc20 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0afe60 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58014440 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.314+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0ab6e0 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.315+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c066720 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.316+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 39) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f0b58024070 con 0x7f0b44004690 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.316+0000 7f0b4a7fc700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:45.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.316+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.316+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0b5807a970 con 0x7f0b44004690 2023-05-10T01:25:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.316+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:25:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.320+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b5804be00 con 0x7f0b44004690 2023-05-10T01:25:45.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.517+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:45.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.517+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:25:45.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.523+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b5c154a90 con 0x7f0b3c05edb0 2023-05-10T01:25:45.856 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:45.853+0000 7f8fe0c80680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:45.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.918+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:45.918+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:25:45.928 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:45.925+0000 7f8fe0c80680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:45.937 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:45.934+0000 7f8228d48680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:25:46.005 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.002+0000 7f8228d48680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:25:46.112 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.109+0000 7f8fe0c80680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:46.198 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.195+0000 7f8228d48680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:25:46.530 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.527+0000 7f8fe0c80680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:46.631 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.629+0000 7f8fe0c80680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:46.633 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.631+0000 7f8228d48680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:25:46.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:46.719+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:46.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:46.719+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:25:46.740 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.738+0000 7f8228d48680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:46.784 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.781+0000 7f8fe0c80680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:46.858 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.855+0000 7f8fe0c80680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:46.900 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.897+0000 7f8228d48680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:46.924 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:46.921+0000 7f8fe0c80680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:46.977 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:46.975+0000 7f8228d48680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:25:47.047 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:47.044+0000 7f8228d48680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:25:47.178 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:47.175+0000 7f8fe0c80680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:47.316 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:47.313+0000 7f8228d48680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:25:47.359 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:47.356+0000 7f8fe0c80680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:47.509 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:47.506+0000 7f8228d48680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:25:48.003 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.000+0000 7f8fe0c80680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:48.070 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.068+0000 7f8fe0c80680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:48.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.141+0000 7f8fe0c80680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:48.188 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.186+0000 7f8228d48680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:25:48.260 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.257+0000 7f8228d48680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:25:48.289 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.286+0000 7f8fe0c80680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:48.321+0000 7f0b61d3f700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:25:48.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:48.321+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:25:48.337 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.335+0000 7f8228d48680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:25:48.358 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.355+0000 7f8fe0c80680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:48.474 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.471+0000 7f8fe0c80680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:48.492 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.490+0000 7f8228d48680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:25:48.566 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.563+0000 7f8228d48680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:25:48.580 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.577+0000 7f8fe0c80680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:48.686 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.683+0000 7f8228d48680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:25:48.798 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:48.796+0000 7f8228d48680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:25:48.869 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.866+0000 7f8fe0c80680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:48.939 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:48.936+0000 7f8fe0c80680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:49.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:49.007+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 40) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f0b58078760 con 0x7f0b44004690 2023-05-10T01:25:49.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:49.007+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:25:49.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:49.007+0000 7f0b4a7fc700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:25:49.070 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5f462700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.070 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5bc5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.070 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5f462700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5bc5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5f462700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5bc5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5f462700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5bc5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5f462700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.071 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:25:49.067+0000 7f8f5bc5b700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:25:49.108 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:49.105+0000 7f8228d48680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:25:49.181 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:25:49.179+0000 7f8228d48680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:25:50.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.023+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 41) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f0b58078ae0 con 0x7f0b44004690 2023-05-10T01:25:50.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.024+0000 7f0b4a7fc700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c02fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.024+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b5c154a90 con 0x7f0b3c05edb0 2023-05-10T01:25:50.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.029+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c02fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.031+0000 7f0b61d3f700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c02fd10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0b5c156060 tx=0x7f0b4c015000).ready entity=mgr.6251 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:50.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.040+0000 7f0b4a7fc700 1 -- 172.21.15.52:0/2490456832 <== mgr.6251 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0b5c154a90 con 0x7f0b3c05edb0 2023-05-10T01:25:50.043 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:25:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 msgr2=0x7f0b3c02fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c02fd10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0b5c156060 tx=0x7f0b4c015000).stop 2023-05-10T01:25:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 msgr2=0x7f0b5c0aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f0b58011d70 tx=0x7f0b58006f40).stop 2023-05-10T01:25:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 shutdown_connections 2023-05-10T01:25:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f0b3c05edb0 0x7f0b3c02fd10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b5c14dad0 0x7f0b5c158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b44004690 0x7f0b5c0aae20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 --2- 172.21.15.52:0/2490456832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b5c0aa240 0x7f0b5c0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 >> 172.21.15.52:0/2490456832 conn(0x7f0b5c0678d0 msgr2=0x7f0b5c156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:50.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 shutdown_connections 2023-05-10T01:25:50.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.042+0000 7f0b647a4700 1 -- 172.21.15.52:0/2490456832 wait complete. 2023-05-10T01:25:50.060 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:25:50.061 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-10-01_26_00 in ~10s... 2023-05-10T01:25:50.061 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-05-10T01:25:50.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-10T01:25:50.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.185+0000 7efc3c658700 1 Processor -- start 2023-05-10T01:25:50.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.185+0000 7efc3c658700 1 -- start start 2023-05-10T01:25:50.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3c658700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc34068860 0x7efc340aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3c658700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340c94c0 con 0x7efc34154080 2023-05-10T01:25:50.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3c658700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340cb7d0 con 0x7efc34154460 2023-05-10T01:25:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3c658700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc340c88b0 con 0x7efc34068860 2023-05-10T01:25:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc34068860 0x7efc340aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc34068860 0x7efc340aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37684/0 (socket says 172.21.15.52:37684) 2023-05-10T01:25:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 -- 172.21.15.52:0/4186346202 learned_addr learned my addr 172.21.15.52:0/4186346202 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:50.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 -- 172.21.15.52:0/4186346202 >> v1:172.21.15.172:6789/0 conn(0x7efc34154460 legacy=0x7efc34068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 -- 172.21.15.52:0/4186346202 >> v1:172.21.15.52:6789/0 conn(0x7efc34154080 legacy=0x7efc340a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 -- 172.21.15.52:0/4186346202 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340c8b90 con 0x7efc34068860 2023-05-10T01:25:50.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc3abf5700 1 --2- 172.21.15.52:0/4186346202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34068860 0x7efc340aac90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7efc2c009f20 tx=0x7efc2c009840).ready entity=mon.0 client_cookie=ed8fc6db3e55521e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:50.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.186+0000 7efc393f2700 1 -- 172.21.15.52:0/4186346202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00e070 con 0x7efc34068860 2023-05-10T01:25:50.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc393f2700 1 -- 172.21.15.52:0/4186346202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00ba80 con 0x7efc34068860 2023-05-10T01:25:50.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc393f2700 1 -- 172.21.15.52:0/4186346202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00be00 con 0x7efc34068860 2023-05-10T01:25:50.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 -- 172.21.15.52:0/4186346202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34068860 msgr2=0x7efc340aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 --2- 172.21.15.52:0/4186346202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34068860 0x7efc340aac90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7efc2c009f20 tx=0x7efc2c009840).stop 2023-05-10T01:25:50.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 -- 172.21.15.52:0/4186346202 shutdown_connections 2023-05-10T01:25:50.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 --2- 172.21.15.52:0/4186346202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34068860 0x7efc340aac90 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 -- 172.21.15.52:0/4186346202 >> 172.21.15.52:0/4186346202 conn(0x7efc34067910 msgr2=0x7efc340cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:50.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 -- 172.21.15.52:0/4186346202 shutdown_connections 2023-05-10T01:25:50.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.187+0000 7efc3c658700 1 -- 172.21.15.52:0/4186346202 wait complete. 2023-05-10T01:25:50.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.188+0000 7efc3c658700 1 Processor -- start 2023-05-10T01:25:50.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.188+0000 7efc3c658700 1 -- start start 2023-05-10T01:25:50.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc34068860 0x7efc34146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc34154460 0x7efc340c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc340c10c0 con 0x7efc34154080 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc341657e0 con 0x7efc34068860 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3c658700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34164eb0 con 0x7efc34154460 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc39bf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc39bf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37688/0 (socket says 172.21.15.52:37688) 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc39bf3700 1 -- 172.21.15.52:0/3109736339 learned_addr learned my addr 172.21.15.52:0/3109736339 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3abf5700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc34154460 0x7efc340c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.189+0000 7efc3a3f4700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc34068860 0x7efc34146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 -- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc34154460 msgr2=0x7efc340c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc34154460 0x7efc340c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 -- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc34068860 msgr2=0x7efc34146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc34068860 0x7efc34146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 -- 172.21.15.52:0/3109736339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c009ae0 con 0x7efc34154080 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc39bf3700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7efc2400c440 tx=0x7efc24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24007020 con 0x7efc34154080 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24007180 con 0x7efc34154080 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc34165190 con 0x7efc34154080 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24007520 con 0x7efc34154080 2023-05-10T01:25:50.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.190+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc34164b60 con 0x7efc34154080 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.191+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc34165990 con 0x7efc34154080 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.191+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 41) v1 ==== 75179+0+0 (secure 0 0 0) 0x7efc24010070 con 0x7efc34154080 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.191+0000 7efc227fc700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 0x7efc14061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.192+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7efc24078d10 con 0x7efc34154080 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.192+0000 7efc3a3f4700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 0x7efc14061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:25:50.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.192+0000 7efc3a3f4700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 0x7efc14061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efc34083a50 tx=0x7efc30009040).ready entity=mgr.6251 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:25:50.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.196+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc240478f0 con 0x7efc34154080 2023-05-10T01:25:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.391+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc34066720 con 0x7efc1405ed40 2023-05-10T01:25:50.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.394+0000 7efc227fc700 1 -- 172.21.15.52:0/3109736339 <== mgr.6251 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7efc34066720 con 0x7efc1405ed40 2023-05-10T01:25:50.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:25:50.397 INFO:teuthology.orchestra.run.smithi052.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-05-10T01:25:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 msgr2=0x7efc14061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 0x7efc14061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7efc34083a50 tx=0x7efc30009040).stop 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 msgr2=0x7efc340c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7efc2400c440 tx=0x7efc24007e00).stop 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 shutdown_connections 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efc1405ed40 0x7efc14061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc34154460 0x7efc340c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc34068860 0x7efc34146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 --2- 172.21.15.52:0/3109736339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc34154080 0x7efc340c06e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:25:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 >> 172.21.15.52:0/3109736339 conn(0x7efc34067910 msgr2=0x7efc340c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:25:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 shutdown_connections 2023-05-10T01:25:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:25:50.396+0000 7efc3c658700 1 -- 172.21.15.52:0/3109736339 wait complete. 2023-05-10T01:25:50.410 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-05-10T01:25:50.410 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-05-10T01:25:50.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:50.411 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:51.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:51.429 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:52.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:52.450 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:53.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:53.473 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:54.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:54.496 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:55.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:55.516 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:56.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:56.538 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:57.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:57.558 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:58.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:58.581 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:25:59.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:25:59.101 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:25:59.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:25:59.602 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:26:00.047 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:00.044+0000 7f8f4f442700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:00.047 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:00.044+0000 7f8f4f442700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:00.047 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:00.044+0000 7f8f4f442700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:00.047 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:00.044+0000 7f8f4f442700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:00.048 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:00.044+0000 7f8f4f442700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:00.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:00.624 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:26:00.643 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_26_00_UTC 2023-05-10T01:26:00.644 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-10-01_26_00_UTC'] 2023-05-10T01:26:00.645 DEBUG:tasks.cephfs.test_snap_schedules:exec=1683681950.0609615, now = 1683681960.6452918, timo = 10 2023-05-10T01:26:01.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-10T01:26:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.777+0000 7f524ada0700 1 Processor -- start 2023-05-10T01:26:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.777+0000 7f524ada0700 1 -- start start 2023-05-10T01:26:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f524ada0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f524414f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f524ada0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440c3160 con 0x7f524414f3a0 2023-05-10T01:26:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f524ada0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524405e930 con 0x7f524405e450 2023-05-10T01:26:01.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f524ada0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524405ec10 con 0x7f52440a7df0 2023-05-10T01:26:01.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f5249d9e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f524414f3a0 0x7f52440a76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46712/0 (socket says 172.21.15.52:46712) 2023-05-10T01:26:01.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.778+0000 7f5249d9e700 1 -- 172.21.15.52:0/3281000880 learned_addr learned my addr 172.21.15.52:0/3281000880 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:01.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f524959d700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f524414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151891622 0 0) 0x7f52440c3160 con 0x7f524414f3a0 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52300033f0 con 0x7f524414f3a0 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821429095 0 0) 0x7f52300033f0 con 0x7f524414f3a0 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 msgr2=0x7f524414f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f524414f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 >> v1:172.21.15.172:6789/0 conn(0x7f524405e450 legacy=0x7f52440bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244063660 con 0x7f524414f3a0 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f523c0017f0 con 0x7f524414f3a0 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 >> v1:172.21.15.52:6789/0 conn(0x7f524414f3a0 legacy=0x7f52440a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5230003910 0x7f5230003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f5230004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004b80 0x7f5230005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524405ec10 con 0x7f5230004b80 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523000b910 con 0x7f5230003910 2023-05-10T01:26:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523000bad0 con 0x7f52440a7df0 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f524a59f700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004b80 0x7f5230005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f5249d9e700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5230003910 0x7f5230003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f524959d700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f5230004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f524a59f700 1 -- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 msgr2=0x7f5230004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.779+0000 7f524a59f700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52440a7df0 0x7f5230004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524a59f700 1 -- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5230003910 msgr2=0x7f5230003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524a59f700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5230003910 0x7f5230003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524a59f700 1 -- 172.21.15.52:0/3281000880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300033f0 con 0x7f5230004b80 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524a59f700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004b80 0x7f5230005000 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f524405e860 tx=0x7f5234007bb0).ready entity=mon.0 client_cookie=864018c19b3481af server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234007020 con 0x7f5230004b80 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234007180 con 0x7f5230004b80 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f5248d9c700 1 -- 172.21.15.52:0/3281000880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234007500 con 0x7f5230004b80 2023-05-10T01:26:01.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 -- 172.21.15.52:0/3281000880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004b80 msgr2=0x7f5230005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 --2- 172.21.15.52:0/3281000880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5230004b80 0x7f5230005000 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f524405e860 tx=0x7f5234007bb0).stop 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524a59f700 1 -- 172.21.15.52:0/3281000880 reap_dead start 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 -- 172.21.15.52:0/3281000880 shutdown_connections 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 -- 172.21.15.52:0/3281000880 >> 172.21.15.52:0/3281000880 conn(0x7f5244062d70 msgr2=0x7f524405dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 -- 172.21.15.52:0/3281000880 shutdown_connections 2023-05-10T01:26:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.780+0000 7f524ada0700 1 -- 172.21.15.52:0/3281000880 wait complete. 2023-05-10T01:26:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 Processor -- start 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 -- start start 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5230004b80 0x7f524414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52440adff0 0x7f52440ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440ae920 con 0x7f52440bf940 2023-05-10T01:26:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440adb60 con 0x7f52440adff0 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524ada0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440ad550 con 0x7f5230004b80 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524959d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524959d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37710/0 (socket says 172.21.15.52:37710) 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.782+0000 7f524959d700 1 -- 172.21.15.52:0/1547278553 learned_addr learned my addr 172.21.15.52:0/1547278553 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524a59f700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52440adff0 0x7f52440ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f5249d9e700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5230004b80 0x7f524414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 -- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5230004b80 msgr2=0x7f524414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5230004b80 0x7f524414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 -- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52440adff0 msgr2=0x7f52440ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52440adff0 0x7f52440ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 -- 172.21.15.52:0/1547278553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440ac6f0 con 0x7f52440bf940 2023-05-10T01:26:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524959d700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f52380119f0 tx=0x7f5238009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523800f940 con 0x7f52440bf940 2023-05-10T01:26:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523800faa0 con 0x7f52440bf940 2023-05-10T01:26:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440ad7f0 con 0x7f52440bf940 2023-05-10T01:26:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523800fe20 con 0x7f52440bf940 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.783+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524414e170 con 0x7f52440bf940 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.784+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440adcd0 con 0x7f52440bf940 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.785+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 43) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f5238024070 con 0x7f52440bf940 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.785+0000 7f5241ffb700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 0x7f52240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.785+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f523807a8c0 con 0x7f52440bf940 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.785+0000 7f5249d9e700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 0x7f52240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.786+0000 7f5249d9e700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 0x7f52240613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f523c001920 tx=0x7f523c009040).ready entity=mgr.6251 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:01.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.789+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f523804bc30 con 0x7f52440bf940 2023-05-10T01:26:01.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.993+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5244047150 con 0x7f522405ef30 2023-05-10T01:26:01.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.997+0000 7f5241ffb700 1 -- 172.21.15.52:0/1547278553 <== mgr.6251 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5244047150 con 0x7f522405ef30 2023-05-10T01:26:02.000 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path snap_test_dir1 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 msgr2=0x7f52240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 0x7f52240613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f523c001920 tx=0x7f523c009040).stop 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 msgr2=0x7f52440bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f52380119f0 tx=0x7f5238009060).stop 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 shutdown_connections 2023-05-10T01:26:02.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f522405ef30 0x7f52240613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52440adff0 0x7f52440ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5230004b80 0x7f524414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 --2- 172.21.15.52:0/1547278553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52440bf940 0x7f52440bfdc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 >> 172.21.15.52:0/1547278553 conn(0x7f5244062d70 msgr2=0x7f52440696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:02.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 shutdown_connections 2023-05-10T01:26:02.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:01.999+0000 7f524ada0700 1 -- 172.21.15.52:0/1547278553 wait complete. 2023-05-10T01:26:02.014 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-10T01:26:02.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:02.014 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:26:02.030 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_26_00_UTC 2023-05-10T01:26:02.031 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-10-01_26_00_UTC 2023-05-10T01:26:02.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:02.031 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-10-01_26_00_UTC) 2023-05-10T01:26:02.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:02.091 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:26:02.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:26:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.303+0000 7f3a7c7c7700 1 Processor -- start 2023-05-10T01:26:02.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.303+0000 7f3a7c7c7700 1 -- start start 2023-05-10T01:26:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.304+0000 7f3a7c7c7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3a7414e6e0 0x7f3a74155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.304+0000 7f3a7c7c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a740c4d30 0x7f3a740622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.304+0000 7f3a7c7c7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7414eac0 con 0x7f3a74062790 2023-05-10T01:26:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.304+0000 7f3a7c7c7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a74154ca0 con 0x7f3a740c4d30 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.304+0000 7f3a7c7c7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740c6010 con 0x7f3a7414e6e0 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a740c4d30 0x7f3a740622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a740c4d30 0x7f3a740622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37718/0 (socket says 172.21.15.52:37718) 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 -- 172.21.15.52:0/4269209166 learned_addr learned my addr 172.21.15.52:0/4269209166 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a7a563700 1 --2- 172.21.15.52:0/4269209166 >> v2:172.21.15.172:3300/0 conn(0x7f3a7414e6e0 0x7f3a74155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 -- 172.21.15.52:0/4269209166 >> v2:172.21.15.172:3300/0 conn(0x7f3a7414e6e0 msgr2=0x7f3a74155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 --2- 172.21.15.52:0/4269209166 >> v2:172.21.15.172:3300/0 conn(0x7f3a7414e6e0 0x7f3a74155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 -- 172.21.15.52:0/4269209166 >> v1:172.21.15.172:6789/0 conn(0x7f3a74062790 legacy=0x7f3a740635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 -- 172.21.15.52:0/4269209166 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74154650 con 0x7f3a740c4d30 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79d62700 1 --2- 172.21.15.52:0/4269209166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a740c4d30 0x7f3a740622a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f3a740c9af0 tx=0x7f3a680090f0).ready entity=mon.0 client_cookie=d73d57ad9b9c8dec server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79561700 1 -- 172.21.15.52:0/4269209166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800b600 con 0x7f3a740c4d30 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79561700 1 -- 172.21.15.52:0/4269209166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800b760 con 0x7f3a740c4d30 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.305+0000 7f3a79561700 1 -- 172.21.15.52:0/4269209166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800bae0 con 0x7f3a740c4d30 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/4269209166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a740c4d30 msgr2=0x7f3a740622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/4269209166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a740c4d30 0x7f3a740622a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f3a740c9af0 tx=0x7f3a680090f0).stop 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/4269209166 shutdown_connections 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/4269209166 >> v2:172.21.15.172:3300/0 conn(0x7f3a7414e6e0 0x7f3a74155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/4269209166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a740c4d30 0x7f3a740622a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/4269209166 >> 172.21.15.52:0/4269209166 conn(0x7f3a7405e810 msgr2=0x7f3a740c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/4269209166 shutdown_connections 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.306+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/4269209166 wait complete. 2023-05-10T01:26:02.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.307+0000 7f3a7c7c7700 1 Processor -- start 2023-05-10T01:26:02.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.307+0000 7f3a7c7c7700 1 -- start start 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a74062790 0x7f3a740aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a740c4d30 0x7f3a74161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740a9d20 con 0x7f3a7414e6e0 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740a8700 con 0x7f3a740c4d30 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740a89a0 con 0x7f3a74062790 2023-05-10T01:26:02.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37726/0 (socket says 172.21.15.52:37726) 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 -- 172.21.15.52:0/2847896673 learned_addr learned my addr 172.21.15.52:0/2847896673 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a79d62700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a740c4d30 0x7f3a74161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7a563700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a74062790 0x7f3a740aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 -- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a74062790 msgr2=0x7f3a740aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a74062790 0x7f3a740aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 -- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a740c4d30 msgr2=0x7f3a74161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a740c4d30 0x7f3a74161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 -- 172.21.15.52:0/2847896673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009370 con 0x7f3a7414e6e0 2023-05-10T01:26:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7ad64700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f3a6400c7c0 tx=0x7f3a64001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400e4a0 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6400e620 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740a9940 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400e9e0 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.308+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a740ab460 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.309+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a740a9e60 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.310+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 43) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f3a64019030 con 0x7f3a7414e6e0 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.310+0000 7f3a727fc700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 0x7f3a540613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.310+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f3a64079430 con 0x7f3a7414e6e0 2023-05-10T01:26:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.310+0000 7f3a7a563700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 0x7f3a540613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.311+0000 7f3a7a563700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 0x7f3a540613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3a740ad000 tx=0x7f3a6c008040).ready entity=mgr.6251 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.314+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3a740a9e60 con 0x7f3a7414e6e0 2023-05-10T01:26:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.533+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f3a740a9e60 con 0x7f3a7414e6e0 2023-05-10T01:26:02.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.565+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f3a64010070 con 0x7f3a7414e6e0 2023-05-10T01:26:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.566+0000 7f3a727fc700 1 -- 172.21.15.52:0/2847896673 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v44) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3a64071f00 con 0x7f3a7414e6e0 2023-05-10T01:26:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 msgr2=0x7f3a540613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 0x7f3a540613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3a740ad000 tx=0x7f3a6c008040).stop 2023-05-10T01:26:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 msgr2=0x7f3a74167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f3a6400c7c0 tx=0x7f3a64001560).stop 2023-05-10T01:26:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 shutdown_connections 2023-05-10T01:26:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3a5405ef00 0x7f3a540613c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7414e6e0 0x7f3a74167e20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a74062790 0x7f3a740aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 --2- 172.21.15.52:0/2847896673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a740c4d30 0x7f3a74161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 >> 172.21.15.52:0/2847896673 conn(0x7f3a7405e810 msgr2=0x7f3a740c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 shutdown_connections 2023-05-10T01:26:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.568+0000 7f3a7c7c7700 1 -- 172.21.15.52:0/2847896673 wait complete. 2023-05-10T01:26:02.583 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:26:02.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:02.614 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:02.642 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:26:02.643 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:26:02.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:02.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:26:02.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:26:02.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:02.694 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:26:02.711 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:02.708+0000 7f8955033680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:02.716 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:02.713+0000 7f70eda83680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:02.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:02.777 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:02.774+0000 7f8955033680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:02.778 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:02.775+0000 7f70eda83680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:02.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.881+0000 7f05ada97700 1 Processor -- start 2023-05-10T01:26:02.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.881+0000 7f05ada97700 1 -- start start 2023-05-10T01:26:02.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ada97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 0x7f05a8153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ada97700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05a8153d00 0x7f05a80c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ada97700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a81588f0 con 0x7f05a80c76d0 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ada97700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a8157ce0 con 0x7f05a8153d00 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ada97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8157fc0 con 0x7f05a80c7ab0 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 0x7f05a8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05aca95700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f05a80c76d0 0x7f05a80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:49324/0 (socket says 172.21.15.52:49324) 2023-05-10T01:26:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05aca95700 1 -- 172.21.15.52:0/1472464720 learned_addr learned my addr 172.21.15.52:0/1472464720 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05ad296700 1 --2- 172.21.15.52:0/1472464720 >> v2:172.21.15.172:3300/0 conn(0x7f05a8153d00 0x7f05a80c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05a77fe700 1 -- 172.21.15.52:0/1472464720 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551182459 0 0) 0x7f05a81588f0 con 0x7f05a80c76d0 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.882+0000 7f05a77fe700 1 -- 172.21.15.52:0/1472464720 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c0033f0 con 0x7f05a80c76d0 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ad296700 1 -- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 msgr2=0x7f05a8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ad296700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 0x7f05a8153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ad296700 1 -- 172.21.15.52:0/1472464720 >> v1:172.21.15.172:6789/0 conn(0x7f05a80c76d0 legacy=0x7f05a80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ad296700 1 -- 172.21.15.52:0/1472464720 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a81582a0 con 0x7f05a8153d00 2023-05-10T01:26:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05a7fff700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 0x7f05a8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:02.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ad296700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c0080 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f05a0009e60 tx=0x7f05a0009780).ready entity=mon.1 client_cookie=835cd5677a0bf8b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:02.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05a77fe700 1 -- 172.21.15.52:0/1472464720 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000e070 con 0x7f05a8153d00 2023-05-10T01:26:02.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05a77fe700 1 -- 172.21.15.52:0/1472464720 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a000bab0 con 0x7f05a8153d00 2023-05-10T01:26:02.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05a77fe700 1 -- 172.21.15.52:0/1472464720 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000be30 con 0x7f05a8153d00 2023-05-10T01:26:02.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 -- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 msgr2=0x7f05a80c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c0080 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f05a0009e60 tx=0x7f05a0009780).stop 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 -- 172.21.15.52:0/1472464720 shutdown_connections 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c0080 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 --2- 172.21.15.52:0/1472464720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c7ab0 0x7f05a8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.883+0000 7f05ada97700 1 -- 172.21.15.52:0/1472464720 >> 172.21.15.52:0/1472464720 conn(0x7f05a8068320 msgr2=0x7f05a8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.884+0000 7f05ada97700 1 -- 172.21.15.52:0/1472464720 shutdown_connections 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.884+0000 7f05ada97700 1 -- 172.21.15.52:0/1472464720 wait complete. 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 Processor -- start 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 -- start start 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 0x7f05a8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80ae0c0 con 0x7f05a80c7ab0 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.885+0000 7f05ada97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8147c20 con 0x7f05a8153d00 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05ada97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80ada90 con 0x7f05a80c76d0 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37778/0 (socket says 172.21.15.52:37778) 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 -- 172.21.15.52:0/1953358480 learned_addr learned my addr 172.21.15.52:0/1953358480 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05aca95700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 0x7f05a8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05ad296700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:02.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 msgr2=0x7f05a8147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 0x7f05a8147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 msgr2=0x7f05a80c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 -- 172.21.15.52:0/1953358480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940092a0 con 0x7f05a80c7ab0 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05aca95700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 0x7f05a8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a7fff700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f059400ea50 tx=0x7f0594009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400ee90 con 0x7f05a80c7ab0 2023-05-10T01:26:02.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400c850 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a0009a20 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059400cbd0 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.886+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a80adce0 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.887+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a80ae200 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.888+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f0594022070 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.888+0000 7f05a4ff9700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 0x7f0590061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.888+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f059407a590 con 0x7f05a80c7ab0 2023-05-10T01:26:02.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.888+0000 7f05aca95700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 msgr2=0x7f0590061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:02.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.888+0000 7f05aca95700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 0x7f0590061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:02.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:02.892+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f059404b980 con 0x7f05a80c7ab0 2023-05-10T01:26:03.049 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:03.047+0000 7f70eda83680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:03.069 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:03.067+0000 7f8955033680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:03.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.089+0000 7f05aca95700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 msgr2=0x7f0590061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:03.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.089+0000 7f05aca95700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 0x7f0590061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:03.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.111+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05a80ae200 con 0x7f05a80c7ab0 2023-05-10T01:26:03.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.111+0000 7f05a4ff9700 1 -- 172.21.15.52:0/1953358480 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f05a80ae200 con 0x7f05a80c7ab0 2023-05-10T01:26:03.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:03.114 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:26:03.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 msgr2=0x7f0590061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:03.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 0x7f0590061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 msgr2=0x7f05a80ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f059400ea50 tx=0x7f0594009060).stop 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 shutdown_connections 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f059005ee80 0x7f0590061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05a8153d00 0x7f05a80c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05a80c76d0 0x7f05a8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 --2- 172.21.15.52:0/1953358480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05a80c7ab0 0x7f05a80ae480 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.113+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 >> 172.21.15.52:0/1953358480 conn(0x7f05a8068320 msgr2=0x7f05a814f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:03.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.114+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 shutdown_connections 2023-05-10T01:26:03.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.114+0000 7f05ada97700 1 -- 172.21.15.52:0/1953358480 wait complete. 2023-05-10T01:26:03.118 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:26:03.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.285+0000 7fd0c9cf8700 1 Processor -- start 2023-05-10T01:26:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.285+0000 7fd0c9cf8700 1 -- start start 2023-05-10T01:26:03.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c9cf8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd0c40c7370 0x7fd0c4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c9cf8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c4158960 con 0x7fd0c40ad250 2023-05-10T01:26:03.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c9cf8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c40ad6b0 con 0x7fd0c40c7750 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c9cf8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c4155330 con 0x7fd0c40c7370 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c94f7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd0c40ad250 0x7fd0c414dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46850/0 (socket says 172.21.15.52:46850) 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c94f7700 1 -- 172.21.15.52:0/2678703415 learned_addr learned my addr 172.21.15.52:0/2678703415 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c8cf6700 1 --2- 172.21.15.52:0/2678703415 >> v2:172.21.15.172:3300/0 conn(0x7fd0c40c7370 0x7fd0c4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c37fe700 1 -- 172.21.15.52:0/2678703415 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984701505 0 0) 0x7fd0c4158960 con 0x7fd0c40ad250 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c37fe700 1 -- 172.21.15.52:0/2678703415 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a80033f0 con 0x7fd0c40ad250 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c8cf6700 1 -- 172.21.15.52:0/2678703415 >> v1:172.21.15.172:6789/0 conn(0x7fd0c40c7750 legacy=0x7fd0c40acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c8cf6700 1 -- 172.21.15.52:0/2678703415 >> v1:172.21.15.52:6789/0 conn(0x7fd0c40ad250 legacy=0x7fd0c414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.286+0000 7fd0c8cf6700 1 -- 172.21.15.52:0/2678703415 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4157d50 con 0x7fd0c40c7370 2023-05-10T01:26:03.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c8cf6700 1 --2- 172.21.15.52:0/2678703415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40c7370 0x7fd0c4154e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fd0b8009760 tx=0x7fd0b8009060).ready entity=mon.1 client_cookie=c77148889ee1765 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:03.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c37fe700 1 -- 172.21.15.52:0/2678703415 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800f510 con 0x7fd0c40c7370 2023-05-10T01:26:03.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c37fe700 1 -- 172.21.15.52:0/2678703415 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800f670 con 0x7fd0c40c7370 2023-05-10T01:26:03.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c37fe700 1 -- 172.21.15.52:0/2678703415 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800f9f0 con 0x7fd0c40c7370 2023-05-10T01:26:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/2678703415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40c7370 msgr2=0x7fd0c4154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/2678703415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40c7370 0x7fd0c4154e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fd0b8009760 tx=0x7fd0b8009060).stop 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/2678703415 shutdown_connections 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/2678703415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40c7370 0x7fd0c4154e40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/2678703415 >> 172.21.15.52:0/2678703415 conn(0x7fd0c4068320 msgr2=0x7fd0c4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/2678703415 shutdown_connections 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.287+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/2678703415 wait complete. 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.288+0000 7fd0c9cf8700 1 Processor -- start 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 -- start start 2023-05-10T01:26:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40ad250 0x7fd0c414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0c40c7370 0x7fd0c41642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40c3240 con 0x7fd0c40c7750 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c414cd00 con 0x7fd0c40ad250 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c9cf8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4164da0 con 0x7fd0c40c7370 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c94f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c94f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37840/0 (socket says 172.21.15.52:37840) 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.289+0000 7fd0c94f7700 1 -- 172.21.15.52:0/3627518297 learned_addr learned my addr 172.21.15.52:0/3627518297 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c8cf6700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40ad250 0x7fd0c414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c3fff700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0c40c7370 0x7fd0c41642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 -- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0c40c7370 msgr2=0x7fd0c41642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0c40c7370 0x7fd0c41642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 -- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40ad250 msgr2=0x7fd0c414c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40ad250 0x7fd0c414c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 -- 172.21.15.52:0/3627518297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80092a0 con 0x7fd0c40c7750 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c94f7700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fd0bc005ad0 tx=0x7fd0bc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc005d30 con 0x7fd0c40c7750 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc005e90 con 0x7fd0c40c7750 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c4165080 con 0x7fd0c40c7750 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc007320 con 0x7fd0c40c7750 2023-05-10T01:26:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.290+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c40c3770 con 0x7fd0c40c7750 2023-05-10T01:26:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.291+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fd0bc010030 con 0x7fd0c40c7750 2023-05-10T01:26:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.291+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c41652c0 con 0x7fd0c40c7750 2023-05-10T01:26:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.292+0000 7fd0c0ff9700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 0x7fd0ac061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.292+0000 7fd0c8cf6700 1 -- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 msgr2=0x7fd0ac061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:03.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.292+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fd0bc079bd0 con 0x7fd0c40c7750 2023-05-10T01:26:03.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.292+0000 7fd0c8cf6700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 0x7fd0ac061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:03.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.296+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0bc04aee0 con 0x7fd0c40c7750 2023-05-10T01:26:03.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.486+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0c40bfb80 con 0x7fd0c40c7750 2023-05-10T01:26:03.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.487+0000 7fd0c0ff9700 1 -- 172.21.15.52:0/3627518297 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17689 (secure 0 0 0) 0x7fd0bc04e500 con 0x7fd0c40c7750 2023-05-10T01:26:03.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:03.490 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":109,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:48.951392+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/614387587":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/1036636026":"2023-05-11T01:25:48.951345+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 msgr2=0x7fd0ac061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 0x7fd0ac061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 msgr2=0x7fd0c41647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fd0bc005ad0 tx=0x7fd0bc001650).stop 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 shutdown_connections 2023-05-10T01:26:03.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd0ac05eeb0 0x7fd0ac061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0c40c7750 0x7fd0c41647d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c40ad250 0x7fd0c414c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 --2- 172.21.15.52:0/3627518297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0c40c7370 0x7fd0c41642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 >> 172.21.15.52:0/3627518297 conn(0x7fd0c4068320 msgr2=0x7fd0c4153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 shutdown_connections 2023-05-10T01:26:03.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.489+0000 7fd0c9cf8700 1 -- 172.21.15.52:0/3627518297 wait complete. 2023-05-10T01:26:03.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:25:30.009809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:25:31.322233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:26:03.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:26:03.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.626+0000 7f6232f96700 1 Processor -- start 2023-05-10T01:26:03.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.626+0000 7f6232f96700 1 -- start start 2023-05-10T01:26:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232f96700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 0x7f622c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232f96700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f622c0c61e0 0x7f622c154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232f96700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c06a130 con 0x7f622c153f80 2023-05-10T01:26:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232f96700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c069f50 con 0x7f622c0c61e0 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232f96700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c06a9d0 con 0x7f622c0c1150 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f622c0c61e0 0x7f622c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6231f94700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f622c153f80 0x7f622c0a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46860/0 (socket says 172.21.15.52:46860) 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6231f94700 1 -- 172.21.15.52:0/2878742624 learned_addr learned my addr 172.21.15.52:0/2878742624 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6231793700 1 --2- 172.21.15.52:0/2878742624 >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 0x7f622c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 -- 172.21.15.52:0/2878742624 >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 msgr2=0x7f622c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 --2- 172.21.15.52:0/2878742624 >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 0x7f622c0c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 -- 172.21.15.52:0/2878742624 >> v1:172.21.15.52:6789/0 conn(0x7f622c153f80 legacy=0x7f622c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 -- 172.21.15.52:0/2878742624 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c06a410 con 0x7f622c0c61e0 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6230f92700 1 -- 172.21.15.52:0/2878742624 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586858633 0 0) 0x7f622c06a130 con 0x7f622c153f80 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6231793700 1 --2- 172.21.15.52:0/2878742624 >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 0x7f622c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6232795700 1 --2- 172.21.15.52:0/2878742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c154360 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f622c0c8230 tx=0x7f6224009780).ready entity=mon.0 client_cookie=e655f6ef9239ae22 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.627+0000 7f6230f92700 1 -- 172.21.15.52:0/2878742624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400e070 con 0x7f622c0c61e0 2023-05-10T01:26:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6230f92700 1 -- 172.21.15.52:0/2878742624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400bc30 con 0x7f622c0c61e0 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6230f92700 1 -- 172.21.15.52:0/2878742624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224012410 con 0x7f622c0c61e0 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 -- 172.21.15.52:0/2878742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 msgr2=0x7f622c154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 --2- 172.21.15.52:0/2878742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c154360 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f622c0c8230 tx=0x7f6224009780).stop 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 -- 172.21.15.52:0/2878742624 shutdown_connections 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 --2- 172.21.15.52:0/2878742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c154360 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 --2- 172.21.15.52:0/2878742624 >> v2:172.21.15.172:3300/0 conn(0x7f622c0c1150 0x7f622c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 -- 172.21.15.52:0/2878742624 >> 172.21.15.52:0/2878742624 conn(0x7f622c0cb5f0 msgr2=0x7f622c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:03.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 -- 172.21.15.52:0/2878742624 shutdown_connections 2023-05-10T01:26:03.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.628+0000 7f6232f96700 1 -- 172.21.15.52:0/2878742624 wait complete. 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.629+0000 7f6232f96700 1 Processor -- start 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.629+0000 7f6232f96700 1 -- start start 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f622c0c1150 0x7f622c167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c153f80 0x7f622c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c167e70 con 0x7f622c0c61e0 2023-05-10T01:26:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c165840 con 0x7f622c153f80 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232f96700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c165210 con 0x7f622c0c1150 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231793700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231793700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37852/0 (socket says 172.21.15.52:37852) 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231793700 1 -- 172.21.15.52:0/1181969997 learned_addr learned my addr 172.21.15.52:0/1181969997 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6232795700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c153f80 0x7f622c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231f94700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f622c0c1150 0x7f622c167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231793700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f622c0c1150 msgr2=0x7f622c167490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.630+0000 7f6231793700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f622c0c1150 0x7f622c167490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6231793700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c153f80 msgr2=0x7f622c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6231793700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c153f80 0x7f622c146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6231793700 1 -- 172.21.15.52:0/1181969997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009a20 con 0x7f622c0c61e0 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6231793700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f621c00d860 tx=0x7f621c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011590 con 0x7f622c0c61e0 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0116f0 con 0x7f622c0c61e0 2023-05-10T01:26:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c0c35a0 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011a70 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.631+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c147430 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.632+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c165690 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.632+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f621c012420 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.633+0000 7f6219ffb700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 0x7f620c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.633+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f621c0799a0 con 0x7f622c0c61e0 2023-05-10T01:26:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.633+0000 7f6231f94700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 msgr2=0x7f620c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.633+0000 7f6231f94700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 0x7f620c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.637+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f621c04aba0 con 0x7f622c0c61e0 2023-05-10T01:26:03.655 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:03.652+0000 7f70eda83680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:03.726 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:03.723+0000 7f70eda83680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:03.751 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:03.745+0000 7f8955033680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:03.817 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:03.815+0000 7f8955033680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:03.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.834+0000 7f6231f94700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 msgr2=0x7f620c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.834+0000 7f6231f94700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 0x7f620c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:03.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.856+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f622c083110 con 0x7f622c0c61e0 2023-05-10T01:26:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.856+0000 7f6219ffb700 1 -- 172.21.15.52:0/1181969997 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v109) v1 ==== 110+0+10 (secure 0 0 0) 0x7f621c077c60 con 0x7f622c0c61e0 2023-05-10T01:26:03.859 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:26:03.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 msgr2=0x7f620c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:03.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 0x7f620c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 msgr2=0x7f622c167980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:03.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f621c00d860 tx=0x7f621c008040).stop 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 shutdown_connections 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f620c05eeb0 0x7f620c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f622c153f80 0x7f622c146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f622c0c1150 0x7f622c167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 --2- 172.21.15.52:0/1181969997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f622c0c61e0 0x7f622c167980 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 >> 172.21.15.52:0/1181969997 conn(0x7f622c0cb5f0 msgr2=0x7f622c152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:03.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 shutdown_connections 2023-05-10T01:26:03.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.858+0000 7f6232f96700 1 -- 172.21.15.52:0/1181969997 wait complete. 2023-05-10T01:26:03.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:26:03.910 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:03.907+0000 7f70eda83680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:03.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.996+0000 7f61641c3700 1 Processor -- start 2023-05-10T01:26:03.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.997+0000 7f61641c3700 1 -- start start 2023-05-10T01:26:04.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.997+0000 7f61641c3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.997+0000 7f61641c3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0653a0 con 0x7f615c154db0 2023-05-10T01:26:04.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.997+0000 7f61641c3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c157ff0 con 0x7f615c067550 2023-05-10T01:26:04.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.997+0000 7f61641c3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1582d0 con 0x7f615c14e430 2023-05-10T01:26:04.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f616175e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f615c154db0 0x7f615c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46902/0 (socket says 172.21.15.52:46902) 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f616175e700 1 -- 172.21.15.52:0/2881239073 learned_addr learned my addr 172.21.15.52:0/2881239073 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6161f5f700 1 --2- 172.21.15.52:0/2881239073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391616414 0 0) 0x7f615c0653a0 con 0x7f615c154db0 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61440033f0 con 0x7f615c154db0 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656832647 0 0) 0x7f615c157ff0 con 0x7f615c067550 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c0653a0 con 0x7f615c067550 2023-05-10T01:26:04.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6161f5f700 1 -- 172.21.15.52:0/2881239073 >> v1:172.21.15.172:6789/0 conn(0x7f615c067550 legacy=0x7f615c065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6161f5f700 1 -- 172.21.15.52:0/2881239073 >> v1:172.21.15.52:6789/0 conn(0x7f615c154db0 legacy=0x7f615c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6161f5f700 1 -- 172.21.15.52:0/2881239073 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c1585b0 con 0x7f615c14e430 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6161f5f700 1 --2- 172.21.15.52:0/2881239073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c157a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6158009790 tx=0x7f6158009060).ready entity=mon.2 client_cookie=3488e9f03f4a6a35 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800f510 con 0x7f615c14e430 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800f670 con 0x7f615c14e430 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.998+0000 7f6160f5d700 1 -- 172.21.15.52:0/2881239073 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800f9f0 con 0x7f615c14e430 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 -- 172.21.15.52:0/2881239073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 msgr2=0x7f615c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 --2- 172.21.15.52:0/2881239073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c157a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6158009790 tx=0x7f6158009060).stop 2023-05-10T01:26:04.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 -- 172.21.15.52:0/2881239073 shutdown_connections 2023-05-10T01:26:04.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 --2- 172.21.15.52:0/2881239073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c157a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 -- 172.21.15.52:0/2881239073 >> 172.21.15.52:0/2881239073 conn(0x7f615c0c8460 msgr2=0x7f615c0c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 -- 172.21.15.52:0/2881239073 shutdown_connections 2023-05-10T01:26:04.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:03.999+0000 7f61641c3700 1 -- 172.21.15.52:0/2881239073 wait complete. 2023-05-10T01:26:04.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.000+0000 7f61641c3700 1 Processor -- start 2023-05-10T01:26:04.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.000+0000 7f61641c3700 1 -- start start 2023-05-10T01:26:04.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c0a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 0x7f615c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c14fa30 con 0x7f615c067550 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c150890 con 0x7f615c154db0 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f61641c3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c14fc80 con 0x7f615c14e430 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f6161f5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f6161f5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37892/0 (socket says 172.21.15.52:37892) 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f6161f5f700 1 -- 172.21.15.52:0/1639443390 learned_addr learned my addr 172.21.15.52:0/1639443390 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f616175e700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c0a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.001+0000 7f6162760700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 0x7f615c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 -- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 msgr2=0x7f615c0a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c0a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 -- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 msgr2=0x7f615c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 0x7f615c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 -- 172.21.15.52:0/1639443390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580092a0 con 0x7f615c067550 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f616175e700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c0a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6162760700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 0x7f615c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6161f5f700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f615c064ac0 tx=0x7f6158017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800fe80 con 0x7f615c067550 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800f7e0 con 0x7f615c067550 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c14ff60 con 0x7f615c067550 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615801b640 con 0x7f615c067550 2023-05-10T01:26:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.002+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c150520 con 0x7f615c067550 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.003+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c150b70 con 0x7f615c067550 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.004+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f615800f070 con 0x7f615c067550 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.004+0000 7f6149ffb700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 0x7f613c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.004+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f615807bad0 con 0x7f615c067550 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.004+0000 7f616175e700 1 -- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 msgr2=0x7f613c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.004+0000 7f616175e700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 0x7f613c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.008+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f615804cec0 con 0x7f615c067550 2023-05-10T01:26:04.020 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.017+0000 7f8955033680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:04.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.181+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f615c06c340 con 0x7f615c067550 2023-05-10T01:26:04.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.181+0000 7f6149ffb700 1 -- 172.21.15.52:0/1639443390 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61580504e0 con 0x7f615c067550 2023-05-10T01:26:04.185 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:26:04.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 msgr2=0x7f613c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:04.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 0x7f613c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 msgr2=0x7f615c1383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f615c064ac0 tx=0x7f6158017000).stop 2023-05-10T01:26:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 shutdown_connections 2023-05-10T01:26:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613c05eeb0 0x7f613c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f615c154db0 0x7f615c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f615c067550 0x7f615c1383e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 --2- 172.21.15.52:0/1639443390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f615c14e430 0x7f615c0a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 >> 172.21.15.52:0/1639443390 conn(0x7f615c0c8460 msgr2=0x7f615c153860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.183+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 shutdown_connections 2023-05-10T01:26:04.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.184+0000 7f61641c3700 1 -- 172.21.15.52:0/1639443390 wait complete. 2023-05-10T01:26:04.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:26:04.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.321+0000 7f86f9345700 1 Processor -- start 2023-05-10T01:26:04.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.321+0000 7f86f9345700 1 -- start start 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f9345700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 0x7f86f4062840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f9345700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40a7b50 con 0x7f86f4062460 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f9345700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40c50c0 con 0x7f86f40a7fe0 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f9345700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40641a0 con 0x7f86f4154080 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f86f4062460 0x7f86f40bf270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46916/0 (socket says 172.21.15.52:46916) 2023-05-10T01:26:04.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f2ffd700 1 -- 172.21.15.52:0/2302987639 learned_addr learned my addr 172.21.15.52:0/2302987639 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f37fe700 1 --2- 172.21.15.52:0/2302987639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 0x7f86f4062840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464403626 0 0) 0x7f86f40a7b50 con 0x7f86f4062460 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e00033f0 con 0x7f86f4062460 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677443420 0 0) 0x7f86f40c50c0 con 0x7f86f40a7fe0 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f37fe700 1 -- 172.21.15.52:0/2302987639 >> v1:172.21.15.172:6789/0 conn(0x7f86f40a7fe0 legacy=0x7f86f4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f37fe700 1 -- 172.21.15.52:0/2302987639 >> v1:172.21.15.52:6789/0 conn(0x7f86f4062460 legacy=0x7f86f40bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f37fe700 1 -- 172.21.15.52:0/2302987639 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4064480 con 0x7f86f4154080 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.322+0000 7f86f37fe700 1 --2- 172.21.15.52:0/2302987639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 0x7f86f4062840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f86ec009e90 tx=0x7f86ec009780).ready entity=mon.2 client_cookie=ac0c1b99eda2862f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00e070 con 0x7f86f4154080 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00bb60 con 0x7f86f4154080 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f1ffb700 1 -- 172.21.15.52:0/2302987639 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00bee0 con 0x7f86f4154080 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 -- 172.21.15.52:0/2302987639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 msgr2=0x7f86f4062840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 --2- 172.21.15.52:0/2302987639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 0x7f86f4062840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f86ec009e90 tx=0x7f86ec009780).stop 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 -- 172.21.15.52:0/2302987639 shutdown_connections 2023-05-10T01:26:04.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 --2- 172.21.15.52:0/2302987639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4154080 0x7f86f4062840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 -- 172.21.15.52:0/2302987639 >> 172.21.15.52:0/2302987639 conn(0x7f86f405e7d0 msgr2=0x7f86f40c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 -- 172.21.15.52:0/2302987639 shutdown_connections 2023-05-10T01:26:04.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.323+0000 7f86f9345700 1 -- 172.21.15.52:0/2302987639 wait complete. 2023-05-10T01:26:04.329 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.323+0000 7f70eda83680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:04.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 Processor -- start 2023-05-10T01:26:04.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 -- start start 2023-05-10T01:26:04.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4062460 0x7f86f40abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86f40a7fe0 0x7f86f40ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4165880 con 0x7f86f4154080 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40ac630 con 0x7f86f40a7fe0 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f9345700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4164d00 con 0x7f86f4062460 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37910/0 (socket says 172.21.15.52:37910) 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.325+0000 7f86f37fe700 1 -- 172.21.15.52:0/3674254119 learned_addr learned my addr 172.21.15.52:0/3674254119 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f2ffd700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4062460 0x7f86f40abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f27fc700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86f40a7fe0 0x7f86f40ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 -- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4062460 msgr2=0x7f86f40abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4062460 0x7f86f40abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 -- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86f40a7fe0 msgr2=0x7f86f40ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86f40a7fe0 0x7f86f40ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 -- 172.21.15.52:0/3674254119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009a20 con 0x7f86f4154080 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f37fe700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f86ec00b6c0 tx=0x7f86ec009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec01d630 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec01d7b0 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f4164fe0 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec01db70 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.326+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41655a0 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.327+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f406c340 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.327+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f86ec026410 con 0x7f86f4154080 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.328+0000 7f86daffd700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 0x7f86d4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.328+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f86ec07c010 con 0x7f86f4154080 2023-05-10T01:26:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.328+0000 7f86f2ffd700 1 -- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 msgr2=0x7f86d4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.328+0000 7f86f2ffd700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 0x7f86d4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.332+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86ec04d320 con 0x7f86f4154080 2023-05-10T01:26:04.432 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.429+0000 7f70eda83680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:04.469 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.465+0000 7f8955033680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:04.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.509+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86f40c4d50 con 0x7f86f4154080 2023-05-10T01:26:04.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.509+0000 7f86daffd700 1 -- 172.21.15.52:0/3674254119 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86ec050940 con 0x7f86f4154080 2023-05-10T01:26:04.512 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:26:04.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 msgr2=0x7f86d4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:04.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 0x7f86d4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 msgr2=0x7f86f40adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f86ec00b6c0 tx=0x7f86ec009780).stop 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 shutdown_connections 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f86d405eeb0 0x7f86d4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86f4154080 0x7f86f40adf80 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86f4062460 0x7f86f40abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 --2- 172.21.15.52:0/3674254119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86f40a7fe0 0x7f86f40ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 >> 172.21.15.52:0/3674254119 conn(0x7f86f405e7d0 msgr2=0x7f86f4158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 shutdown_connections 2023-05-10T01:26:04.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.511+0000 7f86f9345700 1 -- 172.21.15.52:0/3674254119 wait complete. 2023-05-10T01:26:04.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:26:04.580 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.577+0000 7f8955033680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:04.586 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.583+0000 7f70eda83680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:04.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.647+0000 7f3d059e9700 1 Processor -- start 2023-05-10T01:26:04.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.647+0000 7f3d059e9700 1 -- start start 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3d059e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 0x7f3d001544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3d059e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000c6310 con 0x7f3d00155570 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3d059e9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d001550e0 con 0x7f3d000cb410 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3d059e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000c6830 con 0x7f3d00154110 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cff7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d00155570 0x7f3d00068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46934/0 (socket says 172.21.15.52:46934) 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cff7fe700 1 -- 172.21.15.52:0/811209994 learned_addr learned my addr 172.21.15.52:0/811209994 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:04.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfeffd700 1 --2- 172.21.15.52:0/811209994 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 0x7f3d001544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfdffb700 1 -- 172.21.15.52:0/811209994 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221636697 0 0) 0x7f3cf8001490 con 0x7f3d00155570 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfdffb700 1 -- 172.21.15.52:0/811209994 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cec0033f0 con 0x7f3d00155570 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfeffd700 1 -- 172.21.15.52:0/811209994 >> v1:172.21.15.172:6789/0 conn(0x7f3d000cb410 legacy=0x7f3d000c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfeffd700 1 -- 172.21.15.52:0/811209994 >> v1:172.21.15.52:6789/0 conn(0x7f3d00155570 legacy=0x7f3d00068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfeffd700 1 -- 172.21.15.52:0/811209994 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000c6550 con 0x7f3d00154110 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.648+0000 7f3cfeffd700 1 --2- 172.21.15.52:0/811209994 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 0x7f3d001544f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3cf0009760 tx=0x7f3cf0006f40).ready entity=mon.2 client_cookie=97599d9b9b90883d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3cfdffb700 1 -- 172.21.15.52:0/811209994 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0005880 con 0x7f3d00154110 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3cfdffb700 1 -- 172.21.15.52:0/811209994 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf00059e0 con 0x7f3d00154110 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3cfdffb700 1 -- 172.21.15.52:0/811209994 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0005d60 con 0x7f3d00154110 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 -- 172.21.15.52:0/811209994 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 msgr2=0x7f3d001544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 --2- 172.21.15.52:0/811209994 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 0x7f3d001544f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3cf0009760 tx=0x7f3cf0006f40).stop 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 -- 172.21.15.52:0/811209994 shutdown_connections 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 --2- 172.21.15.52:0/811209994 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d00154110 0x7f3d001544f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 -- 172.21.15.52:0/811209994 >> 172.21.15.52:0/811209994 conn(0x7f3d000678d0 msgr2=0x7f3d000cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 -- 172.21.15.52:0/811209994 shutdown_connections 2023-05-10T01:26:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.649+0000 7f3d059e9700 1 -- 172.21.15.52:0/811209994 wait complete. 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.651+0000 7f3d059e9700 1 Processor -- start 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.651+0000 7f3d059e9700 1 -- start start 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d000cb410 0x7f3d000a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d00155570 0x7f3d00147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000c2e40 con 0x7f3d00154110 2023-05-10T01:26:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000c3090 con 0x7f3d00155570 2023-05-10T01:26:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000c3370 con 0x7f3d000cb410 2023-05-10T01:26:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cff7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d00155570 0x7f3d00147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37922/0 (socket says 172.21.15.52:37922) 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 -- 172.21.15.52:0/1437992071 learned_addr learned my addr 172.21.15.52:0/1437992071 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfeffd700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d000cb410 0x7f3d000a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 -- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d000cb410 msgr2=0x7f3d000a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d000cb410 0x7f3d000a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 -- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d00155570 msgr2=0x7f3d00147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d00155570 0x7f3d00147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 -- 172.21.15.52:0/1437992071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009250 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3cfe7fc700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f3cf400c440 tx=0x7f3cf4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4007020 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4001e90 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d000c3650 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.652+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40073b0 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.653+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d000c3c10 con 0x7f3d00154110 2023-05-10T01:26:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.653+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d000c3e30 con 0x7f3d00154110 2023-05-10T01:26:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.654+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f3cf4010070 con 0x7f3d00154110 2023-05-10T01:26:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.654+0000 7f3ce6ffd700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 0x7f3ce0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.654+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f3cf40794a0 con 0x7f3d00154110 2023-05-10T01:26:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.654+0000 7f3cfeffd700 1 -- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 msgr2=0x7f3ce0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.654+0000 7f3cfeffd700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 0x7f3ce0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:04.662 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.657+0000 7f70eda83680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:04.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.661+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cf404a810 con 0x7f3d00154110 2023-05-10T01:26:04.726 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.723+0000 7f70eda83680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:04.746 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.741+0000 7f8955033680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:04.822 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.820+0000 7f8955033680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:04.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.836+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d00154a90 con 0x7f3d00154110 2023-05-10T01:26:04.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.837+0000 7f3ce6ffd700 1 -- 172.21.15.52:0/1437992071 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cf404de30 con 0x7f3d00154110 2023-05-10T01:26:04.840 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:26:04.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 msgr2=0x7f3ce0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 0x7f3ce0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 msgr2=0x7f3d000ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f3cf400c440 tx=0x7f3cf4007d70).stop 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 shutdown_connections 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3ce005eeb0 0x7f3ce0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d00155570 0x7f3d00147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d000cb410 0x7f3d000a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 --2- 172.21.15.52:0/1437992071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d00154110 0x7f3d000ab420 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 >> 172.21.15.52:0/1437992071 conn(0x7f3d000678d0 msgr2=0x7f3d000ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 shutdown_connections 2023-05-10T01:26:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.839+0000 7f3d059e9700 1 -- 172.21.15.52:0/1437992071 wait complete. 2023-05-10T01:26:04.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:04.896 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:04.893+0000 7f8955033680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:04.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.970+0000 7f6678df5700 1 Processor -- start 2023-05-10T01:26:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 -- start start 2023-05-10T01:26:04.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6674154540 0x7f66740c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740c0650 con 0x7f6674069690 2023-05-10T01:26:04.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740c1af0 con 0x7f6674154540 2023-05-10T01:26:04.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.971+0000 7f6678df5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740bfd20 con 0x7f6674154160 2023-05-10T01:26:04.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6674154540 0x7f66740c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6672d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6674069690 0x7f6674157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46946/0 (socket says 172.21.15.52:46946) 2023-05-10T01:26:04.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6672d9d700 1 -- 172.21.15.52:0/2527138781 learned_addr learned my addr 172.21.15.52:0/2527138781 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:04.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f667259c700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 -- 172.21.15.52:0/2527138781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 msgr2=0x7f66740c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:04.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 -- 172.21.15.52:0/2527138781 >> v1:172.21.15.52:6789/0 conn(0x7f6674069690 legacy=0x7f6674157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 -- 172.21.15.52:0/2527138781 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740c0000 con 0x7f6674154540 2023-05-10T01:26:04.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f667159a700 1 -- 172.21.15.52:0/2527138781 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163456584 0 0) 0x7f66740c0650 con 0x7f6674069690 2023-05-10T01:26:04.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f6671d9b700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f66740c6150 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f6668009760 tx=0x7f6668009060).ready entity=mon.0 client_cookie=13d2db51a12e700b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f667159a700 1 -- 172.21.15.52:0/2527138781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680090d0 con 0x7f6674154540 2023-05-10T01:26:04.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f667159a700 1 -- 172.21.15.52:0/2527138781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800f510 con 0x7f6674154540 2023-05-10T01:26:04.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.972+0000 7f667159a700 1 -- 172.21.15.52:0/2527138781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800f890 con 0x7f6674154540 2023-05-10T01:26:04.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 -- 172.21.15.52:0/2527138781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 msgr2=0x7f66740c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f66740c6150 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f6668009760 tx=0x7f6668009060).stop 2023-05-10T01:26:04.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 -- 172.21.15.52:0/2527138781 shutdown_connections 2023-05-10T01:26:04.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 --2- 172.21.15.52:0/2527138781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f66740c6150 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 -- 172.21.15.52:0/2527138781 >> 172.21.15.52:0/2527138781 conn(0x7f66740cb6f0 msgr2=0x7f66740c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:04.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 -- 172.21.15.52:0/2527138781 shutdown_connections 2023-05-10T01:26:04.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.973+0000 7f6678df5700 1 -- 172.21.15.52:0/2527138781 wait complete. 2023-05-10T01:26:04.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.974+0000 7f6678df5700 1 Processor -- start 2023-05-10T01:26:04.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.974+0000 7f6678df5700 1 -- start start 2023-05-10T01:26:04.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6674069690 0x7f66741533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:04.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740b0480 con 0x7f6674154540 2023-05-10T01:26:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740aeb30 con 0x7f6674069690 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6678df5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6674151120 con 0x7f6674154160 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37936/0 (socket says 172.21.15.52:37936) 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 -- 172.21.15.52:0/889626619 learned_addr learned my addr 172.21.15.52:0/889626619 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6671d9b700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f667259c700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6674069690 0x7f66741533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 msgr2=0x7f66740afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6674069690 msgr2=0x7f66741533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6674069690 0x7f66741533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 -- 172.21.15.52:0/889626619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680092a0 con 0x7f6674154540 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f6672d9d700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f666c00c790 tx=0x7f666c007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:04.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.975+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c005d30 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.976+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c007110 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.976+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66741507f0 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.976+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0074d0 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.976+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6674150db0 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.976+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66740666b0 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.977+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f666c010030 con 0x7f6674154540 2023-05-10T01:26:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.977+0000 7f66627fc700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 0x7f6650061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.977+0000 7f667259c700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 msgr2=0x7f6650061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:05.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.977+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f666c079b80 con 0x7f6674154540 2023-05-10T01:26:05.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.977+0000 7f667259c700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 0x7f6650061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:05.002 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:04.977+0000 7f70eda83680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:05.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:04.982+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f666c04aef0 con 0x7f6674154540 2023-05-10T01:26:05.163 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:05.160+0000 7f70eda83680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:05.172 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:05.169+0000 7f8955033680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:05.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.178+0000 7f667259c700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 msgr2=0x7f6650061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:05.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.178+0000 7f667259c700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 0x7f6650061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:05.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.197+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f667406c340 con 0x7f6674154540 2023-05-10T01:26:05.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.198+0000 7f66627fc700 1 -- 172.21.15.52:0/889626619 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f666c079020 con 0x7f6674154540 2023-05-10T01:26:05.201 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:05.201 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:26:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 msgr2=0x7f6650061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 0x7f6650061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 msgr2=0x7f6674154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f666c00c790 tx=0x7f666c007f30).stop 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 shutdown_connections 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f665005eeb0 0x7f6650061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6674154540 0x7f6674154ea0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6674069690 0x7f66741533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 --2- 172.21.15.52:0/889626619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6674154160 0x7f66740afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 >> 172.21.15.52:0/889626619 conn(0x7f66740cb6f0 msgr2=0x7f6674155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 shutdown_connections 2023-05-10T01:26:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.200+0000 7f6678df5700 1 -- 172.21.15.52:0/889626619 wait complete. 2023-05-10T01:26:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:26:05.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:05.365 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:05.362+0000 7f8955033680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:05.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.374+0000 7f5bd12bd700 1 Processor -- start 2023-05-10T01:26:05.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.374+0000 7f5bd12bd700 1 -- start start 2023-05-10T01:26:05.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5bcc153ea0 0x7f5bcc154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc068c60 0x7f5bcc066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bcc064ff0 0x7f5bcc0654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc065990 con 0x7f5bcc064ff0 2023-05-10T01:26:05.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0bc9a0 con 0x7f5bcc153ea0 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bd12bd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0bcc80 con 0x7f5bcc068c60 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bcc064ff0 0x7f5bcc0654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bcc064ff0 0x7f5bcc0654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37946/0 (socket says 172.21.15.52:37946) 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 -- 172.21.15.52:0/3696861852 learned_addr learned my addr 172.21.15.52:0/3696861852 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bca7fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc068c60 0x7f5bcc066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcaffd700 1 --2- 172.21.15.52:0/3696861852 >> v2:172.21.15.172:3300/0 conn(0x7f5bcc153ea0 0x7f5bcc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 -- 172.21.15.52:0/3696861852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc068c60 msgr2=0x7f5bcc066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 --2- 172.21.15.52:0/3696861852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc068c60 0x7f5bcc066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 -- 172.21.15.52:0/3696861852 >> v2:172.21.15.172:3300/0 conn(0x7f5bcc153ea0 msgr2=0x7f5bcc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 --2- 172.21.15.52:0/3696861852 >> v2:172.21.15.172:3300/0 conn(0x7f5bcc153ea0 0x7f5bcc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 -- 172.21.15.52:0/3696861852 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0bcf60 con 0x7f5bcc064ff0 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bcb7fe700 1 --2- 172.21.15.52:0/3696861852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0654a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f5bcc064420 tx=0x7f5bc4009840).ready entity=mon.0 client_cookie=7005b9344f6f21d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bc9ffb700 1 -- 172.21.15.52:0/3696861852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400e070 con 0x7f5bcc064ff0 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bc9ffb700 1 -- 172.21.15.52:0/3696861852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc400b970 con 0x7f5bcc064ff0 2023-05-10T01:26:05.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.375+0000 7f5bc9ffb700 1 -- 172.21.15.52:0/3696861852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400bcf0 con 0x7f5bcc064ff0 2023-05-10T01:26:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 -- 172.21.15.52:0/3696861852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 msgr2=0x7f5bcc0654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/3696861852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0654a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f5bcc064420 tx=0x7f5bc4009840).stop 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 -- 172.21.15.52:0/3696861852 shutdown_connections 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/3696861852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0654a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/3696861852 >> v2:172.21.15.172:3300/0 conn(0x7f5bcc153ea0 0x7f5bcc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/3696861852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc068c60 0x7f5bcc066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 -- 172.21.15.52:0/3696861852 >> 172.21.15.52:0/3696861852 conn(0x7f5bcc0c4420 msgr2=0x7f5bcc0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 -- 172.21.15.52:0/3696861852 shutdown_connections 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.376+0000 7f5bd12bd700 1 -- 172.21.15.52:0/3696861852 wait complete. 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.377+0000 7f5bd12bd700 1 Processor -- start 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.377+0000 7f5bd12bd700 1 -- start start 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bcc153ea0 0x7f5bcc0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc151280 0x7f5bcc155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc159380 con 0x7f5bcc064ff0 2023-05-10T01:26:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0a79c0 con 0x7f5bcc153ea0 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bd12bd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0a7ca0 con 0x7f5bcc151280 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bcaffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bcaffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37948/0 (socket says 172.21.15.52:37948) 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bcaffd700 1 -- 172.21.15.52:0/2413848897 learned_addr learned my addr 172.21.15.52:0/2413848897 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bca7fc700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bcc153ea0 0x7f5bcc0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bcb7fe700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc151280 0x7f5bcc155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.378+0000 7f5bcaffd700 1 -- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc151280 msgr2=0x7f5bcc155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bcaffd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc151280 0x7f5bcc155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bcaffd700 1 -- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bcc153ea0 msgr2=0x7f5bcc0a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bcaffd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bcc153ea0 0x7f5bcc0a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bcaffd700 1 -- 172.21.15.52:0/2413848897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009ae0 con 0x7f5bcc064ff0 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bcaffd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f5bb400e900 tx=0x7f5bb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4012600 con 0x7f5bcc064ff0 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb4012760 con 0x7f5bcc064ff0 2023-05-10T01:26:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc0a7f80 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4012ae0 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.379+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc1516e0 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.380+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc06c340 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.380+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f5bb4022070 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.381+0000 7f5bc2ffd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 0x7f5bb0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.381+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f5bb4079fb0 con 0x7f5bcc064ff0 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.381+0000 7f5bca7fc700 1 -- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 msgr2=0x7f5bb0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.381+0000 7f5bca7fc700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 0x7f5bb0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.385+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bb404b320 con 0x7f5bcc064ff0 2023-05-10T01:26:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.560+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bcc0bd240 con 0x7f5bcc064ff0 2023-05-10T01:26:05.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.561+0000 7f5bc2ffd700 1 -- 172.21.15.52:0/2413848897 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17689 (secure 0 0 0) 0x7f5bb404e940 con 0x7f5bcc064ff0 2023-05-10T01:26:05.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:05.564 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":109,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:48.951392+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/614387587":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/1036636026":"2023-05-11T01:25:48.951345+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 msgr2=0x7f5bb0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 0x7f5bb0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 msgr2=0x7f5bcc0a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f5bb400e900 tx=0x7f5bb4009060).stop 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 shutdown_connections 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5bb005eeb0 0x7f5bb0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bcc151280 0x7f5bcc155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bcc064ff0 0x7f5bcc0a73e0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 --2- 172.21.15.52:0/2413848897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bcc153ea0 0x7f5bcc0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 >> 172.21.15.52:0/2413848897 conn(0x7f5bcc0c4420 msgr2=0x7f5bcc153150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:05.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 shutdown_connections 2023-05-10T01:26:05.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.563+0000 7f5bd12bd700 1 -- 172.21.15.52:0/2413848897 wait complete. 2023-05-10T01:26:05.579 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:26:05.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:05.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.695+0000 7fd0115a7700 1 Processor -- start 2023-05-10T01:26:05.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.695+0000 7fd0115a7700 1 -- start start 2023-05-10T01:26:05.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd0115a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154160 0x7fd00c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd0115a7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd00c069da0 0x7fd00c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd0115a7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0c0650 con 0x7fd00c154540 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd0115a7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c0c1af0 con 0x7fd00c069da0 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd0115a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0bfd20 con 0x7fd00c154160 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd00c069da0 0x7fd00c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00a7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd00c154540 0x7fd00c069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47006/0 (socket says 172.21.15.52:47006) 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00a7fc700 1 -- 172.21.15.52:0/3532136108 learned_addr learned my addr 172.21.15.52:0/3532136108 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00affd700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154160 0x7fd00c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 -- 172.21.15.52:0/3532136108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154160 msgr2=0x7fd00c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154160 0x7fd00c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 -- 172.21.15.52:0/3532136108 >> v1:172.21.15.52:6789/0 conn(0x7fd00c154540 legacy=0x7fd00c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd009ffb700 1 -- 172.21.15.52:0/3532136108 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813907423 0 0) 0x7fd00c0c0650 con 0x7fd00c154540 2023-05-10T01:26:05.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 -- 172.21.15.52:0/3532136108 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0c0000 con 0x7fd00c069da0 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd00b7fe700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0c6150 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fd004009e60 tx=0x7fd004009780).ready entity=mon.0 client_cookie=bdf718c6db1dce92 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.696+0000 7fd009ffb700 1 -- 172.21.15.52:0/3532136108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400e070 con 0x7fd00c069da0 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd009ffb700 1 -- 172.21.15.52:0/3532136108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400bc30 con 0x7fd00c069da0 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd009ffb700 1 -- 172.21.15.52:0/3532136108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004012410 con 0x7fd00c069da0 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 -- 172.21.15.52:0/3532136108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 msgr2=0x7fd00c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0c6150 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fd004009e60 tx=0x7fd004009780).stop 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 -- 172.21.15.52:0/3532136108 shutdown_connections 2023-05-10T01:26:05.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0c6150 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3532136108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154160 0x7fd00c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 -- 172.21.15.52:0/3532136108 >> 172.21.15.52:0/3532136108 conn(0x7fd00c0cb740 msgr2=0x7fd00c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:05.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 -- 172.21.15.52:0/3532136108 shutdown_connections 2023-05-10T01:26:05.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.697+0000 7fd0115a7700 1 -- 172.21.15.52:0/3532136108 wait complete. 2023-05-10T01:26:05.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.698+0000 7fd0115a7700 1 Processor -- start 2023-05-10T01:26:05.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.698+0000 7fd0115a7700 1 -- start start 2023-05-10T01:26:05.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd00c154160 0x7fd00c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154540 0x7fd00c165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c150ee0 con 0x7fd00c069da0 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c165500 con 0x7fd00c154160 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd0115a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0c4b00 con 0x7fd00c154540 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd00affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd00affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37994/0 (socket says 172.21.15.52:37994) 2023-05-10T01:26:05.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd00affd700 1 -- 172.21.15.52:0/3458290784 learned_addr learned my addr 172.21.15.52:0/3458290784 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:05.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd00b7fe700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154540 0x7fd00c165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.699+0000 7fd00a7fc700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd00c154160 0x7fd00c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154540 msgr2=0x7fd00c165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154540 0x7fd00c165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd00c154160 msgr2=0x7fd00c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd00c154160 0x7fd00c1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 -- 172.21.15.52:0/3458290784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009a20 con 0x7fd00c069da0 2023-05-10T01:26:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd00affd700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fcffc00d890 tx=0x7fcffc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc011590 con 0x7fd00c069da0 2023-05-10T01:26:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc0116f0 con 0x7fd00c069da0 2023-05-10T01:26:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc011a70 con 0x7fd00c069da0 2023-05-10T01:26:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c0c31e0 con 0x7fd00c069da0 2023-05-10T01:26:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.700+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c0c37a0 con 0x7fd00c069da0 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.701+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c0666b0 con 0x7fd00c069da0 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.702+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fcffc01c460 con 0x7fd00c069da0 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.702+0000 7fcff2ffd700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 0x7fcfec061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.702+0000 7fd00a7fc700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 msgr2=0x7fcfec061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.702+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fcffc079cc0 con 0x7fd00c069da0 2023-05-10T01:26:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.702+0000 7fd00a7fc700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 0x7fcfec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:05.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.710+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcffc04afd0 con 0x7fd00c069da0 2023-05-10T01:26:05.808 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:05.804+0000 7f70eda83680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:05.874 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:05.871+0000 7f70eda83680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.903+0000 7fd00a7fc700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 msgr2=0x7fcfec061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.903+0000 7fd00a7fc700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 0x7fcfec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:05.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.925+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd00c06c340 con 0x7fd00c069da0 2023-05-10T01:26:05.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.926+0000 7fcff2ffd700 1 -- 172.21.15.52:0/3458290784 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7fcffc011e60 con 0x7fd00c069da0 2023-05-10T01:26:05.929 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:05.929 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 msgr2=0x7fcfec061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 0x7fcfec061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 msgr2=0x7fd00c0adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fcffc00d890 tx=0x7fcffc008040).stop 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 shutdown_connections 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcfec05eeb0 0x7fcfec061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd00c154540 0x7fd00c165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd00c069da0 0x7fd00c0adc40 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 --2- 172.21.15.52:0/3458290784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd00c154160 0x7fd00c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 >> 172.21.15.52:0/3458290784 conn(0x7fd00c0cb740 msgr2=0x7fd00c154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 shutdown_connections 2023-05-10T01:26:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:05.928+0000 7fd0115a7700 1 -- 172.21.15.52:0/3458290784 wait complete. 2023-05-10T01:26:05.933 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:26:05.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:05.947 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:05.944+0000 7f70eda83680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:06.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.061+0000 7f39cbfff700 1 Processor -- start 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.061+0000 7f39cbfff700 1 -- start start 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cbfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cbfff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0697e0 con 0x7f39cc0c41a0 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cbfff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc06a340 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cbfff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc069aa0 con 0x7f39cc0631e0 2023-05-10T01:26:06.066 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f8955033680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39ca7fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39caffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39ca7fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:57640/0 (socket says 172.21.15.52:57640) 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cb7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f39cc0c41a0 0x7f39cc0c4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:49562/0 (socket says 172.21.15.52:49562) 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39caffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:36328/0 (socket says 172.21.15.52:36328) 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.062+0000 7f39cb7fe700 1 -- 172.21.15.52:0/1014674987 learned_addr learned my addr 172.21.15.52:0/1014674987 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1014674987 >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 msgr2=0x7f39cc065d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39ca7fc700 1 --2- 172.21.15.52:0/1014674987 >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1014674987 >> v1:172.21.15.172:6789/0 conn(0x7f39cc0c41a0 legacy=0x7f39cc0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39c9ffb700 1 -- 172.21.15.52:0/1014674987 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825489633 0 0) 0x7f39cc0697e0 con 0x7f39cc0c41a0 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1014674987 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc069d80 con 0x7f39cc0631e0 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39caffd700 1 --2- 172.21.15.52:0/1014674987 >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39ca7fc700 1 --2- 172.21.15.52:0/1014674987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f39bc009760 tx=0x7f39bc009060).ready entity=mon.2 client_cookie=25b7e16c7f8258da server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39c9ffb700 1 -- 172.21.15.52:0/1014674987 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00f510 con 0x7f39cc0631e0 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39c9ffb700 1 -- 172.21.15.52:0/1014674987 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00f670 con 0x7f39cc0631e0 2023-05-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39c9ffb700 1 -- 172.21.15.52:0/1014674987 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00f9f0 con 0x7f39cc0631e0 2023-05-10T01:26:06.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 -- 172.21.15.52:0/1014674987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 msgr2=0x7f39cc0a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1014674987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f39bc009760 tx=0x7f39bc009060).stop 2023-05-10T01:26:06.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 -- 172.21.15.52:0/1014674987 shutdown_connections 2023-05-10T01:26:06.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1014674987 >> v2:172.21.15.172:3300/0 conn(0x7f39cc0a6cf0 0x7f39cc065d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1014674987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0a8b70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.063+0000 7f39cbfff700 1 -- 172.21.15.52:0/1014674987 >> 172.21.15.52:0/1014674987 conn(0x7f39cc067f50 msgr2=0x7f39cc068360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.064+0000 7f39cbfff700 1 -- 172.21.15.52:0/1014674987 shutdown_connections 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.064+0000 7f39cbfff700 1 -- 172.21.15.52:0/1014674987 wait complete. 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.065+0000 7f39cbfff700 1 Processor -- start 2023-05-10T01:26:06.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.065+0000 7f39cbfff700 1 -- start start 2023-05-10T01:26:06.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.065+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39cc0c41a0 0x7f39cc0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0ac4a0 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0c3c60 con 0x7f39cc0c41a0 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0ab890 con 0x7f39cc0631e0 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38012/0 (socket says 172.21.15.52:38012) 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1926081617 learned_addr learned my addr 172.21.15.52:0/1926081617 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cb7fe700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39cc0c41a0 0x7f39cc0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39caffd700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 msgr2=0x7f39cc0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39cc0c41a0 msgr2=0x7f39cc0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39cc0c41a0 0x7f39cc0c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 -- 172.21.15.52:0/1926081617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40092a0 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39ca7fc700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f39bc00f610 tx=0x7f39bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00fe80 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00f7e0 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc0092a0 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc01b670 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.066+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc0abe50 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.067+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0ac650 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.068+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f39bc00f070 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.068+0000 7f39c2ffd700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 0x7f39b0061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.068+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f39bc07b380 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.068+0000 7f39caffd700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 msgr2=0x7f39b0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.068+0000 7f39caffd700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 0x7f39b0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.076+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39cc0ac650 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.091 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.088+0000 7f70eda83680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:06.141 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.139+0000 7f8955033680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:06.160 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.157+0000 7f70eda83680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:06.220 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.217+0000 7f8955033680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:06.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.269+0000 7f39caffd700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 msgr2=0x7f39b0061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.269+0000 7f39caffd700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 0x7f39b0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:06.272 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.269+0000 7f70eda83680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.295+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39cc0ac650 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.295+0000 7f39c2ffd700 1 -- 172.21.15.52:0/1926081617 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4491 (secure 0 0 0) 0x7f39cc0ac650 con 0x7f39cc0a6cf0 2023-05-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:06.299 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:25:32.342428+0000","modified":"2023-05-10T01:25:35.355946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7146":{"gid":7146,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/1857645329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1857645329},{"type":"v1","addr":"172.21.15.172:6837","nonce":1857645329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-05-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 msgr2=0x7f39b0061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 0x7f39b0061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 msgr2=0x7f39cc0ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f39bc00f610 tx=0x7f39bc017000).stop 2023-05-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 shutdown_connections 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f39b005eeb0 0x7f39b0061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39cc0c41a0 0x7f39cc0c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39cc0631e0 0x7f39cc0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 --2- 172.21.15.52:0/1926081617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39cc0a6cf0 0x7f39cc0ad490 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 >> 172.21.15.52:0/1926081617 conn(0x7f39cc067f50 msgr2=0x7f39cc0bb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 shutdown_connections 2023-05-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.297+0000 7f39cbfff700 1 -- 172.21.15.52:0/1926081617 wait complete. 2023-05-10T01:26:06.302 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 46 2023-05-10T01:26:06.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:06.377 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.374+0000 7f70eda83680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:06.378 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.375+0000 7f8955033680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:06.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.427+0000 7ffb77535700 1 Processor -- start 2023-05-10T01:26:06.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 -- start start 2023-05-10T01:26:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb701555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb70068860 0x7ffb700bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70155120 con 0x7ffb700a9ed0 2023-05-10T01:26:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700c55c0 con 0x7ffb70068860 2023-05-10T01:26:06.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.428+0000 7ffb77535700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700cb730 con 0x7ffb70151fe0 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb70068860 0x7ffb700bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb70068860 0x7ffb700bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38024/0 (socket says 172.21.15.52:38024) 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 -- 172.21.15.52:0/1910129231 learned_addr learned my addr 172.21.15.52:0/1910129231 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb752d1700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb701555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 -- 172.21.15.52:0/1910129231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 msgr2=0x7ffb701555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb701555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 -- 172.21.15.52:0/1910129231 >> v1:172.21.15.172:6789/0 conn(0x7ffb700a9ed0 legacy=0x7ffb70068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 -- 172.21.15.52:0/1910129231 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700cba10 con 0x7ffb70068860 2023-05-10T01:26:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb75ad2700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb70068860 0x7ffb700bfc10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7ffb68009f20 tx=0x7ffb68009840).ready entity=mon.0 client_cookie=4db6bc8af950817 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb63fff700 1 -- 172.21.15.52:0/1910129231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb70068860 2023-05-10T01:26:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb63fff700 1 -- 172.21.15.52:0/1910129231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800ba80 con 0x7ffb70068860 2023-05-10T01:26:06.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.429+0000 7ffb63fff700 1 -- 172.21.15.52:0/1910129231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800be00 con 0x7ffb70068860 2023-05-10T01:26:06.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 -- 172.21.15.52:0/1910129231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb70068860 msgr2=0x7ffb700bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb70068860 0x7ffb700bfc10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7ffb68009f20 tx=0x7ffb68009840).stop 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 -- 172.21.15.52:0/1910129231 shutdown_connections 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb701555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 --2- 172.21.15.52:0/1910129231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb70068860 0x7ffb700bfc10 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 -- 172.21.15.52:0/1910129231 >> 172.21.15.52:0/1910129231 conn(0x7ffb70067910 msgr2=0x7ffb700cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:06.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 -- 172.21.15.52:0/1910129231 shutdown_connections 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.430+0000 7ffb77535700 1 -- 172.21.15.52:0/1910129231 wait complete. 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.431+0000 7ffb77535700 1 Processor -- start 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.431+0000 7ffb77535700 1 -- start start 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 0x7ffb700ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb700c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700abe20 con 0x7ffb700a9ed0 2023-05-10T01:26:06.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701501f0 con 0x7ffb70068860 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb77535700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70164180 con 0x7ffb70151fe0 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb74ad0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb74ad0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38028/0 (socket says 172.21.15.52:38028) 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb74ad0700 1 -- 172.21.15.52:0/1625838577 learned_addr learned my addr 172.21.15.52:0/1625838577 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb752d1700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 0x7ffb700ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.432+0000 7ffb75ad2700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb700c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 -- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 msgr2=0x7ffb700c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb700c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 -- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 msgr2=0x7ffb700ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 0x7ffb700ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 -- 172.21.15.52:0/1625838577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009ae0 con 0x7ffb700a9ed0 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb752d1700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 0x7ffb700ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb75ad2700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb700c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb74ad0700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7ffb6400c4f0 tx=0x7ffb64007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64007020 con 0x7ffb700a9ed0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64007180 con 0x7ffb700a9ed0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64007520 con 0x7ffb700a9ed0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700ac920 con 0x7ffb700a9ed0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.433+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb70154500 con 0x7ffb700a9ed0 2023-05-10T01:26:06.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.434+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb700666b0 con 0x7ffb700a9ed0 2023-05-10T01:26:06.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.435+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7ffb64010070 con 0x7ffb700a9ed0 2023-05-10T01:26:06.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.435+0000 7ffb617fa700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 0x7ffb50061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.435+0000 7ffb752d1700 1 -- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 msgr2=0x7ffb50061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:06.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.435+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6557+0+0 (secure 0 0 0) 0x7ffb64079080 con 0x7ffb700a9ed0 2023-05-10T01:26:06.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.435+0000 7ffb752d1700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 0x7ffb50061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:06.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.439+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffb640478f0 con 0x7ffb700a9ed0 2023-05-10T01:26:06.454 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.452+0000 7f8955033680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:06.577 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.575+0000 7f8955033680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.615+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb701642f0 con 0x7ffb700a9ed0 2023-05-10T01:26:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.616+0000 7ffb617fa700 1 -- 172.21.15.52:0/1625838577 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17689 (secure 0 0 0) 0x7ffb6404a3f0 con 0x7ffb700a9ed0 2023-05-10T01:26:06.619 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:06.619 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":109,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:25:48.951392+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:25:30.009809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-05-10T01:25:31.322233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:6832/116173":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/614387587":"2023-05-11T01:25:48.951345+0000","172.21.15.172:0/1036636026":"2023-05-11T01:25:48.951345+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 msgr2=0x7ffb50061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 0x7ffb50061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 msgr2=0x7ffb7014fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7ffb6400c4f0 tx=0x7ffb64007dd0).stop 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 shutdown_connections 2023-05-10T01:26:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ffb5005eeb0 0x7ffb50061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb70151fe0 0x7ffb700c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70068860 0x7ffb700ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 --2- 172.21.15.52:0/1625838577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb700a9ed0 0x7ffb7014fd00 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 >> 172.21.15.52:0/1625838577 conn(0x7ffb70067910 msgr2=0x7ffb70155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 shutdown_connections 2023-05-10T01:26:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.618+0000 7ffb77535700 1 -- 172.21.15.52:0/1625838577 wait complete. 2023-05-10T01:26:06.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:26:06.670 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.664+0000 7f70eda83680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:06.694 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:06.691+0000 7f8955033680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:06.736 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:06.733+0000 7f70eda83680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.752+0000 7f5eaf22f700 1 Processor -- start 2023-05-10T01:26:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.752+0000 7f5eaf22f700 1 -- start start 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eaf22f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ea813a990 0x7f5ea8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eaf22f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80c3ed0 con 0x7f5ea813a5b0 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eaf22f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80c3330 con 0x7f5ea8068440 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eaf22f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80c2aa0 con 0x7f5ea813a990 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eacfcb700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5ea813a5b0 0x7f5ea80c37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47050/0 (socket says 172.21.15.52:47050) 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5eacfcb700 1 -- 172.21.15.52:0/2201120223 learned_addr learned my addr 172.21.15.52:0/2201120223 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5ea7fff700 1 --2- 172.21.15.52:0/2201120223 >> v2:172.21.15.52:3300/0 conn(0x7f5ea813a990 0x7f5ea8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5ea7fff700 1 -- 172.21.15.52:0/2201120223 >> v1:172.21.15.172:6789/0 conn(0x7f5ea8068440 legacy=0x7f5ea81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5ea7fff700 1 -- 172.21.15.52:0/2201120223 >> v1:172.21.15.52:6789/0 conn(0x7f5ea813a5b0 legacy=0x7f5ea80c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5ea7fff700 1 -- 172.21.15.52:0/2201120223 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80c2d00 con 0x7f5ea813a990 2023-05-10T01:26:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.754+0000 7f5ea7fff700 1 --2- 172.21.15.52:0/2201120223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea813a990 0x7f5ea8067f50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5e94009760 tx=0x7f5e94009060).ready entity=mon.0 client_cookie=d1c807deffdccb22 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.755+0000 7f5ea77fe700 1 -- 172.21.15.52:0/2201120223 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400b580 con 0x7f5ea813a990 2023-05-10T01:26:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.755+0000 7f5ea77fe700 1 -- 172.21.15.52:0/2201120223 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400b6e0 con 0x7f5ea813a990 2023-05-10T01:26:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.755+0000 7f5ea77fe700 1 -- 172.21.15.52:0/2201120223 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400ba60 con 0x7f5ea813a990 2023-05-10T01:26:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 -- 172.21.15.52:0/2201120223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea813a990 msgr2=0x7f5ea8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/2201120223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea813a990 0x7f5ea8067f50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5e94009760 tx=0x7f5e94009060).stop 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 -- 172.21.15.52:0/2201120223 shutdown_connections 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/2201120223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea813a990 0x7f5ea8067f50 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 -- 172.21.15.52:0/2201120223 >> 172.21.15.52:0/2201120223 conn(0x7f5ea80c4420 msgr2=0x7f5ea80c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 -- 172.21.15.52:0/2201120223 shutdown_connections 2023-05-10T01:26:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.756+0000 7f5eaf22f700 1 -- 172.21.15.52:0/2201120223 wait complete. 2023-05-10T01:26:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.758+0000 7f5eaf22f700 1 Processor -- start 2023-05-10T01:26:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.758+0000 7f5eaf22f700 1 -- start start 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ea8068440 0x7f5ea80aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea813a5b0 0x7f5ea80c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81659e0 con 0x7f5ea80c6190 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8164d20 con 0x7f5ea813a5b0 2023-05-10T01:26:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5eaf22f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8165000 con 0x7f5ea8068440 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5ead7cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5ead7cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38040/0 (socket says 172.21.15.52:38040) 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.759+0000 7f5ead7cc700 1 -- 172.21.15.52:0/3675297740 learned_addr learned my addr 172.21.15.52:0/3675297740 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ea7fff700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea813a5b0 0x7f5ea80c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5eacfcb700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ea8068440 0x7f5ea80aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ea8068440 msgr2=0x7f5ea80aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ea8068440 0x7f5ea80aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea813a5b0 msgr2=0x7f5ea80c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea813a5b0 0x7f5ea80c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 -- 172.21.15.52:0/3675297740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e940092a0 con 0x7f5ea80c6190 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ead7cc700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f5ea000c7c0 tx=0x7f5ea0001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000e4a0 con 0x7f5ea80c6190 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000e600 con 0x7f5ea80c6190 2023-05-10T01:26:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000e980 con 0x7f5ea80c6190 2023-05-10T01:26:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea81652e0 con 0x7f5ea80c6190 2023-05-10T01:26:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.760+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea80ab150 con 0x7f5ea80c6190 2023-05-10T01:26:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.761+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea806c340 con 0x7f5ea80c6190 2023-05-10T01:26:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.762+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 44) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f5ea0010070 con 0x7f5ea80c6190 2023-05-10T01:26:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.762+0000 7f5ea4ff9700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.762+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6815+0+0 (secure 0 0 0) 0x7f5ea0079640 con 0x7f5ea80c6190 2023-05-10T01:26:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.762+0000 7f5eacfcb700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 msgr2=0x7f5e900613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.762+0000 7f5eacfcb700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.766+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ea00478f0 con 0x7f5ea80c6190 2023-05-10T01:26:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.963+0000 7f5eacfcb700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 msgr2=0x7f5e900613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.963+0000 7f5eacfcb700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:06.985+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5ea80c2fb0 con 0x7f5ea80c6190 2023-05-10T01:26:07.003 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:07.000+0000 7f8955033680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:07.078 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:07.076+0000 7f8955033680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:07.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.364+0000 7f5eacfcb700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 msgr2=0x7f5e900613a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:07.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.364+0000 7f5eacfcb700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:26:07.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.576+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 45) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f5ea000ed70 con 0x7f5ea80c6190 2023-05-10T01:26:07.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.576+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 msgr2=0x7f5e900613a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:07.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.576+0000 7f5ea4ff9700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:07.641 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f706d267700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.641 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f706d267700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.641 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f706d267700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f706d267700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f706d267700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f7070a6e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f7070a6e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f7070a6e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f7070a6e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.642 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:07.638+0000 7f7070a6e700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:07.643 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:07.641+0000 7fe520b20700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:07.643 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:07.641+0000 7fe520b20700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:07.644 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:07.641+0000 7fe520b20700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:26:07.648 INFO:tasks.ceph.mds.d.smithi172.stderr: -4592> 2023-05-10T01:25:37.535+0000 7fe524327700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:26:07.653 INFO:tasks.ceph.mds.d.smithi172.stderr: -5> 2023-05-10T01:26:07.641+0000 7fe520b20700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:07.654 INFO:tasks.ceph.mds.d.smithi172.stderr: -4> 2023-05-10T01:26:07.641+0000 7fe520b20700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:07.654 INFO:tasks.ceph.mds.d.smithi172.stderr: -2> 2023-05-10T01:26:07.641+0000 7fe520b20700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:26:07.673 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:26:07.750 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:26:07.748+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:26:07.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.750+0000 7f5ea4ff9700 1 -- 172.21.15.52:0/3675297740 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5ea0071070 con 0x7f5ea80c6190 2023-05-10T01:26:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.752+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 msgr2=0x7f5ea80ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.752+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f5ea000c7c0 tx=0x7f5ea0001510).stop 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 shutdown_connections 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5e9005eee0 0x7f5e900613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ea80c6190 0x7f5ea80ab460 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5ea8068440 0x7f5ea80aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 --2- 172.21.15.52:0/3675297740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea813a5b0 0x7f5ea80c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 >> 172.21.15.52:0/3675297740 conn(0x7f5ea80c4420 msgr2=0x7f5ea80c37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:07.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 shutdown_connections 2023-05-10T01:26:07.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.753+0000 7f5eaf22f700 1 -- 172.21.15.52:0/3675297740 wait complete. 2023-05-10T01:26:07.757 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:26:07.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:26:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.888+0000 7f4176138700 1 Processor -- start 2023-05-10T01:26:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.888+0000 7f4176138700 1 -- start start 2023-05-10T01:26:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170154110 0x7f41701544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 0x7f41700c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4170155570 0x7f4170068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41700c6830 con 0x7f4170155570 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41701550e0 con 0x7f41700cb410 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f4176138700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700c6550 con 0x7f4170154110 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4170155570 0x7f4170068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4170155570 0x7f4170068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38060/0 (socket says 172.21.15.52:38060) 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 -- 172.21.15.52:0/3831708045 learned_addr learned my addr 172.21.15.52:0/3831708045 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416f7fe700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170154110 0x7f41701544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416effd700 1 --2- 172.21.15.52:0/3831708045 >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 0x7f41700c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 -- 172.21.15.52:0/3831708045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170154110 msgr2=0x7f41701544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170154110 0x7f41701544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 -- 172.21.15.52:0/3831708045 >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 msgr2=0x7f41700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 --2- 172.21.15.52:0/3831708045 >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 0x7f41700c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416ffff700 1 -- 172.21.15.52:0/3831708045 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170154a90 con 0x7f4170155570 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.889+0000 7f416effd700 1 --2- 172.21.15.52:0/3831708045 >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 0x7f41700c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:07.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f416ffff700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170155570 0x7f4170068150 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4170083f20 tx=0x7f4168009840).ready entity=mon.0 client_cookie=b3730adfbdd6974 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f416e7fc700 1 -- 172.21.15.52:0/3831708045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416800e070 con 0x7f4170155570 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f416e7fc700 1 -- 172.21.15.52:0/3831708045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416800b970 con 0x7f4170155570 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f416e7fc700 1 -- 172.21.15.52:0/3831708045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416800bcf0 con 0x7f4170155570 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 -- 172.21.15.52:0/3831708045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170155570 msgr2=0x7f4170068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170155570 0x7f4170068150 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4170083f20 tx=0x7f4168009840).stop 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 -- 172.21.15.52:0/3831708045 shutdown_connections 2023-05-10T01:26:07.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170155570 0x7f4170068150 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 --2- 172.21.15.52:0/3831708045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170154110 0x7f41701544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 --2- 172.21.15.52:0/3831708045 >> v2:172.21.15.172:3300/0 conn(0x7f41700cb410 0x7f41700c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 -- 172.21.15.52:0/3831708045 >> 172.21.15.52:0/3831708045 conn(0x7f41700678d0 msgr2=0x7f41700cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:07.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 -- 172.21.15.52:0/3831708045 shutdown_connections 2023-05-10T01:26:07.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.890+0000 7f4176138700 1 -- 172.21.15.52:0/3831708045 wait complete. 2023-05-10T01:26:07.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 Processor -- start 2023-05-10T01:26:07.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 -- start start 2023-05-10T01:26:07.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 0x7f417014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170155570 0x7f41700af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41700af840 con 0x7f4170154110 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417014c390 con 0x7f41700cb410 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f4176138700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4170151470 con 0x7f4170155570 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.892+0000 7f416effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38064/0 (socket says 172.21.15.52:38064) 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 -- 172.21.15.52:0/3458068481 learned_addr learned my addr 172.21.15.52:0/3458068481 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416f7fe700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 0x7f417014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416ffff700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170155570 0x7f41700af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 -- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170155570 msgr2=0x7f41700af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170155570 0x7f41700af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 -- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 msgr2=0x7f417014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 0x7f417014bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 -- 172.21.15.52:0/3458068481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640092a0 con 0x7f4170154110 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416f7fe700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 0x7f417014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f416effd700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f416400e960 tx=0x7f4164009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400c850 con 0x7f4170154110 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416400c9b0 con 0x7f4170154110 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4168009ae0 con 0x7f4170154110 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400cd30 con 0x7f4170154110 2023-05-10T01:26:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.893+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4170151a30 con 0x7f4170154110 2023-05-10T01:26:07.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.894+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4170066720 con 0x7f4170154110 2023-05-10T01:26:07.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.894+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 45) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f4164022070 con 0x7f4170154110 2023-05-10T01:26:07.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.895+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f416407a1e0 con 0x7f4170154110 2023-05-10T01:26:07.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:07.899+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f416404b4e0 con 0x7f4170154110 2023-05-10T01:26:08.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.116+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4170154d70 con 0x7f4170154110 2023-05-10T01:26:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.579+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 46) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f4164077e40 con 0x7f4170154110 2023-05-10T01:26:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.579+0000 7f41577fe700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 0x7f4150067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.583+0000 7f416f7fe700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 0x7f4150067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.584+0000 7f416f7fe700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 0x7f4150067a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4160009200 tx=0x7f4160008040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:08.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.752+0000 7f41577fe700 1 -- 172.21.15.52:0/3458068481 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f416406cc20 con 0x7f4170154110 2023-05-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 msgr2=0x7f4150067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 0x7f4150067a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4160009200 tx=0x7f4160008040).stop 2023-05-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 msgr2=0x7f41700aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f416400e960 tx=0x7f4164009060).stop 2023-05-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 shutdown_connections 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4150030180 0x7f4150067a50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4170155570 0x7f41700af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41700cb410 0x7f417014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 --2- 172.21.15.52:0/3458068481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4170154110 0x7f41700aee60 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 >> 172.21.15.52:0/3458068481 conn(0x7f41700678d0 msgr2=0x7f41700c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 shutdown_connections 2023-05-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.754+0000 7f4176138700 1 -- 172.21.15.52:0/3458068481 wait complete. 2023-05-10T01:26:08.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:26:08.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.896+0000 7fa98f9e0700 1 Processor -- start 2023-05-10T01:26:08.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.896+0000 7fa98f9e0700 1 -- start start 2023-05-10T01:26:08.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.896+0000 7fa98f9e0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa988154080 0x7fa9880aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.896+0000 7fa98f9e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154460 0x7fa9880a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98f9e0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880c94c0 con 0x7fa9880aa140 2023-05-10T01:26:08.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98f9e0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880aa5b0 con 0x7fa988154080 2023-05-10T01:26:08.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98f9e0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880cb7d0 con 0x7fa988154460 2023-05-10T01:26:08.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98d77c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa988154080 0x7fa9880aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98df7d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa9880aa140 0x7fa988068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:49644/0 (socket says 172.21.15.52:49644) 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98df7d700 1 -- 172.21.15.52:0/3870662449 learned_addr learned my addr 172.21.15.52:0/3870662449 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98cf7b700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154460 0x7fa9880a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98d77c700 1 -- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154460 msgr2=0x7fa9880a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98d77c700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154460 0x7fa9880a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98d77c700 1 -- 172.21.15.52:0/3870662449 >> v1:172.21.15.172:6789/0 conn(0x7fa9880aa140 legacy=0x7fa988068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa987fff700 1 -- 172.21.15.52:0/3870662449 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945594925 0 0) 0x7fa9880c94c0 con 0x7fa9880aa140 2023-05-10T01:26:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.897+0000 7fa98d77c700 1 -- 172.21.15.52:0/3870662449 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880c88b0 con 0x7fa988154080 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98d77c700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa988154080 0x7fa9880aac90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fa980009e60 tx=0x7fa980009780).ready entity=mon.1 client_cookie=98abd9c2121da039 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa987fff700 1 -- 172.21.15.52:0/3870662449 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000e070 con 0x7fa988154080 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa987fff700 1 -- 172.21.15.52:0/3870662449 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98000bb60 con 0x7fa988154080 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa987fff700 1 -- 172.21.15.52:0/3870662449 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980012410 con 0x7fa988154080 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 -- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa988154080 msgr2=0x7fa9880aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa988154080 0x7fa9880aac90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fa980009e60 tx=0x7fa980009780).stop 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 -- 172.21.15.52:0/3870662449 shutdown_connections 2023-05-10T01:26:08.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa988154080 0x7fa9880aac90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/3870662449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154460 0x7fa9880a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 -- 172.21.15.52:0/3870662449 >> 172.21.15.52:0/3870662449 conn(0x7fa988067910 msgr2=0x7fa9880cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:08.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 -- 172.21.15.52:0/3870662449 shutdown_connections 2023-05-10T01:26:08.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.898+0000 7fa98f9e0700 1 -- 172.21.15.52:0/3870662449 wait complete. 2023-05-10T01:26:08.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.899+0000 7fa98f9e0700 1 Processor -- start 2023-05-10T01:26:08.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.899+0000 7fa98f9e0700 1 -- start start 2023-05-10T01:26:08.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 0x7fa98814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154080 0x7fa988154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880adfe0 con 0x7fa988154460 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988155220 con 0x7fa9880aa140 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98f9e0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa988155500 con 0x7fa988154080 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98df7d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.900+0000 7fa98df7d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38096/0 (socket says 172.21.15.52:38096) 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 -- 172.21.15.52:0/1803926627 learned_addr learned my addr 172.21.15.52:0/1803926627 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98d77c700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 0x7fa98814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98cf7b700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154080 0x7fa988154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 -- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154080 msgr2=0x7fa988154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154080 0x7fa988154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 -- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 msgr2=0x7fa98814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 0x7fa98814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 -- 172.21.15.52:0/1803926627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009a20 con 0x7fa988154460 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98d77c700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 0x7fa98814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98df7d700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7fa97800c460 tx=0x7fa978007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780072e0 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978007440 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9881557e0 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780057a0 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.901+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98815a280 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.902+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988066720 con 0x7fa988154460 2023-05-10T01:26:08.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.903+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 46) v1 ==== 75162+0+0 (secure 0 0 0) 0x7fa97801a060 con 0x7fa988154460 2023-05-10T01:26:08.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.903+0000 7fa9857fa700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 0x7fa9680611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:08.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.903+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fa9780793b0 con 0x7fa988154460 2023-05-10T01:26:08.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.903+0000 7fa98d77c700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 0x7fa9680611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:08.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.904+0000 7fa98d77c700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 0x7fa9680611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa980009fd0 tx=0x7fa980009780).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:08.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:08.907+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa97804a6b0 con 0x7fa988154460 2023-05-10T01:26:09.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.079+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa98806c340 con 0x7fa988154460 2023-05-10T01:26:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.756+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa978010070 con 0x7fa988154460 2023-05-10T01:26:09.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.761+0000 7fa9857fa700 1 -- 172.21.15.52:0/1803926627 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa9780723b0 con 0x7fa988154460 2023-05-10T01:26:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 msgr2=0x7fa9680611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 0x7fa9680611e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa980009fd0 tx=0x7fa980009780).stop 2023-05-10T01:26:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 msgr2=0x7fa9880ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7fa97800c460 tx=0x7fa978007e10).stop 2023-05-10T01:26:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 shutdown_connections 2023-05-10T01:26:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa96805ed20 0x7fa9680611e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa988154460 0x7fa9880ae470 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9880aa140 0x7fa98814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 --2- 172.21.15.52:0/1803926627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa988154080 0x7fa988154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 >> 172.21.15.52:0/1803926627 conn(0x7fa988067910 msgr2=0x7fa9880ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 shutdown_connections 2023-05-10T01:26:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.765+0000 7fa98f9e0700 1 -- 172.21.15.52:0/1803926627 wait complete. 2023-05-10T01:26:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:26:09.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:26:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.907+0000 7f4deddfb700 1 Processor -- start 2023-05-10T01:26:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.907+0000 7f4deddfb700 1 -- start start 2023-05-10T01:26:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4deddfb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 0x7f4de80a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4deddfb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de806a130 con 0x7f4de80c5cf0 2023-05-10T01:26:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4deddfb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de806a410 con 0x7f4de8155370 2023-05-10T01:26:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4deddfb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8069f50 con 0x7f4de8153f80 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de7fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4de80c5cf0 0x7f4de80c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47120/0 (socket says 172.21.15.52:47120) 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de7fff700 1 -- 172.21.15.52:0/2033852394 learned_addr learned my addr 172.21.15.52:0/2033852394 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4decdf9700 1 --2- 172.21.15.52:0/2033852394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 0x7f4de80a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346833416 0 0) 0x7f4de806a130 con 0x7f4de80c5cf0 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dcc0033f0 con 0x7f4de80c5cf0 2023-05-10T01:26:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647035613 0 0) 0x7f4de806a410 con 0x7f4de8155370 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de806a130 con 0x7f4de8155370 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4decdf9700 1 -- 172.21.15.52:0/2033852394 >> v1:172.21.15.172:6789/0 conn(0x7f4de8155370 legacy=0x7f4de80c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4decdf9700 1 -- 172.21.15.52:0/2033852394 >> v1:172.21.15.52:6789/0 conn(0x7f4de80c5cf0 legacy=0x7f4de80c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.908+0000 7f4decdf9700 1 -- 172.21.15.52:0/2033852394 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de806a6f0 con 0x7f4de8153f80 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4decdf9700 1 --2- 172.21.15.52:0/2033852394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 0x7f4de80a9d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4ddc009790 tx=0x7f4ddc009060).ready entity=mon.2 client_cookie=fc4ca97ea8e8d0a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00f510 con 0x7f4de8153f80 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00f670 con 0x7f4de8153f80 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4de77fe700 1 -- 172.21.15.52:0/2033852394 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00f9f0 con 0x7f4de8153f80 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 -- 172.21.15.52:0/2033852394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 msgr2=0x7f4de80a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2033852394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 0x7f4de80a9d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f4ddc009790 tx=0x7f4ddc009060).stop 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 -- 172.21.15.52:0/2033852394 shutdown_connections 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2033852394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8153f80 0x7f4de80a9d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 -- 172.21.15.52:0/2033852394 >> 172.21.15.52:0/2033852394 conn(0x7f4de80cb5f0 msgr2=0x7f4de80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 -- 172.21.15.52:0/2033852394 shutdown_connections 2023-05-10T01:26:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.909+0000 7f4deddfb700 1 -- 172.21.15.52:0/2033852394 wait complete. 2023-05-10T01:26:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.910+0000 7f4deddfb700 1 Processor -- start 2023-05-10T01:26:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 -- start start 2023-05-10T01:26:09.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:09.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de8153f80 0x7f4de814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8155370 0x7f4de814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80adad0 con 0x7f4de80c5cf0 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80adcb0 con 0x7f4de8153f80 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4deddfb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80adf90 con 0x7f4de8155370 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4decdf9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:09.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4decdf9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38106/0 (socket says 172.21.15.52:38106) 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.911+0000 7f4decdf9700 1 -- 172.21.15.52:0/2477876425 learned_addr learned my addr 172.21.15.52:0/2477876425 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4de7fff700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de8153f80 0x7f4de814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4ded5fa700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8155370 0x7f4de814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 -- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8155370 msgr2=0x7f4de814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8155370 0x7f4de814ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 -- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de8153f80 msgr2=0x7f4de814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de8153f80 0x7f4de814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 -- 172.21.15.52:0/2477876425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0092a0 con 0x7f4de80c5cf0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4decdf9700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4de80668b0 tx=0x7f4ddc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00f7e0 con 0x7f4de80c5cf0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00f940 con 0x7f4de80c5cf0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de80ae270 con 0x7f4de80c5cf0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc01b660 con 0x7f4de80c5cf0 2023-05-10T01:26:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.912+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de814f1b0 con 0x7f4de80c5cf0 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.913+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de8083110 con 0x7f4de80c5cf0 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.914+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ddc02c070 con 0x7f4de80c5cf0 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.914+0000 7f4de4ff9700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 0x7f4dd0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.914+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6491+0+0 (secure 0 0 0) 0x7f4ddc07b690 con 0x7f4de80c5cf0 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.914+0000 7f4de7fff700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 0x7f4dd0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.914+0000 7f4de7fff700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 0x7f4dd0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4de80b0b70 tx=0x7f4dd4009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:09.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:09.918+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ddc04cb40 con 0x7f4de80c5cf0 2023-05-10T01:26:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.092+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4de8047150 con 0x7f4de80c5cf0 2023-05-10T01:26:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.538+0000 7f4de4ff9700 1 -- 172.21.15.52:0/2477876425 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4ddc050160 con 0x7f4de80c5cf0 2023-05-10T01:26:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.541+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 msgr2=0x7f4dd0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.541+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 0x7f4dd0061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4de80b0b70 tx=0x7f4dd4009040).stop 2023-05-10T01:26:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.541+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 msgr2=0x7f4de80b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.541+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4de80668b0 tx=0x7f4ddc017000).stop 2023-05-10T01:26:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 shutdown_connections 2023-05-10T01:26:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4dd005ed90 0x7f4dd0061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4de8155370 0x7f4de814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de80c5cf0 0x7f4de80b0680 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 --2- 172.21.15.52:0/2477876425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4de8153f80 0x7f4de814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.542+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 >> 172.21.15.52:0/2477876425 conn(0x7f4de80cb5f0 msgr2=0x7f4de80c0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.543+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 shutdown_connections 2023-05-10T01:26:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.543+0000 7f4deddfb700 1 -- 172.21.15.52:0/2477876425 wait complete. 2023-05-10T01:26:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:26:10.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:26:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.677+0000 7f90fb047700 1 Processor -- start 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.678+0000 7f90fb047700 1 -- start start 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.678+0000 7f90fb047700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f90f40aa200 0x7f90f40c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.678+0000 7f90fb047700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40ca5f0 con 0x7f90f40c5d20 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.678+0000 7f90fb047700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f41545f0 con 0x7f90f4153a90 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.678+0000 7f90fb047700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40c8820 con 0x7f90f40aa200 2023-05-10T01:26:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f8de3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f90f40c5d20 0x7f90f4069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47130/0 (socket says 172.21.15.52:47130) 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f8de3700 1 -- 172.21.15.52:0/3982531357 learned_addr learned my addr 172.21.15.52:0/3982531357 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827451212 0 0) 0x7f90f40ca5f0 con 0x7f90f40c5d20 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d40033f0 con 0x7f90f40c5d20 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f3fff700 1 --2- 172.21.15.52:0/3982531357 >> v2:172.21.15.172:3300/0 conn(0x7f90f40aa200 0x7f90f40c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1363974602 0 0) 0x7f90d40033f0 con 0x7f90f40c5d20 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 >> v2:172.21.15.172:3300/0 conn(0x7f90f40aa200 msgr2=0x7f90f40c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 --2- 172.21.15.52:0/3982531357 >> v2:172.21.15.172:3300/0 conn(0x7f90f40aa200 0x7f90f40c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 >> v1:172.21.15.172:6789/0 conn(0x7f90f4153a90 legacy=0x7f90f4153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40c8b00 con 0x7f90f40c5d20 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f90ec001470 con 0x7f90f40c5d20 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 >> v1:172.21.15.52:6789/0 conn(0x7f90f40c5d20 legacy=0x7f90f4069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 0x7f90d4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4004690 0x7f90d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d4005000 0x7f90d400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c8820 con 0x7f90d40038e0 2023-05-10T01:26:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d400beb0 con 0x7f90d4004690 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d400c070 con 0x7f90d4005000 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f8de3700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 0x7f90d4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f3fff700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4004690 0x7f90d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.679+0000 7f90f95e4700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d4005000 0x7f90d400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 -- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d4005000 msgr2=0x7f90d400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d4005000 0x7f90d400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 -- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4004690 msgr2=0x7f90d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4004690 0x7f90d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 -- 172.21.15.52:0/3982531357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40033f0 con 0x7f90d40038e0 2023-05-10T01:26:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f95e4700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d4005000 0x7f90d400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f95e4700 1 -- 172.21.15.52:0/3982531357 reap_dead start 2023-05-10T01:26:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f8de3700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 0x7f90d4003d00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f90ec00c190 tx=0x7f90ec001e50).ready entity=mon.0 client_cookie=954e505f3bc67ecd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec007a20 con 0x7f90d40038e0 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec00cac0 con 0x7f90d40038e0 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90f37fe700 1 -- 172.21.15.52:0/3982531357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00ce40 con 0x7f90d40038e0 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 -- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 msgr2=0x7f90d4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 0x7f90d4003d00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f90ec00c190 tx=0x7f90ec001e50).stop 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 -- 172.21.15.52:0/3982531357 shutdown_connections 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 --2- 172.21.15.52:0/3982531357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90d40038e0 0x7f90d4003d00 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 -- 172.21.15.52:0/3982531357 >> 172.21.15.52:0/3982531357 conn(0x7f90f40cb6f0 msgr2=0x7f90f40c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 -- 172.21.15.52:0/3982531357 shutdown_connections 2023-05-10T01:26:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.680+0000 7f90fb047700 1 -- 172.21.15.52:0/3982531357 wait complete. 2023-05-10T01:26:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 Processor -- start 2023-05-10T01:26:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 -- start start 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 0x7f90f40acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 0x7f90f40ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c2630 con 0x7f90f40c1cc0 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40af6c0 con 0x7f90f40abd60 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.682+0000 7f90fb047700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40ad260 con 0x7f90d40038e0 2023-05-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38128/0 (socket says 172.21.15.52:38128) 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 -- 172.21.15.52:0/2390074825 learned_addr learned my addr 172.21.15.52:0/2390074825 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f8de3700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 0x7f90f40acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f3fff700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 0x7f90f40ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 -- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 msgr2=0x7f90f40acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 0x7f90f40acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 -- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 msgr2=0x7f90f40ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 0x7f90f40ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 -- 172.21.15.52:0/2390074825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40aacc0 con 0x7f90f40c1cc0 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f8de3700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 0x7f90f40acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f3fff700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 0x7f90f40ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f95e4700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f90f40837a0 tx=0x7f90dc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc014430 con 0x7f90f40c1cc0 2023-05-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc014590 con 0x7f90f40c1cc0 2023-05-10T01:26:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc014910 con 0x7f90f40c1cc0 2023-05-10T01:26:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f40aafa0 con 0x7f90f40c1cc0 2023-05-10T01:26:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.683+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40ab560 con 0x7f90f40c1cc0 2023-05-10T01:26:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.684+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f4066720 con 0x7f90f40c1cc0 2023-05-10T01:26:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.684+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f90dc01e070 con 0x7f90f40c1cc0 2023-05-10T01:26:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.685+0000 7f90f0ff9700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 0x7f90d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.685+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f90dc078cb0 con 0x7f90f40c1cc0 2023-05-10T01:26:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.685+0000 7f90f8de3700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 0x7f90d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.685+0000 7f90f8de3700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 0x7f90d8061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f90ec001ed0 tx=0x7f90ec015000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.689+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90dc04a170 con 0x7f90f40c1cc0 2023-05-10T01:26:10.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.862+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f90f406c340 con 0x7f90f40c1cc0 2023-05-10T01:26:10.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.866+0000 7f90f0ff9700 1 -- 172.21.15.52:0/2390074825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f90dc01c070 con 0x7f90f40c1cc0 2023-05-10T01:26:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 msgr2=0x7f90d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 0x7f90d8061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f90ec001ed0 tx=0x7f90ec015000).stop 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 msgr2=0x7f90f40c2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f90f40837a0 tx=0x7f90dc009040).stop 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 shutdown_connections 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f90d805ed90 0x7f90d8061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f40c1cc0 0x7f90f40c2140 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90d40038e0 0x7f90f40acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 --2- 172.21.15.52:0/2390074825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f40abd60 0x7f90f40ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:10.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 >> 172.21.15.52:0/2390074825 conn(0x7f90f40cb6f0 msgr2=0x7f90f414f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:10.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 shutdown_connections 2023-05-10T01:26:10.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.868+0000 7f90fb047700 1 -- 172.21.15.52:0/2390074825 wait complete. 2023-05-10T01:26:10.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:26:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.997+0000 7f2261b96700 1 Processor -- start 2023-05-10T01:26:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.997+0000 7f2261b96700 1 -- start start 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.998+0000 7f2261b96700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 0x7f225c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.998+0000 7f2261b96700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.998+0000 7f2261b96700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c158540 con 0x7f225c14e200 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.998+0000 7f2261b96700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c06a460 con 0x7f225c157bd0 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.998+0000 7f2261b96700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c137660 con 0x7f225c068b90 2023-05-10T01:26:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:57770/0 (socket says 172.21.15.52:57770) 2023-05-10T01:26:11.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 -- 172.21.15.52:0/356980484 learned_addr learned my addr 172.21.15.52:0/356980484 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:11.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225affd700 1 --2- 172.21.15.52:0/356980484 >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 0x7f225c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 -- 172.21.15.52:0/356980484 >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 msgr2=0x7f225c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:11.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 --2- 172.21.15.52:0/356980484 >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 0x7f225c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 -- 172.21.15.52:0/356980484 >> v1:172.21.15.172:6789/0 conn(0x7f225c14e200 legacy=0x7f225c14e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 -- 172.21.15.52:0/356980484 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0697e0 con 0x7f225c068b90 2023-05-10T01:26:11.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225affd700 1 --2- 172.21.15.52:0/356980484 >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 0x7f225c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:11.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225bfff700 1 --2- 172.21.15.52:0/356980484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2254009f20 tx=0x7f2254009840).ready entity=mon.2 client_cookie=cc4e9299c3be4eed server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225a7fc700 1 -- 172.21.15.52:0/356980484 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400e070 con 0x7f225c068b90 2023-05-10T01:26:11.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225a7fc700 1 -- 172.21.15.52:0/356980484 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400b9d0 con 0x7f225c068b90 2023-05-10T01:26:11.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:10.999+0000 7f225a7fc700 1 -- 172.21.15.52:0/356980484 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400bd50 con 0x7f225c068b90 2023-05-10T01:26:11.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 -- 172.21.15.52:0/356980484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 msgr2=0x7f225c068fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 --2- 172.21.15.52:0/356980484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2254009f20 tx=0x7f2254009840).stop 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 -- 172.21.15.52:0/356980484 shutdown_connections 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 --2- 172.21.15.52:0/356980484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c068fc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 --2- 172.21.15.52:0/356980484 >> v2:172.21.15.172:3300/0 conn(0x7f225c157bd0 0x7f225c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 -- 172.21.15.52:0/356980484 >> 172.21.15.52:0/356980484 conn(0x7f225c0c45f0 msgr2=0x7f225c066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:11.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 -- 172.21.15.52:0/356980484 shutdown_connections 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.000+0000 7f2261b96700 1 -- 172.21.15.52:0/356980484 wait complete. 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.001+0000 7f2261b96700 1 Processor -- start 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.001+0000 7f2261b96700 1 -- start start 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c157bd0 0x7f225c137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0ac1e0 con 0x7f225c14e200 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0ab5d0 con 0x7f225c157bd0 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f2261b96700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0ab8b0 con 0x7f225c068b90 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38138/0 (socket says 172.21.15.52:38138) 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 -- 172.21.15.52:0/1878089517 learned_addr learned my addr 172.21.15.52:0/1878089517 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225b7fe700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225bfff700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c157bd0 0x7f225c137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 -- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 msgr2=0x7f225c0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 -- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c157bd0 msgr2=0x7f225c137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c157bd0 0x7f225c137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 -- 172.21.15.52:0/1878089517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500092a0 con 0x7f225c14e200 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225b7fe700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.002+0000 7f225affd700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f225000ea20 tx=0x7f2250009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.003+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000c850 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.003+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225000c9b0 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.003+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254009ae0 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.003+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000cd30 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.003+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0abef0 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.004+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c0ac350 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.004+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2250022070 con 0x7f225c14e200 2023-05-10T01:26:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.004+0000 7f22437fe700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 0x7f223c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.004+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f2250079fe0 con 0x7f225c14e200 2023-05-10T01:26:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.005+0000 7f225b7fe700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 0x7f223c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.005+0000 7f225b7fe700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 0x7f223c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f224c001690 tx=0x7f224c009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.008+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f225004b5b0 con 0x7f225c14e200 2023-05-10T01:26:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.195+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f225c14dfe0 con 0x7f225c14e200 2023-05-10T01:26:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.199+0000 7f22437fe700 1 -- 172.21.15.52:0/1878089517 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f225004ebd0 con 0x7f225c14e200 2023-05-10T01:26:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 msgr2=0x7f223c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 0x7f223c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f224c001690 tx=0x7f224c009040).stop 2023-05-10T01:26:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 msgr2=0x7f225c156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f225000ea20 tx=0x7f2250009060).stop 2023-05-10T01:26:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 shutdown_connections 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f223c05ed90 0x7f223c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c157bd0 0x7f225c137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225c068b90 0x7f225c0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 --2- 172.21.15.52:0/1878089517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f225c14e200 0x7f225c156ba0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 >> 172.21.15.52:0/1878089517 conn(0x7f225c0c45f0 msgr2=0x7f225c0c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 shutdown_connections 2023-05-10T01:26:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.201+0000 7f2261b96700 1 -- 172.21.15.52:0/1878089517 wait complete. 2023-05-10T01:26:11.216 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-05-10T01:26:11.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.329+0000 7fce5afcb700 1 Processor -- start 2023-05-10T01:26:11.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.329+0000 7fce5afcb700 1 -- start start 2023-05-10T01:26:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce5afcb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce540c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce5afcb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce54069da0 0x7fce540c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce5afcb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540c0650 con 0x7fce54154540 2023-05-10T01:26:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce5afcb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540c1af0 con 0x7fce54069da0 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce5afcb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540bfd20 con 0x7fce54154160 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce59568700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce54069da0 0x7fce540c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce53fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce54154540 0x7fce54069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47164/0 (socket says 172.21.15.52:47164) 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce53fff700 1 -- 172.21.15.52:0/1204826711 learned_addr learned my addr 172.21.15.52:0/1204826711 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce58d67700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce540c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce59568700 1 -- 172.21.15.52:0/1204826711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 msgr2=0x7fce540c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce59568700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce540c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce59568700 1 -- 172.21.15.52:0/1204826711 >> v1:172.21.15.52:6789/0 conn(0x7fce54154540 legacy=0x7fce54069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce537fe700 1 -- 172.21.15.52:0/1204826711 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670732420 0 0) 0x7fce540c0650 con 0x7fce54154540 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.330+0000 7fce59568700 1 -- 172.21.15.52:0/1204826711 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540c0000 con 0x7fce54069da0 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce59568700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54069da0 0x7fce540c6150 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fce3c009760 tx=0x7fce3c009060).ready entity=mon.0 client_cookie=5d17ee5927e41876 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce537fe700 1 -- 172.21.15.52:0/1204826711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00b580 con 0x7fce54069da0 2023-05-10T01:26:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce537fe700 1 -- 172.21.15.52:0/1204826711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00b6e0 con 0x7fce54069da0 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce537fe700 1 -- 172.21.15.52:0/1204826711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00ba60 con 0x7fce54069da0 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 -- 172.21.15.52:0/1204826711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54069da0 msgr2=0x7fce540c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54069da0 0x7fce540c6150 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fce3c009760 tx=0x7fce3c009060).stop 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 -- 172.21.15.52:0/1204826711 shutdown_connections 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54069da0 0x7fce540c6150 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1204826711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce540c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 -- 172.21.15.52:0/1204826711 >> 172.21.15.52:0/1204826711 conn(0x7fce540cb740 msgr2=0x7fce540c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 -- 172.21.15.52:0/1204826711 shutdown_connections 2023-05-10T01:26:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.331+0000 7fce5afcb700 1 -- 172.21.15.52:0/1204826711 wait complete. 2023-05-10T01:26:11.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.332+0000 7fce5afcb700 1 Processor -- start 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 -- start start 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce54069da0 0x7fce540adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce541509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54150ee0 con 0x7fce54154540 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54165500 con 0x7fce54069da0 2023-05-10T01:26:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce5afcb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540c4b00 con 0x7fce54154160 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce59568700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce59568700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38154/0 (socket says 172.21.15.52:38154) 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.333+0000 7fce59568700 1 -- 172.21.15.52:0/1332954389 learned_addr learned my addr 172.21.15.52:0/1332954389 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce53fff700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce541509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 -- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 msgr2=0x7fce541509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce541509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 -- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce54069da0 msgr2=0x7fce540adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce58d67700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce54069da0 0x7fce540adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce54069da0 0x7fce540adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 -- 172.21.15.52:0/1332954389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0092a0 con 0x7fce54154540 2023-05-10T01:26:11.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce59568700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fce3c011000 tx=0x7fce3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00ba60 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00bea0 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce540c31e0 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c01b620 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.334+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce540c37a0 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.335+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce540666b0 con 0x7fce54154540 2023-05-10T01:26:11.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.335+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fce3c00f070 con 0x7fce54154540 2023-05-10T01:26:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.336+0000 7fce50ff9700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 0x7fce38061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.336+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7fce3c07b8a0 con 0x7fce54154540 2023-05-10T01:26:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.336+0000 7fce58d67700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 0x7fce38061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.336+0000 7fce58d67700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 0x7fce38061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fce4c006fd0 tx=0x7fce4c008040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.340+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce3c04cef0 con 0x7fce54154540 2023-05-10T01:26:11.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.581+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fce5406c340 con 0x7fce54154540 2023-05-10T01:26:11.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.596+0000 7fce50ff9700 1 -- 172.21.15.52:0/1332954389 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v616) v1 ==== 148+0+0 (secure 0 0 0) 0x7fce3c028020 con 0x7fce54154540 2023-05-10T01:26:11.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 msgr2=0x7fce38061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 0x7fce38061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fce4c006fd0 tx=0x7fce4c008040).stop 2023-05-10T01:26:11.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 msgr2=0x7fce54165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7fce3c011000 tx=0x7fce3c017000).stop 2023-05-10T01:26:11.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 shutdown_connections 2023-05-10T01:26:11.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fce3805ed90 0x7fce38061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce54154540 0x7fce54165010 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce54069da0 0x7fce540adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 --2- 172.21.15.52:0/1332954389 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce54154160 0x7fce541509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 >> 172.21.15.52:0/1332954389 conn(0x7fce540cb740 msgr2=0x7fce54154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:11.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 shutdown_connections 2023-05-10T01:26:11.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.598+0000 7fce5afcb700 1 -- 172.21.15.52:0/1332954389 wait complete. 2023-05-10T01:26:11.614 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-05-10T01:26:11.615 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-05-10T01:26:11.615 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:26:11.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-05-10T01:26:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.730+0000 7f4d3fdfa700 1 Processor -- start 2023-05-10T01:26:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.730+0000 7f4d3fdfa700 1 -- start start 2023-05-10T01:26:11.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3fdfa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3814e1f0 0x7f4d3814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3fdfa700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d38066e40 0x7f4d38157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3fdfa700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380683c0 con 0x7f4d380672a0 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3fdfa700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d38137460 con 0x7f4d38066e40 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3fdfa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c3510 con 0x7f4d3814e1f0 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d38066e40 0x7f4d38157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d38066e40 0x7f4d38157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38160/0 (socket says 172.21.15.52:38160) 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 -- 172.21.15.52:0/1193891022 learned_addr learned my addr 172.21.15.52:0/1193891022 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3db96700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3814e1f0 0x7f4d3814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 -- 172.21.15.52:0/1193891022 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3814e1f0 msgr2=0x7f4d3814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3814e1f0 0x7f4d3814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 -- 172.21.15.52:0/1193891022 >> v1:172.21.15.172:6789/0 conn(0x7f4d380672a0 legacy=0x7f4d38154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 -- 172.21.15.52:0/1193891022 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380be050 con 0x7f4d38066e40 2023-05-10T01:26:11.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3d395700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38157a40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f4d2c009f50 tx=0x7f4d2c009840).ready entity=mon.0 client_cookie=973354de7946ca74 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.731+0000 7f4d3cb94700 1 -- 172.21.15.52:0/1193891022 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00e070 con 0x7f4d38066e40 2023-05-10T01:26:11.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3cb94700 1 -- 172.21.15.52:0/1193891022 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00b9c0 con 0x7f4d38066e40 2023-05-10T01:26:11.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3cb94700 1 -- 172.21.15.52:0/1193891022 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00bd40 con 0x7f4d38066e40 2023-05-10T01:26:11.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/1193891022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 msgr2=0x7f4d38157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38157a40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f4d2c009f50 tx=0x7f4d2c009840).stop 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/1193891022 shutdown_connections 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3814e1f0 0x7f4d3814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/1193891022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38157a40 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/1193891022 >> 172.21.15.52:0/1193891022 conn(0x7f4d380c7bb0 msgr2=0x7f4d380c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:11.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/1193891022 shutdown_connections 2023-05-10T01:26:11.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.732+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/1193891022 wait complete. 2023-05-10T01:26:11.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.733+0000 7f4d3fdfa700 1 Processor -- start 2023-05-10T01:26:11.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.733+0000 7f4d3fdfa700 1 -- start start 2023-05-10T01:26:11.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d380672a0 0x7f4d38139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3814e1f0 0x7f4d38139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3813a4e0 con 0x7f4d38066e40 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380aca80 con 0x7f4d3814e1f0 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3fdfa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d381375a0 con 0x7f4d380672a0 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38162/0 (socket says 172.21.15.52:38162) 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 -- 172.21.15.52:0/3363047210 learned_addr learned my addr 172.21.15.52:0/3363047210 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3e397700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3814e1f0 0x7f4d38139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3d395700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d380672a0 0x7f4d38139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 -- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d380672a0 msgr2=0x7f4d38139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d380672a0 0x7f4d38139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 -- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3814e1f0 msgr2=0x7f4d38139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3814e1f0 0x7f4d38139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:11.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.734+0000 7f4d3db96700 1 -- 172.21.15.52:0/3363047210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009ae0 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d3db96700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f4d3000e950 tx=0x7f4d30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30009530 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30012600 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d38137840 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30012980 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.735+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380ac540 con 0x7f4d38066e40 2023-05-10T01:26:11.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.736+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380c1d30 con 0x7f4d38066e40 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.736+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4d30022070 con 0x7f4d38066e40 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.737+0000 7f4d35ffb700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 0x7f4d18061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.737+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f4d30079fa0 con 0x7f4d38066e40 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.737+0000 7f4d3d395700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 0x7f4d18061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.738+0000 7f4d3d395700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 0x7f4d18061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4d2c009f50 tx=0x7f4d38158a20).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:11.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.741+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d3004b460 con 0x7f4d38066e40 2023-05-10T01:26:11.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:11.981+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f4d3806c340 con 0x7f4d38066e40 2023-05-10T01:26:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.597+0000 7f4d35ffb700 1 -- 172.21.15.52:0/3363047210 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v617) v1 ==== 177+0+0 (secure 0 0 0) 0x7f4d3004ea80 con 0x7f4d38066e40 2023-05-10T01:26:12.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.599+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 msgr2=0x7f4d18061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.599+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 0x7f4d18061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4d2c009f50 tx=0x7f4d38158a20).stop 2023-05-10T01:26:12.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.599+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 msgr2=0x7f4d38136ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.599+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f4d3000e950 tx=0x7f4d30009060).stop 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 shutdown_connections 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f4d1805ed90 0x7f4d18061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3814e1f0 0x7f4d38139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d38066e40 0x7f4d38136ae0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 --2- 172.21.15.52:0/3363047210 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d380672a0 0x7f4d38139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 >> 172.21.15.52:0/3363047210 conn(0x7f4d380c7bb0 msgr2=0x7f4d380a6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 shutdown_connections 2023-05-10T01:26:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.600+0000 7f4d3fdfa700 1 -- 172.21.15.52:0/3363047210 wait complete. 2023-05-10T01:26:12.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:26:12.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.738+0000 7f29e4249700 1 Processor -- start 2023-05-10T01:26:12.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.738+0000 7f29e4249700 1 -- start start 2023-05-10T01:26:12.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e4249700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29dc0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e4249700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0ca5f0 con 0x7f29dc0c6100 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e4249700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc154630 con 0x7f29dc153a90 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e4249700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c8820 con 0x7f29dc0c5d20 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e17e4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f29dc0c6100 0x7f29dc069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47190/0 (socket says 172.21.15.52:47190) 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e17e4700 1 -- 172.21.15.52:0/769314385 learned_addr learned my addr 172.21.15.52:0/769314385 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29dc0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881486064 0 0) 0x7f29dc0ca5f0 con 0x7f29dc0c6100 2023-05-10T01:26:12.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c40033f0 con 0x7f29dc0c6100 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870362769 0 0) 0x7f29c40033f0 con 0x7f29dc0c6100 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 msgr2=0x7f29dc0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29dc0aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 >> v1:172.21.15.172:6789/0 conn(0x7f29dc153a90 legacy=0x7f29dc153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0c8b00 con 0x7f29dc0c6100 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f29cc001470 con 0x7f29dc0c6100 2023-05-10T01:26:12.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 >> v1:172.21.15.52:6789/0 conn(0x7f29dc0c6100 legacy=0x7f29dc069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c4003910 0x7f29c4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4004b80 0x7f29c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c8820 con 0x7f29c4003910 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c400b8e0 con 0x7f29c4004b80 2023-05-10T01:26:12.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c400ba50 con 0x7f29dc0c5d20 2023-05-10T01:26:12.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.739+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c4003910 0x7f29c4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e17e4700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e27e6700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4004b80 0x7f29c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 -- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 msgr2=0x7f29c4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:12.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0c5d20 0x7f29c4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 -- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4004b80 msgr2=0x7f29c4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4004b80 0x7f29c4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 -- 172.21.15.52:0/769314385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40033f0 con 0x7f29c4003910 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c4003910 0x7f29c4003cf0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f29d400e210 tx=0x7f29d400b040).ready entity=mon.0 client_cookie=e2ca0a48f1adcd38 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4009ac0 con 0x7f29c4003910 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400f040 con 0x7f29c4003910 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.740+0000 7f29e0fe3700 1 -- 172.21.15.52:0/769314385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400ec70 con 0x7f29c4003910 2023-05-10T01:26:12.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 -- 172.21.15.52:0/769314385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c4003910 msgr2=0x7f29c4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 --2- 172.21.15.52:0/769314385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c4003910 0x7f29c4003cf0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f29d400e210 tx=0x7f29d400b040).stop 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e27e6700 1 -- 172.21.15.52:0/769314385 reap_dead start 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 -- 172.21.15.52:0/769314385 shutdown_connections 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 -- 172.21.15.52:0/769314385 >> 172.21.15.52:0/769314385 conn(0x7f29dc0cb6f0 msgr2=0x7f29dc0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 -- 172.21.15.52:0/769314385 shutdown_connections 2023-05-10T01:26:12.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.741+0000 7f29e4249700 1 -- 172.21.15.52:0/769314385 wait complete. 2023-05-10T01:26:12.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.742+0000 7f29e4249700 1 Processor -- start 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.742+0000 7f29e4249700 1 -- start start 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 0x7f29dc0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0ad180 0x7f29dc0ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c3c50 con 0x7f29dc167f20 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc168ec0 con 0x7f29c4003910 2023-05-10T01:26:12.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1683a0 con 0x7f29dc0ad180 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38184/0 (socket says 172.21.15.52:38184) 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 -- 172.21.15.52:0/1865135289 learned_addr learned my addr 172.21.15.52:0/1865135289 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e27e6700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0ad180 0x7f29dc0ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 0x7f29dc0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 -- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0ad180 msgr2=0x7f29dc0ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0ad180 0x7f29dc0ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 -- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 msgr2=0x7f29dc0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 0x7f29dc0adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 -- 172.21.15.52:0/1865135289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0c1e60 con 0x7f29dc167f20 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 0x7f29dc0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e17e4700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f29cc004a10 tx=0x7f29cc001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc001470 con 0x7f29dc167f20 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00f870 con 0x7f29dc167f20 2023-05-10T01:26:12.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc168620 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00fc10 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.743+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc168be0 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.744+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc066720 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.745+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f29cc015410 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.745+0000 7f29c9ffb700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 0x7f29bc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.745+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f29cc079ff0 con 0x7f29dc167f20 2023-05-10T01:26:12.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.745+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 0x7f29bc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:12.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.746+0000 7f29e1fe5700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 0x7f29bc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f29d400afd0 tx=0x7f29d401a000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:12.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.749+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29cc04b560 con 0x7f29dc167f20 2023-05-10T01:26:12.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.926+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f29dc0c1ca0 con 0x7f29dc167f20 2023-05-10T01:26:12.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.929+0000 7f29c9ffb700 1 -- 172.21.15.52:0/1865135289 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f29cc04eb80 con 0x7f29dc167f20 2023-05-10T01:26:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 msgr2=0x7f29bc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 0x7f29bc061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f29d400afd0 tx=0x7f29d401a000).stop 2023-05-10T01:26:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 msgr2=0x7f29dc0acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f29cc004a10 tx=0x7f29cc001e70).stop 2023-05-10T01:26:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 shutdown_connections 2023-05-10T01:26:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f29bc05ed90 0x7f29bc061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29dc0ad180 0x7f29dc0ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4003910 0x7f29dc0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 --2- 172.21.15.52:0/1865135289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29dc167f20 0x7f29dc0acc90 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.931+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 >> 172.21.15.52:0/1865135289 conn(0x7f29dc0cb6f0 msgr2=0x7f29dc0aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.932+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 shutdown_connections 2023-05-10T01:26:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:12.932+0000 7f29e4249700 1 -- 172.21.15.52:0/1865135289 wait complete. 2023-05-10T01:26:12.947 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:26:12.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:12.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:13.008 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:26:13.009 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:26:13.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.130+0000 7fd1e759e700 1 Processor -- start 2023-05-10T01:26:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.130+0000 7fd1e759e700 1 -- start start 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1e80c76d0 0x7fd1e80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e759e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e81588f0 con 0x7fd1e8153f20 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e8157ce0 con 0x7fd1e80a9b60 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e8157fc0 con 0x7fd1e80c76d0 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd1e8153f20 0x7fd1e80c0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47210/0 (socket says 172.21.15.52:47210) 2023-05-10T01:26:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/669227821 learned_addr learned my addr 172.21.15.52:0/669227821 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e659c700 1 --2- 172.21.15.52:0/669227821 >> v2:172.21.15.172:3300/0 conn(0x7fd1e80c76d0 0x7fd1e80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436322283 0 0) 0x7fd1e81588f0 con 0x7fd1e8153f20 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c80033f0 con 0x7fd1e8153f20 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156460859 0 0) 0x7fd1e8157ce0 con 0x7fd1e80a9b60 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e81588f0 con 0x7fd1e80a9b60 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542747691 0 0) 0x7fd1c80033f0 con 0x7fd1e8153f20 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 >> v2:172.21.15.172:3300/0 conn(0x7fd1e80c76d0 msgr2=0x7fd1e80c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 --2- 172.21.15.52:0/669227821 >> v2:172.21.15.172:3300/0 conn(0x7fd1e80c76d0 0x7fd1e80c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 >> v1:172.21.15.172:6789/0 conn(0x7fd1e80a9b60 legacy=0x7fd1e8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.131+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e81582a0 con 0x7fd1e8153f20 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd1d8001470 con 0x7fd1e8153f20 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 >> v1:172.21.15.52:6789/0 conn(0x7fd1e8153f20 legacy=0x7fd1e80c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8003ac0 0x7fd1c8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1c8004690 0x7fd1c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 0x7fd1c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8157fc0 con 0x7fd1c8005000 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800bf60 con 0x7fd1c8003ac0 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c120 con 0x7fd1c8004690 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 0x7fd1c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e659c700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8003ac0 0x7fd1c8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e5d9b700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1c8004690 0x7fd1c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1c8004690 msgr2=0x7fd1c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1c8004690 0x7fd1c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8003ac0 msgr2=0x7fd1c8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8003ac0 0x7fd1c8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/669227821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80033f0 con 0x7fd1c8005000 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/669227821 reap_dead start 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 0x7fd1c800b8e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd1d8007f60 tx=0x7fd1d8001d40).ready entity=mon.0 client_cookie=516f4e41ff39bf35 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800c980 con 0x7fd1c8005000 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800cae0 con 0x7fd1c8005000 2023-05-10T01:26:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.132+0000 7fd1e559a700 1 -- 172.21.15.52:0/669227821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800cea0 con 0x7fd1c8005000 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 -- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 msgr2=0x7fd1c800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 0x7fd1c800b8e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd1d8007f60 tx=0x7fd1d8001d40).stop 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 -- 172.21.15.52:0/669227821 shutdown_connections 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 --2- 172.21.15.52:0/669227821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1c8005000 0x7fd1c800b8e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 -- 172.21.15.52:0/669227821 >> 172.21.15.52:0/669227821 conn(0x7fd1e8068320 msgr2=0x7fd1e8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 -- 172.21.15.52:0/669227821 shutdown_connections 2023-05-10T01:26:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.133+0000 7fd1e759e700 1 -- 172.21.15.52:0/669227821 wait complete. 2023-05-10T01:26:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.134+0000 7fd1e759e700 1 Processor -- start 2023-05-10T01:26:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.134+0000 7fd1e759e700 1 -- start start 2023-05-10T01:26:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8005000 0x7fd1e8145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1e80bff80 0x7fd1e80c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81561f0 con 0x7fd1e814c7b0 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80c08f0 con 0x7fd1c8005000 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8145c10 con 0x7fd1e80bff80 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38206/0 (socket says 172.21.15.52:38206) 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/3715384038 learned_addr learned my addr 172.21.15.52:0/3715384038 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e659c700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8005000 0x7fd1e8145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e5d9b700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1e80bff80 0x7fd1e80c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1e80bff80 msgr2=0x7fd1e80c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1e80bff80 0x7fd1e80c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8005000 msgr2=0x7fd1e8145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8005000 0x7fd1e8145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 -- 172.21.15.52:0/3715384038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8155380 con 0x7fd1e814c7b0 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e6d9d700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fd1d800c6a0 tx=0x7fd1d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8001d40 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d80046b0 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8004a70 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.135+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e8155620 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.136+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8155ba0 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.136+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8047150 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.137+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd1d8010070 con 0x7fd1e814c7b0 2023-05-10T01:26:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.137+0000 7fd1de7fc700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 0x7fd1cc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.137+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6077+0+0 (secure 0 0 0) 0x7fd1d807aab0 con 0x7fd1e814c7b0 2023-05-10T01:26:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.137+0000 7fd1e659c700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 0x7fd1cc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.138+0000 7fd1e659c700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 0x7fd1cc061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd1e0006d80 tx=0x7fd1e0009060).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.141+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1d804bf70 con 0x7fd1e814c7b0 2023-05-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.358+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1e8158580 con 0x7fd1e814c7b0 2023-05-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.358+0000 7fd1de7fc700 1 -- 172.21.15.52:0/3715384038 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fd1d8025020 con 0x7fd1e814c7b0 2023-05-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/746876914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":746876914},{"type":"v1","addr":"172.21.15.172:6836","nonce":746876914}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2738017977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2738017977},{"type":"v1","addr":"172.21.15.52:6835","nonce":2738017977}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/359494770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":359494770},{"type":"v1","addr":"172.21.15.172:6837","nonce":359494770}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/543789361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":543789361},{"type":"v1","addr":"172.21.15.52:6834","nonce":543789361}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-05-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 msgr2=0x7fd1cc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 0x7fd1cc061220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd1e0006d80 tx=0x7fd1e0009060).stop 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 msgr2=0x7fd1e814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fd1d800c6a0 tx=0x7fd1d8015000).stop 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 shutdown_connections 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd1cc05ed60 0x7fd1cc061220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e814c7b0 0x7fd1e814cc30 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1c8005000 0x7fd1e8145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 --2- 172.21.15.52:0/3715384038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1e80bff80 0x7fd1e80c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 >> 172.21.15.52:0/3715384038 conn(0x7fd1e8068320 msgr2=0x7fd1e8147350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 shutdown_connections 2023-05-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.360+0000 7fd1e759e700 1 -- 172.21.15.52:0/3715384038 wait complete. 2023-05-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 48 2023-05-10T01:26:13.376 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:26:13.377 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:26:13.377 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:26:13.377 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:13.378 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:26:13.378 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:26:13.378 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:26:13.378 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:13.378 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:26:13.379 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:26:13.379 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:26:13.379 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:13.379 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:26:13.379 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:26:13.380 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:26:13.380 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:13.386 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:26:13.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:26:13.387 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:26:13.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:26:13.389 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:26:13.390 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:26:13.391 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:26:13.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:26:13.428 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:26:13.429 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:13.430 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:26:13.430 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:13.432 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:26:13.432 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:13.438 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:26:13.438 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:13.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:26:13.503 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:26:13.503 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:26:13.514 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:26:13.515 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.558+0000 7f29bf101700 1 Processor -- start 2023-05-10T01:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.558+0000 7f29bf101700 1 -- start start 2023-05-10T01:26:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bf101700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29b8069740 0x7f29b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bf101700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b8153af0 0x7f29b8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bf101700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b806a910 con 0x7f29b80aab30 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bf101700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b80c65e0 con 0x7f29b8153af0 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bf101700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b80bfa20 con 0x7f29b8069740 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b8153af0 0x7f29b8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29b8153af0 0x7f29b8153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38240/0 (socket says 172.21.15.52:38240) 2023-05-10T01:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 -- 172.21.15.52:0/489227752 learned_addr learned my addr 172.21.15.52:0/489227752 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be0ff700 1 --2- 172.21.15.52:0/489227752 >> v2:172.21.15.172:3300/0 conn(0x7f29b8069740 0x7f29b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 -- 172.21.15.52:0/489227752 >> v2:172.21.15.172:3300/0 conn(0x7f29b8069740 msgr2=0x7f29b8069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 --2- 172.21.15.52:0/489227752 >> v2:172.21.15.172:3300/0 conn(0x7f29b8069740 0x7f29b8069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 -- 172.21.15.52:0/489227752 >> v1:172.21.15.172:6789/0 conn(0x7f29b80aab30 legacy=0x7f29b80c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 -- 172.21.15.52:0/489227752 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80bfc70 con 0x7f29b8153af0 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29be900700 1 --2- 172.21.15.52:0/489227752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8153af0 0x7f29b8153f20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f29b80c74c0 tx=0x7f29b0009840).ready entity=mon.0 client_cookie=74ea65f03ded4931 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bd0fd700 1 -- 172.21.15.52:0/489227752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000e070 con 0x7f29b8153af0 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bd0fd700 1 -- 172.21.15.52:0/489227752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b000ba10 con 0x7f29b8153af0 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.559+0000 7f29bd0fd700 1 -- 172.21.15.52:0/489227752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000bd90 con 0x7f29b8153af0 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 -- 172.21.15.52:0/489227752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8153af0 msgr2=0x7f29b8153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 --2- 172.21.15.52:0/489227752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8153af0 0x7f29b8153f20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f29b80c74c0 tx=0x7f29b0009840).stop 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 -- 172.21.15.52:0/489227752 shutdown_connections 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 --2- 172.21.15.52:0/489227752 >> v2:172.21.15.172:3300/0 conn(0x7f29b8069740 0x7f29b8069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 --2- 172.21.15.52:0/489227752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8153af0 0x7f29b8153f20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 -- 172.21.15.52:0/489227752 >> 172.21.15.52:0/489227752 conn(0x7f29b80cb540 msgr2=0x7f29b80c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 -- 172.21.15.52:0/489227752 shutdown_connections 2023-05-10T01:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.560+0000 7f29bf101700 1 -- 172.21.15.52:0/489227752 wait complete. 2023-05-10T01:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.561+0000 7f29bf101700 1 Processor -- start 2023-05-10T01:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.561+0000 7f29bf101700 1 -- start start 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b80aab30 0x7f29b814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29b8153af0 0x7f29b814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80ae480 con 0x7f29b8069740 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80ae6d0 con 0x7f29b80aab30 2023-05-10T01:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bf101700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80ae9b0 con 0x7f29b8153af0 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38244/0 (socket says 172.21.15.52:38244) 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 -- 172.21.15.52:0/1857687748 learned_addr learned my addr 172.21.15.52:0/1857687748 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29bd8fe700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b80aab30 0x7f29b814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be900700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29b8153af0 0x7f29b814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 -- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29b8153af0 msgr2=0x7f29b814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29b8153af0 0x7f29b814ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 -- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b80aab30 msgr2=0x7f29b814d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b80aab30 0x7f29b814d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 -- 172.21.15.52:0/1857687748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0009ae0 con 0x7f29b8069740 2023-05-10T01:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.562+0000 7f29be0ff700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f29b400c850 tx=0x7f29b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4010580 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40106e0 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b80aec90 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4010a60 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b80af250 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.563+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b8083030 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.564+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f29b401b460 con 0x7f29b8069740 2023-05-10T01:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.564+0000 7f29a67fc700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 0x7f2998061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.564+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f29b4079a40 con 0x7f29b8069740 2023-05-10T01:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.564+0000 7f29bd8fe700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 0x7f2998061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.565+0000 7f29bd8fe700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 0x7f2998061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f29b80ca6a0 tx=0x7f29a8007d20).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.568+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29b404afc0 con 0x7f29b8069740 2023-05-10T01:26:13.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:13.759+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f29b80af470 con 0x7f29b8069740 2023-05-10T01:26:14.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.603+0000 7f29a67fc700 1 -- 172.21.15.52:0/1857687748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7f29b404e5e0 con 0x7f29b8069740 2023-05-10T01:26:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 msgr2=0x7f2998061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 0x7f2998061280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f29b80ca6a0 tx=0x7f29a8007d20).stop 2023-05-10T01:26:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 msgr2=0x7f29b80af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f29b400c850 tx=0x7f29b4008040).stop 2023-05-10T01:26:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 shutdown_connections 2023-05-10T01:26:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f299805edc0 0x7f2998061280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29b8153af0 0x7f29b814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b8069740 0x7f29b80af770 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 --2- 172.21.15.52:0/1857687748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b80aab30 0x7f29b814d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 >> 172.21.15.52:0/1857687748 conn(0x7f29b80cb540 msgr2=0x7f29b8150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 shutdown_connections 2023-05-10T01:26:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.606+0000 7f29bf101700 1 -- 172.21.15.52:0/1857687748 wait complete. 2023-05-10T01:26:14.612 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:26:14.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:26:14.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.743+0000 7f75c42d9700 1 Processor -- start 2023-05-10T01:26:14.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.743+0000 7f75c42d9700 1 -- start start 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75bc154030 0x7f75bc069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 0x7f75bc062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75bc063710 0x7f75bc063ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc154410 con 0x7f75bc063710 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc062950 con 0x7f75bc154030 2023-05-10T01:26:14.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c42d9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc069fa0 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75bc063710 0x7f75bc063ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75bc063710 0x7f75bc063ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38254/0 (socket says 172.21.15.52:38254) 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 -- 172.21.15.52:0/1176186003 learned_addr learned my addr 172.21.15.52:0/1176186003 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c1874700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 0x7f75bc062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 -- 172.21.15.52:0/1176186003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 msgr2=0x7f75bc062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2075700 1 --2- 172.21.15.52:0/1176186003 >> v2:172.21.15.172:3300/0 conn(0x7f75bc154030 0x7f75bc069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 0x7f75bc062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 -- 172.21.15.52:0/1176186003 >> v2:172.21.15.172:3300/0 conn(0x7f75bc154030 msgr2=0x7f75bc069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 --2- 172.21.15.52:0/1176186003 >> v2:172.21.15.172:3300/0 conn(0x7f75bc154030 0x7f75bc069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c2876700 1 -- 172.21.15.52:0/1176186003 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc064090 con 0x7f75bc063710 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.744+0000 7f75c1874700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 0x7f75bc062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c2876700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc063710 0x7f75bc063ba0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f75bc0c89a0 tx=0x7f75ac009840).ready entity=mon.0 client_cookie=49bd6fb440ecb844 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c1073700 1 -- 172.21.15.52:0/1176186003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00e070 con 0x7f75bc063710 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c1073700 1 -- 172.21.15.52:0/1176186003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00ba50 con 0x7f75bc063710 2023-05-10T01:26:14.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c1073700 1 -- 172.21.15.52:0/1176186003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00bdd0 con 0x7f75bc063710 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 -- 172.21.15.52:0/1176186003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc063710 msgr2=0x7f75bc063ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc063710 0x7f75bc063ba0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f75bc0c89a0 tx=0x7f75ac009840).stop 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 -- 172.21.15.52:0/1176186003 shutdown_connections 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc063710 0x7f75bc063ba0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 --2- 172.21.15.52:0/1176186003 >> v2:172.21.15.172:3300/0 conn(0x7f75bc154030 0x7f75bc069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 --2- 172.21.15.52:0/1176186003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0bf4e0 0x7f75bc062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 -- 172.21.15.52:0/1176186003 >> 172.21.15.52:0/1176186003 conn(0x7f75bc0c8a90 msgr2=0x7f75bc0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:14.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 -- 172.21.15.52:0/1176186003 shutdown_connections 2023-05-10T01:26:14.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.745+0000 7f75c42d9700 1 -- 172.21.15.52:0/1176186003 wait complete. 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.746+0000 7f75c42d9700 1 Processor -- start 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.746+0000 7f75c42d9700 1 -- start start 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc063710 0x7f75bc14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc154030 0x7f75bc0be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc14caf0 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc14c5f0 con 0x7f75bc063710 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c42d9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1683d0 con 0x7f75bc154030 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c1874700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c1874700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38264/0 (socket says 172.21.15.52:38264) 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c1874700 1 -- 172.21.15.52:0/530197985 learned_addr learned my addr 172.21.15.52:0/530197985 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c2075700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc063710 0x7f75bc14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.747+0000 7f75c2876700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc154030 0x7f75bc0be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 -- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc154030 msgr2=0x7f75bc0be4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc154030 0x7f75bc0be4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 -- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc063710 msgr2=0x7f75bc14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc063710 0x7f75bc14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 -- 172.21.15.52:0/530197985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009ae0 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c1874700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f75b000c8b0 tx=0x7f75b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:14.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0010580 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b00106e0 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc157380 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0010a60 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.748+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc164330 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.749+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc06c340 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.749+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f75b001b460 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.750+0000 7f75ba7fc700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 0x7f759c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:14.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.750+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f75b00799c0 con 0x7f75bc0bf4e0 2023-05-10T01:26:14.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.750+0000 7f75c2075700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 0x7f759c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:14.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.750+0000 7f75c2075700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 0x7f759c061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f75b400ab30 tx=0x7f75b4008040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:14.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.754+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75b004b040 con 0x7f75bc0bf4e0 2023-05-10T01:26:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.997+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f75bc067150 con 0x7f75bc0bf4e0 2023-05-10T01:26:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.997+0000 7f75ba7fc700 1 -- 172.21.15.52:0/530197985 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f75b004e660 con 0x7f75bc0bf4e0 2023-05-10T01:26:15.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:15.001 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:26:15.003 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:15.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:15.004 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.004 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:15.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:26:15.007 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:26:15.008 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.008 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:26:15.009 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:26:15.010 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.011 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.013 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.014 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:26:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:26:15.017 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.018 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:15.019 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.020 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.020 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.021 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:15.022 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:15.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:26:15.024 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:15.025 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:15.026 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:26:15.027 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:26:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 msgr2=0x7f759c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 0x7f759c061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f75b400ab30 tx=0x7f75b4008040).stop 2023-05-10T01:26:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 msgr2=0x7f75bc167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f75b000c8b0 tx=0x7f75b0008040).stop 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 shutdown_connections 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f759c05ed60 0x7f759c061220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc154030 0x7f75bc0be4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc063710 0x7f75bc14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 --2- 172.21.15.52:0/530197985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75bc0bf4e0 0x7f75bc167ee0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 >> 172.21.15.52:0/530197985 conn(0x7f75bc0c8a90 msgr2=0x7f75bc0c4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:14.999+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 shutdown_connections 2023-05-10T01:26:15.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.000+0000 7f75c42d9700 1 -- 172.21.15.52:0/530197985 wait complete. 2023-05-10T01:26:15.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.144+0000 7f2307011700 1 Processor -- start 2023-05-10T01:26:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.144+0000 7f2307011700 1 -- start start 2023-05-10T01:26:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2307011700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2300154160 0x7f23000c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2307011700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2307011700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000c0650 con 0x7f2300154540 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2307011700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000c1af0 con 0x7f2300154160 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2307011700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000bfd20 con 0x7f2300069da0 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f2304dad700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2300154160 0x7f23000c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f22fffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2300154540 0x7f2300069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47284/0 (socket says 172.21.15.52:47284) 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.145+0000 7f22fffff700 1 -- 172.21.15.52:0/2117921558 learned_addr learned my addr 172.21.15.52:0/2117921558 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f23055ae700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2304dad700 1 -- 172.21.15.52:0/2117921558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 msgr2=0x7f23000c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2304dad700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2304dad700 1 -- 172.21.15.52:0/2117921558 >> v1:172.21.15.52:6789/0 conn(0x7f2300154540 legacy=0x7f2300069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2304dad700 1 -- 172.21.15.52:0/2117921558 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000c0000 con 0x7f2300154160 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f22ff7fe700 1 -- 172.21.15.52:0/2117921558 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188811114 0 0) 0x7f23000c0650 con 0x7f2300154540 2023-05-10T01:26:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2304dad700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23000c5c60 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f22f8009760 tx=0x7f22f8009060).ready entity=mon.0 client_cookie=3598599073df8f8b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f22ff7fe700 1 -- 172.21.15.52:0/2117921558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80090d0 con 0x7f2300154160 2023-05-10T01:26:15.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f22ff7fe700 1 -- 172.21.15.52:0/2117921558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f800b580 con 0x7f2300154160 2023-05-10T01:26:15.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f22ff7fe700 1 -- 172.21.15.52:0/2117921558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f800b900 con 0x7f2300154160 2023-05-10T01:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2307011700 1 -- 172.21.15.52:0/2117921558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 msgr2=0x7f23000c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.146+0000 7f2307011700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23000c5c60 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f22f8009760 tx=0x7f22f8009060).stop 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 -- 172.21.15.52:0/2117921558 shutdown_connections 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 --2- 172.21.15.52:0/2117921558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23000c5c60 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 -- 172.21.15.52:0/2117921558 >> 172.21.15.52:0/2117921558 conn(0x7f23000cb6f0 msgr2=0x7f23000c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 -- 172.21.15.52:0/2117921558 shutdown_connections 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.147+0000 7f2307011700 1 -- 172.21.15.52:0/2117921558 wait complete. 2023-05-10T01:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.148+0000 7f2307011700 1 Processor -- start 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.148+0000 7f2307011700 1 -- start start 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2300154540 0x7f23000c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c38c0 con 0x7f2300154160 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c2cb0 con 0x7f2300154540 2023-05-10T01:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c2f90 con 0x7f2300069da0 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38272/0 (socket says 172.21.15.52:38272) 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 -- 172.21.15.52:0/1369927592 learned_addr learned my addr 172.21.15.52:0/1369927592 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2304dad700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f23055ae700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2300154540 0x7f23000c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 -- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 msgr2=0x7f23000c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 -- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2300154540 msgr2=0x7f23000c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2300154540 0x7f23000c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 -- 172.21.15.52:0/1369927592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80092a0 con 0x7f2300154160 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2304dad700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fffff700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f22f000c790 tx=0x7f22f0001550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0005d30 con 0x7f2300154160 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0005e90 con 0x7f2300154160 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000c3270 con 0x7f2300154160 2023-05-10T01:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0007320 con 0x7f2300154160 2023-05-10T01:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.149+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230014d020 con 0x7f2300154160 2023-05-10T01:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.150+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23000666b0 con 0x7f2300154160 2023-05-10T01:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.151+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f22f0010030 con 0x7f2300154160 2023-05-10T01:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.151+0000 7f22fcff9700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 0x7f22e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.151+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f22f0079de0 con 0x7f2300154160 2023-05-10T01:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.152+0000 7f2304dad700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 0x7f22e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.152+0000 7f2304dad700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 0x7f22e4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f23000c0a90 tx=0x7f22f8017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.155+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22f004b5f0 con 0x7f2300154160 2023-05-10T01:26:15.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.328+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f230006c340 con 0x7f2300154160 2023-05-10T01:26:15.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.329+0000 7f22fcff9700 1 -- 172.21.15.52:0/1369927592 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+14222 (secure 0 0 0) 0x7f22f004ec10 con 0x7f2300154160 2023-05-10T01:26:15.333 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:15.333 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":118,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:14.598938+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:15.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 msgr2=0x7f22e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 0x7f22e4061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f23000c0a90 tx=0x7f22f8017000).stop 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 msgr2=0x7f23001584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f22f000c790 tx=0x7f22f0001550).stop 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 shutdown_connections 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f22e405ed90 0x7f22e4061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2300154540 0x7f23000c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2300069da0 0x7f23000c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 --2- 172.21.15.52:0/1369927592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2300154160 0x7f23001584a0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 >> 172.21.15.52:0/1369927592 conn(0x7f23000cb6f0 msgr2=0x7f23000ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 shutdown_connections 2023-05-10T01:26:15.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.331+0000 7f2307011700 1 -- 172.21.15.52:0/1369927592 wait complete. 2023-05-10T01:26:15.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:26:15.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:26:15.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.463+0000 7f726b59e700 1 Processor -- start 2023-05-10T01:26:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.463+0000 7f726b59e700 1 -- start start 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f726c153f80 0x7f726c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f726c155370 0x7f726c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0c6690 con 0x7f726c0c5cf0 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c069f50 con 0x7f726c153f80 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c06a9d0 con 0x7f726c155370 2023-05-10T01:26:15.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f726c153f80 0x7f726c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f726c153f80 0x7f726c0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38278/0 (socket says 172.21.15.52:38278) 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 -- 172.21.15.52:0/3353764126 learned_addr learned my addr 172.21.15.52:0/3353764126 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726ad9d700 1 --2- 172.21.15.52:0/3353764126 >> v2:172.21.15.172:3300/0 conn(0x7f726c155370 0x7f726c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 -- 172.21.15.52:0/3353764126 >> v2:172.21.15.172:3300/0 conn(0x7f726c155370 msgr2=0x7f726c0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 --2- 172.21.15.52:0/3353764126 >> v2:172.21.15.172:3300/0 conn(0x7f726c155370 0x7f726c0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 -- 172.21.15.52:0/3353764126 >> v1:172.21.15.172:6789/0 conn(0x7f726c0c5cf0 legacy=0x7f726c0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 -- 172.21.15.52:0/3353764126 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c155770 con 0x7f726c153f80 2023-05-10T01:26:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.464+0000 7f726a59c700 1 --2- 172.21.15.52:0/3353764126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0a9d10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f726c0c1b40 tx=0x7f72640090f0).ready entity=mon.0 client_cookie=b05fbc7e7923fa2c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726959a700 1 -- 172.21.15.52:0/3353764126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400b600 con 0x7f726c153f80 2023-05-10T01:26:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726959a700 1 -- 172.21.15.52:0/3353764126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400b760 con 0x7f726c153f80 2023-05-10T01:26:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726959a700 1 -- 172.21.15.52:0/3353764126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400bae0 con 0x7f726c153f80 2023-05-10T01:26:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 -- 172.21.15.52:0/3353764126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 msgr2=0x7f726c0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 --2- 172.21.15.52:0/3353764126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0a9d10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f726c0c1b40 tx=0x7f72640090f0).stop 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 -- 172.21.15.52:0/3353764126 shutdown_connections 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 --2- 172.21.15.52:0/3353764126 >> v2:172.21.15.172:3300/0 conn(0x7f726c155370 0x7f726c0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 --2- 172.21.15.52:0/3353764126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0a9d10 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 -- 172.21.15.52:0/3353764126 >> 172.21.15.52:0/3353764126 conn(0x7f726c0cb5f0 msgr2=0x7f726c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 -- 172.21.15.52:0/3353764126 shutdown_connections 2023-05-10T01:26:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.465+0000 7f726b59e700 1 -- 172.21.15.52:0/3353764126 wait complete. 2023-05-10T01:26:15.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.466+0000 7f726b59e700 1 Processor -- start 2023-05-10T01:26:15.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.466+0000 7f726b59e700 1 -- start start 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f726c0c5cf0 0x7f726c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f726c155370 0x7f726c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0aea30 con 0x7f726c153f80 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c168850 con 0x7f726c155370 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c151200 con 0x7f726c0c5cf0 2023-05-10T01:26:15.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38286/0 (socket says 172.21.15.52:38286) 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 -- 172.21.15.52:0/2082957628 learned_addr learned my addr 172.21.15.52:0/2082957628 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726a59c700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f726c0c5cf0 0x7f726c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f726ad9d700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f726c155370 0x7f726c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 -- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f726c0c5cf0 msgr2=0x7f726c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f726c0c5cf0 0x7f726c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 -- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f726c155370 msgr2=0x7f726c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f726c155370 0x7f726c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.467+0000 7f7269d9b700 1 -- 172.21.15.52:0/2082957628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009370 con 0x7f726c153f80 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f7269d9b700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f725400c7c0 tx=0x7f72540015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254006a20 con 0x7f726c153f80 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254006b80 con 0x7f726c153f80 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0adeb0 con 0x7f726c153f80 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254007020 con 0x7f726c153f80 2023-05-10T01:26:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.468+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c0ae470 con 0x7f726c153f80 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.469+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c083110 con 0x7f726c153f80 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.469+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7254018020 con 0x7f726c153f80 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.469+0000 7f72627fc700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 0x7f7250061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.469+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f7254078c10 con 0x7f726c153f80 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.470+0000 7f726a59c700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 0x7f7250061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.470+0000 7f726a59c700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 0x7f7250061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7264009130 tx=0x7f7264017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.473+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72540488f0 con 0x7f726c153f80 2023-05-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.651+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f726c0c6690 con 0x7f726c153f80 2023-05-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.651+0000 7f72627fc700 1 -- 172.21.15.52:0/2082957628 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v118) v1 ==== 110+0+10 (secure 0 0 0) 0x7f726c0c6690 con 0x7f726c153f80 2023-05-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:26:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 msgr2=0x7f7250061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 0x7f7250061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7264009130 tx=0x7f7264017000).stop 2023-05-10T01:26:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 msgr2=0x7f726c0c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f725400c7c0 tx=0x7f72540015c0).stop 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 shutdown_connections 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f725005ed90 0x7f7250061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f726c155370 0x7f726c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f726c0c5cf0 0x7f726c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 --2- 172.21.15.52:0/2082957628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f726c153f80 0x7f726c0c3520 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 >> 172.21.15.52:0/2082957628 conn(0x7f726c0cb5f0 msgr2=0x7f726c0c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 shutdown_connections 2023-05-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.653+0000 7f726b59e700 1 -- 172.21.15.52:0/2082957628 wait complete. 2023-05-10T01:26:15.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:26:15.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.784+0000 7f751148e700 1 Processor -- start 2023-05-10T01:26:15.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.784+0000 7f751148e700 1 -- start start 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.785+0000 7f751148e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f750c153cf0 0x7f750c063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.785+0000 7f751148e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.785+0000 7f751148e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0bf940 con 0x7f750c1540d0 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.785+0000 7f751148e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c067f50 con 0x7f750c153cf0 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.785+0000 7f751148e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0a7c80 con 0x7f750c0622a0 2023-05-10T01:26:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f750c153cf0 0x7f750c063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f750c153cf0 0x7f750c063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:36616/0 (socket says 172.21.15.52:36616) 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:57930/0 (socket says 172.21.15.52:57930) 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 -- 172.21.15.52:0/1449525583 learned_addr learned my addr 172.21.15.52:0/1449525583 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750a7fc700 1 --1- 172.21.15.52:0/1449525583 >> v1:172.21.15.172:6789/0 conn(0x7f750c1540d0 0x7f750c0bf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:49848/0 (socket says 172.21.15.52:49848) 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 -- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 msgr2=0x7f750c0626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 -- 172.21.15.52:0/1449525583 >> v1:172.21.15.172:6789/0 conn(0x7f750c1540d0 legacy=0x7f750c0bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 -- 172.21.15.52:0/1449525583 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c062bd0 con 0x7f750c153cf0 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750b7fe700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f750affd700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c153cf0 0x7f750c063fa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7504009f20 tx=0x7f7504009840).ready entity=mon.1 client_cookie=d00840225b37975a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f7509ffb700 1 -- 172.21.15.52:0/1449525583 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400e070 con 0x7f750c153cf0 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f7509ffb700 1 -- 172.21.15.52:0/1449525583 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400b9d0 con 0x7f750c153cf0 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.786+0000 7f7509ffb700 1 -- 172.21.15.52:0/1449525583 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400bd50 con 0x7f750c153cf0 2023-05-10T01:26:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 -- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c153cf0 msgr2=0x7f750c063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c153cf0 0x7f750c063fa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7504009f20 tx=0x7f7504009840).stop 2023-05-10T01:26:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 -- 172.21.15.52:0/1449525583 shutdown_connections 2023-05-10T01:26:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c0622a0 0x7f750c0626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 --2- 172.21.15.52:0/1449525583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c153cf0 0x7f750c063fa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 -- 172.21.15.52:0/1449525583 >> 172.21.15.52:0/1449525583 conn(0x7f750c05e810 msgr2=0x7f750c0c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 -- 172.21.15.52:0/1449525583 shutdown_connections 2023-05-10T01:26:15.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.787+0000 7f751148e700 1 -- 172.21.15.52:0/1449525583 wait complete. 2023-05-10T01:26:15.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.788+0000 7f751148e700 1 Processor -- start 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.788+0000 7f751148e700 1 -- start start 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c0622a0 0x7f750c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c153cf0 0x7f750c0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0bfb20 con 0x7f750c1540d0 2023-05-10T01:26:15.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0ae170 con 0x7f750c0622a0 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f751148e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0ae450 con 0x7f750c153cf0 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38300/0 (socket says 172.21.15.52:38300) 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 -- 172.21.15.52:0/1420448195 learned_addr learned my addr 172.21.15.52:0/1420448195 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750affd700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c0622a0 0x7f750c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750a7fc700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c153cf0 0x7f750c0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 -- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c153cf0 msgr2=0x7f750c0c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c153cf0 0x7f750c0c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 -- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c0622a0 msgr2=0x7f750c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c0622a0 0x7f750c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 -- 172.21.15.52:0/1420448195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009290 con 0x7f750c1540d0 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.789+0000 7f750b7fe700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f74fc00e930 tx=0x7f74fc006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.790+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc012600 con 0x7f750c1540d0 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.790+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc012760 con 0x7f750c1540d0 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.790+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7504009ae0 con 0x7f750c1540d0 2023-05-10T01:26:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.790+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc012b00 con 0x7f750c1540d0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.790+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c0ae7e0 con 0x7f750c1540d0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.791+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c06c340 con 0x7f750c1540d0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.791+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74fc022070 con 0x7f750c1540d0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.791+0000 7f7502ffd700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 0x7f74f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.792+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f74fc079d40 con 0x7f750c1540d0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.792+0000 7f750affd700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 0x7f74f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.792+0000 7f750affd700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 0x7f74f0061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f750400b9a0 tx=0x7f7504009840).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.796+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74fc04b420 con 0x7f750c1540d0 2023-05-10T01:26:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.967+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f750c0a7ef0 con 0x7f750c1540d0 2023-05-10T01:26:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.968+0000 7f7502ffd700 1 -- 172.21.15.52:0/1420448195 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74fc016030 con 0x7f750c1540d0 2023-05-10T01:26:15.972 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:26:15.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 msgr2=0x7f74f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 0x7f74f0061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f750400b9a0 tx=0x7f7504009840).stop 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 msgr2=0x7f750c14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f74fc00e930 tx=0x7f74fc006f90).stop 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 shutdown_connections 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f74f005ed90 0x7f74f0061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f750c1540d0 0x7f750c14e990 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f750c0622a0 0x7f750c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 --2- 172.21.15.52:0/1420448195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f750c153cf0 0x7f750c0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:15.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 >> 172.21.15.52:0/1420448195 conn(0x7f750c05e810 msgr2=0x7f750c0c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:15.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 shutdown_connections 2023-05-10T01:26:15.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:15.970+0000 7f751148e700 1 -- 172.21.15.52:0/1420448195 wait complete. 2023-05-10T01:26:15.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:26:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.097+0000 7fa4247ee700 1 Processor -- start 2023-05-10T01:26:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.097+0000 7fa4247ee700 1 -- start start 2023-05-10T01:26:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa4247ee700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa41c154160 0x7fa41c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa4247ee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0c0650 con 0x7fa41c069da0 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa4247ee700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0bfd20 con 0x7fa41c154540 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa4247ee700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0c0000 con 0x7fa41c154160 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa422d8b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa41c069da0 0x7fa41c0c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47326/0 (socket says 172.21.15.52:47326) 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.098+0000 7fa422d8b700 1 -- 172.21.15.52:0/1486557048 learned_addr learned my addr 172.21.15.52:0/1486557048 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa42258a700 1 --2- 172.21.15.52:0/1486557048 >> v2:172.21.15.172:3300/0 conn(0x7fa41c154160 0x7fa41c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143505615 0 0) 0x7fa41c0c0650 con 0x7fa41c069da0 2023-05-10T01:26:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4080033f0 con 0x7fa41c069da0 2023-05-10T01:26:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa42258a700 1 -- 172.21.15.52:0/1486557048 >> v1:172.21.15.172:6789/0 conn(0x7fa41c154540 legacy=0x7fa41c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197380453 0 0) 0x7fa41c0bfd20 con 0x7fa41c154540 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa42258a700 1 -- 172.21.15.52:0/1486557048 >> v1:172.21.15.52:6789/0 conn(0x7fa41c069da0 legacy=0x7fa41c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa42258a700 1 -- 172.21.15.52:0/1486557048 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0c02e0 con 0x7fa41c154160 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa42258a700 1 --2- 172.21.15.52:0/1486557048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c154160 0x7fa41c0c5c60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fa414009760 tx=0x7fa414009060).ready entity=mon.1 client_cookie=97db092ffb069f2f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0017f0 con 0x7fa41c154160 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414009130 con 0x7fa41c154160 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.099+0000 7fa421588700 1 -- 172.21.15.52:0/1486557048 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414012620 con 0x7fa41c154160 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 -- 172.21.15.52:0/1486557048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c154160 msgr2=0x7fa41c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 --2- 172.21.15.52:0/1486557048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c154160 0x7fa41c0c5c60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fa414009760 tx=0x7fa414009060).stop 2023-05-10T01:26:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 -- 172.21.15.52:0/1486557048 shutdown_connections 2023-05-10T01:26:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 --2- 172.21.15.52:0/1486557048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c154160 0x7fa41c0c5c60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 -- 172.21.15.52:0/1486557048 >> 172.21.15.52:0/1486557048 conn(0x7fa41c0cb6f0 msgr2=0x7fa41c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 -- 172.21.15.52:0/1486557048 shutdown_connections 2023-05-10T01:26:16.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.100+0000 7fa4247ee700 1 -- 172.21.15.52:0/1486557048 wait complete. 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.101+0000 7fa4247ee700 1 Processor -- start 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.101+0000 7fa4247ee700 1 -- start start 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c069da0 0x7fa41c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 0x7fa41c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0b0630 con 0x7fa41c154540 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c1589b0 con 0x7fa41c069da0 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa4247ee700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c157da0 con 0x7fa41c154160 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38316/0 (socket says 172.21.15.52:38316) 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 -- 172.21.15.52:0/3573018756 learned_addr learned my addr 172.21.15.52:0/3573018756 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa42258a700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c069da0 0x7fa41c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa421d89700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 0x7fa41c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 -- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 msgr2=0x7fa41c0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 0x7fa41c0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 -- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c069da0 msgr2=0x7fa41c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c069da0 0x7fa41c0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 -- 172.21.15.52:0/3573018756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140092a0 con 0x7fa41c154540 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa421d89700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 0x7fa41c0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa422d8b700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fa40c007fd0 tx=0x7fa40c007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.102+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004c40 con 0x7fa41c154540 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.103+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c004da0 con 0x7fa41c154540 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.103+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c158080 con 0x7fa41c154540 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.103+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00a9a0 con 0x7fa41c154540 2023-05-10T01:26:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.103+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c158640 con 0x7fa41c154540 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.104+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c141350 con 0x7fa41c154540 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.104+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa40c01b060 con 0x7fa41c154540 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.104+0000 7fa41a7fc700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 0x7fa3fc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.104+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fa40c079850 con 0x7fa41c154540 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.105+0000 7fa42258a700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 0x7fa3fc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.105+0000 7fa42258a700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 0x7fa3fc061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa414000e50 tx=0x7fa414015000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.108+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa41c141350 con 0x7fa41c154540 2023-05-10T01:26:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.283+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa41c141350 con 0x7fa41c154540 2023-05-10T01:26:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.283+0000 7fa41a7fc700 1 -- 172.21.15.52:0/3573018756 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa41c141350 con 0x7fa41c154540 2023-05-10T01:26:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:26:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:26:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:16.289 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 msgr2=0x7fa3fc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 0x7fa3fc061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa414000e50 tx=0x7fa414015000).stop 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 msgr2=0x7fa41c0c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fa40c007fd0 tx=0x7fa40c007cf0).stop 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 shutdown_connections 2023-05-10T01:26:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa3fc05ed60 0x7fa3fc061220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa41c154540 0x7fa41c0c3e80 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa41c069da0 0x7fa41c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 --2- 172.21.15.52:0/3573018756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa41c154160 0x7fa41c0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 >> 172.21.15.52:0/3573018756 conn(0x7fa41c0cb6f0 msgr2=0x7fa41c0abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 shutdown_connections 2023-05-10T01:26:16.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.285+0000 7fa4247ee700 1 -- 172.21.15.52:0/3573018756 wait complete. 2023-05-10T01:26:16.300 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:26:16.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:26:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.418+0000 7f8ac7eb5700 1 Processor -- start 2023-05-10T01:26:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.418+0000 7f8ac7eb5700 1 -- start start 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac7eb5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ac0154080 0x7f8ac00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac7eb5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ac0154460 0x7f8ac00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac7eb5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00c94c0 con 0x7f8ac00aa140 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac7eb5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00aa590 con 0x7f8ac0154080 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac7eb5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00cb7d0 con 0x7f8ac0154460 2023-05-10T01:26:16.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac5c51700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ac0154080 0x7f8ac00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac6452700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8ac00aa140 0x7f8ac0068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47338/0 (socket says 172.21.15.52:47338) 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.419+0000 7f8ac6452700 1 -- 172.21.15.52:0/3958624233 learned_addr learned my addr 172.21.15.52:0/3958624233 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5450700 1 --2- 172.21.15.52:0/3958624233 >> v2:172.21.15.172:3300/0 conn(0x7f8ac0154460 0x7f8ac00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5c51700 1 -- 172.21.15.52:0/3958624233 >> v2:172.21.15.172:3300/0 conn(0x7f8ac0154460 msgr2=0x7f8ac00a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5c51700 1 --2- 172.21.15.52:0/3958624233 >> v2:172.21.15.172:3300/0 conn(0x7f8ac0154460 0x7f8ac00a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5c51700 1 -- 172.21.15.52:0/3958624233 >> v1:172.21.15.52:6789/0 conn(0x7f8ac00aa140 legacy=0x7f8ac0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac4c4f700 1 -- 172.21.15.52:0/3958624233 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491021568 0 0) 0x7f8ac00c94c0 con 0x7f8ac00aa140 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5c51700 1 -- 172.21.15.52:0/3958624233 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00c88b0 con 0x7f8ac0154080 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac5c51700 1 --2- 172.21.15.52:0/3958624233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00aac90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f8ac0084310 tx=0x7f8ab8009780).ready entity=mon.0 client_cookie=ee5913677ab1590a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac4c4f700 1 -- 172.21.15.52:0/3958624233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800e070 con 0x7f8ac0154080 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac4c4f700 1 -- 172.21.15.52:0/3958624233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800bc30 con 0x7f8ac0154080 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac4c4f700 1 -- 172.21.15.52:0/3958624233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8012410 con 0x7f8ac0154080 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/3958624233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 msgr2=0x7f8ac00aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/3958624233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00aac90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f8ac0084310 tx=0x7f8ab8009780).stop 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/3958624233 shutdown_connections 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/3958624233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00aac90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/3958624233 >> v2:172.21.15.172:3300/0 conn(0x7f8ac0154460 0x7f8ac00a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/3958624233 >> 172.21.15.52:0/3958624233 conn(0x7f8ac0067910 msgr2=0x7f8ac00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/3958624233 shutdown_connections 2023-05-10T01:26:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.420+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/3958624233 wait complete. 2023-05-10T01:26:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 Processor -- start 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 -- start start 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ac00aa140 0x7f8ac014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 0x7f8ac0154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0156310 con 0x7f8ac0154080 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c3200 con 0x7f8ac0154460 2023-05-10T01:26:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac7eb5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c4040 con 0x7f8ac00aa140 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac5450700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac5450700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38328/0 (socket says 172.21.15.52:38328) 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.422+0000 7f8ac5450700 1 -- 172.21.15.52:0/1238601410 learned_addr learned my addr 172.21.15.52:0/1238601410 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 -- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ac00aa140 msgr2=0x7f8ac014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ac00aa140 0x7f8ac014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 -- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 msgr2=0x7f8ac0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac6452700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 0x7f8ac0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 0x7f8ac0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 -- 172.21.15.52:0/1238601410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009a20 con 0x7f8ac0154080 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac6452700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 0x7f8ac0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac5450700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f8ab400c680 tx=0x7f8ab4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4010580 con 0x7f8ac0154080 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab40106e0 con 0x7f8ac0154080 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00c3430 con 0x7f8ac0154080 2023-05-10T01:26:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4010a60 con 0x7f8ac0154080 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.423+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac00c39f0 con 0x7f8ac0154080 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.424+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00c4320 con 0x7f8ac0154080 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.424+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ab401b460 con 0x7f8ac0154080 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.425+0000 7f8abdffb700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 0x7f8aa0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.425+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f8ab40798e0 con 0x7f8ac0154080 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.425+0000 7f8ac5c51700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 0x7f8aa0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.425+0000 7f8ac5c51700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 0x7f8aa0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ac0084310 tx=0x7f8ab8009780).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.429+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ab404b070 con 0x7f8ac0154080 2023-05-10T01:26:16.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:16.603+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8ac0066720 con 0x7f8ac0154080 2023-05-10T01:26:17.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.541+0000 7f8abdffb700 1 -- 172.21.15.52:0/1238601410 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8ab404e690 con 0x7f8ac0154080 2023-05-10T01:26:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.547+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 msgr2=0x7f8aa0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.547+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 0x7f8aa0061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ac0084310 tx=0x7f8ab8009780).stop 2023-05-10T01:26:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.547+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 msgr2=0x7f8ac00c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.547+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f8ab400c680 tx=0x7f8ab4008040).stop 2023-05-10T01:26:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 shutdown_connections 2023-05-10T01:26:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8aa005ed90 0x7f8aa0061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ac0154460 0x7f8ac0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ac00aa140 0x7f8ac014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:17.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 --2- 172.21.15.52:0/1238601410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac0154080 0x7f8ac00c44d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.550+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 >> 172.21.15.52:0/1238601410 conn(0x7f8ac0067910 msgr2=0x7f8ac014e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.552+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 shutdown_connections 2023-05-10T01:26:17.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.552+0000 7f8ac7eb5700 1 -- 172.21.15.52:0/1238601410 wait complete. 2023-05-10T01:26:17.556 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:26:17.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:26:17.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.696+0000 7fd5ab942700 1 Processor -- start 2023-05-10T01:26:17.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.696+0000 7fd5ab942700 1 -- start start 2023-05-10T01:26:17.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5ab942700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5a40c0f00 0x7fd5a4158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5ab942700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd5a40c7c90 0x7fd5a40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5ab942700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a40c5d10 con 0x7fd5a4154130 2023-05-10T01:26:17.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5ab942700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40c5f90 con 0x7fd5a40c7c90 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5ab942700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40c6270 con 0x7fd5a40c0f00 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd5a40c7c90 0x7fd5a40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a96de700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd5a4154130 0x7fd5a40c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47350/0 (socket says 172.21.15.52:47350) 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a96de700 1 -- 172.21.15.52:0/2548956384 learned_addr learned my addr 172.21.15.52:0/2548956384 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a8edd700 1 --2- 172.21.15.52:0/2548956384 >> v2:172.21.15.172:3300/0 conn(0x7fd5a40c0f00 0x7fd5a4158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 -- 172.21.15.52:0/2548956384 >> v2:172.21.15.172:3300/0 conn(0x7fd5a40c0f00 msgr2=0x7fd5a4158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:17.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 --2- 172.21.15.52:0/2548956384 >> v2:172.21.15.172:3300/0 conn(0x7fd5a40c0f00 0x7fd5a4158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 -- 172.21.15.52:0/2548956384 >> v1:172.21.15.52:6789/0 conn(0x7fd5a4154130 legacy=0x7fd5a40c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 -- 172.21.15.52:0/2548956384 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40c6550 con 0x7fd5a40c7c90 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd593fff700 1 -- 172.21.15.52:0/2548956384 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047516845 0 0) 0x7fd5a40c5d10 con 0x7fd5a4154130 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.697+0000 7fd5a9edf700 1 --2- 172.21.15.52:0/2548956384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c7c90 0x7fd5a40c5820 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fd5a4047290 tx=0x7fd59c009780).ready entity=mon.0 client_cookie=3d935767b2523e86 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd593fff700 1 -- 172.21.15.52:0/2548956384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00e070 con 0x7fd5a40c7c90 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd593fff700 1 -- 172.21.15.52:0/2548956384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00bc30 con 0x7fd5a40c7c90 2023-05-10T01:26:17.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd593fff700 1 -- 172.21.15.52:0/2548956384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c012410 con 0x7fd5a40c7c90 2023-05-10T01:26:17.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 -- 172.21.15.52:0/2548956384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c7c90 msgr2=0x7fd5a40c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 --2- 172.21.15.52:0/2548956384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c7c90 0x7fd5a40c5820 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fd5a4047290 tx=0x7fd59c009780).stop 2023-05-10T01:26:17.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 -- 172.21.15.52:0/2548956384 shutdown_connections 2023-05-10T01:26:17.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 --2- 172.21.15.52:0/2548956384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c7c90 0x7fd5a40c5820 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 --2- 172.21.15.52:0/2548956384 >> v2:172.21.15.172:3300/0 conn(0x7fd5a40c0f00 0x7fd5a4158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 -- 172.21.15.52:0/2548956384 >> 172.21.15.52:0/2548956384 conn(0x7fd5a4067910 msgr2=0x7fd5a4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 -- 172.21.15.52:0/2548956384 shutdown_connections 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.698+0000 7fd5ab942700 1 -- 172.21.15.52:0/2548956384 wait complete. 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.699+0000 7fd5ab942700 1 Processor -- start 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.699+0000 7fd5ab942700 1 -- start start 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a40c7c90 0x7fd5a4164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5a4154130 0x7fd5a4155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4155850 con 0x7fd5a40c0f00 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4153010 con 0x7fd5a40c7c90 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5ab942700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4165060 con 0x7fd5a4154130 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5a96de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5a96de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38338/0 (socket says 172.21.15.52:38338) 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.700+0000 7fd5a96de700 1 -- 172.21.15.52:0/3182030244 learned_addr learned my addr 172.21.15.52:0/3182030244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a9edf700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5a4154130 0x7fd5a4155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a8edd700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a40c7c90 0x7fd5a4164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 -- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5a4154130 msgr2=0x7fd5a4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5a4154130 0x7fd5a4155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 -- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a40c7c90 msgr2=0x7fd5a4164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a40c7c90 0x7fd5a4164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 -- 172.21.15.52:0/3182030244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009a20 con 0x7fd5a40c0f00 2023-05-10T01:26:17.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5a96de700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd5a0001eb0 tx=0x7fd5a0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00072e0 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0007440 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4165340 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00057a0 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.701+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a41554e0 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.702+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4155b30 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.702+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd5a0010070 con 0x7fd5a40c0f00 2023-05-10T01:26:17.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.703+0000 7fd5917fa700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 0x7fd584061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:17.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.703+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5903+0+0 (secure 0 0 0) 0x7fd5a0079100 con 0x7fd5a40c0f00 2023-05-10T01:26:17.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.703+0000 7fd5a8edd700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 0x7fd584061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:17.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.703+0000 7fd5a8edd700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 0x7fd584061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd5a4157510 tx=0x7fd594008040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:17.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.707+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5a004a780 con 0x7fd5a40c0f00 2023-05-10T01:26:17.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:17.880+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd5a405e6e0 con 0x7fd5a40c0f00 2023-05-10T01:26:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.549+0000 7fd5917fa700 1 -- 172.21.15.52:0/3182030244 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd5a004dda0 con 0x7fd5a40c0f00 2023-05-10T01:26:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.555+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 msgr2=0x7fd584061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.555+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 0x7fd584061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd5a4157510 tx=0x7fd594008040).stop 2023-05-10T01:26:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.555+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 msgr2=0x7fd5a4152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.555+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd5a0001eb0 tx=0x7fd5a0007e90).stop 2023-05-10T01:26:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 shutdown_connections 2023-05-10T01:26:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd58405ed90 0x7fd584061250 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fd5a4157510 tx=0x7fd594008040).stop 2023-05-10T01:26:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5a4154130 0x7fd5a4155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5a40c0f00 0x7fd5a4152b20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 --2- 172.21.15.52:0/3182030244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a40c7c90 0x7fd5a4164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.556+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 >> 172.21.15.52:0/3182030244 conn(0x7fd5a4067910 msgr2=0x7fd5a4153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.568+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 shutdown_connections 2023-05-10T01:26:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.569+0000 7fd5ab942700 1 -- 172.21.15.52:0/3182030244 wait complete. 2023-05-10T01:26:18.578 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:26:18.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:26:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.714+0000 7f6c16ea0700 1 Processor -- start 2023-05-10T01:26:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.714+0000 7f6c16ea0700 1 -- start start 2023-05-10T01:26:18.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c16ea0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 0x7f6c100c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:18.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c16ea0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c100ca5f0 con 0x7f6c10153a90 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c16ea0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c10154610 con 0x7f6c100c5d20 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c16ea0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100c8820 con 0x7f6c100aa200 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c1543d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6c10153a90 0x7f6c10153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47364/0 (socket says 172.21.15.52:47364) 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.715+0000 7f6c1543d700 1 -- 172.21.15.52:0/2926234199 learned_addr learned my addr 172.21.15.52:0/2926234199 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0ffff700 1 --2- 172.21.15.52:0/2926234199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 0x7f6c100c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533666605 0 0) 0x7f6c100ca5f0 con 0x7f6c10153a90 2023-05-10T01:26:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00033f0 con 0x7f6c10153a90 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992332052 0 0) 0x7f6c10154610 con 0x7f6c100c5d20 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0ffff700 1 -- 172.21.15.52:0/2926234199 >> v1:172.21.15.172:6789/0 conn(0x7f6c100c5d20 legacy=0x7f6c10069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0ffff700 1 -- 172.21.15.52:0/2926234199 >> v1:172.21.15.52:6789/0 conn(0x7f6c10153a90 legacy=0x7f6c10153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0ffff700 1 -- 172.21.15.52:0/2926234199 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100c8b00 con 0x7f6c100aa200 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0ffff700 1 --2- 172.21.15.52:0/2926234199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 0x7f6c100c6100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6c00009e90 tx=0x7f6c00009780).ready entity=mon.2 client_cookie=b0f3b2acdae2efb5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000e070 con 0x7f6c100aa200 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000b850 con 0x7f6c100aa200 2023-05-10T01:26:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.716+0000 7f6c0f7fe700 1 -- 172.21.15.52:0/2926234199 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8001470 con 0x7f6c100aa200 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 -- 172.21.15.52:0/2926234199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 msgr2=0x7f6c100c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/2926234199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 0x7f6c100c6100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6c00009e90 tx=0x7f6c00009780).stop 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 -- 172.21.15.52:0/2926234199 shutdown_connections 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/2926234199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c100aa200 0x7f6c100c6100 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 -- 172.21.15.52:0/2926234199 >> 172.21.15.52:0/2926234199 conn(0x7f6c100cb6f0 msgr2=0x7f6c100c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 -- 172.21.15.52:0/2926234199 shutdown_connections 2023-05-10T01:26:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.717+0000 7f6c16ea0700 1 -- 172.21.15.52:0/2926234199 wait complete. 2023-05-10T01:26:18.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.718+0000 7f6c16ea0700 1 Processor -- start 2023-05-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.718+0000 7f6c16ea0700 1 -- start start 2023-05-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c100c5d20 0x7f6c100aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10153a90 0x7f6c100b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100ae980 con 0x7f6c100aa200 2023-05-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100add70 con 0x7f6c100c5d20 2023-05-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c16ea0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100ae050 con 0x7f6c10153a90 2023-05-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38350/0 (socket says 172.21.15.52:38350) 2023-05-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 -- 172.21.15.52:0/997039567 learned_addr learned my addr 172.21.15.52:0/997039567 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c1543d700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10153a90 0x7f6c100b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c0ffff700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c100c5d20 0x7f6c100aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 -- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10153a90 msgr2=0x7f6c100b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10153a90 0x7f6c100b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 -- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c100c5d20 msgr2=0x7f6c100aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c100c5d20 0x7f6c100aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 -- 172.21.15.52:0/997039567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009a20 con 0x7f6c100aa200 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c14c3c700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f6c08001eb0 tx=0x7f6c08007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.719+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ce60 con 0x7f6c100aa200 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.720+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800f470 con 0x7f6c100aa200 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.720+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c100ae330 con 0x7f6c100aa200 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.720+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800f810 con 0x7f6c100aa200 2023-05-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.720+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1014f620 con 0x7f6c100aa200 2023-05-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.720+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c100aec60 con 0x7f6c100aa200 2023-05-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.721+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6c08019030 con 0x7f6c100aa200 2023-05-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.722+0000 7f6c0cff9700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 0x7f6bf4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.722+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6285+0+0 (secure 0 0 0) 0x7f6c080795b0 con 0x7f6c100aa200 2023-05-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.722+0000 7f6c0ffff700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 0x7f6bf4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.722+0000 7f6c0ffff700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 0x7f6bf4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6c000099f0 tx=0x7f6c00009780).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:18.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.726+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c0804ab30 con 0x7f6c100aa200 2023-05-10T01:26:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.945+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6c10066720 con 0x7f6c100aa200 2023-05-10T01:26:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.953+0000 7f6c0cff9700 1 -- 172.21.15.52:0/997039567 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6c0804e150 con 0x7f6c100aa200 2023-05-10T01:26:18.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.961+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 msgr2=0x7f6bf4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.961+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 0x7f6bf4061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6c000099f0 tx=0x7f6c00009780).stop 2023-05-10T01:26:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.961+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 msgr2=0x7f6c1014f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.961+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f6c08001eb0 tx=0x7f6c08007c70).stop 2023-05-10T01:26:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 shutdown_connections 2023-05-10T01:26:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6bf405ed90 0x7f6bf4061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10153a90 0x7f6c100b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c100aa200 0x7f6c1014f130 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 --2- 172.21.15.52:0/997039567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c100c5d20 0x7f6c100aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.962+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 >> 172.21.15.52:0/997039567 conn(0x7f6c100cb6f0 msgr2=0x7f6c100acc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.964+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 shutdown_connections 2023-05-10T01:26:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:18.965+0000 7f6c16ea0700 1 -- 172.21.15.52:0/997039567 wait complete. 2023-05-10T01:26:18.971 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 15 and data pool 16 2023-05-10T01:26:18.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.101+0000 7ff3f872b700 1 Processor -- start 2023-05-10T01:26:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.101+0000 7ff3f872b700 1 -- start start 2023-05-10T01:26:19.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3f0150da0 0x7ff3f0064270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0151180 0x7ff3f00c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3f014ff90 0x7ff3f0150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00bd370 con 0x7ff3f0150da0 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f0065440 con 0x7ff3f014ff90 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f872b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00c1360 con 0x7ff3f0151180 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f64c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3f0150da0 0x7ff3f0064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f64c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3f0150da0 0x7ff3f0064270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38358/0 (socket says 172.21.15.52:38358) 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f64c7700 1 -- 172.21.15.52:0/4251841581 learned_addr learned my addr 172.21.15.52:0/4251841581 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f6cc8700 1 --2- 172.21.15.52:0/4251841581 >> v2:172.21.15.172:3300/0 conn(0x7ff3f014ff90 0x7ff3f0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.102+0000 7ff3f5cc6700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0151180 0x7ff3f00c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 -- 172.21.15.52:0/4251841581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0151180 msgr2=0x7ff3f00c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0151180 0x7ff3f00c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 -- 172.21.15.52:0/4251841581 >> v2:172.21.15.172:3300/0 conn(0x7ff3f014ff90 msgr2=0x7ff3f0150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/4251841581 >> v2:172.21.15.172:3300/0 conn(0x7ff3f014ff90 0x7ff3f0150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 -- 172.21.15.52:0/4251841581 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f01519d0 con 0x7ff3f0150da0 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0150da0 0x7ff3f0064270 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff3f00653b0 tx=0x7ff3e80090f0).ready entity=mon.0 client_cookie=f071b85d323aaaa7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f54c5700 1 -- 172.21.15.52:0/4251841581 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800f510 con 0x7ff3f0150da0 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f54c5700 1 -- 172.21.15.52:0/4251841581 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800f670 con 0x7ff3f0150da0 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f54c5700 1 -- 172.21.15.52:0/4251841581 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800f9f0 con 0x7ff3f0150da0 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 -- 172.21.15.52:0/4251841581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0150da0 msgr2=0x7ff3f0064270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0150da0 0x7ff3f0064270 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff3f00653b0 tx=0x7ff3e80090f0).stop 2023-05-10T01:26:19.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 -- 172.21.15.52:0/4251841581 shutdown_connections 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 --2- 172.21.15.52:0/4251841581 >> v2:172.21.15.172:3300/0 conn(0x7ff3f014ff90 0x7ff3f0150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0150da0 0x7ff3f0064270 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 --2- 172.21.15.52:0/4251841581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0151180 0x7ff3f00c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.103+0000 7ff3f872b700 1 -- 172.21.15.52:0/4251841581 >> 172.21.15.52:0/4251841581 conn(0x7ff3f00c7340 msgr2=0x7ff3f00c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.104+0000 7ff3f872b700 1 -- 172.21.15.52:0/4251841581 shutdown_connections 2023-05-10T01:26:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.104+0000 7ff3f872b700 1 -- 172.21.15.52:0/4251841581 wait complete. 2023-05-10T01:26:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 Processor -- start 2023-05-10T01:26:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 -- start start 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f014ff90 0x7ff3f0160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0150da0 0x7ff3f014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0160fa0 con 0x7ff3f0151180 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00bdab0 con 0x7ff3f014ff90 2023-05-10T01:26:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f872b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00bdd90 con 0x7ff3f0150da0 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f6cc8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f6cc8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38366/0 (socket says 172.21.15.52:38366) 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.105+0000 7ff3f6cc8700 1 -- 172.21.15.52:0/3501156579 learned_addr learned my addr 172.21.15.52:0/3501156579 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f5cc6700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0150da0 0x7ff3f014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f014ff90 0x7ff3f0160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 -- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0150da0 msgr2=0x7ff3f014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0150da0 0x7ff3f014d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 -- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f014ff90 msgr2=0x7ff3f0160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f014ff90 0x7ff3f0160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 -- 172.21.15.52:0/3501156579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009370 con 0x7ff3f0151180 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f6cc8700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7ff3ec009df0 tx=0x7ff3ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00caa0 con 0x7ff3f0151180 2023-05-10T01:26:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00f040 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f00be070 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00ce10 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.106+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00be630 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.107+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f00be820 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.108+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff3ec013610 con 0x7ff3f0151180 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.108+0000 7ff3de7fc700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 0x7ff3d0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.108+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff3ec07a470 con 0x7ff3f0151180 2023-05-10T01:26:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.108+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 0x7ff3d0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.108+0000 7ff3f64c7700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 0x7ff3d0061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff3e8009130 tx=0x7ff3e8017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.112+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3ec04b900 con 0x7ff3f0151180 2023-05-10T01:26:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.290+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f006c340 con 0x7ff3f0151180 2023-05-10T01:26:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.291+0000 7ff3de7fc700 1 -- 172.21.15.52:0/3501156579 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+17455 (secure 0 0 0) 0x7ff3ec04ef20 con 0x7ff3f0151180 2023-05-10T01:26:19.294 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:19.295 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":121,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:18.946996+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:19.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 msgr2=0x7ff3d0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 0x7ff3d0061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff3e8009130 tx=0x7ff3e8017000).stop 2023-05-10T01:26:19.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 msgr2=0x7ff3f00beb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7ff3ec009df0 tx=0x7ff3ec00b040).stop 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 shutdown_connections 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff3d005ed60 0x7ff3d0061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3f0151180 0x7ff3f00beb50 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f014ff90 0x7ff3f0160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 --2- 172.21.15.52:0/3501156579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3f0150da0 0x7ff3f014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 >> 172.21.15.52:0/3501156579 conn(0x7ff3f00c7340 msgr2=0x7ff3f00c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 shutdown_connections 2023-05-10T01:26:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.292+0000 7ff3f872b700 1 -- 172.21.15.52:0/3501156579 wait complete. 2023-05-10T01:26:19.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 Processor -- start 2023-05-10T01:26:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 -- start start 2023-05-10T01:26:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb08c154160 0x7fb08c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0c0650 con 0x7fb08c069690 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0c1af0 con 0x7fb08c154160 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.423+0000 7fb091ff0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0bfd20 con 0x7fb08c154540 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb08c154160 0x7fb08c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb08c069690 0x7fb08c157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47390/0 (socket says 172.21.15.52:47390) 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb08c154160 0x7fb08c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38370/0 (socket says 172.21.15.52:38370) 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08bfff700 1 -- 172.21.15.52:0/2629965236 learned_addr learned my addr 172.21.15.52:0/2629965236 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08affd700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 -- 172.21.15.52:0/2629965236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 msgr2=0x7fb08c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 -- 172.21.15.52:0/2629965236 >> v1:172.21.15.52:6789/0 conn(0x7fb08c069690 legacy=0x7fb08c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 -- 172.21.15.52:0/2629965236 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0c0000 con 0x7fb08c154160 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08a7fc700 1 -- 172.21.15.52:0/2629965236 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748543609 0 0) 0x7fb08c0c0650 con 0x7fb08c069690 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08affd700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08b7fe700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c0c5c60 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fb07c009760 tx=0x7fb07c009060).ready entity=mon.0 client_cookie=14ab17a6868f607b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08a7fc700 1 -- 172.21.15.52:0/2629965236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0090d0 con 0x7fb08c154160 2023-05-10T01:26:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08a7fc700 1 -- 172.21.15.52:0/2629965236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00b580 con 0x7fb08c154160 2023-05-10T01:26:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.424+0000 7fb08a7fc700 1 -- 172.21.15.52:0/2629965236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00b900 con 0x7fb08c154160 2023-05-10T01:26:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 -- 172.21.15.52:0/2629965236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 msgr2=0x7fb08c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c0c5c60 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fb07c009760 tx=0x7fb07c009060).stop 2023-05-10T01:26:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 -- 172.21.15.52:0/2629965236 shutdown_connections 2023-05-10T01:26:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c0c5c60 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 --2- 172.21.15.52:0/2629965236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 -- 172.21.15.52:0/2629965236 >> 172.21.15.52:0/2629965236 conn(0x7fb08c0cb6f0 msgr2=0x7fb08c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 -- 172.21.15.52:0/2629965236 shutdown_connections 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.425+0000 7fb091ff0700 1 -- 172.21.15.52:0/2629965236 wait complete. 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.426+0000 7fb091ff0700 1 Processor -- start 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.426+0000 7fb091ff0700 1 -- start start 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb08c069690 0x7fb08c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14d830 con 0x7fb08c154160 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14cbb0 con 0x7fb08c069690 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb091ff0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14ce90 con 0x7fb08c154540 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38378/0 (socket says 172.21.15.52:38378) 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 -- 172.21.15.52:0/3316558697 learned_addr learned my addr 172.21.15.52:0/3316558697 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08bfff700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08b7fe700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb08c069690 0x7fb08c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 -- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 msgr2=0x7fb08c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 -- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb08c069690 msgr2=0x7fb08c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb08c069690 0x7fb08c1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 -- 172.21.15.52:0/3316558697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0092a0 con 0x7fb08c154160 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.427+0000 7fb08affd700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb08000c670 tx=0x7fb080008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.428+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080015070 con 0x7fb08c154160 2023-05-10T01:26:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.428+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080010580 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.428+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c14d170 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.428+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080010900 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.428+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c1537b0 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.429+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0666b0 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.429+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb080010cf0 con 0x7fb08c154160 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.429+0000 7fb0737fe700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 0x7fb06c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.429+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb080079900 con 0x7fb08c154160 2023-05-10T01:26:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.429+0000 7fb08b7fe700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 0x7fb06c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.430+0000 7fb08b7fe700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 0x7fb06c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb07c00b340 tx=0x7fb07c017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.433+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb08004ad90 con 0x7fb08c154160 2023-05-10T01:26:19.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.605+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb08c14d970 con 0x7fb08c154160 2023-05-10T01:26:19.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.606+0000 7fb0737fe700 1 -- 172.21.15.52:0/3316558697 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+17455 (secure 0 0 0) 0x7fb08004e3b0 con 0x7fb08c154160 2023-05-10T01:26:19.610 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:19.610 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":121,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:18.946996+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 msgr2=0x7fb06c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 0x7fb06c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb07c00b340 tx=0x7fb07c017000).stop 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 msgr2=0x7fb08c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fb08000c670 tx=0x7fb080008040).stop 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 shutdown_connections 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb06c05ed90 0x7fb06c061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb08c154540 0x7fb08c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb08c069690 0x7fb08c1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 --2- 172.21.15.52:0/3316558697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb08c154160 0x7fb08c152230 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 >> 172.21.15.52:0/3316558697 conn(0x7fb08c0cb6f0 msgr2=0x7fb08c158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 shutdown_connections 2023-05-10T01:26:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.608+0000 7fb091ff0700 1 -- 172.21.15.52:0/3316558697 wait complete. 2023-05-10T01:26:19.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:26:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.739+0000 7faec10ff700 1 Processor -- start 2023-05-10T01:26:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faec10ff700 1 -- start start 2023-05-10T01:26:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faec10ff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faebc06a0e0 0x7faebc150640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faec10ff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc0c3120 con 0x7faebc1546e0 2023-05-10T01:26:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faec10ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc068530 con 0x7faebc154300 2023-05-10T01:26:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faec10ff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc154b10 con 0x7faebc06a0e0 2023-05-10T01:26:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.740+0000 7faeba59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faebc06a0e0 0x7faebc150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faebc06a0e0 0x7faebc150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38386/0 (socket says 172.21.15.52:38386) 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faebb59e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faebc1546e0 0x7faebc0c16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47404/0 (socket says 172.21.15.52:47404) 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 -- 172.21.15.52:0/2584093519 learned_addr learned my addr 172.21.15.52:0/2584093519 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 -- 172.21.15.52:0/2584093519 >> v1:172.21.15.172:6789/0 conn(0x7faebc154300 legacy=0x7faebc14ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 -- 172.21.15.52:0/2584093519 >> v1:172.21.15.52:6789/0 conn(0x7faebc1546e0 legacy=0x7faebc0c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 -- 172.21.15.52:0/2584093519 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0c2880 con 0x7faebc06a0e0 2023-05-10T01:26:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeb9d9b700 1 -- 172.21.15.52:0/2584093519 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176574677 0 0) 0x7faebc0c3120 con 0x7faebc1546e0 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeba59c700 1 --2- 172.21.15.52:0/2584093519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc150640 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7faea4006fd0 tx=0x7faea40090f0).ready entity=mon.0 client_cookie=56577119b4285eae server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeb9d9b700 1 -- 172.21.15.52:0/2584093519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea400b600 con 0x7faebc06a0e0 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeb9d9b700 1 -- 172.21.15.52:0/2584093519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea400b760 con 0x7faebc06a0e0 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.741+0000 7faeb9d9b700 1 -- 172.21.15.52:0/2584093519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea400bae0 con 0x7faebc06a0e0 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 -- 172.21.15.52:0/2584093519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 msgr2=0x7faebc150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 --2- 172.21.15.52:0/2584093519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc150640 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7faea4006fd0 tx=0x7faea40090f0).stop 2023-05-10T01:26:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 -- 172.21.15.52:0/2584093519 shutdown_connections 2023-05-10T01:26:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 --2- 172.21.15.52:0/2584093519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc150640 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 -- 172.21.15.52:0/2584093519 >> 172.21.15.52:0/2584093519 conn(0x7faebc0c3d80 msgr2=0x7faebc0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 -- 172.21.15.52:0/2584093519 shutdown_connections 2023-05-10T01:26:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.742+0000 7faec10ff700 1 -- 172.21.15.52:0/2584093519 wait complete. 2023-05-10T01:26:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.743+0000 7faec10ff700 1 Processor -- start 2023-05-10T01:26:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.743+0000 7faec10ff700 1 -- start start 2023-05-10T01:26:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faebc154300 0x7faebc1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faebc1546e0 0x7faebc146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc150bc0 con 0x7faebc06a0e0 2023-05-10T01:26:19.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc150ea0 con 0x7faebc1546e0 2023-05-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc151180 con 0x7faebc154300 2023-05-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38390/0 (socket says 172.21.15.52:38390) 2023-05-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 -- 172.21.15.52:0/9982451 learned_addr learned my addr 172.21.15.52:0/9982451 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebb59e700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faebc1546e0 0x7faebc146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 -- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faebc154300 msgr2=0x7faebc1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faebc154300 0x7faebc1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 -- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faebc1546e0 msgr2=0x7faebc146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faebc1546e0 0x7faebc146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 -- 172.21.15.52:0/9982451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4009370 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faebad9d700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7faeb400c440 tx=0x7faeb4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400f470 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400f5f0 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc151460 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400f9b0 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.744+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc151a20 con 0x7faebc06a0e0 2023-05-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.745+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc06c340 con 0x7faebc06a0e0 2023-05-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.746+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faeb4019030 con 0x7faebc06a0e0 2023-05-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.746+0000 7faeb2ffd700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 0x7faea0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.746+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6385+0+0 (secure 0 0 0) 0x7faeb4079060 con 0x7faebc06a0e0 2023-05-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.746+0000 7faeba59c700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 0x7faea0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.747+0000 7faeba59c700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 0x7faea0061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faebc0a55f0 tx=0x7faea4017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.750+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faeb40488f0 con 0x7faebc06a0e0 2023-05-10T01:26:19.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:19.967+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faebc0c2b60 con 0x7faebc06a0e0 2023-05-10T01:26:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.959+0000 7faeb2ffd700 1 -- 172.21.15.52:0/9982451 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7faeb404dfd0 con 0x7faebc06a0e0 2023-05-10T01:26:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 msgr2=0x7faea0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 0x7faea0061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faebc0a55f0 tx=0x7faea4017000).stop 2023-05-10T01:26:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 msgr2=0x7faebc0aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7faeb400c440 tx=0x7faeb4007de0).stop 2023-05-10T01:26:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 shutdown_connections 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faea005ed90 0x7faea0061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faebc1546e0 0x7faebc146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc06a0e0 0x7faebc0aa1d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 --2- 172.21.15.52:0/9982451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faebc154300 0x7faebc1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 >> 172.21.15.52:0/9982451 conn(0x7faebc0c3d80 msgr2=0x7faebc0be350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 shutdown_connections 2023-05-10T01:26:20.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:20.962+0000 7faec10ff700 1 -- 172.21.15.52:0/9982451 wait complete. 2023-05-10T01:26:20.980 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:26:21.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.103+0000 7fbe36511700 1 Processor -- start 2023-05-10T01:26:21.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.103+0000 7fbe36511700 1 -- start start 2023-05-10T01:26:21.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe36511700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe30157bd0 0x7fbe30158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:21.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe36511700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe30158540 con 0x7fbe30068b90 2023-05-10T01:26:21.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe36511700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300697e0 con 0x7fbe3014e200 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe36511700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3006a460 con 0x7fbe30157bd0 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe30157bd0 0x7fbe30158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe34aae700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbe30068b90 0x7fbe30068fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47418/0 (socket says 172.21.15.52:47418) 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe34aae700 1 -- 172.21.15.52:0/3891208904 learned_addr learned my addr 172.21.15.52:0/3891208904 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/3891208904 >> v1:172.21.15.172:6789/0 conn(0x7fbe3014e200 legacy=0x7fbe3014e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/3891208904 >> v1:172.21.15.52:6789/0 conn(0x7fbe30068b90 legacy=0x7fbe30068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2effd700 1 -- 172.21.15.52:0/3891208904 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148422574 0 0) 0x7fbe30158540 con 0x7fbe30068b90 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/3891208904 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30069ac0 con 0x7fbe30157bd0 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2f7fe700 1 --2- 172.21.15.52:0/3891208904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe30157bd0 0x7fbe30158050 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fbe24009760 tx=0x7fbe24009060).ready entity=mon.0 client_cookie=559bfaff1088691f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2effd700 1 -- 172.21.15.52:0/3891208904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24009120 con 0x7fbe30157bd0 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2effd700 1 -- 172.21.15.52:0/3891208904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400b580 con 0x7fbe30157bd0 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.104+0000 7fbe2effd700 1 -- 172.21.15.52:0/3891208904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400b900 con 0x7fbe30157bd0 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 -- 172.21.15.52:0/3891208904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe30157bd0 msgr2=0x7fbe30158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 --2- 172.21.15.52:0/3891208904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe30157bd0 0x7fbe30158050 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fbe24009760 tx=0x7fbe24009060).stop 2023-05-10T01:26:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 -- 172.21.15.52:0/3891208904 shutdown_connections 2023-05-10T01:26:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 --2- 172.21.15.52:0/3891208904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe30157bd0 0x7fbe30158050 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 -- 172.21.15.52:0/3891208904 >> 172.21.15.52:0/3891208904 conn(0x7fbe300c45f0 msgr2=0x7fbe30066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 -- 172.21.15.52:0/3891208904 shutdown_connections 2023-05-10T01:26:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.105+0000 7fbe36511700 1 -- 172.21.15.52:0/3891208904 wait complete. 2023-05-10T01:26:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.106+0000 7fbe36511700 1 Processor -- start 2023-05-10T01:26:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.106+0000 7fbe36511700 1 -- start start 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe30068b90 0x7fbe30153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 0x7fbe30065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe301523d0 con 0x7fbe3014e200 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe301526b0 con 0x7fbe30157bd0 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe36511700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30152990 con 0x7fbe30068b90 2023-05-10T01:26:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38406/0 (socket says 172.21.15.52:38406) 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/814783381 learned_addr learned my addr 172.21.15.52:0/814783381 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2ffff700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe30068b90 0x7fbe30153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe34aae700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 0x7fbe30065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe30068b90 msgr2=0x7fbe30153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe30068b90 0x7fbe30153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 msgr2=0x7fbe30065870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 0x7fbe30065870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe2f7fe700 1 -- 172.21.15.52:0/814783381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240092a0 con 0x7fbe3014e200 2023-05-10T01:26:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.107+0000 7fbe34aae700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 0x7fbe30065870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe2f7fe700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fbe24009eb0 tx=0x7fbe24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400b900 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe24006970 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe30152c70 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400bed0 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.108+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe301541c0 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.109+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe30153190 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.109+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbe2402a070 con 0x7fbe3014e200 2023-05-10T01:26:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.109+0000 7fbe17fff700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.110+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fbe2407b200 con 0x7fbe3014e200 2023-05-10T01:26:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.110+0000 7fbe2ffff700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.110+0000 7fbe2ffff700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 0x7fbe10061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe20003860 tx=0x7fbe20007d40).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.114+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe30153190 con 0x7fbe3014e200 2023-05-10T01:26:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.330+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbe30153190 con 0x7fbe3014e200 2023-05-10T01:26:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.966+0000 7fbe17fff700 1 -- 172.21.15.52:0/814783381 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe30153190 con 0x7fbe3014e200 2023-05-10T01:26:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 msgr2=0x7fbe10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 0x7fbe10061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe20003860 tx=0x7fbe20007d40).stop 2023-05-10T01:26:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 msgr2=0x7fbe3014d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fbe24009eb0 tx=0x7fbe24017000).stop 2023-05-10T01:26:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 shutdown_connections 2023-05-10T01:26:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbe1005ed90 0x7fbe10061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe30157bd0 0x7fbe30065870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe30068b90 0x7fbe30153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 --2- 172.21.15.52:0/814783381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe3014e200 0x7fbe3014d640 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 >> 172.21.15.52:0/814783381 conn(0x7fbe300c45f0 msgr2=0x7fbe30068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 shutdown_connections 2023-05-10T01:26:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:21.968+0000 7fbe36511700 1 -- 172.21.15.52:0/814783381 wait complete. 2023-05-10T01:26:21.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:22.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.107+0000 7f0903fa8700 1 Processor -- start 2023-05-10T01:26:22.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.107+0000 7f0903fa8700 1 -- start start 2023-05-10T01:26:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0903fa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0903fa8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08fc0c4220 0x7f08fc0c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0903fa8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0c27d0 con 0x7f08fc158500 2023-05-10T01:26:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0903fa8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0c1f70 con 0x7f08fc0c4220 2023-05-10T01:26:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0903fa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0c4800 con 0x7f08fc153cc0 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08fc0c4220 0x7f08fc0c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08fc0c4220 0x7f08fc0c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38414/0 (socket says 172.21.15.52:38414) 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 -- 172.21.15.52:0/2496951050 learned_addr learned my addr 172.21.15.52:0/2496951050 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901d44700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 -- 172.21.15.52:0/2496951050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 msgr2=0x7f08fc1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 -- 172.21.15.52:0/2496951050 >> v1:172.21.15.172:6789/0 conn(0x7f08fc158500 legacy=0x7f08fc0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.108+0000 7f0901543700 1 -- 172.21.15.52:0/2496951050 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0c2180 con 0x7f08fc0c4220 2023-05-10T01:26:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0901543700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc0c2c60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f08f0006fd0 tx=0x7f08f00090f0).ready entity=mon.0 client_cookie=3dfc4cee864d0b52 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0900d42700 1 -- 172.21.15.52:0/2496951050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000b600 con 0x7f08fc0c4220 2023-05-10T01:26:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0900d42700 1 -- 172.21.15.52:0/2496951050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000b760 con 0x7f08fc0c4220 2023-05-10T01:26:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0900d42700 1 -- 172.21.15.52:0/2496951050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000bae0 con 0x7f08fc0c4220 2023-05-10T01:26:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 -- 172.21.15.52:0/2496951050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 msgr2=0x7f08fc0c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc0c2c60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f08f0006fd0 tx=0x7f08f00090f0).stop 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 -- 172.21.15.52:0/2496951050 shutdown_connections 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 --2- 172.21.15.52:0/2496951050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc0c2c60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 -- 172.21.15.52:0/2496951050 >> 172.21.15.52:0/2496951050 conn(0x7f08fc0c7b40 msgr2=0x7f08fc0c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 -- 172.21.15.52:0/2496951050 shutdown_connections 2023-05-10T01:26:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.109+0000 7f0903fa8700 1 -- 172.21.15.52:0/2496951050 wait complete. 2023-05-10T01:26:22.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.110+0000 7f0903fa8700 1 Processor -- start 2023-05-10T01:26:22.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.110+0000 7f0903fa8700 1 -- start start 2023-05-10T01:26:22.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08fc158500 0x7f08fc164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0a7800 con 0x7f08fc0c4220 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0a6bf0 con 0x7f08fc158500 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0903fa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0a6ed0 con 0x7f08fc153cc0 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0901d44700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0901d44700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38418/0 (socket says 172.21.15.52:38418) 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0901d44700 1 -- 172.21.15.52:0/754280582 learned_addr learned my addr 172.21.15.52:0/754280582 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0901543700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.111+0000 7f0902545700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08fc158500 0x7f08fc164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 -- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 msgr2=0x7f08fc150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 -- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08fc158500 msgr2=0x7f08fc164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08fc158500 0x7f08fc164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 -- 172.21.15.52:0/754280582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009370 con 0x7f08fc0c4220 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901543700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0901d44700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f08f400d890 tx=0x7f08f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40125f0 con 0x7f08fc0c4220 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4012750 con 0x7f08fc0c4220 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc0a71b0 con 0x7f08fc0c4220 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4012ad0 con 0x7f08fc0c4220 2023-05-10T01:26:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.112+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc1568a0 con 0x7f08fc0c4220 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.113+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc06c340 con 0x7f08fc0c4220 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.113+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f08f4013480 con 0x7f08fc0c4220 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.114+0000 7f08f9ffb700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 0x7f08dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.114+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f08f4079f70 con 0x7f08fc0c4220 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.114+0000 7f0901543700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 0x7f08dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.114+0000 7f0901543700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 0x7f08dc061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08f0006fd0 tx=0x7f08f0017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.118+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08f40a88f0 con 0x7f08fc0c4220 2023-05-10T01:26:22.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.330+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08fc0c2460 con 0x7f08fc0c4220 2023-05-10T01:26:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.330+0000 7f08f9ffb700 1 -- 172.21.15.52:0/754280582 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f08fc0c2460 con 0x7f08fc0c4220 2023-05-10T01:26:22.334 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:22.335 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 msgr2=0x7f08dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 0x7f08dc061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08f0006fd0 tx=0x7f08f0017000).stop 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 msgr2=0x7f08fc1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f08f400d890 tx=0x7f08f4008040).stop 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 shutdown_connections 2023-05-10T01:26:22.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f08dc05ed90 0x7f08dc061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08fc158500 0x7f08fc164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08fc0c4220 0x7f08fc1563b0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 --2- 172.21.15.52:0/754280582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08fc153cc0 0x7f08fc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 >> 172.21.15.52:0/754280582 conn(0x7f08fc0c7b40 msgr2=0x7f08fc0ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 shutdown_connections 2023-05-10T01:26:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.332+0000 7f0903fa8700 1 -- 172.21.15.52:0/754280582 wait complete. 2023-05-10T01:26:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:22.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.460+0000 7fae9e600700 1 Processor -- start 2023-05-10T01:26:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.460+0000 7fae9e600700 1 -- start start 2023-05-10T01:26:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9e600700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7370 0x7fae98154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9e600700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae980c7750 0x7fae980acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9e600700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae98158960 con 0x7fae980ad030 2023-05-10T01:26:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9e600700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae98155330 con 0x7fae980c7750 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9e600700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae98157d50 con 0x7fae980c7370 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9cdfd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae980c7750 0x7fae980acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9cdfd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae980c7750 0x7fae980acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38430/0 (socket says 172.21.15.52:38430) 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.461+0000 7fae9cdfd700 1 -- 172.21.15.52:0/1133095449 learned_addr learned my addr 172.21.15.52:0/1133095449 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9d5fe700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7370 0x7fae98154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9cdfd700 1 -- 172.21.15.52:0/1133095449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7370 msgr2=0x7fae98154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9cdfd700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7370 0x7fae98154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9cdfd700 1 -- 172.21.15.52:0/1133095449 >> v1:172.21.15.172:6789/0 conn(0x7fae980ad030 legacy=0x7fae9814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9cdfd700 1 -- 172.21.15.52:0/1133095449 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98158030 con 0x7fae980c7750 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae9cdfd700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7750 0x7fae980acb40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fae88006fd0 tx=0x7fae880090f0).ready entity=mon.0 client_cookie=fdee4f5bd982db33 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae87fff700 1 -- 172.21.15.52:0/1133095449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800b580 con 0x7fae980c7750 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae87fff700 1 -- 172.21.15.52:0/1133095449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800b6e0 con 0x7fae980c7750 2023-05-10T01:26:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.462+0000 7fae87fff700 1 -- 172.21.15.52:0/1133095449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800ba60 con 0x7fae980c7750 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 -- 172.21.15.52:0/1133095449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7750 msgr2=0x7fae980acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7750 0x7fae980acb40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fae88006fd0 tx=0x7fae880090f0).stop 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 -- 172.21.15.52:0/1133095449 shutdown_connections 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7370 0x7fae98154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 --2- 172.21.15.52:0/1133095449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7750 0x7fae980acb40 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 -- 172.21.15.52:0/1133095449 >> 172.21.15.52:0/1133095449 conn(0x7fae98068320 msgr2=0x7fae98068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 -- 172.21.15.52:0/1133095449 shutdown_connections 2023-05-10T01:26:22.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.463+0000 7fae9e600700 1 -- 172.21.15.52:0/1133095449 wait complete. 2023-05-10T01:26:22.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.464+0000 7fae9e600700 1 Processor -- start 2023-05-10T01:26:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.464+0000 7fae9e600700 1 -- start start 2023-05-10T01:26:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae980ad030 0x7fae981643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 0x7fae980afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980ae220 con 0x7fae980c7370 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98164980 con 0x7fae980ad030 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae98164c60 con 0x7fae980c7750 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38434/0 (socket says 172.21.15.52:38434) 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 -- 172.21.15.52:0/40636711 learned_addr learned my addr 172.21.15.52:0/40636711 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9d5fe700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae980ad030 0x7fae981643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9ddff700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 0x7fae980afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 -- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 msgr2=0x7fae980afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 0x7fae980afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 -- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae980ad030 msgr2=0x7fae981643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae980ad030 0x7fae981643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 -- 172.21.15.52:0/40636711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88009370 con 0x7fae980c7370 2023-05-10T01:26:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9ddff700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 0x7fae980afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9cdfd700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fae88011000 tx=0x7fae88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800b850 con 0x7fae980c7370 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800b9b0 con 0x7fae980c7370 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.465+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae98164f40 con 0x7fae980c7370 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.466+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8801c670 con 0x7fae980c7370 2023-05-10T01:26:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.466+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae98168860 con 0x7fae980c7370 2023-05-10T01:26:22.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.466+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae980ae3d0 con 0x7fae980c7370 2023-05-10T01:26:22.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.467+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae88022020 con 0x7fae980c7370 2023-05-10T01:26:22.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.467+0000 7fae857fa700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 0x7fae78061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.467+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fae8807b250 con 0x7fae980c7370 2023-05-10T01:26:22.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.467+0000 7fae9d5fe700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 0x7fae78061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.468+0000 7fae9d5fe700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 0x7fae78061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fae94009c30 tx=0x7fae94009060).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.471+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae980ae3d0 con 0x7fae980c7370 2023-05-10T01:26:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.644+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae980ae3d0 con 0x7fae980c7370 2023-05-10T01:26:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.645+0000 7fae857fa700 1 -- 172.21.15.52:0/40636711 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17442 (secure 0 0 0) 0x7fae980ae3d0 con 0x7fae980c7370 2023-05-10T01:26:22.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:22.650 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":122,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:19.949215+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 msgr2=0x7fae78061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 0x7fae78061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fae94009c30 tx=0x7fae94009060).stop 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 msgr2=0x7fae98168370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fae88011000 tx=0x7fae88017000).stop 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 shutdown_connections 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fae7805ed90 0x7fae78061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae980c7750 0x7fae980afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae980ad030 0x7fae981643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 --2- 172.21.15.52:0/40636711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae980c7370 0x7fae98168370 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.646+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 >> 172.21.15.52:0/40636711 conn(0x7fae98068320 msgr2=0x7fae9814f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.647+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 shutdown_connections 2023-05-10T01:26:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.647+0000 7fae9e600700 1 -- 172.21.15.52:0/40636711 wait complete. 2023-05-10T01:26:22.662 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:26:22.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:26:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.775+0000 7fb2ac1bc700 1 Processor -- start 2023-05-10T01:26:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.775+0000 7fb2ac1bc700 1 -- start start 2023-05-10T01:26:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2ac1bc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb2a4068f00 0x7fb2a4150f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2ac1bc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2a40bc8e0 0x7fb2a40bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2ac1bc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40a61c0 con 0x7fb2a4150b40 2023-05-10T01:26:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2ac1bc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4066320 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2ac1bc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a40bd230 con 0x7fb2a4068f00 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2aa759700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2a40bc8e0 0x7fb2a40bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2a9f58700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2a4150b40 0x7fb2a40a5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47456/0 (socket says 172.21.15.52:47456) 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2a9f58700 1 -- 172.21.15.52:0/1510192886 learned_addr learned my addr 172.21.15.52:0/1510192886 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.776+0000 7fb2a9757700 1 --2- 172.21.15.52:0/1510192886 >> v2:172.21.15.172:3300/0 conn(0x7fb2a4068f00 0x7fb2a4150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2aa759700 1 -- 172.21.15.52:0/1510192886 >> v2:172.21.15.172:3300/0 conn(0x7fb2a4068f00 msgr2=0x7fb2a4150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2aa759700 1 --2- 172.21.15.52:0/1510192886 >> v2:172.21.15.172:3300/0 conn(0x7fb2a4068f00 0x7fb2a4150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2aa759700 1 -- 172.21.15.52:0/1510192886 >> v1:172.21.15.52:6789/0 conn(0x7fb2a4150b40 legacy=0x7fb2a40a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2a8f56700 1 -- 172.21.15.52:0/1510192886 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224125944 0 0) 0x7fb2a40a61c0 con 0x7fb2a4150b40 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2aa759700 1 -- 172.21.15.52:0/1510192886 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4069400 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2aa759700 1 --2- 172.21.15.52:0/1510192886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a40bcd40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fb2a4062350 tx=0x7fb29c009780).ready entity=mon.0 client_cookie=e520caf7035acd90 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2a8f56700 1 -- 172.21.15.52:0/1510192886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00e070 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2a8f56700 1 -- 172.21.15.52:0/1510192886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c00bc30 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2a8f56700 1 -- 172.21.15.52:0/1510192886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c012410 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/1510192886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a40bc8e0 msgr2=0x7fb2a40bcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/1510192886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a40bcd40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fb2a4062350 tx=0x7fb29c009780).stop 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/1510192886 shutdown_connections 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/1510192886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a40bcd40 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/1510192886 >> v2:172.21.15.172:3300/0 conn(0x7fb2a4068f00 0x7fb2a4150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.777+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/1510192886 >> 172.21.15.52:0/1510192886 conn(0x7fb2a40c7340 msgr2=0x7fb2a40c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.778+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/1510192886 shutdown_connections 2023-05-10T01:26:22.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.778+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/1510192886 wait complete. 2023-05-10T01:26:22.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 Processor -- start 2023-05-10T01:26:22.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 -- start start 2023-05-10T01:26:22.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 0x7fb2a40abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a4144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40aae00 con 0x7fb2a4150b40 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40ab0e0 con 0x7fb2a40bc8e0 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2ac1bc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40ab3c0 con 0x7fb2a4068f00 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.779+0000 7fb2aa759700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38448/0 (socket says 172.21.15.52:38448) 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 -- 172.21.15.52:0/815631259 learned_addr learned my addr 172.21.15.52:0/815631259 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2a9f58700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 0x7fb2a40abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2a9757700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a4144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 -- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 msgr2=0x7fb2a40abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 0x7fb2a40abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 -- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2a40bc8e0 msgr2=0x7fb2a4144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a4144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 -- 172.21.15.52:0/815631259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c009a20 con 0x7fb2a4150b40 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2a9f58700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 0x7fb2a40abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2aa759700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fb2a4068060 tx=0x7fb29c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c01d630 con 0x7fb2a4150b40 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c01d790 con 0x7fb2a4150b40 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c01db30 con 0x7fb2a4150b40 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40ab6a0 con 0x7fb2a4150b40 2023-05-10T01:26:22.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.780+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40ac390 con 0x7fb2a4150b40 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.781+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a406c340 con 0x7fb2a4150b40 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.782+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb29c026410 con 0x7fb2a4150b40 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.782+0000 7fb291ffb700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 0x7fb284061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.782+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb29c07bfd0 con 0x7fb2a4150b40 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.782+0000 7fb2a9f58700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 0x7fb284061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.783+0000 7fb2a9f58700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 0x7fb284061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb2a0001710 tx=0x7fb2a0009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:22.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.786+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb29c04d400 con 0x7fb2a4150b40 2023-05-10T01:26:22.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.955+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2a4069f60 con 0x7fb28405ed90 2023-05-10T01:26:22.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.965+0000 7fb291ffb700 1 -- 172.21.15.52:0/815631259 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358507 (secure 0 0 0) 0x7fb2a4069f60 con 0x7fb28405ed90 2023-05-10T01:26:22.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:22.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 msgr2=0x7fb284061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 0x7fb284061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb2a0001710 tx=0x7fb2a0009040).stop 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 msgr2=0x7fb2a40be320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fb2a4068060 tx=0x7fb29c009780).stop 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 shutdown_connections 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb28405ed90 0x7fb284061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2a4150b40 0x7fb2a40be320 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2a4068f00 0x7fb2a40abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 --2- 172.21.15.52:0/815631259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2a40bc8e0 0x7fb2a4144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 >> 172.21.15.52:0/815631259 conn(0x7fb2a40c7340 msgr2=0x7fb2a40bb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 shutdown_connections 2023-05-10T01:26:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:22.969+0000 7fb2ac1bc700 1 -- 172.21.15.52:0/815631259 wait complete. 2023-05-10T01:26:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:26:22.987 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:26:21.588614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":163552,"kb_used_data":11488,"kb_used_omap":0,"kb_used_meta":152000,"kb_avail":754811168,"statfs":{"total":773094113280,"available":772926636032,"internally_reserved":0,"allocated":11763712,"data_stored":5959776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":155648000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19804,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.174073"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563300+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571497+0000","last_change":"2023-05-10T01:26:18.571497+0000","last_active":"2023-05-10T01:26:18.571497+0000","last_peered":"2023-05-10T01:26:18.571497+0000","last_clean":"2023-05-10T01:26:18.571497+0000","last_became_active":"2023-05-10T01:26:18.571204+0000","last_became_peered":"2023-05-10T01:26:18.571204+0000","last_unstale":"2023-05-10T01:26:18.571497+0000","last_undegraded":"2023-05-10T01:26:18.571497+0000","last_fullsized":"2023-05-10T01:26:18.571497+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562474+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561226+0000","last_change":"2023-05-10T01:26:18.561226+0000","last_active":"2023-05-10T01:26:18.561226+0000","last_peered":"2023-05-10T01:26:18.561226+0000","last_clean":"2023-05-10T01:26:18.561226+0000","last_became_active":"2023-05-10T01:26:18.560909+0000","last_became_peered":"2023-05-10T01:26:18.560909+0000","last_unstale":"2023-05-10T01:26:18.561226+0000","last_undegraded":"2023-05-10T01:26:18.561226+0000","last_fullsized":"2023-05-10T01:26:18.561226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556349+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568238+0000","last_change":"2023-05-10T01:26:18.568238+0000","last_active":"2023-05-10T01:26:18.568238+0000","last_peered":"2023-05-10T01:26:18.568238+0000","last_clean":"2023-05-10T01:26:18.568238+0000","last_became_active":"2023-05-10T01:26:18.567912+0000","last_became_peered":"2023-05-10T01:26:18.567912+0000","last_unstale":"2023-05-10T01:26:18.568238+0000","last_undegraded":"2023-05-10T01:26:18.568238+0000","last_fullsized":"2023-05-10T01:26:18.568238+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560448+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575171+0000","last_change":"2023-05-10T01:26:18.575171+0000","last_active":"2023-05-10T01:26:18.575171+0000","last_peered":"2023-05-10T01:26:18.575171+0000","last_clean":"2023-05-10T01:26:18.575171+0000","last_became_active":"2023-05-10T01:26:18.574795+0000","last_became_peered":"2023-05-10T01:26:18.574795+0000","last_unstale":"2023-05-10T01:26:18.575171+0000","last_undegraded":"2023-05-10T01:26:18.575171+0000","last_fullsized":"2023-05-10T01:26:18.575171+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563290+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575538+0000","last_change":"2023-05-10T01:26:18.575538+0000","last_active":"2023-05-10T01:26:18.575538+0000","last_peered":"2023-05-10T01:26:18.575538+0000","last_clean":"2023-05-10T01:26:18.575538+0000","last_became_active":"2023-05-10T01:26:18.575295+0000","last_became_peered":"2023-05-10T01:26:18.575295+0000","last_unstale":"2023-05-10T01:26:18.575538+0000","last_undegraded":"2023-05-10T01:26:18.575538+0000","last_fullsized":"2023-05-10T01:26:18.575538+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551985+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567857+0000","last_change":"2023-05-10T01:26:18.567857+0000","last_active":"2023-05-10T01:26:18.567857+0000","last_peered":"2023-05-10T01:26:18.567857+0000","last_clean":"2023-05-10T01:26:18.567857+0000","last_became_active":"2023-05-10T01:26:18.567563+0000","last_became_peered":"2023-05-10T01:26:18.567563+0000","last_unstale":"2023-05-10T01:26:18.567857+0000","last_undegraded":"2023-05-10T01:26:18.567857+0000","last_fullsized":"2023-05-10T01:26:18.567857+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555942+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567240+0000","last_change":"2023-05-10T01:26:18.567240+0000","last_active":"2023-05-10T01:26:18.567240+0000","last_peered":"2023-05-10T01:26:18.567240+0000","last_clean":"2023-05-10T01:26:18.567240+0000","last_became_active":"2023-05-10T01:26:18.567028+0000","last_became_peered":"2023-05-10T01:26:18.567028+0000","last_unstale":"2023-05-10T01:26:18.567240+0000","last_undegraded":"2023-05-10T01:26:18.567240+0000","last_fullsized":"2023-05-10T01:26:18.567240+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557059+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569917+0000","last_change":"2023-05-10T01:26:18.569917+0000","last_active":"2023-05-10T01:26:18.569917+0000","last_peered":"2023-05-10T01:26:18.569917+0000","last_clean":"2023-05-10T01:26:18.569917+0000","last_became_active":"2023-05-10T01:26:18.569637+0000","last_became_peered":"2023-05-10T01:26:18.569637+0000","last_unstale":"2023-05-10T01:26:18.569917+0000","last_undegraded":"2023-05-10T01:26:18.569917+0000","last_fullsized":"2023-05-10T01:26:18.569917+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555492+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570414+0000","last_change":"2023-05-10T01:26:18.570414+0000","last_active":"2023-05-10T01:26:18.570414+0000","last_peered":"2023-05-10T01:26:18.570414+0000","last_clean":"2023-05-10T01:26:18.570414+0000","last_became_active":"2023-05-10T01:26:18.570143+0000","last_became_peered":"2023-05-10T01:26:18.570143+0000","last_unstale":"2023-05-10T01:26:18.570414+0000","last_undegraded":"2023-05-10T01:26:18.570414+0000","last_fullsized":"2023-05-10T01:26:18.570414+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558565+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565303+0000","last_change":"2023-05-10T01:26:18.565303+0000","last_active":"2023-05-10T01:26:18.565303+0000","last_peered":"2023-05-10T01:26:18.565303+0000","last_clean":"2023-05-10T01:26:18.565303+0000","last_became_active":"2023-05-10T01:26:18.564990+0000","last_became_peered":"2023-05-10T01:26:18.564990+0000","last_unstale":"2023-05-10T01:26:18.565303+0000","last_undegraded":"2023-05-10T01:26:18.565303+0000","last_fullsized":"2023-05-10T01:26:18.565303+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556721+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573117+0000","last_change":"2023-05-10T01:26:18.573117+0000","last_active":"2023-05-10T01:26:18.573117+0000","last_peered":"2023-05-10T01:26:18.573117+0000","last_clean":"2023-05-10T01:26:18.573117+0000","last_became_active":"2023-05-10T01:26:18.572730+0000","last_became_peered":"2023-05-10T01:26:18.572730+0000","last_unstale":"2023-05-10T01:26:18.573117+0000","last_undegraded":"2023-05-10T01:26:18.573117+0000","last_fullsized":"2023-05-10T01:26:18.573117+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560972+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565872+0000","last_change":"2023-05-10T01:26:18.565872+0000","last_active":"2023-05-10T01:26:18.565872+0000","last_peered":"2023-05-10T01:26:18.565872+0000","last_clean":"2023-05-10T01:26:18.565872+0000","last_became_active":"2023-05-10T01:26:18.565544+0000","last_became_peered":"2023-05-10T01:26:18.565544+0000","last_unstale":"2023-05-10T01:26:18.565872+0000","last_undegraded":"2023-05-10T01:26:18.565872+0000","last_fullsized":"2023-05-10T01:26:18.565872+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557801+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565955+0000","last_change":"2023-05-10T01:26:18.565955+0000","last_active":"2023-05-10T01:26:18.565955+0000","last_peered":"2023-05-10T01:26:18.565955+0000","last_clean":"2023-05-10T01:26:18.565955+0000","last_became_active":"2023-05-10T01:26:18.565618+0000","last_became_peered":"2023-05-10T01:26:18.565618+0000","last_unstale":"2023-05-10T01:26:18.565955+0000","last_undegraded":"2023-05-10T01:26:18.565955+0000","last_fullsized":"2023-05-10T01:26:18.565955+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559704+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573304+0000","last_change":"2023-05-10T01:26:18.573304+0000","last_active":"2023-05-10T01:26:18.573304+0000","last_peered":"2023-05-10T01:26:18.573304+0000","last_clean":"2023-05-10T01:26:18.573304+0000","last_became_active":"2023-05-10T01:26:18.573011+0000","last_became_peered":"2023-05-10T01:26:18.573011+0000","last_unstale":"2023-05-10T01:26:18.573304+0000","last_undegraded":"2023-05-10T01:26:18.573304+0000","last_fullsized":"2023-05-10T01:26:18.573304+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557490+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572389+0000","last_change":"2023-05-10T01:26:18.572389+0000","last_active":"2023-05-10T01:26:18.572389+0000","last_peered":"2023-05-10T01:26:18.572389+0000","last_clean":"2023-05-10T01:26:18.572389+0000","last_became_active":"2023-05-10T01:26:18.572045+0000","last_became_peered":"2023-05-10T01:26:18.572045+0000","last_unstale":"2023-05-10T01:26:18.572389+0000","last_undegraded":"2023-05-10T01:26:18.572389+0000","last_fullsized":"2023-05-10T01:26:18.572389+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557614+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573081+0000","last_change":"2023-05-10T01:26:18.573081+0000","last_active":"2023-05-10T01:26:18.573081+0000","last_peered":"2023-05-10T01:26:18.573081+0000","last_clean":"2023-05-10T01:26:18.573081+0000","last_became_active":"2023-05-10T01:26:18.572641+0000","last_became_peered":"2023-05-10T01:26:18.572641+0000","last_unstale":"2023-05-10T01:26:18.573081+0000","last_undegraded":"2023-05-10T01:26:18.573081+0000","last_fullsized":"2023-05-10T01:26:18.573081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557681+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570935+0000","last_change":"2023-05-10T01:26:18.570935+0000","last_active":"2023-05-10T01:26:18.570935+0000","last_peered":"2023-05-10T01:26:18.570935+0000","last_clean":"2023-05-10T01:26:18.570935+0000","last_became_active":"2023-05-10T01:26:18.570644+0000","last_became_peered":"2023-05-10T01:26:18.570644+0000","last_unstale":"2023-05-10T01:26:18.570935+0000","last_undegraded":"2023-05-10T01:26:18.570935+0000","last_fullsized":"2023-05-10T01:26:18.570935+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557677+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573110+0000","last_change":"2023-05-10T01:26:18.573110+0000","last_active":"2023-05-10T01:26:18.573110+0000","last_peered":"2023-05-10T01:26:18.573110+0000","last_clean":"2023-05-10T01:26:18.573110+0000","last_became_active":"2023-05-10T01:26:18.572645+0000","last_became_peered":"2023-05-10T01:26:18.572645+0000","last_unstale":"2023-05-10T01:26:18.573110+0000","last_undegraded":"2023-05-10T01:26:18.573110+0000","last_fullsized":"2023-05-10T01:26:18.573110+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557431+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578477+0000","last_change":"2023-05-10T01:26:18.578477+0000","last_active":"2023-05-10T01:26:18.578477+0000","last_peered":"2023-05-10T01:26:18.578477+0000","last_clean":"2023-05-10T01:26:18.578477+0000","last_became_active":"2023-05-10T01:26:18.578107+0000","last_became_peered":"2023-05-10T01:26:18.578107+0000","last_unstale":"2023-05-10T01:26:18.578477+0000","last_undegraded":"2023-05-10T01:26:18.578477+0000","last_fullsized":"2023-05-10T01:26:18.578477+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558565+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573995+0000","last_change":"2023-05-10T01:26:18.573995+0000","last_active":"2023-05-10T01:26:18.573995+0000","last_peered":"2023-05-10T01:26:18.573995+0000","last_clean":"2023-05-10T01:26:18.573995+0000","last_became_active":"2023-05-10T01:26:18.573725+0000","last_became_peered":"2023-05-10T01:26:18.573725+0000","last_unstale":"2023-05-10T01:26:18.573995+0000","last_undegraded":"2023-05-10T01:26:18.573995+0000","last_fullsized":"2023-05-10T01:26:18.573995+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556906+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573187+0000","last_change":"2023-05-10T01:26:18.573187+0000","last_active":"2023-05-10T01:26:18.573187+0000","last_peered":"2023-05-10T01:26:18.573187+0000","last_clean":"2023-05-10T01:26:18.573187+0000","last_became_active":"2023-05-10T01:26:18.572833+0000","last_became_peered":"2023-05-10T01:26:18.572833+0000","last_unstale":"2023-05-10T01:26:18.573187+0000","last_undegraded":"2023-05-10T01:26:18.573187+0000","last_fullsized":"2023-05-10T01:26:18.573187+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.553363+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561026+0000","last_change":"2023-05-10T01:26:18.561026+0000","last_active":"2023-05-10T01:26:18.561026+0000","last_peered":"2023-05-10T01:26:18.561026+0000","last_clean":"2023-05-10T01:26:18.561026+0000","last_became_active":"2023-05-10T01:26:18.560672+0000","last_became_peered":"2023-05-10T01:26:18.560672+0000","last_unstale":"2023-05-10T01:26:18.561026+0000","last_undegraded":"2023-05-10T01:26:18.561026+0000","last_fullsized":"2023-05-10T01:26:18.561026+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557327+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.560867+0000","last_change":"2023-05-10T01:26:18.560867+0000","last_active":"2023-05-10T01:26:18.560867+0000","last_peered":"2023-05-10T01:26:18.560867+0000","last_clean":"2023-05-10T01:26:18.560867+0000","last_became_active":"2023-05-10T01:26:18.560517+0000","last_became_peered":"2023-05-10T01:26:18.560517+0000","last_unstale":"2023-05-10T01:26:18.560867+0000","last_undegraded":"2023-05-10T01:26:18.560867+0000","last_fullsized":"2023-05-10T01:26:18.560867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559818+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568747+0000","last_change":"2023-05-10T01:26:18.568747+0000","last_active":"2023-05-10T01:26:18.568747+0000","last_peered":"2023-05-10T01:26:18.568747+0000","last_clean":"2023-05-10T01:26:18.568747+0000","last_became_active":"2023-05-10T01:26:18.568459+0000","last_became_peered":"2023-05-10T01:26:18.568459+0000","last_unstale":"2023-05-10T01:26:18.568747+0000","last_undegraded":"2023-05-10T01:26:18.568747+0000","last_fullsized":"2023-05-10T01:26:18.568747+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563780+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572795+0000","last_change":"2023-05-10T01:26:18.572795+0000","last_active":"2023-05-10T01:26:18.572795+0000","last_peered":"2023-05-10T01:26:18.572795+0000","last_clean":"2023-05-10T01:26:18.572795+0000","last_became_active":"2023-05-10T01:26:18.572492+0000","last_became_peered":"2023-05-10T01:26:18.572492+0000","last_unstale":"2023-05-10T01:26:18.572795+0000","last_undegraded":"2023-05-10T01:26:18.572795+0000","last_fullsized":"2023-05-10T01:26:18.572795+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563029+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569164+0000","last_change":"2023-05-10T01:26:18.569164+0000","last_active":"2023-05-10T01:26:18.569164+0000","last_peered":"2023-05-10T01:26:18.569164+0000","last_clean":"2023-05-10T01:26:18.569164+0000","last_became_active":"2023-05-10T01:26:18.568880+0000","last_became_peered":"2023-05-10T01:26:18.568880+0000","last_unstale":"2023-05-10T01:26:18.569164+0000","last_undegraded":"2023-05-10T01:26:18.569164+0000","last_fullsized":"2023-05-10T01:26:18.569164+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555548+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579601+0000","last_change":"2023-05-10T01:26:18.579601+0000","last_active":"2023-05-10T01:26:18.579601+0000","last_peered":"2023-05-10T01:26:18.579601+0000","last_clean":"2023-05-10T01:26:18.579601+0000","last_became_active":"2023-05-10T01:26:18.579357+0000","last_became_peered":"2023-05-10T01:26:18.579357+0000","last_unstale":"2023-05-10T01:26:18.579601+0000","last_undegraded":"2023-05-10T01:26:18.579601+0000","last_fullsized":"2023-05-10T01:26:18.579601+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562847+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578551+0000","last_change":"2023-05-10T01:26:18.578551+0000","last_active":"2023-05-10T01:26:18.578551+0000","last_peered":"2023-05-10T01:26:18.578551+0000","last_clean":"2023-05-10T01:26:18.578551+0000","last_became_active":"2023-05-10T01:26:18.578284+0000","last_became_peered":"2023-05-10T01:26:18.578284+0000","last_unstale":"2023-05-10T01:26:18.578551+0000","last_undegraded":"2023-05-10T01:26:18.578551+0000","last_fullsized":"2023-05-10T01:26:18.578551+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559897+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.574810+0000","last_change":"2023-05-10T01:26:18.574810+0000","last_active":"2023-05-10T01:26:18.574810+0000","last_peered":"2023-05-10T01:26:18.574810+0000","last_clean":"2023-05-10T01:26:18.574810+0000","last_became_active":"2023-05-10T01:26:18.574499+0000","last_became_peered":"2023-05-10T01:26:18.574499+0000","last_unstale":"2023-05-10T01:26:18.574810+0000","last_undegraded":"2023-05-10T01:26:18.574810+0000","last_fullsized":"2023-05-10T01:26:18.574810+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560055+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579613+0000","last_change":"2023-05-10T01:26:18.579613+0000","last_active":"2023-05-10T01:26:18.579613+0000","last_peered":"2023-05-10T01:26:18.579613+0000","last_clean":"2023-05-10T01:26:18.579613+0000","last_became_active":"2023-05-10T01:26:18.579329+0000","last_became_peered":"2023-05-10T01:26:18.579329+0000","last_unstale":"2023-05-10T01:26:18.579613+0000","last_undegraded":"2023-05-10T01:26:18.579613+0000","last_fullsized":"2023-05-10T01:26:18.579613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559646+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573948+0000","last_change":"2023-05-10T01:26:18.573948+0000","last_active":"2023-05-10T01:26:18.573948+0000","last_peered":"2023-05-10T01:26:18.573948+0000","last_clean":"2023-05-10T01:26:18.573948+0000","last_became_active":"2023-05-10T01:26:18.573657+0000","last_became_peered":"2023-05-10T01:26:18.573657+0000","last_unstale":"2023-05-10T01:26:18.573948+0000","last_undegraded":"2023-05-10T01:26:18.573948+0000","last_fullsized":"2023-05-10T01:26:18.573948+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557994+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568537+0000","last_change":"2023-05-10T01:26:18.568537+0000","last_active":"2023-05-10T01:26:18.568537+0000","last_peered":"2023-05-10T01:26:18.568537+0000","last_clean":"2023-05-10T01:26:18.568537+0000","last_became_active":"2023-05-10T01:26:18.568280+0000","last_became_peered":"2023-05-10T01:26:18.568280+0000","last_unstale":"2023-05-10T01:26:18.568537+0000","last_undegraded":"2023-05-10T01:26:18.568537+0000","last_fullsized":"2023-05-10T01:26:18.568537+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.553999+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573919+0000","last_change":"2023-05-10T01:26:18.573919+0000","last_active":"2023-05-10T01:26:18.573919+0000","last_peered":"2023-05-10T01:26:18.573919+0000","last_clean":"2023-05-10T01:26:18.573919+0000","last_became_active":"2023-05-10T01:26:18.573623+0000","last_became_peered":"2023-05-10T01:26:18.573623+0000","last_unstale":"2023-05-10T01:26:18.573919+0000","last_undegraded":"2023-05-10T01:26:18.573919+0000","last_fullsized":"2023-05-10T01:26:18.573919+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557861+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.566612+0000","last_change":"2023-05-10T01:26:18.566612+0000","last_active":"2023-05-10T01:26:18.566612+0000","last_peered":"2023-05-10T01:26:18.566612+0000","last_clean":"2023-05-10T01:26:18.566612+0000","last_became_active":"2023-05-10T01:26:18.566339+0000","last_became_peered":"2023-05-10T01:26:18.566339+0000","last_unstale":"2023-05-10T01:26:18.566612+0000","last_undegraded":"2023-05-10T01:26:18.566612+0000","last_fullsized":"2023-05-10T01:26:18.566612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555826+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569910+0000","last_change":"2023-05-10T01:26:18.569910+0000","last_active":"2023-05-10T01:26:18.569910+0000","last_peered":"2023-05-10T01:26:18.569910+0000","last_clean":"2023-05-10T01:26:18.569910+0000","last_became_active":"2023-05-10T01:26:18.569422+0000","last_became_peered":"2023-05-10T01:26:18.569422+0000","last_unstale":"2023-05-10T01:26:18.569910+0000","last_undegraded":"2023-05-10T01:26:18.569910+0000","last_fullsized":"2023-05-10T01:26:18.569910+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552218+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565715+0000","last_change":"2023-05-10T01:26:18.565715+0000","last_active":"2023-05-10T01:26:18.565715+0000","last_peered":"2023-05-10T01:26:18.565715+0000","last_clean":"2023-05-10T01:26:18.565715+0000","last_became_active":"2023-05-10T01:26:18.565428+0000","last_became_peered":"2023-05-10T01:26:18.565428+0000","last_unstale":"2023-05-10T01:26:18.565715+0000","last_undegraded":"2023-05-10T01:26:18.565715+0000","last_fullsized":"2023-05-10T01:26:18.565715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556493+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569655+0000","last_change":"2023-05-10T01:26:18.569655+0000","last_active":"2023-05-10T01:26:18.569655+0000","last_peered":"2023-05-10T01:26:18.569655+0000","last_clean":"2023-05-10T01:26:18.569655+0000","last_became_active":"2023-05-10T01:26:18.569340+0000","last_became_peered":"2023-05-10T01:26:18.569340+0000","last_unstale":"2023-05-10T01:26:18.569655+0000","last_undegraded":"2023-05-10T01:26:18.569655+0000","last_fullsized":"2023-05-10T01:26:18.569655+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555564+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561470+0000","last_change":"2023-05-10T01:26:18.561470+0000","last_active":"2023-05-10T01:26:18.561470+0000","last_peered":"2023-05-10T01:26:18.561470+0000","last_clean":"2023-05-10T01:26:18.561470+0000","last_became_active":"2023-05-10T01:26:18.561192+0000","last_became_peered":"2023-05-10T01:26:18.561192+0000","last_unstale":"2023-05-10T01:26:18.561470+0000","last_undegraded":"2023-05-10T01:26:18.561470+0000","last_fullsized":"2023-05-10T01:26:18.561470+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557091+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570686+0000","last_change":"2023-05-10T01:26:18.570686+0000","last_active":"2023-05-10T01:26:18.570686+0000","last_peered":"2023-05-10T01:26:18.570686+0000","last_clean":"2023-05-10T01:26:18.570686+0000","last_became_active":"2023-05-10T01:26:18.569082+0000","last_became_peered":"2023-05-10T01:26:18.569082+0000","last_unstale":"2023-05-10T01:26:18.570686+0000","last_undegraded":"2023-05-10T01:26:18.570686+0000","last_fullsized":"2023-05-10T01:26:18.570686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556556+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568330+0000","last_change":"2023-05-10T01:26:18.568330+0000","last_active":"2023-05-10T01:26:18.568330+0000","last_peered":"2023-05-10T01:26:18.568330+0000","last_clean":"2023-05-10T01:26:18.568330+0000","last_became_active":"2023-05-10T01:26:18.568050+0000","last_became_peered":"2023-05-10T01:26:18.568050+0000","last_unstale":"2023-05-10T01:26:18.568330+0000","last_undegraded":"2023-05-10T01:26:18.568330+0000","last_fullsized":"2023-05-10T01:26:18.568330+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554484+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570874+0000","last_change":"2023-05-10T01:26:18.570874+0000","last_active":"2023-05-10T01:26:18.570874+0000","last_peered":"2023-05-10T01:26:18.570874+0000","last_clean":"2023-05-10T01:26:18.570874+0000","last_became_active":"2023-05-10T01:26:18.569744+0000","last_became_peered":"2023-05-10T01:26:18.569744+0000","last_unstale":"2023-05-10T01:26:18.570874+0000","last_undegraded":"2023-05-10T01:26:18.570874+0000","last_fullsized":"2023-05-10T01:26:18.570874+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554848+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.566957+0000","last_change":"2023-05-10T01:26:18.566957+0000","last_active":"2023-05-10T01:26:18.566957+0000","last_peered":"2023-05-10T01:26:18.566957+0000","last_clean":"2023-05-10T01:26:18.566957+0000","last_became_active":"2023-05-10T01:26:18.566513+0000","last_became_peered":"2023-05-10T01:26:18.566513+0000","last_unstale":"2023-05-10T01:26:18.566957+0000","last_undegraded":"2023-05-10T01:26:18.566957+0000","last_fullsized":"2023-05-10T01:26:18.566957+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562816+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571475+0000","last_change":"2023-05-10T01:26:18.571475+0000","last_active":"2023-05-10T01:26:18.571475+0000","last_peered":"2023-05-10T01:26:18.571475+0000","last_clean":"2023-05-10T01:26:18.571475+0000","last_became_active":"2023-05-10T01:26:18.569950+0000","last_became_peered":"2023-05-10T01:26:18.569950+0000","last_unstale":"2023-05-10T01:26:18.571475+0000","last_undegraded":"2023-05-10T01:26:18.571475+0000","last_fullsized":"2023-05-10T01:26:18.571475+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.561976+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573036+0000","last_change":"2023-05-10T01:26:18.573036+0000","last_active":"2023-05-10T01:26:18.573036+0000","last_peered":"2023-05-10T01:26:18.573036+0000","last_clean":"2023-05-10T01:26:18.573036+0000","last_became_active":"2023-05-10T01:26:18.572465+0000","last_became_peered":"2023-05-10T01:26:18.572465+0000","last_unstale":"2023-05-10T01:26:18.573036+0000","last_undegraded":"2023-05-10T01:26:18.573036+0000","last_fullsized":"2023-05-10T01:26:18.573036+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552327+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580354+0000","last_change":"2023-05-10T01:26:18.580354+0000","last_active":"2023-05-10T01:26:18.580354+0000","last_peered":"2023-05-10T01:26:18.580354+0000","last_clean":"2023-05-10T01:26:18.580354+0000","last_became_active":"2023-05-10T01:26:18.580040+0000","last_became_peered":"2023-05-10T01:26:18.580040+0000","last_unstale":"2023-05-10T01:26:18.580354+0000","last_undegraded":"2023-05-10T01:26:18.580354+0000","last_fullsized":"2023-05-10T01:26:18.580354+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556332+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567694+0000","last_change":"2023-05-10T01:26:18.567694+0000","last_active":"2023-05-10T01:26:18.567694+0000","last_peered":"2023-05-10T01:26:18.567694+0000","last_clean":"2023-05-10T01:26:18.567694+0000","last_became_active":"2023-05-10T01:26:18.567244+0000","last_became_peered":"2023-05-10T01:26:18.567244+0000","last_unstale":"2023-05-10T01:26:18.567694+0000","last_undegraded":"2023-05-10T01:26:18.567694+0000","last_fullsized":"2023-05-10T01:26:18.567694+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556246+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572168+0000","last_change":"2023-05-10T01:26:18.572168+0000","last_active":"2023-05-10T01:26:18.572168+0000","last_peered":"2023-05-10T01:26:18.572168+0000","last_clean":"2023-05-10T01:26:18.572168+0000","last_became_active":"2023-05-10T01:26:18.571872+0000","last_became_peered":"2023-05-10T01:26:18.571872+0000","last_unstale":"2023-05-10T01:26:18.572168+0000","last_undegraded":"2023-05-10T01:26:18.572168+0000","last_fullsized":"2023-05-10T01:26:18.572168+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554213+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569425+0000","last_change":"2023-05-10T01:26:18.569425+0000","last_active":"2023-05-10T01:26:18.569425+0000","last_peered":"2023-05-10T01:26:18.569425+0000","last_clean":"2023-05-10T01:26:18.569425+0000","last_became_active":"2023-05-10T01:26:18.569075+0000","last_became_peered":"2023-05-10T01:26:18.569075+0000","last_unstale":"2023-05-10T01:26:18.569425+0000","last_undegraded":"2023-05-10T01:26:18.569425+0000","last_fullsized":"2023-05-10T01:26:18.569425+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557434+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580476+0000","last_change":"2023-05-10T01:26:18.580476+0000","last_active":"2023-05-10T01:26:18.580476+0000","last_peered":"2023-05-10T01:26:18.580476+0000","last_clean":"2023-05-10T01:26:18.580476+0000","last_became_active":"2023-05-10T01:26:18.580007+0000","last_became_peered":"2023-05-10T01:26:18.580007+0000","last_unstale":"2023-05-10T01:26:18.580476+0000","last_undegraded":"2023-05-10T01:26:18.580476+0000","last_fullsized":"2023-05-10T01:26:18.580476+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555389+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.560982+0000","last_change":"2023-05-10T01:26:18.560982+0000","last_active":"2023-05-10T01:26:18.560982+0000","last_peered":"2023-05-10T01:26:18.560982+0000","last_clean":"2023-05-10T01:26:18.560982+0000","last_became_active":"2023-05-10T01:26:18.560649+0000","last_became_peered":"2023-05-10T01:26:18.560649+0000","last_unstale":"2023-05-10T01:26:18.560982+0000","last_undegraded":"2023-05-10T01:26:18.560982+0000","last_fullsized":"2023-05-10T01:26:18.560982+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557455+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575580+0000","last_change":"2023-05-10T01:26:18.575580+0000","last_active":"2023-05-10T01:26:18.575580+0000","last_peered":"2023-05-10T01:26:18.575580+0000","last_clean":"2023-05-10T01:26:18.575580+0000","last_became_active":"2023-05-10T01:26:18.575249+0000","last_became_peered":"2023-05-10T01:26:18.575249+0000","last_unstale":"2023-05-10T01:26:18.575580+0000","last_undegraded":"2023-05-10T01:26:18.575580+0000","last_fullsized":"2023-05-10T01:26:18.575580+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552700+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572138+0000","last_change":"2023-05-10T01:26:18.572138+0000","last_active":"2023-05-10T01:26:18.572138+0000","last_peered":"2023-05-10T01:26:18.572138+0000","last_clean":"2023-05-10T01:26:18.572138+0000","last_became_active":"2023-05-10T01:26:18.569386+0000","last_became_peered":"2023-05-10T01:26:18.569386+0000","last_unstale":"2023-05-10T01:26:18.572138+0000","last_undegraded":"2023-05-10T01:26:18.572138+0000","last_fullsized":"2023-05-10T01:26:18.572138+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555948+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569725+0000","last_change":"2023-05-10T01:26:18.569725+0000","last_active":"2023-05-10T01:26:18.569725+0000","last_peered":"2023-05-10T01:26:18.569725+0000","last_clean":"2023-05-10T01:26:18.569725+0000","last_became_active":"2023-05-10T01:26:18.569433+0000","last_became_peered":"2023-05-10T01:26:18.569433+0000","last_unstale":"2023-05-10T01:26:18.569725+0000","last_undegraded":"2023-05-10T01:26:18.569725+0000","last_fullsized":"2023-05-10T01:26:18.569725+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554866+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.576060+0000","last_change":"2023-05-10T01:26:18.576060+0000","last_active":"2023-05-10T01:26:18.576060+0000","last_peered":"2023-05-10T01:26:18.576060+0000","last_clean":"2023-05-10T01:26:18.576060+0000","last_became_active":"2023-05-10T01:26:18.575751+0000","last_became_peered":"2023-05-10T01:26:18.575751+0000","last_unstale":"2023-05-10T01:26:18.576060+0000","last_undegraded":"2023-05-10T01:26:18.576060+0000","last_fullsized":"2023-05-10T01:26:18.576060+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558196+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578645+0000","last_change":"2023-05-10T01:26:18.578645+0000","last_active":"2023-05-10T01:26:18.578645+0000","last_peered":"2023-05-10T01:26:18.578645+0000","last_clean":"2023-05-10T01:26:18.578645+0000","last_became_active":"2023-05-10T01:26:18.578350+0000","last_became_peered":"2023-05-10T01:26:18.578350+0000","last_unstale":"2023-05-10T01:26:18.578645+0000","last_undegraded":"2023-05-10T01:26:18.578645+0000","last_fullsized":"2023-05-10T01:26:18.578645+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551964+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580160+0000","last_change":"2023-05-10T01:26:18.580160+0000","last_active":"2023-05-10T01:26:18.580160+0000","last_peered":"2023-05-10T01:26:18.580160+0000","last_clean":"2023-05-10T01:26:18.580160+0000","last_became_active":"2023-05-10T01:26:18.576910+0000","last_became_peered":"2023-05-10T01:26:18.576910+0000","last_unstale":"2023-05-10T01:26:18.580160+0000","last_undegraded":"2023-05-10T01:26:18.580160+0000","last_fullsized":"2023-05-10T01:26:18.580160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557092+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569768+0000","last_change":"2023-05-10T01:26:18.569768+0000","last_active":"2023-05-10T01:26:18.569768+0000","last_peered":"2023-05-10T01:26:18.569768+0000","last_clean":"2023-05-10T01:26:18.569768+0000","last_became_active":"2023-05-10T01:26:18.569436+0000","last_became_peered":"2023-05-10T01:26:18.569436+0000","last_unstale":"2023-05-10T01:26:18.569768+0000","last_undegraded":"2023-05-10T01:26:18.569768+0000","last_fullsized":"2023-05-10T01:26:18.569768+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.546782+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:17.546782+0000","last_peered":"2023-05-10T01:26:17.546782+0000","last_clean":"2023-05-10T01:26:17.546782+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:17.546782+0000","last_undegraded":"2023-05-10T01:26:17.546782+0000","last_fullsized":"2023-05-10T01:26:17.546782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562850+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575263+0000","last_change":"2023-05-10T01:26:18.575263+0000","last_active":"2023-05-10T01:26:18.575263+0000","last_peered":"2023-05-10T01:26:18.575263+0000","last_clean":"2023-05-10T01:26:18.575263+0000","last_became_active":"2023-05-10T01:26:18.574988+0000","last_became_peered":"2023-05-10T01:26:18.574988+0000","last_unstale":"2023-05-10T01:26:18.575263+0000","last_undegraded":"2023-05-10T01:26:18.575263+0000","last_fullsized":"2023-05-10T01:26:18.575263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.548890+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:17.548890+0000","last_peered":"2023-05-10T01:26:17.548890+0000","last_clean":"2023-05-10T01:26:17.548890+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:17.548890+0000","last_undegraded":"2023-05-10T01:26:17.548890+0000","last_fullsized":"2023-05-10T01:26:17.548890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562398+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569662+0000","last_change":"2023-05-10T01:26:18.569662+0000","last_active":"2023-05-10T01:26:18.569662+0000","last_peered":"2023-05-10T01:26:18.569662+0000","last_clean":"2023-05-10T01:26:18.569662+0000","last_became_active":"2023-05-10T01:26:18.569358+0000","last_became_peered":"2023-05-10T01:26:18.569358+0000","last_unstale":"2023-05-10T01:26:18.569662+0000","last_undegraded":"2023-05-10T01:26:18.569662+0000","last_fullsized":"2023-05-10T01:26:18.569662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.541892+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:17.541892+0000","last_peered":"2023-05-10T01:26:17.541892+0000","last_clean":"2023-05-10T01:26:17.541892+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:17.541892+0000","last_undegraded":"2023-05-10T01:26:17.541892+0000","last_fullsized":"2023-05-10T01:26:17.541892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551974+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575798+0000","last_change":"2023-05-10T01:26:18.575798+0000","last_active":"2023-05-10T01:26:18.575798+0000","last_peered":"2023-05-10T01:26:18.575798+0000","last_clean":"2023-05-10T01:26:18.575798+0000","last_became_active":"2023-05-10T01:26:18.574943+0000","last_became_peered":"2023-05-10T01:26:18.574943+0000","last_unstale":"2023-05-10T01:26:18.575798+0000","last_undegraded":"2023-05-10T01:26:18.575798+0000","last_fullsized":"2023-05-10T01:26:18.575798+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.548757+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:17.548757+0000","last_peered":"2023-05-10T01:26:17.548757+0000","last_clean":"2023-05-10T01:26:17.548757+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:17.548757+0000","last_undegraded":"2023-05-10T01:26:17.548757+0000","last_fullsized":"2023-05-10T01:26:17.548757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550227+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:17.550227+0000","last_peered":"2023-05-10T01:26:17.550227+0000","last_clean":"2023-05-10T01:26:17.550227+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:17.550227+0000","last_undegraded":"2023-05-10T01:26:17.550227+0000","last_fullsized":"2023-05-10T01:26:17.550227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555154+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570758+0000","last_change":"2023-05-10T01:26:18.570758+0000","last_active":"2023-05-10T01:26:18.570758+0000","last_peered":"2023-05-10T01:26:18.570758+0000","last_clean":"2023-05-10T01:26:18.570758+0000","last_became_active":"2023-05-10T01:26:18.570490+0000","last_became_peered":"2023-05-10T01:26:18.570490+0000","last_unstale":"2023-05-10T01:26:18.570758+0000","last_undegraded":"2023-05-10T01:26:18.570758+0000","last_fullsized":"2023-05-10T01:26:18.570758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550192+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:17.550192+0000","last_peered":"2023-05-10T01:26:17.550192+0000","last_clean":"2023-05-10T01:26:17.550192+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:17.550192+0000","last_undegraded":"2023-05-10T01:26:17.550192+0000","last_fullsized":"2023-05-10T01:26:17.550192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554707+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578122+0000","last_change":"2023-05-10T01:26:18.578122+0000","last_active":"2023-05-10T01:26:18.578122+0000","last_peered":"2023-05-10T01:26:18.578122+0000","last_clean":"2023-05-10T01:26:18.578122+0000","last_became_active":"2023-05-10T01:26:18.577601+0000","last_became_peered":"2023-05-10T01:26:18.577601+0000","last_unstale":"2023-05-10T01:26:18.578122+0000","last_undegraded":"2023-05-10T01:26:18.578122+0000","last_fullsized":"2023-05-10T01:26:18.578122+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550258+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:17.550258+0000","last_peered":"2023-05-10T01:26:17.550258+0000","last_clean":"2023-05-10T01:26:17.550258+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:17.550258+0000","last_undegraded":"2023-05-10T01:26:17.550258+0000","last_fullsized":"2023-05-10T01:26:17.550258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563984+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.574188+0000","last_change":"2023-05-10T01:26:18.574188+0000","last_active":"2023-05-10T01:26:18.574188+0000","last_peered":"2023-05-10T01:26:18.574188+0000","last_clean":"2023-05-10T01:26:18.574188+0000","last_became_active":"2023-05-10T01:26:18.573881+0000","last_became_peered":"2023-05-10T01:26:18.573881+0000","last_unstale":"2023-05-10T01:26:18.574188+0000","last_undegraded":"2023-05-10T01:26:18.574188+0000","last_fullsized":"2023-05-10T01:26:18.574188+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.546140+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:17.546140+0000","last_peered":"2023-05-10T01:26:17.546140+0000","last_clean":"2023-05-10T01:26:17.546140+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:17.546140+0000","last_undegraded":"2023-05-10T01:26:17.546140+0000","last_fullsized":"2023-05-10T01:26:17.546140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556787+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578734+0000","last_change":"2023-05-10T01:26:18.578734+0000","last_active":"2023-05-10T01:26:18.578734+0000","last_peered":"2023-05-10T01:26:18.578734+0000","last_clean":"2023-05-10T01:26:18.578734+0000","last_became_active":"2023-05-10T01:26:18.577120+0000","last_became_peered":"2023-05-10T01:26:18.577120+0000","last_unstale":"2023-05-10T01:26:18.578734+0000","last_undegraded":"2023-05-10T01:26:18.578734+0000","last_fullsized":"2023-05-10T01:26:18.578734+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.544602+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:17.544602+0000","last_peered":"2023-05-10T01:26:17.544602+0000","last_clean":"2023-05-10T01:26:17.544602+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:17.544602+0000","last_undegraded":"2023-05-10T01:26:17.544602+0000","last_fullsized":"2023-05-10T01:26:17.544602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353500,"statfs":{"total":96636764160,"available":96617984000,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.44},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17828,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354012,"statfs":{"total":96636764160,"available":96618508288,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70999999999999996}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.69699999999999995}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68300000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.745},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21796,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":20352,"kb_avail":94350044,"statfs":{"total":96636764160,"available":96614445056,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20840448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.27200000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.30399999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.223},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.311}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17444,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354396,"statfs":{"total":96636764160,"available":96618901504,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.504}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.59099999999999997}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.748},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23012,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94348828,"statfs":{"total":96636764160,"available":96613199872,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.313},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.372}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.499}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.373}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18084,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353756,"statfs":{"total":96636764160,"available":96618246144,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.626},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.752},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21220,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94350620,"statfs":{"total":96636764160,"available":96615034880,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.45800000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.497},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.47899999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:26:22.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:26:23.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.138+0000 7f68a62ce700 1 Processor -- start 2023-05-10T01:26:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.138+0000 7f68a62ce700 1 -- start start 2023-05-10T01:26:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a62ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68a0154160 0x7f68a00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a62ce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f68a0069da0 0x7f68a00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a62ce700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00c0650 con 0x7f68a0154540 2023-05-10T01:26:23.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a62ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00c1af0 con 0x7f68a0154160 2023-05-10T01:26:23.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a62ce700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00bfd20 con 0x7f68a0069da0 2023-05-10T01:26:23.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f689ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68a0154160 0x7f68a00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f689ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f68a0154160 0x7f68a00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38454/0 (socket says 172.21.15.52:38454) 2023-05-10T01:26:23.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f689ffff700 1 -- 172.21.15.52:0/1498703845 learned_addr learned my addr 172.21.15.52:0/1498703845 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:23.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.139+0000 7f68a486b700 1 --2- 172.21.15.52:0/1498703845 >> v2:172.21.15.172:3300/0 conn(0x7f68a0069da0 0x7f68a00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689ffff700 1 -- 172.21.15.52:0/1498703845 >> v2:172.21.15.172:3300/0 conn(0x7f68a0069da0 msgr2=0x7f68a00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689ffff700 1 --2- 172.21.15.52:0/1498703845 >> v2:172.21.15.172:3300/0 conn(0x7f68a0069da0 0x7f68a00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689ffff700 1 -- 172.21.15.52:0/1498703845 >> v1:172.21.15.172:6789/0 conn(0x7f68a0154540 legacy=0x7f68a0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689ffff700 1 -- 172.21.15.52:0/1498703845 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00c0000 con 0x7f68a0154160 2023-05-10T01:26:23.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689ffff700 1 --2- 172.21.15.52:0/1498703845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0154160 0x7f68a00c5c60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f68a00c5200 tx=0x7f68900090f0).ready entity=mon.0 client_cookie=d9a19ee51d0ace91 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689f7fe700 1 -- 172.21.15.52:0/1498703845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000b520 con 0x7f68a0154160 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689f7fe700 1 -- 172.21.15.52:0/1498703845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000b680 con 0x7f68a0154160 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f689f7fe700 1 -- 172.21.15.52:0/1498703845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000ba00 con 0x7f68a0154160 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 -- 172.21.15.52:0/1498703845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0154160 msgr2=0x7f68a00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 --2- 172.21.15.52:0/1498703845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0154160 0x7f68a00c5c60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f68a00c5200 tx=0x7f68900090f0).stop 2023-05-10T01:26:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 -- 172.21.15.52:0/1498703845 shutdown_connections 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 --2- 172.21.15.52:0/1498703845 >> v2:172.21.15.172:3300/0 conn(0x7f68a0069da0 0x7f68a00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 --2- 172.21.15.52:0/1498703845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0154160 0x7f68a00c5c60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 -- 172.21.15.52:0/1498703845 >> 172.21.15.52:0/1498703845 conn(0x7f68a00cb740 msgr2=0x7f68a00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 -- 172.21.15.52:0/1498703845 shutdown_connections 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.140+0000 7f68a62ce700 1 -- 172.21.15.52:0/1498703845 wait complete. 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 Processor -- start 2023-05-10T01:26:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 -- start start 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f68a0154160 0x7f68a00c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 0x7f68a00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01537f0 con 0x7f68a0069da0 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0159cc0 con 0x7f68a0154540 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f68a62ce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01590b0 con 0x7f68a0154160 2023-05-10T01:26:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f689ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f689ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38460/0 (socket says 172.21.15.52:38460) 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.142+0000 7f689ffff700 1 -- 172.21.15.52:0/257927639 learned_addr learned my addr 172.21.15.52:0/257927639 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f68a486b700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 0x7f68a00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f6897fff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f68a0154160 0x7f68a00c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 -- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f68a0154160 msgr2=0x7f68a00c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f68a0154160 0x7f68a00c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 -- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 msgr2=0x7f68a00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 0x7f68a00aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 -- 172.21.15.52:0/257927639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009370 con 0x7f68a0069da0 2023-05-10T01:26:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f68a486b700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 0x7f68a00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689ffff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f68a0083050 tx=0x7f6890017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000b7f0 con 0x7f68a0069da0 2023-05-10T01:26:23.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000b950 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689001c650 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a0159390 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.143+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01599d0 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.144+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a00666b0 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.144+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f689002c070 con 0x7f68a0069da0 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.145+0000 7f689cff9700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 0x7f6884061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.145+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f689007b6e0 con 0x7f68a0069da0 2023-05-10T01:26:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.145+0000 7f6897fff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 0x7f6884061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.145+0000 7f6897fff700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 0x7f6884061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f68a01533f0 tx=0x7f6888009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.149+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f689004cb70 con 0x7f68a0069da0 2023-05-10T01:26:23.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.317+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68a006c340 con 0x7f688405ed60 2023-05-10T01:26:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.328+0000 7f689cff9700 1 -- 172.21.15.52:0/257927639 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358507 (secure 0 0 0) 0x7f68a006c340 con 0x7f688405ed60 2023-05-10T01:26:23.337 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 msgr2=0x7f6884061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 0x7f6884061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f68a01533f0 tx=0x7f6888009040).stop 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 msgr2=0x7f68a0157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f68a0083050 tx=0x7f6890017000).stop 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 shutdown_connections 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f688405ed60 0x7f6884061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68a0154540 0x7f68a00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a0069da0 0x7f68a0157050 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 --2- 172.21.15.52:0/257927639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f68a0154160 0x7f68a00c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 >> 172.21.15.52:0/257927639 conn(0x7f68a00cb740 msgr2=0x7f68a00aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 shutdown_connections 2023-05-10T01:26:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.331+0000 7f68a62ce700 1 -- 172.21.15.52:0/257927639 wait complete. 2023-05-10T01:26:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:26:23.349 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:26:21.588614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":163552,"kb_used_data":11488,"kb_used_omap":0,"kb_used_meta":152000,"kb_avail":754811168,"statfs":{"total":773094113280,"available":772926636032,"internally_reserved":0,"allocated":11763712,"data_stored":5959776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":155648000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19804,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.174073"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563300+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571497+0000","last_change":"2023-05-10T01:26:18.571497+0000","last_active":"2023-05-10T01:26:18.571497+0000","last_peered":"2023-05-10T01:26:18.571497+0000","last_clean":"2023-05-10T01:26:18.571497+0000","last_became_active":"2023-05-10T01:26:18.571204+0000","last_became_peered":"2023-05-10T01:26:18.571204+0000","last_unstale":"2023-05-10T01:26:18.571497+0000","last_undegraded":"2023-05-10T01:26:18.571497+0000","last_fullsized":"2023-05-10T01:26:18.571497+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562474+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561226+0000","last_change":"2023-05-10T01:26:18.561226+0000","last_active":"2023-05-10T01:26:18.561226+0000","last_peered":"2023-05-10T01:26:18.561226+0000","last_clean":"2023-05-10T01:26:18.561226+0000","last_became_active":"2023-05-10T01:26:18.560909+0000","last_became_peered":"2023-05-10T01:26:18.560909+0000","last_unstale":"2023-05-10T01:26:18.561226+0000","last_undegraded":"2023-05-10T01:26:18.561226+0000","last_fullsized":"2023-05-10T01:26:18.561226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556349+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568238+0000","last_change":"2023-05-10T01:26:18.568238+0000","last_active":"2023-05-10T01:26:18.568238+0000","last_peered":"2023-05-10T01:26:18.568238+0000","last_clean":"2023-05-10T01:26:18.568238+0000","last_became_active":"2023-05-10T01:26:18.567912+0000","last_became_peered":"2023-05-10T01:26:18.567912+0000","last_unstale":"2023-05-10T01:26:18.568238+0000","last_undegraded":"2023-05-10T01:26:18.568238+0000","last_fullsized":"2023-05-10T01:26:18.568238+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560448+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575171+0000","last_change":"2023-05-10T01:26:18.575171+0000","last_active":"2023-05-10T01:26:18.575171+0000","last_peered":"2023-05-10T01:26:18.575171+0000","last_clean":"2023-05-10T01:26:18.575171+0000","last_became_active":"2023-05-10T01:26:18.574795+0000","last_became_peered":"2023-05-10T01:26:18.574795+0000","last_unstale":"2023-05-10T01:26:18.575171+0000","last_undegraded":"2023-05-10T01:26:18.575171+0000","last_fullsized":"2023-05-10T01:26:18.575171+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563290+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575538+0000","last_change":"2023-05-10T01:26:18.575538+0000","last_active":"2023-05-10T01:26:18.575538+0000","last_peered":"2023-05-10T01:26:18.575538+0000","last_clean":"2023-05-10T01:26:18.575538+0000","last_became_active":"2023-05-10T01:26:18.575295+0000","last_became_peered":"2023-05-10T01:26:18.575295+0000","last_unstale":"2023-05-10T01:26:18.575538+0000","last_undegraded":"2023-05-10T01:26:18.575538+0000","last_fullsized":"2023-05-10T01:26:18.575538+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551985+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567857+0000","last_change":"2023-05-10T01:26:18.567857+0000","last_active":"2023-05-10T01:26:18.567857+0000","last_peered":"2023-05-10T01:26:18.567857+0000","last_clean":"2023-05-10T01:26:18.567857+0000","last_became_active":"2023-05-10T01:26:18.567563+0000","last_became_peered":"2023-05-10T01:26:18.567563+0000","last_unstale":"2023-05-10T01:26:18.567857+0000","last_undegraded":"2023-05-10T01:26:18.567857+0000","last_fullsized":"2023-05-10T01:26:18.567857+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555942+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567240+0000","last_change":"2023-05-10T01:26:18.567240+0000","last_active":"2023-05-10T01:26:18.567240+0000","last_peered":"2023-05-10T01:26:18.567240+0000","last_clean":"2023-05-10T01:26:18.567240+0000","last_became_active":"2023-05-10T01:26:18.567028+0000","last_became_peered":"2023-05-10T01:26:18.567028+0000","last_unstale":"2023-05-10T01:26:18.567240+0000","last_undegraded":"2023-05-10T01:26:18.567240+0000","last_fullsized":"2023-05-10T01:26:18.567240+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557059+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569917+0000","last_change":"2023-05-10T01:26:18.569917+0000","last_active":"2023-05-10T01:26:18.569917+0000","last_peered":"2023-05-10T01:26:18.569917+0000","last_clean":"2023-05-10T01:26:18.569917+0000","last_became_active":"2023-05-10T01:26:18.569637+0000","last_became_peered":"2023-05-10T01:26:18.569637+0000","last_unstale":"2023-05-10T01:26:18.569917+0000","last_undegraded":"2023-05-10T01:26:18.569917+0000","last_fullsized":"2023-05-10T01:26:18.569917+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555492+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570414+0000","last_change":"2023-05-10T01:26:18.570414+0000","last_active":"2023-05-10T01:26:18.570414+0000","last_peered":"2023-05-10T01:26:18.570414+0000","last_clean":"2023-05-10T01:26:18.570414+0000","last_became_active":"2023-05-10T01:26:18.570143+0000","last_became_peered":"2023-05-10T01:26:18.570143+0000","last_unstale":"2023-05-10T01:26:18.570414+0000","last_undegraded":"2023-05-10T01:26:18.570414+0000","last_fullsized":"2023-05-10T01:26:18.570414+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558565+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565303+0000","last_change":"2023-05-10T01:26:18.565303+0000","last_active":"2023-05-10T01:26:18.565303+0000","last_peered":"2023-05-10T01:26:18.565303+0000","last_clean":"2023-05-10T01:26:18.565303+0000","last_became_active":"2023-05-10T01:26:18.564990+0000","last_became_peered":"2023-05-10T01:26:18.564990+0000","last_unstale":"2023-05-10T01:26:18.565303+0000","last_undegraded":"2023-05-10T01:26:18.565303+0000","last_fullsized":"2023-05-10T01:26:18.565303+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556721+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573117+0000","last_change":"2023-05-10T01:26:18.573117+0000","last_active":"2023-05-10T01:26:18.573117+0000","last_peered":"2023-05-10T01:26:18.573117+0000","last_clean":"2023-05-10T01:26:18.573117+0000","last_became_active":"2023-05-10T01:26:18.572730+0000","last_became_peered":"2023-05-10T01:26:18.572730+0000","last_unstale":"2023-05-10T01:26:18.573117+0000","last_undegraded":"2023-05-10T01:26:18.573117+0000","last_fullsized":"2023-05-10T01:26:18.573117+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560972+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565872+0000","last_change":"2023-05-10T01:26:18.565872+0000","last_active":"2023-05-10T01:26:18.565872+0000","last_peered":"2023-05-10T01:26:18.565872+0000","last_clean":"2023-05-10T01:26:18.565872+0000","last_became_active":"2023-05-10T01:26:18.565544+0000","last_became_peered":"2023-05-10T01:26:18.565544+0000","last_unstale":"2023-05-10T01:26:18.565872+0000","last_undegraded":"2023-05-10T01:26:18.565872+0000","last_fullsized":"2023-05-10T01:26:18.565872+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557801+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565955+0000","last_change":"2023-05-10T01:26:18.565955+0000","last_active":"2023-05-10T01:26:18.565955+0000","last_peered":"2023-05-10T01:26:18.565955+0000","last_clean":"2023-05-10T01:26:18.565955+0000","last_became_active":"2023-05-10T01:26:18.565618+0000","last_became_peered":"2023-05-10T01:26:18.565618+0000","last_unstale":"2023-05-10T01:26:18.565955+0000","last_undegraded":"2023-05-10T01:26:18.565955+0000","last_fullsized":"2023-05-10T01:26:18.565955+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559704+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573304+0000","last_change":"2023-05-10T01:26:18.573304+0000","last_active":"2023-05-10T01:26:18.573304+0000","last_peered":"2023-05-10T01:26:18.573304+0000","last_clean":"2023-05-10T01:26:18.573304+0000","last_became_active":"2023-05-10T01:26:18.573011+0000","last_became_peered":"2023-05-10T01:26:18.573011+0000","last_unstale":"2023-05-10T01:26:18.573304+0000","last_undegraded":"2023-05-10T01:26:18.573304+0000","last_fullsized":"2023-05-10T01:26:18.573304+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557490+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572389+0000","last_change":"2023-05-10T01:26:18.572389+0000","last_active":"2023-05-10T01:26:18.572389+0000","last_peered":"2023-05-10T01:26:18.572389+0000","last_clean":"2023-05-10T01:26:18.572389+0000","last_became_active":"2023-05-10T01:26:18.572045+0000","last_became_peered":"2023-05-10T01:26:18.572045+0000","last_unstale":"2023-05-10T01:26:18.572389+0000","last_undegraded":"2023-05-10T01:26:18.572389+0000","last_fullsized":"2023-05-10T01:26:18.572389+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557614+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573081+0000","last_change":"2023-05-10T01:26:18.573081+0000","last_active":"2023-05-10T01:26:18.573081+0000","last_peered":"2023-05-10T01:26:18.573081+0000","last_clean":"2023-05-10T01:26:18.573081+0000","last_became_active":"2023-05-10T01:26:18.572641+0000","last_became_peered":"2023-05-10T01:26:18.572641+0000","last_unstale":"2023-05-10T01:26:18.573081+0000","last_undegraded":"2023-05-10T01:26:18.573081+0000","last_fullsized":"2023-05-10T01:26:18.573081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557681+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570935+0000","last_change":"2023-05-10T01:26:18.570935+0000","last_active":"2023-05-10T01:26:18.570935+0000","last_peered":"2023-05-10T01:26:18.570935+0000","last_clean":"2023-05-10T01:26:18.570935+0000","last_became_active":"2023-05-10T01:26:18.570644+0000","last_became_peered":"2023-05-10T01:26:18.570644+0000","last_unstale":"2023-05-10T01:26:18.570935+0000","last_undegraded":"2023-05-10T01:26:18.570935+0000","last_fullsized":"2023-05-10T01:26:18.570935+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557677+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573110+0000","last_change":"2023-05-10T01:26:18.573110+0000","last_active":"2023-05-10T01:26:18.573110+0000","last_peered":"2023-05-10T01:26:18.573110+0000","last_clean":"2023-05-10T01:26:18.573110+0000","last_became_active":"2023-05-10T01:26:18.572645+0000","last_became_peered":"2023-05-10T01:26:18.572645+0000","last_unstale":"2023-05-10T01:26:18.573110+0000","last_undegraded":"2023-05-10T01:26:18.573110+0000","last_fullsized":"2023-05-10T01:26:18.573110+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557431+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578477+0000","last_change":"2023-05-10T01:26:18.578477+0000","last_active":"2023-05-10T01:26:18.578477+0000","last_peered":"2023-05-10T01:26:18.578477+0000","last_clean":"2023-05-10T01:26:18.578477+0000","last_became_active":"2023-05-10T01:26:18.578107+0000","last_became_peered":"2023-05-10T01:26:18.578107+0000","last_unstale":"2023-05-10T01:26:18.578477+0000","last_undegraded":"2023-05-10T01:26:18.578477+0000","last_fullsized":"2023-05-10T01:26:18.578477+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558565+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573995+0000","last_change":"2023-05-10T01:26:18.573995+0000","last_active":"2023-05-10T01:26:18.573995+0000","last_peered":"2023-05-10T01:26:18.573995+0000","last_clean":"2023-05-10T01:26:18.573995+0000","last_became_active":"2023-05-10T01:26:18.573725+0000","last_became_peered":"2023-05-10T01:26:18.573725+0000","last_unstale":"2023-05-10T01:26:18.573995+0000","last_undegraded":"2023-05-10T01:26:18.573995+0000","last_fullsized":"2023-05-10T01:26:18.573995+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556906+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573187+0000","last_change":"2023-05-10T01:26:18.573187+0000","last_active":"2023-05-10T01:26:18.573187+0000","last_peered":"2023-05-10T01:26:18.573187+0000","last_clean":"2023-05-10T01:26:18.573187+0000","last_became_active":"2023-05-10T01:26:18.572833+0000","last_became_peered":"2023-05-10T01:26:18.572833+0000","last_unstale":"2023-05-10T01:26:18.573187+0000","last_undegraded":"2023-05-10T01:26:18.573187+0000","last_fullsized":"2023-05-10T01:26:18.573187+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.553363+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561026+0000","last_change":"2023-05-10T01:26:18.561026+0000","last_active":"2023-05-10T01:26:18.561026+0000","last_peered":"2023-05-10T01:26:18.561026+0000","last_clean":"2023-05-10T01:26:18.561026+0000","last_became_active":"2023-05-10T01:26:18.560672+0000","last_became_peered":"2023-05-10T01:26:18.560672+0000","last_unstale":"2023-05-10T01:26:18.561026+0000","last_undegraded":"2023-05-10T01:26:18.561026+0000","last_fullsized":"2023-05-10T01:26:18.561026+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557327+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.560867+0000","last_change":"2023-05-10T01:26:18.560867+0000","last_active":"2023-05-10T01:26:18.560867+0000","last_peered":"2023-05-10T01:26:18.560867+0000","last_clean":"2023-05-10T01:26:18.560867+0000","last_became_active":"2023-05-10T01:26:18.560517+0000","last_became_peered":"2023-05-10T01:26:18.560517+0000","last_unstale":"2023-05-10T01:26:18.560867+0000","last_undegraded":"2023-05-10T01:26:18.560867+0000","last_fullsized":"2023-05-10T01:26:18.560867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559818+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568747+0000","last_change":"2023-05-10T01:26:18.568747+0000","last_active":"2023-05-10T01:26:18.568747+0000","last_peered":"2023-05-10T01:26:18.568747+0000","last_clean":"2023-05-10T01:26:18.568747+0000","last_became_active":"2023-05-10T01:26:18.568459+0000","last_became_peered":"2023-05-10T01:26:18.568459+0000","last_unstale":"2023-05-10T01:26:18.568747+0000","last_undegraded":"2023-05-10T01:26:18.568747+0000","last_fullsized":"2023-05-10T01:26:18.568747+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563780+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572795+0000","last_change":"2023-05-10T01:26:18.572795+0000","last_active":"2023-05-10T01:26:18.572795+0000","last_peered":"2023-05-10T01:26:18.572795+0000","last_clean":"2023-05-10T01:26:18.572795+0000","last_became_active":"2023-05-10T01:26:18.572492+0000","last_became_peered":"2023-05-10T01:26:18.572492+0000","last_unstale":"2023-05-10T01:26:18.572795+0000","last_undegraded":"2023-05-10T01:26:18.572795+0000","last_fullsized":"2023-05-10T01:26:18.572795+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563029+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569164+0000","last_change":"2023-05-10T01:26:18.569164+0000","last_active":"2023-05-10T01:26:18.569164+0000","last_peered":"2023-05-10T01:26:18.569164+0000","last_clean":"2023-05-10T01:26:18.569164+0000","last_became_active":"2023-05-10T01:26:18.568880+0000","last_became_peered":"2023-05-10T01:26:18.568880+0000","last_unstale":"2023-05-10T01:26:18.569164+0000","last_undegraded":"2023-05-10T01:26:18.569164+0000","last_fullsized":"2023-05-10T01:26:18.569164+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555548+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579601+0000","last_change":"2023-05-10T01:26:18.579601+0000","last_active":"2023-05-10T01:26:18.579601+0000","last_peered":"2023-05-10T01:26:18.579601+0000","last_clean":"2023-05-10T01:26:18.579601+0000","last_became_active":"2023-05-10T01:26:18.579357+0000","last_became_peered":"2023-05-10T01:26:18.579357+0000","last_unstale":"2023-05-10T01:26:18.579601+0000","last_undegraded":"2023-05-10T01:26:18.579601+0000","last_fullsized":"2023-05-10T01:26:18.579601+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562847+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578551+0000","last_change":"2023-05-10T01:26:18.578551+0000","last_active":"2023-05-10T01:26:18.578551+0000","last_peered":"2023-05-10T01:26:18.578551+0000","last_clean":"2023-05-10T01:26:18.578551+0000","last_became_active":"2023-05-10T01:26:18.578284+0000","last_became_peered":"2023-05-10T01:26:18.578284+0000","last_unstale":"2023-05-10T01:26:18.578551+0000","last_undegraded":"2023-05-10T01:26:18.578551+0000","last_fullsized":"2023-05-10T01:26:18.578551+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559897+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.574810+0000","last_change":"2023-05-10T01:26:18.574810+0000","last_active":"2023-05-10T01:26:18.574810+0000","last_peered":"2023-05-10T01:26:18.574810+0000","last_clean":"2023-05-10T01:26:18.574810+0000","last_became_active":"2023-05-10T01:26:18.574499+0000","last_became_peered":"2023-05-10T01:26:18.574499+0000","last_unstale":"2023-05-10T01:26:18.574810+0000","last_undegraded":"2023-05-10T01:26:18.574810+0000","last_fullsized":"2023-05-10T01:26:18.574810+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.560055+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579613+0000","last_change":"2023-05-10T01:26:18.579613+0000","last_active":"2023-05-10T01:26:18.579613+0000","last_peered":"2023-05-10T01:26:18.579613+0000","last_clean":"2023-05-10T01:26:18.579613+0000","last_became_active":"2023-05-10T01:26:18.579329+0000","last_became_peered":"2023-05-10T01:26:18.579329+0000","last_unstale":"2023-05-10T01:26:18.579613+0000","last_undegraded":"2023-05-10T01:26:18.579613+0000","last_fullsized":"2023-05-10T01:26:18.579613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.559646+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573948+0000","last_change":"2023-05-10T01:26:18.573948+0000","last_active":"2023-05-10T01:26:18.573948+0000","last_peered":"2023-05-10T01:26:18.573948+0000","last_clean":"2023-05-10T01:26:18.573948+0000","last_became_active":"2023-05-10T01:26:18.573657+0000","last_became_peered":"2023-05-10T01:26:18.573657+0000","last_unstale":"2023-05-10T01:26:18.573948+0000","last_undegraded":"2023-05-10T01:26:18.573948+0000","last_fullsized":"2023-05-10T01:26:18.573948+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557994+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568537+0000","last_change":"2023-05-10T01:26:18.568537+0000","last_active":"2023-05-10T01:26:18.568537+0000","last_peered":"2023-05-10T01:26:18.568537+0000","last_clean":"2023-05-10T01:26:18.568537+0000","last_became_active":"2023-05-10T01:26:18.568280+0000","last_became_peered":"2023-05-10T01:26:18.568280+0000","last_unstale":"2023-05-10T01:26:18.568537+0000","last_undegraded":"2023-05-10T01:26:18.568537+0000","last_fullsized":"2023-05-10T01:26:18.568537+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.553999+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573919+0000","last_change":"2023-05-10T01:26:18.573919+0000","last_active":"2023-05-10T01:26:18.573919+0000","last_peered":"2023-05-10T01:26:18.573919+0000","last_clean":"2023-05-10T01:26:18.573919+0000","last_became_active":"2023-05-10T01:26:18.573623+0000","last_became_peered":"2023-05-10T01:26:18.573623+0000","last_unstale":"2023-05-10T01:26:18.573919+0000","last_undegraded":"2023-05-10T01:26:18.573919+0000","last_fullsized":"2023-05-10T01:26:18.573919+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557861+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.566612+0000","last_change":"2023-05-10T01:26:18.566612+0000","last_active":"2023-05-10T01:26:18.566612+0000","last_peered":"2023-05-10T01:26:18.566612+0000","last_clean":"2023-05-10T01:26:18.566612+0000","last_became_active":"2023-05-10T01:26:18.566339+0000","last_became_peered":"2023-05-10T01:26:18.566339+0000","last_unstale":"2023-05-10T01:26:18.566612+0000","last_undegraded":"2023-05-10T01:26:18.566612+0000","last_fullsized":"2023-05-10T01:26:18.566612+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555826+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569910+0000","last_change":"2023-05-10T01:26:18.569910+0000","last_active":"2023-05-10T01:26:18.569910+0000","last_peered":"2023-05-10T01:26:18.569910+0000","last_clean":"2023-05-10T01:26:18.569910+0000","last_became_active":"2023-05-10T01:26:18.569422+0000","last_became_peered":"2023-05-10T01:26:18.569422+0000","last_unstale":"2023-05-10T01:26:18.569910+0000","last_undegraded":"2023-05-10T01:26:18.569910+0000","last_fullsized":"2023-05-10T01:26:18.569910+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552218+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.565715+0000","last_change":"2023-05-10T01:26:18.565715+0000","last_active":"2023-05-10T01:26:18.565715+0000","last_peered":"2023-05-10T01:26:18.565715+0000","last_clean":"2023-05-10T01:26:18.565715+0000","last_became_active":"2023-05-10T01:26:18.565428+0000","last_became_peered":"2023-05-10T01:26:18.565428+0000","last_unstale":"2023-05-10T01:26:18.565715+0000","last_undegraded":"2023-05-10T01:26:18.565715+0000","last_fullsized":"2023-05-10T01:26:18.565715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556493+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569655+0000","last_change":"2023-05-10T01:26:18.569655+0000","last_active":"2023-05-10T01:26:18.569655+0000","last_peered":"2023-05-10T01:26:18.569655+0000","last_clean":"2023-05-10T01:26:18.569655+0000","last_became_active":"2023-05-10T01:26:18.569340+0000","last_became_peered":"2023-05-10T01:26:18.569340+0000","last_unstale":"2023-05-10T01:26:18.569655+0000","last_undegraded":"2023-05-10T01:26:18.569655+0000","last_fullsized":"2023-05-10T01:26:18.569655+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555564+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.561470+0000","last_change":"2023-05-10T01:26:18.561470+0000","last_active":"2023-05-10T01:26:18.561470+0000","last_peered":"2023-05-10T01:26:18.561470+0000","last_clean":"2023-05-10T01:26:18.561470+0000","last_became_active":"2023-05-10T01:26:18.561192+0000","last_became_peered":"2023-05-10T01:26:18.561192+0000","last_unstale":"2023-05-10T01:26:18.561470+0000","last_undegraded":"2023-05-10T01:26:18.561470+0000","last_fullsized":"2023-05-10T01:26:18.561470+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557091+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570686+0000","last_change":"2023-05-10T01:26:18.570686+0000","last_active":"2023-05-10T01:26:18.570686+0000","last_peered":"2023-05-10T01:26:18.570686+0000","last_clean":"2023-05-10T01:26:18.570686+0000","last_became_active":"2023-05-10T01:26:18.569082+0000","last_became_peered":"2023-05-10T01:26:18.569082+0000","last_unstale":"2023-05-10T01:26:18.570686+0000","last_undegraded":"2023-05-10T01:26:18.570686+0000","last_fullsized":"2023-05-10T01:26:18.570686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556556+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568330+0000","last_change":"2023-05-10T01:26:18.568330+0000","last_active":"2023-05-10T01:26:18.568330+0000","last_peered":"2023-05-10T01:26:18.568330+0000","last_clean":"2023-05-10T01:26:18.568330+0000","last_became_active":"2023-05-10T01:26:18.568050+0000","last_became_peered":"2023-05-10T01:26:18.568050+0000","last_unstale":"2023-05-10T01:26:18.568330+0000","last_undegraded":"2023-05-10T01:26:18.568330+0000","last_fullsized":"2023-05-10T01:26:18.568330+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554484+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570874+0000","last_change":"2023-05-10T01:26:18.570874+0000","last_active":"2023-05-10T01:26:18.570874+0000","last_peered":"2023-05-10T01:26:18.570874+0000","last_clean":"2023-05-10T01:26:18.570874+0000","last_became_active":"2023-05-10T01:26:18.569744+0000","last_became_peered":"2023-05-10T01:26:18.569744+0000","last_unstale":"2023-05-10T01:26:18.570874+0000","last_undegraded":"2023-05-10T01:26:18.570874+0000","last_fullsized":"2023-05-10T01:26:18.570874+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554848+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.566957+0000","last_change":"2023-05-10T01:26:18.566957+0000","last_active":"2023-05-10T01:26:18.566957+0000","last_peered":"2023-05-10T01:26:18.566957+0000","last_clean":"2023-05-10T01:26:18.566957+0000","last_became_active":"2023-05-10T01:26:18.566513+0000","last_became_peered":"2023-05-10T01:26:18.566513+0000","last_unstale":"2023-05-10T01:26:18.566957+0000","last_undegraded":"2023-05-10T01:26:18.566957+0000","last_fullsized":"2023-05-10T01:26:18.566957+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562816+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571475+0000","last_change":"2023-05-10T01:26:18.571475+0000","last_active":"2023-05-10T01:26:18.571475+0000","last_peered":"2023-05-10T01:26:18.571475+0000","last_clean":"2023-05-10T01:26:18.571475+0000","last_became_active":"2023-05-10T01:26:18.569950+0000","last_became_peered":"2023-05-10T01:26:18.569950+0000","last_unstale":"2023-05-10T01:26:18.571475+0000","last_undegraded":"2023-05-10T01:26:18.571475+0000","last_fullsized":"2023-05-10T01:26:18.571475+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.561976+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573036+0000","last_change":"2023-05-10T01:26:18.573036+0000","last_active":"2023-05-10T01:26:18.573036+0000","last_peered":"2023-05-10T01:26:18.573036+0000","last_clean":"2023-05-10T01:26:18.573036+0000","last_became_active":"2023-05-10T01:26:18.572465+0000","last_became_peered":"2023-05-10T01:26:18.572465+0000","last_unstale":"2023-05-10T01:26:18.573036+0000","last_undegraded":"2023-05-10T01:26:18.573036+0000","last_fullsized":"2023-05-10T01:26:18.573036+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552327+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580354+0000","last_change":"2023-05-10T01:26:18.580354+0000","last_active":"2023-05-10T01:26:18.580354+0000","last_peered":"2023-05-10T01:26:18.580354+0000","last_clean":"2023-05-10T01:26:18.580354+0000","last_became_active":"2023-05-10T01:26:18.580040+0000","last_became_peered":"2023-05-10T01:26:18.580040+0000","last_unstale":"2023-05-10T01:26:18.580354+0000","last_undegraded":"2023-05-10T01:26:18.580354+0000","last_fullsized":"2023-05-10T01:26:18.580354+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556332+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567694+0000","last_change":"2023-05-10T01:26:18.567694+0000","last_active":"2023-05-10T01:26:18.567694+0000","last_peered":"2023-05-10T01:26:18.567694+0000","last_clean":"2023-05-10T01:26:18.567694+0000","last_became_active":"2023-05-10T01:26:18.567244+0000","last_became_peered":"2023-05-10T01:26:18.567244+0000","last_unstale":"2023-05-10T01:26:18.567694+0000","last_undegraded":"2023-05-10T01:26:18.567694+0000","last_fullsized":"2023-05-10T01:26:18.567694+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556246+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572168+0000","last_change":"2023-05-10T01:26:18.572168+0000","last_active":"2023-05-10T01:26:18.572168+0000","last_peered":"2023-05-10T01:26:18.572168+0000","last_clean":"2023-05-10T01:26:18.572168+0000","last_became_active":"2023-05-10T01:26:18.571872+0000","last_became_peered":"2023-05-10T01:26:18.571872+0000","last_unstale":"2023-05-10T01:26:18.572168+0000","last_undegraded":"2023-05-10T01:26:18.572168+0000","last_fullsized":"2023-05-10T01:26:18.572168+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554213+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569425+0000","last_change":"2023-05-10T01:26:18.569425+0000","last_active":"2023-05-10T01:26:18.569425+0000","last_peered":"2023-05-10T01:26:18.569425+0000","last_clean":"2023-05-10T01:26:18.569425+0000","last_became_active":"2023-05-10T01:26:18.569075+0000","last_became_peered":"2023-05-10T01:26:18.569075+0000","last_unstale":"2023-05-10T01:26:18.569425+0000","last_undegraded":"2023-05-10T01:26:18.569425+0000","last_fullsized":"2023-05-10T01:26:18.569425+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557434+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580476+0000","last_change":"2023-05-10T01:26:18.580476+0000","last_active":"2023-05-10T01:26:18.580476+0000","last_peered":"2023-05-10T01:26:18.580476+0000","last_clean":"2023-05-10T01:26:18.580476+0000","last_became_active":"2023-05-10T01:26:18.580007+0000","last_became_peered":"2023-05-10T01:26:18.580007+0000","last_unstale":"2023-05-10T01:26:18.580476+0000","last_undegraded":"2023-05-10T01:26:18.580476+0000","last_fullsized":"2023-05-10T01:26:18.580476+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555389+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.560982+0000","last_change":"2023-05-10T01:26:18.560982+0000","last_active":"2023-05-10T01:26:18.560982+0000","last_peered":"2023-05-10T01:26:18.560982+0000","last_clean":"2023-05-10T01:26:18.560982+0000","last_became_active":"2023-05-10T01:26:18.560649+0000","last_became_peered":"2023-05-10T01:26:18.560649+0000","last_unstale":"2023-05-10T01:26:18.560982+0000","last_undegraded":"2023-05-10T01:26:18.560982+0000","last_fullsized":"2023-05-10T01:26:18.560982+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557455+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575580+0000","last_change":"2023-05-10T01:26:18.575580+0000","last_active":"2023-05-10T01:26:18.575580+0000","last_peered":"2023-05-10T01:26:18.575580+0000","last_clean":"2023-05-10T01:26:18.575580+0000","last_became_active":"2023-05-10T01:26:18.575249+0000","last_became_peered":"2023-05-10T01:26:18.575249+0000","last_unstale":"2023-05-10T01:26:18.575580+0000","last_undegraded":"2023-05-10T01:26:18.575580+0000","last_fullsized":"2023-05-10T01:26:18.575580+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.552700+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.572138+0000","last_change":"2023-05-10T01:26:18.572138+0000","last_active":"2023-05-10T01:26:18.572138+0000","last_peered":"2023-05-10T01:26:18.572138+0000","last_clean":"2023-05-10T01:26:18.572138+0000","last_became_active":"2023-05-10T01:26:18.569386+0000","last_became_peered":"2023-05-10T01:26:18.569386+0000","last_unstale":"2023-05-10T01:26:18.572138+0000","last_undegraded":"2023-05-10T01:26:18.572138+0000","last_fullsized":"2023-05-10T01:26:18.572138+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555948+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569725+0000","last_change":"2023-05-10T01:26:18.569725+0000","last_active":"2023-05-10T01:26:18.569725+0000","last_peered":"2023-05-10T01:26:18.569725+0000","last_clean":"2023-05-10T01:26:18.569725+0000","last_became_active":"2023-05-10T01:26:18.569433+0000","last_became_peered":"2023-05-10T01:26:18.569433+0000","last_unstale":"2023-05-10T01:26:18.569725+0000","last_undegraded":"2023-05-10T01:26:18.569725+0000","last_fullsized":"2023-05-10T01:26:18.569725+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554866+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.576060+0000","last_change":"2023-05-10T01:26:18.576060+0000","last_active":"2023-05-10T01:26:18.576060+0000","last_peered":"2023-05-10T01:26:18.576060+0000","last_clean":"2023-05-10T01:26:18.576060+0000","last_became_active":"2023-05-10T01:26:18.575751+0000","last_became_peered":"2023-05-10T01:26:18.575751+0000","last_unstale":"2023-05-10T01:26:18.576060+0000","last_undegraded":"2023-05-10T01:26:18.576060+0000","last_fullsized":"2023-05-10T01:26:18.576060+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558196+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578645+0000","last_change":"2023-05-10T01:26:18.578645+0000","last_active":"2023-05-10T01:26:18.578645+0000","last_peered":"2023-05-10T01:26:18.578645+0000","last_clean":"2023-05-10T01:26:18.578645+0000","last_became_active":"2023-05-10T01:26:18.578350+0000","last_became_peered":"2023-05-10T01:26:18.578350+0000","last_unstale":"2023-05-10T01:26:18.578645+0000","last_undegraded":"2023-05-10T01:26:18.578645+0000","last_fullsized":"2023-05-10T01:26:18.578645+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551964+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.580160+0000","last_change":"2023-05-10T01:26:18.580160+0000","last_active":"2023-05-10T01:26:18.580160+0000","last_peered":"2023-05-10T01:26:18.580160+0000","last_clean":"2023-05-10T01:26:18.580160+0000","last_became_active":"2023-05-10T01:26:18.576910+0000","last_became_peered":"2023-05-10T01:26:18.576910+0000","last_unstale":"2023-05-10T01:26:18.580160+0000","last_undegraded":"2023-05-10T01:26:18.580160+0000","last_fullsized":"2023-05-10T01:26:18.580160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557092+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569768+0000","last_change":"2023-05-10T01:26:18.569768+0000","last_active":"2023-05-10T01:26:18.569768+0000","last_peered":"2023-05-10T01:26:18.569768+0000","last_clean":"2023-05-10T01:26:18.569768+0000","last_became_active":"2023-05-10T01:26:18.569436+0000","last_became_peered":"2023-05-10T01:26:18.569436+0000","last_unstale":"2023-05-10T01:26:18.569768+0000","last_undegraded":"2023-05-10T01:26:18.569768+0000","last_fullsized":"2023-05-10T01:26:18.569768+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.546782+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:17.546782+0000","last_peered":"2023-05-10T01:26:17.546782+0000","last_clean":"2023-05-10T01:26:17.546782+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:17.546782+0000","last_undegraded":"2023-05-10T01:26:17.546782+0000","last_fullsized":"2023-05-10T01:26:17.546782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562850+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575263+0000","last_change":"2023-05-10T01:26:18.575263+0000","last_active":"2023-05-10T01:26:18.575263+0000","last_peered":"2023-05-10T01:26:18.575263+0000","last_clean":"2023-05-10T01:26:18.575263+0000","last_became_active":"2023-05-10T01:26:18.574988+0000","last_became_peered":"2023-05-10T01:26:18.574988+0000","last_unstale":"2023-05-10T01:26:18.575263+0000","last_undegraded":"2023-05-10T01:26:18.575263+0000","last_fullsized":"2023-05-10T01:26:18.575263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.548890+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:17.548890+0000","last_peered":"2023-05-10T01:26:17.548890+0000","last_clean":"2023-05-10T01:26:17.548890+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:17.548890+0000","last_undegraded":"2023-05-10T01:26:17.548890+0000","last_fullsized":"2023-05-10T01:26:17.548890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.562398+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569662+0000","last_change":"2023-05-10T01:26:18.569662+0000","last_active":"2023-05-10T01:26:18.569662+0000","last_peered":"2023-05-10T01:26:18.569662+0000","last_clean":"2023-05-10T01:26:18.569662+0000","last_became_active":"2023-05-10T01:26:18.569358+0000","last_became_peered":"2023-05-10T01:26:18.569358+0000","last_unstale":"2023-05-10T01:26:18.569662+0000","last_undegraded":"2023-05-10T01:26:18.569662+0000","last_fullsized":"2023-05-10T01:26:18.569662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.541892+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:17.541892+0000","last_peered":"2023-05-10T01:26:17.541892+0000","last_clean":"2023-05-10T01:26:17.541892+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:17.541892+0000","last_undegraded":"2023-05-10T01:26:17.541892+0000","last_fullsized":"2023-05-10T01:26:17.541892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.551974+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.575798+0000","last_change":"2023-05-10T01:26:18.575798+0000","last_active":"2023-05-10T01:26:18.575798+0000","last_peered":"2023-05-10T01:26:18.575798+0000","last_clean":"2023-05-10T01:26:18.575798+0000","last_became_active":"2023-05-10T01:26:18.574943+0000","last_became_peered":"2023-05-10T01:26:18.574943+0000","last_unstale":"2023-05-10T01:26:18.575798+0000","last_undegraded":"2023-05-10T01:26:18.575798+0000","last_fullsized":"2023-05-10T01:26:18.575798+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.548757+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:17.548757+0000","last_peered":"2023-05-10T01:26:17.548757+0000","last_clean":"2023-05-10T01:26:17.548757+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:17.548757+0000","last_undegraded":"2023-05-10T01:26:17.548757+0000","last_fullsized":"2023-05-10T01:26:17.548757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550227+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:17.550227+0000","last_peered":"2023-05-10T01:26:17.550227+0000","last_clean":"2023-05-10T01:26:17.550227+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:17.550227+0000","last_undegraded":"2023-05-10T01:26:17.550227+0000","last_fullsized":"2023-05-10T01:26:17.550227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.555154+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570758+0000","last_change":"2023-05-10T01:26:18.570758+0000","last_active":"2023-05-10T01:26:18.570758+0000","last_peered":"2023-05-10T01:26:18.570758+0000","last_clean":"2023-05-10T01:26:18.570758+0000","last_became_active":"2023-05-10T01:26:18.570490+0000","last_became_peered":"2023-05-10T01:26:18.570490+0000","last_unstale":"2023-05-10T01:26:18.570758+0000","last_undegraded":"2023-05-10T01:26:18.570758+0000","last_fullsized":"2023-05-10T01:26:18.570758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550192+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:17.550192+0000","last_peered":"2023-05-10T01:26:17.550192+0000","last_clean":"2023-05-10T01:26:17.550192+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:17.550192+0000","last_undegraded":"2023-05-10T01:26:17.550192+0000","last_fullsized":"2023-05-10T01:26:17.550192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.554707+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578122+0000","last_change":"2023-05-10T01:26:18.578122+0000","last_active":"2023-05-10T01:26:18.578122+0000","last_peered":"2023-05-10T01:26:18.578122+0000","last_clean":"2023-05-10T01:26:18.578122+0000","last_became_active":"2023-05-10T01:26:18.577601+0000","last_became_peered":"2023-05-10T01:26:18.577601+0000","last_unstale":"2023-05-10T01:26:18.578122+0000","last_undegraded":"2023-05-10T01:26:18.578122+0000","last_fullsized":"2023-05-10T01:26:18.578122+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550258+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:17.550258+0000","last_peered":"2023-05-10T01:26:17.550258+0000","last_clean":"2023-05-10T01:26:17.550258+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:17.550258+0000","last_undegraded":"2023-05-10T01:26:17.550258+0000","last_fullsized":"2023-05-10T01:26:17.550258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.563984+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.574188+0000","last_change":"2023-05-10T01:26:18.574188+0000","last_active":"2023-05-10T01:26:18.574188+0000","last_peered":"2023-05-10T01:26:18.574188+0000","last_clean":"2023-05-10T01:26:18.574188+0000","last_became_active":"2023-05-10T01:26:18.573881+0000","last_became_peered":"2023-05-10T01:26:18.573881+0000","last_unstale":"2023-05-10T01:26:18.574188+0000","last_undegraded":"2023-05-10T01:26:18.574188+0000","last_fullsized":"2023-05-10T01:26:18.574188+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.546140+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:17.546140+0000","last_peered":"2023-05-10T01:26:17.546140+0000","last_clean":"2023-05-10T01:26:17.546140+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:17.546140+0000","last_undegraded":"2023-05-10T01:26:17.546140+0000","last_fullsized":"2023-05-10T01:26:17.546140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.556787+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.578734+0000","last_change":"2023-05-10T01:26:18.578734+0000","last_active":"2023-05-10T01:26:18.578734+0000","last_peered":"2023-05-10T01:26:18.578734+0000","last_clean":"2023-05-10T01:26:18.578734+0000","last_became_active":"2023-05-10T01:26:18.577120+0000","last_became_peered":"2023-05-10T01:26:18.577120+0000","last_unstale":"2023-05-10T01:26:18.578734+0000","last_undegraded":"2023-05-10T01:26:18.578734+0000","last_fullsized":"2023-05-10T01:26:18.578734+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.544602+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:17.544602+0000","last_peered":"2023-05-10T01:26:17.544602+0000","last_clean":"2023-05-10T01:26:17.544602+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:17.544602+0000","last_undegraded":"2023-05-10T01:26:17.544602+0000","last_fullsized":"2023-05-10T01:26:17.544602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353500,"statfs":{"total":96636764160,"available":96617984000,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.44},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17828,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94354012,"statfs":{"total":96636764160,"available":96618508288,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70999999999999996}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.69699999999999995}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68300000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.745},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21796,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":20352,"kb_avail":94350044,"statfs":{"total":96636764160,"available":96614445056,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20840448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.27200000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.30399999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.223},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.311}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17444,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354396,"statfs":{"total":96636764160,"available":96618901504,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.66800000000000004,"15min":0.80300000000000005},"last":0.504}]},{"osd":2,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.41599999999999998,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":3.8370000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52200000000000002,"5min":0.65500000000000003,"15min":0.84099999999999997},"last":0.59099999999999997}]},{"osd":3,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39900000000000002,"15min":0.41699999999999998},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45600000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.85799999999999998},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.39500000000000002,"15min":0.375},"max":{"1min":0.77900000000000003,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.748},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.67800000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.224},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.68700000000000006},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Wed May 10 01:25:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.69599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"max":{"1min":0.76700000000000002,"5min":0.98599999999999999,"15min":1.139},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90900000000000003,"5min":1.353,"15min":1.353},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23012,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":94348828,"statfs":{"total":96636764160,"available":96613199872,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.313},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.372}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.499}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.35599999999999998}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.373}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18084,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353756,"statfs":{"total":96636764160,"available":96618246144,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.251,"15min":0.251},"max":{"1min":0.73499999999999999,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.63700000000000001,"5min":1.337,"15min":1.337},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59899999999999998,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.92100000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.373,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60199999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.626},{"interface":"front","average":{"1min":0.503,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65700000000000003,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.41899999999999998,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.748,"15min":0.83599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.82199999999999995,"15min":0.89200000000000002},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.29099999999999998,"5min":0.28299999999999997,"15min":0.28000000000000003},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.88200000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.32300000000000001,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":1.0149999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed May 10 01:25:17 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68799999999999994,"5min":0.80500000000000005,"15min":0.92700000000000005},"last":0.752},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81000000000000005,"5min":0.871,"15min":1.0589999999999999},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21220,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":19776,"kb_avail":94350620,"statfs":{"total":96636764160,"available":96615034880,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20250624},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.45800000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.497},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.47899999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:26:23.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:26:23.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.502+0000 7f615f54f700 1 Processor -- start 2023-05-10T01:26:23.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.502+0000 7f615f54f700 1 -- start start 2023-05-10T01:26:23.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615f54f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6158154e40 0x7f61580acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615f54f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61580ad030 0x7f615814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615f54f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6158158960 con 0x7f61580c7370 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615f54f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6158157d50 con 0x7f61580ad030 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615f54f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6158158030 con 0x7f6158154e40 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61580ad030 0x7f615814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61580ad030 0x7f615814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38472/0 (socket says 172.21.15.52:38472) 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 -- 172.21.15.52:0/3997002500 learned_addr learned my addr 172.21.15.52:0/3997002500 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615dd4c700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6158154e40 0x7f61580acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 -- 172.21.15.52:0/3997002500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6158154e40 msgr2=0x7f61580acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6158154e40 0x7f61580acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 -- 172.21.15.52:0/3997002500 >> v1:172.21.15.172:6789/0 conn(0x7f61580c7370 legacy=0x7f61580c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 -- 172.21.15.52:0/3997002500 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158158310 con 0x7f61580ad030 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.503+0000 7f615ed4e700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61580ad030 0x7f615814dd60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f6150009f20 tx=0x7f6150009840).ready entity=mon.0 client_cookie=cb69bd00684b44c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615d54b700 1 -- 172.21.15.52:0/3997002500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000e070 con 0x7f61580ad030 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615d54b700 1 -- 172.21.15.52:0/3997002500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000b9d0 con 0x7f61580ad030 2023-05-10T01:26:23.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615d54b700 1 -- 172.21.15.52:0/3997002500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bd50 con 0x7f61580ad030 2023-05-10T01:26:23.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 -- 172.21.15.52:0/3997002500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61580ad030 msgr2=0x7f615814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61580ad030 0x7f615814dd60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f6150009f20 tx=0x7f6150009840).stop 2023-05-10T01:26:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 -- 172.21.15.52:0/3997002500 shutdown_connections 2023-05-10T01:26:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61580ad030 0x7f615814dd60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 --2- 172.21.15.52:0/3997002500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6158154e40 0x7f61580acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 -- 172.21.15.52:0/3997002500 >> 172.21.15.52:0/3997002500 conn(0x7f6158068320 msgr2=0x7f6158068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 -- 172.21.15.52:0/3997002500 shutdown_connections 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.504+0000 7f615f54f700 1 -- 172.21.15.52:0/3997002500 wait complete. 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.505+0000 7f615f54f700 1 Processor -- start 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.505+0000 7f615f54f700 1 -- start start 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61580ad030 0x7f61581445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61580c7370 0x7f61580ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615814fe40 con 0x7f6158154e40 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580c3ba0 con 0x7f61580c7370 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615f54f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580c2f90 con 0x7f61580ad030 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615ed4e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615ed4e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38478/0 (socket says 172.21.15.52:38478) 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615ed4e700 1 -- 172.21.15.52:0/1058222969 learned_addr learned my addr 172.21.15.52:0/1058222969 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:23.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615e54d700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61580ad030 0x7f61581445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.506+0000 7f615dd4c700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61580c7370 0x7f61580ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 -- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61580ad030 msgr2=0x7f61581445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61580ad030 0x7f61581445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 -- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61580c7370 msgr2=0x7f61580ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61580c7370 0x7f61580ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 -- 172.21.15.52:0/1058222969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009ae0 con 0x7f6158154e40 2023-05-10T01:26:23.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615ed4e700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f6158083bc0 tx=0x7f61581588d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bd50 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500092e0 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61580c3270 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615001d6b0 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.507+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61580c3830 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.508+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61580c7da0 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.508+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6150024030 con 0x7f6158154e40 2023-05-10T01:26:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.509+0000 7f61467fc700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 0x7f6138061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.509+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f615007b050 con 0x7f6158154e40 2023-05-10T01:26:23.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.509+0000 7f615e54d700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 0x7f6138061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.509+0000 7f615e54d700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 0x7f6138061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f61540038e0 tx=0x7f6154007d40).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.513+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f615004c480 con 0x7f6158154e40 2023-05-10T01:26:23.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.682+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61580bfb80 con 0x7f613805ed90 2023-05-10T01:26:23.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.692+0000 7f61467fc700 1 -- 172.21.15.52:0/1058222969 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361458 (secure 0 0 0) 0x7f61580bfb80 con 0x7f613805ed90 2023-05-10T01:26:23.700 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:23.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 msgr2=0x7f6138061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 0x7f6138061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f61540038e0 tx=0x7f6154007d40).stop 2023-05-10T01:26:23.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 msgr2=0x7f6158156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f6158083bc0 tx=0x7f61581588d0).stop 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 shutdown_connections 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f613805ed90 0x7f6138061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6158154e40 0x7f6158156b80 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61580ad030 0x7f61581445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.695+0000 7f615f54f700 1 --2- 172.21.15.52:0/1058222969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61580c7370 0x7f61580ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.696+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 >> 172.21.15.52:0/1058222969 conn(0x7f6158068320 msgr2=0x7f61581506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:23.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.696+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 shutdown_connections 2023-05-10T01:26:23.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.696+0000 7f615f54f700 1 -- 172.21.15.52:0/1058222969 wait complete. 2023-05-10T01:26:23.704 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:26:23.711 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:26:23.588981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":165208,"kb_used_data":11800,"kb_used_omap":0,"kb_used_meta":153344,"kb_avail":754809512,"statfs":{"total":773094113280,"available":772924940288,"internally_reserved":0,"allocated":12083200,"data_stored":6113776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":157024256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19804,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.174073"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976105+0000","last_change":"2023-05-10T01:26:18.975353+0000","last_active":"2023-05-10T01:26:18.976105+0000","last_peered":"2023-05-10T01:26:18.976105+0000","last_clean":"2023-05-10T01:26:18.976105+0000","last_became_active":"2023-05-10T01:26:18.975196+0000","last_became_peered":"2023-05-10T01:26:18.975196+0000","last_unstale":"2023-05-10T01:26:18.976105+0000","last_undegraded":"2023-05-10T01:26:18.976105+0000","last_fullsized":"2023-05-10T01:26:18.976105+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"121'3","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.964489+0000","last_change":"2023-05-10T01:26:18.571497+0000","last_active":"2023-05-10T01:26:18.964489+0000","last_peered":"2023-05-10T01:26:18.964489+0000","last_clean":"2023-05-10T01:26:18.964489+0000","last_became_active":"2023-05-10T01:26:18.571204+0000","last_became_peered":"2023-05-10T01:26:18.571204+0000","last_unstale":"2023-05-10T01:26:18.964489+0000","last_undegraded":"2023-05-10T01:26:18.964489+0000","last_fullsized":"2023-05-10T01:26:18.964489+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983885+0000","last_change":"2023-05-10T01:26:18.976055+0000","last_active":"2023-05-10T01:26:18.983885+0000","last_peered":"2023-05-10T01:26:18.983885+0000","last_clean":"2023-05-10T01:26:18.983885+0000","last_became_active":"2023-05-10T01:26:18.975611+0000","last_became_peered":"2023-05-10T01:26:18.975611+0000","last_unstale":"2023-05-10T01:26:18.983885+0000","last_undegraded":"2023-05-10T01:26:18.983885+0000","last_fullsized":"2023-05-10T01:26:18.983885+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950738+0000","last_change":"2023-05-10T01:26:18.561226+0000","last_active":"2023-05-10T01:26:18.950738+0000","last_peered":"2023-05-10T01:26:18.950738+0000","last_clean":"2023-05-10T01:26:18.950738+0000","last_became_active":"2023-05-10T01:26:18.560909+0000","last_became_peered":"2023-05-10T01:26:18.560909+0000","last_unstale":"2023-05-10T01:26:18.950738+0000","last_undegraded":"2023-05-10T01:26:18.950738+0000","last_fullsized":"2023-05-10T01:26:18.950738+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986126+0000","last_change":"2023-05-10T01:26:18.980502+0000","last_active":"2023-05-10T01:26:18.986126+0000","last_peered":"2023-05-10T01:26:18.986126+0000","last_clean":"2023-05-10T01:26:18.986126+0000","last_became_active":"2023-05-10T01:26:18.980170+0000","last_became_peered":"2023-05-10T01:26:18.980170+0000","last_unstale":"2023-05-10T01:26:18.986126+0000","last_undegraded":"2023-05-10T01:26:18.986126+0000","last_fullsized":"2023-05-10T01:26:18.986126+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.958018+0000","last_change":"2023-05-10T01:26:18.568238+0000","last_active":"2023-05-10T01:26:18.958018+0000","last_peered":"2023-05-10T01:26:18.958018+0000","last_clean":"2023-05-10T01:26:18.958018+0000","last_became_active":"2023-05-10T01:26:18.567912+0000","last_became_peered":"2023-05-10T01:26:18.567912+0000","last_unstale":"2023-05-10T01:26:18.958018+0000","last_undegraded":"2023-05-10T01:26:18.958018+0000","last_fullsized":"2023-05-10T01:26:18.958018+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973199+0000","last_change":"2023-05-10T01:26:18.972680+0000","last_active":"2023-05-10T01:26:18.973199+0000","last_peered":"2023-05-10T01:26:18.973199+0000","last_clean":"2023-05-10T01:26:18.973199+0000","last_became_active":"2023-05-10T01:26:18.972387+0000","last_became_peered":"2023-05-10T01:26:18.972387+0000","last_unstale":"2023-05-10T01:26:18.973199+0000","last_undegraded":"2023-05-10T01:26:18.973199+0000","last_fullsized":"2023-05-10T01:26:18.973199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962990+0000","last_change":"2023-05-10T01:26:18.575171+0000","last_active":"2023-05-10T01:26:18.962990+0000","last_peered":"2023-05-10T01:26:18.962990+0000","last_clean":"2023-05-10T01:26:18.962990+0000","last_became_active":"2023-05-10T01:26:18.574795+0000","last_became_peered":"2023-05-10T01:26:18.574795+0000","last_unstale":"2023-05-10T01:26:18.962990+0000","last_undegraded":"2023-05-10T01:26:18.962990+0000","last_fullsized":"2023-05-10T01:26:18.962990+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984096+0000","last_change":"2023-05-10T01:26:18.977610+0000","last_active":"2023-05-10T01:26:18.984096+0000","last_peered":"2023-05-10T01:26:18.984096+0000","last_clean":"2023-05-10T01:26:18.984096+0000","last_became_active":"2023-05-10T01:26:18.977328+0000","last_became_peered":"2023-05-10T01:26:18.977328+0000","last_unstale":"2023-05-10T01:26:18.984096+0000","last_undegraded":"2023-05-10T01:26:18.984096+0000","last_fullsized":"2023-05-10T01:26:18.984096+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975581+0000","last_change":"2023-05-10T01:26:18.575538+0000","last_active":"2023-05-10T01:26:18.975581+0000","last_peered":"2023-05-10T01:26:18.975581+0000","last_clean":"2023-05-10T01:26:18.975581+0000","last_became_active":"2023-05-10T01:26:18.575295+0000","last_became_peered":"2023-05-10T01:26:18.575295+0000","last_unstale":"2023-05-10T01:26:18.975581+0000","last_undegraded":"2023-05-10T01:26:18.975581+0000","last_fullsized":"2023-05-10T01:26:18.975581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975305+0000","last_change":"2023-05-10T01:26:18.972512+0000","last_active":"2023-05-10T01:26:18.975305+0000","last_peered":"2023-05-10T01:26:18.975305+0000","last_clean":"2023-05-10T01:26:18.975305+0000","last_became_active":"2023-05-10T01:26:18.966620+0000","last_became_peered":"2023-05-10T01:26:18.966620+0000","last_unstale":"2023-05-10T01:26:18.975305+0000","last_undegraded":"2023-05-10T01:26:18.975305+0000","last_fullsized":"2023-05-10T01:26:18.975305+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567857+0000","last_change":"2023-05-10T01:26:18.567857+0000","last_active":"2023-05-10T01:26:18.567857+0000","last_peered":"2023-05-10T01:26:18.567857+0000","last_clean":"2023-05-10T01:26:18.567857+0000","last_became_active":"2023-05-10T01:26:18.567563+0000","last_became_peered":"2023-05-10T01:26:18.567563+0000","last_unstale":"2023-05-10T01:26:18.567857+0000","last_undegraded":"2023-05-10T01:26:18.567857+0000","last_fullsized":"2023-05-10T01:26:18.567857+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986176+0000","last_change":"2023-05-10T01:26:18.983119+0000","last_active":"2023-05-10T01:26:18.986176+0000","last_peered":"2023-05-10T01:26:18.986176+0000","last_clean":"2023-05-10T01:26:18.986176+0000","last_became_active":"2023-05-10T01:26:18.982828+0000","last_became_peered":"2023-05-10T01:26:18.982828+0000","last_unstale":"2023-05-10T01:26:18.986176+0000","last_undegraded":"2023-05-10T01:26:18.986176+0000","last_fullsized":"2023-05-10T01:26:18.986176+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567240+0000","last_change":"2023-05-10T01:26:18.567240+0000","last_active":"2023-05-10T01:26:18.567240+0000","last_peered":"2023-05-10T01:26:18.567240+0000","last_clean":"2023-05-10T01:26:18.567240+0000","last_became_active":"2023-05-10T01:26:18.567028+0000","last_became_peered":"2023-05-10T01:26:18.567028+0000","last_unstale":"2023-05-10T01:26:18.567240+0000","last_undegraded":"2023-05-10T01:26:18.567240+0000","last_fullsized":"2023-05-10T01:26:18.567240+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986097+0000","last_change":"2023-05-10T01:26:18.980324+0000","last_active":"2023-05-10T01:26:18.986097+0000","last_peered":"2023-05-10T01:26:18.986097+0000","last_clean":"2023-05-10T01:26:18.986097+0000","last_became_active":"2023-05-10T01:26:18.980084+0000","last_became_peered":"2023-05-10T01:26:18.980084+0000","last_unstale":"2023-05-10T01:26:18.986097+0000","last_undegraded":"2023-05-10T01:26:18.986097+0000","last_fullsized":"2023-05-10T01:26:18.986097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951498+0000","last_change":"2023-05-10T01:26:18.569917+0000","last_active":"2023-05-10T01:26:18.951498+0000","last_peered":"2023-05-10T01:26:18.951498+0000","last_clean":"2023-05-10T01:26:18.951498+0000","last_became_active":"2023-05-10T01:26:18.569637+0000","last_became_peered":"2023-05-10T01:26:18.569637+0000","last_unstale":"2023-05-10T01:26:18.951498+0000","last_undegraded":"2023-05-10T01:26:18.951498+0000","last_fullsized":"2023-05-10T01:26:18.951498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965834+0000","last_change":"2023-05-10T01:26:18.958289+0000","last_active":"2023-05-10T01:26:18.965834+0000","last_peered":"2023-05-10T01:26:18.965834+0000","last_clean":"2023-05-10T01:26:18.965834+0000","last_became_active":"2023-05-10T01:26:18.957990+0000","last_became_peered":"2023-05-10T01:26:18.957990+0000","last_unstale":"2023-05-10T01:26:18.965834+0000","last_undegraded":"2023-05-10T01:26:18.965834+0000","last_fullsized":"2023-05-10T01:26:18.965834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971177+0000","last_change":"2023-05-10T01:26:18.570414+0000","last_active":"2023-05-10T01:26:18.971177+0000","last_peered":"2023-05-10T01:26:18.971177+0000","last_clean":"2023-05-10T01:26:18.971177+0000","last_became_active":"2023-05-10T01:26:18.570143+0000","last_became_peered":"2023-05-10T01:26:18.570143+0000","last_unstale":"2023-05-10T01:26:18.971177+0000","last_undegraded":"2023-05-10T01:26:18.971177+0000","last_fullsized":"2023-05-10T01:26:18.971177+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968954+0000","last_change":"2023-05-10T01:26:18.965747+0000","last_active":"2023-05-10T01:26:18.968954+0000","last_peered":"2023-05-10T01:26:18.968954+0000","last_clean":"2023-05-10T01:26:18.968954+0000","last_became_active":"2023-05-10T01:26:18.965359+0000","last_became_peered":"2023-05-10T01:26:18.965359+0000","last_unstale":"2023-05-10T01:26:18.968954+0000","last_undegraded":"2023-05-10T01:26:18.968954+0000","last_fullsized":"2023-05-10T01:26:18.968954+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973463+0000","last_change":"2023-05-10T01:26:18.565303+0000","last_active":"2023-05-10T01:26:18.973463+0000","last_peered":"2023-05-10T01:26:18.973463+0000","last_clean":"2023-05-10T01:26:18.973463+0000","last_became_active":"2023-05-10T01:26:18.564990+0000","last_became_peered":"2023-05-10T01:26:18.564990+0000","last_unstale":"2023-05-10T01:26:18.973463+0000","last_undegraded":"2023-05-10T01:26:18.973463+0000","last_fullsized":"2023-05-10T01:26:18.973463+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969309+0000","last_change":"2023-05-10T01:26:18.967059+0000","last_active":"2023-05-10T01:26:18.969309+0000","last_peered":"2023-05-10T01:26:18.969309+0000","last_clean":"2023-05-10T01:26:18.969309+0000","last_became_active":"2023-05-10T01:26:18.966792+0000","last_became_peered":"2023-05-10T01:26:18.966792+0000","last_unstale":"2023-05-10T01:26:18.969309+0000","last_undegraded":"2023-05-10T01:26:18.969309+0000","last_fullsized":"2023-05-10T01:26:18.969309+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573117+0000","last_change":"2023-05-10T01:26:18.573117+0000","last_active":"2023-05-10T01:26:18.573117+0000","last_peered":"2023-05-10T01:26:18.573117+0000","last_clean":"2023-05-10T01:26:18.573117+0000","last_became_active":"2023-05-10T01:26:18.572730+0000","last_became_peered":"2023-05-10T01:26:18.572730+0000","last_unstale":"2023-05-10T01:26:18.573117+0000","last_undegraded":"2023-05-10T01:26:18.573117+0000","last_fullsized":"2023-05-10T01:26:18.573117+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982351+0000","last_change":"2023-05-10T01:26:18.980270+0000","last_active":"2023-05-10T01:26:18.982351+0000","last_peered":"2023-05-10T01:26:18.982351+0000","last_clean":"2023-05-10T01:26:18.982351+0000","last_became_active":"2023-05-10T01:26:18.980092+0000","last_became_peered":"2023-05-10T01:26:18.980092+0000","last_unstale":"2023-05-10T01:26:18.982351+0000","last_undegraded":"2023-05-10T01:26:18.982351+0000","last_fullsized":"2023-05-10T01:26:18.982351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986217+0000","last_change":"2023-05-10T01:26:18.565872+0000","last_active":"2023-05-10T01:26:18.986217+0000","last_peered":"2023-05-10T01:26:18.986217+0000","last_clean":"2023-05-10T01:26:18.986217+0000","last_became_active":"2023-05-10T01:26:18.565544+0000","last_became_peered":"2023-05-10T01:26:18.565544+0000","last_unstale":"2023-05-10T01:26:18.986217+0000","last_undegraded":"2023-05-10T01:26:18.986217+0000","last_fullsized":"2023-05-10T01:26:18.986217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984412+0000","last_change":"2023-05-10T01:26:18.979400+0000","last_active":"2023-05-10T01:26:18.984412+0000","last_peered":"2023-05-10T01:26:18.984412+0000","last_clean":"2023-05-10T01:26:18.984412+0000","last_became_active":"2023-05-10T01:26:18.978810+0000","last_became_peered":"2023-05-10T01:26:18.978810+0000","last_unstale":"2023-05-10T01:26:18.984412+0000","last_undegraded":"2023-05-10T01:26:18.984412+0000","last_fullsized":"2023-05-10T01:26:18.984412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961736+0000","last_change":"2023-05-10T01:26:18.565955+0000","last_active":"2023-05-10T01:26:18.961736+0000","last_peered":"2023-05-10T01:26:18.961736+0000","last_clean":"2023-05-10T01:26:18.961736+0000","last_became_active":"2023-05-10T01:26:18.565618+0000","last_became_peered":"2023-05-10T01:26:18.565618+0000","last_unstale":"2023-05-10T01:26:18.961736+0000","last_undegraded":"2023-05-10T01:26:18.961736+0000","last_fullsized":"2023-05-10T01:26:18.961736+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979075+0000","last_change":"2023-05-10T01:26:18.978241+0000","last_active":"2023-05-10T01:26:18.979075+0000","last_peered":"2023-05-10T01:26:18.979075+0000","last_clean":"2023-05-10T01:26:18.979075+0000","last_became_active":"2023-05-10T01:26:18.977953+0000","last_became_peered":"2023-05-10T01:26:18.977953+0000","last_unstale":"2023-05-10T01:26:18.979075+0000","last_undegraded":"2023-05-10T01:26:18.979075+0000","last_fullsized":"2023-05-10T01:26:18.979075+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962194+0000","last_change":"2023-05-10T01:26:18.573304+0000","last_active":"2023-05-10T01:26:18.962194+0000","last_peered":"2023-05-10T01:26:18.962194+0000","last_clean":"2023-05-10T01:26:18.962194+0000","last_became_active":"2023-05-10T01:26:18.573011+0000","last_became_peered":"2023-05-10T01:26:18.573011+0000","last_unstale":"2023-05-10T01:26:18.962194+0000","last_undegraded":"2023-05-10T01:26:18.962194+0000","last_fullsized":"2023-05-10T01:26:18.962194+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986326+0000","last_change":"2023-05-10T01:26:18.982281+0000","last_active":"2023-05-10T01:26:18.986326+0000","last_peered":"2023-05-10T01:26:18.986326+0000","last_clean":"2023-05-10T01:26:18.986326+0000","last_became_active":"2023-05-10T01:26:18.981892+0000","last_became_peered":"2023-05-10T01:26:18.981892+0000","last_unstale":"2023-05-10T01:26:18.986326+0000","last_undegraded":"2023-05-10T01:26:18.986326+0000","last_fullsized":"2023-05-10T01:26:18.986326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953937+0000","last_change":"2023-05-10T01:26:18.572389+0000","last_active":"2023-05-10T01:26:18.953937+0000","last_peered":"2023-05-10T01:26:18.953937+0000","last_clean":"2023-05-10T01:26:18.953937+0000","last_became_active":"2023-05-10T01:26:18.572045+0000","last_became_peered":"2023-05-10T01:26:18.572045+0000","last_unstale":"2023-05-10T01:26:18.953937+0000","last_undegraded":"2023-05-10T01:26:18.953937+0000","last_fullsized":"2023-05-10T01:26:18.953937+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972130+0000","last_change":"2023-05-10T01:26:18.968895+0000","last_active":"2023-05-10T01:26:18.972130+0000","last_peered":"2023-05-10T01:26:18.972130+0000","last_clean":"2023-05-10T01:26:18.972130+0000","last_became_active":"2023-05-10T01:26:18.968544+0000","last_became_peered":"2023-05-10T01:26:18.968544+0000","last_unstale":"2023-05-10T01:26:18.972130+0000","last_undegraded":"2023-05-10T01:26:18.972130+0000","last_fullsized":"2023-05-10T01:26:18.972130+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573081+0000","last_change":"2023-05-10T01:26:18.573081+0000","last_active":"2023-05-10T01:26:18.573081+0000","last_peered":"2023-05-10T01:26:18.573081+0000","last_clean":"2023-05-10T01:26:18.573081+0000","last_became_active":"2023-05-10T01:26:18.572641+0000","last_became_peered":"2023-05-10T01:26:18.572641+0000","last_unstale":"2023-05-10T01:26:18.573081+0000","last_undegraded":"2023-05-10T01:26:18.573081+0000","last_fullsized":"2023-05-10T01:26:18.573081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557681+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951662+0000","last_change":"2023-05-10T01:26:18.570935+0000","last_active":"2023-05-10T01:26:18.951662+0000","last_peered":"2023-05-10T01:26:18.951662+0000","last_clean":"2023-05-10T01:26:18.951662+0000","last_became_active":"2023-05-10T01:26:18.570644+0000","last_became_peered":"2023-05-10T01:26:18.570644+0000","last_unstale":"2023-05-10T01:26:18.951662+0000","last_undegraded":"2023-05-10T01:26:18.951662+0000","last_fullsized":"2023-05-10T01:26:18.951662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557677+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954278+0000","last_change":"2023-05-10T01:26:18.573110+0000","last_active":"2023-05-10T01:26:18.954278+0000","last_peered":"2023-05-10T01:26:18.954278+0000","last_clean":"2023-05-10T01:26:18.954278+0000","last_became_active":"2023-05-10T01:26:18.572645+0000","last_became_peered":"2023-05-10T01:26:18.572645+0000","last_unstale":"2023-05-10T01:26:18.954278+0000","last_undegraded":"2023-05-10T01:26:18.954278+0000","last_fullsized":"2023-05-10T01:26:18.954278+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557431+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969888+0000","last_change":"2023-05-10T01:26:18.578477+0000","last_active":"2023-05-10T01:26:18.969888+0000","last_peered":"2023-05-10T01:26:18.969888+0000","last_clean":"2023-05-10T01:26:18.969888+0000","last_became_active":"2023-05-10T01:26:18.578107+0000","last_became_peered":"2023-05-10T01:26:18.578107+0000","last_unstale":"2023-05-10T01:26:18.969888+0000","last_undegraded":"2023-05-10T01:26:18.969888+0000","last_fullsized":"2023-05-10T01:26:18.969888+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969112+0000","last_change":"2023-05-10T01:26:18.966385+0000","last_active":"2023-05-10T01:26:18.969112+0000","last_peered":"2023-05-10T01:26:18.969112+0000","last_clean":"2023-05-10T01:26:18.969112+0000","last_became_active":"2023-05-10T01:26:18.966106+0000","last_became_peered":"2023-05-10T01:26:18.966106+0000","last_unstale":"2023-05-10T01:26:18.969112+0000","last_undegraded":"2023-05-10T01:26:18.969112+0000","last_fullsized":"2023-05-10T01:26:18.969112+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.967263+0000","last_change":"2023-05-10T01:26:18.573995+0000","last_active":"2023-05-10T01:26:18.967263+0000","last_peered":"2023-05-10T01:26:18.967263+0000","last_clean":"2023-05-10T01:26:18.967263+0000","last_became_active":"2023-05-10T01:26:18.573725+0000","last_became_peered":"2023-05-10T01:26:18.573725+0000","last_unstale":"2023-05-10T01:26:18.967263+0000","last_undegraded":"2023-05-10T01:26:18.967263+0000","last_fullsized":"2023-05-10T01:26:18.967263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984389+0000","last_change":"2023-05-10T01:26:18.979267+0000","last_active":"2023-05-10T01:26:18.984389+0000","last_peered":"2023-05-10T01:26:18.984389+0000","last_clean":"2023-05-10T01:26:18.984389+0000","last_became_active":"2023-05-10T01:26:18.978510+0000","last_became_peered":"2023-05-10T01:26:18.978510+0000","last_unstale":"2023-05-10T01:26:18.984389+0000","last_undegraded":"2023-05-10T01:26:18.984389+0000","last_fullsized":"2023-05-10T01:26:18.984389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980364+0000","last_change":"2023-05-10T01:26:18.573187+0000","last_active":"2023-05-10T01:26:18.980364+0000","last_peered":"2023-05-10T01:26:18.980364+0000","last_clean":"2023-05-10T01:26:18.980364+0000","last_became_active":"2023-05-10T01:26:18.572833+0000","last_became_peered":"2023-05-10T01:26:18.572833+0000","last_unstale":"2023-05-10T01:26:18.980364+0000","last_undegraded":"2023-05-10T01:26:18.980364+0000","last_fullsized":"2023-05-10T01:26:18.980364+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979290+0000","last_change":"2023-05-10T01:26:18.977829+0000","last_active":"2023-05-10T01:26:18.979290+0000","last_peered":"2023-05-10T01:26:18.979290+0000","last_clean":"2023-05-10T01:26:18.979290+0000","last_became_active":"2023-05-10T01:26:18.977552+0000","last_became_peered":"2023-05-10T01:26:18.977552+0000","last_unstale":"2023-05-10T01:26:18.979290+0000","last_undegraded":"2023-05-10T01:26:18.979290+0000","last_fullsized":"2023-05-10T01:26:18.979290+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950638+0000","last_change":"2023-05-10T01:26:18.561026+0000","last_active":"2023-05-10T01:26:18.950638+0000","last_peered":"2023-05-10T01:26:18.950638+0000","last_clean":"2023-05-10T01:26:18.950638+0000","last_became_active":"2023-05-10T01:26:18.560672+0000","last_became_peered":"2023-05-10T01:26:18.560672+0000","last_unstale":"2023-05-10T01:26:18.950638+0000","last_undegraded":"2023-05-10T01:26:18.950638+0000","last_fullsized":"2023-05-10T01:26:18.950638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980906+0000","last_change":"2023-05-10T01:26:18.979154+0000","last_active":"2023-05-10T01:26:18.980906+0000","last_peered":"2023-05-10T01:26:18.980906+0000","last_clean":"2023-05-10T01:26:18.980906+0000","last_became_active":"2023-05-10T01:26:18.978702+0000","last_became_peered":"2023-05-10T01:26:18.978702+0000","last_unstale":"2023-05-10T01:26:18.980906+0000","last_undegraded":"2023-05-10T01:26:18.980906+0000","last_fullsized":"2023-05-10T01:26:18.980906+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950627+0000","last_change":"2023-05-10T01:26:18.560867+0000","last_active":"2023-05-10T01:26:18.950627+0000","last_peered":"2023-05-10T01:26:18.950627+0000","last_clean":"2023-05-10T01:26:18.950627+0000","last_became_active":"2023-05-10T01:26:18.560517+0000","last_became_peered":"2023-05-10T01:26:18.560517+0000","last_unstale":"2023-05-10T01:26:18.950627+0000","last_undegraded":"2023-05-10T01:26:18.950627+0000","last_fullsized":"2023-05-10T01:26:18.950627+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983937+0000","last_change":"2023-05-10T01:26:18.975922+0000","last_active":"2023-05-10T01:26:18.983937+0000","last_peered":"2023-05-10T01:26:18.983937+0000","last_clean":"2023-05-10T01:26:18.983937+0000","last_became_active":"2023-05-10T01:26:18.975625+0000","last_became_peered":"2023-05-10T01:26:18.975625+0000","last_unstale":"2023-05-10T01:26:18.983937+0000","last_undegraded":"2023-05-10T01:26:18.983937+0000","last_fullsized":"2023-05-10T01:26:18.983937+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568747+0000","last_change":"2023-05-10T01:26:18.568747+0000","last_active":"2023-05-10T01:26:18.568747+0000","last_peered":"2023-05-10T01:26:18.568747+0000","last_clean":"2023-05-10T01:26:18.568747+0000","last_became_active":"2023-05-10T01:26:18.568459+0000","last_became_peered":"2023-05-10T01:26:18.568459+0000","last_unstale":"2023-05-10T01:26:18.568747+0000","last_undegraded":"2023-05-10T01:26:18.568747+0000","last_fullsized":"2023-05-10T01:26:18.568747+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969978+0000","last_change":"2023-05-10T01:26:18.968227+0000","last_active":"2023-05-10T01:26:18.969978+0000","last_peered":"2023-05-10T01:26:18.969978+0000","last_clean":"2023-05-10T01:26:18.969978+0000","last_became_active":"2023-05-10T01:26:18.967878+0000","last_became_peered":"2023-05-10T01:26:18.967878+0000","last_unstale":"2023-05-10T01:26:18.969978+0000","last_undegraded":"2023-05-10T01:26:18.969978+0000","last_fullsized":"2023-05-10T01:26:18.969978+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970296+0000","last_change":"2023-05-10T01:26:18.572795+0000","last_active":"2023-05-10T01:26:18.970296+0000","last_peered":"2023-05-10T01:26:18.970296+0000","last_clean":"2023-05-10T01:26:18.970296+0000","last_became_active":"2023-05-10T01:26:18.572492+0000","last_became_peered":"2023-05-10T01:26:18.572492+0000","last_unstale":"2023-05-10T01:26:18.970296+0000","last_undegraded":"2023-05-10T01:26:18.970296+0000","last_fullsized":"2023-05-10T01:26:18.970296+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984313+0000","last_change":"2023-05-10T01:26:18.980822+0000","last_active":"2023-05-10T01:26:18.984313+0000","last_peered":"2023-05-10T01:26:18.984313+0000","last_clean":"2023-05-10T01:26:18.984313+0000","last_became_active":"2023-05-10T01:26:18.980525+0000","last_became_peered":"2023-05-10T01:26:18.980525+0000","last_unstale":"2023-05-10T01:26:18.984313+0000","last_undegraded":"2023-05-10T01:26:18.984313+0000","last_fullsized":"2023-05-10T01:26:18.984313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-05-10T01:26:19.955231+0000","last_change":"2023-05-10T01:26:18.569164+0000","last_active":"2023-05-10T01:26:19.955231+0000","last_peered":"2023-05-10T01:26:19.955231+0000","last_clean":"2023-05-10T01:26:19.955231+0000","last_became_active":"2023-05-10T01:26:18.568880+0000","last_became_peered":"2023-05-10T01:26:18.568880+0000","last_unstale":"2023-05-10T01:26:19.955231+0000","last_undegraded":"2023-05-10T01:26:19.955231+0000","last_fullsized":"2023-05-10T01:26:19.955231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984073+0000","last_change":"2023-05-10T01:26:18.977385+0000","last_active":"2023-05-10T01:26:18.984073+0000","last_peered":"2023-05-10T01:26:18.984073+0000","last_clean":"2023-05-10T01:26:18.984073+0000","last_became_active":"2023-05-10T01:26:18.977035+0000","last_became_peered":"2023-05-10T01:26:18.977035+0000","last_unstale":"2023-05-10T01:26:18.984073+0000","last_undegraded":"2023-05-10T01:26:18.984073+0000","last_fullsized":"2023-05-10T01:26:18.984073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579601+0000","last_change":"2023-05-10T01:26:18.579601+0000","last_active":"2023-05-10T01:26:18.579601+0000","last_peered":"2023-05-10T01:26:18.579601+0000","last_clean":"2023-05-10T01:26:18.579601+0000","last_became_active":"2023-05-10T01:26:18.579357+0000","last_became_peered":"2023-05-10T01:26:18.579357+0000","last_unstale":"2023-05-10T01:26:18.579601+0000","last_undegraded":"2023-05-10T01:26:18.579601+0000","last_fullsized":"2023-05-10T01:26:18.579601+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981042+0000","last_change":"2023-05-10T01:26:18.979843+0000","last_active":"2023-05-10T01:26:18.981042+0000","last_peered":"2023-05-10T01:26:18.981042+0000","last_clean":"2023-05-10T01:26:18.981042+0000","last_became_active":"2023-05-10T01:26:18.979531+0000","last_became_peered":"2023-05-10T01:26:18.979531+0000","last_unstale":"2023-05-10T01:26:18.981042+0000","last_undegraded":"2023-05-10T01:26:18.981042+0000","last_fullsized":"2023-05-10T01:26:18.981042+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969780+0000","last_change":"2023-05-10T01:26:18.578551+0000","last_active":"2023-05-10T01:26:18.969780+0000","last_peered":"2023-05-10T01:26:18.969780+0000","last_clean":"2023-05-10T01:26:18.969780+0000","last_became_active":"2023-05-10T01:26:18.578284+0000","last_became_peered":"2023-05-10T01:26:18.578284+0000","last_unstale":"2023-05-10T01:26:18.969780+0000","last_undegraded":"2023-05-10T01:26:18.969780+0000","last_fullsized":"2023-05-10T01:26:18.969780+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981032+0000","last_change":"2023-05-10T01:26:18.980314+0000","last_active":"2023-05-10T01:26:18.981032+0000","last_peered":"2023-05-10T01:26:18.981032+0000","last_clean":"2023-05-10T01:26:18.981032+0000","last_became_active":"2023-05-10T01:26:18.980009+0000","last_became_peered":"2023-05-10T01:26:18.980009+0000","last_unstale":"2023-05-10T01:26:18.981032+0000","last_undegraded":"2023-05-10T01:26:18.981032+0000","last_fullsized":"2023-05-10T01:26:18.981032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950702+0000","last_change":"2023-05-10T01:26:18.574810+0000","last_active":"2023-05-10T01:26:18.950702+0000","last_peered":"2023-05-10T01:26:18.950702+0000","last_clean":"2023-05-10T01:26:18.950702+0000","last_became_active":"2023-05-10T01:26:18.574499+0000","last_became_peered":"2023-05-10T01:26:18.574499+0000","last_unstale":"2023-05-10T01:26:18.950702+0000","last_undegraded":"2023-05-10T01:26:18.950702+0000","last_fullsized":"2023-05-10T01:26:18.950702+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.968399+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.967572+0000","last_became_peered":"2023-05-10T01:26:18.967572+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962166+0000","last_change":"2023-05-10T01:26:18.579613+0000","last_active":"2023-05-10T01:26:18.962166+0000","last_peered":"2023-05-10T01:26:18.962166+0000","last_clean":"2023-05-10T01:26:18.962166+0000","last_became_active":"2023-05-10T01:26:18.579329+0000","last_became_peered":"2023-05-10T01:26:18.579329+0000","last_unstale":"2023-05-10T01:26:18.962166+0000","last_undegraded":"2023-05-10T01:26:18.962166+0000","last_fullsized":"2023-05-10T01:26:18.962166+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986337+0000","last_change":"2023-05-10T01:26:18.983347+0000","last_active":"2023-05-10T01:26:18.986337+0000","last_peered":"2023-05-10T01:26:18.986337+0000","last_clean":"2023-05-10T01:26:18.986337+0000","last_became_active":"2023-05-10T01:26:18.983062+0000","last_became_peered":"2023-05-10T01:26:18.983062+0000","last_unstale":"2023-05-10T01:26:18.986337+0000","last_undegraded":"2023-05-10T01:26:18.986337+0000","last_fullsized":"2023-05-10T01:26:18.986337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953996+0000","last_change":"2023-05-10T01:26:18.573948+0000","last_active":"2023-05-10T01:26:18.953996+0000","last_peered":"2023-05-10T01:26:18.953996+0000","last_clean":"2023-05-10T01:26:18.953996+0000","last_became_active":"2023-05-10T01:26:18.573657+0000","last_became_peered":"2023-05-10T01:26:18.573657+0000","last_unstale":"2023-05-10T01:26:18.953996+0000","last_undegraded":"2023-05-10T01:26:18.953996+0000","last_fullsized":"2023-05-10T01:26:18.953996+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961425+0000","last_change":"2023-05-10T01:26:18.959076+0000","last_active":"2023-05-10T01:26:18.961425+0000","last_peered":"2023-05-10T01:26:18.961425+0000","last_clean":"2023-05-10T01:26:18.961425+0000","last_became_active":"2023-05-10T01:26:18.958781+0000","last_became_peered":"2023-05-10T01:26:18.958781+0000","last_unstale":"2023-05-10T01:26:18.961425+0000","last_undegraded":"2023-05-10T01:26:18.961425+0000","last_fullsized":"2023-05-10T01:26:18.961425+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954585+0000","last_change":"2023-05-10T01:26:18.568537+0000","last_active":"2023-05-10T01:26:18.954585+0000","last_peered":"2023-05-10T01:26:18.954585+0000","last_clean":"2023-05-10T01:26:18.954585+0000","last_became_active":"2023-05-10T01:26:18.568280+0000","last_became_peered":"2023-05-10T01:26:18.568280+0000","last_unstale":"2023-05-10T01:26:18.954585+0000","last_undegraded":"2023-05-10T01:26:18.954585+0000","last_fullsized":"2023-05-10T01:26:18.954585+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981294+0000","last_change":"2023-05-10T01:26:18.977492+0000","last_active":"2023-05-10T01:26:18.981294+0000","last_peered":"2023-05-10T01:26:18.981294+0000","last_clean":"2023-05-10T01:26:18.981294+0000","last_became_active":"2023-05-10T01:26:18.976984+0000","last_became_peered":"2023-05-10T01:26:18.976984+0000","last_unstale":"2023-05-10T01:26:18.981294+0000","last_undegraded":"2023-05-10T01:26:18.981294+0000","last_fullsized":"2023-05-10T01:26:18.981294+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961450+0000","last_change":"2023-05-10T01:26:18.573919+0000","last_active":"2023-05-10T01:26:18.961450+0000","last_peered":"2023-05-10T01:26:18.961450+0000","last_clean":"2023-05-10T01:26:18.961450+0000","last_became_active":"2023-05-10T01:26:18.573623+0000","last_became_peered":"2023-05-10T01:26:18.573623+0000","last_unstale":"2023-05-10T01:26:18.961450+0000","last_undegraded":"2023-05-10T01:26:18.961450+0000","last_fullsized":"2023-05-10T01:26:18.961450+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972875+0000","last_change":"2023-05-10T01:26:18.969323+0000","last_active":"2023-05-10T01:26:18.972875+0000","last_peered":"2023-05-10T01:26:18.972875+0000","last_clean":"2023-05-10T01:26:18.972875+0000","last_became_active":"2023-05-10T01:26:18.969064+0000","last_became_peered":"2023-05-10T01:26:18.969064+0000","last_unstale":"2023-05-10T01:26:18.972875+0000","last_undegraded":"2023-05-10T01:26:18.972875+0000","last_fullsized":"2023-05-10T01:26:18.972875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975962+0000","last_change":"2023-05-10T01:26:18.566612+0000","last_active":"2023-05-10T01:26:18.975962+0000","last_peered":"2023-05-10T01:26:18.975962+0000","last_clean":"2023-05-10T01:26:18.975962+0000","last_became_active":"2023-05-10T01:26:18.566339+0000","last_became_peered":"2023-05-10T01:26:18.566339+0000","last_unstale":"2023-05-10T01:26:18.975962+0000","last_undegraded":"2023-05-10T01:26:18.975962+0000","last_fullsized":"2023-05-10T01:26:18.975962+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986012+0000","last_change":"2023-05-10T01:26:18.979914+0000","last_active":"2023-05-10T01:26:18.986012+0000","last_peered":"2023-05-10T01:26:18.986012+0000","last_clean":"2023-05-10T01:26:18.986012+0000","last_became_active":"2023-05-10T01:26:18.978337+0000","last_became_peered":"2023-05-10T01:26:18.978337+0000","last_unstale":"2023-05-10T01:26:18.986012+0000","last_undegraded":"2023-05-10T01:26:18.986012+0000","last_fullsized":"2023-05-10T01:26:18.986012+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981678+0000","last_change":"2023-05-10T01:26:18.569910+0000","last_active":"2023-05-10T01:26:18.981678+0000","last_peered":"2023-05-10T01:26:18.981678+0000","last_clean":"2023-05-10T01:26:18.981678+0000","last_became_active":"2023-05-10T01:26:18.569422+0000","last_became_peered":"2023-05-10T01:26:18.569422+0000","last_unstale":"2023-05-10T01:26:18.981678+0000","last_undegraded":"2023-05-10T01:26:18.981678+0000","last_fullsized":"2023-05-10T01:26:18.981678+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981337+0000","last_change":"2023-05-10T01:26:18.979463+0000","last_active":"2023-05-10T01:26:18.981337+0000","last_peered":"2023-05-10T01:26:18.981337+0000","last_clean":"2023-05-10T01:26:18.981337+0000","last_became_active":"2023-05-10T01:26:18.979196+0000","last_became_peered":"2023-05-10T01:26:18.979196+0000","last_unstale":"2023-05-10T01:26:18.981337+0000","last_undegraded":"2023-05-10T01:26:18.981337+0000","last_fullsized":"2023-05-10T01:26:18.981337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953861+0000","last_change":"2023-05-10T01:26:18.565715+0000","last_active":"2023-05-10T01:26:18.953861+0000","last_peered":"2023-05-10T01:26:18.953861+0000","last_clean":"2023-05-10T01:26:18.953861+0000","last_became_active":"2023-05-10T01:26:18.565428+0000","last_became_peered":"2023-05-10T01:26:18.565428+0000","last_unstale":"2023-05-10T01:26:18.953861+0000","last_undegraded":"2023-05-10T01:26:18.953861+0000","last_fullsized":"2023-05-10T01:26:18.953861+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969143+0000","last_change":"2023-05-10T01:26:18.967157+0000","last_active":"2023-05-10T01:26:18.969143+0000","last_peered":"2023-05-10T01:26:18.969143+0000","last_clean":"2023-05-10T01:26:18.969143+0000","last_became_active":"2023-05-10T01:26:18.966855+0000","last_became_peered":"2023-05-10T01:26:18.966855+0000","last_unstale":"2023-05-10T01:26:18.969143+0000","last_undegraded":"2023-05-10T01:26:18.969143+0000","last_fullsized":"2023-05-10T01:26:18.969143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569655+0000","last_change":"2023-05-10T01:26:18.569655+0000","last_active":"2023-05-10T01:26:18.569655+0000","last_peered":"2023-05-10T01:26:18.569655+0000","last_clean":"2023-05-10T01:26:18.569655+0000","last_became_active":"2023-05-10T01:26:18.569340+0000","last_became_peered":"2023-05-10T01:26:18.569340+0000","last_unstale":"2023-05-10T01:26:18.569655+0000","last_undegraded":"2023-05-10T01:26:18.569655+0000","last_fullsized":"2023-05-10T01:26:18.569655+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979056+0000","last_change":"2023-05-10T01:26:18.978201+0000","last_active":"2023-05-10T01:26:18.979056+0000","last_peered":"2023-05-10T01:26:18.979056+0000","last_clean":"2023-05-10T01:26:18.979056+0000","last_became_active":"2023-05-10T01:26:18.977901+0000","last_became_peered":"2023-05-10T01:26:18.977901+0000","last_unstale":"2023-05-10T01:26:18.979056+0000","last_undegraded":"2023-05-10T01:26:18.979056+0000","last_fullsized":"2023-05-10T01:26:18.979056+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961877+0000","last_change":"2023-05-10T01:26:18.561470+0000","last_active":"2023-05-10T01:26:18.961877+0000","last_peered":"2023-05-10T01:26:18.961877+0000","last_clean":"2023-05-10T01:26:18.961877+0000","last_became_active":"2023-05-10T01:26:18.561192+0000","last_became_peered":"2023-05-10T01:26:18.561192+0000","last_unstale":"2023-05-10T01:26:18.961877+0000","last_undegraded":"2023-05-10T01:26:18.961877+0000","last_fullsized":"2023-05-10T01:26:18.961877+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986239+0000","last_change":"2023-05-10T01:26:18.981603+0000","last_active":"2023-05-10T01:26:18.986239+0000","last_peered":"2023-05-10T01:26:18.986239+0000","last_clean":"2023-05-10T01:26:18.986239+0000","last_became_active":"2023-05-10T01:26:18.981305+0000","last_became_peered":"2023-05-10T01:26:18.981305+0000","last_unstale":"2023-05-10T01:26:18.986239+0000","last_undegraded":"2023-05-10T01:26:18.986239+0000","last_fullsized":"2023-05-10T01:26:18.986239+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962513+0000","last_change":"2023-05-10T01:26:18.570686+0000","last_active":"2023-05-10T01:26:18.962513+0000","last_peered":"2023-05-10T01:26:18.962513+0000","last_clean":"2023-05-10T01:26:18.962513+0000","last_became_active":"2023-05-10T01:26:18.569082+0000","last_became_peered":"2023-05-10T01:26:18.569082+0000","last_unstale":"2023-05-10T01:26:18.962513+0000","last_undegraded":"2023-05-10T01:26:18.962513+0000","last_fullsized":"2023-05-10T01:26:18.962513+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.959799+0000","last_change":"2023-05-10T01:26:18.958884+0000","last_active":"2023-05-10T01:26:18.959799+0000","last_peered":"2023-05-10T01:26:18.959799+0000","last_clean":"2023-05-10T01:26:18.959799+0000","last_became_active":"2023-05-10T01:26:18.958618+0000","last_became_peered":"2023-05-10T01:26:18.958618+0000","last_unstale":"2023-05-10T01:26:18.959799+0000","last_undegraded":"2023-05-10T01:26:18.959799+0000","last_fullsized":"2023-05-10T01:26:18.959799+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954615+0000","last_change":"2023-05-10T01:26:18.568330+0000","last_active":"2023-05-10T01:26:18.954615+0000","last_peered":"2023-05-10T01:26:18.954615+0000","last_clean":"2023-05-10T01:26:18.954615+0000","last_became_active":"2023-05-10T01:26:18.568050+0000","last_became_peered":"2023-05-10T01:26:18.568050+0000","last_unstale":"2023-05-10T01:26:18.954615+0000","last_undegraded":"2023-05-10T01:26:18.954615+0000","last_fullsized":"2023-05-10T01:26:18.954615+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981313+0000","last_change":"2023-05-10T01:26:18.978294+0000","last_active":"2023-05-10T01:26:18.981313+0000","last_peered":"2023-05-10T01:26:18.981313+0000","last_clean":"2023-05-10T01:26:18.981313+0000","last_became_active":"2023-05-10T01:26:18.978004+0000","last_became_peered":"2023-05-10T01:26:18.978004+0000","last_unstale":"2023-05-10T01:26:18.981313+0000","last_undegraded":"2023-05-10T01:26:18.981313+0000","last_fullsized":"2023-05-10T01:26:18.981313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971271+0000","last_change":"2023-05-10T01:26:18.570874+0000","last_active":"2023-05-10T01:26:18.971271+0000","last_peered":"2023-05-10T01:26:18.971271+0000","last_clean":"2023-05-10T01:26:18.971271+0000","last_became_active":"2023-05-10T01:26:18.569744+0000","last_became_peered":"2023-05-10T01:26:18.569744+0000","last_unstale":"2023-05-10T01:26:18.971271+0000","last_undegraded":"2023-05-10T01:26:18.971271+0000","last_fullsized":"2023-05-10T01:26:18.971271+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975668+0000","last_change":"2023-05-10T01:26:18.974160+0000","last_active":"2023-05-10T01:26:18.975668+0000","last_peered":"2023-05-10T01:26:18.975668+0000","last_clean":"2023-05-10T01:26:18.975668+0000","last_became_active":"2023-05-10T01:26:18.973883+0000","last_became_peered":"2023-05-10T01:26:18.973883+0000","last_unstale":"2023-05-10T01:26:18.975668+0000","last_undegraded":"2023-05-10T01:26:18.975668+0000","last_fullsized":"2023-05-10T01:26:18.975668+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950863+0000","last_change":"2023-05-10T01:26:18.566957+0000","last_active":"2023-05-10T01:26:18.950863+0000","last_peered":"2023-05-10T01:26:18.950863+0000","last_clean":"2023-05-10T01:26:18.950863+0000","last_became_active":"2023-05-10T01:26:18.566513+0000","last_became_peered":"2023-05-10T01:26:18.566513+0000","last_unstale":"2023-05-10T01:26:18.950863+0000","last_undegraded":"2023-05-10T01:26:18.950863+0000","last_fullsized":"2023-05-10T01:26:18.950863+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973486+0000","last_change":"2023-05-10T01:26:18.968563+0000","last_active":"2023-05-10T01:26:18.973486+0000","last_peered":"2023-05-10T01:26:18.973486+0000","last_clean":"2023-05-10T01:26:18.973486+0000","last_became_active":"2023-05-10T01:26:18.968254+0000","last_became_peered":"2023-05-10T01:26:18.968254+0000","last_unstale":"2023-05-10T01:26:18.973486+0000","last_undegraded":"2023-05-10T01:26:18.973486+0000","last_fullsized":"2023-05-10T01:26:18.973486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571475+0000","last_change":"2023-05-10T01:26:18.571475+0000","last_active":"2023-05-10T01:26:18.571475+0000","last_peered":"2023-05-10T01:26:18.571475+0000","last_clean":"2023-05-10T01:26:18.571475+0000","last_became_active":"2023-05-10T01:26:18.569950+0000","last_became_peered":"2023-05-10T01:26:18.569950+0000","last_unstale":"2023-05-10T01:26:18.571475+0000","last_undegraded":"2023-05-10T01:26:18.571475+0000","last_fullsized":"2023-05-10T01:26:18.571475+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.970445+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.970153+0000","last_became_peered":"2023-05-10T01:26:18.970153+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976396+0000","last_change":"2023-05-10T01:26:18.573036+0000","last_active":"2023-05-10T01:26:18.976396+0000","last_peered":"2023-05-10T01:26:18.976396+0000","last_clean":"2023-05-10T01:26:18.976396+0000","last_became_active":"2023-05-10T01:26:18.572465+0000","last_became_peered":"2023-05-10T01:26:18.572465+0000","last_unstale":"2023-05-10T01:26:18.976396+0000","last_undegraded":"2023-05-10T01:26:18.976396+0000","last_fullsized":"2023-05-10T01:26:18.976396+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972570+0000","last_change":"2023-05-10T01:26:18.965093+0000","last_active":"2023-05-10T01:26:18.972570+0000","last_peered":"2023-05-10T01:26:18.972570+0000","last_clean":"2023-05-10T01:26:18.972570+0000","last_became_active":"2023-05-10T01:26:18.964893+0000","last_became_peered":"2023-05-10T01:26:18.964893+0000","last_unstale":"2023-05-10T01:26:18.972570+0000","last_undegraded":"2023-05-10T01:26:18.972570+0000","last_fullsized":"2023-05-10T01:26:18.972570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963502+0000","last_change":"2023-05-10T01:26:18.580354+0000","last_active":"2023-05-10T01:26:18.963502+0000","last_peered":"2023-05-10T01:26:18.963502+0000","last_clean":"2023-05-10T01:26:18.963502+0000","last_became_active":"2023-05-10T01:26:18.580040+0000","last_became_peered":"2023-05-10T01:26:18.580040+0000","last_unstale":"2023-05-10T01:26:18.963502+0000","last_undegraded":"2023-05-10T01:26:18.963502+0000","last_fullsized":"2023-05-10T01:26:18.963502+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983953+0000","last_change":"2023-05-10T01:26:18.976867+0000","last_active":"2023-05-10T01:26:18.983953+0000","last_peered":"2023-05-10T01:26:18.983953+0000","last_clean":"2023-05-10T01:26:18.983953+0000","last_became_active":"2023-05-10T01:26:18.976452+0000","last_became_peered":"2023-05-10T01:26:18.976452+0000","last_unstale":"2023-05-10T01:26:18.983953+0000","last_undegraded":"2023-05-10T01:26:18.983953+0000","last_fullsized":"2023-05-10T01:26:18.983953+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954051+0000","last_change":"2023-05-10T01:26:18.567694+0000","last_active":"2023-05-10T01:26:18.954051+0000","last_peered":"2023-05-10T01:26:18.954051+0000","last_clean":"2023-05-10T01:26:18.954051+0000","last_became_active":"2023-05-10T01:26:18.567244+0000","last_became_peered":"2023-05-10T01:26:18.567244+0000","last_unstale":"2023-05-10T01:26:18.954051+0000","last_undegraded":"2023-05-10T01:26:18.954051+0000","last_fullsized":"2023-05-10T01:26:18.954051+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982326+0000","last_change":"2023-05-10T01:26:18.978674+0000","last_active":"2023-05-10T01:26:18.982326+0000","last_peered":"2023-05-10T01:26:18.982326+0000","last_clean":"2023-05-10T01:26:18.982326+0000","last_became_active":"2023-05-10T01:26:18.978366+0000","last_became_peered":"2023-05-10T01:26:18.978366+0000","last_unstale":"2023-05-10T01:26:18.982326+0000","last_undegraded":"2023-05-10T01:26:18.982326+0000","last_fullsized":"2023-05-10T01:26:18.982326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961008+0000","last_change":"2023-05-10T01:26:18.572168+0000","last_active":"2023-05-10T01:26:18.961008+0000","last_peered":"2023-05-10T01:26:18.961008+0000","last_clean":"2023-05-10T01:26:18.961008+0000","last_became_active":"2023-05-10T01:26:18.571872+0000","last_became_peered":"2023-05-10T01:26:18.571872+0000","last_unstale":"2023-05-10T01:26:18.961008+0000","last_undegraded":"2023-05-10T01:26:18.961008+0000","last_fullsized":"2023-05-10T01:26:18.961008+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972109+0000","last_change":"2023-05-10T01:26:18.968772+0000","last_active":"2023-05-10T01:26:18.972109+0000","last_peered":"2023-05-10T01:26:18.972109+0000","last_clean":"2023-05-10T01:26:18.972109+0000","last_became_active":"2023-05-10T01:26:18.967819+0000","last_became_peered":"2023-05-10T01:26:18.967819+0000","last_unstale":"2023-05-10T01:26:18.972109+0000","last_undegraded":"2023-05-10T01:26:18.972109+0000","last_fullsized":"2023-05-10T01:26:18.972109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980075+0000","last_change":"2023-05-10T01:26:18.569425+0000","last_active":"2023-05-10T01:26:18.980075+0000","last_peered":"2023-05-10T01:26:18.980075+0000","last_clean":"2023-05-10T01:26:18.980075+0000","last_became_active":"2023-05-10T01:26:18.569075+0000","last_became_peered":"2023-05-10T01:26:18.569075+0000","last_unstale":"2023-05-10T01:26:18.980075+0000","last_undegraded":"2023-05-10T01:26:18.980075+0000","last_fullsized":"2023-05-10T01:26:18.980075+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961234+0000","last_change":"2023-05-10T01:26:18.959040+0000","last_active":"2023-05-10T01:26:18.961234+0000","last_peered":"2023-05-10T01:26:18.961234+0000","last_clean":"2023-05-10T01:26:18.961234+0000","last_became_active":"2023-05-10T01:26:18.958767+0000","last_became_peered":"2023-05-10T01:26:18.958767+0000","last_unstale":"2023-05-10T01:26:18.961234+0000","last_undegraded":"2023-05-10T01:26:18.961234+0000","last_fullsized":"2023-05-10T01:26:18.961234+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963744+0000","last_change":"2023-05-10T01:26:18.580476+0000","last_active":"2023-05-10T01:26:18.963744+0000","last_peered":"2023-05-10T01:26:18.963744+0000","last_clean":"2023-05-10T01:26:18.963744+0000","last_became_active":"2023-05-10T01:26:18.580007+0000","last_became_peered":"2023-05-10T01:26:18.580007+0000","last_unstale":"2023-05-10T01:26:18.963744+0000","last_undegraded":"2023-05-10T01:26:18.963744+0000","last_fullsized":"2023-05-10T01:26:18.963744+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980228+0000","last_change":"2023-05-10T01:26:18.975016+0000","last_active":"2023-05-10T01:26:18.980228+0000","last_peered":"2023-05-10T01:26:18.980228+0000","last_clean":"2023-05-10T01:26:18.980228+0000","last_became_active":"2023-05-10T01:26:18.974745+0000","last_became_peered":"2023-05-10T01:26:18.974745+0000","last_unstale":"2023-05-10T01:26:18.980228+0000","last_undegraded":"2023-05-10T01:26:18.980228+0000","last_fullsized":"2023-05-10T01:26:18.980228+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950970+0000","last_change":"2023-05-10T01:26:18.560982+0000","last_active":"2023-05-10T01:26:18.950970+0000","last_peered":"2023-05-10T01:26:18.950970+0000","last_clean":"2023-05-10T01:26:18.950970+0000","last_became_active":"2023-05-10T01:26:18.560649+0000","last_became_peered":"2023-05-10T01:26:18.560649+0000","last_unstale":"2023-05-10T01:26:18.950970+0000","last_undegraded":"2023-05-10T01:26:18.950970+0000","last_fullsized":"2023-05-10T01:26:18.950970+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.977733+0000","last_change":"2023-05-10T01:26:18.976890+0000","last_active":"2023-05-10T01:26:18.977733+0000","last_peered":"2023-05-10T01:26:18.977733+0000","last_clean":"2023-05-10T01:26:18.977733+0000","last_became_active":"2023-05-10T01:26:18.976638+0000","last_became_peered":"2023-05-10T01:26:18.976638+0000","last_unstale":"2023-05-10T01:26:18.977733+0000","last_undegraded":"2023-05-10T01:26:18.977733+0000","last_fullsized":"2023-05-10T01:26:18.977733+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971866+0000","last_change":"2023-05-10T01:26:18.575580+0000","last_active":"2023-05-10T01:26:18.971866+0000","last_peered":"2023-05-10T01:26:18.971866+0000","last_clean":"2023-05-10T01:26:18.971866+0000","last_became_active":"2023-05-10T01:26:18.575249+0000","last_became_peered":"2023-05-10T01:26:18.575249+0000","last_unstale":"2023-05-10T01:26:18.971866+0000","last_undegraded":"2023-05-10T01:26:18.971866+0000","last_fullsized":"2023-05-10T01:26:18.971866+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979702+0000","last_change":"2023-05-10T01:26:18.977320+0000","last_active":"2023-05-10T01:26:18.979702+0000","last_peered":"2023-05-10T01:26:18.979702+0000","last_clean":"2023-05-10T01:26:18.979702+0000","last_became_active":"2023-05-10T01:26:18.968364+0000","last_became_peered":"2023-05-10T01:26:18.968364+0000","last_unstale":"2023-05-10T01:26:18.979702+0000","last_undegraded":"2023-05-10T01:26:18.979702+0000","last_fullsized":"2023-05-10T01:26:18.979702+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953969+0000","last_change":"2023-05-10T01:26:18.572138+0000","last_active":"2023-05-10T01:26:18.953969+0000","last_peered":"2023-05-10T01:26:18.953969+0000","last_clean":"2023-05-10T01:26:18.953969+0000","last_became_active":"2023-05-10T01:26:18.569386+0000","last_became_peered":"2023-05-10T01:26:18.569386+0000","last_unstale":"2023-05-10T01:26:18.953969+0000","last_undegraded":"2023-05-10T01:26:18.953969+0000","last_fullsized":"2023-05-10T01:26:18.953969+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972925+0000","last_change":"2023-05-10T01:26:18.970193+0000","last_active":"2023-05-10T01:26:18.972925+0000","last_peered":"2023-05-10T01:26:18.972925+0000","last_clean":"2023-05-10T01:26:18.972925+0000","last_became_active":"2023-05-10T01:26:18.969884+0000","last_became_peered":"2023-05-10T01:26:18.969884+0000","last_unstale":"2023-05-10T01:26:18.972925+0000","last_undegraded":"2023-05-10T01:26:18.972925+0000","last_fullsized":"2023-05-10T01:26:18.972925+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968737+0000","last_change":"2023-05-10T01:26:18.569725+0000","last_active":"2023-05-10T01:26:18.968737+0000","last_peered":"2023-05-10T01:26:18.968737+0000","last_clean":"2023-05-10T01:26:18.968737+0000","last_became_active":"2023-05-10T01:26:18.569433+0000","last_became_peered":"2023-05-10T01:26:18.569433+0000","last_unstale":"2023-05-10T01:26:18.968737+0000","last_undegraded":"2023-05-10T01:26:18.968737+0000","last_fullsized":"2023-05-10T01:26:18.968737+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972865+0000","last_change":"2023-05-10T01:26:18.971705+0000","last_active":"2023-05-10T01:26:18.972865+0000","last_peered":"2023-05-10T01:26:18.972865+0000","last_clean":"2023-05-10T01:26:18.972865+0000","last_became_active":"2023-05-10T01:26:18.969722+0000","last_became_peered":"2023-05-10T01:26:18.969722+0000","last_unstale":"2023-05-10T01:26:18.972865+0000","last_undegraded":"2023-05-10T01:26:18.972865+0000","last_fullsized":"2023-05-10T01:26:18.972865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962270+0000","last_change":"2023-05-10T01:26:18.576060+0000","last_active":"2023-05-10T01:26:18.962270+0000","last_peered":"2023-05-10T01:26:18.962270+0000","last_clean":"2023-05-10T01:26:18.962270+0000","last_became_active":"2023-05-10T01:26:18.575751+0000","last_became_peered":"2023-05-10T01:26:18.575751+0000","last_unstale":"2023-05-10T01:26:18.962270+0000","last_undegraded":"2023-05-10T01:26:18.962270+0000","last_fullsized":"2023-05-10T01:26:18.962270+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558196+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970841+0000","last_change":"2023-05-10T01:26:18.578645+0000","last_active":"2023-05-10T01:26:18.970841+0000","last_peered":"2023-05-10T01:26:18.970841+0000","last_clean":"2023-05-10T01:26:18.970841+0000","last_became_active":"2023-05-10T01:26:18.578350+0000","last_became_peered":"2023-05-10T01:26:18.578350+0000","last_unstale":"2023-05-10T01:26:18.970841+0000","last_undegraded":"2023-05-10T01:26:18.970841+0000","last_fullsized":"2023-05-10T01:26:18.970841+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975930+0000","last_change":"2023-05-10T01:26:18.971661+0000","last_active":"2023-05-10T01:26:18.975930+0000","last_peered":"2023-05-10T01:26:18.975930+0000","last_clean":"2023-05-10T01:26:18.975930+0000","last_became_active":"2023-05-10T01:26:18.971078+0000","last_became_peered":"2023-05-10T01:26:18.971078+0000","last_unstale":"2023-05-10T01:26:18.975930+0000","last_undegraded":"2023-05-10T01:26:18.975930+0000","last_fullsized":"2023-05-10T01:26:18.975930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960417+0000","last_change":"2023-05-10T01:26:18.580160+0000","last_active":"2023-05-10T01:26:18.960417+0000","last_peered":"2023-05-10T01:26:18.960417+0000","last_clean":"2023-05-10T01:26:18.960417+0000","last_became_active":"2023-05-10T01:26:18.576910+0000","last_became_peered":"2023-05-10T01:26:18.576910+0000","last_unstale":"2023-05-10T01:26:18.960417+0000","last_undegraded":"2023-05-10T01:26:18.960417+0000","last_fullsized":"2023-05-10T01:26:18.960417+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982521+0000","last_change":"2023-05-10T01:26:18.981668+0000","last_active":"2023-05-10T01:26:18.982521+0000","last_peered":"2023-05-10T01:26:18.982521+0000","last_clean":"2023-05-10T01:26:18.982521+0000","last_became_active":"2023-05-10T01:26:18.981394+0000","last_became_peered":"2023-05-10T01:26:18.981394+0000","last_unstale":"2023-05-10T01:26:18.982521+0000","last_undegraded":"2023-05-10T01:26:18.982521+0000","last_fullsized":"2023-05-10T01:26:18.982521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970750+0000","last_change":"2023-05-10T01:26:18.569768+0000","last_active":"2023-05-10T01:26:18.970750+0000","last_peered":"2023-05-10T01:26:18.970750+0000","last_clean":"2023-05-10T01:26:18.970750+0000","last_became_active":"2023-05-10T01:26:18.569436+0000","last_became_peered":"2023-05-10T01:26:18.569436+0000","last_unstale":"2023-05-10T01:26:18.970750+0000","last_undegraded":"2023-05-10T01:26:18.970750+0000","last_fullsized":"2023-05-10T01:26:18.970750+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954048+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:18.954048+0000","last_peered":"2023-05-10T01:26:18.954048+0000","last_clean":"2023-05-10T01:26:18.954048+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:18.954048+0000","last_undegraded":"2023-05-10T01:26:18.954048+0000","last_fullsized":"2023-05-10T01:26:18.954048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969958+0000","last_change":"2023-05-10T01:26:18.964991+0000","last_active":"2023-05-10T01:26:18.969958+0000","last_peered":"2023-05-10T01:26:18.969958+0000","last_clean":"2023-05-10T01:26:18.969958+0000","last_became_active":"2023-05-10T01:26:18.964688+0000","last_became_peered":"2023-05-10T01:26:18.964688+0000","last_unstale":"2023-05-10T01:26:18.969958+0000","last_undegraded":"2023-05-10T01:26:18.969958+0000","last_fullsized":"2023-05-10T01:26:18.969958+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984331+0000","last_change":"2023-05-10T01:26:18.575263+0000","last_active":"2023-05-10T01:26:18.984331+0000","last_peered":"2023-05-10T01:26:18.984331+0000","last_clean":"2023-05-10T01:26:18.984331+0000","last_became_active":"2023-05-10T01:26:18.574988+0000","last_became_peered":"2023-05-10T01:26:18.574988+0000","last_unstale":"2023-05-10T01:26:18.984331+0000","last_undegraded":"2023-05-10T01:26:18.984331+0000","last_fullsized":"2023-05-10T01:26:18.984331+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961951+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:18.961951+0000","last_peered":"2023-05-10T01:26:18.961951+0000","last_clean":"2023-05-10T01:26:18.961951+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:18.961951+0000","last_undegraded":"2023-05-10T01:26:18.961951+0000","last_fullsized":"2023-05-10T01:26:18.961951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968295+0000","last_change":"2023-05-10T01:26:18.964989+0000","last_active":"2023-05-10T01:26:18.968295+0000","last_peered":"2023-05-10T01:26:18.968295+0000","last_clean":"2023-05-10T01:26:18.968295+0000","last_became_active":"2023-05-10T01:26:18.964712+0000","last_became_peered":"2023-05-10T01:26:18.964712+0000","last_unstale":"2023-05-10T01:26:18.968295+0000","last_undegraded":"2023-05-10T01:26:18.968295+0000","last_fullsized":"2023-05-10T01:26:18.968295+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961619+0000","last_change":"2023-05-10T01:26:18.569662+0000","last_active":"2023-05-10T01:26:18.961619+0000","last_peered":"2023-05-10T01:26:18.961619+0000","last_clean":"2023-05-10T01:26:18.961619+0000","last_became_active":"2023-05-10T01:26:18.569358+0000","last_became_peered":"2023-05-10T01:26:18.569358+0000","last_unstale":"2023-05-10T01:26:18.961619+0000","last_undegraded":"2023-05-10T01:26:18.961619+0000","last_fullsized":"2023-05-10T01:26:18.961619+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961120+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:18.961120+0000","last_peered":"2023-05-10T01:26:18.961120+0000","last_clean":"2023-05-10T01:26:18.961120+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:18.961120+0000","last_undegraded":"2023-05-10T01:26:18.961120+0000","last_fullsized":"2023-05-10T01:26:18.961120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972323+0000","last_change":"2023-05-10T01:26:18.964995+0000","last_active":"2023-05-10T01:26:18.972323+0000","last_peered":"2023-05-10T01:26:18.972323+0000","last_clean":"2023-05-10T01:26:18.972323+0000","last_became_active":"2023-05-10T01:26:18.964677+0000","last_became_peered":"2023-05-10T01:26:18.964677+0000","last_unstale":"2023-05-10T01:26:18.972323+0000","last_undegraded":"2023-05-10T01:26:18.972323+0000","last_fullsized":"2023-05-10T01:26:18.972323+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971607+0000","last_change":"2023-05-10T01:26:18.575798+0000","last_active":"2023-05-10T01:26:18.971607+0000","last_peered":"2023-05-10T01:26:18.971607+0000","last_clean":"2023-05-10T01:26:18.971607+0000","last_became_active":"2023-05-10T01:26:18.574943+0000","last_became_peered":"2023-05-10T01:26:18.574943+0000","last_unstale":"2023-05-10T01:26:18.971607+0000","last_undegraded":"2023-05-10T01:26:18.971607+0000","last_fullsized":"2023-05-10T01:26:18.971607+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960821+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:18.960821+0000","last_peered":"2023-05-10T01:26:18.960821+0000","last_clean":"2023-05-10T01:26:18.960821+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:18.960821+0000","last_undegraded":"2023-05-10T01:26:18.960821+0000","last_fullsized":"2023-05-10T01:26:18.960821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550227+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:17.550227+0000","last_peered":"2023-05-10T01:26:17.550227+0000","last_clean":"2023-05-10T01:26:17.550227+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:17.550227+0000","last_undegraded":"2023-05-10T01:26:17.550227+0000","last_fullsized":"2023-05-10T01:26:17.550227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983903+0000","last_change":"2023-05-10T01:26:18.976078+0000","last_active":"2023-05-10T01:26:18.983903+0000","last_peered":"2023-05-10T01:26:18.983903+0000","last_clean":"2023-05-10T01:26:18.983903+0000","last_became_active":"2023-05-10T01:26:18.975740+0000","last_became_peered":"2023-05-10T01:26:18.975740+0000","last_unstale":"2023-05-10T01:26:18.983903+0000","last_undegraded":"2023-05-10T01:26:18.983903+0000","last_fullsized":"2023-05-10T01:26:18.983903+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570758+0000","last_change":"2023-05-10T01:26:18.570758+0000","last_active":"2023-05-10T01:26:18.570758+0000","last_peered":"2023-05-10T01:26:18.570758+0000","last_clean":"2023-05-10T01:26:18.570758+0000","last_became_active":"2023-05-10T01:26:18.570490+0000","last_became_peered":"2023-05-10T01:26:18.570490+0000","last_unstale":"2023-05-10T01:26:18.570758+0000","last_undegraded":"2023-05-10T01:26:18.570758+0000","last_fullsized":"2023-05-10T01:26:18.570758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550192+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:17.550192+0000","last_peered":"2023-05-10T01:26:17.550192+0000","last_clean":"2023-05-10T01:26:17.550192+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:17.550192+0000","last_undegraded":"2023-05-10T01:26:17.550192+0000","last_fullsized":"2023-05-10T01:26:17.550192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972898+0000","last_change":"2023-05-10T01:26:18.971829+0000","last_active":"2023-05-10T01:26:18.972898+0000","last_peered":"2023-05-10T01:26:18.972898+0000","last_clean":"2023-05-10T01:26:18.972898+0000","last_became_active":"2023-05-10T01:26:18.970007+0000","last_became_peered":"2023-05-10T01:26:18.970007+0000","last_unstale":"2023-05-10T01:26:18.972898+0000","last_undegraded":"2023-05-10T01:26:18.972898+0000","last_fullsized":"2023-05-10T01:26:18.972898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960315+0000","last_change":"2023-05-10T01:26:18.578122+0000","last_active":"2023-05-10T01:26:18.960315+0000","last_peered":"2023-05-10T01:26:18.960315+0000","last_clean":"2023-05-10T01:26:18.960315+0000","last_became_active":"2023-05-10T01:26:18.577601+0000","last_became_peered":"2023-05-10T01:26:18.577601+0000","last_unstale":"2023-05-10T01:26:18.960315+0000","last_undegraded":"2023-05-10T01:26:18.960315+0000","last_fullsized":"2023-05-10T01:26:18.960315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550258+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:17.550258+0000","last_peered":"2023-05-10T01:26:17.550258+0000","last_clean":"2023-05-10T01:26:17.550258+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:17.550258+0000","last_undegraded":"2023-05-10T01:26:17.550258+0000","last_fullsized":"2023-05-10T01:26:17.550258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962342+0000","last_change":"2023-05-10T01:26:18.959675+0000","last_active":"2023-05-10T01:26:18.962342+0000","last_peered":"2023-05-10T01:26:18.962342+0000","last_clean":"2023-05-10T01:26:18.962342+0000","last_became_active":"2023-05-10T01:26:18.958898+0000","last_became_peered":"2023-05-10T01:26:18.958898+0000","last_unstale":"2023-05-10T01:26:18.962342+0000","last_undegraded":"2023-05-10T01:26:18.962342+0000","last_fullsized":"2023-05-10T01:26:18.962342+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972813+0000","last_change":"2023-05-10T01:26:18.574188+0000","last_active":"2023-05-10T01:26:18.972813+0000","last_peered":"2023-05-10T01:26:18.972813+0000","last_clean":"2023-05-10T01:26:18.972813+0000","last_became_active":"2023-05-10T01:26:18.573881+0000","last_became_peered":"2023-05-10T01:26:18.573881+0000","last_unstale":"2023-05-10T01:26:18.972813+0000","last_undegraded":"2023-05-10T01:26:18.972813+0000","last_fullsized":"2023-05-10T01:26:18.972813+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.957192+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:18.957192+0000","last_peered":"2023-05-10T01:26:18.957192+0000","last_clean":"2023-05-10T01:26:18.957192+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:18.957192+0000","last_undegraded":"2023-05-10T01:26:18.957192+0000","last_fullsized":"2023-05-10T01:26:18.957192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968989+0000","last_change":"2023-05-10T01:26:18.965607+0000","last_active":"2023-05-10T01:26:18.968989+0000","last_peered":"2023-05-10T01:26:18.968989+0000","last_clean":"2023-05-10T01:26:18.968989+0000","last_became_active":"2023-05-10T01:26:18.965326+0000","last_became_peered":"2023-05-10T01:26:18.965326+0000","last_unstale":"2023-05-10T01:26:18.968989+0000","last_undegraded":"2023-05-10T01:26:18.968989+0000","last_fullsized":"2023-05-10T01:26:18.968989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962238+0000","last_change":"2023-05-10T01:26:18.578734+0000","last_active":"2023-05-10T01:26:18.962238+0000","last_peered":"2023-05-10T01:26:18.962238+0000","last_clean":"2023-05-10T01:26:18.962238+0000","last_became_active":"2023-05-10T01:26:18.577120+0000","last_became_peered":"2023-05-10T01:26:18.577120+0000","last_unstale":"2023-05-10T01:26:18.962238+0000","last_undegraded":"2023-05-10T01:26:18.962238+0000","last_fullsized":"2023-05-10T01:26:18.962238+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970423+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:18.970423+0000","last_peered":"2023-05-10T01:26:18.970423+0000","last_clean":"2023-05-10T01:26:18.970423+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:18.970423+0000","last_undegraded":"2023-05-10T01:26:18.970423+0000","last_fullsized":"2023-05-10T01:26:18.970423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353500,"statfs":{"total":96636764160,"available":96617984000,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.44},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18068,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353772,"statfs":{"total":96636764160,"available":96618262528,"internally_reserved":0,"allocated":1519616,"data_stored":766992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.80000000000000004}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.747}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22104,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94349736,"statfs":{"total":96636764160,"available":96614129664,"internally_reserved":0,"allocated":1523712,"data_stored":767876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.40699999999999997}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.374}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17684,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354156,"statfs":{"total":96636764160,"available":96618655744,"internally_reserved":0,"allocated":1519616,"data_stored":767060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.748}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23184,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348656,"statfs":{"total":96636764160,"available":96613023744,"internally_reserved":0,"allocated":1515520,"data_stored":766430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.497}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.745},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82799999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.84599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26056,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":24576,"kb_avail":94345784,"statfs":{"total":96636764160,"available":96610082816,"internally_reserved":0,"allocated":1507328,"data_stored":766326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25165824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.496}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18320,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353520,"statfs":{"total":96636764160,"available":96618004480,"internally_reserved":0,"allocated":1515520,"data_stored":767240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.62},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.629}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.432},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21452,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":19968,"kb_avail":94350388,"statfs":{"total":96636764160,"available":96614797312,"internally_reserved":0,"allocated":1511424,"data_stored":766880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20447232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66300000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:26:23.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-05-10T01:26:23.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:18.540496+0000', 'last_change': '2023-05-10T01:26:18.557681+0000', 'last_active': '2023-05-10T01:26:18.540496+0000', 'last_peered': '2023-05-10T01:26:18.540496+0000', 'last_clean': '2023-05-10T01:26:18.540496+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:18.540496+0000', 'last_undegraded': '2023-05-10T01:26:18.540496+0000', 'last_fullsized': '2023-05-10T01:26:18.540496+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:26:23.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-05-10T01:26:23.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:18.540496+0000', 'last_change': '2023-05-10T01:26:18.557677+0000', 'last_active': '2023-05-10T01:26:18.540496+0000', 'last_peered': '2023-05-10T01:26:18.540496+0000', 'last_clean': '2023-05-10T01:26:18.540496+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:18.540496+0000', 'last_undegraded': '2023-05-10T01:26:18.540496+0000', 'last_fullsized': '2023-05-10T01:26:18.540496+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:26:23.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-05-10T01:26:23.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:18.540496+0000', 'last_change': '2023-05-10T01:26:18.557431+0000', 'last_active': '2023-05-10T01:26:18.540496+0000', 'last_peered': '2023-05-10T01:26:18.540496+0000', 'last_clean': '2023-05-10T01:26:18.540496+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:18.540496+0000', 'last_undegraded': '2023-05-10T01:26:18.540496+0000', 'last_fullsized': '2023-05-10T01:26:18.540496+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:26:23.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-05-10T01:26:23.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:18.540496+0000', 'last_change': '2023-05-10T01:26:18.558196+0000', 'last_active': '2023-05-10T01:26:18.540496+0000', 'last_peered': '2023-05-10T01:26:18.540496+0000', 'last_clean': '2023-05-10T01:26:18.540496+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:18.540496+0000', 'last_undegraded': '2023-05-10T01:26:18.540496+0000', 'last_fullsized': '2023-05-10T01:26:18.540496+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:18.540496+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:26:23.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:26:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.862+0000 7f658b65a700 1 Processor -- start 2023-05-10T01:26:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.862+0000 7f658b65a700 1 -- start start 2023-05-10T01:26:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.863+0000 7f658b65a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65841541a0 0x7f6584154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.863+0000 7f658b65a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65840c52e0 0x7f65840c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.863+0000 7f658b65a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840bfba0 con 0x7f6584069760 2023-05-10T01:26:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.863+0000 7f658b65a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840c82e0 con 0x7f65840c52e0 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.863+0000 7f658b65a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c0160 con 0x7f65841541a0 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6589bf7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6584069760 0x7f65840c05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47502/0 (socket says 172.21.15.52:47502) 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6589bf7700 1 -- 172.21.15.52:0/2001956989 learned_addr learned my addr 172.21.15.52:0/2001956989 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6588bf5700 1 --2- 172.21.15.52:0/2001956989 >> v2:172.21.15.172:3300/0 conn(0x7f65840c52e0 0x7f65840c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65841541a0 0x7f6584154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547552660 0 0) 0x7f65840bfba0 con 0x7f6584069760 2023-05-10T01:26:23.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f656c0033f0 con 0x7f6584069760 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944240653 0 0) 0x7f656c0033f0 con 0x7f6584069760 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65841541a0 msgr2=0x7f6584154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65841541a0 0x7f6584154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 >> v2:172.21.15.172:3300/0 conn(0x7f65840c52e0 msgr2=0x7f65840c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 --2- 172.21.15.52:0/2001956989 >> v2:172.21.15.172:3300/0 conn(0x7f65840c52e0 0x7f65840c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840aa0a0 con 0x7f6584069760 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f6580001470 con 0x7f6584069760 2023-05-10T01:26:23.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 >> v1:172.21.15.52:6789/0 conn(0x7f6584069760 legacy=0x7f65840c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f656c0038e0 0x7f656c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c004690 0x7f656c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c005000 0x7f656c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c82e0 con 0x7f656c0038e0 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c0160 con 0x7f656c004690 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c00bdd0 con 0x7f656c005000 2023-05-10T01:26:23.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65841541a0 0x7f6584154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:23.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6588bf5700 1 --2- 172.21.15.52:0/2001956989 >> v2:172.21.15.172:3300/0 conn(0x7f65840c52e0 0x7f65840c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:23.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f656c0038e0 0x7f656c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6589bf7700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c005000 0x7f656c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.864+0000 7f6588bf5700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c004690 0x7f656c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 -- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c005000 msgr2=0x7f656c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c005000 0x7f656c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 -- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c004690 msgr2=0x7f656c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c004690 0x7f656c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 -- 172.21.15.52:0/2001956989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0033f0 con 0x7f656c0038e0 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f65893f6700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f656c0038e0 0x7f656c003d00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f657c00e280 tx=0x7f657c00b040).ready entity=mon.0 client_cookie=b41ae4485299dc64 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00ead0 con 0x7f656c0038e0 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00f040 con 0x7f656c0038e0 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f6573fff700 1 -- 172.21.15.52:0/2001956989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00ee60 con 0x7f656c0038e0 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f658b65a700 1 -- 172.21.15.52:0/2001956989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f656c0038e0 msgr2=0x7f656c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f658b65a700 1 --2- 172.21.15.52:0/2001956989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f656c0038e0 0x7f656c003d00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f657c00e280 tx=0x7f657c00b040).stop 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f6589bf7700 1 -- 172.21.15.52:0/2001956989 reap_dead start 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f658b65a700 1 -- 172.21.15.52:0/2001956989 shutdown_connections 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.865+0000 7f658b65a700 1 -- 172.21.15.52:0/2001956989 >> 172.21.15.52:0/2001956989 conn(0x7f65840cb710 msgr2=0x7f65840c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:23.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.866+0000 7f658b65a700 1 -- 172.21.15.52:0/2001956989 shutdown_connections 2023-05-10T01:26:23.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.866+0000 7f658b65a700 1 -- 172.21.15.52:0/2001956989 wait complete. 2023-05-10T01:26:23.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.867+0000 7f658b65a700 1 Processor -- start 2023-05-10T01:26:23.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.867+0000 7f658b65a700 1 -- start start 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.867+0000 7f658b65a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c0038e0 0x7f658413c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 0x7f65841518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584150810 con 0x7f6584151da0 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584150af0 con 0x7f658413c890 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584150dd0 con 0x7f656c0038e0 2023-05-10T01:26:23.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38498/0 (socket says 172.21.15.52:38498) 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 -- 172.21.15.52:0/296117321 learned_addr learned my addr 172.21.15.52:0/296117321 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f65893f6700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c0038e0 0x7f658413c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6588bf5700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 0x7f65841518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 -- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c0038e0 msgr2=0x7f658413c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c0038e0 0x7f658413c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 -- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 msgr2=0x7f65841518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:23.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 0x7f65841518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 -- 172.21.15.52:0/296117321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65841510b0 con 0x7f6584151da0 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6588bf5700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 0x7f65841518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f6589bf7700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f6580000c00 tx=0x7f6580001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000f630 con 0x7f6584151da0 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000f790 con 0x7f6584151da0 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6584151390 con 0x7f6584151da0 2023-05-10T01:26:23.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000fb30 con 0x7f6584151da0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.868+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584150240 con 0x7f6584151da0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.869+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65840666b0 con 0x7f6584151da0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.870+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f658001c360 con 0x7f6584151da0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.870+0000 7f65717fa700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 0x7f6564061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.870+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f65800793a0 con 0x7f6584151da0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.870+0000 7f65893f6700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 0x7f6564061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.870+0000 7f65893f6700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 0x7f6564061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f657c00e280 tx=0x7f657c017000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:23.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:23.874+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f658004a7d0 con 0x7f6584151da0 2023-05-10T01:26:23.939 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:23.936+0000 7f9bc76ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:26:24.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.115+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6584151580 con 0x7f6584151da0 2023-05-10T01:26:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.115+0000 7f65717fa700 1 -- 172.21.15.52:0/296117321 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1039 (secure 0 0 0) 0x7f6580019030 con 0x7f6584151da0 2023-05-10T01:26:24.119 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:24.119 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1008,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":133},{"state_name":"creating+peering","count":4}],"num_pgs":137,"num_pools":4,"num_objects":18,"data_bytes":2216,"bytes_used":169172992,"bytes_avail":772924940288,"bytes_total":773094113280,"inactive_pgs_ratio":0.029197080060839653},"fsmap":{"epoch":54,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-05-10T01:23:14.899867+0000","services":{}},"progress_events":{}} 2023-05-10T01:26:24.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 msgr2=0x7f6564061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 0x7f6564061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f657c00e280 tx=0x7f657c017000).stop 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 msgr2=0x7f658414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f6580000c00 tx=0x7f6580001e90).stop 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 shutdown_connections 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f656405ed90 0x7f6564061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584151da0 0x7f658414fd50 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f656c0038e0 0x7f658413c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 --2- 172.21.15.52:0/296117321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f658413c890 0x7f65841518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 >> 172.21.15.52:0/296117321 conn(0x7f65840cb710 msgr2=0x7f65840c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 shutdown_connections 2023-05-10T01:26:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.117+0000 7f658b65a700 1 -- 172.21.15.52:0/296117321 wait complete. 2023-05-10T01:26:24.133 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:26:24.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:26:24.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.246+0000 7fe63759e700 1 Processor -- start 2023-05-10T01:26:24.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.246+0000 7fe63759e700 1 -- start start 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe638154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6380c7750 0x7fe6380acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6380ad030 0x7fe63814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638158960 con 0x7fe6380ad030 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638155330 con 0x7fe6380c7750 2023-05-10T01:26:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638157d50 con 0x7fe6380c7370 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6380ad030 0x7fe63814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6380ad030 0x7fe63814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38506/0 (socket says 172.21.15.52:38506) 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 -- 172.21.15.52:0/1153194140 learned_addr learned my addr 172.21.15.52:0/1153194140 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63659c700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe638154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 -- 172.21.15.52:0/1153194140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 msgr2=0x7fe638154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe635d9b700 1 --2- 172.21.15.52:0/1153194140 >> v2:172.21.15.172:3300/0 conn(0x7fe6380c7750 0x7fe6380acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe638154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 -- 172.21.15.52:0/1153194140 >> v2:172.21.15.172:3300/0 conn(0x7fe6380c7750 msgr2=0x7fe6380acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 --2- 172.21.15.52:0/1153194140 >> v2:172.21.15.172:3300/0 conn(0x7fe6380c7750 0x7fe6380acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 -- 172.21.15.52:0/1153194140 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638158030 con 0x7fe6380ad030 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63659c700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe638154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe636d9d700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380ad030 0x7fe63814dd60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fe638083790 tx=0x7fe628009840).ready entity=mon.0 client_cookie=170abeb1a8b08ebe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.247+0000 7fe63559a700 1 -- 172.21.15.52:0/1153194140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800e070 con 0x7fe6380ad030 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63559a700 1 -- 172.21.15.52:0/1153194140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62800ba50 con 0x7fe6380ad030 2023-05-10T01:26:24.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63559a700 1 -- 172.21.15.52:0/1153194140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800bdd0 con 0x7fe6380ad030 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 -- 172.21.15.52:0/1153194140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380ad030 msgr2=0x7fe63814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380ad030 0x7fe63814dd60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fe638083790 tx=0x7fe628009840).stop 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 -- 172.21.15.52:0/1153194140 shutdown_connections 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380ad030 0x7fe63814dd60 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 --2- 172.21.15.52:0/1153194140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe638154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 --2- 172.21.15.52:0/1153194140 >> v2:172.21.15.172:3300/0 conn(0x7fe6380c7750 0x7fe6380acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 -- 172.21.15.52:0/1153194140 >> 172.21.15.52:0/1153194140 conn(0x7fe638068320 msgr2=0x7fe638068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:24.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 -- 172.21.15.52:0/1153194140 shutdown_connections 2023-05-10T01:26:24.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.248+0000 7fe63759e700 1 -- 172.21.15.52:0/1153194140 wait complete. 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.249+0000 7fe63759e700 1 Processor -- start 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.249+0000 7fe63759e700 1 -- start start 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 0x7fe6380c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe6380cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380adb00 con 0x7fe6380c7750 2023-05-10T01:26:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380c9e80 con 0x7fe6380ad030 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380ca160 con 0x7fe6380c7370 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38512/0 (socket says 172.21.15.52:38512) 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 -- 172.21.15.52:0/800575835 learned_addr learned my addr 172.21.15.52:0/800575835 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe635d9b700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe6380cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe63659c700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 0x7fe6380c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 -- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 msgr2=0x7fe6380cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe6380cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 -- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 msgr2=0x7fe6380c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.250+0000 7fe636d9d700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 0x7fe6380c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe636d9d700 1 -- 172.21.15.52:0/800575835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628009ae0 con 0x7fe6380c7750 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe63659c700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 0x7fe6380c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe636d9d700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe638083bc0 tx=0x7fe6381543c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280092e0 con 0x7fe6380c7750 2023-05-10T01:26:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62801e470 con 0x7fe6380c7750 2023-05-10T01:26:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380ca440 con 0x7fe6380c7750 2023-05-10T01:26:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62801e830 con 0x7fe6380c7750 2023-05-10T01:26:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.251+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6380cb240 con 0x7fe6380c7750 2023-05-10T01:26:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.252+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380adc70 con 0x7fe6380c7750 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.252+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe628025030 con 0x7fe6380c7750 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.252+0000 7fe62e7fc700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 0x7fe61c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.253+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe62807b4a0 con 0x7fe6380c7750 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.253+0000 7fe63659c700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 0x7fe61c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.253+0000 7fe63659c700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 0x7fe61c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe63000aa90 tx=0x7fe630008040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:24.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.257+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe62804c930 con 0x7fe6380c7750 2023-05-10T01:26:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.428+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe638047150 con 0x7fe61c05ed90 2023-05-10T01:26:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.438+0000 7fe62e7fc700 1 -- 172.21.15.52:0/800575835 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361458 (secure 0 0 0) 0x7fe638047150 con 0x7fe61c05ed90 2023-05-10T01:26:24.446 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 msgr2=0x7fe61c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 0x7fe61c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe63000aa90 tx=0x7fe630008040).stop 2023-05-10T01:26:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 msgr2=0x7fe638168370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe638083bc0 tx=0x7fe6381543c0).stop 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 shutdown_connections 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe61c05ed90 0x7fe61c061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6380c7750 0x7fe638168370 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6380ad030 0x7fe6380c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 --2- 172.21.15.52:0/800575835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6380c7370 0x7fe6380cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 >> 172.21.15.52:0/800575835 conn(0x7fe638068320 msgr2=0x7fe638069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 shutdown_connections 2023-05-10T01:26:24.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:24.442+0000 7fe63759e700 1 -- 172.21.15.52:0/800575835 wait complete. 2023-05-10T01:26:24.450 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:26:24.457 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:26:23.588981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":165208,"kb_used_data":11800,"kb_used_omap":0,"kb_used_meta":153344,"kb_avail":754809512,"statfs":{"total":773094113280,"available":772924940288,"internally_reserved":0,"allocated":12083200,"data_stored":6113776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":157024256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19804,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.174073"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976105+0000","last_change":"2023-05-10T01:26:18.975353+0000","last_active":"2023-05-10T01:26:18.976105+0000","last_peered":"2023-05-10T01:26:18.976105+0000","last_clean":"2023-05-10T01:26:18.976105+0000","last_became_active":"2023-05-10T01:26:18.975196+0000","last_became_peered":"2023-05-10T01:26:18.975196+0000","last_unstale":"2023-05-10T01:26:18.976105+0000","last_undegraded":"2023-05-10T01:26:18.976105+0000","last_fullsized":"2023-05-10T01:26:18.976105+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"121'3","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.964489+0000","last_change":"2023-05-10T01:26:18.571497+0000","last_active":"2023-05-10T01:26:18.964489+0000","last_peered":"2023-05-10T01:26:18.964489+0000","last_clean":"2023-05-10T01:26:18.964489+0000","last_became_active":"2023-05-10T01:26:18.571204+0000","last_became_peered":"2023-05-10T01:26:18.571204+0000","last_unstale":"2023-05-10T01:26:18.964489+0000","last_undegraded":"2023-05-10T01:26:18.964489+0000","last_fullsized":"2023-05-10T01:26:18.964489+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983885+0000","last_change":"2023-05-10T01:26:18.976055+0000","last_active":"2023-05-10T01:26:18.983885+0000","last_peered":"2023-05-10T01:26:18.983885+0000","last_clean":"2023-05-10T01:26:18.983885+0000","last_became_active":"2023-05-10T01:26:18.975611+0000","last_became_peered":"2023-05-10T01:26:18.975611+0000","last_unstale":"2023-05-10T01:26:18.983885+0000","last_undegraded":"2023-05-10T01:26:18.983885+0000","last_fullsized":"2023-05-10T01:26:18.983885+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950738+0000","last_change":"2023-05-10T01:26:18.561226+0000","last_active":"2023-05-10T01:26:18.950738+0000","last_peered":"2023-05-10T01:26:18.950738+0000","last_clean":"2023-05-10T01:26:18.950738+0000","last_became_active":"2023-05-10T01:26:18.560909+0000","last_became_peered":"2023-05-10T01:26:18.560909+0000","last_unstale":"2023-05-10T01:26:18.950738+0000","last_undegraded":"2023-05-10T01:26:18.950738+0000","last_fullsized":"2023-05-10T01:26:18.950738+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986126+0000","last_change":"2023-05-10T01:26:18.980502+0000","last_active":"2023-05-10T01:26:18.986126+0000","last_peered":"2023-05-10T01:26:18.986126+0000","last_clean":"2023-05-10T01:26:18.986126+0000","last_became_active":"2023-05-10T01:26:18.980170+0000","last_became_peered":"2023-05-10T01:26:18.980170+0000","last_unstale":"2023-05-10T01:26:18.986126+0000","last_undegraded":"2023-05-10T01:26:18.986126+0000","last_fullsized":"2023-05-10T01:26:18.986126+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.958018+0000","last_change":"2023-05-10T01:26:18.568238+0000","last_active":"2023-05-10T01:26:18.958018+0000","last_peered":"2023-05-10T01:26:18.958018+0000","last_clean":"2023-05-10T01:26:18.958018+0000","last_became_active":"2023-05-10T01:26:18.567912+0000","last_became_peered":"2023-05-10T01:26:18.567912+0000","last_unstale":"2023-05-10T01:26:18.958018+0000","last_undegraded":"2023-05-10T01:26:18.958018+0000","last_fullsized":"2023-05-10T01:26:18.958018+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973199+0000","last_change":"2023-05-10T01:26:18.972680+0000","last_active":"2023-05-10T01:26:18.973199+0000","last_peered":"2023-05-10T01:26:18.973199+0000","last_clean":"2023-05-10T01:26:18.973199+0000","last_became_active":"2023-05-10T01:26:18.972387+0000","last_became_peered":"2023-05-10T01:26:18.972387+0000","last_unstale":"2023-05-10T01:26:18.973199+0000","last_undegraded":"2023-05-10T01:26:18.973199+0000","last_fullsized":"2023-05-10T01:26:18.973199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962990+0000","last_change":"2023-05-10T01:26:18.575171+0000","last_active":"2023-05-10T01:26:18.962990+0000","last_peered":"2023-05-10T01:26:18.962990+0000","last_clean":"2023-05-10T01:26:18.962990+0000","last_became_active":"2023-05-10T01:26:18.574795+0000","last_became_peered":"2023-05-10T01:26:18.574795+0000","last_unstale":"2023-05-10T01:26:18.962990+0000","last_undegraded":"2023-05-10T01:26:18.962990+0000","last_fullsized":"2023-05-10T01:26:18.962990+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984096+0000","last_change":"2023-05-10T01:26:18.977610+0000","last_active":"2023-05-10T01:26:18.984096+0000","last_peered":"2023-05-10T01:26:18.984096+0000","last_clean":"2023-05-10T01:26:18.984096+0000","last_became_active":"2023-05-10T01:26:18.977328+0000","last_became_peered":"2023-05-10T01:26:18.977328+0000","last_unstale":"2023-05-10T01:26:18.984096+0000","last_undegraded":"2023-05-10T01:26:18.984096+0000","last_fullsized":"2023-05-10T01:26:18.984096+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975581+0000","last_change":"2023-05-10T01:26:18.575538+0000","last_active":"2023-05-10T01:26:18.975581+0000","last_peered":"2023-05-10T01:26:18.975581+0000","last_clean":"2023-05-10T01:26:18.975581+0000","last_became_active":"2023-05-10T01:26:18.575295+0000","last_became_peered":"2023-05-10T01:26:18.575295+0000","last_unstale":"2023-05-10T01:26:18.975581+0000","last_undegraded":"2023-05-10T01:26:18.975581+0000","last_fullsized":"2023-05-10T01:26:18.975581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975305+0000","last_change":"2023-05-10T01:26:18.972512+0000","last_active":"2023-05-10T01:26:18.975305+0000","last_peered":"2023-05-10T01:26:18.975305+0000","last_clean":"2023-05-10T01:26:18.975305+0000","last_became_active":"2023-05-10T01:26:18.966620+0000","last_became_peered":"2023-05-10T01:26:18.966620+0000","last_unstale":"2023-05-10T01:26:18.975305+0000","last_undegraded":"2023-05-10T01:26:18.975305+0000","last_fullsized":"2023-05-10T01:26:18.975305+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567857+0000","last_change":"2023-05-10T01:26:18.567857+0000","last_active":"2023-05-10T01:26:18.567857+0000","last_peered":"2023-05-10T01:26:18.567857+0000","last_clean":"2023-05-10T01:26:18.567857+0000","last_became_active":"2023-05-10T01:26:18.567563+0000","last_became_peered":"2023-05-10T01:26:18.567563+0000","last_unstale":"2023-05-10T01:26:18.567857+0000","last_undegraded":"2023-05-10T01:26:18.567857+0000","last_fullsized":"2023-05-10T01:26:18.567857+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986176+0000","last_change":"2023-05-10T01:26:18.983119+0000","last_active":"2023-05-10T01:26:18.986176+0000","last_peered":"2023-05-10T01:26:18.986176+0000","last_clean":"2023-05-10T01:26:18.986176+0000","last_became_active":"2023-05-10T01:26:18.982828+0000","last_became_peered":"2023-05-10T01:26:18.982828+0000","last_unstale":"2023-05-10T01:26:18.986176+0000","last_undegraded":"2023-05-10T01:26:18.986176+0000","last_fullsized":"2023-05-10T01:26:18.986176+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.567240+0000","last_change":"2023-05-10T01:26:18.567240+0000","last_active":"2023-05-10T01:26:18.567240+0000","last_peered":"2023-05-10T01:26:18.567240+0000","last_clean":"2023-05-10T01:26:18.567240+0000","last_became_active":"2023-05-10T01:26:18.567028+0000","last_became_peered":"2023-05-10T01:26:18.567028+0000","last_unstale":"2023-05-10T01:26:18.567240+0000","last_undegraded":"2023-05-10T01:26:18.567240+0000","last_fullsized":"2023-05-10T01:26:18.567240+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986097+0000","last_change":"2023-05-10T01:26:18.980324+0000","last_active":"2023-05-10T01:26:18.986097+0000","last_peered":"2023-05-10T01:26:18.986097+0000","last_clean":"2023-05-10T01:26:18.986097+0000","last_became_active":"2023-05-10T01:26:18.980084+0000","last_became_peered":"2023-05-10T01:26:18.980084+0000","last_unstale":"2023-05-10T01:26:18.986097+0000","last_undegraded":"2023-05-10T01:26:18.986097+0000","last_fullsized":"2023-05-10T01:26:18.986097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951498+0000","last_change":"2023-05-10T01:26:18.569917+0000","last_active":"2023-05-10T01:26:18.951498+0000","last_peered":"2023-05-10T01:26:18.951498+0000","last_clean":"2023-05-10T01:26:18.951498+0000","last_became_active":"2023-05-10T01:26:18.569637+0000","last_became_peered":"2023-05-10T01:26:18.569637+0000","last_unstale":"2023-05-10T01:26:18.951498+0000","last_undegraded":"2023-05-10T01:26:18.951498+0000","last_fullsized":"2023-05-10T01:26:18.951498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965834+0000","last_change":"2023-05-10T01:26:18.958289+0000","last_active":"2023-05-10T01:26:18.965834+0000","last_peered":"2023-05-10T01:26:18.965834+0000","last_clean":"2023-05-10T01:26:18.965834+0000","last_became_active":"2023-05-10T01:26:18.957990+0000","last_became_peered":"2023-05-10T01:26:18.957990+0000","last_unstale":"2023-05-10T01:26:18.965834+0000","last_undegraded":"2023-05-10T01:26:18.965834+0000","last_fullsized":"2023-05-10T01:26:18.965834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971177+0000","last_change":"2023-05-10T01:26:18.570414+0000","last_active":"2023-05-10T01:26:18.971177+0000","last_peered":"2023-05-10T01:26:18.971177+0000","last_clean":"2023-05-10T01:26:18.971177+0000","last_became_active":"2023-05-10T01:26:18.570143+0000","last_became_peered":"2023-05-10T01:26:18.570143+0000","last_unstale":"2023-05-10T01:26:18.971177+0000","last_undegraded":"2023-05-10T01:26:18.971177+0000","last_fullsized":"2023-05-10T01:26:18.971177+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968954+0000","last_change":"2023-05-10T01:26:18.965747+0000","last_active":"2023-05-10T01:26:18.968954+0000","last_peered":"2023-05-10T01:26:18.968954+0000","last_clean":"2023-05-10T01:26:18.968954+0000","last_became_active":"2023-05-10T01:26:18.965359+0000","last_became_peered":"2023-05-10T01:26:18.965359+0000","last_unstale":"2023-05-10T01:26:18.968954+0000","last_undegraded":"2023-05-10T01:26:18.968954+0000","last_fullsized":"2023-05-10T01:26:18.968954+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973463+0000","last_change":"2023-05-10T01:26:18.565303+0000","last_active":"2023-05-10T01:26:18.973463+0000","last_peered":"2023-05-10T01:26:18.973463+0000","last_clean":"2023-05-10T01:26:18.973463+0000","last_became_active":"2023-05-10T01:26:18.564990+0000","last_became_peered":"2023-05-10T01:26:18.564990+0000","last_unstale":"2023-05-10T01:26:18.973463+0000","last_undegraded":"2023-05-10T01:26:18.973463+0000","last_fullsized":"2023-05-10T01:26:18.973463+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969309+0000","last_change":"2023-05-10T01:26:18.967059+0000","last_active":"2023-05-10T01:26:18.969309+0000","last_peered":"2023-05-10T01:26:18.969309+0000","last_clean":"2023-05-10T01:26:18.969309+0000","last_became_active":"2023-05-10T01:26:18.966792+0000","last_became_peered":"2023-05-10T01:26:18.966792+0000","last_unstale":"2023-05-10T01:26:18.969309+0000","last_undegraded":"2023-05-10T01:26:18.969309+0000","last_fullsized":"2023-05-10T01:26:18.969309+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573117+0000","last_change":"2023-05-10T01:26:18.573117+0000","last_active":"2023-05-10T01:26:18.573117+0000","last_peered":"2023-05-10T01:26:18.573117+0000","last_clean":"2023-05-10T01:26:18.573117+0000","last_became_active":"2023-05-10T01:26:18.572730+0000","last_became_peered":"2023-05-10T01:26:18.572730+0000","last_unstale":"2023-05-10T01:26:18.573117+0000","last_undegraded":"2023-05-10T01:26:18.573117+0000","last_fullsized":"2023-05-10T01:26:18.573117+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982351+0000","last_change":"2023-05-10T01:26:18.980270+0000","last_active":"2023-05-10T01:26:18.982351+0000","last_peered":"2023-05-10T01:26:18.982351+0000","last_clean":"2023-05-10T01:26:18.982351+0000","last_became_active":"2023-05-10T01:26:18.980092+0000","last_became_peered":"2023-05-10T01:26:18.980092+0000","last_unstale":"2023-05-10T01:26:18.982351+0000","last_undegraded":"2023-05-10T01:26:18.982351+0000","last_fullsized":"2023-05-10T01:26:18.982351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986217+0000","last_change":"2023-05-10T01:26:18.565872+0000","last_active":"2023-05-10T01:26:18.986217+0000","last_peered":"2023-05-10T01:26:18.986217+0000","last_clean":"2023-05-10T01:26:18.986217+0000","last_became_active":"2023-05-10T01:26:18.565544+0000","last_became_peered":"2023-05-10T01:26:18.565544+0000","last_unstale":"2023-05-10T01:26:18.986217+0000","last_undegraded":"2023-05-10T01:26:18.986217+0000","last_fullsized":"2023-05-10T01:26:18.986217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984412+0000","last_change":"2023-05-10T01:26:18.979400+0000","last_active":"2023-05-10T01:26:18.984412+0000","last_peered":"2023-05-10T01:26:18.984412+0000","last_clean":"2023-05-10T01:26:18.984412+0000","last_became_active":"2023-05-10T01:26:18.978810+0000","last_became_peered":"2023-05-10T01:26:18.978810+0000","last_unstale":"2023-05-10T01:26:18.984412+0000","last_undegraded":"2023-05-10T01:26:18.984412+0000","last_fullsized":"2023-05-10T01:26:18.984412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961736+0000","last_change":"2023-05-10T01:26:18.565955+0000","last_active":"2023-05-10T01:26:18.961736+0000","last_peered":"2023-05-10T01:26:18.961736+0000","last_clean":"2023-05-10T01:26:18.961736+0000","last_became_active":"2023-05-10T01:26:18.565618+0000","last_became_peered":"2023-05-10T01:26:18.565618+0000","last_unstale":"2023-05-10T01:26:18.961736+0000","last_undegraded":"2023-05-10T01:26:18.961736+0000","last_fullsized":"2023-05-10T01:26:18.961736+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979075+0000","last_change":"2023-05-10T01:26:18.978241+0000","last_active":"2023-05-10T01:26:18.979075+0000","last_peered":"2023-05-10T01:26:18.979075+0000","last_clean":"2023-05-10T01:26:18.979075+0000","last_became_active":"2023-05-10T01:26:18.977953+0000","last_became_peered":"2023-05-10T01:26:18.977953+0000","last_unstale":"2023-05-10T01:26:18.979075+0000","last_undegraded":"2023-05-10T01:26:18.979075+0000","last_fullsized":"2023-05-10T01:26:18.979075+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962194+0000","last_change":"2023-05-10T01:26:18.573304+0000","last_active":"2023-05-10T01:26:18.962194+0000","last_peered":"2023-05-10T01:26:18.962194+0000","last_clean":"2023-05-10T01:26:18.962194+0000","last_became_active":"2023-05-10T01:26:18.573011+0000","last_became_peered":"2023-05-10T01:26:18.573011+0000","last_unstale":"2023-05-10T01:26:18.962194+0000","last_undegraded":"2023-05-10T01:26:18.962194+0000","last_fullsized":"2023-05-10T01:26:18.962194+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986326+0000","last_change":"2023-05-10T01:26:18.982281+0000","last_active":"2023-05-10T01:26:18.986326+0000","last_peered":"2023-05-10T01:26:18.986326+0000","last_clean":"2023-05-10T01:26:18.986326+0000","last_became_active":"2023-05-10T01:26:18.981892+0000","last_became_peered":"2023-05-10T01:26:18.981892+0000","last_unstale":"2023-05-10T01:26:18.986326+0000","last_undegraded":"2023-05-10T01:26:18.986326+0000","last_fullsized":"2023-05-10T01:26:18.986326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953937+0000","last_change":"2023-05-10T01:26:18.572389+0000","last_active":"2023-05-10T01:26:18.953937+0000","last_peered":"2023-05-10T01:26:18.953937+0000","last_clean":"2023-05-10T01:26:18.953937+0000","last_became_active":"2023-05-10T01:26:18.572045+0000","last_became_peered":"2023-05-10T01:26:18.572045+0000","last_unstale":"2023-05-10T01:26:18.953937+0000","last_undegraded":"2023-05-10T01:26:18.953937+0000","last_fullsized":"2023-05-10T01:26:18.953937+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972130+0000","last_change":"2023-05-10T01:26:18.968895+0000","last_active":"2023-05-10T01:26:18.972130+0000","last_peered":"2023-05-10T01:26:18.972130+0000","last_clean":"2023-05-10T01:26:18.972130+0000","last_became_active":"2023-05-10T01:26:18.968544+0000","last_became_peered":"2023-05-10T01:26:18.968544+0000","last_unstale":"2023-05-10T01:26:18.972130+0000","last_undegraded":"2023-05-10T01:26:18.972130+0000","last_fullsized":"2023-05-10T01:26:18.972130+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.573081+0000","last_change":"2023-05-10T01:26:18.573081+0000","last_active":"2023-05-10T01:26:18.573081+0000","last_peered":"2023-05-10T01:26:18.573081+0000","last_clean":"2023-05-10T01:26:18.573081+0000","last_became_active":"2023-05-10T01:26:18.572641+0000","last_became_peered":"2023-05-10T01:26:18.572641+0000","last_unstale":"2023-05-10T01:26:18.573081+0000","last_undegraded":"2023-05-10T01:26:18.573081+0000","last_fullsized":"2023-05-10T01:26:18.573081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557681+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951662+0000","last_change":"2023-05-10T01:26:18.570935+0000","last_active":"2023-05-10T01:26:18.951662+0000","last_peered":"2023-05-10T01:26:18.951662+0000","last_clean":"2023-05-10T01:26:18.951662+0000","last_became_active":"2023-05-10T01:26:18.570644+0000","last_became_peered":"2023-05-10T01:26:18.570644+0000","last_unstale":"2023-05-10T01:26:18.951662+0000","last_undegraded":"2023-05-10T01:26:18.951662+0000","last_fullsized":"2023-05-10T01:26:18.951662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557677+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954278+0000","last_change":"2023-05-10T01:26:18.573110+0000","last_active":"2023-05-10T01:26:18.954278+0000","last_peered":"2023-05-10T01:26:18.954278+0000","last_clean":"2023-05-10T01:26:18.954278+0000","last_became_active":"2023-05-10T01:26:18.572645+0000","last_became_peered":"2023-05-10T01:26:18.572645+0000","last_unstale":"2023-05-10T01:26:18.954278+0000","last_undegraded":"2023-05-10T01:26:18.954278+0000","last_fullsized":"2023-05-10T01:26:18.954278+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.557431+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969888+0000","last_change":"2023-05-10T01:26:18.578477+0000","last_active":"2023-05-10T01:26:18.969888+0000","last_peered":"2023-05-10T01:26:18.969888+0000","last_clean":"2023-05-10T01:26:18.969888+0000","last_became_active":"2023-05-10T01:26:18.578107+0000","last_became_peered":"2023-05-10T01:26:18.578107+0000","last_unstale":"2023-05-10T01:26:18.969888+0000","last_undegraded":"2023-05-10T01:26:18.969888+0000","last_fullsized":"2023-05-10T01:26:18.969888+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969112+0000","last_change":"2023-05-10T01:26:18.966385+0000","last_active":"2023-05-10T01:26:18.969112+0000","last_peered":"2023-05-10T01:26:18.969112+0000","last_clean":"2023-05-10T01:26:18.969112+0000","last_became_active":"2023-05-10T01:26:18.966106+0000","last_became_peered":"2023-05-10T01:26:18.966106+0000","last_unstale":"2023-05-10T01:26:18.969112+0000","last_undegraded":"2023-05-10T01:26:18.969112+0000","last_fullsized":"2023-05-10T01:26:18.969112+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.967263+0000","last_change":"2023-05-10T01:26:18.573995+0000","last_active":"2023-05-10T01:26:18.967263+0000","last_peered":"2023-05-10T01:26:18.967263+0000","last_clean":"2023-05-10T01:26:18.967263+0000","last_became_active":"2023-05-10T01:26:18.573725+0000","last_became_peered":"2023-05-10T01:26:18.573725+0000","last_unstale":"2023-05-10T01:26:18.967263+0000","last_undegraded":"2023-05-10T01:26:18.967263+0000","last_fullsized":"2023-05-10T01:26:18.967263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984389+0000","last_change":"2023-05-10T01:26:18.979267+0000","last_active":"2023-05-10T01:26:18.984389+0000","last_peered":"2023-05-10T01:26:18.984389+0000","last_clean":"2023-05-10T01:26:18.984389+0000","last_became_active":"2023-05-10T01:26:18.978510+0000","last_became_peered":"2023-05-10T01:26:18.978510+0000","last_unstale":"2023-05-10T01:26:18.984389+0000","last_undegraded":"2023-05-10T01:26:18.984389+0000","last_fullsized":"2023-05-10T01:26:18.984389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980364+0000","last_change":"2023-05-10T01:26:18.573187+0000","last_active":"2023-05-10T01:26:18.980364+0000","last_peered":"2023-05-10T01:26:18.980364+0000","last_clean":"2023-05-10T01:26:18.980364+0000","last_became_active":"2023-05-10T01:26:18.572833+0000","last_became_peered":"2023-05-10T01:26:18.572833+0000","last_unstale":"2023-05-10T01:26:18.980364+0000","last_undegraded":"2023-05-10T01:26:18.980364+0000","last_fullsized":"2023-05-10T01:26:18.980364+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979290+0000","last_change":"2023-05-10T01:26:18.977829+0000","last_active":"2023-05-10T01:26:18.979290+0000","last_peered":"2023-05-10T01:26:18.979290+0000","last_clean":"2023-05-10T01:26:18.979290+0000","last_became_active":"2023-05-10T01:26:18.977552+0000","last_became_peered":"2023-05-10T01:26:18.977552+0000","last_unstale":"2023-05-10T01:26:18.979290+0000","last_undegraded":"2023-05-10T01:26:18.979290+0000","last_fullsized":"2023-05-10T01:26:18.979290+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950638+0000","last_change":"2023-05-10T01:26:18.561026+0000","last_active":"2023-05-10T01:26:18.950638+0000","last_peered":"2023-05-10T01:26:18.950638+0000","last_clean":"2023-05-10T01:26:18.950638+0000","last_became_active":"2023-05-10T01:26:18.560672+0000","last_became_peered":"2023-05-10T01:26:18.560672+0000","last_unstale":"2023-05-10T01:26:18.950638+0000","last_undegraded":"2023-05-10T01:26:18.950638+0000","last_fullsized":"2023-05-10T01:26:18.950638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980906+0000","last_change":"2023-05-10T01:26:18.979154+0000","last_active":"2023-05-10T01:26:18.980906+0000","last_peered":"2023-05-10T01:26:18.980906+0000","last_clean":"2023-05-10T01:26:18.980906+0000","last_became_active":"2023-05-10T01:26:18.978702+0000","last_became_peered":"2023-05-10T01:26:18.978702+0000","last_unstale":"2023-05-10T01:26:18.980906+0000","last_undegraded":"2023-05-10T01:26:18.980906+0000","last_fullsized":"2023-05-10T01:26:18.980906+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950627+0000","last_change":"2023-05-10T01:26:18.560867+0000","last_active":"2023-05-10T01:26:18.950627+0000","last_peered":"2023-05-10T01:26:18.950627+0000","last_clean":"2023-05-10T01:26:18.950627+0000","last_became_active":"2023-05-10T01:26:18.560517+0000","last_became_peered":"2023-05-10T01:26:18.560517+0000","last_unstale":"2023-05-10T01:26:18.950627+0000","last_undegraded":"2023-05-10T01:26:18.950627+0000","last_fullsized":"2023-05-10T01:26:18.950627+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983937+0000","last_change":"2023-05-10T01:26:18.975922+0000","last_active":"2023-05-10T01:26:18.983937+0000","last_peered":"2023-05-10T01:26:18.983937+0000","last_clean":"2023-05-10T01:26:18.983937+0000","last_became_active":"2023-05-10T01:26:18.975625+0000","last_became_peered":"2023-05-10T01:26:18.975625+0000","last_unstale":"2023-05-10T01:26:18.983937+0000","last_undegraded":"2023-05-10T01:26:18.983937+0000","last_fullsized":"2023-05-10T01:26:18.983937+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.568747+0000","last_change":"2023-05-10T01:26:18.568747+0000","last_active":"2023-05-10T01:26:18.568747+0000","last_peered":"2023-05-10T01:26:18.568747+0000","last_clean":"2023-05-10T01:26:18.568747+0000","last_became_active":"2023-05-10T01:26:18.568459+0000","last_became_peered":"2023-05-10T01:26:18.568459+0000","last_unstale":"2023-05-10T01:26:18.568747+0000","last_undegraded":"2023-05-10T01:26:18.568747+0000","last_fullsized":"2023-05-10T01:26:18.568747+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969978+0000","last_change":"2023-05-10T01:26:18.968227+0000","last_active":"2023-05-10T01:26:18.969978+0000","last_peered":"2023-05-10T01:26:18.969978+0000","last_clean":"2023-05-10T01:26:18.969978+0000","last_became_active":"2023-05-10T01:26:18.967878+0000","last_became_peered":"2023-05-10T01:26:18.967878+0000","last_unstale":"2023-05-10T01:26:18.969978+0000","last_undegraded":"2023-05-10T01:26:18.969978+0000","last_fullsized":"2023-05-10T01:26:18.969978+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970296+0000","last_change":"2023-05-10T01:26:18.572795+0000","last_active":"2023-05-10T01:26:18.970296+0000","last_peered":"2023-05-10T01:26:18.970296+0000","last_clean":"2023-05-10T01:26:18.970296+0000","last_became_active":"2023-05-10T01:26:18.572492+0000","last_became_peered":"2023-05-10T01:26:18.572492+0000","last_unstale":"2023-05-10T01:26:18.970296+0000","last_undegraded":"2023-05-10T01:26:18.970296+0000","last_fullsized":"2023-05-10T01:26:18.970296+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984313+0000","last_change":"2023-05-10T01:26:18.980822+0000","last_active":"2023-05-10T01:26:18.984313+0000","last_peered":"2023-05-10T01:26:18.984313+0000","last_clean":"2023-05-10T01:26:18.984313+0000","last_became_active":"2023-05-10T01:26:18.980525+0000","last_became_peered":"2023-05-10T01:26:18.980525+0000","last_unstale":"2023-05-10T01:26:18.984313+0000","last_undegraded":"2023-05-10T01:26:18.984313+0000","last_fullsized":"2023-05-10T01:26:18.984313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-05-10T01:26:19.955231+0000","last_change":"2023-05-10T01:26:18.569164+0000","last_active":"2023-05-10T01:26:19.955231+0000","last_peered":"2023-05-10T01:26:19.955231+0000","last_clean":"2023-05-10T01:26:19.955231+0000","last_became_active":"2023-05-10T01:26:18.568880+0000","last_became_peered":"2023-05-10T01:26:18.568880+0000","last_unstale":"2023-05-10T01:26:19.955231+0000","last_undegraded":"2023-05-10T01:26:19.955231+0000","last_fullsized":"2023-05-10T01:26:19.955231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984073+0000","last_change":"2023-05-10T01:26:18.977385+0000","last_active":"2023-05-10T01:26:18.984073+0000","last_peered":"2023-05-10T01:26:18.984073+0000","last_clean":"2023-05-10T01:26:18.984073+0000","last_became_active":"2023-05-10T01:26:18.977035+0000","last_became_peered":"2023-05-10T01:26:18.977035+0000","last_unstale":"2023-05-10T01:26:18.984073+0000","last_undegraded":"2023-05-10T01:26:18.984073+0000","last_fullsized":"2023-05-10T01:26:18.984073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.579601+0000","last_change":"2023-05-10T01:26:18.579601+0000","last_active":"2023-05-10T01:26:18.579601+0000","last_peered":"2023-05-10T01:26:18.579601+0000","last_clean":"2023-05-10T01:26:18.579601+0000","last_became_active":"2023-05-10T01:26:18.579357+0000","last_became_peered":"2023-05-10T01:26:18.579357+0000","last_unstale":"2023-05-10T01:26:18.579601+0000","last_undegraded":"2023-05-10T01:26:18.579601+0000","last_fullsized":"2023-05-10T01:26:18.579601+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981042+0000","last_change":"2023-05-10T01:26:18.979843+0000","last_active":"2023-05-10T01:26:18.981042+0000","last_peered":"2023-05-10T01:26:18.981042+0000","last_clean":"2023-05-10T01:26:18.981042+0000","last_became_active":"2023-05-10T01:26:18.979531+0000","last_became_peered":"2023-05-10T01:26:18.979531+0000","last_unstale":"2023-05-10T01:26:18.981042+0000","last_undegraded":"2023-05-10T01:26:18.981042+0000","last_fullsized":"2023-05-10T01:26:18.981042+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969780+0000","last_change":"2023-05-10T01:26:18.578551+0000","last_active":"2023-05-10T01:26:18.969780+0000","last_peered":"2023-05-10T01:26:18.969780+0000","last_clean":"2023-05-10T01:26:18.969780+0000","last_became_active":"2023-05-10T01:26:18.578284+0000","last_became_peered":"2023-05-10T01:26:18.578284+0000","last_unstale":"2023-05-10T01:26:18.969780+0000","last_undegraded":"2023-05-10T01:26:18.969780+0000","last_fullsized":"2023-05-10T01:26:18.969780+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981032+0000","last_change":"2023-05-10T01:26:18.980314+0000","last_active":"2023-05-10T01:26:18.981032+0000","last_peered":"2023-05-10T01:26:18.981032+0000","last_clean":"2023-05-10T01:26:18.981032+0000","last_became_active":"2023-05-10T01:26:18.980009+0000","last_became_peered":"2023-05-10T01:26:18.980009+0000","last_unstale":"2023-05-10T01:26:18.981032+0000","last_undegraded":"2023-05-10T01:26:18.981032+0000","last_fullsized":"2023-05-10T01:26:18.981032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950702+0000","last_change":"2023-05-10T01:26:18.574810+0000","last_active":"2023-05-10T01:26:18.950702+0000","last_peered":"2023-05-10T01:26:18.950702+0000","last_clean":"2023-05-10T01:26:18.950702+0000","last_became_active":"2023-05-10T01:26:18.574499+0000","last_became_peered":"2023-05-10T01:26:18.574499+0000","last_unstale":"2023-05-10T01:26:18.950702+0000","last_undegraded":"2023-05-10T01:26:18.950702+0000","last_fullsized":"2023-05-10T01:26:18.950702+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.968399+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.967572+0000","last_became_peered":"2023-05-10T01:26:18.967572+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962166+0000","last_change":"2023-05-10T01:26:18.579613+0000","last_active":"2023-05-10T01:26:18.962166+0000","last_peered":"2023-05-10T01:26:18.962166+0000","last_clean":"2023-05-10T01:26:18.962166+0000","last_became_active":"2023-05-10T01:26:18.579329+0000","last_became_peered":"2023-05-10T01:26:18.579329+0000","last_unstale":"2023-05-10T01:26:18.962166+0000","last_undegraded":"2023-05-10T01:26:18.962166+0000","last_fullsized":"2023-05-10T01:26:18.962166+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986337+0000","last_change":"2023-05-10T01:26:18.983347+0000","last_active":"2023-05-10T01:26:18.986337+0000","last_peered":"2023-05-10T01:26:18.986337+0000","last_clean":"2023-05-10T01:26:18.986337+0000","last_became_active":"2023-05-10T01:26:18.983062+0000","last_became_peered":"2023-05-10T01:26:18.983062+0000","last_unstale":"2023-05-10T01:26:18.986337+0000","last_undegraded":"2023-05-10T01:26:18.986337+0000","last_fullsized":"2023-05-10T01:26:18.986337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953996+0000","last_change":"2023-05-10T01:26:18.573948+0000","last_active":"2023-05-10T01:26:18.953996+0000","last_peered":"2023-05-10T01:26:18.953996+0000","last_clean":"2023-05-10T01:26:18.953996+0000","last_became_active":"2023-05-10T01:26:18.573657+0000","last_became_peered":"2023-05-10T01:26:18.573657+0000","last_unstale":"2023-05-10T01:26:18.953996+0000","last_undegraded":"2023-05-10T01:26:18.953996+0000","last_fullsized":"2023-05-10T01:26:18.953996+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961425+0000","last_change":"2023-05-10T01:26:18.959076+0000","last_active":"2023-05-10T01:26:18.961425+0000","last_peered":"2023-05-10T01:26:18.961425+0000","last_clean":"2023-05-10T01:26:18.961425+0000","last_became_active":"2023-05-10T01:26:18.958781+0000","last_became_peered":"2023-05-10T01:26:18.958781+0000","last_unstale":"2023-05-10T01:26:18.961425+0000","last_undegraded":"2023-05-10T01:26:18.961425+0000","last_fullsized":"2023-05-10T01:26:18.961425+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954585+0000","last_change":"2023-05-10T01:26:18.568537+0000","last_active":"2023-05-10T01:26:18.954585+0000","last_peered":"2023-05-10T01:26:18.954585+0000","last_clean":"2023-05-10T01:26:18.954585+0000","last_became_active":"2023-05-10T01:26:18.568280+0000","last_became_peered":"2023-05-10T01:26:18.568280+0000","last_unstale":"2023-05-10T01:26:18.954585+0000","last_undegraded":"2023-05-10T01:26:18.954585+0000","last_fullsized":"2023-05-10T01:26:18.954585+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981294+0000","last_change":"2023-05-10T01:26:18.977492+0000","last_active":"2023-05-10T01:26:18.981294+0000","last_peered":"2023-05-10T01:26:18.981294+0000","last_clean":"2023-05-10T01:26:18.981294+0000","last_became_active":"2023-05-10T01:26:18.976984+0000","last_became_peered":"2023-05-10T01:26:18.976984+0000","last_unstale":"2023-05-10T01:26:18.981294+0000","last_undegraded":"2023-05-10T01:26:18.981294+0000","last_fullsized":"2023-05-10T01:26:18.981294+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961450+0000","last_change":"2023-05-10T01:26:18.573919+0000","last_active":"2023-05-10T01:26:18.961450+0000","last_peered":"2023-05-10T01:26:18.961450+0000","last_clean":"2023-05-10T01:26:18.961450+0000","last_became_active":"2023-05-10T01:26:18.573623+0000","last_became_peered":"2023-05-10T01:26:18.573623+0000","last_unstale":"2023-05-10T01:26:18.961450+0000","last_undegraded":"2023-05-10T01:26:18.961450+0000","last_fullsized":"2023-05-10T01:26:18.961450+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972875+0000","last_change":"2023-05-10T01:26:18.969323+0000","last_active":"2023-05-10T01:26:18.972875+0000","last_peered":"2023-05-10T01:26:18.972875+0000","last_clean":"2023-05-10T01:26:18.972875+0000","last_became_active":"2023-05-10T01:26:18.969064+0000","last_became_peered":"2023-05-10T01:26:18.969064+0000","last_unstale":"2023-05-10T01:26:18.972875+0000","last_undegraded":"2023-05-10T01:26:18.972875+0000","last_fullsized":"2023-05-10T01:26:18.972875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975962+0000","last_change":"2023-05-10T01:26:18.566612+0000","last_active":"2023-05-10T01:26:18.975962+0000","last_peered":"2023-05-10T01:26:18.975962+0000","last_clean":"2023-05-10T01:26:18.975962+0000","last_became_active":"2023-05-10T01:26:18.566339+0000","last_became_peered":"2023-05-10T01:26:18.566339+0000","last_unstale":"2023-05-10T01:26:18.975962+0000","last_undegraded":"2023-05-10T01:26:18.975962+0000","last_fullsized":"2023-05-10T01:26:18.975962+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986012+0000","last_change":"2023-05-10T01:26:18.979914+0000","last_active":"2023-05-10T01:26:18.986012+0000","last_peered":"2023-05-10T01:26:18.986012+0000","last_clean":"2023-05-10T01:26:18.986012+0000","last_became_active":"2023-05-10T01:26:18.978337+0000","last_became_peered":"2023-05-10T01:26:18.978337+0000","last_unstale":"2023-05-10T01:26:18.986012+0000","last_undegraded":"2023-05-10T01:26:18.986012+0000","last_fullsized":"2023-05-10T01:26:18.986012+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981678+0000","last_change":"2023-05-10T01:26:18.569910+0000","last_active":"2023-05-10T01:26:18.981678+0000","last_peered":"2023-05-10T01:26:18.981678+0000","last_clean":"2023-05-10T01:26:18.981678+0000","last_became_active":"2023-05-10T01:26:18.569422+0000","last_became_peered":"2023-05-10T01:26:18.569422+0000","last_unstale":"2023-05-10T01:26:18.981678+0000","last_undegraded":"2023-05-10T01:26:18.981678+0000","last_fullsized":"2023-05-10T01:26:18.981678+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981337+0000","last_change":"2023-05-10T01:26:18.979463+0000","last_active":"2023-05-10T01:26:18.981337+0000","last_peered":"2023-05-10T01:26:18.981337+0000","last_clean":"2023-05-10T01:26:18.981337+0000","last_became_active":"2023-05-10T01:26:18.979196+0000","last_became_peered":"2023-05-10T01:26:18.979196+0000","last_unstale":"2023-05-10T01:26:18.981337+0000","last_undegraded":"2023-05-10T01:26:18.981337+0000","last_fullsized":"2023-05-10T01:26:18.981337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953861+0000","last_change":"2023-05-10T01:26:18.565715+0000","last_active":"2023-05-10T01:26:18.953861+0000","last_peered":"2023-05-10T01:26:18.953861+0000","last_clean":"2023-05-10T01:26:18.953861+0000","last_became_active":"2023-05-10T01:26:18.565428+0000","last_became_peered":"2023-05-10T01:26:18.565428+0000","last_unstale":"2023-05-10T01:26:18.953861+0000","last_undegraded":"2023-05-10T01:26:18.953861+0000","last_fullsized":"2023-05-10T01:26:18.953861+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969143+0000","last_change":"2023-05-10T01:26:18.967157+0000","last_active":"2023-05-10T01:26:18.969143+0000","last_peered":"2023-05-10T01:26:18.969143+0000","last_clean":"2023-05-10T01:26:18.969143+0000","last_became_active":"2023-05-10T01:26:18.966855+0000","last_became_peered":"2023-05-10T01:26:18.966855+0000","last_unstale":"2023-05-10T01:26:18.969143+0000","last_undegraded":"2023-05-10T01:26:18.969143+0000","last_fullsized":"2023-05-10T01:26:18.969143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.569655+0000","last_change":"2023-05-10T01:26:18.569655+0000","last_active":"2023-05-10T01:26:18.569655+0000","last_peered":"2023-05-10T01:26:18.569655+0000","last_clean":"2023-05-10T01:26:18.569655+0000","last_became_active":"2023-05-10T01:26:18.569340+0000","last_became_peered":"2023-05-10T01:26:18.569340+0000","last_unstale":"2023-05-10T01:26:18.569655+0000","last_undegraded":"2023-05-10T01:26:18.569655+0000","last_fullsized":"2023-05-10T01:26:18.569655+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979056+0000","last_change":"2023-05-10T01:26:18.978201+0000","last_active":"2023-05-10T01:26:18.979056+0000","last_peered":"2023-05-10T01:26:18.979056+0000","last_clean":"2023-05-10T01:26:18.979056+0000","last_became_active":"2023-05-10T01:26:18.977901+0000","last_became_peered":"2023-05-10T01:26:18.977901+0000","last_unstale":"2023-05-10T01:26:18.979056+0000","last_undegraded":"2023-05-10T01:26:18.979056+0000","last_fullsized":"2023-05-10T01:26:18.979056+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961877+0000","last_change":"2023-05-10T01:26:18.561470+0000","last_active":"2023-05-10T01:26:18.961877+0000","last_peered":"2023-05-10T01:26:18.961877+0000","last_clean":"2023-05-10T01:26:18.961877+0000","last_became_active":"2023-05-10T01:26:18.561192+0000","last_became_peered":"2023-05-10T01:26:18.561192+0000","last_unstale":"2023-05-10T01:26:18.961877+0000","last_undegraded":"2023-05-10T01:26:18.961877+0000","last_fullsized":"2023-05-10T01:26:18.961877+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986239+0000","last_change":"2023-05-10T01:26:18.981603+0000","last_active":"2023-05-10T01:26:18.986239+0000","last_peered":"2023-05-10T01:26:18.986239+0000","last_clean":"2023-05-10T01:26:18.986239+0000","last_became_active":"2023-05-10T01:26:18.981305+0000","last_became_peered":"2023-05-10T01:26:18.981305+0000","last_unstale":"2023-05-10T01:26:18.986239+0000","last_undegraded":"2023-05-10T01:26:18.986239+0000","last_fullsized":"2023-05-10T01:26:18.986239+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962513+0000","last_change":"2023-05-10T01:26:18.570686+0000","last_active":"2023-05-10T01:26:18.962513+0000","last_peered":"2023-05-10T01:26:18.962513+0000","last_clean":"2023-05-10T01:26:18.962513+0000","last_became_active":"2023-05-10T01:26:18.569082+0000","last_became_peered":"2023-05-10T01:26:18.569082+0000","last_unstale":"2023-05-10T01:26:18.962513+0000","last_undegraded":"2023-05-10T01:26:18.962513+0000","last_fullsized":"2023-05-10T01:26:18.962513+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.959799+0000","last_change":"2023-05-10T01:26:18.958884+0000","last_active":"2023-05-10T01:26:18.959799+0000","last_peered":"2023-05-10T01:26:18.959799+0000","last_clean":"2023-05-10T01:26:18.959799+0000","last_became_active":"2023-05-10T01:26:18.958618+0000","last_became_peered":"2023-05-10T01:26:18.958618+0000","last_unstale":"2023-05-10T01:26:18.959799+0000","last_undegraded":"2023-05-10T01:26:18.959799+0000","last_fullsized":"2023-05-10T01:26:18.959799+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954615+0000","last_change":"2023-05-10T01:26:18.568330+0000","last_active":"2023-05-10T01:26:18.954615+0000","last_peered":"2023-05-10T01:26:18.954615+0000","last_clean":"2023-05-10T01:26:18.954615+0000","last_became_active":"2023-05-10T01:26:18.568050+0000","last_became_peered":"2023-05-10T01:26:18.568050+0000","last_unstale":"2023-05-10T01:26:18.954615+0000","last_undegraded":"2023-05-10T01:26:18.954615+0000","last_fullsized":"2023-05-10T01:26:18.954615+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981313+0000","last_change":"2023-05-10T01:26:18.978294+0000","last_active":"2023-05-10T01:26:18.981313+0000","last_peered":"2023-05-10T01:26:18.981313+0000","last_clean":"2023-05-10T01:26:18.981313+0000","last_became_active":"2023-05-10T01:26:18.978004+0000","last_became_peered":"2023-05-10T01:26:18.978004+0000","last_unstale":"2023-05-10T01:26:18.981313+0000","last_undegraded":"2023-05-10T01:26:18.981313+0000","last_fullsized":"2023-05-10T01:26:18.981313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971271+0000","last_change":"2023-05-10T01:26:18.570874+0000","last_active":"2023-05-10T01:26:18.971271+0000","last_peered":"2023-05-10T01:26:18.971271+0000","last_clean":"2023-05-10T01:26:18.971271+0000","last_became_active":"2023-05-10T01:26:18.569744+0000","last_became_peered":"2023-05-10T01:26:18.569744+0000","last_unstale":"2023-05-10T01:26:18.971271+0000","last_undegraded":"2023-05-10T01:26:18.971271+0000","last_fullsized":"2023-05-10T01:26:18.971271+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975668+0000","last_change":"2023-05-10T01:26:18.974160+0000","last_active":"2023-05-10T01:26:18.975668+0000","last_peered":"2023-05-10T01:26:18.975668+0000","last_clean":"2023-05-10T01:26:18.975668+0000","last_became_active":"2023-05-10T01:26:18.973883+0000","last_became_peered":"2023-05-10T01:26:18.973883+0000","last_unstale":"2023-05-10T01:26:18.975668+0000","last_undegraded":"2023-05-10T01:26:18.975668+0000","last_fullsized":"2023-05-10T01:26:18.975668+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950863+0000","last_change":"2023-05-10T01:26:18.566957+0000","last_active":"2023-05-10T01:26:18.950863+0000","last_peered":"2023-05-10T01:26:18.950863+0000","last_clean":"2023-05-10T01:26:18.950863+0000","last_became_active":"2023-05-10T01:26:18.566513+0000","last_became_peered":"2023-05-10T01:26:18.566513+0000","last_unstale":"2023-05-10T01:26:18.950863+0000","last_undegraded":"2023-05-10T01:26:18.950863+0000","last_fullsized":"2023-05-10T01:26:18.950863+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973486+0000","last_change":"2023-05-10T01:26:18.968563+0000","last_active":"2023-05-10T01:26:18.973486+0000","last_peered":"2023-05-10T01:26:18.973486+0000","last_clean":"2023-05-10T01:26:18.973486+0000","last_became_active":"2023-05-10T01:26:18.968254+0000","last_became_peered":"2023-05-10T01:26:18.968254+0000","last_unstale":"2023-05-10T01:26:18.973486+0000","last_undegraded":"2023-05-10T01:26:18.973486+0000","last_fullsized":"2023-05-10T01:26:18.973486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.571475+0000","last_change":"2023-05-10T01:26:18.571475+0000","last_active":"2023-05-10T01:26:18.571475+0000","last_peered":"2023-05-10T01:26:18.571475+0000","last_clean":"2023-05-10T01:26:18.571475+0000","last_became_active":"2023-05-10T01:26:18.569950+0000","last_became_peered":"2023-05-10T01:26:18.569950+0000","last_unstale":"2023-05-10T01:26:18.571475+0000","last_undegraded":"2023-05-10T01:26:18.571475+0000","last_fullsized":"2023-05-10T01:26:18.571475+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.970445+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.970153+0000","last_became_peered":"2023-05-10T01:26:18.970153+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976396+0000","last_change":"2023-05-10T01:26:18.573036+0000","last_active":"2023-05-10T01:26:18.976396+0000","last_peered":"2023-05-10T01:26:18.976396+0000","last_clean":"2023-05-10T01:26:18.976396+0000","last_became_active":"2023-05-10T01:26:18.572465+0000","last_became_peered":"2023-05-10T01:26:18.572465+0000","last_unstale":"2023-05-10T01:26:18.976396+0000","last_undegraded":"2023-05-10T01:26:18.976396+0000","last_fullsized":"2023-05-10T01:26:18.976396+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972570+0000","last_change":"2023-05-10T01:26:18.965093+0000","last_active":"2023-05-10T01:26:18.972570+0000","last_peered":"2023-05-10T01:26:18.972570+0000","last_clean":"2023-05-10T01:26:18.972570+0000","last_became_active":"2023-05-10T01:26:18.964893+0000","last_became_peered":"2023-05-10T01:26:18.964893+0000","last_unstale":"2023-05-10T01:26:18.972570+0000","last_undegraded":"2023-05-10T01:26:18.972570+0000","last_fullsized":"2023-05-10T01:26:18.972570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963502+0000","last_change":"2023-05-10T01:26:18.580354+0000","last_active":"2023-05-10T01:26:18.963502+0000","last_peered":"2023-05-10T01:26:18.963502+0000","last_clean":"2023-05-10T01:26:18.963502+0000","last_became_active":"2023-05-10T01:26:18.580040+0000","last_became_peered":"2023-05-10T01:26:18.580040+0000","last_unstale":"2023-05-10T01:26:18.963502+0000","last_undegraded":"2023-05-10T01:26:18.963502+0000","last_fullsized":"2023-05-10T01:26:18.963502+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983953+0000","last_change":"2023-05-10T01:26:18.976867+0000","last_active":"2023-05-10T01:26:18.983953+0000","last_peered":"2023-05-10T01:26:18.983953+0000","last_clean":"2023-05-10T01:26:18.983953+0000","last_became_active":"2023-05-10T01:26:18.976452+0000","last_became_peered":"2023-05-10T01:26:18.976452+0000","last_unstale":"2023-05-10T01:26:18.983953+0000","last_undegraded":"2023-05-10T01:26:18.983953+0000","last_fullsized":"2023-05-10T01:26:18.983953+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954051+0000","last_change":"2023-05-10T01:26:18.567694+0000","last_active":"2023-05-10T01:26:18.954051+0000","last_peered":"2023-05-10T01:26:18.954051+0000","last_clean":"2023-05-10T01:26:18.954051+0000","last_became_active":"2023-05-10T01:26:18.567244+0000","last_became_peered":"2023-05-10T01:26:18.567244+0000","last_unstale":"2023-05-10T01:26:18.954051+0000","last_undegraded":"2023-05-10T01:26:18.954051+0000","last_fullsized":"2023-05-10T01:26:18.954051+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982326+0000","last_change":"2023-05-10T01:26:18.978674+0000","last_active":"2023-05-10T01:26:18.982326+0000","last_peered":"2023-05-10T01:26:18.982326+0000","last_clean":"2023-05-10T01:26:18.982326+0000","last_became_active":"2023-05-10T01:26:18.978366+0000","last_became_peered":"2023-05-10T01:26:18.978366+0000","last_unstale":"2023-05-10T01:26:18.982326+0000","last_undegraded":"2023-05-10T01:26:18.982326+0000","last_fullsized":"2023-05-10T01:26:18.982326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961008+0000","last_change":"2023-05-10T01:26:18.572168+0000","last_active":"2023-05-10T01:26:18.961008+0000","last_peered":"2023-05-10T01:26:18.961008+0000","last_clean":"2023-05-10T01:26:18.961008+0000","last_became_active":"2023-05-10T01:26:18.571872+0000","last_became_peered":"2023-05-10T01:26:18.571872+0000","last_unstale":"2023-05-10T01:26:18.961008+0000","last_undegraded":"2023-05-10T01:26:18.961008+0000","last_fullsized":"2023-05-10T01:26:18.961008+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972109+0000","last_change":"2023-05-10T01:26:18.968772+0000","last_active":"2023-05-10T01:26:18.972109+0000","last_peered":"2023-05-10T01:26:18.972109+0000","last_clean":"2023-05-10T01:26:18.972109+0000","last_became_active":"2023-05-10T01:26:18.967819+0000","last_became_peered":"2023-05-10T01:26:18.967819+0000","last_unstale":"2023-05-10T01:26:18.972109+0000","last_undegraded":"2023-05-10T01:26:18.972109+0000","last_fullsized":"2023-05-10T01:26:18.972109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980075+0000","last_change":"2023-05-10T01:26:18.569425+0000","last_active":"2023-05-10T01:26:18.980075+0000","last_peered":"2023-05-10T01:26:18.980075+0000","last_clean":"2023-05-10T01:26:18.980075+0000","last_became_active":"2023-05-10T01:26:18.569075+0000","last_became_peered":"2023-05-10T01:26:18.569075+0000","last_unstale":"2023-05-10T01:26:18.980075+0000","last_undegraded":"2023-05-10T01:26:18.980075+0000","last_fullsized":"2023-05-10T01:26:18.980075+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961234+0000","last_change":"2023-05-10T01:26:18.959040+0000","last_active":"2023-05-10T01:26:18.961234+0000","last_peered":"2023-05-10T01:26:18.961234+0000","last_clean":"2023-05-10T01:26:18.961234+0000","last_became_active":"2023-05-10T01:26:18.958767+0000","last_became_peered":"2023-05-10T01:26:18.958767+0000","last_unstale":"2023-05-10T01:26:18.961234+0000","last_undegraded":"2023-05-10T01:26:18.961234+0000","last_fullsized":"2023-05-10T01:26:18.961234+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963744+0000","last_change":"2023-05-10T01:26:18.580476+0000","last_active":"2023-05-10T01:26:18.963744+0000","last_peered":"2023-05-10T01:26:18.963744+0000","last_clean":"2023-05-10T01:26:18.963744+0000","last_became_active":"2023-05-10T01:26:18.580007+0000","last_became_peered":"2023-05-10T01:26:18.580007+0000","last_unstale":"2023-05-10T01:26:18.963744+0000","last_undegraded":"2023-05-10T01:26:18.963744+0000","last_fullsized":"2023-05-10T01:26:18.963744+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980228+0000","last_change":"2023-05-10T01:26:18.975016+0000","last_active":"2023-05-10T01:26:18.980228+0000","last_peered":"2023-05-10T01:26:18.980228+0000","last_clean":"2023-05-10T01:26:18.980228+0000","last_became_active":"2023-05-10T01:26:18.974745+0000","last_became_peered":"2023-05-10T01:26:18.974745+0000","last_unstale":"2023-05-10T01:26:18.980228+0000","last_undegraded":"2023-05-10T01:26:18.980228+0000","last_fullsized":"2023-05-10T01:26:18.980228+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950970+0000","last_change":"2023-05-10T01:26:18.560982+0000","last_active":"2023-05-10T01:26:18.950970+0000","last_peered":"2023-05-10T01:26:18.950970+0000","last_clean":"2023-05-10T01:26:18.950970+0000","last_became_active":"2023-05-10T01:26:18.560649+0000","last_became_peered":"2023-05-10T01:26:18.560649+0000","last_unstale":"2023-05-10T01:26:18.950970+0000","last_undegraded":"2023-05-10T01:26:18.950970+0000","last_fullsized":"2023-05-10T01:26:18.950970+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.977733+0000","last_change":"2023-05-10T01:26:18.976890+0000","last_active":"2023-05-10T01:26:18.977733+0000","last_peered":"2023-05-10T01:26:18.977733+0000","last_clean":"2023-05-10T01:26:18.977733+0000","last_became_active":"2023-05-10T01:26:18.976638+0000","last_became_peered":"2023-05-10T01:26:18.976638+0000","last_unstale":"2023-05-10T01:26:18.977733+0000","last_undegraded":"2023-05-10T01:26:18.977733+0000","last_fullsized":"2023-05-10T01:26:18.977733+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971866+0000","last_change":"2023-05-10T01:26:18.575580+0000","last_active":"2023-05-10T01:26:18.971866+0000","last_peered":"2023-05-10T01:26:18.971866+0000","last_clean":"2023-05-10T01:26:18.971866+0000","last_became_active":"2023-05-10T01:26:18.575249+0000","last_became_peered":"2023-05-10T01:26:18.575249+0000","last_unstale":"2023-05-10T01:26:18.971866+0000","last_undegraded":"2023-05-10T01:26:18.971866+0000","last_fullsized":"2023-05-10T01:26:18.971866+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979702+0000","last_change":"2023-05-10T01:26:18.977320+0000","last_active":"2023-05-10T01:26:18.979702+0000","last_peered":"2023-05-10T01:26:18.979702+0000","last_clean":"2023-05-10T01:26:18.979702+0000","last_became_active":"2023-05-10T01:26:18.968364+0000","last_became_peered":"2023-05-10T01:26:18.968364+0000","last_unstale":"2023-05-10T01:26:18.979702+0000","last_undegraded":"2023-05-10T01:26:18.979702+0000","last_fullsized":"2023-05-10T01:26:18.979702+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953969+0000","last_change":"2023-05-10T01:26:18.572138+0000","last_active":"2023-05-10T01:26:18.953969+0000","last_peered":"2023-05-10T01:26:18.953969+0000","last_clean":"2023-05-10T01:26:18.953969+0000","last_became_active":"2023-05-10T01:26:18.569386+0000","last_became_peered":"2023-05-10T01:26:18.569386+0000","last_unstale":"2023-05-10T01:26:18.953969+0000","last_undegraded":"2023-05-10T01:26:18.953969+0000","last_fullsized":"2023-05-10T01:26:18.953969+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972925+0000","last_change":"2023-05-10T01:26:18.970193+0000","last_active":"2023-05-10T01:26:18.972925+0000","last_peered":"2023-05-10T01:26:18.972925+0000","last_clean":"2023-05-10T01:26:18.972925+0000","last_became_active":"2023-05-10T01:26:18.969884+0000","last_became_peered":"2023-05-10T01:26:18.969884+0000","last_unstale":"2023-05-10T01:26:18.972925+0000","last_undegraded":"2023-05-10T01:26:18.972925+0000","last_fullsized":"2023-05-10T01:26:18.972925+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968737+0000","last_change":"2023-05-10T01:26:18.569725+0000","last_active":"2023-05-10T01:26:18.968737+0000","last_peered":"2023-05-10T01:26:18.968737+0000","last_clean":"2023-05-10T01:26:18.968737+0000","last_became_active":"2023-05-10T01:26:18.569433+0000","last_became_peered":"2023-05-10T01:26:18.569433+0000","last_unstale":"2023-05-10T01:26:18.968737+0000","last_undegraded":"2023-05-10T01:26:18.968737+0000","last_fullsized":"2023-05-10T01:26:18.968737+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972865+0000","last_change":"2023-05-10T01:26:18.971705+0000","last_active":"2023-05-10T01:26:18.972865+0000","last_peered":"2023-05-10T01:26:18.972865+0000","last_clean":"2023-05-10T01:26:18.972865+0000","last_became_active":"2023-05-10T01:26:18.969722+0000","last_became_peered":"2023-05-10T01:26:18.969722+0000","last_unstale":"2023-05-10T01:26:18.972865+0000","last_undegraded":"2023-05-10T01:26:18.972865+0000","last_fullsized":"2023-05-10T01:26:18.972865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962270+0000","last_change":"2023-05-10T01:26:18.576060+0000","last_active":"2023-05-10T01:26:18.962270+0000","last_peered":"2023-05-10T01:26:18.962270+0000","last_clean":"2023-05-10T01:26:18.962270+0000","last_became_active":"2023-05-10T01:26:18.575751+0000","last_became_peered":"2023-05-10T01:26:18.575751+0000","last_unstale":"2023-05-10T01:26:18.962270+0000","last_undegraded":"2023-05-10T01:26:18.962270+0000","last_fullsized":"2023-05-10T01:26:18.962270+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:18.540496+0000","last_change":"2023-05-10T01:26:18.558196+0000","last_active":"2023-05-10T01:26:18.540496+0000","last_peered":"2023-05-10T01:26:18.540496+0000","last_clean":"2023-05-10T01:26:18.540496+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:18.540496+0000","last_undegraded":"2023-05-10T01:26:18.540496+0000","last_fullsized":"2023-05-10T01:26:18.540496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970841+0000","last_change":"2023-05-10T01:26:18.578645+0000","last_active":"2023-05-10T01:26:18.970841+0000","last_peered":"2023-05-10T01:26:18.970841+0000","last_clean":"2023-05-10T01:26:18.970841+0000","last_became_active":"2023-05-10T01:26:18.578350+0000","last_became_peered":"2023-05-10T01:26:18.578350+0000","last_unstale":"2023-05-10T01:26:18.970841+0000","last_undegraded":"2023-05-10T01:26:18.970841+0000","last_fullsized":"2023-05-10T01:26:18.970841+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975930+0000","last_change":"2023-05-10T01:26:18.971661+0000","last_active":"2023-05-10T01:26:18.975930+0000","last_peered":"2023-05-10T01:26:18.975930+0000","last_clean":"2023-05-10T01:26:18.975930+0000","last_became_active":"2023-05-10T01:26:18.971078+0000","last_became_peered":"2023-05-10T01:26:18.971078+0000","last_unstale":"2023-05-10T01:26:18.975930+0000","last_undegraded":"2023-05-10T01:26:18.975930+0000","last_fullsized":"2023-05-10T01:26:18.975930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960417+0000","last_change":"2023-05-10T01:26:18.580160+0000","last_active":"2023-05-10T01:26:18.960417+0000","last_peered":"2023-05-10T01:26:18.960417+0000","last_clean":"2023-05-10T01:26:18.960417+0000","last_became_active":"2023-05-10T01:26:18.576910+0000","last_became_peered":"2023-05-10T01:26:18.576910+0000","last_unstale":"2023-05-10T01:26:18.960417+0000","last_undegraded":"2023-05-10T01:26:18.960417+0000","last_fullsized":"2023-05-10T01:26:18.960417+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982521+0000","last_change":"2023-05-10T01:26:18.981668+0000","last_active":"2023-05-10T01:26:18.982521+0000","last_peered":"2023-05-10T01:26:18.982521+0000","last_clean":"2023-05-10T01:26:18.982521+0000","last_became_active":"2023-05-10T01:26:18.981394+0000","last_became_peered":"2023-05-10T01:26:18.981394+0000","last_unstale":"2023-05-10T01:26:18.982521+0000","last_undegraded":"2023-05-10T01:26:18.982521+0000","last_fullsized":"2023-05-10T01:26:18.982521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970750+0000","last_change":"2023-05-10T01:26:18.569768+0000","last_active":"2023-05-10T01:26:18.970750+0000","last_peered":"2023-05-10T01:26:18.970750+0000","last_clean":"2023-05-10T01:26:18.970750+0000","last_became_active":"2023-05-10T01:26:18.569436+0000","last_became_peered":"2023-05-10T01:26:18.569436+0000","last_unstale":"2023-05-10T01:26:18.970750+0000","last_undegraded":"2023-05-10T01:26:18.970750+0000","last_fullsized":"2023-05-10T01:26:18.970750+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954048+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:18.954048+0000","last_peered":"2023-05-10T01:26:18.954048+0000","last_clean":"2023-05-10T01:26:18.954048+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:18.954048+0000","last_undegraded":"2023-05-10T01:26:18.954048+0000","last_fullsized":"2023-05-10T01:26:18.954048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969958+0000","last_change":"2023-05-10T01:26:18.964991+0000","last_active":"2023-05-10T01:26:18.969958+0000","last_peered":"2023-05-10T01:26:18.969958+0000","last_clean":"2023-05-10T01:26:18.969958+0000","last_became_active":"2023-05-10T01:26:18.964688+0000","last_became_peered":"2023-05-10T01:26:18.964688+0000","last_unstale":"2023-05-10T01:26:18.969958+0000","last_undegraded":"2023-05-10T01:26:18.969958+0000","last_fullsized":"2023-05-10T01:26:18.969958+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984331+0000","last_change":"2023-05-10T01:26:18.575263+0000","last_active":"2023-05-10T01:26:18.984331+0000","last_peered":"2023-05-10T01:26:18.984331+0000","last_clean":"2023-05-10T01:26:18.984331+0000","last_became_active":"2023-05-10T01:26:18.574988+0000","last_became_peered":"2023-05-10T01:26:18.574988+0000","last_unstale":"2023-05-10T01:26:18.984331+0000","last_undegraded":"2023-05-10T01:26:18.984331+0000","last_fullsized":"2023-05-10T01:26:18.984331+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961951+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:18.961951+0000","last_peered":"2023-05-10T01:26:18.961951+0000","last_clean":"2023-05-10T01:26:18.961951+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:18.961951+0000","last_undegraded":"2023-05-10T01:26:18.961951+0000","last_fullsized":"2023-05-10T01:26:18.961951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968295+0000","last_change":"2023-05-10T01:26:18.964989+0000","last_active":"2023-05-10T01:26:18.968295+0000","last_peered":"2023-05-10T01:26:18.968295+0000","last_clean":"2023-05-10T01:26:18.968295+0000","last_became_active":"2023-05-10T01:26:18.964712+0000","last_became_peered":"2023-05-10T01:26:18.964712+0000","last_unstale":"2023-05-10T01:26:18.968295+0000","last_undegraded":"2023-05-10T01:26:18.968295+0000","last_fullsized":"2023-05-10T01:26:18.968295+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961619+0000","last_change":"2023-05-10T01:26:18.569662+0000","last_active":"2023-05-10T01:26:18.961619+0000","last_peered":"2023-05-10T01:26:18.961619+0000","last_clean":"2023-05-10T01:26:18.961619+0000","last_became_active":"2023-05-10T01:26:18.569358+0000","last_became_peered":"2023-05-10T01:26:18.569358+0000","last_unstale":"2023-05-10T01:26:18.961619+0000","last_undegraded":"2023-05-10T01:26:18.961619+0000","last_fullsized":"2023-05-10T01:26:18.961619+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961120+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:18.961120+0000","last_peered":"2023-05-10T01:26:18.961120+0000","last_clean":"2023-05-10T01:26:18.961120+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:18.961120+0000","last_undegraded":"2023-05-10T01:26:18.961120+0000","last_fullsized":"2023-05-10T01:26:18.961120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972323+0000","last_change":"2023-05-10T01:26:18.964995+0000","last_active":"2023-05-10T01:26:18.972323+0000","last_peered":"2023-05-10T01:26:18.972323+0000","last_clean":"2023-05-10T01:26:18.972323+0000","last_became_active":"2023-05-10T01:26:18.964677+0000","last_became_peered":"2023-05-10T01:26:18.964677+0000","last_unstale":"2023-05-10T01:26:18.972323+0000","last_undegraded":"2023-05-10T01:26:18.972323+0000","last_fullsized":"2023-05-10T01:26:18.972323+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971607+0000","last_change":"2023-05-10T01:26:18.575798+0000","last_active":"2023-05-10T01:26:18.971607+0000","last_peered":"2023-05-10T01:26:18.971607+0000","last_clean":"2023-05-10T01:26:18.971607+0000","last_became_active":"2023-05-10T01:26:18.574943+0000","last_became_peered":"2023-05-10T01:26:18.574943+0000","last_unstale":"2023-05-10T01:26:18.971607+0000","last_undegraded":"2023-05-10T01:26:18.971607+0000","last_fullsized":"2023-05-10T01:26:18.971607+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960821+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:18.960821+0000","last_peered":"2023-05-10T01:26:18.960821+0000","last_clean":"2023-05-10T01:26:18.960821+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:18.960821+0000","last_undegraded":"2023-05-10T01:26:18.960821+0000","last_fullsized":"2023-05-10T01:26:18.960821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550227+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:17.550227+0000","last_peered":"2023-05-10T01:26:17.550227+0000","last_clean":"2023-05-10T01:26:17.550227+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:17.550227+0000","last_undegraded":"2023-05-10T01:26:17.550227+0000","last_fullsized":"2023-05-10T01:26:17.550227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983903+0000","last_change":"2023-05-10T01:26:18.976078+0000","last_active":"2023-05-10T01:26:18.983903+0000","last_peered":"2023-05-10T01:26:18.983903+0000","last_clean":"2023-05-10T01:26:18.983903+0000","last_became_active":"2023-05-10T01:26:18.975740+0000","last_became_peered":"2023-05-10T01:26:18.975740+0000","last_unstale":"2023-05-10T01:26:18.983903+0000","last_undegraded":"2023-05-10T01:26:18.983903+0000","last_fullsized":"2023-05-10T01:26:18.983903+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.570758+0000","last_change":"2023-05-10T01:26:18.570758+0000","last_active":"2023-05-10T01:26:18.570758+0000","last_peered":"2023-05-10T01:26:18.570758+0000","last_clean":"2023-05-10T01:26:18.570758+0000","last_became_active":"2023-05-10T01:26:18.570490+0000","last_became_peered":"2023-05-10T01:26:18.570490+0000","last_unstale":"2023-05-10T01:26:18.570758+0000","last_undegraded":"2023-05-10T01:26:18.570758+0000","last_fullsized":"2023-05-10T01:26:18.570758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550192+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:17.550192+0000","last_peered":"2023-05-10T01:26:17.550192+0000","last_clean":"2023-05-10T01:26:17.550192+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:17.550192+0000","last_undegraded":"2023-05-10T01:26:17.550192+0000","last_fullsized":"2023-05-10T01:26:17.550192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972898+0000","last_change":"2023-05-10T01:26:18.971829+0000","last_active":"2023-05-10T01:26:18.972898+0000","last_peered":"2023-05-10T01:26:18.972898+0000","last_clean":"2023-05-10T01:26:18.972898+0000","last_became_active":"2023-05-10T01:26:18.970007+0000","last_became_peered":"2023-05-10T01:26:18.970007+0000","last_unstale":"2023-05-10T01:26:18.972898+0000","last_undegraded":"2023-05-10T01:26:18.972898+0000","last_fullsized":"2023-05-10T01:26:18.972898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960315+0000","last_change":"2023-05-10T01:26:18.578122+0000","last_active":"2023-05-10T01:26:18.960315+0000","last_peered":"2023-05-10T01:26:18.960315+0000","last_clean":"2023-05-10T01:26:18.960315+0000","last_became_active":"2023-05-10T01:26:18.577601+0000","last_became_peered":"2023-05-10T01:26:18.577601+0000","last_unstale":"2023-05-10T01:26:18.960315+0000","last_undegraded":"2023-05-10T01:26:18.960315+0000","last_fullsized":"2023-05-10T01:26:18.960315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-05-10T01:26:17.550258+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:17.550258+0000","last_peered":"2023-05-10T01:26:17.550258+0000","last_clean":"2023-05-10T01:26:17.550258+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:17.550258+0000","last_undegraded":"2023-05-10T01:26:17.550258+0000","last_fullsized":"2023-05-10T01:26:17.550258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962342+0000","last_change":"2023-05-10T01:26:18.959675+0000","last_active":"2023-05-10T01:26:18.962342+0000","last_peered":"2023-05-10T01:26:18.962342+0000","last_clean":"2023-05-10T01:26:18.962342+0000","last_became_active":"2023-05-10T01:26:18.958898+0000","last_became_peered":"2023-05-10T01:26:18.958898+0000","last_unstale":"2023-05-10T01:26:18.962342+0000","last_undegraded":"2023-05-10T01:26:18.962342+0000","last_fullsized":"2023-05-10T01:26:18.962342+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972813+0000","last_change":"2023-05-10T01:26:18.574188+0000","last_active":"2023-05-10T01:26:18.972813+0000","last_peered":"2023-05-10T01:26:18.972813+0000","last_clean":"2023-05-10T01:26:18.972813+0000","last_became_active":"2023-05-10T01:26:18.573881+0000","last_became_peered":"2023-05-10T01:26:18.573881+0000","last_unstale":"2023-05-10T01:26:18.972813+0000","last_undegraded":"2023-05-10T01:26:18.972813+0000","last_fullsized":"2023-05-10T01:26:18.972813+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.957192+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:18.957192+0000","last_peered":"2023-05-10T01:26:18.957192+0000","last_clean":"2023-05-10T01:26:18.957192+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:18.957192+0000","last_undegraded":"2023-05-10T01:26:18.957192+0000","last_fullsized":"2023-05-10T01:26:18.957192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968989+0000","last_change":"2023-05-10T01:26:18.965607+0000","last_active":"2023-05-10T01:26:18.968989+0000","last_peered":"2023-05-10T01:26:18.968989+0000","last_clean":"2023-05-10T01:26:18.968989+0000","last_became_active":"2023-05-10T01:26:18.965326+0000","last_became_peered":"2023-05-10T01:26:18.965326+0000","last_unstale":"2023-05-10T01:26:18.968989+0000","last_undegraded":"2023-05-10T01:26:18.968989+0000","last_fullsized":"2023-05-10T01:26:18.968989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962238+0000","last_change":"2023-05-10T01:26:18.578734+0000","last_active":"2023-05-10T01:26:18.962238+0000","last_peered":"2023-05-10T01:26:18.962238+0000","last_clean":"2023-05-10T01:26:18.962238+0000","last_became_active":"2023-05-10T01:26:18.577120+0000","last_became_peered":"2023-05-10T01:26:18.577120+0000","last_unstale":"2023-05-10T01:26:18.962238+0000","last_undegraded":"2023-05-10T01:26:18.962238+0000","last_fullsized":"2023-05-10T01:26:18.962238+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970423+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:18.970423+0000","last_peered":"2023-05-10T01:26:18.970423+0000","last_clean":"2023-05-10T01:26:18.970423+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:18.970423+0000","last_undegraded":"2023-05-10T01:26:18.970423+0000","last_fullsized":"2023-05-10T01:26:18.970423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18340,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353500,"statfs":{"total":96636764160,"available":96617984000,"internally_reserved":0,"allocated":1470464,"data_stored":744972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.44},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18068,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353772,"statfs":{"total":96636764160,"available":96618262528,"internally_reserved":0,"allocated":1519616,"data_stored":766992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.80000000000000004}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.747}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22104,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94349736,"statfs":{"total":96636764160,"available":96614129664,"internally_reserved":0,"allocated":1523712,"data_stored":767876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.40699999999999997}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.374}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17684,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354156,"statfs":{"total":96636764160,"available":96618655744,"internally_reserved":0,"allocated":1519616,"data_stored":767060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.748}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23184,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348656,"statfs":{"total":96636764160,"available":96613023744,"internally_reserved":0,"allocated":1515520,"data_stored":766430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.497}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.745},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82799999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.84599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26056,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":24576,"kb_avail":94345784,"statfs":{"total":96636764160,"available":96610082816,"internally_reserved":0,"allocated":1507328,"data_stored":766326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25165824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.496}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18320,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353520,"statfs":{"total":96636764160,"available":96618004480,"internally_reserved":0,"allocated":1515520,"data_stored":767240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.62},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.629}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.432},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21452,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":19968,"kb_avail":94350388,"statfs":{"total":96636764160,"available":96614797312,"internally_reserved":0,"allocated":1511424,"data_stored":766880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20447232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66300000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:26:27.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:26:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.595+0000 7fa32c946700 1 Processor -- start 2023-05-10T01:26:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.595+0000 7fa32c946700 1 -- start start 2023-05-10T01:26:27.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32c946700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa328158150 0x7fa32815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32c946700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280683c0 con 0x7fa32814e1f0 2023-05-10T01:26:27.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32c946700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280be050 con 0x7fa32814e5d0 2023-05-10T01:26:27.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32c946700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa328137460 con 0x7fa328158150 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32659c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa32814e1f0 0x7fa328066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47532/0 (socket says 172.21.15.52:47532) 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32659c700 1 -- 172.21.15.52:0/893802924 learned_addr learned my addr 172.21.15.52:0/893802924 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa326d9d700 1 --2- 172.21.15.52:0/893802924 >> v2:172.21.15.52:3300/0 conn(0x7fa328158150 0x7fa32815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32559a700 1 -- 172.21.15.52:0/893802924 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643579689 0 0) 0x7fa3280683c0 con 0x7fa32814e1f0 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa32559a700 1 -- 172.21.15.52:0/893802924 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa30c0033f0 con 0x7fa32814e1f0 2023-05-10T01:26:27.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa326d9d700 1 -- 172.21.15.52:0/893802924 >> v1:172.21.15.172:6789/0 conn(0x7fa32814e5d0 legacy=0x7fa328157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa326d9d700 1 -- 172.21.15.52:0/893802924 >> v1:172.21.15.52:6789/0 conn(0x7fa32814e1f0 legacy=0x7fa328066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.596+0000 7fa326d9d700 1 -- 172.21.15.52:0/893802924 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328067550 con 0x7fa328158150 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa326d9d700 1 --2- 172.21.15.52:0/893802924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa328158150 0x7fa32815edf0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fa318009e60 tx=0x7fa318009780).ready entity=mon.0 client_cookie=2320c9fb6ed67ae2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32559a700 1 -- 172.21.15.52:0/893802924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800e070 con 0x7fa328158150 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32559a700 1 -- 172.21.15.52:0/893802924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800bb20 con 0x7fa328158150 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32559a700 1 -- 172.21.15.52:0/893802924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800bea0 con 0x7fa328158150 2023-05-10T01:26:27.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 -- 172.21.15.52:0/893802924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa328158150 msgr2=0x7fa32815edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 --2- 172.21.15.52:0/893802924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa328158150 0x7fa32815edf0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fa318009e60 tx=0x7fa318009780).stop 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 -- 172.21.15.52:0/893802924 shutdown_connections 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 --2- 172.21.15.52:0/893802924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa328158150 0x7fa32815edf0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 -- 172.21.15.52:0/893802924 >> 172.21.15.52:0/893802924 conn(0x7fa3280c7bb0 msgr2=0x7fa3280c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 -- 172.21.15.52:0/893802924 shutdown_connections 2023-05-10T01:26:27.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.597+0000 7fa32c946700 1 -- 172.21.15.52:0/893802924 wait complete. 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.598+0000 7fa32c946700 1 Processor -- start 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.598+0000 7fa32c946700 1 -- start start 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa32814e5d0 0x7fa328135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 0x7fa328155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280aac90 con 0x7fa32814e1f0 2023-05-10T01:26:27.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280aaf70 con 0x7fa328158150 2023-05-10T01:26:27.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32c946700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa328156790 con 0x7fa32814e5d0 2023-05-10T01:26:27.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38526/0 (socket says 172.21.15.52:38526) 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.599+0000 7fa32659c700 1 -- 172.21.15.52:0/3890874391 learned_addr learned my addr 172.21.15.52:0/3890874391 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa325d9b700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa32814e5d0 0x7fa328135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa326d9d700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 0x7fa328155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 -- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa32814e5d0 msgr2=0x7fa328135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa32814e5d0 0x7fa328135e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 -- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 msgr2=0x7fa328155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 0x7fa328155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 -- 172.21.15.52:0/3890874391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009a20 con 0x7fa32814e1f0 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa326d9d700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 0x7fa328155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32659c700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fa32000c590 tx=0x7fa320007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320007e40 con 0x7fa32814e1f0 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200072e0 con 0x7fa32814e1f0 2023-05-10T01:26:27.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328156a70 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200057a0 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.600+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa328156420 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.601+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32806c340 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.601+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa320010070 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.602+0000 7fa3167fc700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 0x7fa304061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.602+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fa3200792a0 con 0x7fa32814e1f0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.602+0000 7fa325d9b700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 0x7fa304061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.602+0000 7fa325d9b700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 0x7fa304061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa3281575b0 tx=0x7fa31c009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.606+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa32004a730 con 0x7fa32814e1f0 2023-05-10T01:26:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.779+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3280ab0b0 con 0x7fa30405ed90 2023-05-10T01:26:27.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.789+0000 7fa3167fc700 1 -- 172.21.15.52:0/3890874391 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361644 (secure 0 0 0) 0x7fa31c002330 con 0x7fa30405ed90 2023-05-10T01:26:27.796 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 msgr2=0x7fa304061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 0x7fa304061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa3281575b0 tx=0x7fa31c009040).stop 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 msgr2=0x7fa328135600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fa32000c590 tx=0x7fa320007c80).stop 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 shutdown_connections 2023-05-10T01:26:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa30405ed90 0x7fa304061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa328158150 0x7fa328155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa32814e1f0 0x7fa328135600 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 --2- 172.21.15.52:0/3890874391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa32814e5d0 0x7fa328135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 >> 172.21.15.52:0/3890874391 conn(0x7fa3280c7bb0 msgr2=0x7fa328136a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 shutdown_connections 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.793+0000 7fa32c946700 1 -- 172.21.15.52:0/3890874391 wait complete. 2023-05-10T01:26:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:26:27.808 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:26:27.590065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":165376,"kb_used_data":11840,"kb_used_omap":0,"kb_used_meta":153472,"kb_avail":754809344,"statfs":{"total":773094113280,"available":772924768256,"internally_reserved":0,"allocated":12124160,"data_stored":6135220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":157155328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19714,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-59,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.175157"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976105+0000","last_change":"2023-05-10T01:26:18.975353+0000","last_active":"2023-05-10T01:26:18.976105+0000","last_peered":"2023-05-10T01:26:18.976105+0000","last_clean":"2023-05-10T01:26:18.976105+0000","last_became_active":"2023-05-10T01:26:18.975196+0000","last_became_peered":"2023-05-10T01:26:18.975196+0000","last_unstale":"2023-05-10T01:26:18.976105+0000","last_undegraded":"2023-05-10T01:26:18.976105+0000","last_fullsized":"2023-05-10T01:26:18.976105+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"121'3","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.964489+0000","last_change":"2023-05-10T01:26:18.571497+0000","last_active":"2023-05-10T01:26:18.964489+0000","last_peered":"2023-05-10T01:26:18.964489+0000","last_clean":"2023-05-10T01:26:18.964489+0000","last_became_active":"2023-05-10T01:26:18.571204+0000","last_became_peered":"2023-05-10T01:26:18.571204+0000","last_unstale":"2023-05-10T01:26:18.964489+0000","last_undegraded":"2023-05-10T01:26:18.964489+0000","last_fullsized":"2023-05-10T01:26:18.964489+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983885+0000","last_change":"2023-05-10T01:26:18.976055+0000","last_active":"2023-05-10T01:26:18.983885+0000","last_peered":"2023-05-10T01:26:18.983885+0000","last_clean":"2023-05-10T01:26:18.983885+0000","last_became_active":"2023-05-10T01:26:18.975611+0000","last_became_peered":"2023-05-10T01:26:18.975611+0000","last_unstale":"2023-05-10T01:26:18.983885+0000","last_undegraded":"2023-05-10T01:26:18.983885+0000","last_fullsized":"2023-05-10T01:26:18.983885+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950738+0000","last_change":"2023-05-10T01:26:18.561226+0000","last_active":"2023-05-10T01:26:18.950738+0000","last_peered":"2023-05-10T01:26:18.950738+0000","last_clean":"2023-05-10T01:26:18.950738+0000","last_became_active":"2023-05-10T01:26:18.560909+0000","last_became_peered":"2023-05-10T01:26:18.560909+0000","last_unstale":"2023-05-10T01:26:18.950738+0000","last_undegraded":"2023-05-10T01:26:18.950738+0000","last_fullsized":"2023-05-10T01:26:18.950738+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986126+0000","last_change":"2023-05-10T01:26:18.980502+0000","last_active":"2023-05-10T01:26:18.986126+0000","last_peered":"2023-05-10T01:26:18.986126+0000","last_clean":"2023-05-10T01:26:18.986126+0000","last_became_active":"2023-05-10T01:26:18.980170+0000","last_became_peered":"2023-05-10T01:26:18.980170+0000","last_unstale":"2023-05-10T01:26:18.986126+0000","last_undegraded":"2023-05-10T01:26:18.986126+0000","last_fullsized":"2023-05-10T01:26:18.986126+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.958018+0000","last_change":"2023-05-10T01:26:18.568238+0000","last_active":"2023-05-10T01:26:18.958018+0000","last_peered":"2023-05-10T01:26:18.958018+0000","last_clean":"2023-05-10T01:26:18.958018+0000","last_became_active":"2023-05-10T01:26:18.567912+0000","last_became_peered":"2023-05-10T01:26:18.567912+0000","last_unstale":"2023-05-10T01:26:18.958018+0000","last_undegraded":"2023-05-10T01:26:18.958018+0000","last_fullsized":"2023-05-10T01:26:18.958018+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973199+0000","last_change":"2023-05-10T01:26:18.972680+0000","last_active":"2023-05-10T01:26:18.973199+0000","last_peered":"2023-05-10T01:26:18.973199+0000","last_clean":"2023-05-10T01:26:18.973199+0000","last_became_active":"2023-05-10T01:26:18.972387+0000","last_became_peered":"2023-05-10T01:26:18.972387+0000","last_unstale":"2023-05-10T01:26:18.973199+0000","last_undegraded":"2023-05-10T01:26:18.973199+0000","last_fullsized":"2023-05-10T01:26:18.973199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962990+0000","last_change":"2023-05-10T01:26:18.575171+0000","last_active":"2023-05-10T01:26:18.962990+0000","last_peered":"2023-05-10T01:26:18.962990+0000","last_clean":"2023-05-10T01:26:18.962990+0000","last_became_active":"2023-05-10T01:26:18.574795+0000","last_became_peered":"2023-05-10T01:26:18.574795+0000","last_unstale":"2023-05-10T01:26:18.962990+0000","last_undegraded":"2023-05-10T01:26:18.962990+0000","last_fullsized":"2023-05-10T01:26:18.962990+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984096+0000","last_change":"2023-05-10T01:26:18.977610+0000","last_active":"2023-05-10T01:26:18.984096+0000","last_peered":"2023-05-10T01:26:18.984096+0000","last_clean":"2023-05-10T01:26:18.984096+0000","last_became_active":"2023-05-10T01:26:18.977328+0000","last_became_peered":"2023-05-10T01:26:18.977328+0000","last_unstale":"2023-05-10T01:26:18.984096+0000","last_undegraded":"2023-05-10T01:26:18.984096+0000","last_fullsized":"2023-05-10T01:26:18.984096+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975581+0000","last_change":"2023-05-10T01:26:18.575538+0000","last_active":"2023-05-10T01:26:18.975581+0000","last_peered":"2023-05-10T01:26:18.975581+0000","last_clean":"2023-05-10T01:26:18.975581+0000","last_became_active":"2023-05-10T01:26:18.575295+0000","last_became_peered":"2023-05-10T01:26:18.575295+0000","last_unstale":"2023-05-10T01:26:18.975581+0000","last_undegraded":"2023-05-10T01:26:18.975581+0000","last_fullsized":"2023-05-10T01:26:18.975581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975305+0000","last_change":"2023-05-10T01:26:18.972512+0000","last_active":"2023-05-10T01:26:18.975305+0000","last_peered":"2023-05-10T01:26:18.975305+0000","last_clean":"2023-05-10T01:26:18.975305+0000","last_became_active":"2023-05-10T01:26:18.966620+0000","last_became_peered":"2023-05-10T01:26:18.966620+0000","last_unstale":"2023-05-10T01:26:18.975305+0000","last_undegraded":"2023-05-10T01:26:18.975305+0000","last_fullsized":"2023-05-10T01:26:18.975305+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.974043+0000","last_change":"2023-05-10T01:26:18.567857+0000","last_active":"2023-05-10T01:26:18.974043+0000","last_peered":"2023-05-10T01:26:18.974043+0000","last_clean":"2023-05-10T01:26:18.974043+0000","last_became_active":"2023-05-10T01:26:18.567563+0000","last_became_peered":"2023-05-10T01:26:18.567563+0000","last_unstale":"2023-05-10T01:26:18.974043+0000","last_undegraded":"2023-05-10T01:26:18.974043+0000","last_fullsized":"2023-05-10T01:26:18.974043+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986176+0000","last_change":"2023-05-10T01:26:18.983119+0000","last_active":"2023-05-10T01:26:18.986176+0000","last_peered":"2023-05-10T01:26:18.986176+0000","last_clean":"2023-05-10T01:26:18.986176+0000","last_became_active":"2023-05-10T01:26:18.982828+0000","last_became_peered":"2023-05-10T01:26:18.982828+0000","last_unstale":"2023-05-10T01:26:18.986176+0000","last_undegraded":"2023-05-10T01:26:18.986176+0000","last_fullsized":"2023-05-10T01:26:18.986176+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.964613+0000","last_change":"2023-05-10T01:26:18.567240+0000","last_active":"2023-05-10T01:26:18.964613+0000","last_peered":"2023-05-10T01:26:18.964613+0000","last_clean":"2023-05-10T01:26:18.964613+0000","last_became_active":"2023-05-10T01:26:18.567028+0000","last_became_peered":"2023-05-10T01:26:18.567028+0000","last_unstale":"2023-05-10T01:26:18.964613+0000","last_undegraded":"2023-05-10T01:26:18.964613+0000","last_fullsized":"2023-05-10T01:26:18.964613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986097+0000","last_change":"2023-05-10T01:26:18.980324+0000","last_active":"2023-05-10T01:26:18.986097+0000","last_peered":"2023-05-10T01:26:18.986097+0000","last_clean":"2023-05-10T01:26:18.986097+0000","last_became_active":"2023-05-10T01:26:18.980084+0000","last_became_peered":"2023-05-10T01:26:18.980084+0000","last_unstale":"2023-05-10T01:26:18.986097+0000","last_undegraded":"2023-05-10T01:26:18.986097+0000","last_fullsized":"2023-05-10T01:26:18.986097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951498+0000","last_change":"2023-05-10T01:26:18.569917+0000","last_active":"2023-05-10T01:26:18.951498+0000","last_peered":"2023-05-10T01:26:18.951498+0000","last_clean":"2023-05-10T01:26:18.951498+0000","last_became_active":"2023-05-10T01:26:18.569637+0000","last_became_peered":"2023-05-10T01:26:18.569637+0000","last_unstale":"2023-05-10T01:26:18.951498+0000","last_undegraded":"2023-05-10T01:26:18.951498+0000","last_fullsized":"2023-05-10T01:26:18.951498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965834+0000","last_change":"2023-05-10T01:26:18.958289+0000","last_active":"2023-05-10T01:26:18.965834+0000","last_peered":"2023-05-10T01:26:18.965834+0000","last_clean":"2023-05-10T01:26:18.965834+0000","last_became_active":"2023-05-10T01:26:18.957990+0000","last_became_peered":"2023-05-10T01:26:18.957990+0000","last_unstale":"2023-05-10T01:26:18.965834+0000","last_undegraded":"2023-05-10T01:26:18.965834+0000","last_fullsized":"2023-05-10T01:26:18.965834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971177+0000","last_change":"2023-05-10T01:26:18.570414+0000","last_active":"2023-05-10T01:26:18.971177+0000","last_peered":"2023-05-10T01:26:18.971177+0000","last_clean":"2023-05-10T01:26:18.971177+0000","last_became_active":"2023-05-10T01:26:18.570143+0000","last_became_peered":"2023-05-10T01:26:18.570143+0000","last_unstale":"2023-05-10T01:26:18.971177+0000","last_undegraded":"2023-05-10T01:26:18.971177+0000","last_fullsized":"2023-05-10T01:26:18.971177+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968954+0000","last_change":"2023-05-10T01:26:18.965747+0000","last_active":"2023-05-10T01:26:18.968954+0000","last_peered":"2023-05-10T01:26:18.968954+0000","last_clean":"2023-05-10T01:26:18.968954+0000","last_became_active":"2023-05-10T01:26:18.965359+0000","last_became_peered":"2023-05-10T01:26:18.965359+0000","last_unstale":"2023-05-10T01:26:18.968954+0000","last_undegraded":"2023-05-10T01:26:18.968954+0000","last_fullsized":"2023-05-10T01:26:18.968954+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973463+0000","last_change":"2023-05-10T01:26:18.565303+0000","last_active":"2023-05-10T01:26:18.973463+0000","last_peered":"2023-05-10T01:26:18.973463+0000","last_clean":"2023-05-10T01:26:18.973463+0000","last_became_active":"2023-05-10T01:26:18.564990+0000","last_became_peered":"2023-05-10T01:26:18.564990+0000","last_unstale":"2023-05-10T01:26:18.973463+0000","last_undegraded":"2023-05-10T01:26:18.973463+0000","last_fullsized":"2023-05-10T01:26:18.973463+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969309+0000","last_change":"2023-05-10T01:26:18.967059+0000","last_active":"2023-05-10T01:26:18.969309+0000","last_peered":"2023-05-10T01:26:18.969309+0000","last_clean":"2023-05-10T01:26:18.969309+0000","last_became_active":"2023-05-10T01:26:18.966792+0000","last_became_peered":"2023-05-10T01:26:18.966792+0000","last_unstale":"2023-05-10T01:26:18.969309+0000","last_undegraded":"2023-05-10T01:26:18.969309+0000","last_fullsized":"2023-05-10T01:26:18.969309+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965432+0000","last_change":"2023-05-10T01:26:18.573117+0000","last_active":"2023-05-10T01:26:18.965432+0000","last_peered":"2023-05-10T01:26:18.965432+0000","last_clean":"2023-05-10T01:26:18.965432+0000","last_became_active":"2023-05-10T01:26:18.572730+0000","last_became_peered":"2023-05-10T01:26:18.572730+0000","last_unstale":"2023-05-10T01:26:18.965432+0000","last_undegraded":"2023-05-10T01:26:18.965432+0000","last_fullsized":"2023-05-10T01:26:18.965432+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982351+0000","last_change":"2023-05-10T01:26:18.980270+0000","last_active":"2023-05-10T01:26:18.982351+0000","last_peered":"2023-05-10T01:26:18.982351+0000","last_clean":"2023-05-10T01:26:18.982351+0000","last_became_active":"2023-05-10T01:26:18.980092+0000","last_became_peered":"2023-05-10T01:26:18.980092+0000","last_unstale":"2023-05-10T01:26:18.982351+0000","last_undegraded":"2023-05-10T01:26:18.982351+0000","last_fullsized":"2023-05-10T01:26:18.982351+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986217+0000","last_change":"2023-05-10T01:26:18.565872+0000","last_active":"2023-05-10T01:26:18.986217+0000","last_peered":"2023-05-10T01:26:18.986217+0000","last_clean":"2023-05-10T01:26:18.986217+0000","last_became_active":"2023-05-10T01:26:18.565544+0000","last_became_peered":"2023-05-10T01:26:18.565544+0000","last_unstale":"2023-05-10T01:26:18.986217+0000","last_undegraded":"2023-05-10T01:26:18.986217+0000","last_fullsized":"2023-05-10T01:26:18.986217+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984412+0000","last_change":"2023-05-10T01:26:18.979400+0000","last_active":"2023-05-10T01:26:18.984412+0000","last_peered":"2023-05-10T01:26:18.984412+0000","last_clean":"2023-05-10T01:26:18.984412+0000","last_became_active":"2023-05-10T01:26:18.978810+0000","last_became_peered":"2023-05-10T01:26:18.978810+0000","last_unstale":"2023-05-10T01:26:18.984412+0000","last_undegraded":"2023-05-10T01:26:18.984412+0000","last_fullsized":"2023-05-10T01:26:18.984412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961736+0000","last_change":"2023-05-10T01:26:18.565955+0000","last_active":"2023-05-10T01:26:18.961736+0000","last_peered":"2023-05-10T01:26:18.961736+0000","last_clean":"2023-05-10T01:26:18.961736+0000","last_became_active":"2023-05-10T01:26:18.565618+0000","last_became_peered":"2023-05-10T01:26:18.565618+0000","last_unstale":"2023-05-10T01:26:18.961736+0000","last_undegraded":"2023-05-10T01:26:18.961736+0000","last_fullsized":"2023-05-10T01:26:18.961736+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979075+0000","last_change":"2023-05-10T01:26:18.978241+0000","last_active":"2023-05-10T01:26:18.979075+0000","last_peered":"2023-05-10T01:26:18.979075+0000","last_clean":"2023-05-10T01:26:18.979075+0000","last_became_active":"2023-05-10T01:26:18.977953+0000","last_became_peered":"2023-05-10T01:26:18.977953+0000","last_unstale":"2023-05-10T01:26:18.979075+0000","last_undegraded":"2023-05-10T01:26:18.979075+0000","last_fullsized":"2023-05-10T01:26:18.979075+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962194+0000","last_change":"2023-05-10T01:26:18.573304+0000","last_active":"2023-05-10T01:26:18.962194+0000","last_peered":"2023-05-10T01:26:18.962194+0000","last_clean":"2023-05-10T01:26:18.962194+0000","last_became_active":"2023-05-10T01:26:18.573011+0000","last_became_peered":"2023-05-10T01:26:18.573011+0000","last_unstale":"2023-05-10T01:26:18.962194+0000","last_undegraded":"2023-05-10T01:26:18.962194+0000","last_fullsized":"2023-05-10T01:26:18.962194+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986326+0000","last_change":"2023-05-10T01:26:18.982281+0000","last_active":"2023-05-10T01:26:18.986326+0000","last_peered":"2023-05-10T01:26:18.986326+0000","last_clean":"2023-05-10T01:26:18.986326+0000","last_became_active":"2023-05-10T01:26:18.981892+0000","last_became_peered":"2023-05-10T01:26:18.981892+0000","last_unstale":"2023-05-10T01:26:18.986326+0000","last_undegraded":"2023-05-10T01:26:18.986326+0000","last_fullsized":"2023-05-10T01:26:18.986326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953937+0000","last_change":"2023-05-10T01:26:18.572389+0000","last_active":"2023-05-10T01:26:18.953937+0000","last_peered":"2023-05-10T01:26:18.953937+0000","last_clean":"2023-05-10T01:26:18.953937+0000","last_became_active":"2023-05-10T01:26:18.572045+0000","last_became_peered":"2023-05-10T01:26:18.572045+0000","last_unstale":"2023-05-10T01:26:18.953937+0000","last_undegraded":"2023-05-10T01:26:18.953937+0000","last_fullsized":"2023-05-10T01:26:18.953937+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972130+0000","last_change":"2023-05-10T01:26:18.968895+0000","last_active":"2023-05-10T01:26:18.972130+0000","last_peered":"2023-05-10T01:26:18.972130+0000","last_clean":"2023-05-10T01:26:18.972130+0000","last_became_active":"2023-05-10T01:26:18.968544+0000","last_became_peered":"2023-05-10T01:26:18.968544+0000","last_unstale":"2023-05-10T01:26:18.972130+0000","last_undegraded":"2023-05-10T01:26:18.972130+0000","last_fullsized":"2023-05-10T01:26:18.972130+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975022+0000","last_change":"2023-05-10T01:26:18.573081+0000","last_active":"2023-05-10T01:26:18.975022+0000","last_peered":"2023-05-10T01:26:18.975022+0000","last_clean":"2023-05-10T01:26:18.975022+0000","last_became_active":"2023-05-10T01:26:18.572641+0000","last_became_peered":"2023-05-10T01:26:18.572641+0000","last_unstale":"2023-05-10T01:26:18.975022+0000","last_undegraded":"2023-05-10T01:26:18.975022+0000","last_fullsized":"2023-05-10T01:26:18.975022+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976079+0000","last_change":"2023-05-10T01:26:18.972392+0000","last_active":"2023-05-10T01:26:18.976079+0000","last_peered":"2023-05-10T01:26:18.976079+0000","last_clean":"2023-05-10T01:26:18.976079+0000","last_became_active":"2023-05-10T01:26:18.972123+0000","last_became_peered":"2023-05-10T01:26:18.972123+0000","last_unstale":"2023-05-10T01:26:18.976079+0000","last_undegraded":"2023-05-10T01:26:18.976079+0000","last_fullsized":"2023-05-10T01:26:18.976079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.951662+0000","last_change":"2023-05-10T01:26:18.570935+0000","last_active":"2023-05-10T01:26:18.951662+0000","last_peered":"2023-05-10T01:26:18.951662+0000","last_clean":"2023-05-10T01:26:18.951662+0000","last_became_active":"2023-05-10T01:26:18.570644+0000","last_became_peered":"2023-05-10T01:26:18.570644+0000","last_unstale":"2023-05-10T01:26:18.951662+0000","last_undegraded":"2023-05-10T01:26:18.951662+0000","last_fullsized":"2023-05-10T01:26:18.951662+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981301+0000","last_change":"2023-05-10T01:26:18.974489+0000","last_active":"2023-05-10T01:26:18.981301+0000","last_peered":"2023-05-10T01:26:18.981301+0000","last_clean":"2023-05-10T01:26:18.981301+0000","last_became_active":"2023-05-10T01:26:18.974210+0000","last_became_peered":"2023-05-10T01:26:18.974210+0000","last_unstale":"2023-05-10T01:26:18.981301+0000","last_undegraded":"2023-05-10T01:26:18.981301+0000","last_fullsized":"2023-05-10T01:26:18.981301+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954278+0000","last_change":"2023-05-10T01:26:18.573110+0000","last_active":"2023-05-10T01:26:18.954278+0000","last_peered":"2023-05-10T01:26:18.954278+0000","last_clean":"2023-05-10T01:26:18.954278+0000","last_became_active":"2023-05-10T01:26:18.572645+0000","last_became_peered":"2023-05-10T01:26:18.572645+0000","last_unstale":"2023-05-10T01:26:18.954278+0000","last_undegraded":"2023-05-10T01:26:18.954278+0000","last_fullsized":"2023-05-10T01:26:18.954278+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982695+0000","last_change":"2023-05-10T01:26:18.974551+0000","last_active":"2023-05-10T01:26:18.982695+0000","last_peered":"2023-05-10T01:26:18.982695+0000","last_clean":"2023-05-10T01:26:18.982695+0000","last_became_active":"2023-05-10T01:26:18.974260+0000","last_became_peered":"2023-05-10T01:26:18.974260+0000","last_unstale":"2023-05-10T01:26:18.982695+0000","last_undegraded":"2023-05-10T01:26:18.982695+0000","last_fullsized":"2023-05-10T01:26:18.982695+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969888+0000","last_change":"2023-05-10T01:26:18.578477+0000","last_active":"2023-05-10T01:26:18.969888+0000","last_peered":"2023-05-10T01:26:18.969888+0000","last_clean":"2023-05-10T01:26:18.969888+0000","last_became_active":"2023-05-10T01:26:18.578107+0000","last_became_peered":"2023-05-10T01:26:18.578107+0000","last_unstale":"2023-05-10T01:26:18.969888+0000","last_undegraded":"2023-05-10T01:26:18.969888+0000","last_fullsized":"2023-05-10T01:26:18.969888+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969112+0000","last_change":"2023-05-10T01:26:18.966385+0000","last_active":"2023-05-10T01:26:18.969112+0000","last_peered":"2023-05-10T01:26:18.969112+0000","last_clean":"2023-05-10T01:26:18.969112+0000","last_became_active":"2023-05-10T01:26:18.966106+0000","last_became_peered":"2023-05-10T01:26:18.966106+0000","last_unstale":"2023-05-10T01:26:18.969112+0000","last_undegraded":"2023-05-10T01:26:18.969112+0000","last_fullsized":"2023-05-10T01:26:18.969112+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.967263+0000","last_change":"2023-05-10T01:26:18.573995+0000","last_active":"2023-05-10T01:26:18.967263+0000","last_peered":"2023-05-10T01:26:18.967263+0000","last_clean":"2023-05-10T01:26:18.967263+0000","last_became_active":"2023-05-10T01:26:18.573725+0000","last_became_peered":"2023-05-10T01:26:18.573725+0000","last_unstale":"2023-05-10T01:26:18.967263+0000","last_undegraded":"2023-05-10T01:26:18.967263+0000","last_fullsized":"2023-05-10T01:26:18.967263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984389+0000","last_change":"2023-05-10T01:26:18.979267+0000","last_active":"2023-05-10T01:26:18.984389+0000","last_peered":"2023-05-10T01:26:18.984389+0000","last_clean":"2023-05-10T01:26:18.984389+0000","last_became_active":"2023-05-10T01:26:18.978510+0000","last_became_peered":"2023-05-10T01:26:18.978510+0000","last_unstale":"2023-05-10T01:26:18.984389+0000","last_undegraded":"2023-05-10T01:26:18.984389+0000","last_fullsized":"2023-05-10T01:26:18.984389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980364+0000","last_change":"2023-05-10T01:26:18.573187+0000","last_active":"2023-05-10T01:26:18.980364+0000","last_peered":"2023-05-10T01:26:18.980364+0000","last_clean":"2023-05-10T01:26:18.980364+0000","last_became_active":"2023-05-10T01:26:18.572833+0000","last_became_peered":"2023-05-10T01:26:18.572833+0000","last_unstale":"2023-05-10T01:26:18.980364+0000","last_undegraded":"2023-05-10T01:26:18.980364+0000","last_fullsized":"2023-05-10T01:26:18.980364+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979290+0000","last_change":"2023-05-10T01:26:18.977829+0000","last_active":"2023-05-10T01:26:18.979290+0000","last_peered":"2023-05-10T01:26:18.979290+0000","last_clean":"2023-05-10T01:26:18.979290+0000","last_became_active":"2023-05-10T01:26:18.977552+0000","last_became_peered":"2023-05-10T01:26:18.977552+0000","last_unstale":"2023-05-10T01:26:18.979290+0000","last_undegraded":"2023-05-10T01:26:18.979290+0000","last_fullsized":"2023-05-10T01:26:18.979290+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950638+0000","last_change":"2023-05-10T01:26:18.561026+0000","last_active":"2023-05-10T01:26:18.950638+0000","last_peered":"2023-05-10T01:26:18.950638+0000","last_clean":"2023-05-10T01:26:18.950638+0000","last_became_active":"2023-05-10T01:26:18.560672+0000","last_became_peered":"2023-05-10T01:26:18.560672+0000","last_unstale":"2023-05-10T01:26:18.950638+0000","last_undegraded":"2023-05-10T01:26:18.950638+0000","last_fullsized":"2023-05-10T01:26:18.950638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980906+0000","last_change":"2023-05-10T01:26:18.979154+0000","last_active":"2023-05-10T01:26:18.980906+0000","last_peered":"2023-05-10T01:26:18.980906+0000","last_clean":"2023-05-10T01:26:18.980906+0000","last_became_active":"2023-05-10T01:26:18.978702+0000","last_became_peered":"2023-05-10T01:26:18.978702+0000","last_unstale":"2023-05-10T01:26:18.980906+0000","last_undegraded":"2023-05-10T01:26:18.980906+0000","last_fullsized":"2023-05-10T01:26:18.980906+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950627+0000","last_change":"2023-05-10T01:26:18.560867+0000","last_active":"2023-05-10T01:26:18.950627+0000","last_peered":"2023-05-10T01:26:18.950627+0000","last_clean":"2023-05-10T01:26:18.950627+0000","last_became_active":"2023-05-10T01:26:18.560517+0000","last_became_peered":"2023-05-10T01:26:18.560517+0000","last_unstale":"2023-05-10T01:26:18.950627+0000","last_undegraded":"2023-05-10T01:26:18.950627+0000","last_fullsized":"2023-05-10T01:26:18.950627+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983937+0000","last_change":"2023-05-10T01:26:18.975922+0000","last_active":"2023-05-10T01:26:18.983937+0000","last_peered":"2023-05-10T01:26:18.983937+0000","last_clean":"2023-05-10T01:26:18.983937+0000","last_became_active":"2023-05-10T01:26:18.975625+0000","last_became_peered":"2023-05-10T01:26:18.975625+0000","last_unstale":"2023-05-10T01:26:18.983937+0000","last_undegraded":"2023-05-10T01:26:18.983937+0000","last_fullsized":"2023-05-10T01:26:18.983937+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963569+0000","last_change":"2023-05-10T01:26:18.568747+0000","last_active":"2023-05-10T01:26:18.963569+0000","last_peered":"2023-05-10T01:26:18.963569+0000","last_clean":"2023-05-10T01:26:18.963569+0000","last_became_active":"2023-05-10T01:26:18.568459+0000","last_became_peered":"2023-05-10T01:26:18.568459+0000","last_unstale":"2023-05-10T01:26:18.963569+0000","last_undegraded":"2023-05-10T01:26:18.963569+0000","last_fullsized":"2023-05-10T01:26:18.963569+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969978+0000","last_change":"2023-05-10T01:26:18.968227+0000","last_active":"2023-05-10T01:26:18.969978+0000","last_peered":"2023-05-10T01:26:18.969978+0000","last_clean":"2023-05-10T01:26:18.969978+0000","last_became_active":"2023-05-10T01:26:18.967878+0000","last_became_peered":"2023-05-10T01:26:18.967878+0000","last_unstale":"2023-05-10T01:26:18.969978+0000","last_undegraded":"2023-05-10T01:26:18.969978+0000","last_fullsized":"2023-05-10T01:26:18.969978+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970296+0000","last_change":"2023-05-10T01:26:18.572795+0000","last_active":"2023-05-10T01:26:18.970296+0000","last_peered":"2023-05-10T01:26:18.970296+0000","last_clean":"2023-05-10T01:26:18.970296+0000","last_became_active":"2023-05-10T01:26:18.572492+0000","last_became_peered":"2023-05-10T01:26:18.572492+0000","last_unstale":"2023-05-10T01:26:18.970296+0000","last_undegraded":"2023-05-10T01:26:18.970296+0000","last_fullsized":"2023-05-10T01:26:18.970296+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984313+0000","last_change":"2023-05-10T01:26:18.980822+0000","last_active":"2023-05-10T01:26:18.984313+0000","last_peered":"2023-05-10T01:26:18.984313+0000","last_clean":"2023-05-10T01:26:18.984313+0000","last_became_active":"2023-05-10T01:26:18.980525+0000","last_became_peered":"2023-05-10T01:26:18.980525+0000","last_unstale":"2023-05-10T01:26:18.984313+0000","last_undegraded":"2023-05-10T01:26:18.984313+0000","last_fullsized":"2023-05-10T01:26:18.984313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-05-10T01:26:19.955231+0000","last_change":"2023-05-10T01:26:18.569164+0000","last_active":"2023-05-10T01:26:19.955231+0000","last_peered":"2023-05-10T01:26:19.955231+0000","last_clean":"2023-05-10T01:26:19.955231+0000","last_became_active":"2023-05-10T01:26:18.568880+0000","last_became_peered":"2023-05-10T01:26:18.568880+0000","last_unstale":"2023-05-10T01:26:19.955231+0000","last_undegraded":"2023-05-10T01:26:19.955231+0000","last_fullsized":"2023-05-10T01:26:19.955231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984073+0000","last_change":"2023-05-10T01:26:18.977385+0000","last_active":"2023-05-10T01:26:18.984073+0000","last_peered":"2023-05-10T01:26:18.984073+0000","last_clean":"2023-05-10T01:26:18.984073+0000","last_became_active":"2023-05-10T01:26:18.977035+0000","last_became_peered":"2023-05-10T01:26:18.977035+0000","last_unstale":"2023-05-10T01:26:18.984073+0000","last_undegraded":"2023-05-10T01:26:18.984073+0000","last_fullsized":"2023-05-10T01:26:18.984073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965057+0000","last_change":"2023-05-10T01:26:18.579601+0000","last_active":"2023-05-10T01:26:18.965057+0000","last_peered":"2023-05-10T01:26:18.965057+0000","last_clean":"2023-05-10T01:26:18.965057+0000","last_became_active":"2023-05-10T01:26:18.579357+0000","last_became_peered":"2023-05-10T01:26:18.579357+0000","last_unstale":"2023-05-10T01:26:18.965057+0000","last_undegraded":"2023-05-10T01:26:18.965057+0000","last_fullsized":"2023-05-10T01:26:18.965057+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981042+0000","last_change":"2023-05-10T01:26:18.979843+0000","last_active":"2023-05-10T01:26:18.981042+0000","last_peered":"2023-05-10T01:26:18.981042+0000","last_clean":"2023-05-10T01:26:18.981042+0000","last_became_active":"2023-05-10T01:26:18.979531+0000","last_became_peered":"2023-05-10T01:26:18.979531+0000","last_unstale":"2023-05-10T01:26:18.981042+0000","last_undegraded":"2023-05-10T01:26:18.981042+0000","last_fullsized":"2023-05-10T01:26:18.981042+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969780+0000","last_change":"2023-05-10T01:26:18.578551+0000","last_active":"2023-05-10T01:26:18.969780+0000","last_peered":"2023-05-10T01:26:18.969780+0000","last_clean":"2023-05-10T01:26:18.969780+0000","last_became_active":"2023-05-10T01:26:18.578284+0000","last_became_peered":"2023-05-10T01:26:18.578284+0000","last_unstale":"2023-05-10T01:26:18.969780+0000","last_undegraded":"2023-05-10T01:26:18.969780+0000","last_fullsized":"2023-05-10T01:26:18.969780+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981032+0000","last_change":"2023-05-10T01:26:18.980314+0000","last_active":"2023-05-10T01:26:18.981032+0000","last_peered":"2023-05-10T01:26:18.981032+0000","last_clean":"2023-05-10T01:26:18.981032+0000","last_became_active":"2023-05-10T01:26:18.980009+0000","last_became_peered":"2023-05-10T01:26:18.980009+0000","last_unstale":"2023-05-10T01:26:18.981032+0000","last_undegraded":"2023-05-10T01:26:18.981032+0000","last_fullsized":"2023-05-10T01:26:18.981032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950702+0000","last_change":"2023-05-10T01:26:18.574810+0000","last_active":"2023-05-10T01:26:18.950702+0000","last_peered":"2023-05-10T01:26:18.950702+0000","last_clean":"2023-05-10T01:26:18.950702+0000","last_became_active":"2023-05-10T01:26:18.574499+0000","last_became_peered":"2023-05-10T01:26:18.574499+0000","last_unstale":"2023-05-10T01:26:18.950702+0000","last_undegraded":"2023-05-10T01:26:18.950702+0000","last_fullsized":"2023-05-10T01:26:18.950702+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.968399+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.967572+0000","last_became_peered":"2023-05-10T01:26:18.967572+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962166+0000","last_change":"2023-05-10T01:26:18.579613+0000","last_active":"2023-05-10T01:26:18.962166+0000","last_peered":"2023-05-10T01:26:18.962166+0000","last_clean":"2023-05-10T01:26:18.962166+0000","last_became_active":"2023-05-10T01:26:18.579329+0000","last_became_peered":"2023-05-10T01:26:18.579329+0000","last_unstale":"2023-05-10T01:26:18.962166+0000","last_undegraded":"2023-05-10T01:26:18.962166+0000","last_fullsized":"2023-05-10T01:26:18.962166+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986337+0000","last_change":"2023-05-10T01:26:18.983347+0000","last_active":"2023-05-10T01:26:18.986337+0000","last_peered":"2023-05-10T01:26:18.986337+0000","last_clean":"2023-05-10T01:26:18.986337+0000","last_became_active":"2023-05-10T01:26:18.983062+0000","last_became_peered":"2023-05-10T01:26:18.983062+0000","last_unstale":"2023-05-10T01:26:18.986337+0000","last_undegraded":"2023-05-10T01:26:18.986337+0000","last_fullsized":"2023-05-10T01:26:18.986337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953996+0000","last_change":"2023-05-10T01:26:18.573948+0000","last_active":"2023-05-10T01:26:18.953996+0000","last_peered":"2023-05-10T01:26:18.953996+0000","last_clean":"2023-05-10T01:26:18.953996+0000","last_became_active":"2023-05-10T01:26:18.573657+0000","last_became_peered":"2023-05-10T01:26:18.573657+0000","last_unstale":"2023-05-10T01:26:18.953996+0000","last_undegraded":"2023-05-10T01:26:18.953996+0000","last_fullsized":"2023-05-10T01:26:18.953996+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961425+0000","last_change":"2023-05-10T01:26:18.959076+0000","last_active":"2023-05-10T01:26:18.961425+0000","last_peered":"2023-05-10T01:26:18.961425+0000","last_clean":"2023-05-10T01:26:18.961425+0000","last_became_active":"2023-05-10T01:26:18.958781+0000","last_became_peered":"2023-05-10T01:26:18.958781+0000","last_unstale":"2023-05-10T01:26:18.961425+0000","last_undegraded":"2023-05-10T01:26:18.961425+0000","last_fullsized":"2023-05-10T01:26:18.961425+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954585+0000","last_change":"2023-05-10T01:26:18.568537+0000","last_active":"2023-05-10T01:26:18.954585+0000","last_peered":"2023-05-10T01:26:18.954585+0000","last_clean":"2023-05-10T01:26:18.954585+0000","last_became_active":"2023-05-10T01:26:18.568280+0000","last_became_peered":"2023-05-10T01:26:18.568280+0000","last_unstale":"2023-05-10T01:26:18.954585+0000","last_undegraded":"2023-05-10T01:26:18.954585+0000","last_fullsized":"2023-05-10T01:26:18.954585+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981294+0000","last_change":"2023-05-10T01:26:18.977492+0000","last_active":"2023-05-10T01:26:18.981294+0000","last_peered":"2023-05-10T01:26:18.981294+0000","last_clean":"2023-05-10T01:26:18.981294+0000","last_became_active":"2023-05-10T01:26:18.976984+0000","last_became_peered":"2023-05-10T01:26:18.976984+0000","last_unstale":"2023-05-10T01:26:18.981294+0000","last_undegraded":"2023-05-10T01:26:18.981294+0000","last_fullsized":"2023-05-10T01:26:18.981294+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961450+0000","last_change":"2023-05-10T01:26:18.573919+0000","last_active":"2023-05-10T01:26:18.961450+0000","last_peered":"2023-05-10T01:26:18.961450+0000","last_clean":"2023-05-10T01:26:18.961450+0000","last_became_active":"2023-05-10T01:26:18.573623+0000","last_became_peered":"2023-05-10T01:26:18.573623+0000","last_unstale":"2023-05-10T01:26:18.961450+0000","last_undegraded":"2023-05-10T01:26:18.961450+0000","last_fullsized":"2023-05-10T01:26:18.961450+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972875+0000","last_change":"2023-05-10T01:26:18.969323+0000","last_active":"2023-05-10T01:26:18.972875+0000","last_peered":"2023-05-10T01:26:18.972875+0000","last_clean":"2023-05-10T01:26:18.972875+0000","last_became_active":"2023-05-10T01:26:18.969064+0000","last_became_peered":"2023-05-10T01:26:18.969064+0000","last_unstale":"2023-05-10T01:26:18.972875+0000","last_undegraded":"2023-05-10T01:26:18.972875+0000","last_fullsized":"2023-05-10T01:26:18.972875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975962+0000","last_change":"2023-05-10T01:26:18.566612+0000","last_active":"2023-05-10T01:26:18.975962+0000","last_peered":"2023-05-10T01:26:18.975962+0000","last_clean":"2023-05-10T01:26:18.975962+0000","last_became_active":"2023-05-10T01:26:18.566339+0000","last_became_peered":"2023-05-10T01:26:18.566339+0000","last_unstale":"2023-05-10T01:26:18.975962+0000","last_undegraded":"2023-05-10T01:26:18.975962+0000","last_fullsized":"2023-05-10T01:26:18.975962+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986012+0000","last_change":"2023-05-10T01:26:18.979914+0000","last_active":"2023-05-10T01:26:18.986012+0000","last_peered":"2023-05-10T01:26:18.986012+0000","last_clean":"2023-05-10T01:26:18.986012+0000","last_became_active":"2023-05-10T01:26:18.978337+0000","last_became_peered":"2023-05-10T01:26:18.978337+0000","last_unstale":"2023-05-10T01:26:18.986012+0000","last_undegraded":"2023-05-10T01:26:18.986012+0000","last_fullsized":"2023-05-10T01:26:18.986012+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981678+0000","last_change":"2023-05-10T01:26:18.569910+0000","last_active":"2023-05-10T01:26:18.981678+0000","last_peered":"2023-05-10T01:26:18.981678+0000","last_clean":"2023-05-10T01:26:18.981678+0000","last_became_active":"2023-05-10T01:26:18.569422+0000","last_became_peered":"2023-05-10T01:26:18.569422+0000","last_unstale":"2023-05-10T01:26:18.981678+0000","last_undegraded":"2023-05-10T01:26:18.981678+0000","last_fullsized":"2023-05-10T01:26:18.981678+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981337+0000","last_change":"2023-05-10T01:26:18.979463+0000","last_active":"2023-05-10T01:26:18.981337+0000","last_peered":"2023-05-10T01:26:18.981337+0000","last_clean":"2023-05-10T01:26:18.981337+0000","last_became_active":"2023-05-10T01:26:18.979196+0000","last_became_peered":"2023-05-10T01:26:18.979196+0000","last_unstale":"2023-05-10T01:26:18.981337+0000","last_undegraded":"2023-05-10T01:26:18.981337+0000","last_fullsized":"2023-05-10T01:26:18.981337+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953861+0000","last_change":"2023-05-10T01:26:18.565715+0000","last_active":"2023-05-10T01:26:18.953861+0000","last_peered":"2023-05-10T01:26:18.953861+0000","last_clean":"2023-05-10T01:26:18.953861+0000","last_became_active":"2023-05-10T01:26:18.565428+0000","last_became_peered":"2023-05-10T01:26:18.565428+0000","last_unstale":"2023-05-10T01:26:18.953861+0000","last_undegraded":"2023-05-10T01:26:18.953861+0000","last_fullsized":"2023-05-10T01:26:18.953861+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969143+0000","last_change":"2023-05-10T01:26:18.967157+0000","last_active":"2023-05-10T01:26:18.969143+0000","last_peered":"2023-05-10T01:26:18.969143+0000","last_clean":"2023-05-10T01:26:18.969143+0000","last_became_active":"2023-05-10T01:26:18.966855+0000","last_became_peered":"2023-05-10T01:26:18.966855+0000","last_unstale":"2023-05-10T01:26:18.969143+0000","last_undegraded":"2023-05-10T01:26:18.969143+0000","last_fullsized":"2023-05-10T01:26:18.969143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963458+0000","last_change":"2023-05-10T01:26:18.569655+0000","last_active":"2023-05-10T01:26:18.963458+0000","last_peered":"2023-05-10T01:26:18.963458+0000","last_clean":"2023-05-10T01:26:18.963458+0000","last_became_active":"2023-05-10T01:26:18.569340+0000","last_became_peered":"2023-05-10T01:26:18.569340+0000","last_unstale":"2023-05-10T01:26:18.963458+0000","last_undegraded":"2023-05-10T01:26:18.963458+0000","last_fullsized":"2023-05-10T01:26:18.963458+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979056+0000","last_change":"2023-05-10T01:26:18.978201+0000","last_active":"2023-05-10T01:26:18.979056+0000","last_peered":"2023-05-10T01:26:18.979056+0000","last_clean":"2023-05-10T01:26:18.979056+0000","last_became_active":"2023-05-10T01:26:18.977901+0000","last_became_peered":"2023-05-10T01:26:18.977901+0000","last_unstale":"2023-05-10T01:26:18.979056+0000","last_undegraded":"2023-05-10T01:26:18.979056+0000","last_fullsized":"2023-05-10T01:26:18.979056+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961877+0000","last_change":"2023-05-10T01:26:18.561470+0000","last_active":"2023-05-10T01:26:18.961877+0000","last_peered":"2023-05-10T01:26:18.961877+0000","last_clean":"2023-05-10T01:26:18.961877+0000","last_became_active":"2023-05-10T01:26:18.561192+0000","last_became_peered":"2023-05-10T01:26:18.561192+0000","last_unstale":"2023-05-10T01:26:18.961877+0000","last_undegraded":"2023-05-10T01:26:18.961877+0000","last_fullsized":"2023-05-10T01:26:18.961877+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.986239+0000","last_change":"2023-05-10T01:26:18.981603+0000","last_active":"2023-05-10T01:26:18.986239+0000","last_peered":"2023-05-10T01:26:18.986239+0000","last_clean":"2023-05-10T01:26:18.986239+0000","last_became_active":"2023-05-10T01:26:18.981305+0000","last_became_peered":"2023-05-10T01:26:18.981305+0000","last_unstale":"2023-05-10T01:26:18.986239+0000","last_undegraded":"2023-05-10T01:26:18.986239+0000","last_fullsized":"2023-05-10T01:26:18.986239+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962513+0000","last_change":"2023-05-10T01:26:18.570686+0000","last_active":"2023-05-10T01:26:18.962513+0000","last_peered":"2023-05-10T01:26:18.962513+0000","last_clean":"2023-05-10T01:26:18.962513+0000","last_became_active":"2023-05-10T01:26:18.569082+0000","last_became_peered":"2023-05-10T01:26:18.569082+0000","last_unstale":"2023-05-10T01:26:18.962513+0000","last_undegraded":"2023-05-10T01:26:18.962513+0000","last_fullsized":"2023-05-10T01:26:18.962513+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.959799+0000","last_change":"2023-05-10T01:26:18.958884+0000","last_active":"2023-05-10T01:26:18.959799+0000","last_peered":"2023-05-10T01:26:18.959799+0000","last_clean":"2023-05-10T01:26:18.959799+0000","last_became_active":"2023-05-10T01:26:18.958618+0000","last_became_peered":"2023-05-10T01:26:18.958618+0000","last_unstale":"2023-05-10T01:26:18.959799+0000","last_undegraded":"2023-05-10T01:26:18.959799+0000","last_fullsized":"2023-05-10T01:26:18.959799+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954615+0000","last_change":"2023-05-10T01:26:18.568330+0000","last_active":"2023-05-10T01:26:18.954615+0000","last_peered":"2023-05-10T01:26:18.954615+0000","last_clean":"2023-05-10T01:26:18.954615+0000","last_became_active":"2023-05-10T01:26:18.568050+0000","last_became_peered":"2023-05-10T01:26:18.568050+0000","last_unstale":"2023-05-10T01:26:18.954615+0000","last_undegraded":"2023-05-10T01:26:18.954615+0000","last_fullsized":"2023-05-10T01:26:18.954615+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.981313+0000","last_change":"2023-05-10T01:26:18.978294+0000","last_active":"2023-05-10T01:26:18.981313+0000","last_peered":"2023-05-10T01:26:18.981313+0000","last_clean":"2023-05-10T01:26:18.981313+0000","last_became_active":"2023-05-10T01:26:18.978004+0000","last_became_peered":"2023-05-10T01:26:18.978004+0000","last_unstale":"2023-05-10T01:26:18.981313+0000","last_undegraded":"2023-05-10T01:26:18.981313+0000","last_fullsized":"2023-05-10T01:26:18.981313+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971271+0000","last_change":"2023-05-10T01:26:18.570874+0000","last_active":"2023-05-10T01:26:18.971271+0000","last_peered":"2023-05-10T01:26:18.971271+0000","last_clean":"2023-05-10T01:26:18.971271+0000","last_became_active":"2023-05-10T01:26:18.569744+0000","last_became_peered":"2023-05-10T01:26:18.569744+0000","last_unstale":"2023-05-10T01:26:18.971271+0000","last_undegraded":"2023-05-10T01:26:18.971271+0000","last_fullsized":"2023-05-10T01:26:18.971271+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975668+0000","last_change":"2023-05-10T01:26:18.974160+0000","last_active":"2023-05-10T01:26:18.975668+0000","last_peered":"2023-05-10T01:26:18.975668+0000","last_clean":"2023-05-10T01:26:18.975668+0000","last_became_active":"2023-05-10T01:26:18.973883+0000","last_became_peered":"2023-05-10T01:26:18.973883+0000","last_unstale":"2023-05-10T01:26:18.975668+0000","last_undegraded":"2023-05-10T01:26:18.975668+0000","last_fullsized":"2023-05-10T01:26:18.975668+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950863+0000","last_change":"2023-05-10T01:26:18.566957+0000","last_active":"2023-05-10T01:26:18.950863+0000","last_peered":"2023-05-10T01:26:18.950863+0000","last_clean":"2023-05-10T01:26:18.950863+0000","last_became_active":"2023-05-10T01:26:18.566513+0000","last_became_peered":"2023-05-10T01:26:18.566513+0000","last_unstale":"2023-05-10T01:26:18.950863+0000","last_undegraded":"2023-05-10T01:26:18.950863+0000","last_fullsized":"2023-05-10T01:26:18.950863+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.973486+0000","last_change":"2023-05-10T01:26:18.968563+0000","last_active":"2023-05-10T01:26:18.973486+0000","last_peered":"2023-05-10T01:26:18.973486+0000","last_clean":"2023-05-10T01:26:18.973486+0000","last_became_active":"2023-05-10T01:26:18.968254+0000","last_became_peered":"2023-05-10T01:26:18.968254+0000","last_unstale":"2023-05-10T01:26:18.973486+0000","last_undegraded":"2023-05-10T01:26:18.973486+0000","last_fullsized":"2023-05-10T01:26:18.973486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"121'3","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.977141+0000","last_change":"2023-05-10T01:26:18.571475+0000","last_active":"2023-05-10T01:26:18.977141+0000","last_peered":"2023-05-10T01:26:18.977141+0000","last_clean":"2023-05-10T01:26:18.977141+0000","last_became_active":"2023-05-10T01:26:18.569950+0000","last_became_peered":"2023-05-10T01:26:18.569950+0000","last_unstale":"2023-05-10T01:26:18.977141+0000","last_undegraded":"2023-05-10T01:26:18.977141+0000","last_fullsized":"2023-05-10T01:26:18.977141+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972070+0000","last_change":"2023-05-10T01:26:18.970445+0000","last_active":"2023-05-10T01:26:18.972070+0000","last_peered":"2023-05-10T01:26:18.972070+0000","last_clean":"2023-05-10T01:26:18.972070+0000","last_became_active":"2023-05-10T01:26:18.970153+0000","last_became_peered":"2023-05-10T01:26:18.970153+0000","last_unstale":"2023-05-10T01:26:18.972070+0000","last_undegraded":"2023-05-10T01:26:18.972070+0000","last_fullsized":"2023-05-10T01:26:18.972070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.976396+0000","last_change":"2023-05-10T01:26:18.573036+0000","last_active":"2023-05-10T01:26:18.976396+0000","last_peered":"2023-05-10T01:26:18.976396+0000","last_clean":"2023-05-10T01:26:18.976396+0000","last_became_active":"2023-05-10T01:26:18.572465+0000","last_became_peered":"2023-05-10T01:26:18.572465+0000","last_unstale":"2023-05-10T01:26:18.976396+0000","last_undegraded":"2023-05-10T01:26:18.976396+0000","last_fullsized":"2023-05-10T01:26:18.976396+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972570+0000","last_change":"2023-05-10T01:26:18.965093+0000","last_active":"2023-05-10T01:26:18.972570+0000","last_peered":"2023-05-10T01:26:18.972570+0000","last_clean":"2023-05-10T01:26:18.972570+0000","last_became_active":"2023-05-10T01:26:18.964893+0000","last_became_peered":"2023-05-10T01:26:18.964893+0000","last_unstale":"2023-05-10T01:26:18.972570+0000","last_undegraded":"2023-05-10T01:26:18.972570+0000","last_fullsized":"2023-05-10T01:26:18.972570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963502+0000","last_change":"2023-05-10T01:26:18.580354+0000","last_active":"2023-05-10T01:26:18.963502+0000","last_peered":"2023-05-10T01:26:18.963502+0000","last_clean":"2023-05-10T01:26:18.963502+0000","last_became_active":"2023-05-10T01:26:18.580040+0000","last_became_peered":"2023-05-10T01:26:18.580040+0000","last_unstale":"2023-05-10T01:26:18.963502+0000","last_undegraded":"2023-05-10T01:26:18.963502+0000","last_fullsized":"2023-05-10T01:26:18.963502+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983953+0000","last_change":"2023-05-10T01:26:18.976867+0000","last_active":"2023-05-10T01:26:18.983953+0000","last_peered":"2023-05-10T01:26:18.983953+0000","last_clean":"2023-05-10T01:26:18.983953+0000","last_became_active":"2023-05-10T01:26:18.976452+0000","last_became_peered":"2023-05-10T01:26:18.976452+0000","last_unstale":"2023-05-10T01:26:18.983953+0000","last_undegraded":"2023-05-10T01:26:18.983953+0000","last_fullsized":"2023-05-10T01:26:18.983953+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954051+0000","last_change":"2023-05-10T01:26:18.567694+0000","last_active":"2023-05-10T01:26:18.954051+0000","last_peered":"2023-05-10T01:26:18.954051+0000","last_clean":"2023-05-10T01:26:18.954051+0000","last_became_active":"2023-05-10T01:26:18.567244+0000","last_became_peered":"2023-05-10T01:26:18.567244+0000","last_unstale":"2023-05-10T01:26:18.954051+0000","last_undegraded":"2023-05-10T01:26:18.954051+0000","last_fullsized":"2023-05-10T01:26:18.954051+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982326+0000","last_change":"2023-05-10T01:26:18.978674+0000","last_active":"2023-05-10T01:26:18.982326+0000","last_peered":"2023-05-10T01:26:18.982326+0000","last_clean":"2023-05-10T01:26:18.982326+0000","last_became_active":"2023-05-10T01:26:18.978366+0000","last_became_peered":"2023-05-10T01:26:18.978366+0000","last_unstale":"2023-05-10T01:26:18.982326+0000","last_undegraded":"2023-05-10T01:26:18.982326+0000","last_fullsized":"2023-05-10T01:26:18.982326+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961008+0000","last_change":"2023-05-10T01:26:18.572168+0000","last_active":"2023-05-10T01:26:18.961008+0000","last_peered":"2023-05-10T01:26:18.961008+0000","last_clean":"2023-05-10T01:26:18.961008+0000","last_became_active":"2023-05-10T01:26:18.571872+0000","last_became_peered":"2023-05-10T01:26:18.571872+0000","last_unstale":"2023-05-10T01:26:18.961008+0000","last_undegraded":"2023-05-10T01:26:18.961008+0000","last_fullsized":"2023-05-10T01:26:18.961008+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972109+0000","last_change":"2023-05-10T01:26:18.968772+0000","last_active":"2023-05-10T01:26:18.972109+0000","last_peered":"2023-05-10T01:26:18.972109+0000","last_clean":"2023-05-10T01:26:18.972109+0000","last_became_active":"2023-05-10T01:26:18.967819+0000","last_became_peered":"2023-05-10T01:26:18.967819+0000","last_unstale":"2023-05-10T01:26:18.972109+0000","last_undegraded":"2023-05-10T01:26:18.972109+0000","last_fullsized":"2023-05-10T01:26:18.972109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980075+0000","last_change":"2023-05-10T01:26:18.569425+0000","last_active":"2023-05-10T01:26:18.980075+0000","last_peered":"2023-05-10T01:26:18.980075+0000","last_clean":"2023-05-10T01:26:18.980075+0000","last_became_active":"2023-05-10T01:26:18.569075+0000","last_became_peered":"2023-05-10T01:26:18.569075+0000","last_unstale":"2023-05-10T01:26:18.980075+0000","last_undegraded":"2023-05-10T01:26:18.980075+0000","last_fullsized":"2023-05-10T01:26:18.980075+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961234+0000","last_change":"2023-05-10T01:26:18.959040+0000","last_active":"2023-05-10T01:26:18.961234+0000","last_peered":"2023-05-10T01:26:18.961234+0000","last_clean":"2023-05-10T01:26:18.961234+0000","last_became_active":"2023-05-10T01:26:18.958767+0000","last_became_peered":"2023-05-10T01:26:18.958767+0000","last_unstale":"2023-05-10T01:26:18.961234+0000","last_undegraded":"2023-05-10T01:26:18.961234+0000","last_fullsized":"2023-05-10T01:26:18.961234+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963744+0000","last_change":"2023-05-10T01:26:18.580476+0000","last_active":"2023-05-10T01:26:18.963744+0000","last_peered":"2023-05-10T01:26:18.963744+0000","last_clean":"2023-05-10T01:26:18.963744+0000","last_became_active":"2023-05-10T01:26:18.580007+0000","last_became_peered":"2023-05-10T01:26:18.580007+0000","last_unstale":"2023-05-10T01:26:18.963744+0000","last_undegraded":"2023-05-10T01:26:18.963744+0000","last_fullsized":"2023-05-10T01:26:18.963744+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.980228+0000","last_change":"2023-05-10T01:26:18.975016+0000","last_active":"2023-05-10T01:26:18.980228+0000","last_peered":"2023-05-10T01:26:18.980228+0000","last_clean":"2023-05-10T01:26:18.980228+0000","last_became_active":"2023-05-10T01:26:18.974745+0000","last_became_peered":"2023-05-10T01:26:18.974745+0000","last_unstale":"2023-05-10T01:26:18.980228+0000","last_undegraded":"2023-05-10T01:26:18.980228+0000","last_fullsized":"2023-05-10T01:26:18.980228+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.950970+0000","last_change":"2023-05-10T01:26:18.560982+0000","last_active":"2023-05-10T01:26:18.950970+0000","last_peered":"2023-05-10T01:26:18.950970+0000","last_clean":"2023-05-10T01:26:18.950970+0000","last_became_active":"2023-05-10T01:26:18.560649+0000","last_became_peered":"2023-05-10T01:26:18.560649+0000","last_unstale":"2023-05-10T01:26:18.950970+0000","last_undegraded":"2023-05-10T01:26:18.950970+0000","last_fullsized":"2023-05-10T01:26:18.950970+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.977733+0000","last_change":"2023-05-10T01:26:18.976890+0000","last_active":"2023-05-10T01:26:18.977733+0000","last_peered":"2023-05-10T01:26:18.977733+0000","last_clean":"2023-05-10T01:26:18.977733+0000","last_became_active":"2023-05-10T01:26:18.976638+0000","last_became_peered":"2023-05-10T01:26:18.976638+0000","last_unstale":"2023-05-10T01:26:18.977733+0000","last_undegraded":"2023-05-10T01:26:18.977733+0000","last_fullsized":"2023-05-10T01:26:18.977733+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971866+0000","last_change":"2023-05-10T01:26:18.575580+0000","last_active":"2023-05-10T01:26:18.971866+0000","last_peered":"2023-05-10T01:26:18.971866+0000","last_clean":"2023-05-10T01:26:18.971866+0000","last_became_active":"2023-05-10T01:26:18.575249+0000","last_became_peered":"2023-05-10T01:26:18.575249+0000","last_unstale":"2023-05-10T01:26:18.971866+0000","last_undegraded":"2023-05-10T01:26:18.971866+0000","last_fullsized":"2023-05-10T01:26:18.971866+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.979702+0000","last_change":"2023-05-10T01:26:18.977320+0000","last_active":"2023-05-10T01:26:18.979702+0000","last_peered":"2023-05-10T01:26:18.979702+0000","last_clean":"2023-05-10T01:26:18.979702+0000","last_became_active":"2023-05-10T01:26:18.968364+0000","last_became_peered":"2023-05-10T01:26:18.968364+0000","last_unstale":"2023-05-10T01:26:18.979702+0000","last_undegraded":"2023-05-10T01:26:18.979702+0000","last_fullsized":"2023-05-10T01:26:18.979702+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.953969+0000","last_change":"2023-05-10T01:26:18.572138+0000","last_active":"2023-05-10T01:26:18.953969+0000","last_peered":"2023-05-10T01:26:18.953969+0000","last_clean":"2023-05-10T01:26:18.953969+0000","last_became_active":"2023-05-10T01:26:18.569386+0000","last_became_peered":"2023-05-10T01:26:18.569386+0000","last_unstale":"2023-05-10T01:26:18.953969+0000","last_undegraded":"2023-05-10T01:26:18.953969+0000","last_fullsized":"2023-05-10T01:26:18.953969+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972925+0000","last_change":"2023-05-10T01:26:18.970193+0000","last_active":"2023-05-10T01:26:18.972925+0000","last_peered":"2023-05-10T01:26:18.972925+0000","last_clean":"2023-05-10T01:26:18.972925+0000","last_became_active":"2023-05-10T01:26:18.969884+0000","last_became_peered":"2023-05-10T01:26:18.969884+0000","last_unstale":"2023-05-10T01:26:18.972925+0000","last_undegraded":"2023-05-10T01:26:18.972925+0000","last_fullsized":"2023-05-10T01:26:18.972925+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968737+0000","last_change":"2023-05-10T01:26:18.569725+0000","last_active":"2023-05-10T01:26:18.968737+0000","last_peered":"2023-05-10T01:26:18.968737+0000","last_clean":"2023-05-10T01:26:18.968737+0000","last_became_active":"2023-05-10T01:26:18.569433+0000","last_became_peered":"2023-05-10T01:26:18.569433+0000","last_unstale":"2023-05-10T01:26:18.968737+0000","last_undegraded":"2023-05-10T01:26:18.968737+0000","last_fullsized":"2023-05-10T01:26:18.968737+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972865+0000","last_change":"2023-05-10T01:26:18.971705+0000","last_active":"2023-05-10T01:26:18.972865+0000","last_peered":"2023-05-10T01:26:18.972865+0000","last_clean":"2023-05-10T01:26:18.972865+0000","last_became_active":"2023-05-10T01:26:18.969722+0000","last_became_peered":"2023-05-10T01:26:18.969722+0000","last_unstale":"2023-05-10T01:26:18.972865+0000","last_undegraded":"2023-05-10T01:26:18.972865+0000","last_fullsized":"2023-05-10T01:26:18.972865+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962270+0000","last_change":"2023-05-10T01:26:18.576060+0000","last_active":"2023-05-10T01:26:18.962270+0000","last_peered":"2023-05-10T01:26:18.962270+0000","last_clean":"2023-05-10T01:26:18.962270+0000","last_became_active":"2023-05-10T01:26:18.575751+0000","last_became_peered":"2023-05-10T01:26:18.575751+0000","last_unstale":"2023-05-10T01:26:18.962270+0000","last_undegraded":"2023-05-10T01:26:18.962270+0000","last_fullsized":"2023-05-10T01:26:18.962270+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982579+0000","last_change":"2023-05-10T01:26:18.975933+0000","last_active":"2023-05-10T01:26:18.982579+0000","last_peered":"2023-05-10T01:26:18.982579+0000","last_clean":"2023-05-10T01:26:18.982579+0000","last_became_active":"2023-05-10T01:26:18.975668+0000","last_became_peered":"2023-05-10T01:26:18.975668+0000","last_unstale":"2023-05-10T01:26:18.982579+0000","last_undegraded":"2023-05-10T01:26:18.982579+0000","last_fullsized":"2023-05-10T01:26:18.982579+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970841+0000","last_change":"2023-05-10T01:26:18.578645+0000","last_active":"2023-05-10T01:26:18.970841+0000","last_peered":"2023-05-10T01:26:18.970841+0000","last_clean":"2023-05-10T01:26:18.970841+0000","last_became_active":"2023-05-10T01:26:18.578350+0000","last_became_peered":"2023-05-10T01:26:18.578350+0000","last_unstale":"2023-05-10T01:26:18.970841+0000","last_undegraded":"2023-05-10T01:26:18.970841+0000","last_fullsized":"2023-05-10T01:26:18.970841+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.975930+0000","last_change":"2023-05-10T01:26:18.971661+0000","last_active":"2023-05-10T01:26:18.975930+0000","last_peered":"2023-05-10T01:26:18.975930+0000","last_clean":"2023-05-10T01:26:18.975930+0000","last_became_active":"2023-05-10T01:26:18.971078+0000","last_became_peered":"2023-05-10T01:26:18.971078+0000","last_unstale":"2023-05-10T01:26:18.975930+0000","last_undegraded":"2023-05-10T01:26:18.975930+0000","last_fullsized":"2023-05-10T01:26:18.975930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960417+0000","last_change":"2023-05-10T01:26:18.580160+0000","last_active":"2023-05-10T01:26:18.960417+0000","last_peered":"2023-05-10T01:26:18.960417+0000","last_clean":"2023-05-10T01:26:18.960417+0000","last_became_active":"2023-05-10T01:26:18.576910+0000","last_became_peered":"2023-05-10T01:26:18.576910+0000","last_unstale":"2023-05-10T01:26:18.960417+0000","last_undegraded":"2023-05-10T01:26:18.960417+0000","last_fullsized":"2023-05-10T01:26:18.960417+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.982521+0000","last_change":"2023-05-10T01:26:18.981668+0000","last_active":"2023-05-10T01:26:18.982521+0000","last_peered":"2023-05-10T01:26:18.982521+0000","last_clean":"2023-05-10T01:26:18.982521+0000","last_became_active":"2023-05-10T01:26:18.981394+0000","last_became_peered":"2023-05-10T01:26:18.981394+0000","last_unstale":"2023-05-10T01:26:18.982521+0000","last_undegraded":"2023-05-10T01:26:18.982521+0000","last_fullsized":"2023-05-10T01:26:18.982521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970750+0000","last_change":"2023-05-10T01:26:18.569768+0000","last_active":"2023-05-10T01:26:18.970750+0000","last_peered":"2023-05-10T01:26:18.970750+0000","last_clean":"2023-05-10T01:26:18.970750+0000","last_became_active":"2023-05-10T01:26:18.569436+0000","last_became_peered":"2023-05-10T01:26:18.569436+0000","last_unstale":"2023-05-10T01:26:18.970750+0000","last_undegraded":"2023-05-10T01:26:18.970750+0000","last_fullsized":"2023-05-10T01:26:18.970750+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.954048+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:18.954048+0000","last_peered":"2023-05-10T01:26:18.954048+0000","last_clean":"2023-05-10T01:26:18.954048+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:18.954048+0000","last_undegraded":"2023-05-10T01:26:18.954048+0000","last_fullsized":"2023-05-10T01:26:18.954048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.969958+0000","last_change":"2023-05-10T01:26:18.964991+0000","last_active":"2023-05-10T01:26:18.969958+0000","last_peered":"2023-05-10T01:26:18.969958+0000","last_clean":"2023-05-10T01:26:18.969958+0000","last_became_active":"2023-05-10T01:26:18.964688+0000","last_became_peered":"2023-05-10T01:26:18.964688+0000","last_unstale":"2023-05-10T01:26:18.969958+0000","last_undegraded":"2023-05-10T01:26:18.969958+0000","last_fullsized":"2023-05-10T01:26:18.969958+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.984331+0000","last_change":"2023-05-10T01:26:18.575263+0000","last_active":"2023-05-10T01:26:18.984331+0000","last_peered":"2023-05-10T01:26:18.984331+0000","last_clean":"2023-05-10T01:26:18.984331+0000","last_became_active":"2023-05-10T01:26:18.574988+0000","last_became_peered":"2023-05-10T01:26:18.574988+0000","last_unstale":"2023-05-10T01:26:18.984331+0000","last_undegraded":"2023-05-10T01:26:18.984331+0000","last_fullsized":"2023-05-10T01:26:18.984331+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961951+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:18.961951+0000","last_peered":"2023-05-10T01:26:18.961951+0000","last_clean":"2023-05-10T01:26:18.961951+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:18.961951+0000","last_undegraded":"2023-05-10T01:26:18.961951+0000","last_fullsized":"2023-05-10T01:26:18.961951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968295+0000","last_change":"2023-05-10T01:26:18.964989+0000","last_active":"2023-05-10T01:26:18.968295+0000","last_peered":"2023-05-10T01:26:18.968295+0000","last_clean":"2023-05-10T01:26:18.968295+0000","last_became_active":"2023-05-10T01:26:18.964712+0000","last_became_peered":"2023-05-10T01:26:18.964712+0000","last_unstale":"2023-05-10T01:26:18.968295+0000","last_undegraded":"2023-05-10T01:26:18.968295+0000","last_fullsized":"2023-05-10T01:26:18.968295+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961619+0000","last_change":"2023-05-10T01:26:18.569662+0000","last_active":"2023-05-10T01:26:18.961619+0000","last_peered":"2023-05-10T01:26:18.961619+0000","last_clean":"2023-05-10T01:26:18.961619+0000","last_became_active":"2023-05-10T01:26:18.569358+0000","last_became_peered":"2023-05-10T01:26:18.569358+0000","last_unstale":"2023-05-10T01:26:18.961619+0000","last_undegraded":"2023-05-10T01:26:18.961619+0000","last_fullsized":"2023-05-10T01:26:18.961619+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.961120+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:18.961120+0000","last_peered":"2023-05-10T01:26:18.961120+0000","last_clean":"2023-05-10T01:26:18.961120+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:18.961120+0000","last_undegraded":"2023-05-10T01:26:18.961120+0000","last_fullsized":"2023-05-10T01:26:18.961120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972323+0000","last_change":"2023-05-10T01:26:18.964995+0000","last_active":"2023-05-10T01:26:18.972323+0000","last_peered":"2023-05-10T01:26:18.972323+0000","last_clean":"2023-05-10T01:26:18.972323+0000","last_became_active":"2023-05-10T01:26:18.964677+0000","last_became_peered":"2023-05-10T01:26:18.964677+0000","last_unstale":"2023-05-10T01:26:18.972323+0000","last_undegraded":"2023-05-10T01:26:18.972323+0000","last_fullsized":"2023-05-10T01:26:18.972323+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.971607+0000","last_change":"2023-05-10T01:26:18.575798+0000","last_active":"2023-05-10T01:26:18.971607+0000","last_peered":"2023-05-10T01:26:18.971607+0000","last_clean":"2023-05-10T01:26:18.971607+0000","last_became_active":"2023-05-10T01:26:18.574943+0000","last_became_peered":"2023-05-10T01:26:18.574943+0000","last_unstale":"2023-05-10T01:26:18.971607+0000","last_undegraded":"2023-05-10T01:26:18.971607+0000","last_fullsized":"2023-05-10T01:26:18.971607+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960821+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:18.960821+0000","last_peered":"2023-05-10T01:26:18.960821+0000","last_clean":"2023-05-10T01:26:18.960821+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:18.960821+0000","last_undegraded":"2023-05-10T01:26:18.960821+0000","last_fullsized":"2023-05-10T01:26:18.960821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963621+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:18.963621+0000","last_peered":"2023-05-10T01:26:18.963621+0000","last_clean":"2023-05-10T01:26:18.963621+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:18.963621+0000","last_undegraded":"2023-05-10T01:26:18.963621+0000","last_fullsized":"2023-05-10T01:26:18.963621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.983903+0000","last_change":"2023-05-10T01:26:18.976078+0000","last_active":"2023-05-10T01:26:18.983903+0000","last_peered":"2023-05-10T01:26:18.983903+0000","last_clean":"2023-05-10T01:26:18.983903+0000","last_became_active":"2023-05-10T01:26:18.975740+0000","last_became_peered":"2023-05-10T01:26:18.975740+0000","last_unstale":"2023-05-10T01:26:18.983903+0000","last_undegraded":"2023-05-10T01:26:18.983903+0000","last_fullsized":"2023-05-10T01:26:18.983903+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965340+0000","last_change":"2023-05-10T01:26:18.570758+0000","last_active":"2023-05-10T01:26:18.965340+0000","last_peered":"2023-05-10T01:26:18.965340+0000","last_clean":"2023-05-10T01:26:18.965340+0000","last_became_active":"2023-05-10T01:26:18.570490+0000","last_became_peered":"2023-05-10T01:26:18.570490+0000","last_unstale":"2023-05-10T01:26:18.965340+0000","last_undegraded":"2023-05-10T01:26:18.965340+0000","last_fullsized":"2023-05-10T01:26:18.965340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.963710+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:18.963710+0000","last_peered":"2023-05-10T01:26:18.963710+0000","last_clean":"2023-05-10T01:26:18.963710+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:18.963710+0000","last_undegraded":"2023-05-10T01:26:18.963710+0000","last_fullsized":"2023-05-10T01:26:18.963710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972898+0000","last_change":"2023-05-10T01:26:18.971829+0000","last_active":"2023-05-10T01:26:18.972898+0000","last_peered":"2023-05-10T01:26:18.972898+0000","last_clean":"2023-05-10T01:26:18.972898+0000","last_became_active":"2023-05-10T01:26:18.970007+0000","last_became_peered":"2023-05-10T01:26:18.970007+0000","last_unstale":"2023-05-10T01:26:18.972898+0000","last_undegraded":"2023-05-10T01:26:18.972898+0000","last_fullsized":"2023-05-10T01:26:18.972898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.960315+0000","last_change":"2023-05-10T01:26:18.578122+0000","last_active":"2023-05-10T01:26:18.960315+0000","last_peered":"2023-05-10T01:26:18.960315+0000","last_clean":"2023-05-10T01:26:18.960315+0000","last_became_active":"2023-05-10T01:26:18.577601+0000","last_became_peered":"2023-05-10T01:26:18.577601+0000","last_unstale":"2023-05-10T01:26:18.960315+0000","last_undegraded":"2023-05-10T01:26:18.960315+0000","last_fullsized":"2023-05-10T01:26:18.960315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.965511+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:18.965511+0000","last_peered":"2023-05-10T01:26:18.965511+0000","last_clean":"2023-05-10T01:26:18.965511+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:18.965511+0000","last_undegraded":"2023-05-10T01:26:18.965511+0000","last_fullsized":"2023-05-10T01:26:18.965511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962342+0000","last_change":"2023-05-10T01:26:18.959675+0000","last_active":"2023-05-10T01:26:18.962342+0000","last_peered":"2023-05-10T01:26:18.962342+0000","last_clean":"2023-05-10T01:26:18.962342+0000","last_became_active":"2023-05-10T01:26:18.958898+0000","last_became_peered":"2023-05-10T01:26:18.958898+0000","last_unstale":"2023-05-10T01:26:18.962342+0000","last_undegraded":"2023-05-10T01:26:18.962342+0000","last_fullsized":"2023-05-10T01:26:18.962342+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.972813+0000","last_change":"2023-05-10T01:26:18.574188+0000","last_active":"2023-05-10T01:26:18.972813+0000","last_peered":"2023-05-10T01:26:18.972813+0000","last_clean":"2023-05-10T01:26:18.972813+0000","last_became_active":"2023-05-10T01:26:18.573881+0000","last_became_peered":"2023-05-10T01:26:18.573881+0000","last_unstale":"2023-05-10T01:26:18.972813+0000","last_undegraded":"2023-05-10T01:26:18.972813+0000","last_fullsized":"2023-05-10T01:26:18.972813+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.957192+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:18.957192+0000","last_peered":"2023-05-10T01:26:18.957192+0000","last_clean":"2023-05-10T01:26:18.957192+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:18.957192+0000","last_undegraded":"2023-05-10T01:26:18.957192+0000","last_fullsized":"2023-05-10T01:26:18.957192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.968989+0000","last_change":"2023-05-10T01:26:18.965607+0000","last_active":"2023-05-10T01:26:18.968989+0000","last_peered":"2023-05-10T01:26:18.968989+0000","last_clean":"2023-05-10T01:26:18.968989+0000","last_became_active":"2023-05-10T01:26:18.965326+0000","last_became_peered":"2023-05-10T01:26:18.965326+0000","last_unstale":"2023-05-10T01:26:18.968989+0000","last_undegraded":"2023-05-10T01:26:18.968989+0000","last_fullsized":"2023-05-10T01:26:18.968989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:18.540496+0000","last_clean_scrub_stamp":"2023-05-10T01:26:18.540496+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.962238+0000","last_change":"2023-05-10T01:26:18.578734+0000","last_active":"2023-05-10T01:26:18.962238+0000","last_peered":"2023-05-10T01:26:18.962238+0000","last_clean":"2023-05-10T01:26:18.962238+0000","last_became_active":"2023-05-10T01:26:18.577120+0000","last_became_peered":"2023-05-10T01:26:18.577120+0000","last_unstale":"2023-05-10T01:26:18.962238+0000","last_undegraded":"2023-05-10T01:26:18.962238+0000","last_fullsized":"2023-05-10T01:26:18.962238+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:17.538046+0000","last_clean_scrub_stamp":"2023-05-10T01:26:17.538046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-05-10T01:26:18.970423+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:18.970423+0000","last_peered":"2023-05-10T01:26:18.970423+0000","last_clean":"2023-05-10T01:26:18.970423+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:18.970423+0000","last_undegraded":"2023-05-10T01:26:18.970423+0000","last_fullsized":"2023-05-10T01:26:18.970423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18508,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353332,"statfs":{"total":96636764160,"available":96617811968,"internally_reserved":0,"allocated":1511424,"data_stored":766416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.378},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18068,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353772,"statfs":{"total":96636764160,"available":96618262528,"internally_reserved":0,"allocated":1519616,"data_stored":766992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.80000000000000004}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.747}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22104,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94349736,"statfs":{"total":96636764160,"available":96614129664,"internally_reserved":0,"allocated":1523712,"data_stored":767876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.40699999999999997}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.374}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17684,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354156,"statfs":{"total":96636764160,"available":96618655744,"internally_reserved":0,"allocated":1519616,"data_stored":767060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.748}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23184,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348656,"statfs":{"total":96636764160,"available":96613023744,"internally_reserved":0,"allocated":1515520,"data_stored":766430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.497}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.745},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82799999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.84599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26056,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":24576,"kb_avail":94345784,"statfs":{"total":96636764160,"available":96610082816,"internally_reserved":0,"allocated":1507328,"data_stored":766326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25165824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.39400000000000002},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.439,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.57399999999999995}]},{"osd":1,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.26300000000000001},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.496}]},{"osd":4,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed May 10 01:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.746}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18320,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353520,"statfs":{"total":96636764160,"available":96618004480,"internally_reserved":0,"allocated":1515520,"data_stored":767240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.62},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.629}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.432},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575045,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21452,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":19968,"kb_avail":94350388,"statfs":{"total":96636764160,"available":96614797312,"internally_reserved":0,"allocated":1511424,"data_stored":766880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20447232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.39700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66300000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:26:27.817 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:26:27.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:26:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.967+0000 7fb922a1e700 1 Processor -- start 2023-05-10T01:26:27.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.968+0000 7fb922a1e700 1 -- start start 2023-05-10T01:26:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.968+0000 7fb922a1e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb91c0686f0 0x7fb91c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.968+0000 7fb922a1e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c0c2280 con 0x7fb91c1501b0 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.968+0000 7fb922a1e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c065580 con 0x7fb91c150590 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.968+0000 7fb922a1e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c0c7510 con 0x7fb91c0686f0 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb91c0686f0 0x7fb91c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb921a1c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb91c1501b0 0x7fb91c064d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47546/0 (socket says 172.21.15.52:47546) 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb91c0686f0 0x7fb91c0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38532/0 (socket says 172.21.15.52:38532) 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb921a1c700 1 -- 172.21.15.52:0/2530007382 learned_addr learned my addr 172.21.15.52:0/2530007382 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:27.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 -- 172.21.15.52:0/2530007382 >> v1:172.21.15.172:6789/0 conn(0x7fb91c150590 legacy=0x7fb91c0c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 -- 172.21.15.52:0/2530007382 >> v1:172.21.15.52:6789/0 conn(0x7fb91c1501b0 legacy=0x7fb91c064d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb920a1a700 1 -- 172.21.15.52:0/2530007382 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867638787 0 0) 0x7fb91c0c2280 con 0x7fb91c1501b0 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 -- 172.21.15.52:0/2530007382 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0c1950 con 0x7fb91c0686f0 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb92121b700 1 --2- 172.21.15.52:0/2530007382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c0686f0 0x7fb91c0c45f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb910009760 tx=0x7fb910009060).ready entity=mon.0 client_cookie=7c310a207e5d5687 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb920a1a700 1 -- 172.21.15.52:0/2530007382 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000b520 con 0x7fb91c0686f0 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb920a1a700 1 -- 172.21.15.52:0/2530007382 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000b680 con 0x7fb91c0686f0 2023-05-10T01:26:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.969+0000 7fb920a1a700 1 -- 172.21.15.52:0/2530007382 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000ba00 con 0x7fb91c0686f0 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 -- 172.21.15.52:0/2530007382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c0686f0 msgr2=0x7fb91c0c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 --2- 172.21.15.52:0/2530007382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c0686f0 0x7fb91c0c45f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7fb910009760 tx=0x7fb910009060).stop 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 -- 172.21.15.52:0/2530007382 shutdown_connections 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 --2- 172.21.15.52:0/2530007382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c0686f0 0x7fb91c0c45f0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 -- 172.21.15.52:0/2530007382 >> 172.21.15.52:0/2530007382 conn(0x7fb91c067910 msgr2=0x7fb91c0c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 -- 172.21.15.52:0/2530007382 shutdown_connections 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.970+0000 7fb922a1e700 1 -- 172.21.15.52:0/2530007382 wait complete. 2023-05-10T01:26:27.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.971+0000 7fb922a1e700 1 Processor -- start 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.971+0000 7fb922a1e700 1 -- start start 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 0x7fb91c149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 0x7fb91c0a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0aae80 con 0x7fb91c1501b0 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0ab310 con 0x7fb91c150590 2023-05-10T01:26:27.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0aa270 con 0x7fb91c0686f0 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38538/0 (socket says 172.21.15.52:38538) 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 -- 172.21.15.52:0/175649949 learned_addr learned my addr 172.21.15.52:0/175649949 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb921a1c700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 0x7fb91c149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 -- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 msgr2=0x7fb91c149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92221d700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 0x7fb91c0a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 0x7fb91c149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 -- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 msgr2=0x7fb91c0a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 0x7fb91c0a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 -- 172.21.15.52:0/175649949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100092a0 con 0x7fb91c1501b0 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb921a1c700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 0x7fb91c149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92221d700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 0x7fb91c0a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb92121b700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fb910009eb0 tx=0x7fb910017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000b7f0 con 0x7fb91c1501b0 2023-05-10T01:26:27.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000b950 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c0aa550 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91001b690 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.972+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c0aab10 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.973+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c047150 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.974+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb91002a070 con 0x7fb91c1501b0 2023-05-10T01:26:27.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.974+0000 7fb919ffb700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 0x7fb8fc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:27.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.974+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb91007b3f0 con 0x7fb91c1501b0 2023-05-10T01:26:27.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.974+0000 7fb921a1c700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 0x7fb8fc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:27.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.975+0000 7fb921a1c700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 0x7fb8fc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb914000c00 tx=0x7fb914009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:27.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:27.978+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb91004c880 con 0x7fb91c1501b0 2023-05-10T01:26:28.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.215+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb91c0c1c30 con 0x7fb91c1501b0 2023-05-10T01:26:28.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.218+0000 7fb919ffb700 1 -- 172.21.15.52:0/175649949 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb9100280e0 con 0x7fb91c1501b0 2023-05-10T01:26:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 msgr2=0x7fb8fc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 0x7fb8fc061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb914000c00 tx=0x7fb914009040).stop 2023-05-10T01:26:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 msgr2=0x7fb91c0a97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fb910009eb0 tx=0x7fb910017000).stop 2023-05-10T01:26:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 shutdown_connections 2023-05-10T01:26:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8fc05ed90 0x7fb8fc061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91c150590 0x7fb91c0a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb91c0686f0 0x7fb91c149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 --2- 172.21.15.52:0/175649949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91c1501b0 0x7fb91c0a97d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 >> 172.21.15.52:0/175649949 conn(0x7fb91c067910 msgr2=0x7fb91c0bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:28.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 shutdown_connections 2023-05-10T01:26:28.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.220+0000 7fb922a1e700 1 -- 172.21.15.52:0/175649949 wait complete. 2023-05-10T01:26:28.227 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:26:28.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.349+0000 7f56a5468700 1 Processor -- start 2023-05-10T01:26:28.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.349+0000 7f56a5468700 1 -- start start 2023-05-10T01:26:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a5468700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a00ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a5468700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a0158960 con 0x7f56a00c7370 2023-05-10T01:26:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a5468700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a01552f0 con 0x7f56a0154e40 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a5468700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0157d50 con 0x7f56a00c1090 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f56a00c7370 0x7f56a00c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47560/0 (socket says 172.21.15.52:47560) 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569ffff700 1 -- 172.21.15.52:0/1448341954 learned_addr learned my addr 172.21.15.52:0/1448341954 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a4c67700 1 --2- 172.21.15.52:0/1448341954 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a00ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004554818 0 0) 0x7f56a0158960 con 0x7f56a00c7370 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c0033f0 con 0x7f56a00c7370 2023-05-10T01:26:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250227714 0 0) 0x7f56a01552f0 con 0x7f56a0154e40 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a0158960 con 0x7f56a0154e40 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a4c67700 1 -- 172.21.15.52:0/1448341954 >> v1:172.21.15.172:6789/0 conn(0x7f56a0154e40 legacy=0x7f56a00acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183082691 0 0) 0x7f568c0033f0 con 0x7f56a00c7370 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a4c67700 1 -- 172.21.15.52:0/1448341954 >> v1:172.21.15.52:6789/0 conn(0x7f56a00c7370 legacy=0x7f56a00c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.350+0000 7f56a4c67700 1 -- 172.21.15.52:0/1448341954 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0158030 con 0x7f56a00c1090 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a4c67700 1 --2- 172.21.15.52:0/1448341954 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a00ad250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5698009e90 tx=0x7f5698009780).ready entity=mon.2 client_cookie=59b31817131a1e41 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800e070 con 0x7f56a00c1090 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800b7a0 con 0x7f56a00c1090 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f569effd700 1 -- 172.21.15.52:0/1448341954 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690001470 con 0x7f56a00c1090 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 -- 172.21.15.52:0/1448341954 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 msgr2=0x7f56a00ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 --2- 172.21.15.52:0/1448341954 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a00ad250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5698009e90 tx=0x7f5698009780).stop 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 -- 172.21.15.52:0/1448341954 shutdown_connections 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 --2- 172.21.15.52:0/1448341954 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a00ad250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 -- 172.21.15.52:0/1448341954 >> 172.21.15.52:0/1448341954 conn(0x7f56a0068320 msgr2=0x7f56a0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 -- 172.21.15.52:0/1448341954 shutdown_connections 2023-05-10T01:26:28.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.351+0000 7f56a5468700 1 -- 172.21.15.52:0/1448341954 wait complete. 2023-05-10T01:26:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.352+0000 7f56a5468700 1 Processor -- start 2023-05-10T01:26:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 -- start start 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a014f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 0x7f56a0157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c34a0 con 0x7f56a00c7370 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c9e10 con 0x7f56a0154e40 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f56a5468700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a014fa40 con 0x7f56a00c1090 2023-05-10T01:26:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f569f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f569f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38552/0 (socket says 172.21.15.52:38552) 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.353+0000 7f569f7fe700 1 -- 172.21.15.52:0/657332 learned_addr learned my addr 172.21.15.52:0/657332 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f56a4c67700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 0x7f56a0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569ffff700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a014f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 -- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 msgr2=0x7f56a014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a014f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 -- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 msgr2=0x7f56a0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 0x7f56a0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 -- 172.21.15.52:0/657332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698009a20 con 0x7f56a00c7370 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f56a4c67700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 0x7f56a0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569ffff700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f569f7fe700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f569400c440 tx=0x7f5694007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400f470 con 0x7f56a00c7370 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400f5d0 con 0x7f56a00c7370 2023-05-10T01:26:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400f990 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00c31c0 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.354+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00ca390 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.355+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a0047150 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.355+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5694019030 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.356+0000 7f5687fff700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 0x7f5680061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.356+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f5694079040 con 0x7f56a00c7370 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.356+0000 7f569ffff700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 0x7f5680061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:28.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.357+0000 7f569ffff700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 0x7f5680061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5690000c00 tx=0x7f5690009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.360+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f569404a4d0 con 0x7f56a00c7370 2023-05-10T01:26:28.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.575+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56a00666b0 con 0x7f56a00c7370 2023-05-10T01:26:28.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.575+0000 7f5687fff700 1 -- 172.21.15.52:0/657332 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f569404daf0 con 0x7f56a00c7370 2023-05-10T01:26:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:28.580 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:28.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 msgr2=0x7f5680061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 0x7f5680061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5690000c00 tx=0x7f5690009040).stop 2023-05-10T01:26:28.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 msgr2=0x7f56a00c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:28.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f569400c440 tx=0x7f5694007c90).stop 2023-05-10T01:26:28.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 shutdown_connections 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f568005ed90 0x7f5680061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0154e40 0x7f56a0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56a00c1090 0x7f56a014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 --2- 172.21.15.52:0/657332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a00c7370 0x7f56a00c2810 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 >> 172.21.15.52:0/657332 conn(0x7f56a0068320 msgr2=0x7f56a0152010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 shutdown_connections 2023-05-10T01:26:28.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:28.577+0000 7f56a5468700 1 -- 172.21.15.52:0/657332 wait complete. 2023-05-10T01:26:28.583 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:28.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:26:18.947322+0000', 'modified': '2023-05-10T01:26:21.960062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7620': {'gid': 7620, 'name': 'd', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3128322162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6835', 'nonce': 3128322162}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3128322162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:26:28.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:26:28.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-10T01:26:29.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.113+0000 7f71ae744700 1 Processor -- start 2023-05-10T01:26:29.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.113+0000 7f71ae744700 1 -- start start 2023-05-10T01:26:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71ae744700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71a813b920 0x7f71a80c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71ae744700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80bdc20 con 0x7f71a813b540 2023-05-10T01:26:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71ae744700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80c4e30 con 0x7f71a8063e20 2023-05-10T01:26:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71ae744700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a80c53f0 con 0x7f71a813b920 2023-05-10T01:26:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71a7fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f71a813b540 0x7f71a8063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47574/0 (socket says 172.21.15.52:47574) 2023-05-10T01:26:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71a7fff700 1 -- 172.21.15.52:0/2751117207 learned_addr learned my addr 172.21.15.52:0/2751117207 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.114+0000 7f71acce1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71a813b920 0x7f71a80c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71a6ffd700 1 -- 172.21.15.52:0/2751117207 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371963303 0 0) 0x7f71a80bdc20 con 0x7f71a813b540 2023-05-10T01:26:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71a6ffd700 1 -- 172.21.15.52:0/2751117207 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71940033f0 con 0x7f71a813b540 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71acce1700 1 -- 172.21.15.52:0/2751117207 >> v1:172.21.15.172:6789/0 conn(0x7f71a8063e20 legacy=0x7f71a80be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71acce1700 1 -- 172.21.15.52:0/2751117207 >> v1:172.21.15.52:6789/0 conn(0x7f71a813b540 legacy=0x7f71a8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71acce1700 1 -- 172.21.15.52:0/2751117207 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80c5110 con 0x7f71a813b920 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71acce1700 1 --2- 172.21.15.52:0/2751117207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b920 0x7f71a80c31e0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f71a0009e60 tx=0x7f71a0009780).ready entity=mon.0 client_cookie=f00a3f96a1842d5c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71a6ffd700 1 -- 172.21.15.52:0/2751117207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000e070 con 0x7f71a813b920 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71a6ffd700 1 -- 172.21.15.52:0/2751117207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000bb60 con 0x7f71a813b920 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71a6ffd700 1 -- 172.21.15.52:0/2751117207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0012410 con 0x7f71a813b920 2023-05-10T01:26:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71ae744700 1 -- 172.21.15.52:0/2751117207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b920 msgr2=0x7f71a80c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71ae744700 1 --2- 172.21.15.52:0/2751117207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b920 0x7f71a80c31e0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f71a0009e60 tx=0x7f71a0009780).stop 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71ae744700 1 -- 172.21.15.52:0/2751117207 shutdown_connections 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71ae744700 1 --2- 172.21.15.52:0/2751117207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b920 0x7f71a80c31e0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.115+0000 7f71ae744700 1 -- 172.21.15.52:0/2751117207 >> 172.21.15.52:0/2751117207 conn(0x7f71a80c8a90 msgr2=0x7f71a80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.116+0000 7f71ae744700 1 -- 172.21.15.52:0/2751117207 shutdown_connections 2023-05-10T01:26:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.116+0000 7f71ae744700 1 -- 172.21.15.52:0/2751117207 wait complete. 2023-05-10T01:26:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.117+0000 7f71ae744700 1 Processor -- start 2023-05-10T01:26:29.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.117+0000 7f71ae744700 1 -- start start 2023-05-10T01:26:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.117+0000 7f71ae744700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71a8063e20 0x7f71a8151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.117+0000 7f71ae744700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 0x7f71a80c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80685a0 con 0x7f71a813b540 2023-05-10T01:26:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80c6ed0 con 0x7f71a813b920 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80c71b0 con 0x7f71a8063e20 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38566/0 (socket says 172.21.15.52:38566) 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 -- 172.21.15.52:0/649179308 learned_addr learned my addr 172.21.15.52:0/649179308 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a7fff700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71a8063e20 0x7f71a8151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71acce1700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 0x7f71a80c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 -- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71a8063e20 msgr2=0x7f71a8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71a8063e20 0x7f71a8151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 -- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 msgr2=0x7f71a80c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 0x7f71a80c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 -- 172.21.15.52:0/649179308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0009a20 con 0x7f71a813b540 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71acce1700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 0x7f71a80c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71a77fe700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f719c00c490 tx=0x7f719c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f718ffff700 1 -- 172.21.15.52:0/649179308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00f470 con 0x7f71a813b540 2023-05-10T01:26:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f718ffff700 1 -- 172.21.15.52:0/649179308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00f5d0 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a8067f50 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f718ffff700 1 -- 172.21.15.52:0/649179308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00f950 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.118+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a80c5750 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.120+0000 7f718ffff700 1 -- 172.21.15.52:0/649179308 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f719c019030 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.120+0000 7f718ffff700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 0x7f7188061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.120+0000 7f718ffff700 1 -- 172.21.15.52:0/649179308 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f719c078f60 con 0x7f71a813b540 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.120+0000 7f71a7fff700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 0x7f7188061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.121+0000 7f71a7fff700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 0x7f7188061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7198005750 tx=0x7f7198009040).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.122+0000 7f71c00d6b80 1 Processor -- start 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.122+0000 7f71c00d6b80 1 -- start start 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b227ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b2251710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b221c5e0 con 0x55b4b22a0480 2023-05-10T01:26:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b21938a0 con 0x55b4b2257300 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4b21a8900 con 0x55b4b229b560 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38574/0 (socket says 172.21.15.52:38574) 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 -- 172.21.15.52:0/2109311757 learned_addr learned my addr 172.21.15.52:0/2109311757 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71acce1700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b2251710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a7fff700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b227ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 -- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 msgr2=0x55b4b227ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b227ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 -- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 msgr2=0x55b4b2251710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b2251710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 -- 172.21.15.52:0/2109311757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4b204b310 con 0x55b4b22a0480 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71acce1700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b2251710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.123+0000 7f71a77fe700 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f719c007fd0 tx=0x7f719c00f000).ready entity=mon.0 client_cookie=228f63735d573efd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f718d7fa700 1 -- 172.21.15.52:0/2109311757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c04c500 con 0x55b4b22a0480 2023-05-10T01:26:29.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f718d7fa700 1 -- 172.21.15.52:0/2109311757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00fd40 con 0x55b4b22a0480 2023-05-10T01:26:29.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f718d7fa700 1 -- 172.21.15.52:0/2109311757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c04d650 con 0x55b4b22a0480 2023-05-10T01:26:29.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 -- 172.21.15.52:0/2109311757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 msgr2=0x55b4b229b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f719c007fd0 tx=0x7f719c00f000).stop 2023-05-10T01:26:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 -- 172.21.15.52:0/2109311757 shutdown_connections 2023-05-10T01:26:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b2251710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b227ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/2109311757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229b940 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 -- 172.21.15.52:0/2109311757 >> 172.21.15.52:0/2109311757 conn(0x55b4b2013e40 msgr2=0x55b4b229f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 -- 172.21.15.52:0/2109311757 shutdown_connections 2023-05-10T01:26:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.124+0000 7f71c00d6b80 1 -- 172.21.15.52:0/2109311757 wait complete. 2023-05-10T01:26:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.125+0000 7f71c00d6b80 1 -- start start 2023-05-10T01:26:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.125+0000 7f71c00d6b80 1 Processor -- start 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b226bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b2284e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b216fed0 con 0x55b4b22a0480 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b2299750 con 0x55b4b2257300 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4b2285830 con 0x55b4b229b560 2023-05-10T01:26:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71c00d6b80 10 client.0 ll_register_callbacks cb 0x55b4b2216200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38582/0 (socket says 172.21.15.52:38582) 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 -- 172.21.15.52:0/3105472004 learned_addr learned my addr 172.21.15.52:0/3105472004 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71a7fff700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b226bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71a77fe700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b2284e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 -- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 msgr2=0x55b4b2284e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b2284e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 -- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 msgr2=0x55b4b226bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b226bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 -- 172.21.15.52:0/3105472004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a80c5750 con 0x55b4b22a0480 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71acce1700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f71a806a9c0 tx=0x7f71a0009780).ready entity=mon.0 client_cookie=4463a28bc0fbab92 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71827fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.126+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0012d20 con 0x55b4b22a0480 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f71a0026420 con 0x55b4b22a0480 2023-05-10T01:26:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4b224a460 con 0x55b4b22a0480 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a0012e80 con 0x55b4b22a0480 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 10 client.7797 fetch_fsmap learned FSMap version 54 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55b4b21a1880 con 0x55b4b22a0480 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4b224a460 con 0x55b4b22a0480 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f71a0026630 con 0x55b4b22a0480 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 10 client.7797 fetch_fsmap finished waiting for FSMap version 54 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 10 client.7797 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:26:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 20 client.7797 populate_metadata read hostname 'smithi052' 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b22522f0 0x55b4b227b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 4 client.7797 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 --> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4b200fca0 con 0x55b4b22522f0 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.127+0000 7f71a7fff700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b22522f0 0x55b4b227b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71a7fff700 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b22522f0 0x55b4b227b1d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58747e1cae36acb7 server_cookie=c3a4142083bdcc10 in_seq=0 out_seq=0 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71827fc700 10 client.7797 ms_handle_connect on v2:172.21.15.172:6835/3128322162 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71827fc700 1 -- 172.21.15.52:0/3105472004 <== mds.0 v2:172.21.15.172:6835/3128322162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x55b4b200fca0 con 0x55b4b22522f0 2023-05-10T01:26:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71827fc700 10 client.7797 handle_command_reply: tid=0 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71c00d6b80 1 client.7797 shutdown 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 msgr2=0x55b4b2285340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.128+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f71a806a9c0 tx=0x7f71a0009780).stop 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 shutdown_connections 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b2285340 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b2257300 0x55b4b226bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b22522f0 0x55b4b227b1d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/3105472004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b229b560 0x55b4b2284e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71827fc700 0 client.7797 ms_handle_reset on v2:172.21.15.172:6835/3128322162 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 >> 172.21.15.52:0/3105472004 conn(0x55b4b2013e40 msgr2=0x55b4b229c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 shutdown_connections 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 1 -- 172.21.15.52:0/3105472004 wait complete. 2023-05-10T01:26:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.129+0000 7f71c00d6b80 20 client.7797 trim_cache size 0 max 16384 2023-05-10T01:26:29.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.145+0000 7f71c00d6b80 1 Processor -- start 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.145+0000 7f71c00d6b80 1 -- start start 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b22ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b22a0480 0x55b4b22565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b22855c0 con 0x55b4b2257300 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b229b0c0 con 0x55b4b229b560 2023-05-10T01:26:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4b2254c50 con 0x55b4b22a0480 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38586/0 (socket says 172.21.15.52:38586) 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.146+0000 7f71a7fff700 1 -- 172.21.15.52:0/1323802517 learned_addr learned my addr 172.21.15.52:0/1323802517 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 -- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b22a0480 msgr2=0x55b4b22565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b22a0480 0x55b4b22565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 -- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 msgr2=0x55b4b22ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a77fe700 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b22ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b22ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 -- 172.21.15.52:0/1323802517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4b219d070 con 0x55b4b2257300 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a77fe700 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b22ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f7198007fd0 tx=0x7f7198017040).ready entity=mon.0 client_cookie=3a812674000338d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f718dffb700 1 -- 172.21.15.52:0/1323802517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980245d0 con 0x55b4b2257300 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f718dffb700 1 -- 172.21.15.52:0/1323802517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719801a040 con 0x55b4b2257300 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f718dffb700 1 -- 172.21.15.52:0/1323802517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198024940 con 0x55b4b2257300 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1323802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 msgr2=0x55b4b2281a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.147+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f7198007fd0 tx=0x7f7198017040).stop 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1323802517 shutdown_connections 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b22a0480 0x55b4b22565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b2257300 0x55b4b2281a80 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1323802517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b22ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1323802517 >> 172.21.15.52:0/1323802517 conn(0x55b4b2013e40 msgr2=0x55b4b22536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1323802517 shutdown_connections 2023-05-10T01:26:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1323802517 wait complete. 2023-05-10T01:26:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 -- start start 2023-05-10T01:26:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.148+0000 7f71c00d6b80 1 Processor -- start 2023-05-10T01:26:29.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b2257300 0x55b4b22a4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b2300d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b227c7b0 con 0x55b4b22a0480 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b227d610 con 0x55b4b229b560 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4b227ca00 con 0x55b4b2257300 2023-05-10T01:26:29.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71c00d6b80 10 client.0 ll_register_callbacks cb 0x55b4b226b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38596/0 (socket says 172.21.15.52:38596) 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 -- 172.21.15.52:0/1818379683 learned_addr learned my addr 172.21.15.52:0/1818379683 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71a77fe700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b2300d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b2257300 0x55b4b22a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 -- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b2257300 msgr2=0x55b4b22a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b2257300 0x55b4b22a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 -- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 msgr2=0x55b4b2300d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b2300d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.149+0000 7f71acce1700 1 -- 172.21.15.52:0/1818379683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940033f0 con 0x55b4b22a0480 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71acce1700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f71a806a9c0 tx=0x7f71a001f070).ready entity=mon.0 client_cookie=ea3de386e1559c6f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0009880 con 0x55b4b22a0480 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f71a0026e20 con 0x55b4b22a0480 2023-05-10T01:26:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f719c00fd40 con 0x55b4b22a0480 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a0012620 con 0x55b4b22a0480 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 10 client.7803 fetch_fsmap learned FSMap version 54 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55b4b219cdc0 con 0x55b4b22a0480 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00fd40 con 0x55b4b22a0480 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f71a0012780 con 0x55b4b22a0480 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 10 client.7803 fetch_fsmap finished waiting for FSMap version 54 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 10 client.7803 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:26:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 20 client.7803 populate_metadata read hostname 'smithi052' 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b2304720 0x55b4b2304b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 4 client.7803 mds_command: new command op to 7620 tid=0[{"prefix": "status"}] 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 --> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4b2046ca0 con 0x55b4b2304720 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.150+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b2304720 0x55b4b2304b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71827fc700 10 client.7803 ms_handle_connect on v2:172.21.15.172:6835/3128322162 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71a7fff700 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b2304720 0x55b4b2304b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6f330fdb45e1a242 server_cookie=9e4091a6c934fd25 in_seq=0 out_seq=0 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71827fc700 1 -- 172.21.15.52:0/1818379683 <== mds.0 v2:172.21.15.172:6835/3128322162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b4b2046ca0 con 0x55b4b2304720 2023-05-10T01:26:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71827fc700 10 client.7803 handle_command_reply: tid=0 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 client.7803 shutdown 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 msgr2=0x55b4b229f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f71a806a9c0 tx=0x7f71a001f070).stop 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 shutdown_connections 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4b22a0480 0x55b4b229f080 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:6835/3128322162,v1:172.21.15.172:6837/3128322162] conn(0x55b4b2304720 0x55b4b2304b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b4b2257300 0x55b4b22a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 --2- 172.21.15.52:0/1818379683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b4b229b560 0x55b4b2300d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71827fc700 0 client.7803 ms_handle_reset on v2:172.21.15.172:6835/3128322162 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 >> 172.21.15.52:0/1818379683 conn(0x55b4b2013e40 msgr2=0x55b4b2284e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 shutdown_connections 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 1 -- 172.21.15.52:0/1818379683 wait complete. 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.151+0000 7f71c00d6b80 20 client.7803 trim_cache size 0 max 16384 2023-05-10T01:26:29.165 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7620, 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:26:29.166 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.203510826, 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 54, 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 122, 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 122, 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.637618826000001 2023-05-10T01:26:29.167 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:26:29.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 msgr2=0x7f7188061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 0x7f7188061220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7198005750 tx=0x7f7198009040).stop 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 msgr2=0x7f71a80c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f719c00c490 tx=0x7f719c007db0).stop 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 shutdown_connections 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f718805ed60 0x7f7188061220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71a813b920 0x7f71a80c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71a8063e20 0x7f71a8151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 --2- 172.21.15.52:0/649179308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71a813b540 0x7f71a80c6410 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 >> 172.21.15.52:0/649179308 conn(0x7f71a80c8a90 msgr2=0x7f71a813a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 shutdown_connections 2023-05-10T01:26:29.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.152+0000 7f71ae744700 1 -- 172.21.15.52:0/649179308 wait complete. 2023-05-10T01:26:29.170 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:26:29.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:26:29.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:26:29.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.273+0000 7f89be1b0700 1 Processor -- start 2023-05-10T01:26:29.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.273+0000 7f89be1b0700 1 -- start start 2023-05-10T01:26:29.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.273+0000 7f89be1b0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89b8154190 0x7f89b80635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.273+0000 7f89be1b0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80aaf30 con 0x7f89b8153db0 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89be1b0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80c1440 con 0x7f89b80c5c40 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89be1b0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80c1720 con 0x7f89b8154190 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b77fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89b8153db0 0x7f89b80c0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47616/0 (socket says 172.21.15.52:47616) 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b77fe700 1 -- 172.21.15.52:0/1636419970 learned_addr learned my addr 172.21.15.52:0/1636419970 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b6ffd700 1 --2- 172.21.15.52:0/1636419970 >> v2:172.21.15.172:3300/0 conn(0x7f89b8154190 0x7f89b80635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324195812 0 0) 0x7f89b80aaf30 con 0x7f89b8153db0 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89980033f0 con 0x7f89b8153db0 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219785358 0 0) 0x7f89980033f0 con 0x7f89b8153db0 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 >> v2:172.21.15.172:3300/0 conn(0x7f89b8154190 msgr2=0x7f89b80635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 --2- 172.21.15.52:0/1636419970 >> v2:172.21.15.172:3300/0 conn(0x7f89b8154190 0x7f89b80635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 >> v1:172.21.15.172:6789/0 conn(0x7f89b80c5c40 legacy=0x7f89b80ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80c1a00 con 0x7f89b8153db0 2023-05-10T01:26:29.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f89a8001470 con 0x7f89b8153db0 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 >> v1:172.21.15.52:6789/0 conn(0x7f89b8153db0 legacy=0x7f89b80c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 0x7f8998003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8998004690 0x7f8998004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8998005000 0x7f899800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80c1720 con 0x7f89980038e0 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899800bf60 con 0x7f8998005000 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899800c0f0 con 0x7f8998004690 2023-05-10T01:26:29.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b77fe700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 0x7f8998003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.274+0000 7f89b7fff700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8998005000 0x7f899800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b6ffd700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8998004690 0x7f8998004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 -- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8998004690 msgr2=0x7f8998004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8998004690 0x7f8998004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 -- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8998005000 msgr2=0x7f899800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8998005000 0x7f899800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 -- 172.21.15.52:0/1636419970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980033f0 con 0x7f89980038e0 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b7fff700 1 -- 172.21.15.52:0/1636419970 reap_dead start 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b77fe700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 0x7f8998003d00 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f89a800c190 tx=0x7f89a8001e50).ready entity=mon.0 client_cookie=4dc0b6c5173cfa4c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8007a20 con 0x7f89980038e0 2023-05-10T01:26:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a800cac0 con 0x7f89980038e0 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89b67fc700 1 -- 172.21.15.52:0/1636419970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800ce40 con 0x7f89980038e0 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 -- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 msgr2=0x7f8998003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 0x7f8998003d00 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f89a800c190 tx=0x7f89a8001e50).stop 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 -- 172.21.15.52:0/1636419970 shutdown_connections 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 --2- 172.21.15.52:0/1636419970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89980038e0 0x7f8998003d00 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 -- 172.21.15.52:0/1636419970 >> 172.21.15.52:0/1636419970 conn(0x7f89b80cac90 msgr2=0x7f89b80cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 -- 172.21.15.52:0/1636419970 shutdown_connections 2023-05-10T01:26:29.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.275+0000 7f89be1b0700 1 -- 172.21.15.52:0/1636419970 wait complete. 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.277+0000 7f89be1b0700 1 Processor -- start 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.277+0000 7f89be1b0700 1 -- start start 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.277+0000 7f89be1b0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89980038e0 0x7f89b813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b80639e0 0x7f89b8155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b813fce0 con 0x7f89b813bb60 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8063e40 con 0x7f89b80639e0 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b81565f0 con 0x7f89980038e0 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38614/0 (socket says 172.21.15.52:38614) 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 -- 172.21.15.52:0/2409870485 learned_addr learned my addr 172.21.15.52:0/2409870485 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b77fe700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89980038e0 0x7f89b813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b7fff700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b80639e0 0x7f89b8155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 -- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89980038e0 msgr2=0x7f89b813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89980038e0 0x7f89b813f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 -- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b80639e0 msgr2=0x7f89b8155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b80639e0 0x7f89b8155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 -- 172.21.15.52:0/2409870485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80af530 con 0x7f89b813bb60 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89b6ffd700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f89a0011660 tx=0x7f89a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00145f0 con 0x7f89b813bb60 2023-05-10T01:26:29.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a0014750 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b80af810 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0014ad0 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.278+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b813bfe0 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.279+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b805ef90 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.280+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f89a0012040 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.280+0000 7f89af7fe700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 0x7f899c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.280+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f89a007a110 con 0x7f89b813bb60 2023-05-10T01:26:29.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.280+0000 7f89b77fe700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 0x7f899c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:29.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.281+0000 7f89b77fe700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 0x7f899c061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f89b8168690 tx=0x7f89a8015000).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:29.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.284+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89a004b5a0 con 0x7f89b813bb60 2023-05-10T01:26:29.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.501+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89b80aabc0 con 0x7f89b813bb60 2023-05-10T01:26:29.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.501+0000 7f89af7fe700 1 -- 172.21.15.52:0/2409870485 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89a004ebc0 con 0x7f89b813bb60 2023-05-10T01:26:29.505 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 msgr2=0x7f899c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 0x7f899c061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f89b8168690 tx=0x7f89a8015000).stop 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 msgr2=0x7f89b80634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f89a0011660 tx=0x7f89a0008040).stop 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 shutdown_connections 2023-05-10T01:26:29.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f899c05ed90 0x7f899c061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b80639e0 0x7f89b8155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89980038e0 0x7f89b813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 --2- 172.21.15.52:0/2409870485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b813bb60 0x7f89b80634f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 >> 172.21.15.52:0/2409870485 conn(0x7f89b80cac90 msgr2=0x7f89b8064f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 shutdown_connections 2023-05-10T01:26:29.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:29.503+0000 7f89be1b0700 1 -- 172.21.15.52:0/2409870485 wait complete. 2023-05-10T01:26:29.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:26:29.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:26:29.518 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:26:29.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:26:29.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:26:29.519 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:26:29.520 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:26:29.520 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:26:29.520 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:26:29.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.521 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:26:29.536 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:26:29.536 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:26:29.537 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41246sec preferred_lft 41246sec 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:26:29.538 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.539 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:26:29.540 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:26:29.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.541 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:26:29.600 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:26:29.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.601 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:26:29.657 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:26:29.658 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:26:29.658 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:26:29.658 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:26:29.658 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:26:29.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.659 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:26:29.659 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:26:29.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:26:29.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:26:29.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:26:29.661 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:26:29.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.759 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:26:29.773 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:26:29.774 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:26:29.774 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:26:29.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:26:29.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:29.838 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:26:29.892 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:26:29.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:26:29.971 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:26:29.971 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:26:30.014 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:26:30.014 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:26:30.016 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:26:30.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:30.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:26:30.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:26:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.235+0000 7f35b9fd3700 1 Processor -- start 2023-05-10T01:26:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.235+0000 7f35b9fd3700 1 -- start start 2023-05-10T01:26:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b9fd3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154160 0x7f35b40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b9fd3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35b4069da0 0x7f35b40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b9fd3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40c0650 con 0x7f35b4154540 2023-05-10T01:26:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b9fd3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40c1af0 con 0x7f35b4069da0 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b9fd3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40bfd20 con 0x7f35b4154160 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35b4069da0 0x7f35b40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35b4069da0 0x7f35b40c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38630/0 (socket says 172.21.15.52:38630) 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b3fff700 1 -- 172.21.15.52:0/3969119020 learned_addr learned my addr 172.21.15.52:0/3969119020 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b37fe700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154160 0x7f35b40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b3fff700 1 -- 172.21.15.52:0/3969119020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154160 msgr2=0x7f35b40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.236+0000 7f35b3fff700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154160 0x7f35b40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b3fff700 1 -- 172.21.15.52:0/3969119020 >> v1:172.21.15.172:6789/0 conn(0x7f35b4154540 legacy=0x7f35b4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b3fff700 1 -- 172.21.15.52:0/3969119020 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40c0000 con 0x7f35b4069da0 2023-05-10T01:26:30.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b3fff700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b40c6150 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f35ac009f20 tx=0x7f35ac009840).ready entity=mon.0 client_cookie=608eb38b6f21b277 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b27fc700 1 -- 172.21.15.52:0/3969119020 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00e070 con 0x7f35b4069da0 2023-05-10T01:26:30.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b27fc700 1 -- 172.21.15.52:0/3969119020 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac00b9d0 con 0x7f35b4069da0 2023-05-10T01:26:30.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b27fc700 1 -- 172.21.15.52:0/3969119020 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00bd50 con 0x7f35b4069da0 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 -- 172.21.15.52:0/3969119020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 msgr2=0x7f35b40c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b40c6150 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f35ac009f20 tx=0x7f35ac009840).stop 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 -- 172.21.15.52:0/3969119020 shutdown_connections 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154160 0x7f35b40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/3969119020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b40c6150 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 -- 172.21.15.52:0/3969119020 >> 172.21.15.52:0/3969119020 conn(0x7f35b40cb6f0 msgr2=0x7f35b40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:30.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 -- 172.21.15.52:0/3969119020 shutdown_connections 2023-05-10T01:26:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.237+0000 7f35b9fd3700 1 -- 172.21.15.52:0/3969119020 wait complete. 2023-05-10T01:26:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 Processor -- start 2023-05-10T01:26:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 -- start start 2023-05-10T01:26:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b4154160 0x7f35b40c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154540 0x7f35b40ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4150320 con 0x7f35b4069da0 2023-05-10T01:26:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c4f80 con 0x7f35b4154160 2023-05-10T01:26:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b9fd3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b414f9f0 con 0x7f35b4154540 2023-05-10T01:26:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38632/0 (socket says 172.21.15.52:38632) 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.239+0000 7f35b37fe700 1 -- 172.21.15.52:0/4112674379 learned_addr learned my addr 172.21.15.52:0/4112674379 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 -- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154540 msgr2=0x7f35b40ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154540 0x7f35b40ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 -- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b4154160 msgr2=0x7f35b40c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b4154160 0x7f35b40c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 -- 172.21.15.52:0/4112674379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac009ae0 con 0x7f35b4069da0 2023-05-10T01:26:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b37fe700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f35a400e960 tx=0x7f35a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400c8e0 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400ca40 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b414fcd0 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400cdc0 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.240+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b414df20 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.241+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b40666b0 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.241+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f35a4022070 con 0x7f35b4069da0 2023-05-10T01:26:30.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.242+0000 7f359b7fe700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 0x7f3594061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.242+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f35a407a0f0 con 0x7f35b4069da0 2023-05-10T01:26:30.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.242+0000 7f35b2ffd700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 0x7f3594061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.242+0000 7f35b2ffd700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 0x7f3594061280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f35b414f2b0 tx=0x7f35a80079a0).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.246+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35a404b580 con 0x7f35b4069da0 2023-05-10T01:26:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.444+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f35b406c340 con 0x7f359405edc0 2023-05-10T01:26:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.447+0000 7f359b7fe700 1 -- 172.21.15.52:0/4112674379 <== mgr.6320 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f35b406c340 con 0x7f359405edc0 2023-05-10T01:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:26:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 msgr2=0x7f3594061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 0x7f3594061280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f35b414f2b0 tx=0x7f35a80079a0).stop 2023-05-10T01:26:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 msgr2=0x7f35b414da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f35a400e960 tx=0x7f35a4009060).stop 2023-05-10T01:26:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 shutdown_connections 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f359405edc0 0x7f3594061280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35b4154540 0x7f35b40ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35b4069da0 0x7f35b414da30 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 --2- 172.21.15.52:0/4112674379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b4154160 0x7f35b40c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 >> 172.21.15.52:0/4112674379 conn(0x7f35b40cb6f0 msgr2=0x7f35b414e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 shutdown_connections 2023-05-10T01:26:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.448+0000 7f35b9fd3700 1 -- 172.21.15.52:0/4112674379 wait complete. 2023-05-10T01:26:30.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:26:30.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.579+0000 7f35b253f700 1 Processor -- start 2023-05-10T01:26:30.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.579+0000 7f35b253f700 1 -- start start 2023-05-10T01:26:30.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b253f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35ac157700 0x7f35ac0a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b253f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 0x7f35ac15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b253f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0bfcb0 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b253f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac06a990 con 0x7f35ac157700 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b253f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac06a130 con 0x7f35ac0c62b0 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35ac157700 0x7f35ac0a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35ac157700 0x7f35ac0a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38640/0 (socket says 172.21.15.52:38640) 2023-05-10T01:26:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 -- 172.21.15.52:0/3117203769 learned_addr learned my addr 172.21.15.52:0/3117203769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b1d3e700 1 --2- 172.21.15.52:0/3117203769 >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 0x7f35ac15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 -- 172.21.15.52:0/3117203769 >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 msgr2=0x7f35ac15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 --2- 172.21.15.52:0/3117203769 >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 0x7f35ac15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 -- 172.21.15.52:0/3117203769 >> v1:172.21.15.172:6789/0 conn(0x7f35ac0aa1e0 legacy=0x7f35ac0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 -- 172.21.15.52:0/3117203769 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac06a3d0 con 0x7f35ac157700 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b1d3e700 1 --2- 172.21.15.52:0/3117203769 >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 0x7f35ac15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:30.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f35b153d700 1 --2- 172.21.15.52:0/3117203769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac157700 0x7f35ac0a9cf0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f35ac0600b0 tx=0x7f35a80090f0).ready entity=mon.0 client_cookie=3e4635776da85e38 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f359bfff700 1 -- 172.21.15.52:0/3117203769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800b5a0 con 0x7f35ac157700 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f359bfff700 1 -- 172.21.15.52:0/3117203769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a800b700 con 0x7f35ac157700 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.580+0000 7f359bfff700 1 -- 172.21.15.52:0/3117203769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800ba80 con 0x7f35ac157700 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 -- 172.21.15.52:0/3117203769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac157700 msgr2=0x7f35ac0a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 --2- 172.21.15.52:0/3117203769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac157700 0x7f35ac0a9cf0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f35ac0600b0 tx=0x7f35a80090f0).stop 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 -- 172.21.15.52:0/3117203769 shutdown_connections 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 --2- 172.21.15.52:0/3117203769 >> v2:172.21.15.172:3300/0 conn(0x7f35ac0c62b0 0x7f35ac15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 --2- 172.21.15.52:0/3117203769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac157700 0x7f35ac0a9cf0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 -- 172.21.15.52:0/3117203769 >> 172.21.15.52:0/3117203769 conn(0x7f35ac0cb5f0 msgr2=0x7f35ac0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 -- 172.21.15.52:0/3117203769 shutdown_connections 2023-05-10T01:26:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.581+0000 7f35b253f700 1 -- 172.21.15.52:0/3117203769 wait complete. 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.582+0000 7f35b253f700 1 Processor -- start 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.582+0000 7f35b253f700 1 -- start start 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35ac0c62b0 0x7f35ac141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35ac157700 0x7f35ac164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac166320 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac165710 con 0x7f35ac0c62b0 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b253f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac1659f0 con 0x7f35ac157700 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38646/0 (socket says 172.21.15.52:38646) 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 -- 172.21.15.52:0/2004847084 learned_addr learned my addr 172.21.15.52:0/2004847084 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b0d3c700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35ac0c62b0 0x7f35ac141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b1d3e700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35ac157700 0x7f35ac164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 -- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35ac157700 msgr2=0x7f35ac164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35ac157700 0x7f35ac164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 -- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35ac0c62b0 msgr2=0x7f35ac141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35ac0c62b0 0x7f35ac141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.583+0000 7f35b153d700 1 -- 172.21.15.52:0/2004847084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8009370 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35b153d700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f35a8009130 tx=0x7f35a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a800b870 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a800b9d0 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac165cd0 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a801b660 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.584+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac165120 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.585+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac083110 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.585+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 47) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f35a802b070 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.585+0000 7f35997fa700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 0x7f358c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.585+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f35a807b4c0 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.586+0000 7f35b0d3c700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 0x7f358c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.586+0000 7f35b0d3c700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 0x7f358c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f35ac0b0b30 tx=0x7f359c007d20).ready entity=mgr.6320 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.590+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35a804c950 con 0x7f35ac0aa1e0 2023-05-10T01:26:30.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:30.808+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f35ac047150 con 0x7f35ac0aa1e0 2023-05-10T01:26:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.549+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f35a8021030 con 0x7f35ac0aa1e0 2023-05-10T01:26:31.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.550+0000 7f35997fa700 1 -- 172.21.15.52:0/2004847084 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v48) v1 ==== 92+0+0 (secure 0 0 0) 0x7f35a80425e0 con 0x7f35ac0aa1e0 2023-05-10T01:26:31.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 msgr2=0x7f358c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 0x7f358c061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f35ac0b0b30 tx=0x7f359c007d20).stop 2023-05-10T01:26:31.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 msgr2=0x7f35ac1531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f35a8009130 tx=0x7f35a8015000).stop 2023-05-10T01:26:31.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 shutdown_connections 2023-05-10T01:26:31.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f358c05ed90 0x7f358c061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35ac157700 0x7f35ac164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35ac0aa1e0 0x7f35ac1531a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 --2- 172.21.15.52:0/2004847084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35ac0c62b0 0x7f35ac141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 >> 172.21.15.52:0/2004847084 conn(0x7f35ac0cb5f0 msgr2=0x7f35ac0c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:31.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 shutdown_connections 2023-05-10T01:26:31.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.553+0000 7f35b253f700 1 -- 172.21.15.52:0/2004847084 wait complete. 2023-05-10T01:26:31.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:26:31.692 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:31.689+0000 7ff924957680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:31.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.693+0000 7f6119b65700 1 Processor -- start 2023-05-10T01:26:31.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.693+0000 7f6119b65700 1 -- start start 2023-05-10T01:26:31.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6119b65700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6114154080 0x7f61140aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6119b65700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6114154460 0x7f61140a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6119b65700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61140aa560 con 0x7f61140aa140 2023-05-10T01:26:31.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6119b65700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140c94c0 con 0x7f6114154460 2023-05-10T01:26:31.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6119b65700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140cb7d0 con 0x7f6114154080 2023-05-10T01:26:31.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6113fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f61140aa140 0x7f6114068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47700/0 (socket says 172.21.15.52:47700) 2023-05-10T01:26:31.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6113fff700 1 -- 172.21.15.52:0/1335444812 learned_addr learned my addr 172.21.15.52:0/1335444812 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:31.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1335444812 >> v2:172.21.15.172:3300/0 conn(0x7f6114154460 0x7f61140a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:31.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f61137fe700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6114154080 0x7f61140aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:31.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f61127fc700 1 -- 172.21.15.52:0/1335444812 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136907103 0 0) 0x7f610c001490 con 0x7f61140aa140 2023-05-10T01:26:31.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f61127fc700 1 -- 172.21.15.52:0/1335444812 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f40033f0 con 0x7f61140aa140 2023-05-10T01:26:31.700 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f92501c4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:31.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 -- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6114154080 msgr2=0x7f61140aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:31.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6114154080 0x7f61140aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 -- 172.21.15.52:0/1335444812 >> v1:172.21.15.52:6789/0 conn(0x7f61140aa140 legacy=0x7f6114068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 -- 172.21.15.52:0/1335444812 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140c88b0 con 0x7f6114154460 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.694+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f61140a9c50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).ready entity=mon.1 client_cookie=dbcfc1ef5a4f0fb1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f61127fc700 1 -- 172.21.15.52:0/1335444812 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400d4a0 con 0x7f6114154460 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f61127fc700 1 -- 172.21.15.52:0/1335444812 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400d600 con 0x7f6114154460 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f61127fc700 1 -- 172.21.15.52:0/1335444812 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400d980 con 0x7f6114154460 2023-05-10T01:26:31.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 -- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 msgr2=0x7f61140a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f61140a9c50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).stop 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 -- 172.21.15.52:0/1335444812 shutdown_connections 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6114154080 0x7f61140aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 --2- 172.21.15.52:0/1335444812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f61140a9c50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 -- 172.21.15.52:0/1335444812 >> 172.21.15.52:0/1335444812 conn(0x7f6114067910 msgr2=0x7f61140cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 -- 172.21.15.52:0/1335444812 shutdown_connections 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.695+0000 7f6119b65700 1 -- 172.21.15.52:0/1335444812 wait complete. 2023-05-10T01:26:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.696+0000 7f6119b65700 1 Processor -- start 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.696+0000 7f6119b65700 1 -- start start 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61140aa140 0x7f61140aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f6114154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114155220 con 0x7f6114154080 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140afd70 con 0x7f6114154460 2023-05-10T01:26:31.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6119b65700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140af160 con 0x7f61140aa140 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6112ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6112ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38688/0 (socket says 172.21.15.52:38688) 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6112ffd700 1 -- 172.21.15.52:0/1908881800 learned_addr learned my addr 172.21.15.52:0/1908881800 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f61137fe700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61140aa140 0x7f61140aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.697+0000 7f6113fff700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f6114154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 -- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61140aa140 msgr2=0x7f61140aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61140aa140 0x7f61140aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 -- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 msgr2=0x7f6114154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f6114154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 -- 172.21.15.52:0/1908881800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040092a0 con 0x7f6114154080 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6112ffd700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f611406bb20 tx=0x7f6104016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400dd30 con 0x7f6114154080 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400de90 con 0x7f6114154080 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61140af440 con 0x7f6114154080 2023-05-10T01:26:31.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400d980 con 0x7f6114154080 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.698+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61140afa00 con 0x7f6114154080 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.699+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6114066720 con 0x7f6114154080 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.700+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f610400f070 con 0x7f6114154080 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.700+0000 7f610b7fe700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 0x7f60f80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.700+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f610407b1f0 con 0x7f6114154080 2023-05-10T01:26:31.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.700+0000 7f61137fe700 1 -- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 msgr2=0x7f60f80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.700+0000 7f61137fe700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 0x7f60f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:31.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.704+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f610404c680 con 0x7f6114154080 2023-05-10T01:26:31.755 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:31.752+0000 7ff924957680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:31.766 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:31.762+0000 7f92501c4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:31.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.879+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f611406c340 con 0x7f6114154080 2023-05-10T01:26:31.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.882+0000 7f610b7fe700 1 -- 172.21.15.52:0/1908881800 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f610404fca0 con 0x7f6114154080 2023-05-10T01:26:31.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 msgr2=0x7f60f80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:31.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 0x7f60f80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:31.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 msgr2=0x7f6114154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:31.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f611406bb20 tx=0x7f6104016000).stop 2023-05-10T01:26:31.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 shutdown_connections 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f60f805ede0 0x7f60f80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6114154460 0x7f6114154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61140aa140 0x7f61140aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 --2- 172.21.15.52:0/1908881800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6114154080 0x7f6114154840 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 >> 172.21.15.52:0/1908881800 conn(0x7f6114067910 msgr2=0x7f61140ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 shutdown_connections 2023-05-10T01:26:31.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:31.884+0000 7f6119b65700 1 -- 172.21.15.52:0/1908881800 wait complete. 2023-05-10T01:26:31.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:31.901 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:26:31.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-05-10T01:26:32.025 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:32.023+0000 7ff924957680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:32.053 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:32.050+0000 7f92501c4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.079+0000 7f79c2e9a700 1 Processor -- start 2023-05-10T01:26:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.079+0000 7f79c2e9a700 1 -- start start 2023-05-10T01:26:32.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c2e9a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79bc154110 0x7f79bc1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c2e9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79bc155570 0x7f79bc068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c2e9a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0c6310 con 0x7f79bc0cb410 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c2e9a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc0c6830 con 0x7f79bc154110 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c2e9a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc1550e0 con 0x7f79bc155570 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.080+0000 7f79c0c36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79bc154110 0x7f79bc1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79bbfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f79bc0cb410 0x7f79bc0c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47738/0 (socket says 172.21.15.52:47738) 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79bc154110 0x7f79bc1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38722/0 (socket says 172.21.15.52:38722) 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79bbfff700 1 -- 172.21.15.52:0/1564669030 learned_addr learned my addr 172.21.15.52:0/1564669030 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c1437700 1 --2- 172.21.15.52:0/1564669030 >> v2:172.21.15.172:3300/0 conn(0x7f79bc155570 0x7f79bc068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 -- 172.21.15.52:0/1564669030 >> v2:172.21.15.172:3300/0 conn(0x7f79bc155570 msgr2=0x7f79bc068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1564669030 >> v2:172.21.15.172:3300/0 conn(0x7f79bc155570 0x7f79bc068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 -- 172.21.15.52:0/1564669030 >> v1:172.21.15.52:6789/0 conn(0x7f79bc0cb410 legacy=0x7f79bc0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 -- 172.21.15.52:0/1564669030 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0c6550 con 0x7f79bc154110 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1564669030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc1544f0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f79bc0aa6b0 tx=0x7f79b0006f40).ready entity=mon.0 client_cookie=588f3d2465b2bb7d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79bb7fe700 1 -- 172.21.15.52:0/1564669030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005880 con 0x7f79bc154110 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79bb7fe700 1 -- 172.21.15.52:0/1564669030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00059e0 con 0x7f79bc154110 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.081+0000 7f79bb7fe700 1 -- 172.21.15.52:0/1564669030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005d60 con 0x7f79bc154110 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1564669030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 msgr2=0x7f79bc1544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1564669030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc1544f0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f79bc0aa6b0 tx=0x7f79b0006f40).stop 2023-05-10T01:26:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1564669030 shutdown_connections 2023-05-10T01:26:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1564669030 >> v2:172.21.15.172:3300/0 conn(0x7f79bc155570 0x7f79bc068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1564669030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc1544f0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1564669030 >> 172.21.15.52:0/1564669030 conn(0x7f79bc0678d0 msgr2=0x7f79bc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:32.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1564669030 shutdown_connections 2023-05-10T01:26:32.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.082+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1564669030 wait complete. 2023-05-10T01:26:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.083+0000 7f79c2e9a700 1 Processor -- start 2023-05-10T01:26:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.083+0000 7f79c2e9a700 1 -- start start 2023-05-10T01:26:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79bc0cb410 0x7f79bc0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79bc155570 0x7f79bc0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0c20d0 con 0x7f79bc154110 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc1522e0 con 0x7f79bc0cb410 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c2e9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc151870 con 0x7f79bc155570 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79bbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38728/0 (socket says 172.21.15.52:38728) 2023-05-10T01:26:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79bbfff700 1 -- 172.21.15.52:0/1821297769 learned_addr learned my addr 172.21.15.52:0/1821297769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79bc0cb410 0x7f79bc0c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.084+0000 7f79c1437700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79bc155570 0x7f79bc0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79bc155570 msgr2=0x7f79bc0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79bc155570 0x7f79bc0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79bc0cb410 msgr2=0x7f79bc0c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79bc0cb410 0x7f79bc0c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009250 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79bbfff700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f79a800c7f0 tx=0x7f79a8007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80072e0 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8007440 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc0c7cf0 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80057a0 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.085+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc0c1d60 con 0x7f79bc154110 2023-05-10T01:26:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.086+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 48) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f79a8010070 con 0x7f79bc154110 2023-05-10T01:26:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.086+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc0c2280 con 0x7f79bc154110 2023-05-10T01:26:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.086+0000 7f79b8ff9700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.087+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f79a8079280 con 0x7f79bc154110 2023-05-10T01:26:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.087+0000 7f79c0c36700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.087+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.091+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79bc0c2280 con 0x7f79bc154110 2023-05-10T01:26:32.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.288+0000 7f79c0c36700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:32.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.288+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:32.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.291+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc0c6310 con 0x7f79a405ede0 2023-05-10T01:26:32.629 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:32.626+0000 7ff924957680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:32.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.689+0000 7f79c0c36700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:32.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:32.689+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:26:32.700 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:32.697+0000 7ff924957680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:32.715 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:32.711+0000 7f92501c4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:32.783 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:32.780+0000 7f92501c4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:32.883 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:32.880+0000 7ff924957680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:32.977 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:32.973+0000 7f92501c4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:33.298 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.295+0000 7ff924957680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:33.399 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.397+0000 7ff924957680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:33.411 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:33.407+0000 7f92501c4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:33.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:33.490+0000 7f79c0c36700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:33.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:33.490+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:26:33.518 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:33.515+0000 7f92501c4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:33.552 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.549+0000 7ff924957680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:33.625 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.622+0000 7ff924957680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:33.677 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:33.674+0000 7f92501c4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:33.690 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.688+0000 7ff924957680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:33.754 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:33.751+0000 7f92501c4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:33.824 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:33.821+0000 7f92501c4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:33.943 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:33.940+0000 7ff924957680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:34.093 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:34.090+0000 7f92501c4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:34.124 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:34.121+0000 7ff924957680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:34.284 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:34.281+0000 7f92501c4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:34.767 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:34.764+0000 7ff924957680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:34.834 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:34.831+0000 7ff924957680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:34.908 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:34.905+0000 7ff924957680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:34.966 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:34.962+0000 7f92501c4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:35.039 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.035+0000 7f92501c4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:35.054 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.051+0000 7ff924957680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:35.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:35.092+0000 7f79c0c36700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:35.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:35.092+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:26:35.116 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.112+0000 7f92501c4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:35.123 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.120+0000 7ff924957680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:35.236 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.233+0000 7ff924957680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:35.267 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.264+0000 7f92501c4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:35.340 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.336+0000 7f92501c4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:35.341 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.338+0000 7ff924957680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:35.459 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.455+0000 7f92501c4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:35.571 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.568+0000 7f92501c4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:35.631 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.628+0000 7ff924957680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:35.700 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:35.697+0000 7ff924957680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:35.873 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.869+0000 7f92501c4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:35.946 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:35.942+0000 7f92501c4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:36.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:36.551+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 49) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f79a8077070 con 0x7f79bc154110 2023-05-10T01:26:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:36.551+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:36.551+0000 7f79b8ff9700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:36.617 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a3139700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.617 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a3139700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a3139700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a3139700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a3139700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a0133700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a0133700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a0133700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.618 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a0133700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:36.619 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:36.614+0000 7ff8a0133700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.556+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f79a80773f0 con 0x7f79bc154110 2023-05-10T01:26:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.556+0000 7f79b8ff9700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a402fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.556+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc0c6310 con 0x7f79a405ede0 2023-05-10T01:26:37.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.557+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a402fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.559+0000 7f79c0c36700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a402fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f79b0009630 tx=0x7f79b0015000).ready entity=mgr.7258 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.572+0000 7f79b8ff9700 1 -- 172.21.15.52:0/1821297769 <== mgr.7258 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79bc0c6310 con 0x7f79a405ede0 2023-05-10T01:26:37.575 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:26:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 msgr2=0x7f79a402fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a402fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f79b0009630 tx=0x7f79b0015000).stop 2023-05-10T01:26:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 msgr2=0x7f79bc151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f79a800c7f0 tx=0x7f79a8007db0).stop 2023-05-10T01:26:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 shutdown_connections 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79a405ede0 0x7f79a402fd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79bc155570 0x7f79bc0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79bc0cb410 0x7f79bc0c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 --2- 172.21.15.52:0/1821297769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc154110 0x7f79bc151380 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 >> 172.21.15.52:0/1821297769 conn(0x7f79bc0678d0 msgr2=0x7f79bc152980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 shutdown_connections 2023-05-10T01:26:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.574+0000 7f79c2e9a700 1 -- 172.21.15.52:0/1821297769 wait complete. 2023-05-10T01:26:37.592 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:26:37.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-10T01:26:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.718+0000 7ff9589c4700 1 Processor -- start 2023-05-10T01:26:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.718+0000 7ff9589c4700 1 -- start start 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff9589c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff9540aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff9589c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff954154460 0x7ff9540a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff9589c4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540aa560 con 0x7ff9540aa140 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff9589c4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540c94c0 con 0x7ff954154460 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff9589c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cb7d0 con 0x7ff954154080 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff954154460 0x7ff9540a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff954154460 0x7ff9540a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38900/0 (socket says 172.21.15.52:38900) 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 -- 172.21.15.52:0/3579645367 learned_addr learned my addr 172.21.15.52:0/3579645367 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff95259c700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff9540aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 -- 172.21.15.52:0/3579645367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 msgr2=0x7ff9540aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff9540aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 -- 172.21.15.52:0/3579645367 >> v1:172.21.15.172:6789/0 conn(0x7ff9540aa140 legacy=0x7ff954068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 -- 172.21.15.52:0/3579645367 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540c88b0 con 0x7ff954154460 2023-05-10T01:26:37.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff95259c700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff9540aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff951d9b700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff9540a9c50 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7ff948006fd0 tx=0x7ff9480090f0).ready entity=mon.0 client_cookie=145d6bdfb135254b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff95159a700 1 -- 172.21.15.52:0/3579645367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800b600 con 0x7ff954154460 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff95159a700 1 -- 172.21.15.52:0/3579645367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800b760 con 0x7ff954154460 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.719+0000 7ff95159a700 1 -- 172.21.15.52:0/3579645367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800bae0 con 0x7ff954154460 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 -- 172.21.15.52:0/3579645367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 msgr2=0x7ff9540a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff9540a9c50 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7ff948006fd0 tx=0x7ff9480090f0).stop 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 -- 172.21.15.52:0/3579645367 shutdown_connections 2023-05-10T01:26:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff9540aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 --2- 172.21.15.52:0/3579645367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff9540a9c50 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 -- 172.21.15.52:0/3579645367 >> 172.21.15.52:0/3579645367 conn(0x7ff954067910 msgr2=0x7ff9540cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:37.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 -- 172.21.15.52:0/3579645367 shutdown_connections 2023-05-10T01:26:37.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.720+0000 7ff9589c4700 1 -- 172.21.15.52:0/3579645367 wait complete. 2023-05-10T01:26:37.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.721+0000 7ff9589c4700 1 Processor -- start 2023-05-10T01:26:37.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.721+0000 7ff9589c4700 1 -- start start 2023-05-10T01:26:37.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9540aa140 0x7ff9540c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff95414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954150430 con 0x7ff954154460 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954153920 con 0x7ff9540aa140 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff9589c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c4650 con 0x7ff954154080 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38908/0 (socket says 172.21.15.52:38908) 2023-05-10T01:26:37.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 -- 172.21.15.52:0/1784881868 learned_addr learned my addr 172.21.15.52:0/1784881868 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff951d9b700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff95414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff95259c700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9540aa140 0x7ff9540c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 -- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 msgr2=0x7ff95414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff95414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 -- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9540aa140 msgr2=0x7ff9540c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9540aa140 0x7ff9540c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 -- 172.21.15.52:0/1784881868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009370 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.722+0000 7ff952d9d700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7ff94400b460 tx=0x7ff944006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012410 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9440125b0 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540c4930 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012970 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540c4ef0 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.723+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954066720 con 0x7ff954154460 2023-05-10T01:26:37.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.724+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7ff94400f030 con 0x7ff954154460 2023-05-10T01:26:37.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.724+0000 7ff9427fc700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 0x7ff930061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:37.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.724+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7ff944079630 con 0x7ff954154460 2023-05-10T01:26:37.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.725+0000 7ff95259c700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 0x7ff930061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:37.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.725+0000 7ff95259c700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 0x7ff930061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff94c00d6e0 tx=0x7ff94c007850).ready entity=mgr.7258 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:37.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.729+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff94404a9b0 con 0x7ff954154460 2023-05-10T01:26:37.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.926+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9540c50e0 con 0x7ff93005ed40 2023-05-10T01:26:37.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.930+0000 7ff9427fc700 1 -- 172.21.15.52:0/1784881868 <== mgr.7258 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff9540c50e0 con 0x7ff93005ed40 2023-05-10T01:26:37.934 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path snap_test_dir1 2023-05-10T01:26:37.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 msgr2=0x7ff930061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 0x7ff930061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff94c00d6e0 tx=0x7ff94c007850).stop 2023-05-10T01:26:37.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 msgr2=0x7ff95414ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:37.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7ff94400b460 tx=0x7ff944006f20).stop 2023-05-10T01:26:37.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 shutdown_connections 2023-05-10T01:26:37.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff93005ed40 0x7ff930061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff954154460 0x7ff95414ff40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9540aa140 0x7ff9540c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 --2- 172.21.15.52:0/1784881868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff954154080 0x7ff95414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 >> 172.21.15.52:0/1784881868 conn(0x7ff954067910 msgr2=0x7ff95414d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 shutdown_connections 2023-05-10T01:26:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:37.932+0000 7ff9589c4700 1 -- 172.21.15.52:0/1784881868 wait complete. 2023-05-10T01:26:37.947 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-10T01:26:37.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-05-10T01:26:38.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.064+0000 7fca534b6700 1 Processor -- start 2023-05-10T01:26:38.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.064+0000 7fca534b6700 1 -- start start 2023-05-10T01:26:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca534b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca4c0c5d20 0x7fca4c0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca534b6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0ca5f0 con 0x7fca4c0c6100 2023-05-10T01:26:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca534b6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c154630 con 0x7fca4c153a90 2023-05-10T01:26:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca534b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c8820 con 0x7fca4c0c5d20 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca50a51700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca4c0c6100 0x7fca4c069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47930/0 (socket says 172.21.15.52:47930) 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca50a51700 1 -- 172.21.15.52:0/740615029 learned_addr learned my addr 172.21.15.52:0/740615029 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca4c0c5d20 0x7fca4c0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623021825 0 0) 0x7fca4c0ca5f0 con 0x7fca4c0c6100 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca340033f0 con 0x7fca4c0c6100 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63642459 0 0) 0x7fca4c154630 con 0x7fca4c153a90 2023-05-10T01:26:38.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca4c0ca5f0 con 0x7fca4c153a90 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740901888 0 0) 0x7fca340033f0 con 0x7fca4c0c6100 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca4c0c5d20 msgr2=0x7fca4c0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca4c0c5d20 0x7fca4c0aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 >> v1:172.21.15.172:6789/0 conn(0x7fca4c153a90 legacy=0x7fca4c153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0c8b00 con 0x7fca4c0c6100 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fca3c001470 con 0x7fca4c0c6100 2023-05-10T01:26:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.065+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 >> v1:172.21.15.52:6789/0 conn(0x7fca4c0c6100 legacy=0x7fca4c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003aa0 0x7fca34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34004690 0x7fca34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34005000 0x7fca3400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c8820 con 0x7fca34003aa0 2023-05-10T01:26:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3400bdd0 con 0x7fca34005000 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3400bf90 con 0x7fca34004690 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca4c0c5d20 0x7fca4c0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003aa0 0x7fca34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51a53700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34005000 0x7fca3400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca50a51700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34004690 0x7fca34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 -- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34004690 msgr2=0x7fca34004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34004690 0x7fca34004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 -- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34005000 msgr2=0x7fca3400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34005000 0x7fca3400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 -- 172.21.15.52:0/740615029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340033f0 con 0x7fca34003aa0 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca51252700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003aa0 0x7fca34003ea0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fca4c0cabf0 tx=0x7fca48009060).ready entity=mon.0 client_cookie=3ea4a7b8dd6cea08 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca480094d0 con 0x7fca34003aa0 2023-05-10T01:26:38.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800e640 con 0x7fca34003aa0 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.066+0000 7fca3bfff700 1 -- 172.21.15.52:0/740615029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800ea00 con 0x7fca34003aa0 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 -- 172.21.15.52:0/740615029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003aa0 msgr2=0x7fca34003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 --2- 172.21.15.52:0/740615029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003aa0 0x7fca34003ea0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fca4c0cabf0 tx=0x7fca48009060).stop 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca51a53700 1 -- 172.21.15.52:0/740615029 reap_dead start 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 -- 172.21.15.52:0/740615029 shutdown_connections 2023-05-10T01:26:38.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 -- 172.21.15.52:0/740615029 >> 172.21.15.52:0/740615029 conn(0x7fca4c0cb6f0 msgr2=0x7fca4c0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 -- 172.21.15.52:0/740615029 shutdown_connections 2023-05-10T01:26:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.067+0000 7fca534b6700 1 -- 172.21.15.52:0/740615029 wait complete. 2023-05-10T01:26:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.068+0000 7fca534b6700 1 Processor -- start 2023-05-10T01:26:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.068+0000 7fca534b6700 1 -- start start 2023-05-10T01:26:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34003aa0 0x7fca4c0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca4c0c4b10 0x7fca4c0afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca4c14c990 0x7fca4c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c14d300 con 0x7fca4c14c990 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c164a80 con 0x7fca4c0c4b10 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca534b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c1579f0 con 0x7fca34003aa0 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca4c14c990 0x7fca4c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca4c14c990 0x7fca4c14ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38926/0 (socket says 172.21.15.52:38926) 2023-05-10T01:26:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 -- 172.21.15.52:0/67762495 learned_addr learned my addr 172.21.15.52:0/67762495 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51252700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34003aa0 0x7fca4c0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca50a51700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca4c0c4b10 0x7fca4c0afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 -- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34003aa0 msgr2=0x7fca4c0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca34003aa0 0x7fca4c0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 -- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca4c0c4b10 msgr2=0x7fca4c0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca4c0c4b10 0x7fca4c0afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 -- 172.21.15.52:0/67762495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c157cd0 con 0x7fca4c14c990 2023-05-10T01:26:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.069+0000 7fca51a53700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca4c14c990 0x7fca4c14ce10 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fca4c153e70 tx=0x7fca44007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400c5a0 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400c700 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca534b6700 1 -- 172.21.15.52:0/67762495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c157fb0 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400cac0 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca534b6700 1 -- 172.21.15.52:0/67762495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c0a9c70 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.070+0000 7fca534b6700 1 -- 172.21.15.52:0/67762495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c066720 con 0x7fca4c14c990 2023-05-10T01:26:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.071+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fca4401b030 con 0x7fca4c14c990 2023-05-10T01:26:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.071+0000 7fca397fa700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fca2c05ed40 0x7fca2c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.071+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fca44079590 con 0x7fca4c14c990 2023-05-10T01:26:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.071+0000 7fca51252700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fca2c05ed40 0x7fca2c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.072+0000 7fca51252700 1 --2- 172.21.15.52:0/67762495 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fca2c05ed40 0x7fca2c061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fca48006a10 tx=0x7fca48019000).ready entity=mgr.7258 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.075+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca4404aa20 con 0x7fca4c14c990 2023-05-10T01:26:38.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.273+0000 7fca534b6700 1 -- 172.21.15.52:0/67762495 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fca4c06c340 con 0x7fca2c05ed40 2023-05-10T01:26:38.278 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:38.275+0000 7ff8d23e2700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-05-10T01:26:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.275+0000 7fca397fa700 1 -- 172.21.15.52:0/67762495 <== mgr.7258 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fca4c06c340 con 0x7fca2c05ed40 2023-05-10T01:26:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-05-10T01:26:38.282 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-05-10T01:26:38.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:38.284 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:26:38.300 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:26:38.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.455+0000 7fed62fe0700 1 Processor -- start 2023-05-10T01:26:38.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.455+0000 7fed62fe0700 1 -- start start 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed62fe0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed5c0c1150 0x7fed5c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed62fe0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c06a130 con 0x7fed5c153f80 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed62fe0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c06a410 con 0x7fed5c0c61e0 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed62fe0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c069f50 con 0x7fed5c0c1150 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed617dd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed5c0c1150 0x7fed5c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed61fde700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fed5c153f80 0x7fed5c0a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47948/0 (socket says 172.21.15.52:47948) 2023-05-10T01:26:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed61fde700 1 -- 172.21.15.52:0/1333754611 learned_addr learned my addr 172.21.15.52:0/1333754611 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed617dd700 1 -- 172.21.15.52:0/1333754611 >> v1:172.21.15.172:6789/0 conn(0x7fed5c0c61e0 legacy=0x7fed5c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed617dd700 1 -- 172.21.15.52:0/1333754611 >> v1:172.21.15.52:6789/0 conn(0x7fed5c153f80 legacy=0x7fed5c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed60fdc700 1 -- 172.21.15.52:0/1333754611 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963205804 0 0) 0x7fed5c06a130 con 0x7fed5c153f80 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed617dd700 1 -- 172.21.15.52:0/1333754611 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c06a6f0 con 0x7fed5c0c1150 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed617dd700 1 --2- 172.21.15.52:0/1333754611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c0c5cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fed50009760 tx=0x7fed50009060).ready entity=mon.0 client_cookie=24512b360893c829 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed60fdc700 1 -- 172.21.15.52:0/1333754611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000b580 con 0x7fed5c0c1150 2023-05-10T01:26:38.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.456+0000 7fed60fdc700 1 -- 172.21.15.52:0/1333754611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000b6e0 con 0x7fed5c0c1150 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed60fdc700 1 -- 172.21.15.52:0/1333754611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000ba60 con 0x7fed5c0c1150 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 -- 172.21.15.52:0/1333754611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 msgr2=0x7fed5c0c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 --2- 172.21.15.52:0/1333754611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c0c5cf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fed50009760 tx=0x7fed50009060).stop 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 -- 172.21.15.52:0/1333754611 shutdown_connections 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 --2- 172.21.15.52:0/1333754611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c0c5cf0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 -- 172.21.15.52:0/1333754611 >> 172.21.15.52:0/1333754611 conn(0x7fed5c0cb5f0 msgr2=0x7fed5c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 -- 172.21.15.52:0/1333754611 shutdown_connections 2023-05-10T01:26:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.457+0000 7fed62fe0700 1 -- 172.21.15.52:0/1333754611 wait complete. 2023-05-10T01:26:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.458+0000 7fed62fe0700 1 Processor -- start 2023-05-10T01:26:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.458+0000 7fed62fe0700 1 -- start start 2023-05-10T01:26:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5c0c61e0 0x7fed5c144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 0x7fed5c1454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c164190 con 0x7fed5c0c1150 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c2870 con 0x7fed5c0c61e0 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed62fe0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c1c60 con 0x7fed5c153f80 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38938/0 (socket says 172.21.15.52:38938) 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 -- 172.21.15.52:0/2710355571 learned_addr learned my addr 172.21.15.52:0/2710355571 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed617dd700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5c0c61e0 0x7fed5c144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed627df700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 0x7fed5c1454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 -- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 msgr2=0x7fed5c1454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 0x7fed5c1454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 -- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5c0c61e0 msgr2=0x7fed5c144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5c0c61e0 0x7fed5c144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed61fde700 1 -- 172.21.15.52:0/2710355571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500092a0 con 0x7fed5c0c1150 2023-05-10T01:26:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.459+0000 7fed627df700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 0x7fed5c1454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed61fde700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fed5400c810 tx=0x7fed54001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54005d30 con 0x7fed5c0c1150 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54005e90 con 0x7fed5c0c1150 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0c1f40 con 0x7fed5c0c1150 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54007320 con 0x7fed5c0c1150 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.460+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0c2500 con 0x7fed5c0c1150 2023-05-10T01:26:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.461+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c083110 con 0x7fed5c0c1150 2023-05-10T01:26:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.461+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 50) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fed54010030 con 0x7fed5c0c1150 2023-05-10T01:26:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.461+0000 7fed59ffb700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 0x7fed3c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.462+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fed54079b60 con 0x7fed5c0c1150 2023-05-10T01:26:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.462+0000 7fed617dd700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 0x7fed3c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.462+0000 7fed617dd700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 0x7fed3c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed5c0c15e0 tx=0x7fed50017000).ready entity=mgr.7258 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:38.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.466+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed5404aff0 con 0x7fed5c0c1150 2023-05-10T01:26:38.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.568+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 51) v1 ==== 75379+0+0 (secure 0 0 0) 0x7fed54077950 con 0x7fed5c0c1150 2023-05-10T01:26:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:38.688+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fed5c047150 con 0x7fed5c0c1150 2023-05-10T01:26:39.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.574+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fed54077cd0 con 0x7fed5c0c1150 2023-05-10T01:26:39.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.575+0000 7fed59ffb700 1 -- 172.21.15.52:0/2710355571 <== mon.0 v2:172.21.15.52:3300/0 9 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v52) v1 ==== 93+0+0 (secure 0 0 0) 0x7fed5404c000 con 0x7fed5c0c1150 2023-05-10T01:26:39.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 msgr2=0x7fed3c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 0x7fed3c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fed5c0c15e0 tx=0x7fed50017000).stop 2023-05-10T01:26:39.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 msgr2=0x7fed5c163ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fed5400c810 tx=0x7fed54001570).stop 2023-05-10T01:26:39.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 shutdown_connections 2023-05-10T01:26:39.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fed3c05ed40 0x7fed3c061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fed5c153f80 0x7fed5c1454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed5c0c1150 0x7fed5c163ca0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 --2- 172.21.15.52:0/2710355571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5c0c61e0 0x7fed5c144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 >> 172.21.15.52:0/2710355571 conn(0x7fed5c0cb5f0 msgr2=0x7fed5c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:39.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 shutdown_connections 2023-05-10T01:26:39.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.578+0000 7fed62fe0700 1 -- 172.21.15.52:0/2710355571 wait complete. 2023-05-10T01:26:39.597 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:26:39.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:39.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:39.658 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:26:39.659 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:26:39.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:26:39.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:26:39.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:26:39.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:26:39.715 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:26:39.727 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:39.724+0000 7f4360db8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:39.729 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:39.725+0000 7fd84eeaf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:26:39.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:39.789 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:39.787+0000 7f4360db8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:39.794 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:39.790+0000 7fd84eeaf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:26:39.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.898+0000 7fd6a35c7700 1 Processor -- start 2023-05-10T01:26:39.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.898+0000 7fd6a35c7700 1 -- start start 2023-05-10T01:26:39.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a35c7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd69c154160 0x7fd69c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a35c7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd69c154540 0x7fd69c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a35c7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0c0650 con 0x7fd69c069690 2023-05-10T01:26:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a35c7700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c0c1af0 con 0x7fd69c154160 2023-05-10T01:26:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a35c7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c0bfd20 con 0x7fd69c154540 2023-05-10T01:26:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1363700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd69c154160 0x7fd69c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1b64700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd69c069690 0x7fd69c157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48034/0 (socket says 172.21.15.52:48034) 2023-05-10T01:26:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1b64700 1 -- 172.21.15.52:0/2487883584 learned_addr learned my addr 172.21.15.52:0/2487883584 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a0b62700 1 --2- 172.21.15.52:0/2487883584 >> v2:172.21.15.172:3300/0 conn(0x7fd69c154540 0x7fd69c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1363700 1 -- 172.21.15.52:0/2487883584 >> v2:172.21.15.172:3300/0 conn(0x7fd69c154540 msgr2=0x7fd69c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1363700 1 --2- 172.21.15.52:0/2487883584 >> v2:172.21.15.172:3300/0 conn(0x7fd69c154540 0x7fd69c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1363700 1 -- 172.21.15.52:0/2487883584 >> v1:172.21.15.52:6789/0 conn(0x7fd69c069690 legacy=0x7fd69c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd6a1363700 1 -- 172.21.15.52:0/2487883584 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0c0000 con 0x7fd69c154160 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.899+0000 7fd68bfff700 1 -- 172.21.15.52:0/2487883584 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692386003 0 0) 0x7fd69c0c0650 con 0x7fd69c069690 2023-05-10T01:26:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a1363700 1 --2- 172.21.15.52:0/2487883584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c154160 0x7fd69c0c5c60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fd69c06a780 tx=0x7fd68c009060).ready entity=mon.0 client_cookie=f62b873deecda091 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd68bfff700 1 -- 172.21.15.52:0/2487883584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f510 con 0x7fd69c154160 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd68bfff700 1 -- 172.21.15.52:0/2487883584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00f670 con 0x7fd69c154160 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd68bfff700 1 -- 172.21.15.52:0/2487883584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f9f0 con 0x7fd69c154160 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 -- 172.21.15.52:0/2487883584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c154160 msgr2=0x7fd69c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/2487883584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c154160 0x7fd69c0c5c60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fd69c06a780 tx=0x7fd68c009060).stop 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 -- 172.21.15.52:0/2487883584 shutdown_connections 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/2487883584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c154160 0x7fd69c0c5c60 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/2487883584 >> v2:172.21.15.172:3300/0 conn(0x7fd69c154540 0x7fd69c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 -- 172.21.15.52:0/2487883584 >> 172.21.15.52:0/2487883584 conn(0x7fd69c0cb740 msgr2=0x7fd69c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:39.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 -- 172.21.15.52:0/2487883584 shutdown_connections 2023-05-10T01:26:39.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.900+0000 7fd6a35c7700 1 -- 172.21.15.52:0/2487883584 wait complete. 2023-05-10T01:26:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 Processor -- start 2023-05-10T01:26:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 -- start start 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd69c154160 0x7fd69c167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69c154540 0x7fd69c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c1689e0 con 0x7fd69c069690 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c156fc0 con 0x7fd69c154540 2023-05-10T01:26:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.902+0000 7fd6a35c7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c168420 con 0x7fd69c154160 2023-05-10T01:26:39.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:39.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39020/0 (socket says 172.21.15.52:39020) 2023-05-10T01:26:39.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 -- 172.21.15.52:0/3255586913 learned_addr learned my addr 172.21.15.52:0/3255586913 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:39.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a0b62700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd69c154160 0x7fd69c167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1b64700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69c154540 0x7fd69c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd69c154160 msgr2=0x7fd69c167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd69c154160 0x7fd69c167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69c154540 msgr2=0x7fd69c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69c154540 0x7fd69c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:39.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 -- 172.21.15.52:0/3255586913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0092a0 con 0x7fd69c069690 2023-05-10T01:26:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a1363700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fd68c009dd0 tx=0x7fd68c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f7e0 con 0x7fd69c069690 2023-05-10T01:26:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00f940 con 0x7fd69c069690 2023-05-10T01:26:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c01b660 con 0x7fd69c069690 2023-05-10T01:26:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c168700 con 0x7fd69c069690 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.903+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c0c4db0 con 0x7fd69c069690 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.904+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c0666b0 con 0x7fd69c069690 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.905+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd68c02b070 con 0x7fd69c069690 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.905+0000 7fd6897fa700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 0x7fd67c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.905+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fd68c07b4c0 con 0x7fd69c069690 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.905+0000 7fd6a0b62700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 msgr2=0x7fd67c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:39.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.905+0000 7fd6a0b62700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 0x7fd67c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:39.913+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd68c04c7e0 con 0x7fd69c069690 2023-05-10T01:26:40.062 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:40.059+0000 7f4360db8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:40.087 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:40.084+0000 7fd84eeaf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:26:40.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.106+0000 7fd6a0b62700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 msgr2=0x7fd67c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:40.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.106+0000 7fd6a0b62700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 0x7fd67c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:40.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.135+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd69c0c4fa0 con 0x7fd69c069690 2023-05-10T01:26:40.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.135+0000 7fd6897fa700 1 -- 172.21.15.52:0/3255586913 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fd68c029090 con 0x7fd69c069690 2023-05-10T01:26:40.139 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:40.140 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.137+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 msgr2=0x7fd67c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.137+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 0x7fd67c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.137+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 msgr2=0x7fd69c1428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.137+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fd68c009dd0 tx=0x7fd68c017000).stop 2023-05-10T01:26:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 shutdown_connections 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd67c05ede0 0x7fd67c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69c154540 0x7fd69c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c069690 0x7fd69c1428b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 --2- 172.21.15.52:0/3255586913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd69c154160 0x7fd69c167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 >> 172.21.15.52:0/3255586913 conn(0x7fd69c0cb740 msgr2=0x7fd69c0aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 shutdown_connections 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.138+0000 7fd6a35c7700 1 -- 172.21.15.52:0/3255586913 wait complete. 2023-05-10T01:26:40.143 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:40.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:40.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.308+0000 7fe43a31c700 1 Processor -- start 2023-05-10T01:26:40.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.308+0000 7fe43a31c700 1 -- start start 2023-05-10T01:26:40.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43a31c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4340c7370 0x7fe434154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43a31c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe434158960 con 0x7fe4340ad250 2023-05-10T01:26:40.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43a31c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340ad6b0 con 0x7fe4340c7750 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43a31c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe434155330 con 0x7fe4340c7370 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe439b1b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe4340ad250 0x7fe43414dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48094/0 (socket says 172.21.15.52:48094) 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe439b1b700 1 -- 172.21.15.52:0/2245948956 learned_addr learned my addr 172.21.15.52:0/2245948956 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43931a700 1 --2- 172.21.15.52:0/2245948956 >> v2:172.21.15.172:3300/0 conn(0x7fe4340c7370 0x7fe434154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe423fff700 1 -- 172.21.15.52:0/2245948956 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080472083 0 0) 0x7fe434158960 con 0x7fe4340ad250 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe423fff700 1 -- 172.21.15.52:0/2245948956 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe41c0033f0 con 0x7fe4340ad250 2023-05-10T01:26:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43931a700 1 -- 172.21.15.52:0/2245948956 >> v1:172.21.15.172:6789/0 conn(0x7fe4340c7750 legacy=0x7fe4340acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.309+0000 7fe43931a700 1 -- 172.21.15.52:0/2245948956 >> v1:172.21.15.52:6789/0 conn(0x7fe4340ad250 legacy=0x7fe43414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43931a700 1 -- 172.21.15.52:0/2245948956 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434157d50 con 0x7fe4340c7370 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43931a700 1 --2- 172.21.15.52:0/2245948956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340c7370 0x7fe434154e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fe430009760 tx=0x7fe430009060).ready entity=mon.1 client_cookie=1cb8b63cd2a643bf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe423fff700 1 -- 172.21.15.52:0/2245948956 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000f510 con 0x7fe4340c7370 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe423fff700 1 -- 172.21.15.52:0/2245948956 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000f670 con 0x7fe4340c7370 2023-05-10T01:26:40.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe423fff700 1 -- 172.21.15.52:0/2245948956 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000f9f0 con 0x7fe4340c7370 2023-05-10T01:26:40.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43a31c700 1 -- 172.21.15.52:0/2245948956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340c7370 msgr2=0x7fe434154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2245948956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340c7370 0x7fe434154e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fe430009760 tx=0x7fe430009060).stop 2023-05-10T01:26:40.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43a31c700 1 -- 172.21.15.52:0/2245948956 shutdown_connections 2023-05-10T01:26:40.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2245948956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340c7370 0x7fe434154e40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.310+0000 7fe43a31c700 1 -- 172.21.15.52:0/2245948956 >> 172.21.15.52:0/2245948956 conn(0x7fe434068320 msgr2=0x7fe434068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.311+0000 7fe43a31c700 1 -- 172.21.15.52:0/2245948956 shutdown_connections 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.311+0000 7fe43a31c700 1 -- 172.21.15.52:0/2245948956 wait complete. 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.312+0000 7fe43a31c700 1 Processor -- start 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.312+0000 7fe43a31c700 1 -- start start 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 0x7fe43414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4340c7750 0x7fe4341647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c3240 con 0x7fe4340c7370 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43414cd00 con 0x7fe4340ad250 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43a31c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe434164da0 con 0x7fe4340c7750 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39082/0 (socket says 172.21.15.52:39082) 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 -- 172.21.15.52:0/2273248647 learned_addr learned my addr 172.21.15.52:0/2273248647 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43931a700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 0x7fe43414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe439b1b700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4340c7750 0x7fe4341647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 -- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4340c7750 msgr2=0x7fe4341647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4340c7750 0x7fe4341647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 -- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 msgr2=0x7fe43414c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 0x7fe43414c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 -- 172.21.15.52:0/2273248647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300092a0 con 0x7fe4340c7370 2023-05-10T01:26:40.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe43931a700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 0x7fe43414c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.313+0000 7fe438b19700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe42400c440 tx=0x7fe424007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424007020 con 0x7fe4340c7370 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424007180 con 0x7fe4340c7370 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe434165080 con 0x7fe4340c7370 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424007520 con 0x7fe4340c7370 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4340c3770 con 0x7fe4340c7370 2023-05-10T01:26:40.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.314+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4341652c0 con 0x7fe4340c7370 2023-05-10T01:26:40.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.315+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe424010070 con 0x7fe4340c7370 2023-05-10T01:26:40.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.315+0000 7fe4217fa700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 0x7fe4140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.315+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fe424078f00 con 0x7fe4340c7370 2023-05-10T01:26:40.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.315+0000 7fe43931a700 1 -- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 msgr2=0x7fe4140612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:40.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.316+0000 7fe43931a700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 0x7fe4140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:40.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.320+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe4240478f0 con 0x7fe4340c7370 2023-05-10T01:26:40.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.494+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4340c3960 con 0x7fe4340c7370 2023-05-10T01:26:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.495+0000 7fe4217fa700 1 -- 172.21.15.52:0/2273248647 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17691 (secure 0 0 0) 0x7fe42404a220 con 0x7fe4340c7370 2023-05-10T01:26:40.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:40.500 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:35.711251+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:6832/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3286885938":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3835510018":"2023-05-11T01:26:35.711223+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.497+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 msgr2=0x7fe4140612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:40.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.497+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 0x7fe4140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.497+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 msgr2=0x7fe4341642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.497+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe42400c440 tx=0x7fe424007e00).stop 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 shutdown_connections 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe41405ede0 0x7fe4140612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4340c7750 0x7fe4341647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4340ad250 0x7fe43414c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 --2- 172.21.15.52:0/2273248647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340c7370 0x7fe4341642e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 >> 172.21.15.52:0/2273248647 conn(0x7fe434068320 msgr2=0x7fe434153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:40.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 shutdown_connections 2023-05-10T01:26:40.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.498+0000 7fe43a31c700 1 -- 172.21.15.52:0/2273248647 wait complete. 2023-05-10T01:26:40.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:26:16.641028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:26:17.917984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:26:40.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:26:40.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 Processor -- start 2023-05-10T01:26:40.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 -- start start 2023-05-10T01:26:40.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe8067070 0x7febe80bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80bc8a0 con 0x7febe80bd7e0 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8068810 con 0x7febe8155b80 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.636+0000 7febee9a3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80bdc90 con 0x7febe8067070 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febecf40700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7febe80bd7e0 0x7febe80a6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48108/0 (socket says 172.21.15.52:48108) 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febecf40700 1 -- 172.21.15.52:0/2932971500 learned_addr learned my addr 172.21.15.52:0/2932971500 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:40.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe77fe700 1 --2- 172.21.15.52:0/2932971500 >> v2:172.21.15.172:3300/0 conn(0x7febe8067070 0x7febe80bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715298828 0 0) 0x7febe80bc8a0 con 0x7febe80bd7e0 2023-05-10T01:26:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc80033f0 con 0x7febe80bd7e0 2023-05-10T01:26:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175514858 0 0) 0x7febc80033f0 con 0x7febe80bd7e0 2023-05-10T01:26:40.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 >> v2:172.21.15.172:3300/0 conn(0x7febe8067070 msgr2=0x7febe80bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 --2- 172.21.15.52:0/2932971500 >> v2:172.21.15.172:3300/0 conn(0x7febe8067070 0x7febe80bd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 >> v1:172.21.15.172:6789/0 conn(0x7febe8155b80 legacy=0x7febe8064e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8068a90 con 0x7febe80bd7e0 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7febe00017f0 con 0x7febe80bd7e0 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 >> v1:172.21.15.52:6789/0 conn(0x7febe80bd7e0 legacy=0x7febe80a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febc80038e0 0x7febc8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8004690 0x7febc8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 0x7febc800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc800bf60 con 0x7febc8005000 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc800c0a0 con 0x7febc8004690 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc800c230 con 0x7febc80038e0 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.637+0000 7febecf40700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 0x7febc800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febe7fff700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febc80038e0 0x7febc8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 -- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febc80038e0 msgr2=0x7febc8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febc80038e0 0x7febc8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 -- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8004690 msgr2=0x7febc8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8004690 0x7febc8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 -- 172.21.15.52:0/2932971500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80033f0 con 0x7febc8005000 2023-05-10T01:26:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 -- 172.21.15.52:0/2932971500 reap_dead start 2023-05-10T01:26:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febecf40700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 0x7febc800b8e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7febe000c5f0 tx=0x7febe8067520).ready entity=mon.0 client_cookie=bbb926ae0253060b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cdf0 con 0x7febc8005000 2023-05-10T01:26:40.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0005b20 con 0x7febc8005000 2023-05-10T01:26:40.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febe6ffd700 1 -- 172.21.15.52:0/2932971500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0005ea0 con 0x7febc8005000 2023-05-10T01:26:40.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.638+0000 7febee9a3700 1 -- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 msgr2=0x7febc800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 0x7febc800b8e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7febe000c5f0 tx=0x7febe8067520).stop 2023-05-10T01:26:40.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 -- 172.21.15.52:0/2932971500 shutdown_connections 2023-05-10T01:26:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 --2- 172.21.15.52:0/2932971500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc8005000 0x7febc800b8e0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 -- 172.21.15.52:0/2932971500 >> 172.21.15.52:0/2932971500 conn(0x7febe80c8410 msgr2=0x7febe80c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 -- 172.21.15.52:0/2932971500 shutdown_connections 2023-05-10T01:26:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.639+0000 7febee9a3700 1 -- 172.21.15.52:0/2932971500 wait complete. 2023-05-10T01:26:40.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.640+0000 7febee9a3700 1 Processor -- start 2023-05-10T01:26:40.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.640+0000 7febee9a3700 1 -- start start 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8005000 0x7febe8163620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febe80ac300 0x7febe80ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80c18e0 con 0x7febe80c1460 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8164830 con 0x7febc8005000 2023-05-10T01:26:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80acc70 con 0x7febe80ac300 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39102/0 (socket says 172.21.15.52:39102) 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 -- 172.21.15.52:0/2103533112 learned_addr learned my addr 172.21.15.52:0/2103533112 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe7fff700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8005000 0x7febe8163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febecf40700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febe80ac300 0x7febe80ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febe80ac300 msgr2=0x7febe80ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febe80ac300 0x7febe80ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8005000 msgr2=0x7febe8163620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8005000 0x7febe8163620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 -- 172.21.15.52:0/2103533112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8163c20 con 0x7febe80c1460 2023-05-10T01:26:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febe77fe700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7febd000e930 tx=0x7febd0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0012600 con 0x7febe80c1460 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0012760 con 0x7febe80c1460 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0012b00 con 0x7febe80c1460 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.641+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe8163f00 con 0x7febe80c1460 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.642+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe81644c0 con 0x7febe80c1460 2023-05-10T01:26:40.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.642+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8164650 con 0x7febe80c1460 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.643+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7febd0022070 con 0x7febe80c1460 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.644+0000 7febdffff700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 0x7febcc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.644+0000 7febe7fff700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 msgr2=0x7febcc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.644+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7febd007a660 con 0x7febe80c1460 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.644+0000 7febe7fff700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 0x7febcc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.647+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febd004b980 con 0x7febe80c1460 2023-05-10T01:26:40.674 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:40.671+0000 7f4360db8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:40.746 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:40.743+0000 7f4360db8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:40.764 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:40.760+0000 7fd84eeaf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:26:40.834 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:40.831+0000 7fd84eeaf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:26:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.845+0000 7febe7fff700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 msgr2=0x7febcc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:40.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.845+0000 7febe7fff700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 0x7febcc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.886+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7febe806c340 con 0x7febe80c1460 2023-05-10T01:26:40.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.887+0000 7febdffff700 1 -- 172.21.15.52:0/2103533112 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v123) v1 ==== 110+0+10 (secure 0 0 0) 0x7febd0016020 con 0x7febe80c1460 2023-05-10T01:26:40.891 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 msgr2=0x7febcc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 0x7febcc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 msgr2=0x7febe80a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7febd000e930 tx=0x7febd0009060).stop 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 shutdown_connections 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7febcc05ede0 0x7febcc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febe80ac300 0x7febe80ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc8005000 0x7febe8163620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 --2- 172.21.15.52:0/2103533112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febe80c1460 0x7febe80a0620 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 >> 172.21.15.52:0/2103533112 conn(0x7febe80c8410 msgr2=0x7febe80be030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 shutdown_connections 2023-05-10T01:26:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:40.889+0000 7febee9a3700 1 -- 172.21.15.52:0/2103533112 wait complete. 2023-05-10T01:26:40.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:26:40.930 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:40.928+0000 7f4360db8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.025+0000 7f66cd3a3700 1 Processor -- start 2023-05-10T01:26:41.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.025+0000 7f66cd3a3700 1 -- start start 2023-05-10T01:26:41.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66cd3a3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66c80a6da0 0x7f66c8069100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66cd3a3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 0x7f66c80659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66cd3a3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c8069a80 con 0x7f66c81509e0 2023-05-10T01:26:41.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66cd3a3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8065560 con 0x7f66c80a6da0 2023-05-10T01:26:41.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66cd3a3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80a7220 con 0x7f66c80695f0 2023-05-10T01:26:41.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c6ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66c81509e0 0x7f66c8150dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48160/0 (socket says 172.21.15.52:48160) 2023-05-10T01:26:41.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c6ffd700 1 -- 172.21.15.52:0/2211477850 learned_addr learned my addr 172.21.15.52:0/2211477850 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:41.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c77fe700 1 --2- 172.21.15.52:0/2211477850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 0x7f66c80659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c67fc700 1 --2- 172.21.15.52:0/2211477850 >> v2:172.21.15.172:3300/0 conn(0x7f66c80a6da0 0x7f66c8069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010498320 0 0) 0x7f66c8069a80 con 0x7f66c81509e0 2023-05-10T01:26:41.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66b40033f0 con 0x7f66c81509e0 2023-05-10T01:26:41.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c77fe700 1 -- 172.21.15.52:0/2211477850 >> v2:172.21.15.172:3300/0 conn(0x7f66c80a6da0 msgr2=0x7f66c8069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:41.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c77fe700 1 --2- 172.21.15.52:0/2211477850 >> v2:172.21.15.172:3300/0 conn(0x7f66c80a6da0 0x7f66c8069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c77fe700 1 -- 172.21.15.52:0/2211477850 >> v1:172.21.15.52:6789/0 conn(0x7f66c81509e0 legacy=0x7f66c8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183573708 0 0) 0x7f66b40033f0 con 0x7f66c81509e0 2023-05-10T01:26:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.026+0000 7f66c77fe700 1 -- 172.21.15.52:0/2211477850 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c81514d0 con 0x7f66c80695f0 2023-05-10T01:26:41.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66c77fe700 1 --2- 172.21.15.52:0/2211477850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 0x7f66c80659b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f66c0009e60 tx=0x7f66c0009780).ready entity=mon.2 client_cookie=90a9fb93cce1d4b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000e070 con 0x7f66c80695f0 2023-05-10T01:26:41.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000b7a0 con 0x7f66c80695f0 2023-05-10T01:26:41.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66c5ffb700 1 -- 172.21.15.52:0/2211477850 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc001470 con 0x7f66c80695f0 2023-05-10T01:26:41.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 -- 172.21.15.52:0/2211477850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 msgr2=0x7f66c80659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/2211477850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 0x7f66c80659b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f66c0009e60 tx=0x7f66c0009780).stop 2023-05-10T01:26:41.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 -- 172.21.15.52:0/2211477850 shutdown_connections 2023-05-10T01:26:41.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/2211477850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80695f0 0x7f66c80659b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/2211477850 >> v2:172.21.15.172:3300/0 conn(0x7f66c80a6da0 0x7f66c8069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 -- 172.21.15.52:0/2211477850 >> 172.21.15.52:0/2211477850 conn(0x7f66c80c8260 msgr2=0x7f66c80c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 -- 172.21.15.52:0/2211477850 shutdown_connections 2023-05-10T01:26:41.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.027+0000 7f66cd3a3700 1 -- 172.21.15.52:0/2211477850 wait complete. 2023-05-10T01:26:41.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 Processor -- start 2023-05-10T01:26:41.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 -- start start 2023-05-10T01:26:41.042 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.029+0000 7fd84eeaf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:26:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 0x7f66c80aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c81509e0 0x7f66c8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80a7c30 con 0x7f66c80695f0 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80ab230 con 0x7f66c81509e0 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66cd3a3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80ab510 con 0x7f66c80a6da0 2023-05-10T01:26:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66c6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66c6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39150/0 (socket says 172.21.15.52:39150) 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.029+0000 7f66c6ffd700 1 -- 172.21.15.52:0/1713595004 learned_addr learned my addr 172.21.15.52:0/1713595004 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c67fc700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 0x7f66c80aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c77fe700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c81509e0 0x7f66c8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 -- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 msgr2=0x7f66c80aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 0x7f66c80aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 -- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c81509e0 msgr2=0x7f66c8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c81509e0 0x7f66c8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 -- 172.21.15.52:0/1713595004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009a20 con 0x7f66c80695f0 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c67fc700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 0x7f66c80aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66c6ffd700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f66bc00e9d0 tx=0x7f66bc001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc016070 con 0x7f66c80695f0 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc007170 con 0x7f66c80695f0 2023-05-10T01:26:41.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80ab7f0 con 0x7f66c80695f0 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc007530 con 0x7f66c80695f0 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.030+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80abad0 con 0x7f66c80695f0 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.031+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c80a7a90 con 0x7f66c80695f0 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.032+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f66bc004ad0 con 0x7f66c80695f0 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.032+0000 7f66aeffd700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 0x7f66a80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.032+0000 7f66c67fc700 1 -- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 msgr2=0x7f66a80612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:41.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.032+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f66bc07c040 con 0x7f66c80695f0 2023-05-10T01:26:41.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.032+0000 7f66c67fc700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 0x7f66a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:41.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.036+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66c80a7a90 con 0x7f66c80695f0 2023-05-10T01:26:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.219+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66c80a7a90 con 0x7f66c80695f0 2023-05-10T01:26:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.220+0000 7f66aeffd700 1 -- 172.21.15.52:0/1713595004 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66c80a7a90 con 0x7f66c80695f0 2023-05-10T01:26:41.224 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:26:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 msgr2=0x7f66a80612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 0x7f66a80612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 msgr2=0x7f66c8140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f66bc00e9d0 tx=0x7f66bc001b30).stop 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 shutdown_connections 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f66a805ede0 0x7f66a80612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c81509e0 0x7f66c8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80695f0 0x7f66c8140210 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 --2- 172.21.15.52:0/1713595004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66c80a6da0 0x7f66c80aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 >> 172.21.15.52:0/1713595004 conn(0x7f66c80c8260 msgr2=0x7f66c80c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 shutdown_connections 2023-05-10T01:26:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.222+0000 7f66cd3a3700 1 -- 172.21.15.52:0/1713595004 wait complete. 2023-05-10T01:26:41.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:26:41.349 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:41.346+0000 7f4360db8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.357+0000 7f579eb34700 1 Processor -- start 2023-05-10T01:26:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.357+0000 7f579eb34700 1 -- start start 2023-05-10T01:26:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579eb34700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 0x7f57980aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579eb34700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980c94c0 con 0x7f5798154460 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579eb34700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980cb7d0 con 0x7f5798154080 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579eb34700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980c88b0 con 0x7f5798068860 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f5797fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5798154460 0x7f5798068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48176/0 (socket says 172.21.15.52:48176) 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f5797fff700 1 -- 172.21.15.52:0/1371776972 learned_addr learned my addr 172.21.15.52:0/1371776972 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579d0d1700 1 --2- 172.21.15.52:0/1371776972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 0x7f57980aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608789319 0 0) 0x7f57980c94c0 con 0x7f5798154460 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c0033f0 con 0x7f5798154460 2023-05-10T01:26:41.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177087511 0 0) 0x7f57980cb7d0 con 0x7f5798154080 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57980c94c0 con 0x7f5798154080 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579d0d1700 1 -- 172.21.15.52:0/1371776972 >> v1:172.21.15.172:6789/0 conn(0x7f5798154080 legacy=0x7f57980a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579d0d1700 1 -- 172.21.15.52:0/1371776972 >> v1:172.21.15.52:6789/0 conn(0x7f5798154460 legacy=0x7f5798068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.358+0000 7f579d0d1700 1 -- 172.21.15.52:0/1371776972 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57980c8b90 con 0x7f5798068860 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579d0d1700 1 --2- 172.21.15.52:0/1371776972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 0x7f57980aac90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5790009e90 tx=0x7f5790009780).ready entity=mon.2 client_cookie=5da254ef22648260 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000e070 con 0x7f5798068860 2023-05-10T01:26:41.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579000bab0 con 0x7f5798068860 2023-05-10T01:26:41.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f57977fe700 1 -- 172.21.15.52:0/1371776972 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000be30 con 0x7f5798068860 2023-05-10T01:26:41.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 -- 172.21.15.52:0/1371776972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 msgr2=0x7f57980aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 --2- 172.21.15.52:0/1371776972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 0x7f57980aac90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5790009e90 tx=0x7f5790009780).stop 2023-05-10T01:26:41.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 -- 172.21.15.52:0/1371776972 shutdown_connections 2023-05-10T01:26:41.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 --2- 172.21.15.52:0/1371776972 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798068860 0x7f57980aac90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 -- 172.21.15.52:0/1371776972 >> 172.21.15.52:0/1371776972 conn(0x7f5798067910 msgr2=0x7f57980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 -- 172.21.15.52:0/1371776972 shutdown_connections 2023-05-10T01:26:41.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.359+0000 7f579eb34700 1 -- 172.21.15.52:0/1371776972 wait complete. 2023-05-10T01:26:41.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.360+0000 7f579eb34700 1 Processor -- start 2023-05-10T01:26:41.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 -- start start 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798154080 0x7f57980c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798154460 0x7f57980afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980af160 con 0x7f5798068860 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579814d500 con 0x7f5798154460 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579eb34700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980c4ad0 con 0x7f5798154080 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.361+0000 7f579c8d0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39164/0 (socket says 172.21.15.52:39164) 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 -- 172.21.15.52:0/2999125055 learned_addr learned my addr 172.21.15.52:0/2999125055 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f5797fff700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798154080 0x7f57980c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579d0d1700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798154460 0x7f57980afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 -- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798154080 msgr2=0x7f57980c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798154080 0x7f57980c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 -- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798154460 msgr2=0x7f57980afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798154460 0x7f57980afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 -- 172.21.15.52:0/2999125055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009a20 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579c8d0700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f578c00c490 tx=0x7f578c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00ce40 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00f470 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00f810 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57980ae8c0 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.362+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57980aee80 con 0x7f5798068860 2023-05-10T01:26:41.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.363+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798066720 con 0x7f5798068860 2023-05-10T01:26:41.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.364+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f578c019030 con 0x7f5798068860 2023-05-10T01:26:41.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.364+0000 7f5794ff9700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 0x7f57800612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.364+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f578c079250 con 0x7f5798068860 2023-05-10T01:26:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.364+0000 7f5797fff700 1 -- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 msgr2=0x7f57800612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.364+0000 7f5797fff700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 0x7f57800612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.368+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f578c04a570 con 0x7f5798068860 2023-05-10T01:26:41.452 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:41.449+0000 7f4360db8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:41.483 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.480+0000 7fd84eeaf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:26:41.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.542+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f579806c3a0 con 0x7f5798068860 2023-05-10T01:26:41.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.543+0000 7f5794ff9700 1 -- 172.21.15.52:0/2999125055 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f578c04db90 con 0x7f5798068860 2023-05-10T01:26:41.547 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:26:41.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 msgr2=0x7f57800612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:41.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 0x7f57800612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 msgr2=0x7f579814d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f578c00c490 tx=0x7f578c007c90).stop 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 shutdown_connections 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f578005ede0 0x7f57800612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798154460 0x7f57980afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5798068860 0x7f579814d010 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 --2- 172.21.15.52:0/2999125055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5798154080 0x7f57980c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 >> 172.21.15.52:0/2999125055 conn(0x7f5798067910 msgr2=0x7f579814f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 shutdown_connections 2023-05-10T01:26:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.545+0000 7f579eb34700 1 -- 172.21.15.52:0/2999125055 wait complete. 2023-05-10T01:26:41.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:26:41.595 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.591+0000 7fd84eeaf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:41.605 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:41.602+0000 7f4360db8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:41.679 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:41.676+0000 7f4360db8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:41.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.682+0000 7fe3fdff0700 1 Processor -- start 2023-05-10T01:26:41.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.682+0000 7fe3fdff0700 1 -- start start 2023-05-10T01:26:41.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3fdff0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3f814e430 0x7fe3f8157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3fdff0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3f8154db0 0x7fe3f8066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3fdff0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80653a0 con 0x7fe3f8067330 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3fdff0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80677a0 con 0x7fe3f8154db0 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3fdff0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f8157ff0 con 0x7fe3f814e430 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3f8154db0 0x7fe3f8066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3f8154db0 0x7fe3f8066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39172/0 (socket says 172.21.15.52:39172) 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 -- 172.21.15.52:0/1730571590 learned_addr learned my addr 172.21.15.52:0/1730571590 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f77fe700 1 --2- 172.21.15.52:0/1730571590 >> v2:172.21.15.172:3300/0 conn(0x7fe3f814e430 0x7fe3f8157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 -- 172.21.15.52:0/1730571590 >> v2:172.21.15.172:3300/0 conn(0x7fe3f814e430 msgr2=0x7fe3f8157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 --2- 172.21.15.52:0/1730571590 >> v2:172.21.15.172:3300/0 conn(0x7fe3f814e430 0x7fe3f8157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 -- 172.21.15.52:0/1730571590 >> v1:172.21.15.172:6789/0 conn(0x7fe3f8067330 legacy=0x7fe3f8065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.683+0000 7fe3f6ffd700 1 -- 172.21.15.52:0/1730571590 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f81582d0 con 0x7fe3f8154db0 2023-05-10T01:26:41.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3f6ffd700 1 --2- 172.21.15.52:0/1730571590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f8066e40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fe3f80c7860 tx=0x7fe3e80090f0).ready entity=mon.0 client_cookie=1bca5c7315ce320c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3f67fc700 1 -- 172.21.15.52:0/1730571590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800b520 con 0x7fe3f8154db0 2023-05-10T01:26:41.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3f67fc700 1 -- 172.21.15.52:0/1730571590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800b680 con 0x7fe3f8154db0 2023-05-10T01:26:41.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3f67fc700 1 -- 172.21.15.52:0/1730571590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800ba00 con 0x7fe3f8154db0 2023-05-10T01:26:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1730571590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 msgr2=0x7fe3f8066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1730571590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f8066e40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fe3f80c7860 tx=0x7fe3e80090f0).stop 2023-05-10T01:26:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1730571590 shutdown_connections 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1730571590 >> v2:172.21.15.172:3300/0 conn(0x7fe3f814e430 0x7fe3f8157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1730571590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f8066e40 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1730571590 >> 172.21.15.52:0/1730571590 conn(0x7fe3f80c8460 msgr2=0x7fe3f80c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.684+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1730571590 shutdown_connections 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.685+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1730571590 wait complete. 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.686+0000 7fe3fdff0700 1 Processor -- start 2023-05-10T01:26:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.686+0000 7fe3fdff0700 1 -- start start 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3f8067330 0x7fe3f81684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3f814e430 0x7fe3f814d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8150e00 con 0x7fe3f8154db0 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80ac180 con 0x7fe3f814e430 2023-05-10T01:26:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3fdff0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8151000 con 0x7fe3f8067330 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39182/0 (socket says 172.21.15.52:39182) 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1238464510 learned_addr learned my addr 172.21.15.52:0/1238464510 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f77fe700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3f8067330 0x7fe3f81684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f6ffd700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3f814e430 0x7fe3f814d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3f8067330 msgr2=0x7fe3f81684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3f8067330 0x7fe3f81684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3f814e430 msgr2=0x7fe3f814d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3f814e430 0x7fe3f814d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 -- 172.21.15.52:0/1238464510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009370 con 0x7fe3f8154db0 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3f7fff700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fe3f0002230 tx=0x7fe3f00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e4a0 con 0x7fe3f8154db0 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.687+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000e600 con 0x7fe3f8154db0 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.688+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f81512e0 con 0x7fe3f8154db0 2023-05-10T01:26:41.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.688+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e980 con 0x7fe3f8154db0 2023-05-10T01:26:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.688+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81515c0 con 0x7fe3f8154db0 2023-05-10T01:26:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80abf50 con 0x7fe3f8154db0 2023-05-10T01:26:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe3f0019030 con 0x7fe3f8154db0 2023-05-10T01:26:41.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3ef7fe700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 0x7fe3dc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:41.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fe3f0079350 con 0x7fe3f8154db0 2023-05-10T01:26:41.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3f77fe700 1 -- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 msgr2=0x7fe3dc0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:41.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.689+0000 7fe3f77fe700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 0x7fe3dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:41.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.693+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3f00488f0 con 0x7fe3f8154db0 2023-05-10T01:26:41.748 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:41.745+0000 7f4360db8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:41.756 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.752+0000 7fd84eeaf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:41.834 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.831+0000 7fd84eeaf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:26:41.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.869+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3f80ac2f0 con 0x7fe3f8154db0 2023-05-10T01:26:41.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.869+0000 7fe3ef7fe700 1 -- 172.21.15.52:0/1238464510 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3f80ac2f0 con 0x7fe3f8154db0 2023-05-10T01:26:41.873 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:26:41.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 msgr2=0x7fe3dc0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:41.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 0x7fe3dc0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 msgr2=0x7fe3f81382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:41.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fe3f0002230 tx=0x7fe3f00015e0).stop 2023-05-10T01:26:41.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 shutdown_connections 2023-05-10T01:26:41.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3dc05ede0 0x7fe3dc0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:41.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8154db0 0x7fe3f81382f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3f8067330 0x7fe3f81684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 --2- 172.21.15.52:0/1238464510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3f814e430 0x7fe3f814d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:41.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 >> 172.21.15.52:0/1238464510 conn(0x7fe3f80c8460 msgr2=0x7fe3f8151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:41.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 shutdown_connections 2023-05-10T01:26:41.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:41.871+0000 7fe3fdff0700 1 -- 172.21.15.52:0/1238464510 wait complete. 2023-05-10T01:26:41.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:41.906 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:41.902+0000 7fd84eeaf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:26:42.003 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:42.000+0000 7f4360db8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:42.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.020+0000 7f059f4dc700 1 Processor -- start 2023-05-10T01:26:42.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.020+0000 7f059f4dc700 1 -- start start 2023-05-10T01:26:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059f4dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059f4dc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 0x7f05980c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059f4dc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980c6640 con 0x7f0598154160 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059f4dc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980ab1f0 con 0x7f05980c5ca0 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059f4dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980c08a0 con 0x7f0598154540 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059ca77700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059da79700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 0x7f05980c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059ca77700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:58824/0 (socket says 172.21.15.52:58824) 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.021+0000 7f059ca77700 1 -- 172.21.15.52:0/2799227778 learned_addr learned my addr 172.21.15.52:0/2799227778 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059ca77700 1 -- 172.21.15.52:0/2799227778 >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 msgr2=0x7f05980c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059ca77700 1 --2- 172.21.15.52:0/2799227778 >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 0x7f05980c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059ca77700 1 -- 172.21.15.52:0/2799227778 >> v1:172.21.15.172:6789/0 conn(0x7f0598154160 legacy=0x7f05980a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f058bfff700 1 -- 172.21.15.52:0/2799227778 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139884684 0 0) 0x7f0594001110 con 0x7f0598154160 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059ca77700 1 -- 172.21.15.52:0/2799227778 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980bfc90 con 0x7f0598154540 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059da79700 1 --2- 172.21.15.52:0/2799227778 >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 0x7f05980c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059ca77700 1 --2- 172.21.15.52:0/2799227778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f058c006fd0 tx=0x7f058c0090f0).ready entity=mon.2 client_cookie=b22a183f0a9893b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f058bfff700 1 -- 172.21.15.52:0/2799227778 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00b580 con 0x7f0598154540 2023-05-10T01:26:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f058bfff700 1 -- 172.21.15.52:0/2799227778 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00b6e0 con 0x7f0598154540 2023-05-10T01:26:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f058bfff700 1 -- 172.21.15.52:0/2799227778 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00ba60 con 0x7f0598154540 2023-05-10T01:26:42.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 -- 172.21.15.52:0/2799227778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 msgr2=0x7f05980aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 --2- 172.21.15.52:0/2799227778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f058c006fd0 tx=0x7f058c0090f0).stop 2023-05-10T01:26:42.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 -- 172.21.15.52:0/2799227778 shutdown_connections 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 --2- 172.21.15.52:0/2799227778 >> v2:172.21.15.172:3300/0 conn(0x7f05980c5ca0 0x7f05980c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 --2- 172.21.15.52:0/2799227778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0598154540 0x7f05980aad00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.022+0000 7f059f4dc700 1 -- 172.21.15.52:0/2799227778 >> 172.21.15.52:0/2799227778 conn(0x7f05980cb6c0 msgr2=0x7f05980c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.023+0000 7f059f4dc700 1 -- 172.21.15.52:0/2799227778 shutdown_connections 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.023+0000 7f059f4dc700 1 -- 172.21.15.52:0/2799227778 wait complete. 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.024+0000 7f059f4dc700 1 Processor -- start 2023-05-10T01:26:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.024+0000 7f059f4dc700 1 -- start start 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.024+0000 7f059f4dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05980c5ca0 0x7f0598151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0598154540 0x7f059814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980c41b0 con 0x7f0598154160 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598150b20 con 0x7f0598154540 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0598150e00 con 0x7f05980c5ca0 2023-05-10T01:26:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39194/0 (socket says 172.21.15.52:39194) 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 -- 172.21.15.52:0/3825352144 learned_addr learned my addr 172.21.15.52:0/3825352144 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059d278700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05980c5ca0 0x7f0598151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059da79700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0598154540 0x7f059814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05980c5ca0 msgr2=0x7f0598151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05980c5ca0 0x7f0598151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0598154540 msgr2=0x7f059814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0598154540 0x7f059814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 -- 172.21.15.52:0/3825352144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009a20 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059ca77700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f058c011000 tx=0x7f058c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00b850 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00b9b0 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c009370 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c01c670 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.025+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05981513c0 con 0x7f0598154160 2023-05-10T01:26:42.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.026+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05980666b0 con 0x7f0598154160 2023-05-10T01:26:42.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.027+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f058c022020 con 0x7f0598154160 2023-05-10T01:26:42.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.027+0000 7f05897fa700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 0x7f05780612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.028+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f058c07b450 con 0x7f0598154160 2023-05-10T01:26:42.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.028+0000 7f059d278700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 msgr2=0x7f05780612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:42.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.028+0000 7f059d278700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 0x7f05780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:42.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.032+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f058c04c770 con 0x7f0598154160 2023-05-10T01:26:42.184 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:42.180+0000 7fd84eeaf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:26:42.196 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:42.193+0000 7f4360db8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.229+0000 7f059d278700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 msgr2=0x7f05780612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:42.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.229+0000 7f059d278700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 0x7f05780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.249+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f059806c340 con 0x7f0598154160 2023-05-10T01:26:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.250+0000 7f05897fa700 1 -- 172.21.15.52:0/3825352144 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f058c04fd90 con 0x7f0598154160 2023-05-10T01:26:42.254 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:42.254 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 msgr2=0x7f05780612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 0x7f05780612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 msgr2=0x7f059813c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f058c011000 tx=0x7f058c017000).stop 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 shutdown_connections 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f057805ede0 0x7f05780612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0598154540 0x7f059814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05980c5ca0 0x7f0598151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 --2- 172.21.15.52:0/3825352144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598154160 0x7f059813c1c0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 >> 172.21.15.52:0/3825352144 conn(0x7f05980cb6c0 msgr2=0x7f05980ab360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 shutdown_connections 2023-05-10T01:26:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.252+0000 7f059f4dc700 1 -- 172.21.15.52:0/3825352144 wait complete. 2023-05-10T01:26:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:42.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:42.376 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:42.372+0000 7fd84eeaf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:26:42.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.386+0000 7f9f096a1700 1 Processor -- start 2023-05-10T01:26:42.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.386+0000 7f9f096a1700 1 -- start start 2023-05-10T01:26:42.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f096a1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 0x7f9f040c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f096a1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f041547a0 0x7f9f04154c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f096a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040c2230 con 0x7f9f040bc040 2023-05-10T01:26:42.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f096a1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f040c3190 con 0x7f9f041547a0 2023-05-10T01:26:42.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f096a1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f04155110 con 0x7f9f04150ab0 2023-05-10T01:26:42.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f027fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f041547a0 0x7f9f04154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f037fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9f040bc040 0x7f9f040bc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48222/0 (socket says 172.21.15.52:48222) 2023-05-10T01:26:42.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f037fe700 1 -- 172.21.15.52:0/2853604425 learned_addr learned my addr 172.21.15.52:0/2853604425 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:42.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.387+0000 7f9f02ffd700 1 --2- 172.21.15.52:0/2853604425 >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 0x7f9f040c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f027fc700 1 -- 172.21.15.52:0/2853604425 >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 msgr2=0x7f9f040c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:42.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f027fc700 1 --2- 172.21.15.52:0/2853604425 >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 0x7f9f040c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f027fc700 1 -- 172.21.15.52:0/2853604425 >> v1:172.21.15.52:6789/0 conn(0x7f9f040bc040 legacy=0x7f9f040bc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f01ffb700 1 -- 172.21.15.52:0/2853604425 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005239336 0 0) 0x7f9f040c2230 con 0x7f9f040bc040 2023-05-10T01:26:42.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f027fc700 1 -- 172.21.15.52:0/2853604425 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040c4670 con 0x7f9f041547a0 2023-05-10T01:26:42.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f02ffd700 1 --2- 172.21.15.52:0/2853604425 >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 0x7f9f040c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:42.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f027fc700 1 --2- 172.21.15.52:0/2853604425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f041547a0 0x7f9f04154c20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f9f04069eb0 tx=0x7f9ef4009060).ready entity=mon.0 client_cookie=a885c084a8302dda server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f01ffb700 1 -- 172.21.15.52:0/2853604425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef400b580 con 0x7f9f041547a0 2023-05-10T01:26:42.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f01ffb700 1 -- 172.21.15.52:0/2853604425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef400b6e0 con 0x7f9f041547a0 2023-05-10T01:26:42.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f01ffb700 1 -- 172.21.15.52:0/2853604425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef400ba60 con 0x7f9f041547a0 2023-05-10T01:26:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 -- 172.21.15.52:0/2853604425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f041547a0 msgr2=0x7f9f04154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 --2- 172.21.15.52:0/2853604425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f041547a0 0x7f9f04154c20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f9f04069eb0 tx=0x7f9ef4009060).stop 2023-05-10T01:26:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 -- 172.21.15.52:0/2853604425 shutdown_connections 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 --2- 172.21.15.52:0/2853604425 >> v2:172.21.15.172:3300/0 conn(0x7f9f04150ab0 0x7f9f040c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 --2- 172.21.15.52:0/2853604425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f041547a0 0x7f9f04154c20 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.388+0000 7f9f096a1700 1 -- 172.21.15.52:0/2853604425 >> 172.21.15.52:0/2853604425 conn(0x7f9f040c7bb0 msgr2=0x7f9f040c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.389+0000 7f9f096a1700 1 -- 172.21.15.52:0/2853604425 shutdown_connections 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.389+0000 7f9f096a1700 1 -- 172.21.15.52:0/2853604425 wait complete. 2023-05-10T01:26:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.390+0000 7f9f096a1700 1 Processor -- start 2023-05-10T01:26:42.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.390+0000 7f9f096a1700 1 -- start start 2023-05-10T01:26:42.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04150ab0 0x7f9f040a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f041547a0 0x7f9f04144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040be970 con 0x7f9f040bc040 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040a9bd0 con 0x7f9f04150ab0 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0414c360 con 0x7f9f041547a0 2023-05-10T01:26:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39208/0 (socket says 172.21.15.52:39208) 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 -- 172.21.15.52:0/3131217757 learned_addr learned my addr 172.21.15.52:0/3131217757 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f027fc700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04150ab0 0x7f9f040a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f037fe700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f041547a0 0x7f9f04144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 -- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f041547a0 msgr2=0x7f9f04144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f041547a0 0x7f9f04144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 -- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04150ab0 msgr2=0x7f9f040a9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04150ab0 0x7f9f040a9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 -- 172.21.15.52:0/3131217757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40092a0 con 0x7f9f040bc040 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f02ffd700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f9ef800d890 tx=0x7f9ef8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011590 con 0x7f9f040bc040 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80116f0 con 0x7f9f040bc040 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040a98f0 con 0x7f9f040bc040 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011a70 con 0x7f9f040bc040 2023-05-10T01:26:42.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.391+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040be600 con 0x7f9f040bc040 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.392+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f040642c0 con 0x7f9f040bc040 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.393+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f9ef8012420 con 0x7f9f040bc040 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.393+0000 7f9eeaffd700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 0x7f9ee40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.393+0000 7f9f027fc700 1 -- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 msgr2=0x7f9ee40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.393+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f9ef80799a0 con 0x7f9f040bc040 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.393+0000 7f9f027fc700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 0x7f9ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:42.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.397+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ef804ac60 con 0x7f9f040bc040 2023-05-10T01:26:42.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.572+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0406c340 con 0x7f9f040bc040 2023-05-10T01:26:42.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.573+0000 7f9eeaffd700 1 -- 172.21.15.52:0/3131217757 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17691 (secure 0 0 0) 0x7f9ef804e280 con 0x7f9f040bc040 2023-05-10T01:26:42.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:42.577 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:35.711251+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:6832/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3286885938":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3835510018":"2023-05-11T01:26:35.711223+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:42.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 msgr2=0x7f9ee40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:42.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 0x7f9ee40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 msgr2=0x7f9f0414be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f9ef800d890 tx=0x7f9ef8008040).stop 2023-05-10T01:26:42.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 shutdown_connections 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f9ee405ede0 0x7f9ee40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f041547a0 0x7f9f04144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040bc040 0x7f9f0414be70 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 --2- 172.21.15.52:0/3131217757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04150ab0 0x7f9f040a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 >> 172.21.15.52:0/3131217757 conn(0x7f9f040c7bb0 msgr2=0x7f9f04065260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.576+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 shutdown_connections 2023-05-10T01:26:42.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.577+0000 7f9f096a1700 1 -- 172.21.15.52:0/3131217757 wait complete. 2023-05-10T01:26:42.593 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:26:42.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:42.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.708+0000 7fb1f3fff700 1 Processor -- start 2023-05-10T01:26:42.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.708+0000 7fb1f3fff700 1 -- start start 2023-05-10T01:26:42.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 0x7fb1f4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f40c7750 0x7fb1f40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f3fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f4158960 con 0x7fb1f40ad030 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f3fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f4155330 con 0x7fb1f40c7750 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f3fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f4157d50 con 0x7fb1f40c7370 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f40c7750 0x7fb1f40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb1f40ad030 0x7fb1f414dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48270/0 (socket says 172.21.15.52:48270) 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb1f40c7750 0x7fb1f40acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39252/0 (socket says 172.21.15.52:39252) 2023-05-10T01:26:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f37fe700 1 -- 172.21.15.52:0/3310985958 learned_addr learned my addr 172.21.15.52:0/3310985958 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f2ffd700 1 --2- 172.21.15.52:0/3310985958 >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 0x7fb1f4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 -- 172.21.15.52:0/3310985958 >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 msgr2=0x7fb1f4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 --2- 172.21.15.52:0/3310985958 >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 0x7fb1f4154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 -- 172.21.15.52:0/3310985958 >> v1:172.21.15.52:6789/0 conn(0x7fb1f40ad030 legacy=0x7fb1f414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f1ffb700 1 -- 172.21.15.52:0/3310985958 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061892103 0 0) 0x7fb1f4158960 con 0x7fb1f40ad030 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f27fc700 1 -- 172.21.15.52:0/3310985958 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4158030 con 0x7fb1f40c7750 2023-05-10T01:26:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.709+0000 7fb1f2ffd700 1 --2- 172.21.15.52:0/3310985958 >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 0x7fb1f4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f27fc700 1 --2- 172.21.15.52:0/3310985958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40acb40 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fb1f4083b90 tx=0x7fb1e8009060).ready entity=mon.0 client_cookie=473e2b09683b5e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f1ffb700 1 -- 172.21.15.52:0/3310985958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800b580 con 0x7fb1f40c7750 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f1ffb700 1 -- 172.21.15.52:0/3310985958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800b6e0 con 0x7fb1f40c7750 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f1ffb700 1 -- 172.21.15.52:0/3310985958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800ba60 con 0x7fb1f40c7750 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 -- 172.21.15.52:0/3310985958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 msgr2=0x7fb1f40acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/3310985958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40acb40 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fb1f4083b90 tx=0x7fb1e8009060).stop 2023-05-10T01:26:42.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 -- 172.21.15.52:0/3310985958 shutdown_connections 2023-05-10T01:26:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/3310985958 >> v2:172.21.15.172:3300/0 conn(0x7fb1f40c7370 0x7fb1f4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/3310985958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40acb40 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 -- 172.21.15.52:0/3310985958 >> 172.21.15.52:0/3310985958 conn(0x7fb1f4068320 msgr2=0x7fb1f4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 -- 172.21.15.52:0/3310985958 shutdown_connections 2023-05-10T01:26:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.710+0000 7fb1f3fff700 1 -- 172.21.15.52:0/3310985958 wait complete. 2023-05-10T01:26:42.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 Processor -- start 2023-05-10T01:26:42.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 -- start start 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 0x7fb1f414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 0x7fb1f40c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40af4b0 con 0x7fb1f40c7750 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f414ee50 con 0x7fb1f40ad030 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40af1d0 con 0x7fb1f40c7370 2023-05-10T01:26:42.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.712+0000 7fb1f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39260/0 (socket says 172.21.15.52:39260) 2023-05-10T01:26:42.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f27fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 0x7fb1f40c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 0x7fb1f414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:42.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 -- 172.21.15.52:0/667877698 learned_addr learned my addr 172.21.15.52:0/667877698 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:42.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 msgr2=0x7fb1f40c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 0x7fb1f40c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 msgr2=0x7fb1f414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 0x7fb1f414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 -- 172.21.15.52:0/667877698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80092a0 con 0x7fb1f40c7750 2023-05-10T01:26:42.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f27fc700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 0x7fb1f40c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:42.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f2ffd700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 0x7fb1f414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:42.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f37fe700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb1ec00c7e0 tx=0x7fb1ec007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec005d30 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec005e90 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f40c33a0 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec007320 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.713+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f40c3960 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.714+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f4153dc0 con 0x7fb1f40c7750 2023-05-10T01:26:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.715+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fb1ec010030 con 0x7fb1f40c7750 2023-05-10T01:26:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.715+0000 7fb1daffd700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 0x7fb1d40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.715+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fb1ec07a320 con 0x7fb1f40c7750 2023-05-10T01:26:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.715+0000 7fb1f2ffd700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 msgr2=0x7fb1d40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.715+0000 7fb1f2ffd700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 0x7fb1d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:42.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.719+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1ec04b550 con 0x7fb1f40c7750 2023-05-10T01:26:42.846 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:42.843+0000 7f4360db8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:42.913 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:42.910+0000 7f4360db8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:42.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.916+0000 7fb1f2ffd700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 msgr2=0x7fb1d40612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:42.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.916+0000 7fb1f2ffd700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 0x7fb1d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:42.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.936+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f4047150 con 0x7fb1f40c7750 2023-05-10T01:26:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.937+0000 7fb1daffd700 1 -- 172.21.15.52:0/667877698 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fb1ec04eb70 con 0x7fb1f40c7750 2023-05-10T01:26:42.943 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:42.944 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 msgr2=0x7fb1d40612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 0x7fb1d40612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 msgr2=0x7fb1f40c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb1ec00c7e0 tx=0x7fb1ec007f90).stop 2023-05-10T01:26:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 shutdown_connections 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb1d405ede0 0x7fb1d40612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1f40c7750 0x7fb1f40c1050 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1f40ad030 0x7fb1f414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 --2- 172.21.15.52:0/667877698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1f40c7370 0x7fb1f40c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 >> 172.21.15.52:0/667877698 conn(0x7fb1f4068320 msgr2=0x7fb1f414f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 shutdown_connections 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:42.939+0000 7fb1f3fff700 1 -- 172.21.15.52:0/667877698 wait complete. 2023-05-10T01:26:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:42.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:42.988 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:42.986+0000 7f4360db8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:43.073 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.069+0000 7fd84eeaf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:26:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.075+0000 7f8e20ee6700 1 Processor -- start 2023-05-10T01:26:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.075+0000 7f8e20ee6700 1 -- start start 2023-05-10T01:26:43.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e20ee6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c154540 0x7f8e1c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e20ee6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e20ee6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c0c0650 con 0x7f8e1c154160 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e20ee6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c06a010 con 0x7f8e1c069b80 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e20ee6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0bfd20 con 0x7f8e1c154540 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39270/0 (socket says 172.21.15.52:39270) 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 -- 172.21.15.52:0/2979385100 learned_addr learned my addr 172.21.15.52:0/2979385100 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e19d9b700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c154540 0x7f8e1c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1959a700 1 -- 172.21.15.52:0/2979385100 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971765746 0 0) 0x7f8e1c0c0650 con 0x7f8e1c154160 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 -- 172.21.15.52:0/2979385100 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c154540 msgr2=0x7f8e1c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c154540 0x7f8e1c069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 -- 172.21.15.52:0/2979385100 >> v1:172.21.15.172:6789/0 conn(0x7f8e1c154160 legacy=0x7f8e1c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.076+0000 7f8e1ad9d700 1 -- 172.21.15.52:0/2979385100 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0c0000 con 0x7f8e1c069b80 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e1ad9d700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f8e14009f20 tx=0x7f8e14009840).ready entity=mon.0 client_cookie=4a1cee5bba570b91 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e1959a700 1 -- 172.21.15.52:0/2979385100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400e070 con 0x7f8e1c069b80 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e1959a700 1 -- 172.21.15.52:0/2979385100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400b9d0 con 0x7f8e1c069b80 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e1959a700 1 -- 172.21.15.52:0/2979385100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400bd50 con 0x7f8e1c069b80 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 -- 172.21.15.52:0/2979385100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c069b80 msgr2=0x7f8e1c0c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f8e14009f20 tx=0x7f8e14009840).stop 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 -- 172.21.15.52:0/2979385100 shutdown_connections 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c069b80 0x7f8e1c0c0ae0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/2979385100 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c154540 0x7f8e1c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 -- 172.21.15.52:0/2979385100 >> 172.21.15.52:0/2979385100 conn(0x7f8e1c0cb6f0 msgr2=0x7f8e1c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:43.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 -- 172.21.15.52:0/2979385100 shutdown_connections 2023-05-10T01:26:43.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.077+0000 7f8e20ee6700 1 -- 172.21.15.52:0/2979385100 wait complete. 2023-05-10T01:26:43.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.078+0000 7f8e20ee6700 1 Processor -- start 2023-05-10T01:26:43.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 -- start start 2023-05-10T01:26:43.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c069b80 0x7f8e1c168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c154540 0x7f8e1c13bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c14f030 con 0x7f8e1c154160 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0af420 con 0x7f8e1c154540 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e20ee6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0af6c0 con 0x7f8e1c069b80 2023-05-10T01:26:43.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e19d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e19d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39274/0 (socket says 172.21.15.52:39274) 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e19d9b700 1 -- 172.21.15.52:0/251089701 learned_addr learned my addr 172.21.15.52:0/251089701 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e1a59c700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c069b80 0x7f8e1c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.079+0000 7f8e1ad9d700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c154540 0x7f8e1c13bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c069b80 msgr2=0x7f8e1c168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c069b80 0x7f8e1c168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c154540 msgr2=0x7f8e1c13bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c154540 0x7f8e1c13bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 -- 172.21.15.52:0/251089701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009ae0 con 0x7f8e1c154160 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e19d9b700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f8e1000e900 tx=0x7f8e10009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10012600 con 0x7f8e1c154160 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10012760 con 0x7f8e1c154160 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c1684f0 con 0x7f8e1c154160 2023-05-10T01:26:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10012ae0 con 0x7f8e1c154160 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.080+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0c48e0 con 0x7f8e1c154160 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.081+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0666b0 con 0x7f8e1c154160 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.081+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f8e10022070 con 0x7f8e1c154160 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.082+0000 7f8e0a7fc700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 0x7f8df8061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.082+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f8e1007a180 con 0x7f8e1c154160 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.082+0000 7f8e1a59c700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 msgr2=0x7f8df8061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:43.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.082+0000 7f8e1a59c700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 0x7f8df8061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:43.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.086+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e1004b4a0 con 0x7f8e1c154160 2023-05-10T01:26:43.134 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.132+0000 7f4360db8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:43.146 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.143+0000 7fd84eeaf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:26:43.203 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.201+0000 7f4360db8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:43.224 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.221+0000 7fd84eeaf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:26:43.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.283+0000 7f8e1a59c700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 msgr2=0x7f8df8061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:43.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.283+0000 7f8e1a59c700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 0x7f8df8061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:43.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.303+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e1c0c5540 con 0x7f8e1c154160 2023-05-10T01:26:43.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.304+0000 7f8e0a7fc700 1 -- 172.21.15.52:0/251089701 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f8e10016090 con 0x7f8e1c154160 2023-05-10T01:26:43.308 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:43.308 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:18.947322+0000","modified":"2023-05-10T01:26:21.960062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"d","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3128322162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3128322162},{"type":"v1","addr":"172.21.15.172:6837","nonce":3128322162}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-05-10T01:26:43.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 msgr2=0x7f8df8061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:43.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 0x7f8df8061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 msgr2=0x7f8e1c0c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f8e1000e900 tx=0x7f8e10009060).stop 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 shutdown_connections 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8df805edb0 0x7f8df8061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c154540 0x7f8e1c13bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e1c069b80 0x7f8e1c168000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 --2- 172.21.15.52:0/251089701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e1c154160 0x7f8e1c0c1d30 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 >> 172.21.15.52:0/251089701 conn(0x7f8e1c0cb6f0 msgr2=0x7f8e1c0aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:43.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 shutdown_connections 2023-05-10T01:26:43.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.306+0000 7f8e20ee6700 1 -- 172.21.15.52:0/251089701 wait complete. 2023-05-10T01:26:43.311 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 54 2023-05-10T01:26:43.317 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.315+0000 7f4360db8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:43.321 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:43.381 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.377+0000 7fd84eeaf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:26:43.423 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.420+0000 7f4360db8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.435+0000 7fd8665e9700 1 Processor -- start 2023-05-10T01:26:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.435+0000 7fd8665e9700 1 -- start start 2023-05-10T01:26:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd860153ea0 0x7fd860154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd860068c60 0x7fd860066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd860065960 con 0x7fd860153ea0 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600bc9a0 con 0x7fd860068c60 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd8665e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600bcc80 con 0x7fd860064ff0 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd85ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd860153ea0 0x7fd860154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd85ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd860153ea0 0x7fd860154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39282/0 (socket says 172.21.15.52:39282) 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.436+0000 7fd85ffff700 1 -- 172.21.15.52:0/1343768839 learned_addr learned my addr 172.21.15.52:0/1343768839 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85f7fe700 1 --2- 172.21.15.52:0/1343768839 >> v2:172.21.15.172:3300/0 conn(0x7fd860068c60 0x7fd860066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd864b86700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 -- 172.21.15.52:0/1343768839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 msgr2=0x7fd860065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 -- 172.21.15.52:0/1343768839 >> v2:172.21.15.172:3300/0 conn(0x7fd860068c60 msgr2=0x7fd860066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 --2- 172.21.15.52:0/1343768839 >> v2:172.21.15.172:3300/0 conn(0x7fd860068c60 0x7fd860066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 -- 172.21.15.52:0/1343768839 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600bcf60 con 0x7fd860153ea0 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85ffff700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd860153ea0 0x7fd860154280 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fd860064aa0 tx=0x7fd8480090f0).ready entity=mon.0 client_cookie=88aa144a898e54c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85effd700 1 -- 172.21.15.52:0/1343768839 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800f510 con 0x7fd860153ea0 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85effd700 1 -- 172.21.15.52:0/1343768839 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84800f670 con 0x7fd860153ea0 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.437+0000 7fd85effd700 1 -- 172.21.15.52:0/1343768839 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800f9f0 con 0x7fd860153ea0 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 -- 172.21.15.52:0/1343768839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd860153ea0 msgr2=0x7fd860154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd860153ea0 0x7fd860154280 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fd860064aa0 tx=0x7fd8480090f0).stop 2023-05-10T01:26:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 -- 172.21.15.52:0/1343768839 shutdown_connections 2023-05-10T01:26:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 --2- 172.21.15.52:0/1343768839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd860153ea0 0x7fd860154280 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 --2- 172.21.15.52:0/1343768839 >> v2:172.21.15.172:3300/0 conn(0x7fd860068c60 0x7fd860066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 -- 172.21.15.52:0/1343768839 >> 172.21.15.52:0/1343768839 conn(0x7fd8600c4420 msgr2=0x7fd8600c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 -- 172.21.15.52:0/1343768839 shutdown_connections 2023-05-10T01:26:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.438+0000 7fd8665e9700 1 -- 172.21.15.52:0/1343768839 wait complete. 2023-05-10T01:26:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.439+0000 7fd8665e9700 1 Processor -- start 2023-05-10T01:26:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.439+0000 7fd8665e9700 1 -- start start 2023-05-10T01:26:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd860166b20 con 0x7fd8600a5040 2023-05-10T01:26:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600a5990 con 0x7fd860153ea0 2023-05-10T01:26:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd8665e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd860165f10 con 0x7fd860064ff0 2023-05-10T01:26:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd864b86700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:58924/0 (socket says 172.21.15.52:58924) 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd864b86700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39292/0 (socket says 172.21.15.52:39292) 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85ffff700 1 -- 172.21.15.52:0/79521513 learned_addr learned my addr 172.21.15.52:0/79521513 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:37614/0 (socket says 172.21.15.52:37614) 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 -- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 msgr2=0x7fd860166fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 -- 172.21.15.52:0/79521513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 msgr2=0x7fd8600a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85f7fe700 1 -- 172.21.15.52:0/79521513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848009370 con 0x7fd860153ea0 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd85ffff700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.440+0000 7fd864b86700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd85f7fe700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fd85000e900 tx=0x7fd850009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850012600 con 0x7fd860153ea0 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd850012760 con 0x7fd860153ea0 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8601661f0 con 0x7fd860153ea0 2023-05-10T01:26:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850012ae0 con 0x7fd860153ea0 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.441+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8601667b0 con 0x7fd860153ea0 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.442+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86006c340 con 0x7fd860153ea0 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.442+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd850022070 con 0x7fd860153ea0 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.442+0000 7fd857fff700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 0x7fd8440612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.443+0000 7fd85ffff700 1 -- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 msgr2=0x7fd8440612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.443+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fd85007a0e0 con 0x7fd860153ea0 2023-05-10T01:26:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.443+0000 7fd85ffff700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 0x7fd8440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.447+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd85004b400 con 0x7fd860153ea0 2023-05-10T01:26:43.456 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.453+0000 7fd84eeaf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:26:43.579 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.576+0000 7fd84eeaf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:26:43.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.624+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8600bd240 con 0x7fd860153ea0 2023-05-10T01:26:43.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.625+0000 7fd857fff700 1 -- 172.21.15.52:0/79521513 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17691 (secure 0 0 0) 0x7fd85004ea20 con 0x7fd860153ea0 2023-05-10T01:26:43.629 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:43.629 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:35.711251+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:16.641028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:17.917984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6833/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:6832/116173":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3286885938":"2023-05-11T01:26:35.711223+0000","172.21.15.172:0/3835510018":"2023-05-11T01:26:35.711223+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 msgr2=0x7fd8440612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 0x7fd8440612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 msgr2=0x7fd8601451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fd85000e900 tx=0x7fd850009060).stop 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 shutdown_connections 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd84405ede0 0x7fd8440612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8600a5040 0x7fd8600a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd860064ff0 0x7fd860166fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 --2- 172.21.15.52:0/79521513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd860153ea0 0x7fd8601451c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.627+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 >> 172.21.15.52:0/79521513 conn(0x7fd8600c4420 msgr2=0x7fd8600bd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:43.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.628+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 shutdown_connections 2023-05-10T01:26:43.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.628+0000 7fd8665e9700 1 -- 172.21.15.52:0/79521513 wait complete. 2023-05-10T01:26:43.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:26:43.695 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.692+0000 7fd84eeaf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:26:43.713 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.710+0000 7f4360db8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.760+0000 7fad59160700 1 Processor -- start 2023-05-10T01:26:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.760+0000 7fad59160700 1 -- start start 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fad541519f0 0x7fad54066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad54151dd0 0x7fad540bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540a6cd0 con 0x7fad54151dd0 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540c4b10 con 0x7fad541519f0 2023-05-10T01:26:43.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad59160700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad540bce70 con 0x7fad540bc530 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad5259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad54151dd0 0x7fad540bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad5259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad54151dd0 0x7fad540bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39296/0 (socket says 172.21.15.52:39296) 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad5259c700 1 -- 172.21.15.52:0/2304835217 learned_addr learned my addr 172.21.15.52:0/2304835217 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad5359e700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.761+0000 7fad52d9d700 1 --2- 172.21.15.52:0/2304835217 >> v2:172.21.15.172:3300/0 conn(0x7fad541519f0 0x7fad54066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 -- 172.21.15.52:0/2304835217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 msgr2=0x7fad540bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 -- 172.21.15.52:0/2304835217 >> v2:172.21.15.172:3300/0 conn(0x7fad541519f0 msgr2=0x7fad54066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 --2- 172.21.15.52:0/2304835217 >> v2:172.21.15.172:3300/0 conn(0x7fad541519f0 0x7fad54066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 -- 172.21.15.52:0/2304835217 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54066a00 con 0x7fad54151dd0 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad5259c700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad540bc040 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fad540c3a20 tx=0x7fad440090f0).ready entity=mon.0 client_cookie=dfd35acb5a91d767 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad51d9b700 1 -- 172.21.15.52:0/2304835217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400f510 con 0x7fad54151dd0 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad51d9b700 1 -- 172.21.15.52:0/2304835217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400f670 con 0x7fad54151dd0 2023-05-10T01:26:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.762+0000 7fad51d9b700 1 -- 172.21.15.52:0/2304835217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400fa10 con 0x7fad54151dd0 2023-05-10T01:26:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 -- 172.21.15.52:0/2304835217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 msgr2=0x7fad540bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad540bc040 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fad540c3a20 tx=0x7fad440090f0).stop 2023-05-10T01:26:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 -- 172.21.15.52:0/2304835217 shutdown_connections 2023-05-10T01:26:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 --2- 172.21.15.52:0/2304835217 >> v2:172.21.15.172:3300/0 conn(0x7fad541519f0 0x7fad54066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 --2- 172.21.15.52:0/2304835217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad540bc040 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 -- 172.21.15.52:0/2304835217 >> 172.21.15.52:0/2304835217 conn(0x7fad540c7bb0 msgr2=0x7fad540c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 -- 172.21.15.52:0/2304835217 shutdown_connections 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.763+0000 7fad59160700 1 -- 172.21.15.52:0/2304835217 wait complete. 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.764+0000 7fad59160700 1 Processor -- start 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.764+0000 7fad59160700 1 -- start start 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad541519f0 0x7fad5414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad540be130 con 0x7fad54151dd0 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad540abc50 con 0x7fad541519f0 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad59160700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54152900 con 0x7fad540bc530 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39302/0 (socket says 172.21.15.52:39302) 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 -- 172.21.15.52:0/4131103964 learned_addr learned my addr 172.21.15.52:0/4131103964 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad52d9d700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5259c700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad541519f0 0x7fad5414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:43.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 msgr2=0x7fad540ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad541519f0 msgr2=0x7fad5414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad541519f0 0x7fad5414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 -- 172.21.15.52:0/4131103964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009370 con 0x7fad54151dd0 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.765+0000 7fad5359e700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fad4c009df0 tx=0x7fad4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.766+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00caa0 con 0x7fad54151dd0 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.766+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00f040 con 0x7fad54151dd0 2023-05-10T01:26:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.766+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00ce10 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.766+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54152be0 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.766+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad540ac5b0 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.767+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad540bdf90 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.767+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 52) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fad4c013610 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.767+0000 7fad3affd700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.768+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fad4c07a6e0 con 0x7fad54151dd0 2023-05-10T01:26:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.768+0000 7fad52d9d700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 msgr2=0x7fad340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.768+0000 7fad52d9d700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:26:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.772+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad540bdf90 con 0x7fad54151dd0 2023-05-10T01:26:43.783 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:43.781+0000 7f4360db8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:43.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.969+0000 7fad52d9d700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 msgr2=0x7fad340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:43.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.969+0000 7fad52d9d700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:26:43.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:43.993+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad540bdf90 con 0x7fad54151dd0 2023-05-10T01:26:44.004 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:43.999+0000 7fd84eeaf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:26:44.077 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:26:44.074+0000 7fd84eeaf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:26:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.370+0000 7fad52d9d700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 msgr2=0x7fad340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:26:44.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.370+0000 7fad52d9d700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:26:44.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.582+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 53) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fad4c0783e0 con 0x7fad54151dd0 2023-05-10T01:26:44.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.582+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 msgr2=0x7fad340612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:26:44.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.582+0000 7fad3affd700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:44.646 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e059c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e059c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e059c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e059c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e059c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e2da1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e2da1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e2da1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.648 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e2da1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.648 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:26:44.643+0000 7f42e2da1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:26:44.649 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:44.649 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:44.649 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:26:44.652 INFO:tasks.ceph.mds.d.smithi172.stderr: -2538> 2023-05-10T01:26:23.936+0000 7f9bc76ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:26:44.656 INFO:tasks.ceph.mds.d.smithi172.stderr: -5> 2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:44.656 INFO:tasks.ceph.mds.d.smithi172.stderr: -4> 2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:26:44.656 INFO:tasks.ceph.mds.d.smithi172.stderr: -1> 2023-05-10T01:26:44.646+0000 7f9bc3ee5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:26:44.674 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:26:44.798 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:26:44.795+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:26:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.798+0000 7fad3affd700 1 -- 172.21.15.52:0/4131103964 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad4c06e460 con 0x7fad54151dd0 2023-05-10T01:26:44.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 msgr2=0x7fad541582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fad4c009df0 tx=0x7fad4c00b040).stop 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 shutdown_connections 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fad3405ede0 0x7fad340612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad54151dd0 0x7fad541582e0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad540bc530 0x7fad540ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 --2- 172.21.15.52:0/4131103964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad541519f0 0x7fad5414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 >> 172.21.15.52:0/4131103964 conn(0x7fad540c7bb0 msgr2=0x7fad540c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 shutdown_connections 2023-05-10T01:26:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.800+0000 7fad59160700 1 -- 172.21.15.52:0/4131103964 wait complete. 2023-05-10T01:26:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:26:44.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:26:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.939+0000 7f797ea73700 1 Processor -- start 2023-05-10T01:26:44.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.939+0000 7f797ea73700 1 -- start start 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ea73700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7978153ba0 0x7f79780698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ea73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f7978067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ea73700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797805e750 con 0x7f79780bd800 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ea73700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7978069ee0 con 0x7f7978153ba0 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ea73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780bf530 con 0x7f7978153f80 2023-05-10T01:26:44.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797e272700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f79780bd800 0x7f79780634c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48334/0 (socket says 172.21.15.52:48334) 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797e272700 1 -- 172.21.15.52:0/1237175615 learned_addr learned my addr 172.21.15.52:0/1237175615 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797da71700 1 --2- 172.21.15.52:0/1237175615 >> v2:172.21.15.172:3300/0 conn(0x7f7978153ba0 0x7f79780698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797d270700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f7978067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987712679 0 0) 0x7f797805e750 con 0x7f79780bd800 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79640033f0 con 0x7f79780bd800 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697009108 0 0) 0x7f79640033f0 con 0x7f79780bd800 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 msgr2=0x7f7978067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:44.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f7978067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 >> v2:172.21.15.172:3300/0 conn(0x7f7978153ba0 msgr2=0x7f79780698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:44.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 --2- 172.21.15.52:0/1237175615 >> v2:172.21.15.172:3300/0 conn(0x7f7978153ba0 0x7f79780698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978068440 con 0x7f79780bd800 2023-05-10T01:26:44.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f7968001470 con 0x7f79780bd800 2023-05-10T01:26:44.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 >> v1:172.21.15.52:6789/0 conn(0x7f79780bd800 legacy=0x7f79780634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.940+0000 7f797ca6f700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f79640038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7964003e10 0x7f7964004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7964005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978069ee0 con 0x7f7964004b80 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780bf530 con 0x7f7964003e10 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796400b8e0 con 0x7f7978153f80 2023-05-10T01:26:44.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7964005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797da71700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f79640038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797d270700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7964003e10 0x7f7964004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 -- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 msgr2=0x7f79640038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7978153f80 0x7f79640038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 -- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7964003e10 msgr2=0x7f7964004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7964003e10 0x7f7964004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 -- 172.21.15.52:0/1237175615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79640033f0 con 0x7f7964004b80 2023-05-10T01:26:44.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797e272700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7964005000 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f796800c240 tx=0x7f7968001e90).ready entity=mon.0 client_cookie=e86b16a07b8c6c6f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968007a60 con 0x7f7964004b80 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800cad0 con 0x7f7964004b80 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.941+0000 7f797ca6f700 1 -- 172.21.15.52:0/1237175615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800ce50 con 0x7f7964004b80 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 -- 172.21.15.52:0/1237175615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 msgr2=0x7f7964005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 --2- 172.21.15.52:0/1237175615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7964005000 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f796800c240 tx=0x7f7968001e90).stop 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797e272700 1 -- 172.21.15.52:0/1237175615 reap_dead start 2023-05-10T01:26:44.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 -- 172.21.15.52:0/1237175615 shutdown_connections 2023-05-10T01:26:44.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 -- 172.21.15.52:0/1237175615 >> 172.21.15.52:0/1237175615 conn(0x7f7978062d70 msgr2=0x7f797805dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:44.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 -- 172.21.15.52:0/1237175615 shutdown_connections 2023-05-10T01:26:44.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.942+0000 7f797ea73700 1 -- 172.21.15.52:0/1237175615 wait complete. 2023-05-10T01:26:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.943+0000 7f797ea73700 1 Processor -- start 2023-05-10T01:26:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.943+0000 7f797ea73700 1 -- start start 2023-05-10T01:26:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79781554f0 0x7f7978155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79780ada00 0x7f79780ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780ae930 con 0x7f7964004b80 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978155060 con 0x7f79780ada00 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780ae370 con 0x7f79781554f0 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39326/0 (socket says 172.21.15.52:39326) 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 -- 172.21.15.52:0/3495803077 learned_addr learned my addr 172.21.15.52:0/3495803077 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797e272700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79780ada00 0x7f79780ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797d270700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79781554f0 0x7f7978155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 -- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79781554f0 msgr2=0x7f7978155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79781554f0 0x7f7978155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 -- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79780ada00 msgr2=0x7f79780ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79780ada00 0x7f79780ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 -- 172.21.15.52:0/3495803077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978154450 con 0x7f7964004b80 2023-05-10T01:26:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797da71700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f7970011eb0 tx=0x7f797000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000e040 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000f040 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7978154730 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.944+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000fe70 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.945+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7978154cf0 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.945+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7978155340 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.946+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 53) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f7970015660 con 0x7f7964004b80 2023-05-10T01:26:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.946+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f797007ad60 con 0x7f7964004b80 2023-05-10T01:26:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:44.950+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f797004bfb0 con 0x7f7964004b80 2023-05-10T01:26:45.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.168+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7978047150 con 0x7f7964004b80 2023-05-10T01:26:45.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.596+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 54) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f7970078910 con 0x7f7964004b80 2023-05-10T01:26:45.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.596+0000 7f7975ffb700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 0x7f7958067930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.597+0000 7f797d270700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 0x7f7958067930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.598+0000 7f797d270700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 0x7f7958067930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7978155f20 tx=0x7f796c009060).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:45.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.800+0000 7f7975ffb700 1 -- 172.21.15.52:0/3495803077 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f797006cad0 con 0x7f7964004b80 2023-05-10T01:26:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 msgr2=0x7f7958067930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 0x7f7958067930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7978155f20 tx=0x7f796c009060).stop 2023-05-10T01:26:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 msgr2=0x7f7978152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f7970011eb0 tx=0x7f797000b040).stop 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 shutdown_connections 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f79580301b0 0x7f7958067930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79780ada00 0x7f79780ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7964004b80 0x7f7978152120 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 --2- 172.21.15.52:0/3495803077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79781554f0 0x7f7978155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 >> 172.21.15.52:0/3495803077 conn(0x7f7978062d70 msgr2=0x7f79780c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 shutdown_connections 2023-05-10T01:26:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.802+0000 7f797ea73700 1 -- 172.21.15.52:0/3495803077 wait complete. 2023-05-10T01:26:45.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:26:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.944+0000 7efdf99c0700 1 Processor -- start 2023-05-10T01:26:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.944+0000 7efdf99c0700 1 -- start start 2023-05-10T01:26:45.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf99c0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efdf4153f80 0x7efdf40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf99c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 0x7efdf40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf99c0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40c6660 con 0x7efdf40c0140 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf99c0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf4069f50 con 0x7efdf4153f80 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf99c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf406a9d0 con 0x7efdf40c5cf0 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf91bf700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efdf40c0140 0x7efdf40c0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48370/0 (socket says 172.21.15.52:48370) 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf91bf700 1 -- 172.21.15.52:0/2407766011 learned_addr learned my addr 172.21.15.52:0/2407766011 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf89be700 1 --2- 172.21.15.52:0/2407766011 >> v2:172.21.15.172:3300/0 conn(0x7efdf4153f80 0x7efdf40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf3fff700 1 --2- 172.21.15.52:0/2407766011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 0x7efdf40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf37fe700 1 -- 172.21.15.52:0/2407766011 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243095163 0 0) 0x7efdf40c6660 con 0x7efdf40c0140 2023-05-10T01:26:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf37fe700 1 -- 172.21.15.52:0/2407766011 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd80033f0 con 0x7efdf40c0140 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf3fff700 1 -- 172.21.15.52:0/2407766011 >> v2:172.21.15.172:3300/0 conn(0x7efdf4153f80 msgr2=0x7efdf40a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf3fff700 1 --2- 172.21.15.52:0/2407766011 >> v2:172.21.15.172:3300/0 conn(0x7efdf4153f80 0x7efdf40a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf3fff700 1 -- 172.21.15.52:0/2407766011 >> v1:172.21.15.52:6789/0 conn(0x7efdf40c0140 legacy=0x7efdf40c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.945+0000 7efdf3fff700 1 -- 172.21.15.52:0/2407766011 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf406a130 con 0x7efdf40c5cf0 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf3fff700 1 --2- 172.21.15.52:0/2407766011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 0x7efdf40c6170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7efde0009760 tx=0x7efde0009060).ready entity=mon.2 client_cookie=9019b62d4faa5102 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf37fe700 1 -- 172.21.15.52:0/2407766011 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000d4a0 con 0x7efdf40c5cf0 2023-05-10T01:26:45.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf37fe700 1 -- 172.21.15.52:0/2407766011 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000d600 con 0x7efdf40c5cf0 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf37fe700 1 -- 172.21.15.52:0/2407766011 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000d980 con 0x7efdf40c5cf0 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 -- 172.21.15.52:0/2407766011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 msgr2=0x7efdf40c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 --2- 172.21.15.52:0/2407766011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 0x7efdf40c6170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7efde0009760 tx=0x7efde0009060).stop 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 -- 172.21.15.52:0/2407766011 shutdown_connections 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 --2- 172.21.15.52:0/2407766011 >> v2:172.21.15.172:3300/0 conn(0x7efdf4153f80 0x7efdf40a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 --2- 172.21.15.52:0/2407766011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf40c5cf0 0x7efdf40c6170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 -- 172.21.15.52:0/2407766011 >> 172.21.15.52:0/2407766011 conn(0x7efdf40cb5f0 msgr2=0x7efdf40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 -- 172.21.15.52:0/2407766011 shutdown_connections 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.946+0000 7efdf99c0700 1 -- 172.21.15.52:0/2407766011 wait complete. 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.947+0000 7efdf99c0700 1 Processor -- start 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 -- start start 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdf40c0140 0x7efdf414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 0x7efdf4153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4153760 con 0x7efdf40c5cf0 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40c4860 con 0x7efdf40c0140 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf99c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40c37c0 con 0x7efdf4153f80 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39360/0 (socket says 172.21.15.52:39360) 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.948+0000 7efdf3fff700 1 -- 172.21.15.52:0/4200159548 learned_addr learned my addr 172.21.15.52:0/4200159548 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf91bf700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 0x7efdf4153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf89be700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdf40c0140 0x7efdf414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 -- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 msgr2=0x7efdf4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 0x7efdf4153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 -- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdf40c0140 msgr2=0x7efdf414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdf40c0140 0x7efdf414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 -- 172.21.15.52:0/4200159548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00092a0 con 0x7efdf40c5cf0 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf91bf700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 0x7efdf4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf3fff700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7efde0009d50 tx=0x7efde0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0000d10 con 0x7efdf40c5cf0 2023-05-10T01:26:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000d770 con 0x7efdf40c5cf0 2023-05-10T01:26:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf40c3aa0 con 0x7efdf40c5cf0 2023-05-10T01:26:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde001d430 con 0x7efdf40c5cf0 2023-05-10T01:26:45.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.949+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf40c4060 con 0x7efdf40c5cf0 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.950+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf4083110 con 0x7efdf40c5cf0 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.950+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 54) v1 ==== 75162+0+0 (secure 0 0 0) 0x7efde000f070 con 0x7efdf40c5cf0 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.951+0000 7efdf0ff9700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 0x7efddc0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.951+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6858+0+0 (secure 0 0 0) 0x7efde007b5b0 con 0x7efdf40c5cf0 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.951+0000 7efdf89be700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 0x7efddc0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.951+0000 7efdf89be700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 0x7efddc0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efde8006d80 tx=0x7efde8008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:45.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:45.955+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efde004c910 con 0x7efdf40c5cf0 2023-05-10T01:26:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.128+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efdf406a410 con 0x7efdf40c5cf0 2023-05-10T01:26:46.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.801+0000 7efdf0ff9700 1 -- 172.21.15.52:0/4200159548 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 181+0+0 (secure 0 0 0) 0x7efde004ff30 con 0x7efdf40c5cf0 2023-05-10T01:26:46.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 msgr2=0x7efddc0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 0x7efddc0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7efde8006d80 tx=0x7efde8008040).stop 2023-05-10T01:26:46.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 msgr2=0x7efdf4152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7efde0009d50 tx=0x7efde0016000).stop 2023-05-10T01:26:46.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 shutdown_connections 2023-05-10T01:26:46.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7efddc05ecf0 0x7efddc0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdf4153f80 0x7efdf4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdf40c0140 0x7efdf414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 --2- 172.21.15.52:0/4200159548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf40c5cf0 0x7efdf4152d80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.805+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 >> 172.21.15.52:0/4200159548 conn(0x7efdf40cb5f0 msgr2=0x7efdf40ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:46.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.806+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 shutdown_connections 2023-05-10T01:26:46.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.806+0000 7efdf99c0700 1 -- 172.21.15.52:0/4200159548 wait complete. 2023-05-10T01:26:46.811 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:26:46.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:26:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.951+0000 7f5a48a65700 1 Processor -- start 2023-05-10T01:26:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.951+0000 7f5a48a65700 1 -- start start 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a48a65700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a440c0f00 0x7f5a44158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a48a65700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440c5f90 con 0x7f5a44154130 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a48a65700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440c6270 con 0x7f5a440c7c90 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a48a65700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440c6550 con 0x7f5a440c0f00 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a4259c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5a44154130 0x7f5a440c7580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48380/0 (socket says 172.21.15.52:48380) 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a4259c700 1 -- 172.21.15.52:0/2678113588 learned_addr learned my addr 172.21.15.52:0/2678113588 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:46.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.952+0000 7f5a41d9b700 1 --2- 172.21.15.52:0/2678113588 >> v2:172.21.15.52:3300/0 conn(0x7f5a440c0f00 0x7f5a44158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a41d9b700 1 -- 172.21.15.52:0/2678113588 >> v1:172.21.15.172:6789/0 conn(0x7f5a440c7c90 legacy=0x7f5a44154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a41d9b700 1 -- 172.21.15.52:0/2678113588 >> v1:172.21.15.52:6789/0 conn(0x7f5a44154130 legacy=0x7f5a440c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a4159a700 1 -- 172.21.15.52:0/2678113588 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266033833 0 0) 0x7f5a440c5f90 con 0x7f5a44154130 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a41d9b700 1 -- 172.21.15.52:0/2678113588 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440c6830 con 0x7f5a440c0f00 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a41d9b700 1 --2- 172.21.15.52:0/2678113588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a440c0f00 0x7f5a44158050 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f5a2c009760 tx=0x7f5a2c009060).ready entity=mon.0 client_cookie=58867e1a69696490 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a4159a700 1 -- 172.21.15.52:0/2678113588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00b580 con 0x7f5a440c0f00 2023-05-10T01:26:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a4159a700 1 -- 172.21.15.52:0/2678113588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00b6e0 con 0x7f5a440c0f00 2023-05-10T01:26:46.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a4159a700 1 -- 172.21.15.52:0/2678113588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00ba60 con 0x7f5a440c0f00 2023-05-10T01:26:46.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a48a65700 1 -- 172.21.15.52:0/2678113588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a440c0f00 msgr2=0x7f5a44158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.953+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2678113588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a440c0f00 0x7f5a44158050 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f5a2c009760 tx=0x7f5a2c009060).stop 2023-05-10T01:26:46.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.954+0000 7f5a48a65700 1 -- 172.21.15.52:0/2678113588 shutdown_connections 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.954+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2678113588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a440c0f00 0x7f5a44158050 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.954+0000 7f5a48a65700 1 -- 172.21.15.52:0/2678113588 >> 172.21.15.52:0/2678113588 conn(0x7f5a44067910 msgr2=0x7f5a44068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.954+0000 7f5a48a65700 1 -- 172.21.15.52:0/2678113588 shutdown_connections 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.954+0000 7f5a48a65700 1 -- 172.21.15.52:0/2678113588 wait complete. 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.955+0000 7f5a48a65700 1 Processor -- start 2023-05-10T01:26:46.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.955+0000 7f5a48a65700 1 -- start start 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.955+0000 7f5a48a65700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440c0f00 0x7f5a441418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a440c7c90 0x7f5a440acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44144f00 con 0x7f5a44154130 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440ad4d0 con 0x7f5a440c7c90 2023-05-10T01:26:46.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441442f0 con 0x7f5a440c0f00 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39374/0 (socket says 172.21.15.52:39374) 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 -- 172.21.15.52:0/2151788368 learned_addr learned my addr 172.21.15.52:0/2151788368 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 -- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440c0f00 msgr2=0x7f5a441418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a4259c700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440c0f00 0x7f5a441418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a41d9b700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a440c7c90 0x7f5a440acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:46.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440c0f00 0x7f5a441418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 -- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a440c7c90 msgr2=0x7f5a440acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a440c7c90 0x7f5a440acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 -- 172.21.15.52:0/2151788368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0092a0 con 0x7f5a44154130 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a42d9d700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f5a3400c440 tx=0x7f5a34007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400f470 con 0x7f5a44154130 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34001e90 con 0x7f5a44154130 2023-05-10T01:26:46.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a441445d0 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400f7e0 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.956+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44144b90 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.957+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4405e6e0 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.958+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5a34010070 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.958+0000 7f5a3a7fc700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 0x7f5a28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.958+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5a34078f10 con 0x7f5a44154130 2023-05-10T01:26:46.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.958+0000 7f5a4259c700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 0x7f5a28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:46.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.959+0000 7f5a4259c700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 0x7f5a28061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5a3c007fd0 tx=0x7f5a3c009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:46.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:46.962+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a340478f0 con 0x7f5a44154130 2023-05-10T01:26:47.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.143+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a440666b0 con 0x7f5a44154130 2023-05-10T01:26:47.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.812+0000 7f5a3a7fc700 1 -- 172.21.15.52:0/2151788368 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a3404a380 con 0x7f5a44154130 2023-05-10T01:26:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 msgr2=0x7f5a28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 0x7f5a28061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5a3c007fd0 tx=0x7f5a3c009040).stop 2023-05-10T01:26:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 msgr2=0x7f5a440acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f5a3400c440 tx=0x7f5a34007d70).stop 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 shutdown_connections 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.816+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5a2805ed90 0x7f5a28061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a44154130 0x7f5a440acfe0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440c0f00 0x7f5a441418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 --2- 172.21.15.52:0/2151788368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a440c7c90 0x7f5a440acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 >> 172.21.15.52:0/2151788368 conn(0x7f5a44067910 msgr2=0x7f5a4406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 shutdown_connections 2023-05-10T01:26:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.817+0000 7f5a48a65700 1 -- 172.21.15.52:0/2151788368 wait complete. 2023-05-10T01:26:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:26:47.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:26:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.956+0000 7faa2e2bb700 1 Processor -- start 2023-05-10T01:26:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.956+0000 7faa2e2bb700 1 -- start start 2023-05-10T01:26:47.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 0x7faa281542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa28062cb0 0x7faa28066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa280bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa28067330 con 0x7faa28062cb0 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa28155660 con 0x7faa28153ed0 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa2e2bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa28155860 con 0x7faa280bdb60 2023-05-10T01:26:47.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa277fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa28062cb0 0x7faa28066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa277fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa28062cb0 0x7faa28066e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39378/0 (socket says 172.21.15.52:39378) 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.957+0000 7faa277fe700 1 -- 172.21.15.52:0/3506833632 learned_addr learned my addr 172.21.15.52:0/3506833632 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa2c858700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa280bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa27fff700 1 --2- 172.21.15.52:0/3506833632 >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 0x7faa281542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 -- 172.21.15.52:0/3506833632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 msgr2=0x7faa280bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa280bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 -- 172.21.15.52:0/3506833632 >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 msgr2=0x7faa281542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 --2- 172.21.15.52:0/3506833632 >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 0x7faa281542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 -- 172.21.15.52:0/3506833632 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28063110 con 0x7faa28062cb0 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa2c858700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa280bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa27fff700 1 --2- 172.21.15.52:0/3506833632 >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 0x7faa281542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa277fe700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa28066e40 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faa280c7850 tx=0x7faa1c0090f0).ready entity=mon.0 client_cookie=e8cc278bc3430e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa26ffd700 1 -- 172.21.15.52:0/3506833632 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00b600 con 0x7faa28062cb0 2023-05-10T01:26:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa26ffd700 1 -- 172.21.15.52:0/3506833632 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00b760 con 0x7faa28062cb0 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa26ffd700 1 -- 172.21.15.52:0/3506833632 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00bae0 con 0x7faa28062cb0 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa2e2bb700 1 -- 172.21.15.52:0/3506833632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 msgr2=0x7faa28066e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.958+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa28066e40 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faa280c7850 tx=0x7faa1c0090f0).stop 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 -- 172.21.15.52:0/3506833632 shutdown_connections 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa280bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/3506833632 >> v2:172.21.15.172:3300/0 conn(0x7faa28153ed0 0x7faa281542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/3506833632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa28066e40 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 -- 172.21.15.52:0/3506833632 >> 172.21.15.52:0/3506833632 conn(0x7faa280c8410 msgr2=0x7faa280c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 -- 172.21.15.52:0/3506833632 shutdown_connections 2023-05-10T01:26:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.959+0000 7faa2e2bb700 1 -- 172.21.15.52:0/3506833632 wait complete. 2023-05-10T01:26:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.960+0000 7faa2e2bb700 1 Processor -- start 2023-05-10T01:26:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.960+0000 7faa2e2bb700 1 -- start start 2023-05-10T01:26:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa28152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 0x7faa28153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa281534f0 con 0x7faa28062cb0 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280bf5b0 con 0x7faa28153ed0 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280be9e0 con 0x7faa280bdb60 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39382/0 (socket says 172.21.15.52:39382) 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 -- 172.21.15.52:0/696394711 learned_addr learned my addr 172.21.15.52:0/696394711 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa277fe700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa28152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2c858700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 0x7faa28153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 -- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 msgr2=0x7faa28152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa28152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 -- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 msgr2=0x7faa28153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 0x7faa28153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 -- 172.21.15.52:0/696394711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c009370 con 0x7faa28062cb0 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa277fe700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa28152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2c858700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 0x7faa28153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa27fff700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7faa1800c880 tx=0x7faa18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18010580 con 0x7faa28062cb0 2023-05-10T01:26:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa180106e0 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280bec80 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18010a80 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.961+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280bf240 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.962+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280bf890 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.963+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa1801b460 con 0x7faa28062cb0 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.963+0000 7faa0ffff700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 0x7faa08061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.963+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7faa18079b50 con 0x7faa28062cb0 2023-05-10T01:26:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.963+0000 7faa277fe700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 0x7faa08061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.964+0000 7faa277fe700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 0x7faa08061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faa28156ef0 tx=0x7faa1c017000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:47.967+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa1804b160 con 0x7faa28062cb0 2023-05-10T01:26:48.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.145+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7faa2806c340 con 0x7faa28062cb0 2023-05-10T01:26:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.148+0000 7faa0ffff700 1 -- 172.21.15.52:0/696394711 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v24) v1 ==== 120+0+0 (secure 0 0 0) 0x7faa1804e780 con 0x7faa28062cb0 2023-05-10T01:26:48.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 msgr2=0x7faa08061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 0x7faa08061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faa28156ef0 tx=0x7faa1c017000).stop 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 msgr2=0x7faa2814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7faa1800c880 tx=0x7faa18008040).stop 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 shutdown_connections 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa0805ed90 0x7faa08061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa28153ed0 0x7faa28153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa28062cb0 0x7faa2814fe00 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 --2- 172.21.15.52:0/696394711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa280bdb60 0x7faa28152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 >> 172.21.15.52:0/696394711 conn(0x7faa280c8410 msgr2=0x7faa28065800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:48.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 shutdown_connections 2023-05-10T01:26:48.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.150+0000 7faa2e2bb700 1 -- 172.21.15.52:0/696394711 wait complete. 2023-05-10T01:26:48.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:26:48.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.283+0000 7f5674289700 1 Processor -- start 2023-05-10T01:26:48.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.283+0000 7f5674289700 1 -- start start 2023-05-10T01:26:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5674289700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f566c154080 0x7f566c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5674289700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c154460 0x7f566c0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5674289700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0c94c0 con 0x7f566c0aa140 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5674289700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c0aa5b0 con 0x7f566c154080 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5674289700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0cb7d0 con 0x7f566c154460 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f566c154080 0x7f566c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f566c154080 0x7f566c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39390/0 (socket says 172.21.15.52:39390) 2023-05-10T01:26:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 -- 172.21.15.52:0/2107524259 learned_addr learned my addr 172.21.15.52:0/2107524259 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5671824700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c154460 0x7f566c0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 -- 172.21.15.52:0/2107524259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c154460 msgr2=0x7f566c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c154460 0x7f566c0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 -- 172.21.15.52:0/2107524259 >> v1:172.21.15.52:6789/0 conn(0x7f566c0aa140 legacy=0x7f566c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 -- 172.21.15.52:0/2107524259 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0c88b0 con 0x7f566c154080 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5672025700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154080 0x7f566c0aac90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f5664006fd0 tx=0x7f56640090f0).ready entity=mon.0 client_cookie=8a6f6d6b8935fd1e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5671023700 1 -- 172.21.15.52:0/2107524259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400b600 con 0x7f566c154080 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5671023700 1 -- 172.21.15.52:0/2107524259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400b760 con 0x7f566c154080 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.284+0000 7f5671023700 1 -- 172.21.15.52:0/2107524259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400bae0 con 0x7f566c154080 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 -- 172.21.15.52:0/2107524259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154080 msgr2=0x7f566c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154080 0x7f566c0aac90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f5664006fd0 tx=0x7f56640090f0).stop 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 -- 172.21.15.52:0/2107524259 shutdown_connections 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154080 0x7f566c0aac90 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 --2- 172.21.15.52:0/2107524259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c154460 0x7f566c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 -- 172.21.15.52:0/2107524259 >> 172.21.15.52:0/2107524259 conn(0x7f566c067910 msgr2=0x7f566c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 -- 172.21.15.52:0/2107524259 shutdown_connections 2023-05-10T01:26:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.285+0000 7f5674289700 1 -- 172.21.15.52:0/2107524259 wait complete. 2023-05-10T01:26:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.286+0000 7f5674289700 1 Processor -- start 2023-05-10T01:26:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.286+0000 7f5674289700 1 -- start start 2023-05-10T01:26:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c0aa140 0x7f566c167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f566c154080 0x7f566c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0aeb10 con 0x7f566c154460 2023-05-10T01:26:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0adf00 con 0x7f566c154080 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5674289700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ae1e0 con 0x7f566c0aa140 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39400/0 (socket says 172.21.15.52:39400) 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 -- 172.21.15.52:0/2575886101 learned_addr learned my addr 172.21.15.52:0/2575886101 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672025700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c0aa140 0x7f566c167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5671824700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f566c154080 0x7f566c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 -- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c0aa140 msgr2=0x7f566c167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c0aa140 0x7f566c167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 -- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f566c154080 msgr2=0x7f566c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f566c154080 0x7f566c0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 -- 172.21.15.52:0/2575886101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009370 con 0x7f566c154460 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.287+0000 7f5672826700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f565c00c7c0 tx=0x7f565c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c010510 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c010670 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c0ae4c0 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c0109f0 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0adbb0 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.288+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c066720 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.289+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f565c010070 con 0x7f566c154460 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.289+0000 7f566a7fc700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 0x7f564c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.289+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f565c0796f0 con 0x7f566c154460 2023-05-10T01:26:48.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.289+0000 7f5672025700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 0x7f564c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.290+0000 7f5672025700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 0x7f564c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5664009130 tx=0x7f5664017000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.293+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f565c04ad00 con 0x7f566c154460 2023-05-10T01:26:48.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.473+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f566c0c8b90 con 0x7f566c154460 2023-05-10T01:26:48.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.476+0000 7f566a7fc700 1 -- 172.21.15.52:0/2575886101 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f565c04e320 con 0x7f566c154460 2023-05-10T01:26:48.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 msgr2=0x7f564c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 0x7f564c061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5664009130 tx=0x7f5664017000).stop 2023-05-10T01:26:48.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 msgr2=0x7f566c14db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f565c00c7c0 tx=0x7f565c001510).stop 2023-05-10T01:26:48.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 shutdown_connections 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f564c05ed90 0x7f564c061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f566c154460 0x7f566c14db00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f566c0aa140 0x7f566c167f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 --2- 172.21.15.52:0/2575886101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f566c154080 0x7f566c0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 >> 172.21.15.52:0/2575886101 conn(0x7f566c067910 msgr2=0x7f566c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 shutdown_connections 2023-05-10T01:26:48.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.478+0000 7f5674289700 1 -- 172.21.15.52:0/2575886101 wait complete. 2023-05-10T01:26:48.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-05-10T01:26:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.608+0000 7f3b4b754700 1 Processor -- start 2023-05-10T01:26:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.608+0000 7f3b4b754700 1 -- start start 2023-05-10T01:26:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b4b754700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b44154160 0x7f3b440c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b4b754700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440c0650 con 0x7f3b44069da0 2023-05-10T01:26:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b4b754700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440bfd20 con 0x7f3b44154540 2023-05-10T01:26:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b4b754700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440c0000 con 0x7f3b44154160 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b49cf1700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b44069da0 0x7f3b440c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48422/0 (socket says 172.21.15.52:48422) 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.609+0000 7f3b49cf1700 1 -- 172.21.15.52:0/1510698087 learned_addr learned my addr 172.21.15.52:0/1510698087 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 --2- 172.21.15.52:0/1510698087 >> v2:172.21.15.172:3300/0 conn(0x7f3b44154160 0x7f3b440c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189102103 0 0) 0x7f3b440c0650 con 0x7f3b44069da0 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b300033f0 con 0x7f3b44069da0 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 275701403 0 0) 0x7f3b300033f0 con 0x7f3b44069da0 2023-05-10T01:26:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 >> v2:172.21.15.172:3300/0 conn(0x7f3b44154160 msgr2=0x7f3b440c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 --2- 172.21.15.52:0/1510698087 >> v2:172.21.15.172:3300/0 conn(0x7f3b44154160 0x7f3b440c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 >> v1:172.21.15.172:6789/0 conn(0x7f3b44154540 legacy=0x7f3b44069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440c02e0 con 0x7f3b44069da0 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f3b34001470 con 0x7f3b44069da0 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 >> v1:172.21.15.52:6789/0 conn(0x7f3b44069da0 legacy=0x7f3b440c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 0x7f3b30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b30004690 0x7f3b30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b30005050 0x7f3b3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440c0000 con 0x7f3b300038e0 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3000bfe0 con 0x7f3b30004690 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3000c1a0 con 0x7f3b30005050 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 0x7f3b30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b48cef700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b30004690 0x7f3b30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b49cf1700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b30005050 0x7f3b3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 -- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b30005050 msgr2=0x7f3b3000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b30005050 0x7f3b3000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 -- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b30004690 msgr2=0x7f3b30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b30004690 0x7f3b30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b49cf1700 1 -- 172.21.15.52:0/1510698087 reap_dead start 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.610+0000 7f3b494f0700 1 -- 172.21.15.52:0/1510698087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300033f0 con 0x7f3b300038e0 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b48cef700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b30004690 0x7f3b30004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b494f0700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 0x7f3b30003d00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f3b3c0094d0 tx=0x7f3b3c00b040).ready entity=mon.0 client_cookie=a6c02e860b5ebcf8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c009ac0 con 0x7f3b300038e0 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c00f040 con 0x7f3b300038e0 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b43fff700 1 -- 172.21.15.52:0/1510698087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00eca0 con 0x7f3b300038e0 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 -- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 msgr2=0x7f3b30003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 0x7f3b30003d00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f3b3c0094d0 tx=0x7f3b3c00b040).stop 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 -- 172.21.15.52:0/1510698087 shutdown_connections 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 --2- 172.21.15.52:0/1510698087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b300038e0 0x7f3b30003d00 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 -- 172.21.15.52:0/1510698087 >> 172.21.15.52:0/1510698087 conn(0x7f3b440cb6f0 msgr2=0x7f3b440c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 -- 172.21.15.52:0/1510698087 shutdown_connections 2023-05-10T01:26:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.611+0000 7f3b4b754700 1 -- 172.21.15.52:0/1510698087 wait complete. 2023-05-10T01:26:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.612+0000 7f3b4b754700 1 Processor -- start 2023-05-10T01:26:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.612+0000 7f3b4b754700 1 -- start start 2023-05-10T01:26:48.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 0x7f3b441505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b440a9af0 0x7f3b440a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440aa420 con 0x7f3b440ca6f0 2023-05-10T01:26:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44150ed0 con 0x7f3b440a9af0 2023-05-10T01:26:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b4b754700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b441511b0 con 0x7f3b300038e0 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b48cef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b48cef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39418/0 (socket says 172.21.15.52:39418) 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.613+0000 7f3b48cef700 1 -- 172.21.15.52:0/501272957 learned_addr learned my addr 172.21.15.52:0/501272957 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b494f0700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 0x7f3b441505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b49cf1700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b440a9af0 0x7f3b440a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 -- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 msgr2=0x7f3b441505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 0x7f3b441505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 -- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b440a9af0 msgr2=0x7f3b440a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b440a9af0 0x7f3b440a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 -- 172.21.15.52:0/501272957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44151490 con 0x7f3b440ca6f0 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b494f0700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 0x7f3b441505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b48cef700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f3b3800e490 tx=0x7f3b38009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38014430 con 0x7f3b440ca6f0 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38014590 con 0x7f3b440ca6f0 2023-05-10T01:26:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b44151770 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38014910 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.614+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b44150ac0 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.615+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b440666b0 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.615+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b38014cc0 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.616+0000 7f3b417fa700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 0x7f3b24061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.616+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f3b38079bf0 con 0x7f3b440ca6f0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.616+0000 7f3b494f0700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 0x7f3b24061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.616+0000 7f3b494f0700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 0x7f3b24061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3b3c00afd0 tx=0x7f3b3c01a000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.620+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b3804b200 con 0x7f3b440ca6f0 2023-05-10T01:26:48.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:48.862+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f3b440666b0 con 0x7f3b440ca6f0 2023-05-10T01:26:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.814+0000 7f3b417fa700 1 -- 172.21.15.52:0/501272957 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v649) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3b3804e820 con 0x7f3b440ca6f0 2023-05-10T01:26:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 msgr2=0x7f3b24061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 0x7f3b24061220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3b3c00afd0 tx=0x7f3b3c01a000).stop 2023-05-10T01:26:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 msgr2=0x7f3b4414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f3b3800e490 tx=0x7f3b38009040).stop 2023-05-10T01:26:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 shutdown_connections 2023-05-10T01:26:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f3b2405ed60 0x7f3b24061220 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b440a9af0 0x7f3b440a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b300038e0 0x7f3b441505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 --2- 172.21.15.52:0/501272957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b440ca6f0 0x7f3b4414d790 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 >> 172.21.15.52:0/501272957 conn(0x7f3b440cb6f0 msgr2=0x7f3b440abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 shutdown_connections 2023-05-10T01:26:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.816+0000 7f3b4b754700 1 -- 172.21.15.52:0/501272957 wait complete. 2023-05-10T01:26:49.834 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-05-10T01:26:49.835 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-05-10T01:26:49.835 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:26:49.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-05-10T01:26:49.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.957+0000 7f974087b700 1 Processor -- start 2023-05-10T01:26:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.957+0000 7f974087b700 1 -- start start 2023-05-10T01:26:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 0x7f973c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f973c154540 0x7f973c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0c0650 con 0x7f973c069690 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0c1af0 con 0x7f973c154540 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0bfd20 con 0x7f973c154160 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f973c154540 0x7f973c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f973c154540 0x7f973c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39426/0 (socket says 172.21.15.52:39426) 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 -- 172.21.15.52:0/2610444179 learned_addr learned my addr 172.21.15.52:0/2610444179 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f973a59c700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 0x7f973c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 -- 172.21.15.52:0/2610444179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 msgr2=0x7f973c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:49.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 0x7f973c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 -- 172.21.15.52:0/2610444179 >> v1:172.21.15.52:6789/0 conn(0x7f973c069690 legacy=0x7f973c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 -- 172.21.15.52:0/2610444179 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0c0000 con 0x7f973c154540 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f973a59c700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 0x7f973c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f9739d9b700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154540 0x7f973c0c6150 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f9724009f20 tx=0x7f9724009840).ready entity=mon.0 client_cookie=bdb39e1bbfd6d7df server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f973959a700 1 -- 172.21.15.52:0/2610444179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400e070 con 0x7f973c154540 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f973959a700 1 -- 172.21.15.52:0/2610444179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400ba80 con 0x7f973c154540 2023-05-10T01:26:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f973959a700 1 -- 172.21.15.52:0/2610444179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400be00 con 0x7f973c154540 2023-05-10T01:26:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- 172.21.15.52:0/2610444179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154540 msgr2=0x7f973c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154540 0x7f973c0c6150 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f9724009f20 tx=0x7f9724009840).stop 2023-05-10T01:26:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- 172.21.15.52:0/2610444179 shutdown_connections 2023-05-10T01:26:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c154160 0x7f973c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 --2- 172.21.15.52:0/2610444179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154540 0x7f973c0c6150 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- 172.21.15.52:0/2610444179 >> 172.21.15.52:0/2610444179 conn(0x7f973c0cb6f0 msgr2=0x7f973c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- 172.21.15.52:0/2610444179 shutdown_connections 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.959+0000 7f974087b700 1 -- 172.21.15.52:0/2610444179 wait complete. 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.960+0000 7f974087b700 1 Processor -- start 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.960+0000 7f974087b700 1 -- start start 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c069690 0x7f973c0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 0x7f973c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c14d720 con 0x7f973c154160 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0c3ab0 con 0x7f973c154540 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f974087b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0c3d90 con 0x7f973c069690 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f9739d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f9739d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39430/0 (socket says 172.21.15.52:39430) 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f9739d9b700 1 -- 172.21.15.52:0/932509019 learned_addr learned my addr 172.21.15.52:0/932509019 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f973a59c700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c069690 0x7f973c0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.961+0000 7f973ad9d700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 0x7f973c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 -- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c069690 msgr2=0x7f973c0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c069690 0x7f973c0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 -- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 msgr2=0x7f973c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 0x7f973c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 -- 172.21.15.52:0/932509019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724009ae0 con 0x7f973c154160 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f973ad9d700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 0x7f973c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f9739d9b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f9724010000 tx=0x7f9724009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240032f0 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400bbf0 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0c4070 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972401e680 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.962+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c0c2bf0 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.963+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c05e950 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.963+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9724025030 con 0x7f973c154160 2023-05-10T01:26:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.964+0000 7f97327fc700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 0x7f9720061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.964+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f972407afa0 con 0x7f973c154160 2023-05-10T01:26:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.964+0000 7f973a59c700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 0x7f9720061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.964+0000 7f973a59c700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 0x7f9720061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9734006d80 tx=0x7f9734008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:49.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:49.968+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f973c05e950 con 0x7f973c154160 2023-05-10T01:26:50.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.208+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f973c05e950 con 0x7f973c154160 2023-05-10T01:26:50.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.816+0000 7f97327fc700 1 -- 172.21.15.52:0/932509019 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v650) v1 ==== 168+0+0 (secure 0 0 0) 0x7f973c05e950 con 0x7f973c154160 2023-05-10T01:26:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.818+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 msgr2=0x7f9720061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.818+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 0x7f9720061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9734006d80 tx=0x7f9734008040).stop 2023-05-10T01:26:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.818+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 msgr2=0x7f973c14bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.818+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f9724010000 tx=0x7f9724009840).stop 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.818+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 shutdown_connections 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f972005edc0 0x7f9720061280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f973c154540 0x7f973c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f973c069690 0x7f973c0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 --2- 172.21.15.52:0/932509019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f973c154160 0x7f973c14bfe0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 >> 172.21.15.52:0/932509019 conn(0x7f973c0cb6f0 msgr2=0x7f973c0ab340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 shutdown_connections 2023-05-10T01:26:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.819+0000 7f974087b700 1 -- 172.21.15.52:0/932509019 wait complete. 2023-05-10T01:26:50.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:26:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.963+0000 7fcc51c54700 1 Processor -- start 2023-05-10T01:26:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.963+0000 7fcc51c54700 1 -- start start 2023-05-10T01:26:50.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc51c54700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc4c154080 0x7fcc4c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc51c54700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154460 0x7fcc4c0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc51c54700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c0c94c0 con 0x7fcc4c0aa140 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc51c54700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0aa5b0 con 0x7fcc4c154080 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc51c54700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cb7d0 con 0x7fcc4c154460 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc4c154080 0x7fcc4c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc4b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc4c154080 0x7fcc4c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39438/0 (socket says 172.21.15.52:39438) 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.964+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3079009155 learned_addr learned my addr 172.21.15.52:0/3079009155 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4affd700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154460 0x7fcc4c0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3079009155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154460 msgr2=0x7fcc4c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4b7fe700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154460 0x7fcc4c0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3079009155 >> v1:172.21.15.52:6789/0 conn(0x7fcc4c0aa140 legacy=0x7fcc4c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3079009155 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0c88b0 con 0x7fcc4c154080 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4b7fe700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c154080 0x7fcc4c0aac90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7fcc3c006fd0 tx=0x7fcc3c0090f0).ready entity=mon.0 client_cookie=fd9575f4c897204 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4a7fc700 1 -- 172.21.15.52:0/3079009155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00b600 con 0x7fcc4c154080 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4a7fc700 1 -- 172.21.15.52:0/3079009155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c00b760 con 0x7fcc4c154080 2023-05-10T01:26:50.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc4a7fc700 1 -- 172.21.15.52:0/3079009155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00bae0 con 0x7fcc4c154080 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc51c54700 1 -- 172.21.15.52:0/3079009155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c154080 msgr2=0x7fcc4c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.965+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c154080 0x7fcc4c0aac90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7fcc3c006fd0 tx=0x7fcc3c0090f0).stop 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 -- 172.21.15.52:0/3079009155 shutdown_connections 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c154080 0x7fcc4c0aac90 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3079009155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154460 0x7fcc4c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 -- 172.21.15.52:0/3079009155 >> 172.21.15.52:0/3079009155 conn(0x7fcc4c067910 msgr2=0x7fcc4c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 -- 172.21.15.52:0/3079009155 shutdown_connections 2023-05-10T01:26:50.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.966+0000 7fcc51c54700 1 -- 172.21.15.52:0/3079009155 wait complete. 2023-05-10T01:26:50.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.967+0000 7fcc51c54700 1 Processor -- start 2023-05-10T01:26:50.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.967+0000 7fcc51c54700 1 -- start start 2023-05-10T01:26:50.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154080 0x7fcc4c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 0x7fcc4c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0aeb10 con 0x7fcc4c0aa140 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0adf00 con 0x7fcc4c154460 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc51c54700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0ae1e0 con 0x7fcc4c154080 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39444/0 (socket says 172.21.15.52:39444) 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3254612077 learned_addr learned my addr 172.21.15.52:0/3254612077 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4affd700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154080 0x7fcc4c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4bfff700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 0x7fcc4c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154080 msgr2=0x7fcc4c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154080 0x7fcc4c0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 msgr2=0x7fcc4c14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 0x7fcc4c14db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 -- 172.21.15.52:0/3254612077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c009370 con 0x7fcc4c0aa140 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4bfff700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 0x7fcc4c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:50.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc4b7fe700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcc4c06bb20 tx=0x7fcc3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.968+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00b8d0 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.969+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c00ba30 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.969+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c0ae4c0 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.969+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01c670 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.969+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0adbb0 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.970+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c066720 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.970+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc3c02c070 con 0x7fcc4c0aa140 2023-05-10T01:26:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.970+0000 7fcc337fe700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:50.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.970+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fcc3c07b620 con 0x7fcc4c0aa140 2023-05-10T01:26:50.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.970+0000 7fcc4affd700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:50.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.971+0000 7fcc4affd700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 0x7fcc2c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fcc4000bbc0 tx=0x7fcc40008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:50.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:50.975+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc3c04cc30 con 0x7fcc4c0aa140 2023-05-10T01:26:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.147+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcc4c06c340 con 0x7fcc4c0aa140 2023-05-10T01:26:51.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.151+0000 7fcc337fe700 1 -- 172.21.15.52:0/3254612077 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc3c02a020 con 0x7fcc4c0aa140 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 msgr2=0x7fcc2c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 0x7fcc2c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fcc4000bbc0 tx=0x7fcc40008040).stop 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 msgr2=0x7fcc4c167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcc4c06bb20 tx=0x7fcc3c017000).stop 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 shutdown_connections 2023-05-10T01:26:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fcc2c05ed90 0x7fcc2c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4c154460 0x7fcc4c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc4c0aa140 0x7fcc4c167f50 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 --2- 172.21.15.52:0/3254612077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4c154080 0x7fcc4c0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 >> 172.21.15.52:0/3254612077 conn(0x7fcc4c067910 msgr2=0x7fcc4c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 shutdown_connections 2023-05-10T01:26:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.153+0000 7fcc51c54700 1 -- 172.21.15.52:0/3254612077 wait complete. 2023-05-10T01:26:51.167 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:26:51.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:51.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:26:51.228 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:26:51.228 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:26:51.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.349+0000 7f08adb7a700 1 Processor -- start 2023-05-10T01:26:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.349+0000 7f08adb7a700 1 -- start start 2023-05-10T01:26:51.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08adb7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 0x7f08a80629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08adb7a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08a8064030 0x7f08a8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08adb7a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8063040 con 0x7f08a8154320 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08adb7a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a80c7ec0 con 0x7f08a8064030 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08adb7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8068080 con 0x7f08a8153a50 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08a7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08a8064030 0x7f08a8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08acb78700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 0x7f08a80629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08a7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08a8064030 0x7f08a8153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:37780/0 (socket says 172.21.15.52:37780) 2023-05-10T01:26:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08ad379700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f08a8154320 0x7f08a80684d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:51008/0 (socket says 172.21.15.52:51008) 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.350+0000 7f08a7fff700 1 -- 172.21.15.52:0/1308210726 learned_addr learned my addr 172.21.15.52:0/1308210726 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a7fff700 1 -- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 msgr2=0x7f08a80629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a7fff700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 0x7f08a80629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a7fff700 1 -- 172.21.15.52:0/1308210726 >> v1:172.21.15.172:6789/0 conn(0x7f08a8154320 legacy=0x7f08a80684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a77fe700 1 -- 172.21.15.52:0/1308210726 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375619500 0 0) 0x7f08a8063040 con 0x7f08a8154320 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a7fff700 1 -- 172.21.15.52:0/1308210726 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80c80d0 con 0x7f08a8064030 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08acb78700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 0x7f08a80629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a7fff700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8064030 0x7f08a8153e30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f0894006fd0 tx=0x7f08940090f0).ready entity=mon.1 client_cookie=44511c5240f17260 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a77fe700 1 -- 172.21.15.52:0/1308210726 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400b580 con 0x7f08a8064030 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a77fe700 1 -- 172.21.15.52:0/1308210726 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089400b6e0 con 0x7f08a8064030 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08a77fe700 1 -- 172.21.15.52:0/1308210726 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400ba60 con 0x7f08a8064030 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08adb7a700 1 -- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8064030 msgr2=0x7f08a8153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.351+0000 7f08adb7a700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8064030 0x7f08a8153e30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f0894006fd0 tx=0x7f08940090f0).stop 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 -- 172.21.15.52:0/1308210726 shutdown_connections 2023-05-10T01:26:51.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8153a50 0x7f08a80629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 --2- 172.21.15.52:0/1308210726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8064030 0x7f08a8153e30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 -- 172.21.15.52:0/1308210726 >> 172.21.15.52:0/1308210726 conn(0x7f08a805e810 msgr2=0x7f08a80622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:51.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 -- 172.21.15.52:0/1308210726 shutdown_connections 2023-05-10T01:26:51.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.352+0000 7f08adb7a700 1 -- 172.21.15.52:0/1308210726 wait complete. 2023-05-10T01:26:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.353+0000 7f08adb7a700 1 Processor -- start 2023-05-10T01:26:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.353+0000 7f08adb7a700 1 -- start start 2023-05-10T01:26:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8064030 0x7f08a814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8154320 0x7f08a8062790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80a98a0 con 0x7f08a8153a50 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8062c80 con 0x7f08a8154320 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08adb7a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80a8920 con 0x7f08a8064030 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39460/0 (socket says 172.21.15.52:39460) 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 -- 172.21.15.52:0/2829911931 learned_addr learned my addr 172.21.15.52:0/2829911931 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08ad379700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8154320 0x7f08a8062790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08acb78700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8064030 0x7f08a814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 -- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8064030 msgr2=0x7f08a814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8064030 0x7f08a814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 -- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8154320 msgr2=0x7f08a8062790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8154320 0x7f08a8062790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 -- 172.21.15.52:0/2829911931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0092a0 con 0x7f08a8153a50 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a7fff700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0894011000 tx=0x7f0894017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894000bc0 con 0x7f08a8153a50 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.354+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089400b850 con 0x7f08a8153a50 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.355+0000 7f08adb7a700 1 -- 172.21.15.52:0/2829911931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0894009370 con 0x7f08a8153a50 2023-05-10T01:26:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.355+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894000d20 con 0x7f08a8153a50 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.355+0000 7f08adb7a700 1 -- 172.21.15.52:0/2829911931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a80a8ee0 con 0x7f08a8153a50 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.356+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a80aaff0 con 0x7f08a8153a50 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.356+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f089402c070 con 0x7f08a8153a50 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.356+0000 7f08a4ff9700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 0x7f0890061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.356+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f089407b7b0 con 0x7f08a8153a50 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.357+0000 7f08acb78700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 0x7f0890061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.357+0000 7f08acb78700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 0x7f0890061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f089c009dc0 tx=0x7f089c009060).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.360+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f089404ccb0 con 0x7f08a8153a50 2023-05-10T01:26:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.578+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08a8047150 con 0x7f08a8153a50 2023-05-10T01:26:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.578+0000 7f08a4ff9700 1 -- 172.21.15.52:0/2829911931 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f089402a020 con 0x7f08a8153a50 2023-05-10T01:26:51.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:51.582 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1641387757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1641387757},{"type":"v1","addr":"172.21.15.172:6836","nonce":1641387757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1439774213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1439774213},{"type":"v1","addr":"172.21.15.172:6837","nonce":1439774213}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7602,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/967570987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":967570987},{"type":"v1","addr":"172.21.15.52:6834","nonce":967570987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7605,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3284922129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3284922129},{"type":"v1","addr":"172.21.15.52:6835","nonce":3284922129}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2023-05-10T01:26:51.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 msgr2=0x7f0890061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 0x7f0890061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f089c009dc0 tx=0x7f089c009060).stop 2023-05-10T01:26:51.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 msgr2=0x7f08a80622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f0894011000 tx=0x7f0894017000).stop 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 shutdown_connections 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f089005ed90 0x7f0890061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08a8154320 0x7f08a8062790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08a8064030 0x7f08a814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 --2- 172.21.15.52:0/2829911931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a8153a50 0x7f08a80622a0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.580+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 >> 172.21.15.52:0/2829911931 conn(0x7f08a805e810 msgr2=0x7f08a814f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:51.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.581+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 shutdown_connections 2023-05-10T01:26:51.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.581+0000 7f088a7fc700 1 -- 172.21.15.52:0/2829911931 wait complete. 2023-05-10T01:26:51.585 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 56 2023-05-10T01:26:51.595 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:26:51.595 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:26:51.596 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:26:51.596 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:51.596 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:26:51.597 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:26:51.597 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:26:51.597 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:51.597 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:26:51.597 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:26:51.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:26:51.598 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:51.598 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:26:51.599 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:26:51.599 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:26:51.599 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:26:51.604 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:26:51.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:26:51.605 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:26:51.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:26:51.609 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:26:51.610 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:26:51.611 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:26:51.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:26:51.647 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:26:51.648 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:51.649 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:26:51.649 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:51.652 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:26:51.652 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:51.653 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:26:51.653 DEBUG:teuthology.parallel:result is None 2023-05-10T01:26:51.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:26:51.721 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:26:51.721 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:26:51.735 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:26:51.736 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:26:51.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.775+0000 7f73292bb700 1 Processor -- start 2023-05-10T01:26:51.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.775+0000 7f73292bb700 1 -- start start 2023-05-10T01:26:51.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73292bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73292bb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 0x7f7324062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73292bb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7324062950 con 0x7f73240bf4e0 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73292bb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7324154410 con 0x7f7324063e20 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73292bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7324069fa0 con 0x7f7324154030 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73237fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 0x7f7324062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73227fc700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f73240bf4e0 0x7f7324063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:51044/0 (socket says 172.21.15.52:51044) 2023-05-10T01:26:51.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f73227fc700 1 -- 172.21.15.52:0/3691169565 learned_addr learned my addr 172.21.15.52:0/3691169565 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:51.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.776+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:59126/0 (socket says 172.21.15.52:59126) 2023-05-10T01:26:51.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7322ffd700 1 -- 172.21.15.52:0/3691169565 >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 msgr2=0x7f7324062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:51.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7322ffd700 1 --2- 172.21.15.52:0/3691169565 >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 0x7f7324062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7322ffd700 1 -- 172.21.15.52:0/3691169565 >> v1:172.21.15.172:6789/0 conn(0x7f73240bf4e0 legacy=0x7f7324063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7321ffb700 1 -- 172.21.15.52:0/3691169565 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112342478 0 0) 0x7f7324062950 con 0x7f73240bf4e0 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7322ffd700 1 -- 172.21.15.52:0/3691169565 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324062340 con 0x7f7324154030 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73237fe700 1 --2- 172.21.15.52:0/3691169565 >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 0x7f7324062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7322ffd700 1 --2- 172.21.15.52:0/3691169565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7318009e60 tx=0x7f7318009780).ready entity=mon.2 client_cookie=4686129e7e49cc41 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7321ffb700 1 -- 172.21.15.52:0/3691169565 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800e070 con 0x7f7324154030 2023-05-10T01:26:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7321ffb700 1 -- 172.21.15.52:0/3691169565 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800bb60 con 0x7f7324154030 2023-05-10T01:26:51.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f7321ffb700 1 -- 172.21.15.52:0/3691169565 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318012410 con 0x7f7324154030 2023-05-10T01:26:51.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 -- 172.21.15.52:0/3691169565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 msgr2=0x7f7324069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 --2- 172.21.15.52:0/3691169565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7318009e60 tx=0x7f7318009780).stop 2023-05-10T01:26:51.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 -- 172.21.15.52:0/3691169565 shutdown_connections 2023-05-10T01:26:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 --2- 172.21.15.52:0/3691169565 >> v2:172.21.15.172:3300/0 conn(0x7f7324063e20 0x7f7324062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 --2- 172.21.15.52:0/3691169565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324154030 0x7f7324069ab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 -- 172.21.15.52:0/3691169565 >> 172.21.15.52:0/3691169565 conn(0x7f73240c8a90 msgr2=0x7f73240c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 -- 172.21.15.52:0/3691169565 shutdown_connections 2023-05-10T01:26:51.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.777+0000 7f73292bb700 1 -- 172.21.15.52:0/3691169565 wait complete. 2023-05-10T01:26:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 Processor -- start 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 -- start start 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324063e20 0x7f73240abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324154030 0x7f73240adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240aaf50 con 0x7f73240bf4e0 2023-05-10T01:26:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240c0bc0 con 0x7f7324154030 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.779+0000 7f73292bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73240ac320 con 0x7f7324063e20 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39496/0 (socket says 172.21.15.52:39496) 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 -- 172.21.15.52:0/2467648523 learned_addr learned my addr 172.21.15.52:0/2467648523 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f7322ffd700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324063e20 0x7f73240abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73237fe700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324154030 0x7f73240adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 -- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324063e20 msgr2=0x7f73240abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324063e20 0x7f73240abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 -- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324154030 msgr2=0x7f73240adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324154030 0x7f73240adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 -- 172.21.15.52:0/2467648523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0092a0 con 0x7f73240bf4e0 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73227fc700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f731400c4a0 tx=0x7f7314007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400ce50 con 0x7f73240bf4e0 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73140072e0 con 0x7f73240bf4e0 2023-05-10T01:26:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314007660 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7318009a20 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.780+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240c0570 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.781+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73240c2cb0 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.782+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7314010070 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.782+0000 7f730affd700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 0x7f7304061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.782+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7314079030 con 0x7f73240bf4e0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.783+0000 7f7322ffd700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 0x7f7304061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.783+0000 7f7322ffd700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 0x7f7304061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7318009fd0 tx=0x7f7318009780).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:51.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.787+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f731404a640 con 0x7f73240bf4e0 2023-05-10T01:26:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:51.974+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f732406c340 con 0x7f73240bf4e0 2023-05-10T01:26:52.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.822+0000 7f730affd700 1 -- 172.21.15.52:0/2467648523 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7f731404dc60 con 0x7f73240bf4e0 2023-05-10T01:26:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.824+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 msgr2=0x7f7304061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.824+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 0x7f7304061220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7318009fd0 tx=0x7f7318009780).stop 2023-05-10T01:26:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 msgr2=0x7f73240ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f731400c4a0 tx=0x7f7314007c30).stop 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 shutdown_connections 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f730405ed60 0x7f7304061220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324154030 0x7f73240adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7324063e20 0x7f73240abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 --2- 172.21.15.52:0/2467648523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73240bf4e0 0x7f73240ad7d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 >> 172.21.15.52:0/2467648523 conn(0x7f73240c8a90 msgr2=0x7f73240c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:52.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 shutdown_connections 2023-05-10T01:26:52.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.825+0000 7f73292bb700 1 -- 172.21.15.52:0/2467648523 wait complete. 2023-05-10T01:26:52.830 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:26:52.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:26:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.966+0000 7fe3d8512700 1 Processor -- start 2023-05-10T01:26:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.966+0000 7fe3d8512700 1 -- start start 2023-05-10T01:26:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d8512700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3d0154160 0x7fe3d00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d8512700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00c0650 con 0x7fe3d0069da0 2023-05-10T01:26:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d8512700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00bfd20 con 0x7fe3d0154540 2023-05-10T01:26:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d8512700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00c0000 con 0x7fe3d0154160 2023-05-10T01:26:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d6aaf700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe3d0069da0 0x7fe3d00c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48526/0 (socket says 172.21.15.52:48526) 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/1528696540 learned_addr learned my addr 172.21.15.52:0/1528696540 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585493736 0 0) 0x7fe3d00c0650 con 0x7fe3d0069da0 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d62ae700 1 --2- 172.21.15.52:0/1528696540 >> v2:172.21.15.172:3300/0 conn(0x7fe3d0154160 0x7fe3d00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3bc0033f0 con 0x7fe3d0069da0 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605133057 0 0) 0x7fe3bc0033f0 con 0x7fe3d0069da0 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 >> v2:172.21.15.172:3300/0 conn(0x7fe3d0154160 msgr2=0x7fe3d00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:52.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 --2- 172.21.15.52:0/1528696540 >> v2:172.21.15.172:3300/0 conn(0x7fe3d0154160 0x7fe3d00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 >> v1:172.21.15.172:6789/0 conn(0x7fe3d0154540 legacy=0x7fe3d0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00c02e0 con 0x7fe3d0069da0 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fe3c00017f0 con 0x7fe3d0069da0 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 >> v1:172.21.15.52:6789/0 conn(0x7fe3d0069da0 legacy=0x7fe3d00c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc0038e0 0x7fe3bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 0x7fe3bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3bc005050 0x7fe3bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c0000 con 0x7fe3bc004690 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc00bfe0 con 0x7fe3bc005050 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.967+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc00c1a0 con 0x7fe3bc0038e0 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 0x7fe3bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d62ae700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc0038e0 0x7fe3bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d6aaf700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3bc005050 0x7fe3bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 -- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc0038e0 msgr2=0x7fe3bc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc0038e0 0x7fe3bc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 -- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3bc005050 msgr2=0x7fe3bc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3bc005050 0x7fe3bc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 -- 172.21.15.52:0/1528696540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0033f0 con 0x7fe3bc004690 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/1528696540 reap_dead start 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d5aad700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 0x7fe3bc004b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fe3d0154920 tx=0x7fe3c4007bb0).ready entity=mon.0 client_cookie=a72bcf853dddc41c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4007020 con 0x7fe3bc004690 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c4007180 con 0x7fe3bc004690 2023-05-10T01:26:52.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.968+0000 7fe3d52ac700 1 -- 172.21.15.52:0/1528696540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4007520 con 0x7fe3bc004690 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 -- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 msgr2=0x7fe3bc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 0x7fe3bc004b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fe3d0154920 tx=0x7fe3c4007bb0).stop 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 -- 172.21.15.52:0/1528696540 shutdown_connections 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 --2- 172.21.15.52:0/1528696540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3bc004690 0x7fe3bc004b10 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 -- 172.21.15.52:0/1528696540 >> 172.21.15.52:0/1528696540 conn(0x7fe3d00cb6f0 msgr2=0x7fe3d00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 -- 172.21.15.52:0/1528696540 shutdown_connections 2023-05-10T01:26:52.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.969+0000 7fe3d8512700 1 -- 172.21.15.52:0/1528696540 wait complete. 2023-05-10T01:26:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.970+0000 7fe3d8512700 1 Processor -- start 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.970+0000 7fe3d8512700 1 -- start start 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc004690 0x7fe3d0141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3d01530d0 0x7fe3d00c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00ca810 con 0x7fe3d0153550 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c2b80 con 0x7fe3d01530d0 2023-05-10T01:26:52.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01525f0 con 0x7fe3bc004690 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39522/0 (socket says 172.21.15.52:39522) 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/2290630594 learned_addr learned my addr 172.21.15.52:0/2290630594 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d62ae700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc004690 0x7fe3d0141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d5aad700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3d01530d0 0x7fe3d00c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc004690 msgr2=0x7fe3d0141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc004690 0x7fe3d0141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3d01530d0 msgr2=0x7fe3d00c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3d01530d0 0x7fe3d00c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 -- 172.21.15.52:0/2290630594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d01528d0 con 0x7fe3d0153550 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d6aaf700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fe3d0083bd0 tx=0x7fe3c0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00079f0 con 0x7fe3d0153550 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000f840 con 0x7fe3d0153550 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0152bb0 con 0x7fe3d0153550 2023-05-10T01:26:52.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.971+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000fbc0 con 0x7fe3d0153550 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.972+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0141d00 con 0x7fe3d0153550 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.972+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0152450 con 0x7fe3d0153550 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.973+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3c001b030 con 0x7fe3d0153550 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.973+0000 7fe3ce7fc700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 0x7fe3b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.973+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fe3c0079010 con 0x7fe3d0153550 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.973+0000 7fe3d62ae700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 0x7fe3b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:52.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.974+0000 7fe3d62ae700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 0x7fe3b0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe3c8006d80 tx=0x7fe3c8009060).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:52.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:52.977+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3d0152450 con 0x7fe3d0153550 2023-05-10T01:26:53.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.214+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe3d0152450 con 0x7fe3d0153550 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.215+0000 7fe3ce7fc700 1 -- 172.21.15.52:0/2290630594 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe3d0152450 con 0x7fe3d0153550 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.218 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:26:53.219 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:26:53.219 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.219 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.219 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:26:53.220 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.221 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.222 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:26:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.224 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.227 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.228 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:26:53.229 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:26:53.230 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.231 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.232 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.233 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:26:53.234 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.235 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:26:53.236 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.237 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:26:53.238 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:26:53.240 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:53.241 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.242 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:53.243 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:26:53.243 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:26:53.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 msgr2=0x7fe3b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 0x7fe3b0061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe3c8006d80 tx=0x7fe3c8009060).stop 2023-05-10T01:26:53.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 msgr2=0x7fe3d00ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fe3d0083bd0 tx=0x7fe3c0007d90).stop 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 shutdown_connections 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fe3b005ed90 0x7fe3b0061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d0153550 0x7fe3d00ca320 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3bc004690 0x7fe3d0141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 --2- 172.21.15.52:0/2290630594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3d01530d0 0x7fe3d00c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 >> 172.21.15.52:0/2290630594 conn(0x7fe3d00cb6f0 msgr2=0x7fe3d014d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 shutdown_connections 2023-05-10T01:26:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.217+0000 7fe3d8512700 1 -- 172.21.15.52:0/2290630594 wait complete. 2023-05-10T01:26:53.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.360+0000 7f34764de700 1 Processor -- start 2023-05-10T01:26:53.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.360+0000 7f34764de700 1 -- start start 2023-05-10T01:26:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34764de700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3470154e40 0x7f34700acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34764de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3470158960 con 0x7f34700c7370 2023-05-10T01:26:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34764de700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34701552f0 con 0x7f34700ad030 2023-05-10T01:26:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34764de700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3470157d50 con 0x7f3470154e40 2023-05-10T01:26:53.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f3474cdb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3470154e40 0x7f34700acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34754dc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f34700c7370 0x7f34700c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48542/0 (socket says 172.21.15.52:48542) 2023-05-10T01:26:53.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f34754dc700 1 -- 172.21.15.52:0/3918657739 learned_addr learned my addr 172.21.15.52:0/3918657739 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:53.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f3474cdb700 1 -- 172.21.15.52:0/3918657739 >> v1:172.21.15.172:6789/0 conn(0x7f34700ad030 legacy=0x7f347014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:53.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f3474cdb700 1 -- 172.21.15.52:0/3918657739 >> v1:172.21.15.52:6789/0 conn(0x7f34700c7370 legacy=0x7f34700c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f345ffff700 1 -- 172.21.15.52:0/3918657739 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738746896 0 0) 0x7f3470158960 con 0x7f34700c7370 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f3474cdb700 1 -- 172.21.15.52:0/3918657739 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470158030 con 0x7f3470154e40 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f3474cdb700 1 --2- 172.21.15.52:0/3918657739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3470154e40 0x7f34700acb40 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f3460009760 tx=0x7f3460009060).ready entity=mon.0 client_cookie=ddbe2f69eb406695 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f345ffff700 1 -- 172.21.15.52:0/3918657739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000b520 con 0x7f3470154e40 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f345ffff700 1 -- 172.21.15.52:0/3918657739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000b680 con 0x7f3470154e40 2023-05-10T01:26:53.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.361+0000 7f345ffff700 1 -- 172.21.15.52:0/3918657739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000ba00 con 0x7f3470154e40 2023-05-10T01:26:53.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 -- 172.21.15.52:0/3918657739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3470154e40 msgr2=0x7f34700acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 --2- 172.21.15.52:0/3918657739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3470154e40 0x7f34700acb40 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f3460009760 tx=0x7f3460009060).stop 2023-05-10T01:26:53.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 -- 172.21.15.52:0/3918657739 shutdown_connections 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 --2- 172.21.15.52:0/3918657739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3470154e40 0x7f34700acb40 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 -- 172.21.15.52:0/3918657739 >> 172.21.15.52:0/3918657739 conn(0x7f3470068320 msgr2=0x7f3470068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 -- 172.21.15.52:0/3918657739 shutdown_connections 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.362+0000 7f34764de700 1 -- 172.21.15.52:0/3918657739 wait complete. 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.363+0000 7f34764de700 1 Processor -- start 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.363+0000 7f34764de700 1 -- start start 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 0x7f347014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3470154e40 0x7f34700c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347014f2d0 con 0x7f34700c7370 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700c40e0 con 0x7f34700ad030 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34764de700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34700c34d0 con 0x7f3470154e40 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39534/0 (socket says 172.21.15.52:39534) 2023-05-10T01:26:53.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 -- 172.21.15.52:0/391571015 learned_addr learned my addr 172.21.15.52:0/391571015 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34754dc700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 0x7f347014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3475cdd700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3470154e40 0x7f34700c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 -- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3470154e40 msgr2=0x7f34700c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3470154e40 0x7f34700c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 -- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 msgr2=0x7f347014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 0x7f347014ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f3474cdb700 1 -- 172.21.15.52:0/391571015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600092a0 con 0x7f34700c7370 2023-05-10T01:26:53.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.364+0000 7f34754dc700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 0x7f347014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f3474cdb700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f3460009eb0 tx=0x7f3460017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000b7f0 con 0x7f34700c7370 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000b950 con 0x7f34700c7370 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34700c37b0 con 0x7f34700c7370 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346001c630 con 0x7f34700c7370 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.365+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700c3d70 con 0x7f34700c7370 2023-05-10T01:26:53.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.366+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3470047150 con 0x7f34700c7370 2023-05-10T01:26:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.366+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f346002c070 con 0x7f34700c7370 2023-05-10T01:26:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.366+0000 7f345d7fa700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 0x7f3450061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.366+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f346007b6b0 con 0x7f34700c7370 2023-05-10T01:26:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.367+0000 7f34754dc700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 0x7f3450061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.367+0000 7f34754dc700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 0x7f3450061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f346c007fd0 tx=0x7f346c009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.370+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f346004cea0 con 0x7f34700c7370 2023-05-10T01:26:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.542+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34700ace10 con 0x7f34700c7370 2023-05-10T01:26:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.543+0000 7f345d7fa700 1 -- 172.21.15.52:0/391571015 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+14222 (secure 0 0 0) 0x7f346002a020 con 0x7f34700c7370 2023-05-10T01:26:53.550 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:53.550 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":132,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:52.816317+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:53.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 msgr2=0x7f3450061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 0x7f3450061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f346c007fd0 tx=0x7f346c009040).stop 2023-05-10T01:26:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 msgr2=0x7f34700c2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f3460009eb0 tx=0x7f3460017000).stop 2023-05-10T01:26:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 shutdown_connections 2023-05-10T01:26:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f345005ed90 0x7f3450061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3470154e40 0x7f34700c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34700ad030 0x7f347014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 --2- 172.21.15.52:0/391571015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34700c7370 0x7f34700c2bd0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 >> 172.21.15.52:0/391571015 conn(0x7f3470068320 msgr2=0x7f3470068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 shutdown_connections 2023-05-10T01:26:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.545+0000 7f34764de700 1 -- 172.21.15.52:0/391571015 wait complete. 2023-05-10T01:26:53.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:26:53.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:26:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.679+0000 7fb486727700 1 Processor -- start 2023-05-10T01:26:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.679+0000 7fb486727700 1 -- start start 2023-05-10T01:26:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb486727700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb4800aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb486727700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4800c6100 0x7fb480069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb486727700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb480154630 con 0x7fb480153a90 2023-05-10T01:26:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb486727700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800ca5f0 con 0x7fb4800c6100 2023-05-10T01:26:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb486727700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c8820 con 0x7fb4800c5d20 2023-05-10T01:26:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb484cc4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb480153a90 0x7fb480153f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48560/0 (socket says 172.21.15.52:48560) 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb484cc4700 1 -- 172.21.15.52:0/2641265926 learned_addr learned my addr 172.21.15.52:0/2641265926 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb47ffff700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb4800aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/2641265926 >> v2:172.21.15.172:3300/0 conn(0x7fb4800c6100 0x7fb480069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513959491 0 0) 0x7fb480154630 con 0x7fb480153a90 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.680+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4600033f0 con 0x7fb480153a90 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198096851 0 0) 0x7fb4600033f0 con 0x7fb480153a90 2023-05-10T01:26:53.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 msgr2=0x7fb4800aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:53.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb4800aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 >> v2:172.21.15.172:3300/0 conn(0x7fb4800c6100 msgr2=0x7fb480069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 --2- 172.21.15.52:0/2641265926 >> v2:172.21.15.172:3300/0 conn(0x7fb4800c6100 0x7fb480069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800c8b00 con 0x7fb480153a90 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fb4780017f0 con 0x7fb480153a90 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 >> v1:172.21.15.52:6789/0 conn(0x7fb480153a90 legacy=0x7fb480153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4600038e0 0x7fb460003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb460004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb460005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800ca5f0 con 0x7fb460004690 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c8820 con 0x7fb4600038e0 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46000b8e0 con 0x7fb4800c5d20 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb460004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47ffff700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4600038e0 0x7fb460003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb484cc4700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb460005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 -- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 msgr2=0x7fb460005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb460005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 -- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4600038e0 msgr2=0x7fb460003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4600038e0 0x7fb460003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 -- 172.21.15.52:0/2641265926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600033f0 con 0x7fb460004690 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb484cc4700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4800c5d20 0x7fb460005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47ffff700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4600038e0 0x7fb460003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb460004b10 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fb480066c60 tx=0x7fb470009060).ready entity=mon.0 client_cookie=af2892c7e4d986ac server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470009e90 con 0x7fb460004690 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470009430 con 0x7fb460004690 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.681+0000 7fb47effd700 1 -- 172.21.15.52:0/2641265926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000e850 con 0x7fb460004690 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 -- 172.21.15.52:0/2641265926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 msgr2=0x7fb460004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 --2- 172.21.15.52:0/2641265926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb460004b10 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fb480066c60 tx=0x7fb470009060).stop 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb484cc4700 1 -- 172.21.15.52:0/2641265926 reap_dead start 2023-05-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 -- 172.21.15.52:0/2641265926 shutdown_connections 2023-05-10T01:26:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 -- 172.21.15.52:0/2641265926 >> 172.21.15.52:0/2641265926 conn(0x7fb4800cb6f0 msgr2=0x7fb4800c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 -- 172.21.15.52:0/2641265926 shutdown_connections 2023-05-10T01:26:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.682+0000 7fb486727700 1 -- 172.21.15.52:0/2641265926 wait complete. 2023-05-10T01:26:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.683+0000 7fb486727700 1 Processor -- start 2023-05-10T01:26:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.683+0000 7fb486727700 1 -- start start 2023-05-10T01:26:53.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb480149340 0x7fb4800aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4800af090 0x7fb480157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480159a30 con 0x7fb460004690 2023-05-10T01:26:53.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c3c40 con 0x7fb4800af090 2023-05-10T01:26:53.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb486727700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800af510 con 0x7fb480149340 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39552/0 (socket says 172.21.15.52:39552) 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 -- 172.21.15.52:0/1564990598 learned_addr learned my addr 172.21.15.52:0/1564990598 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb480149340 0x7fb4800aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb484cc4700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4800af090 0x7fb480157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 -- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb480149340 msgr2=0x7fb4800aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb480149340 0x7fb4800aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 -- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4800af090 msgr2=0x7fb480157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4800af090 0x7fb480157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.684+0000 7fb47ffff700 1 -- 172.21.15.52:0/1564990598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480158180 con 0x7fb460004690 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb47ffff700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fb468011990 tx=0x7fb468008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800f6d0 con 0x7fb460004690 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800f830 con 0x7fb460004690 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480148f00 con 0x7fb460004690 2023-05-10T01:26:53.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800fbb0 con 0x7fb460004690 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.685+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800c35f0 con 0x7fb460004690 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.686+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb480066720 con 0x7fb460004690 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.686+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb468025070 con 0x7fb460004690 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.686+0000 7fb477fff700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 0x7fb464061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.686+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fb46807a080 con 0x7fb460004690 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.687+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 0x7fb464061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.687+0000 7fb47f7fe700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 0x7fb464061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb4700095a0 tx=0x7fb47001a000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:53.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.691+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb46804b870 con 0x7fb460004690 2023-05-10T01:26:53.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.866+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb48006c340 con 0x7fb460004690 2023-05-10T01:26:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.866+0000 7fb477fff700 1 -- 172.21.15.52:0/1564990598 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb46804ee90 con 0x7fb460004690 2023-05-10T01:26:53.871 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:26:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 msgr2=0x7fb464061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 0x7fb464061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb4700095a0 tx=0x7fb47001a000).stop 2023-05-10T01:26:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 msgr2=0x7fb480148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fb468011990 tx=0x7fb468008040).stop 2023-05-10T01:26:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 shutdown_connections 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb46405ed90 0x7fb464061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4800af090 0x7fb480157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb460004690 0x7fb480148a10 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 --2- 172.21.15.52:0/1564990598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb480149340 0x7fb4800aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.868+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 >> 172.21.15.52:0/1564990598 conn(0x7fb4800cb6f0 msgr2=0x7fb4800c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.869+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 shutdown_connections 2023-05-10T01:26:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.869+0000 7fb486727700 1 -- 172.21.15.52:0/1564990598 wait complete. 2023-05-10T01:26:53.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:26:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.999+0000 7ff446dc2700 1 Processor -- start 2023-05-10T01:26:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:53.999+0000 7ff446dc2700 1 -- start start 2023-05-10T01:26:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff446dc2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 0x7ff4400aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff446dc2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4400c94c0 con 0x7ff440154460 2023-05-10T01:26:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff446dc2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4400cb7d0 con 0x7ff440068150 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff446dc2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c88b0 con 0x7ff440154080 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff440154460 0x7ff4400a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48578/0 (socket says 172.21.15.52:48578) 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43ffff700 1 -- 172.21.15.52:0/3007844827 learned_addr learned my addr 172.21.15.52:0/3007844827 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff444b5e700 1 --2- 172.21.15.52:0/3007844827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 0x7ff4400aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557167114 0 0) 0x7ff4400c94c0 con 0x7ff440154460 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff42c0033f0 con 0x7ff440154460 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775491578 0 0) 0x7ff4400cb7d0 con 0x7ff440068150 2023-05-10T01:26:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.000+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4400c94c0 con 0x7ff440068150 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 770517416 0 0) 0x7ff42c0033f0 con 0x7ff440154460 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff444b5e700 1 -- 172.21.15.52:0/3007844827 >> v1:172.21.15.172:6789/0 conn(0x7ff440068150 legacy=0x7ff440068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff444b5e700 1 -- 172.21.15.52:0/3007844827 >> v1:172.21.15.52:6789/0 conn(0x7ff440154460 legacy=0x7ff4400a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff444b5e700 1 -- 172.21.15.52:0/3007844827 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400c8b90 con 0x7ff440154080 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff444b5e700 1 --2- 172.21.15.52:0/3007844827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 0x7ff4400aac90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff438009e90 tx=0x7ff438009780).ready entity=mon.2 client_cookie=31658337397dc8dd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800e070 con 0x7ff440154080 2023-05-10T01:26:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800b7a0 con 0x7ff440154080 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff43f7fe700 1 -- 172.21.15.52:0/3007844827 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434001470 con 0x7ff440154080 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff446dc2700 1 -- 172.21.15.52:0/3007844827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 msgr2=0x7ff4400aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.001+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3007844827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 0x7ff4400aac90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff438009e90 tx=0x7ff438009780).stop 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.002+0000 7ff446dc2700 1 -- 172.21.15.52:0/3007844827 shutdown_connections 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.002+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3007844827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440154080 0x7ff4400aac90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.002+0000 7ff446dc2700 1 -- 172.21.15.52:0/3007844827 >> 172.21.15.52:0/3007844827 conn(0x7ff440067910 msgr2=0x7ff4400cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.002+0000 7ff446dc2700 1 -- 172.21.15.52:0/3007844827 shutdown_connections 2023-05-10T01:26:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.002+0000 7ff446dc2700 1 -- 172.21.15.52:0/3007844827 wait complete. 2023-05-10T01:26:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.003+0000 7ff446dc2700 1 Processor -- start 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.003+0000 7ff446dc2700 1 -- start start 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.003+0000 7ff446dc2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440068150 0x7ff4401532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 0x7ff4400c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff440167e00 con 0x7ff440154080 2023-05-10T01:26:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401680e0 con 0x7ff440154460 2023-05-10T01:26:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401683c0 con 0x7ff440068150 2023-05-10T01:26:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39568/0 (socket says 172.21.15.52:39568) 2023-05-10T01:26:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 -- 172.21.15.52:0/3282028949 learned_addr learned my addr 172.21.15.52:0/3282028949 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff44535f700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 0x7ff4400c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff444b5e700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440068150 0x7ff4401532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 -- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440068150 msgr2=0x7ff4401532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440068150 0x7ff4401532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 -- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 msgr2=0x7ff4400c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 0x7ff4400c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 -- 172.21.15.52:0/3282028949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009a20 con 0x7ff440154080 2023-05-10T01:26:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff44535f700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 0x7ff4400c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43ffff700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7ff43400c790 tx=0x7ff434001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340072e0 con 0x7ff440154080 2023-05-10T01:26:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434007460 con 0x7ff440154080 2023-05-10T01:26:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340059b0 con 0x7ff440154080 2023-05-10T01:26:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4401686a0 con 0x7ff440154080 2023-05-10T01:26:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.004+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff440154d30 con 0x7ff440154080 2023-05-10T01:26:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.005+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff440066720 con 0x7ff440154080 2023-05-10T01:26:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.006+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff434010070 con 0x7ff440154080 2023-05-10T01:26:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.006+0000 7ff43cff9700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.006+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7ff434078fb0 con 0x7ff440154080 2023-05-10T01:26:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.006+0000 7ff444b5e700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.007+0000 7ff444b5e700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 0x7ff420061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff438009de0 tx=0x7ff438009780).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.010+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff43404a7a0 con 0x7ff440154080 2023-05-10T01:26:54.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.181+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff44006c340 con 0x7ff440154080 2023-05-10T01:26:54.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.181+0000 7ff43cff9700 1 -- 172.21.15.52:0/3282028949 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff434018030 con 0x7ff440154080 2023-05-10T01:26:54.184 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 msgr2=0x7ff420061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 0x7ff420061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff438009de0 tx=0x7ff438009780).stop 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 msgr2=0x7ff440154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7ff43400c790 tx=0x7ff434001980).stop 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 shutdown_connections 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff42005ed90 0x7ff420061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff440154460 0x7ff4400c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff440068150 0x7ff4401532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 --2- 172.21.15.52:0/3282028949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff440154080 0x7ff440154840 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 >> 172.21.15.52:0/3282028949 conn(0x7ff440067910 msgr2=0x7ff4400afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 shutdown_connections 2023-05-10T01:26:54.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.183+0000 7ff446dc2700 1 -- 172.21.15.52:0/3282028949 wait complete. 2023-05-10T01:26:54.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:26:54.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.311+0000 7f6d499be700 1 Processor -- start 2023-05-10T01:26:54.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.311+0000 7f6d499be700 1 -- start start 2023-05-10T01:26:54.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d499be700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 0x7f6d44069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d499be700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d440bf4e0 0x7f6d44062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d499be700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d44062950 con 0x7f6d44063710 2023-05-10T01:26:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d499be700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44154410 con 0x7f6d440bf4e0 2023-05-10T01:26:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d499be700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44069fa0 con 0x7f6d44154030 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d440bf4e0 0x7f6d44062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d437fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6d44063710 0x7f6d440bd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48594/0 (socket says 172.21.15.52:48594) 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d437fe700 1 -- 172.21.15.52:0/183645786 learned_addr learned my addr 172.21.15.52:0/183645786 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 -- 172.21.15.52:0/183645786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 msgr2=0x7f6d44069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 0x7f6d44069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d41ffb700 1 -- 172.21.15.52:0/183645786 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857115137 0 0) 0x7f6d44062950 con 0x7f6d44063710 2023-05-10T01:26:54.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 0x7f6d44069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 -- 172.21.15.52:0/183645786 >> v1:172.21.15.52:6789/0 conn(0x7f6d44063710 legacy=0x7f6d440bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 -- 172.21.15.52:0/183645786 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44062340 con 0x7f6d440bf4e0 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 0x7f6d44069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d427fc700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d440bf4e0 0x7f6d44062de0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f6d2c009e60 tx=0x7f6d2c009780).ready entity=mon.0 client_cookie=fdc71036b8daab59 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d41ffb700 1 -- 172.21.15.52:0/183645786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00e070 con 0x7f6d440bf4e0 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d41ffb700 1 -- 172.21.15.52:0/183645786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00bc30 con 0x7f6d440bf4e0 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.312+0000 7f6d41ffb700 1 -- 172.21.15.52:0/183645786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c012410 con 0x7f6d440bf4e0 2023-05-10T01:26:54.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 -- 172.21.15.52:0/183645786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d440bf4e0 msgr2=0x7f6d44062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d440bf4e0 0x7f6d44062de0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f6d2c009e60 tx=0x7f6d2c009780).stop 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 -- 172.21.15.52:0/183645786 shutdown_connections 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d44154030 0x7f6d44069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 --2- 172.21.15.52:0/183645786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d440bf4e0 0x7f6d44062de0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 -- 172.21.15.52:0/183645786 >> 172.21.15.52:0/183645786 conn(0x7f6d440c8a90 msgr2=0x7f6d440c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 -- 172.21.15.52:0/183645786 shutdown_connections 2023-05-10T01:26:54.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.313+0000 7f6d499be700 1 -- 172.21.15.52:0/183645786 wait complete. 2023-05-10T01:26:54.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.314+0000 7f6d499be700 1 Processor -- start 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.314+0000 7f6d499be700 1 -- start start 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 0x7f6d4414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 0x7f6d440c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440c4d00 con 0x7f6d44154030 2023-05-10T01:26:54.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44154970 con 0x7f6d44063710 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d499be700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4414aca0 con 0x7f6d440bf4e0 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39582/0 (socket says 172.21.15.52:39582) 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 -- 172.21.15.52:0/1073403001 learned_addr learned my addr 172.21.15.52:0/1073403001 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d427fc700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 0x7f6d440c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 0x7f6d4414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 -- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 msgr2=0x7f6d440c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 0x7f6d440c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 -- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 msgr2=0x7f6d4414a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 0x7f6d4414a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 -- 172.21.15.52:0/1073403001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c009a20 con 0x7f6d44154030 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d427fc700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 0x7f6d440c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 0x7f6d4414a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.315+0000 7f6d437fe700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f6d3400c4c0 tx=0x7f6d34007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340072e0 con 0x7f6d44154030 2023-05-10T01:26:54.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34007440 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440aa640 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340057a0 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d440aac00 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.316+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4406c340 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.318+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6d3401a060 con 0x7f6d44154030 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.318+0000 7f6d3affd700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 0x7f6d28061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.318+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f6d340795f0 con 0x7f6d44154030 2023-05-10T01:26:54.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.318+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 0x7f6d28061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.319+0000 7f6d42ffd700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 0x7f6d28061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6d3c008990 tx=0x7f6d3c008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.322+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d3404ae00 con 0x7f6d44154030 2023-05-10T01:26:54.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.496+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6d44154ab0 con 0x7f6d44154030 2023-05-10T01:26:54.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.497+0000 7f6d3affd700 1 -- 172.21.15.52:0/1073403001 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6d34018070 con 0x7f6d44154030 2023-05-10T01:26:54.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:54.500 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:26:54.500 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:54.500 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:26:54.500 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:26:54.501 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:26:54.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.498+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 msgr2=0x7f6d28061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.498+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 0x7f6d28061220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6d3c008990 tx=0x7f6d3c008040).stop 2023-05-10T01:26:54.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.498+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 msgr2=0x7f6d440c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.498+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f6d3400c4c0 tx=0x7f6d34007dd0).stop 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 shutdown_connections 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f6d2805ed60 0x7f6d28061220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d44154030 0x7f6d440c4810 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d44063710 0x7f6d4414a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 --2- 172.21.15.52:0/1073403001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d440bf4e0 0x7f6d440c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 >> 172.21.15.52:0/1073403001 conn(0x7f6d440c8a90 msgr2=0x7f6d4414c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 shutdown_connections 2023-05-10T01:26:54.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.499+0000 7f6d499be700 1 -- 172.21.15.52:0/1073403001 wait complete. 2023-05-10T01:26:54.513 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:26:54.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:26:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.632+0000 7f0220e70700 1 Processor -- start 2023-05-10T01:26:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.632+0000 7f0220e70700 1 -- start start 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f0220e70700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f021c154460 0x7f021c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f0220e70700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0c94c0 con 0x7f021c068150 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f0220e70700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0cb7d0 con 0x7f021c154080 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f0220e70700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0c88b0 con 0x7f021c154460 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f021ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f021c068150 0x7f021c0c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48608/0 (socket says 172.21.15.52:48608) 2023-05-10T01:26:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f021ad9d700 1 -- 172.21.15.52:0/2357733414 learned_addr learned my addr 172.21.15.52:0/2357733414 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.633+0000 7f0219d9b700 1 --2- 172.21.15.52:0/2357733414 >> v2:172.21.15.172:3300/0 conn(0x7f021c154460 0x7f021c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330703520 0 0) 0x7f021c0c94c0 con 0x7f021c068150 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc0033f0 con 0x7f021c068150 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192926311 0 0) 0x7f01fc0033f0 con 0x7f021c068150 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 >> v2:172.21.15.172:3300/0 conn(0x7f021c154460 msgr2=0x7f021c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 --2- 172.21.15.52:0/2357733414 >> v2:172.21.15.172:3300/0 conn(0x7f021c154460 0x7f021c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 >> v1:172.21.15.172:6789/0 conn(0x7f021c154080 legacy=0x7f021c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0c8b90 con 0x7f021c068150 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f020c0017f0 con 0x7f021c068150 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 >> v1:172.21.15.52:6789/0 conn(0x7f021c068150 legacy=0x7f021c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 0x7f01fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc004690 0x7f01fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01fc005000 0x7f01fc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c88b0 con 0x7f01fc0038e0 2023-05-10T01:26:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00bf60 con 0x7f01fc005000 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00c0f0 con 0x7f01fc004690 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 0x7f01fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021ad9d700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01fc005000 0x7f01fc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f0219d9b700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc004690 0x7f01fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 -- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc004690 msgr2=0x7f01fc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc004690 0x7f01fc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 -- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01fc005000 msgr2=0x7f01fc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01fc005000 0x7f01fc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 -- 172.21.15.52:0/2357733414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0033f0 con 0x7f01fc0038e0 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021ad9d700 1 -- 172.21.15.52:0/2357733414 reap_dead start 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.634+0000 7f021a59c700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 0x7f01fc003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0214001730 tx=0x7f0214007bb0).ready entity=mon.0 client_cookie=4cd7242f4db619a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007020 con 0x7f01fc0038e0 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214007180 con 0x7f01fc0038e0 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f021959a700 1 -- 172.21.15.52:0/2357733414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007520 con 0x7f01fc0038e0 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 -- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 msgr2=0x7f01fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 0x7f01fc003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0214001730 tx=0x7f0214007bb0).stop 2023-05-10T01:26:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 -- 172.21.15.52:0/2357733414 shutdown_connections 2023-05-10T01:26:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 --2- 172.21.15.52:0/2357733414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01fc0038e0 0x7f01fc003d00 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 -- 172.21.15.52:0/2357733414 >> 172.21.15.52:0/2357733414 conn(0x7f021c067910 msgr2=0x7f021c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 -- 172.21.15.52:0/2357733414 shutdown_connections 2023-05-10T01:26:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.635+0000 7f0220e70700 1 -- 172.21.15.52:0/2357733414 wait complete. 2023-05-10T01:26:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.636+0000 7f0220e70700 1 Processor -- start 2023-05-10T01:26:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.636+0000 7f0220e70700 1 -- start start 2023-05-10T01:26:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc0038e0 0x7f021c1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c155c90 0x7f021c0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0ae5b0 con 0x7f021c155810 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1561f0 con 0x7f021c155c90 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0220e70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1564d0 con 0x7f01fc0038e0 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39600/0 (socket says 172.21.15.52:39600) 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 -- 172.21.15.52:0/1291466246 learned_addr learned my addr 172.21.15.52:0/1291466246 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f021a59c700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc0038e0 0x7f021c1429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f021ad9d700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c155c90 0x7f021c0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 -- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc0038e0 msgr2=0x7f021c1429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc0038e0 0x7f021c1429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.637+0000 7f0219d9b700 1 -- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c155c90 msgr2=0x7f021c0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f0219d9b700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c155c90 0x7f021c0ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f0219d9b700 1 -- 172.21.15.52:0/1291466246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c1567b0 con 0x7f021c155810 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f0219d9b700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f02040116e0 tx=0x7f0204008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204015690 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02040157f0 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c156a90 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204015b70 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.638+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c142ea0 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.639+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c066720 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.639+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0204025070 con 0x7f021c155810 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.639+0000 7f02127fc700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 0x7f0200061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.640+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5533+0+0 (secure 0 0 0) 0x7f020407a080 con 0x7f021c155810 2023-05-10T01:26:54.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.640+0000 7f021a59c700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 0x7f0200061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:54.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.640+0000 7f021a59c700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 0x7f0200061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0214001010 tx=0x7f0214015000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:54.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.644+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f020404b870 con 0x7f021c155810 2023-05-10T01:26:54.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.820+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f021c0c8e70 con 0x7f021c155810 2023-05-10T01:26:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.910+0000 7f02127fc700 1 -- 172.21.15.52:0/1291466246 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 152+0+0 (secure 0 0 0) 0x7f020404ee90 con 0x7f021c155810 2023-05-10T01:26:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 msgr2=0x7f0200061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 0x7f0200061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0214001010 tx=0x7f0214015000).stop 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 msgr2=0x7f021c0adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f02040116e0 tx=0x7f0204008040).stop 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 shutdown_connections 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f020005ed90 0x7f0200061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c155c90 0x7f021c0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01fc0038e0 0x7f021c1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 --2- 172.21.15.52:0/1291466246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f021c155810 0x7f021c0adbd0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 >> 172.21.15.52:0/1291466246 conn(0x7f021c067910 msgr2=0x7f021c0a9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.913+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 shutdown_connections 2023-05-10T01:26:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:54.917+0000 7f0220e70700 1 -- 172.21.15.52:0/1291466246 wait complete. 2023-05-10T01:26:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:26:54.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:26:55.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.054+0000 7f10e57cc700 1 Processor -- start 2023-05-10T01:26:55.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.054+0000 7f10e57cc700 1 -- start start 2023-05-10T01:26:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.054+0000 7f10e57cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10e0153f80 0x7f10e00a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.054+0000 7f10e57cc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10e57cc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00c6660 con 0x7f10e00c0140 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10e57cc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e0069f50 con 0x7f10e0153f80 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10e57cc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e006a9d0 con 0x7f10e00c5cf0 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10e0153f80 0x7f10e00a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10e0153f80 0x7f10e00a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39608/0 (socket says 172.21.15.52:39608) 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 -- 172.21.15.52:0/1996625769 learned_addr learned my addr 172.21.15.52:0/1996625769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10df7fe700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 -- 172.21.15.52:0/1996625769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 msgr2=0x7f10e00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 -- 172.21.15.52:0/1996625769 >> v1:172.21.15.172:6789/0 conn(0x7f10e00c0140 legacy=0x7f10e00c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 -- 172.21.15.52:0/1996625769 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e006a130 con 0x7f10e0153f80 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10dffff700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e0153f80 0x7f10e00a9d10 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f10d0006fd0 tx=0x7f10d00090f0).ready entity=mon.0 client_cookie=31d1597f8750d3c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:55.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10deffd700 1 -- 172.21.15.52:0/1996625769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000b600 con 0x7f10e0153f80 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10deffd700 1 -- 172.21.15.52:0/1996625769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000b760 con 0x7f10e0153f80 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.055+0000 7f10deffd700 1 -- 172.21.15.52:0/1996625769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000bae0 con 0x7f10e0153f80 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 -- 172.21.15.52:0/1996625769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e0153f80 msgr2=0x7f10e00a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e0153f80 0x7f10e00a9d10 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f10d0006fd0 tx=0x7f10d00090f0).stop 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 -- 172.21.15.52:0/1996625769 shutdown_connections 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e0153f80 0x7f10e00a9d10 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 --2- 172.21.15.52:0/1996625769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 -- 172.21.15.52:0/1996625769 >> 172.21.15.52:0/1996625769 conn(0x7f10e00cb5f0 msgr2=0x7f10e00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:55.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 -- 172.21.15.52:0/1996625769 shutdown_connections 2023-05-10T01:26:55.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.056+0000 7f10e57cc700 1 -- 172.21.15.52:0/1996625769 wait complete. 2023-05-10T01:26:55.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.057+0000 7f10e57cc700 1 Processor -- start 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.057+0000 7f10e57cc700 1 -- start start 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e0153f80 0x7f10e00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00ae390 con 0x7f10e00c0140 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00c4000 con 0x7f10e0153f80 2023-05-10T01:26:55.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e57cc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e014f100 con 0x7f10e00c5cf0 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39614/0 (socket says 172.21.15.52:39614) 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 -- 172.21.15.52:0/475313344 learned_addr learned my addr 172.21.15.52:0/475313344 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10df7fe700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10e4fcb700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e0153f80 0x7f10e00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 -- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 msgr2=0x7f10e00adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 -- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e0153f80 msgr2=0x7f10e00ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e0153f80 0x7f10e00ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 -- 172.21.15.52:0/475313344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009370 con 0x7f10e00c0140 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10dffff700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f10e00668b0 tx=0x7f10d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.058+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000bea0 con 0x7f10e00c0140 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.059+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000b8d0 con 0x7f10e00c0140 2023-05-10T01:26:55.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.059+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d001b660 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.059+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e00ae0e0 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.059+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e00c39b0 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.059+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0083110 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.060+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f10d000f070 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.061+0000 7f10c7fff700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 0x7f10c0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.061+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f10d007bcc0 con 0x7f10e00c0140 2023-05-10T01:26:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.061+0000 7f10df7fe700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 0x7f10c0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:55.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.061+0000 7f10df7fe700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 0x7f10c0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f10e00afe60 tx=0x7f10d4008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:55.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.065+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10d0050d70 con 0x7f10e00c0140 2023-05-10T01:26:55.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.240+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10e0047150 con 0x7f10e00c0140 2023-05-10T01:26:55.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.915+0000 7f10c7fff700 1 -- 172.21.15.52:0/475313344 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10d0050960 con 0x7f10e00c0140 2023-05-10T01:26:55.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 msgr2=0x7f10c0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 0x7f10c0061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f10e00afe60 tx=0x7f10d4008040).stop 2023-05-10T01:26:55.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 msgr2=0x7f10e00b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:55.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f10e00668b0 tx=0x7f10d0017000).stop 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 shutdown_connections 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f10c005ed90 0x7f10c0061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e0153f80 0x7f10e00ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00c0140 0x7f10e00b07d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 --2- 172.21.15.52:0/475313344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10e00c5cf0 0x7f10e00adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.923+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 >> 172.21.15.52:0/475313344 conn(0x7f10e00cb5f0 msgr2=0x7f10e0151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:55.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.928+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 shutdown_connections 2023-05-10T01:26:55.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:55.929+0000 7f10e57cc700 1 -- 172.21.15.52:0/475313344 wait complete. 2023-05-10T01:26:55.943 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:26:55.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:26:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.077+0000 7ff174b12700 1 Processor -- start 2023-05-10T01:26:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.077+0000 7ff174b12700 1 -- start start 2023-05-10T01:26:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff174b12700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff170154110 0x7ff1701544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff174b12700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff170155570 0x7ff170068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff174b12700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1700c6310 con 0x7ff1700cb410 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff174b12700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1700c6830 con 0x7ff170154110 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff174b12700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701550e0 con 0x7ff170155570 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff170154110 0x7ff1701544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff170154110 0x7ff1701544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39622/0 (socket says 172.21.15.52:39622) 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 -- 172.21.15.52:0/244850641 learned_addr learned my addr 172.21.15.52:0/244850641 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16ed9d700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff170155570 0x7ff170068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 -- 172.21.15.52:0/244850641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff170155570 msgr2=0x7ff170068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff170155570 0x7ff170068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 -- 172.21.15.52:0/244850641 >> v1:172.21.15.172:6789/0 conn(0x7ff1700cb410 legacy=0x7ff1700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.078+0000 7ff16e59c700 1 -- 172.21.15.52:0/244850641 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700c6550 con 0x7ff170154110 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff16e59c700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170154110 0x7ff1701544f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7ff168009f70 tx=0x7ff168009840).ready entity=mon.0 client_cookie=9894b335b2b2d7aa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff16d59a700 1 -- 172.21.15.52:0/244850641 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800e070 con 0x7ff170154110 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff16d59a700 1 -- 172.21.15.52:0/244850641 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16800ba20 con 0x7ff170154110 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff16d59a700 1 -- 172.21.15.52:0/244850641 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800bda0 con 0x7ff170154110 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 -- 172.21.15.52:0/244850641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170154110 msgr2=0x7ff1701544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170154110 0x7ff1701544f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7ff168009f70 tx=0x7ff168009840).stop 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 -- 172.21.15.52:0/244850641 shutdown_connections 2023-05-10T01:26:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff170155570 0x7ff170068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 --2- 172.21.15.52:0/244850641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170154110 0x7ff1701544f0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 -- 172.21.15.52:0/244850641 >> 172.21.15.52:0/244850641 conn(0x7ff1700678d0 msgr2=0x7ff1700cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 -- 172.21.15.52:0/244850641 shutdown_connections 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.079+0000 7ff174b12700 1 -- 172.21.15.52:0/244850641 wait complete. 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.080+0000 7ff174b12700 1 Processor -- start 2023-05-10T01:26:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.080+0000 7ff174b12700 1 -- start start 2023-05-10T01:26:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1700cb410 0x7ff1701496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff170154110 0x7ff1700c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170149bb0 con 0x7ff170155570 2023-05-10T01:26:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170164950 con 0x7ff170154110 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff174b12700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff170164c30 con 0x7ff1700cb410 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff16ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff16ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39632/0 (socket says 172.21.15.52:39632) 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff16ed9d700 1 -- 172.21.15.52:0/1416472107 learned_addr learned my addr 172.21.15.52:0/1416472107 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff16e59c700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1700cb410 0x7ff1701496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.081+0000 7ff16dd9b700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff170154110 0x7ff1700c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 -- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1700cb410 msgr2=0x7ff1701496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1700cb410 0x7ff1701496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 -- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff170154110 msgr2=0x7ff1700c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff170154110 0x7ff1700c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 -- 172.21.15.52:0/1416472107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168009ae0 con 0x7ff170155570 2023-05-10T01:26:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff16ed9d700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7ff16000e6c0 tx=0x7ff160009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160012600 con 0x7ff170155570 2023-05-10T01:26:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160012760 con 0x7ff170155570 2023-05-10T01:26:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff170164f10 con 0x7ff170155570 2023-05-10T01:26:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160012ae0 con 0x7ff170155570 2023-05-10T01:26:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.082+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1701654d0 con 0x7ff170155570 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.083+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff170066720 con 0x7ff170155570 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.083+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff160022070 con 0x7ff170155570 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.084+0000 7ff1667fc700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 0x7ff154061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.084+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6285+0+0 (secure 0 0 0) 0x7ff160079d50 con 0x7ff170155570 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.084+0000 7ff16e59c700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 0x7ff154061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.084+0000 7ff16e59c700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 0x7ff154061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff16800c010 tx=0x7ff170155220).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.088+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff16004b250 con 0x7ff170155570 2023-05-10T01:26:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.306+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff17006c340 con 0x7ff170155570 2023-05-10T01:26:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.313+0000 7ff1667fc700 1 -- 172.21.15.52:0/1416472107 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v58) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff160016020 con 0x7ff170155570 2023-05-10T01:26:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.322+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 msgr2=0x7ff154061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.322+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 0x7ff154061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff16800c010 tx=0x7ff170155220).stop 2023-05-10T01:26:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.322+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 msgr2=0x7ff1700c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.322+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7ff16000e6c0 tx=0x7ff160009060).stop 2023-05-10T01:26:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 shutdown_connections 2023-05-10T01:26:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff15405ed90 0x7ff154061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff170155570 0x7ff1700c7650 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1700cb410 0x7ff1701496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 --2- 172.21.15.52:0/1416472107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff170154110 0x7ff1700c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 >> 172.21.15.52:0/1416472107 conn(0x7ff1700678d0 msgr2=0x7ff1700a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.324+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 shutdown_connections 2023-05-10T01:26:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.330+0000 7ff174b12700 1 -- 172.21.15.52:0/1416472107 wait complete. 2023-05-10T01:26:56.338 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 17 and data pool 18 2023-05-10T01:26:56.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:56.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.466+0000 7f55c04ae700 1 Processor -- start 2023-05-10T01:26:56.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.466+0000 7f55c04ae700 1 -- start start 2023-05-10T01:26:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55c04ae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55c04ae700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 0x7f55b80696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55c04ae700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80653e0 con 0x7f55b81510b0 2023-05-10T01:26:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55c04ae700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80bda40 con 0x7f55b80bd4d0 2023-05-10T01:26:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55c04ae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80bdd20 con 0x7f55b8150cd0 2023-05-10T01:26:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55bea4b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 0x7f55b80696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55be24a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55bda49700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f55b81510b0 0x7f55b8155380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:51206/0 (socket says 172.21.15.52:51206) 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55bda49700 1 -- 172.21.15.52:0/860212771 learned_addr learned my addr 172.21.15.52:0/860212771 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55be24a700 1 -- 172.21.15.52:0/860212771 >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 msgr2=0x7f55b80696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55be24a700 1 --2- 172.21.15.52:0/860212771 >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 0x7f55b80696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55be24a700 1 -- 172.21.15.52:0/860212771 >> v1:172.21.15.172:6789/0 conn(0x7f55b81510b0 legacy=0x7f55b8155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55bd248700 1 -- 172.21.15.52:0/860212771 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843714351 0 0) 0x7f55b80653e0 con 0x7f55b81510b0 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55be24a700 1 -- 172.21.15.52:0/860212771 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80be000 con 0x7f55b8150cd0 2023-05-10T01:26:56.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.467+0000 7f55bea4b700 1 --2- 172.21.15.52:0/860212771 >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 0x7f55b80696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55be24a700 1 --2- 172.21.15.52:0/860212771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8064ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f55b0009e60 tx=0x7f55b0009780).ready entity=mon.2 client_cookie=c7aa6402e871cf2a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55bd248700 1 -- 172.21.15.52:0/860212771 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000e070 con 0x7f55b8150cd0 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55bd248700 1 -- 172.21.15.52:0/860212771 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b000bb60 con 0x7f55b8150cd0 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55bd248700 1 -- 172.21.15.52:0/860212771 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0012410 con 0x7f55b8150cd0 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 -- 172.21.15.52:0/860212771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 msgr2=0x7f55b8064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 --2- 172.21.15.52:0/860212771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8064ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f55b0009e60 tx=0x7f55b0009780).stop 2023-05-10T01:26:56.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 -- 172.21.15.52:0/860212771 shutdown_connections 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 --2- 172.21.15.52:0/860212771 >> v2:172.21.15.172:3300/0 conn(0x7f55b80bd4d0 0x7f55b80696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 --2- 172.21.15.52:0/860212771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8064ef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 -- 172.21.15.52:0/860212771 >> 172.21.15.52:0/860212771 conn(0x7f55b8063620 msgr2=0x7f55b80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 -- 172.21.15.52:0/860212771 shutdown_connections 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.468+0000 7f55c04ae700 1 -- 172.21.15.52:0/860212771 wait complete. 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.469+0000 7f55c04ae700 1 Processor -- start 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 -- start start 2023-05-10T01:26:56.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55b80bd4d0 0x7f55b81674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b814f990 con 0x7f55b81510b0 2023-05-10T01:26:56.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8151f50 con 0x7f55b80bd4d0 2023-05-10T01:26:56.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55c04ae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8165410 con 0x7f55b8150cd0 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55bea4b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55bea4b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39662/0 (socket says 172.21.15.52:39662) 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.470+0000 7f55bea4b700 1 -- 172.21.15.52:0/3170816924 learned_addr learned my addr 172.21.15.52:0/3170816924 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55be24a700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55b80bd4d0 0x7f55b81674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bda49700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 -- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 msgr2=0x7f55b8164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 -- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55b80bd4d0 msgr2=0x7f55b81674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55b80bd4d0 0x7f55b81674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 -- 172.21.15.52:0/3170816924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40092a0 con 0x7f55b81510b0 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55bea4b700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f55b400e980 tx=0x7f55b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b4012600 con 0x7f55b81510b0 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b4012760 con 0x7f55b81510b0 2023-05-10T01:26:56.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b0009a20 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b4012b00 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.471+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b8151900 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.472+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b806c340 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.472+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f55b4022070 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.473+0000 7f55a67fc700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 0x7f5598061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.473+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f55b4079ff0 con 0x7f55b81510b0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.473+0000 7f55be24a700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 0x7f5598061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.473+0000 7f55be24a700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 0x7f5598061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f55b0009fd0 tx=0x7f55b0009780).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.477+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55b404b480 con 0x7f55b81510b0 2023-05-10T01:26:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.651+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b80c82f0 con 0x7f55b81510b0 2023-05-10T01:26:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.652+0000 7f55a67fc700 1 -- 172.21.15.52:0/3170816924 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+17455 (secure 0 0 0) 0x7f55b4016070 con 0x7f55b81510b0 2023-05-10T01:26:56.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:56.655 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:56.306892+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 msgr2=0x7f5598061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 0x7f5598061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f55b0009fd0 tx=0x7f55b0009780).stop 2023-05-10T01:26:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 msgr2=0x7f55b81656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f55b400e980 tx=0x7f55b4009060).stop 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 shutdown_connections 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f559805ed90 0x7f5598061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55b81510b0 0x7f55b81656b0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55b80bd4d0 0x7f55b81674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 --2- 172.21.15.52:0/3170816924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55b8150cd0 0x7f55b8164f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 >> 172.21.15.52:0/3170816924 conn(0x7f55b8063620 msgr2=0x7f55b80c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.653+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 shutdown_connections 2023-05-10T01:26:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.654+0000 7f55c04ae700 1 -- 172.21.15.52:0/3170816924 wait complete. 2023-05-10T01:26:56.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.782+0000 7ff07d32f700 1 Processor -- start 2023-05-10T01:26:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.782+0000 7ff07d32f700 1 -- start start 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff07d32f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0780a75a0 0x7ff07815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff07d32f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0780c7fc0 con 0x7ff078065aa0 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff07d32f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff078065f30 con 0x7ff078151b40 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff07d32f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780c7690 con 0x7ff0780a75a0 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0767fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff078065aa0 0x7ff078159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48684/0 (socket says 172.21.15.52:48684) 2023-05-10T01:26:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0767fc700 1 -- 172.21.15.52:0/2255625963 learned_addr learned my addr 172.21.15.52:0/2255625963 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0777fe700 1 --2- 172.21.15.52:0/2255625963 >> v2:172.21.15.52:3300/0 conn(0x7ff0780a75a0 0x7ff07815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff075ffb700 1 -- 172.21.15.52:0/2255625963 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677119106 0 0) 0x7ff0780c7fc0 con 0x7ff078065aa0 2023-05-10T01:26:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff075ffb700 1 -- 172.21.15.52:0/2255625963 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0580033f0 con 0x7ff078065aa0 2023-05-10T01:26:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0777fe700 1 -- 172.21.15.52:0/2255625963 >> v1:172.21.15.172:6789/0 conn(0x7ff078151b40 legacy=0x7ff0780a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0777fe700 1 -- 172.21.15.52:0/2255625963 >> v1:172.21.15.52:6789/0 conn(0x7ff078065aa0 legacy=0x7ff078159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0777fe700 1 -- 172.21.15.52:0/2255625963 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780c7970 con 0x7ff0780a75a0 2023-05-10T01:26:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.783+0000 7ff0777fe700 1 --2- 172.21.15.52:0/2255625963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0780a75a0 0x7ff07815ce50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7ff068009e60 tx=0x7ff068009780).ready entity=mon.0 client_cookie=4f95da52300a69ef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff075ffb700 1 -- 172.21.15.52:0/2255625963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800e070 con 0x7ff0780a75a0 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff075ffb700 1 -- 172.21.15.52:0/2255625963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800bb20 con 0x7ff0780a75a0 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff075ffb700 1 -- 172.21.15.52:0/2255625963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800bea0 con 0x7ff0780a75a0 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 -- 172.21.15.52:0/2255625963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0780a75a0 msgr2=0x7ff07815ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2255625963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0780a75a0 0x7ff07815ce50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7ff068009e60 tx=0x7ff068009780).stop 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 -- 172.21.15.52:0/2255625963 shutdown_connections 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2255625963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0780a75a0 0x7ff07815ce50 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 -- 172.21.15.52:0/2255625963 >> 172.21.15.52:0/2255625963 conn(0x7ff0780689d0 msgr2=0x7ff0780695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 -- 172.21.15.52:0/2255625963 shutdown_connections 2023-05-10T01:26:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.784+0000 7ff07d32f700 1 -- 172.21.15.52:0/2255625963 wait complete. 2023-05-10T01:26:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.785+0000 7ff07d32f700 1 Processor -- start 2023-05-10T01:26:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.785+0000 7ff07d32f700 1 -- start start 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 0x7ff0780c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff07814a350 0x7ff0780628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078167fa0 con 0x7ff078151b40 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07814e510 con 0x7ff0780a75a0 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff07d32f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff078167a70 con 0x7ff07814a350 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39672/0 (socket says 172.21.15.52:39672) 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 -- 172.21.15.52:0/2078858394 learned_addr learned my addr 172.21.15.52:0/2078858394 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 -- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff07814a350 msgr2=0x7ff0780628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff07814a350 0x7ff0780628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff0767fc700 1 -- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 msgr2=0x7ff0780c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.786+0000 7ff076ffd700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 0x7ff0780c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff0767fc700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 0x7ff0780c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff0767fc700 1 -- 172.21.15.52:0/2078858394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009a20 con 0x7ff078151b40 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff076ffd700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 0x7ff0780c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff0767fc700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7ff06000c4f0 tx=0x7ff060007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600072e0 con 0x7ff078151b40 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060007440 con 0x7ff078151b40 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600057a0 con 0x7ff078151b40 2023-05-10T01:26:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780c23c0 con 0x7ff078151b40 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.787+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07814df50 con 0x7ff078151b40 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.788+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff078047150 con 0x7ff078151b40 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.788+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff060010070 con 0x7ff078151b40 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.789+0000 7ff06effd700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 0x7ff05c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.789+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff0600793e0 con 0x7ff078151b40 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.789+0000 7ff076ffd700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 0x7ff05c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.789+0000 7ff076ffd700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 0x7ff05c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff07000a820 tx=0x7ff070008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.793+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff06004a760 con 0x7ff078151b40 2023-05-10T01:26:56.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.966+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0780631c0 con 0x7ff078151b40 2023-05-10T01:26:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.967+0000 7ff06effd700 1 -- 172.21.15.52:0/2078858394 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+17455 (secure 0 0 0) 0x7ff060007d90 con 0x7ff078151b40 2023-05-10T01:26:56.970 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:56.306892+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:26:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.968+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 msgr2=0x7ff05c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.968+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 0x7ff05c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff07000a820 tx=0x7ff070008040).stop 2023-05-10T01:26:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.968+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 msgr2=0x7ff07813f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.968+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7ff06000c4f0 tx=0x7ff060007c50).stop 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 shutdown_connections 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7ff05c05ed90 0x7ff05c061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff07814a350 0x7ff0780628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0780a75a0 0x7ff0780c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 --2- 172.21.15.52:0/2078858394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff078151b40 0x7ff07813f260 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 >> 172.21.15.52:0/2078858394 conn(0x7ff0780689d0 msgr2=0x7ff078067590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 shutdown_connections 2023-05-10T01:26:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:56.969+0000 7ff07d32f700 1 -- 172.21.15.52:0/2078858394 wait complete. 2023-05-10T01:26:56.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:26:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 Processor -- start 2023-05-10T01:26:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 -- start start 2023-05-10T01:26:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89400aa200 0x7f89400c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8940153a90 0x7f8940153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400c8820 con 0x7f89400c5d20 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400ca5f0 con 0x7f8940153a90 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.102+0000 7f8945f7c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400c8b00 con 0x7f89400aa200 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8940153a90 0x7f8940153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89400c5d20 0x7f8940069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48696/0 (socket says 172.21.15.52:48696) 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893f7fe700 1 -- 172.21.15.52:0/2650395969 learned_addr learned my addr 172.21.15.52:0/2650395969 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 -- 172.21.15.52:0/2650395969 >> v2:172.21.15.172:3300/0 conn(0x7f89400aa200 msgr2=0x7f89400c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 --2- 172.21.15.52:0/2650395969 >> v2:172.21.15.172:3300/0 conn(0x7f89400aa200 0x7f89400c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 -- 172.21.15.52:0/2650395969 >> v1:172.21.15.52:6789/0 conn(0x7f89400c5d20 legacy=0x7f8940069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893e7fc700 1 -- 172.21.15.52:0/2650395969 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840260092 0 0) 0x7f89400c8820 con 0x7f89400c5d20 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 -- 172.21.15.52:0/2650395969 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400c8de0 con 0x7f8940153a90 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893ffff700 1 --2- 172.21.15.52:0/2650395969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8940153a90 0x7f8940153ee0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f89400aa6b0 tx=0x7f8938009780).ready entity=mon.0 client_cookie=631478941da044a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893e7fc700 1 -- 172.21.15.52:0/2650395969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800e070 con 0x7f8940153a90 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893e7fc700 1 -- 172.21.15.52:0/2650395969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800bc30 con 0x7f8940153a90 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.103+0000 7f893e7fc700 1 -- 172.21.15.52:0/2650395969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938012410 con 0x7f8940153a90 2023-05-10T01:26:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 -- 172.21.15.52:0/2650395969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8940153a90 msgr2=0x7f8940153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 --2- 172.21.15.52:0/2650395969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8940153a90 0x7f8940153ee0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f89400aa6b0 tx=0x7f8938009780).stop 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 -- 172.21.15.52:0/2650395969 shutdown_connections 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 --2- 172.21.15.52:0/2650395969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8940153a90 0x7f8940153ee0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 --2- 172.21.15.52:0/2650395969 >> v2:172.21.15.172:3300/0 conn(0x7f89400aa200 0x7f89400c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 -- 172.21.15.52:0/2650395969 >> 172.21.15.52:0/2650395969 conn(0x7f89400cb6f0 msgr2=0x7f89400c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 -- 172.21.15.52:0/2650395969 shutdown_connections 2023-05-10T01:26:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.104+0000 7f8945f7c700 1 -- 172.21.15.52:0/2650395969 wait complete. 2023-05-10T01:26:57.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.105+0000 7f8945f7c700 1 Processor -- start 2023-05-10T01:26:57.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.105+0000 7f8945f7c700 1 -- start start 2023-05-10T01:26:57.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89400c5d20 0x7f89400c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940153a90 0x7f89400aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400c3740 con 0x7f89400aa200 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400c26a0 con 0x7f8940153a90 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f8945f7c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400c2980 con 0x7f89400c5d20 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39684/0 (socket says 172.21.15.52:39684) 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 -- 172.21.15.52:0/1790671369 learned_addr learned my addr 172.21.15.52:0/1790671369 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893ffff700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940153a90 0x7f89400aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:57.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893effd700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89400c5d20 0x7f89400c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 -- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89400c5d20 msgr2=0x7f89400c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89400c5d20 0x7f89400c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 -- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940153a90 msgr2=0x7f89400aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940153a90 0x7f89400aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 -- 172.21.15.52:0/1790671369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009a20 con 0x7f89400aa200 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f893f7fe700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f893000c4e0 tx=0x7f8930007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:57.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000ce90 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.106+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89300072e0 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.107+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89400c2c60 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.107+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930007660 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.107+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89400c3220 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.107+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8940066720 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.108+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8930010070 con 0x7f89400aa200 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.108+0000 7f89277fe700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 0x7f8920061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.108+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f8930079200 con 0x7f89400aa200 2023-05-10T01:26:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.108+0000 7f893effd700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 0x7f8920061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.109+0000 7f893effd700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 0x7f8920061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f89400c4580 tx=0x7f8934009060).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.112+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f893004a690 con 0x7f89400aa200 2023-05-10T01:26:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:57.329+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f89400c90c0 con 0x7f89400aa200 2023-05-10T01:26:57.557 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:26:57.554+0000 7ffa0e027700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:26:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.316+0000 7f89277fe700 1 -- 172.21.15.52:0/1790671369 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f893004dcb0 con 0x7f89400aa200 2023-05-10T01:26:58.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 msgr2=0x7f8920061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 0x7f8920061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f89400c4580 tx=0x7f8934009060).stop 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 msgr2=0x7f894014d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f893000c4e0 tx=0x7f8930007c70).stop 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 shutdown_connections 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f892005ed90 0x7f8920061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940153a90 0x7f89400aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89400aa200 0x7f894014d2b0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 --2- 172.21.15.52:0/1790671369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89400c5d20 0x7f89400c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 >> 172.21.15.52:0/1790671369 conn(0x7f89400cb6f0 msgr2=0x7f89400acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:58.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 shutdown_connections 2023-05-10T01:26:58.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.319+0000 7f8945f7c700 1 -- 172.21.15.52:0/1790671369 wait complete. 2023-05-10T01:26:58.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:26:58.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.460+0000 7f6805ee6700 1 Processor -- start 2023-05-10T01:26:58.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.460+0000 7f6805ee6700 1 -- start start 2023-05-10T01:26:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6805ee6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6800153f80 0x7f68000a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6805ee6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f68000c5cf0 0x7f68000c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6805ee6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000c6690 con 0x7f68000c0140 2023-05-10T01:26:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6805ee6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6800069f50 con 0x7f6800153f80 2023-05-10T01:26:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6805ee6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680006a9d0 con 0x7f68000c5cf0 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6800153f80 0x7f68000a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6800153f80 0x7f68000a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39692/0 (socket says 172.21.15.52:39692) 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 -- 172.21.15.52:0/3289313844 learned_addr learned my addr 172.21.15.52:0/3289313844 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f67fffff700 1 --2- 172.21.15.52:0/3289313844 >> v2:172.21.15.172:3300/0 conn(0x7f68000c5cf0 0x7f68000c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 -- 172.21.15.52:0/3289313844 >> v2:172.21.15.172:3300/0 conn(0x7f68000c5cf0 msgr2=0x7f68000c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 --2- 172.21.15.52:0/3289313844 >> v2:172.21.15.172:3300/0 conn(0x7f68000c5cf0 0x7f68000c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 -- 172.21.15.52:0/3289313844 >> v1:172.21.15.172:6789/0 conn(0x7f68000c0140 legacy=0x7f68000c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 -- 172.21.15.52:0/3289313844 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680006a130 con 0x7f6800153f80 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f6804ee4700 1 --2- 172.21.15.52:0/3289313844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800153f80 0x7f68000a9d10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f68000c8230 tx=0x7f67f40090f0).ready entity=mon.0 client_cookie=e780e5a9e0cc627 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f67ff7fe700 1 -- 172.21.15.52:0/3289313844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400b5a0 con 0x7f6800153f80 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f67ff7fe700 1 -- 172.21.15.52:0/3289313844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f400b700 con 0x7f6800153f80 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.461+0000 7f67ff7fe700 1 -- 172.21.15.52:0/3289313844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400ba80 con 0x7f6800153f80 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 -- 172.21.15.52:0/3289313844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800153f80 msgr2=0x7f68000a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 --2- 172.21.15.52:0/3289313844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800153f80 0x7f68000a9d10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f68000c8230 tx=0x7f67f40090f0).stop 2023-05-10T01:26:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 -- 172.21.15.52:0/3289313844 shutdown_connections 2023-05-10T01:26:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 --2- 172.21.15.52:0/3289313844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800153f80 0x7f68000a9d10 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 --2- 172.21.15.52:0/3289313844 >> v2:172.21.15.172:3300/0 conn(0x7f68000c5cf0 0x7f68000c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 -- 172.21.15.52:0/3289313844 >> 172.21.15.52:0/3289313844 conn(0x7f68000cb5f0 msgr2=0x7f68000c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 -- 172.21.15.52:0/3289313844 shutdown_connections 2023-05-10T01:26:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.462+0000 7f6805ee6700 1 -- 172.21.15.52:0/3289313844 wait complete. 2023-05-10T01:26:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.463+0000 7f6805ee6700 1 Processor -- start 2023-05-10T01:26:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.463+0000 7f6805ee6700 1 -- start start 2023-05-10T01:26:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68000c0140 0x7f68000ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6800153f80 0x7f680014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c2790 con 0x7f68000c5cf0 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c1bc0 con 0x7f68000c0140 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6805ee6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c1e60 con 0x7f6800153f80 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39698/0 (socket says 172.21.15.52:39698) 2023-05-10T01:26:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 -- 172.21.15.52:0/2974249001 learned_addr learned my addr 172.21.15.52:0/2974249001 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f6804ee4700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68000c0140 0x7f68000ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f68056e5700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6800153f80 0x7f680014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 -- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6800153f80 msgr2=0x7f680014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6800153f80 0x7f680014d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 -- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68000c0140 msgr2=0x7f68000ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68000c0140 0x7f68000ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.464+0000 7f67fffff700 1 -- 172.21.15.52:0/2974249001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009370 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f67fffff700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f67ec00d890 tx=0x7f67ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec011590 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0116f0 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68000c2140 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec011a70 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.465+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68000aeee0 con 0x7f68000c5cf0 2023-05-10T01:26:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.466+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6800083110 con 0x7f68000c5cf0 2023-05-10T01:26:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.466+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f67ec01c460 con 0x7f68000c5cf0 2023-05-10T01:26:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.466+0000 7f67fcff9700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 0x7f67e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.467+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f67ec079b50 con 0x7f68000c5cf0 2023-05-10T01:26:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.467+0000 7f6804ee4700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 0x7f67e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.467+0000 7f6804ee4700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 0x7f67e8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f67f4009130 tx=0x7f67f4015000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:58.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.471+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f67ec04af80 con 0x7f68000c5cf0 2023-05-10T01:26:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:58.694+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6800047150 con 0x7f68000c5cf0 2023-05-10T01:26:59.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:26:59.243 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:26:59.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.320+0000 7f67fcff9700 1 -- 172.21.15.52:0/2974249001 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67ec04e5a0 con 0x7f68000c5cf0 2023-05-10T01:26:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 msgr2=0x7f67e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 0x7f67e8061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f67f4009130 tx=0x7f67f4015000).stop 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 msgr2=0x7f680014b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f67ec00d890 tx=0x7f67ec008040).stop 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 shutdown_connections 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f67e805ed90 0x7f67e8061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6800153f80 0x7f680014d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68000c0140 0x7f68000ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 --2- 172.21.15.52:0/2974249001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000c5cf0 0x7f680014b830 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.322+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 >> 172.21.15.52:0/2974249001 conn(0x7f68000cb5f0 msgr2=0x7f6800153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.323+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 shutdown_connections 2023-05-10T01:26:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.323+0000 7f6805ee6700 1 -- 172.21.15.52:0/2974249001 wait complete. 2023-05-10T01:26:59.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:26:59.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 Processor -- start 2023-05-10T01:26:59.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 -- start start 2023-05-10T01:26:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda14068a00 0x7fda14068de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda140a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda140bd230 con 0x7fda14157ed0 2023-05-10T01:26:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140bc350 con 0x7fda14068a00 2023-05-10T01:26:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.495+0000 7fda19cda700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140bc620 con 0x7fda140a4870 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda14068a00 0x7fda14068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda12ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fda14157ed0 0x7fda140bbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48720/0 (socket says 172.21.15.52:48720) 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda12ffd700 1 -- 172.21.15.52:0/4137883936 learned_addr learned my addr 172.21.15.52:0/4137883936 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda13fff700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda140a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 -- 172.21.15.52:0/4137883936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 msgr2=0x7fda140a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda140a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 -- 172.21.15.52:0/4137883936 >> v1:172.21.15.52:6789/0 conn(0x7fda14157ed0 legacy=0x7fda140bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 -- 172.21.15.52:0/4137883936 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140bc900 con 0x7fda14068a00 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda127fc700 1 -- 172.21.15.52:0/4137883936 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960668396 0 0) 0x7fda140bd230 con 0x7fda14157ed0 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda137fe700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda14068de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fda04009760 tx=0x7fda04009060).ready entity=mon.0 client_cookie=c2b25dde8d9b5604 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda127fc700 1 -- 172.21.15.52:0/4137883936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400b580 con 0x7fda14068a00 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda127fc700 1 -- 172.21.15.52:0/4137883936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b6e0 con 0x7fda14068a00 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.496+0000 7fda127fc700 1 -- 172.21.15.52:0/4137883936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400ba60 con 0x7fda14068a00 2023-05-10T01:26:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 -- 172.21.15.52:0/4137883936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 msgr2=0x7fda14068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda14068de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fda04009760 tx=0x7fda04009060).stop 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 -- 172.21.15.52:0/4137883936 shutdown_connections 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda140a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 --2- 172.21.15.52:0/4137883936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda14068de0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 -- 172.21.15.52:0/4137883936 >> 172.21.15.52:0/4137883936 conn(0x7fda140c6ce0 msgr2=0x7fda140c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 -- 172.21.15.52:0/4137883936 shutdown_connections 2023-05-10T01:26:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.497+0000 7fda19cda700 1 -- 172.21.15.52:0/4137883936 wait complete. 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.498+0000 7fda19cda700 1 Processor -- start 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.498+0000 7fda19cda700 1 -- start start 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda1413ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 0x7fda140c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1413bf30 con 0x7fda14068a00 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140acb70 con 0x7fda14157ed0 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda14153920 con 0x7fda140a4870 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39712/0 (socket says 172.21.15.52:39712) 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 -- 172.21.15.52:0/2260817811 learned_addr learned my addr 172.21.15.52:0/2260817811 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda13fff700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 0x7fda140c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda12ffd700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda1413ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 -- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 msgr2=0x7fda1413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda1413ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 -- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 msgr2=0x7fda140c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 0x7fda140c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 -- 172.21.15.52:0/2260817811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040092a0 con 0x7fda14068a00 2023-05-10T01:26:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda12ffd700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda1413ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda13fff700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 0x7fda140c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda137fe700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fda04009eb0 tx=0x7fda04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400b850 con 0x7fda14068a00 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b9b0 con 0x7fda14068a00 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda14153c00 con 0x7fda14068a00 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.499+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0401b690 con 0x7fda14068a00 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.500+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda140ac800 con 0x7fda14068a00 2023-05-10T01:26:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.500+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda14153780 con 0x7fda14068a00 2023-05-10T01:26:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.501+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda0400f070 con 0x7fda14068a00 2023-05-10T01:26:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.501+0000 7fd9fb7fe700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 0x7fd9f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.501+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fda0407b370 con 0x7fda14068a00 2023-05-10T01:26:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.502+0000 7fda12ffd700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 0x7fd9f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.502+0000 7fda12ffd700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 0x7fd9f4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fda08007fd0 tx=0x7fda08009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.505+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda14153780 con 0x7fda14068a00 2023-05-10T01:26:59.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.721+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda14153780 con 0x7fda14068a00 2023-05-10T01:26:59.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.722+0000 7fd9fb7fe700 1 -- 172.21.15.52:0/2260817811 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fda14153780 con 0x7fda14068a00 2023-05-10T01:26:59.725 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:26:59.725 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:26:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 msgr2=0x7fd9f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 0x7fd9f4061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fda08007fd0 tx=0x7fda08009040).stop 2023-05-10T01:26:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 msgr2=0x7fda140a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fda04009eb0 tx=0x7fda04017000).stop 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 shutdown_connections 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd9f405ed90 0x7fd9f4061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14157ed0 0x7fda140c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda14068a00 0x7fda140a9c90 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 --2- 172.21.15.52:0/2260817811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda140a4870 0x7fda1413ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 >> 172.21.15.52:0/2260817811 conn(0x7fda140c6ce0 msgr2=0x7fda141582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.723+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 shutdown_connections 2023-05-10T01:26:59.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.724+0000 7fda19cda700 1 -- 172.21.15.52:0/2260817811 wait complete. 2023-05-10T01:26:59.728 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:26:59.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:26:59.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.852+0000 7f34af59e700 1 Processor -- start 2023-05-10T01:26:59.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.852+0000 7f34af59e700 1 -- start start 2023-05-10T01:26:59.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34af59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f34b0154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34af59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f34b00c7750 0x7f34b00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34af59e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b0158960 con 0x7f34b00ad030 2023-05-10T01:26:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34af59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b0155330 con 0x7f34b00c7750 2023-05-10T01:26:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34af59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0157d50 con 0x7f34b00c7370 2023-05-10T01:26:59.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34aed9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f34b00ad030 0x7f34b014dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48738/0 (socket says 172.21.15.52:48738) 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34aed9d700 1 -- 172.21.15.52:0/3768247895 learned_addr learned my addr 172.21.15.52:0/3768247895 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34add9b700 1 --2- 172.21.15.52:0/3768247895 >> v2:172.21.15.172:3300/0 conn(0x7f34b00c7750 0x7f34b00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34ae59c700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f34b0154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574496352 0 0) 0x7f34b0158960 con 0x7f34b00ad030 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34900033f0 con 0x7f34b00ad030 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.853+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868069345 0 0) 0x7f34900033f0 con 0x7f34b00ad030 2023-05-10T01:26:59.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 msgr2=0x7f34b0154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f34b0154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 >> v2:172.21.15.172:3300/0 conn(0x7f34b00c7750 msgr2=0x7f34b00acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 --2- 172.21.15.52:0/3768247895 >> v2:172.21.15.172:3300/0 conn(0x7f34b00c7750 0x7f34b00acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0158030 con 0x7f34b00ad030 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f34a0001470 con 0x7f34b00ad030 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34add9b700 1 --2- 172.21.15.52:0/3768247895 >> v2:172.21.15.172:3300/0 conn(0x7f34b00c7750 0x7f34b00acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 >> v1:172.21.15.52:6789/0 conn(0x7f34b00ad030 legacy=0x7f34b014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34900038e0 0x7f3490003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3490004690 0x7f3490004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f3490005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0155330 con 0x7f34900038e0 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0157d50 con 0x7f3490004690 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349000b8e0 con 0x7f34b00c7370 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34900038e0 0x7f3490003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34add9b700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3490004690 0x7f3490004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34aed9d700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f3490005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 -- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 msgr2=0x7f3490005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00c7370 0x7f3490005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 -- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3490004690 msgr2=0x7f3490004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:26:59.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3490004690 0x7f3490004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 -- 172.21.15.52:0/3768247895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900033f0 con 0x7f34900038e0 2023-05-10T01:26:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34add9b700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3490004690 0x7f3490004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:26:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ae59c700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34900038e0 0x7f3490003d00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f34a800e210 tx=0x7f34a800b040).ready entity=mon.0 client_cookie=932fc227fc2afa15 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8009ac0 con 0x7f34900038e0 2023-05-10T01:26:59.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800f040 con 0x7f34900038e0 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.854+0000 7f34ad59a700 1 -- 172.21.15.52:0/3768247895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800ecd0 con 0x7f34900038e0 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 -- 172.21.15.52:0/3768247895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34900038e0 msgr2=0x7f3490003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 --2- 172.21.15.52:0/3768247895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34900038e0 0x7f3490003d00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f34a800e210 tx=0x7f34a800b040).stop 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34aed9d700 1 -- 172.21.15.52:0/3768247895 reap_dead start 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 -- 172.21.15.52:0/3768247895 shutdown_connections 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 -- 172.21.15.52:0/3768247895 >> 172.21.15.52:0/3768247895 conn(0x7f34b0068320 msgr2=0x7f34b0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:26:59.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 -- 172.21.15.52:0/3768247895 shutdown_connections 2023-05-10T01:26:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.855+0000 7f34af59e700 1 -- 172.21.15.52:0/3768247895 wait complete. 2023-05-10T01:26:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.856+0000 7f34af59e700 1 Processor -- start 2023-05-10T01:26:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.856+0000 7f34af59e700 1 -- start start 2023-05-10T01:26:59.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34900038e0 0x7f34b00c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00ca920 0x7f34b00cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00b0a00 con 0x7f34b00af880 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0142e50 con 0x7f34900038e0 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34af59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00c4040 con 0x7f34b00ca920 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39734/0 (socket says 172.21.15.52:39734) 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 -- 172.21.15.52:0/1026821256 learned_addr learned my addr 172.21.15.52:0/1026821256 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34ae59c700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34900038e0 0x7f34b00c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34aed9d700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00ca920 0x7f34b00cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 -- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00ca920 msgr2=0x7f34b00cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00ca920 0x7f34b00cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 -- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34900038e0 msgr2=0x7f34b00c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34900038e0 0x7f34b00c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 -- 172.21.15.52:0/1026821256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00cb270 con 0x7f34b00af880 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.857+0000 7f34add9b700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f3498011990 tx=0x7f3498008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.858+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498015690 con 0x7f34b00af880 2023-05-10T01:26:59.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.858+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34980157f0 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.858+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00afd80 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.858+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498015b70 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.858+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00b0340 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.859+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b00b0b40 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.859+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3498025070 con 0x7f34b00af880 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.859+0000 7f34a67fc700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 0x7f3494061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:26:59.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.859+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f349807a370 con 0x7f34b00af880 2023-05-10T01:26:59.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.860+0000 7f34ae59c700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 0x7f3494061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:26:59.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.860+0000 7f34ae59c700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 0x7f3494061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f34a800afd0 tx=0x7f34a801a000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:26:59.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:26:59.863+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f34b00b0b40 con 0x7f34b00af880 2023-05-10T01:27:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.037+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34b00b0b40 con 0x7f34b00af880 2023-05-10T01:27:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.038+0000 7f34a67fc700 1 -- 172.21.15.52:0/1026821256 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+17442 (secure 0 0 0) 0x7f34b00b0b40 con 0x7f34b00af880 2023-05-10T01:27:00.041 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:00.041 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":136,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:26:57.308948+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 msgr2=0x7f3494061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 0x7f3494061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f34a800afd0 tx=0x7f34a801a000).stop 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 msgr2=0x7f34b00ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f3498011990 tx=0x7f3498008040).stop 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 shutdown_connections 2023-05-10T01:27:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f349405ed90 0x7f3494061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34b00ca920 0x7f34b00cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34900038e0 0x7f34b00c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 --2- 172.21.15.52:0/1026821256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34b00af880 0x7f34b00ae4b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 >> 172.21.15.52:0/1026821256 conn(0x7f34b0068320 msgr2=0x7f34b01517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 shutdown_connections 2023-05-10T01:27:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.040+0000 7f34af59e700 1 -- 172.21.15.52:0/1026821256 wait complete. 2023-05-10T01:27:00.055 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:27:00.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:27:00.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 Processor -- start 2023-05-10T01:27:00.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 -- start start 2023-05-10T01:27:00.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78c80c7370 0x7f78c8154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c8158960 con 0x7f78c80ad250 2023-05-10T01:27:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80ad6b0 con 0x7f78c80c7750 2023-05-10T01:27:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.171+0000 7f78cd106700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8155330 con 0x7f78c80c7370 2023-05-10T01:27:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78c80c7370 0x7f78c8154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78cc905700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f78c80ad250 0x7f78c814dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48758/0 (socket says 172.21.15.52:48758) 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78cc905700 1 -- 172.21.15.52:0/377585080 learned_addr learned my addr 172.21.15.52:0/377585080 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c7fff700 1 -- 172.21.15.52:0/377585080 >> v1:172.21.15.172:6789/0 conn(0x7f78c80c7750 legacy=0x7f78c80acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c7fff700 1 -- 172.21.15.52:0/377585080 >> v1:172.21.15.52:6789/0 conn(0x7f78c80ad250 legacy=0x7f78c814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c77fe700 1 -- 172.21.15.52:0/377585080 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977071214 0 0) 0x7f78c8158960 con 0x7f78c80ad250 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c7fff700 1 -- 172.21.15.52:0/377585080 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8157d50 con 0x7f78c80c7370 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c7fff700 1 --2- 172.21.15.52:0/377585080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7370 0x7f78c8154e40 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f78b8009760 tx=0x7f78b8009060).ready entity=mon.0 client_cookie=e50a31ceec730fe9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c77fe700 1 -- 172.21.15.52:0/377585080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800b520 con 0x7f78c80c7370 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c77fe700 1 -- 172.21.15.52:0/377585080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800b680 con 0x7f78c80c7370 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.172+0000 7f78c77fe700 1 -- 172.21.15.52:0/377585080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800ba00 con 0x7f78c80c7370 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 -- 172.21.15.52:0/377585080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7370 msgr2=0x7f78c8154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 --2- 172.21.15.52:0/377585080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7370 0x7f78c8154e40 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f78b8009760 tx=0x7f78b8009060).stop 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 -- 172.21.15.52:0/377585080 shutdown_connections 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 --2- 172.21.15.52:0/377585080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7370 0x7f78c8154e40 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 -- 172.21.15.52:0/377585080 >> 172.21.15.52:0/377585080 conn(0x7f78c8068320 msgr2=0x7f78c8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 -- 172.21.15.52:0/377585080 shutdown_connections 2023-05-10T01:27:00.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.173+0000 7f78cd106700 1 -- 172.21.15.52:0/377585080 wait complete. 2023-05-10T01:27:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.174+0000 7f78cd106700 1 Processor -- start 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.174+0000 7f78cd106700 1 -- start start 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78c80ad250 0x7f78c813d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78c80c7370 0x7f78c8167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c81686d0 con 0x7f78c80c7750 2023-05-10T01:27:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80ca6b0 con 0x7f78c80c7370 2023-05-10T01:27:00.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c81658f0 con 0x7f78c80ad250 2023-05-10T01:27:00.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39748/0 (socket says 172.21.15.52:39748) 2023-05-10T01:27:00.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 -- 172.21.15.52:0/443601862 learned_addr learned my addr 172.21.15.52:0/443601862 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:00.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78c7fff700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78c80ad250 0x7f78c813d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78bffff700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78c80c7370 0x7f78c8167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 -- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78c80ad250 msgr2=0x7f78c813d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78c80ad250 0x7f78c813d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 -- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78c80c7370 msgr2=0x7f78c8167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78c80c7370 0x7f78c8167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 -- 172.21.15.52:0/443601862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80092a0 con 0x7f78c80c7750 2023-05-10T01:27:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cc905700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f78c000c7e0 tx=0x7f78c0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0005d30 con 0x7f78c80c7750 2023-05-10T01:27:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0005e90 con 0x7f78c80c7750 2023-05-10T01:27:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c8165bd0 con 0x7f78c80c7750 2023-05-10T01:27:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0007320 con 0x7f78c80c7750 2023-05-10T01:27:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.175+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c8166190 con 0x7f78c80c7750 2023-05-10T01:27:00.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.176+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c8166380 con 0x7f78c80c7750 2023-05-10T01:27:00.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.177+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78c0010030 con 0x7f78c80c7750 2023-05-10T01:27:00.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.177+0000 7f78c4ff9700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 0x7f78ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.177+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f78c0079b90 con 0x7f78c80c7750 2023-05-10T01:27:00.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.177+0000 7f78c7fff700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 0x7f78ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.178+0000 7f78c7fff700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 0x7f78ac061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f78b800b2e0 tx=0x7f78b8017000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.181+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78c004b020 con 0x7f78c80c7750 2023-05-10T01:27:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.351+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78c8158030 con 0x7f78ac05ed90 2023-05-10T01:27:00.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.362+0000 7f78c4ff9700 1 -- 172.21.15.52:0/443601862 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352980 (secure 0 0 0) 0x7f78c8158030 con 0x7f78ac05ed90 2023-05-10T01:27:00.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:00.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 msgr2=0x7f78ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 0x7f78ac061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f78b800b2e0 tx=0x7f78b8017000).stop 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 msgr2=0x7f78c81681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f78c000c7e0 tx=0x7f78c0007f90).stop 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 shutdown_connections 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f78ac05ed90 0x7f78ac061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78c80c7750 0x7f78c81681e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78c80ad250 0x7f78c813d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 --2- 172.21.15.52:0/443601862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78c80c7370 0x7f78c8167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 >> 172.21.15.52:0/443601862 conn(0x7f78c8068320 msgr2=0x7f78c8153840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 shutdown_connections 2023-05-10T01:27:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.365+0000 7f78cd106700 1 -- 172.21.15.52:0/443601862 wait complete. 2023-05-10T01:27:00.373 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:27:00.379 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:26:58.592572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":167600,"kb_used_data":12848,"kb_used_omap":0,"kb_used_meta":154688,"kb_avail":754807120,"statfs":{"total":773094113280,"available":772922490880,"internally_reserved":0,"allocated":13156352,"data_stored":6686828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":158400512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.199281"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915541+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911698+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919833+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917887+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913242+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912009+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914955+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.918649+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915155+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916594+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912230+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917525+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916632+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916929+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911208+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916127+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913057+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917655+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919457+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913561+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913940+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914842+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911662+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915732+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912526+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915487+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911495+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915110+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913496+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914332+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917101+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911227+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916961+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911220+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919033+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912354+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913041+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914714+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914432+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915758+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911214+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913154+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917385+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916781+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915035+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916431+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915203+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917377+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914709+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917157+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916633+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917114+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911669+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911796+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916723+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916554+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916444+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919790+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:52.919790+0000","last_peered":"2023-05-10T01:26:52.919790+0000","last_clean":"2023-05-10T01:26:52.919790+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:52.919790+0000","last_undegraded":"2023-05-10T01:26:52.919790+0000","last_fullsized":"2023-05-10T01:26:52.919790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915568+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920186+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:52.920186+0000","last_peered":"2023-05-10T01:26:52.920186+0000","last_clean":"2023-05-10T01:26:52.920186+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:52.920186+0000","last_undegraded":"2023-05-10T01:26:52.920186+0000","last_fullsized":"2023-05-10T01:26:52.920186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914323+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919529+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:52.919529+0000","last_peered":"2023-05-10T01:26:52.919529+0000","last_clean":"2023-05-10T01:26:52.919529+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:52.919529+0000","last_undegraded":"2023-05-10T01:26:52.919529+0000","last_fullsized":"2023-05-10T01:26:52.919529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914199+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920135+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:52.920135+0000","last_peered":"2023-05-10T01:26:52.920135+0000","last_clean":"2023-05-10T01:26:52.920135+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:52.920135+0000","last_undegraded":"2023-05-10T01:26:52.920135+0000","last_fullsized":"2023-05-10T01:26:52.920135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920481+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:52.920481+0000","last_peered":"2023-05-10T01:26:52.920481+0000","last_clean":"2023-05-10T01:26:52.920481+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:52.920481+0000","last_undegraded":"2023-05-10T01:26:52.920481+0000","last_fullsized":"2023-05-10T01:26:52.920481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914222+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920493+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:52.920493+0000","last_peered":"2023-05-10T01:26:52.920493+0000","last_clean":"2023-05-10T01:26:52.920493+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:52.920493+0000","last_undegraded":"2023-05-10T01:26:52.920493+0000","last_fullsized":"2023-05-10T01:26:52.920493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914437+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920522+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:52.920522+0000","last_peered":"2023-05-10T01:26:52.920522+0000","last_clean":"2023-05-10T01:26:52.920522+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:52.920522+0000","last_undegraded":"2023-05-10T01:26:52.920522+0000","last_fullsized":"2023-05-10T01:26:52.920522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914386+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919778+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:52.919778+0000","last_peered":"2023-05-10T01:26:52.919778+0000","last_clean":"2023-05-10T01:26:52.919778+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:52.919778+0000","last_undegraded":"2023-05-10T01:26:52.919778+0000","last_fullsized":"2023-05-10T01:26:52.919778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914746+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920310+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:52.920310+0000","last_peered":"2023-05-10T01:26:52.920310+0000","last_clean":"2023-05-10T01:26:52.920310+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:52.920310+0000","last_undegraded":"2023-05-10T01:26:52.920310+0000","last_fullsized":"2023-05-10T01:26:52.920310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18760,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353080,"statfs":{"total":96636764160,"available":96617553920,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18324,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353516,"statfs":{"total":96636764160,"available":96618000384,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22420,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349420,"statfs":{"total":96636764160,"available":96613806080,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.378}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18004,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94353836,"statfs":{"total":96636764160,"available":96618328064,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23444,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":21824,"kb_avail":94348396,"statfs":{"total":96636764160,"available":96612757504,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22347776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26312,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":94345528,"statfs":{"total":96636764160,"available":96609820672,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":1.742,"15min":1.742},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":1.76,"15min":1.76},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.379,"15min":0.39400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":1.893,"15min":1.893},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.441},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":1.772,"15min":1.772},"last":0.34200000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":1.921,"15min":1.921},"last":0.443},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58199999999999996,"5min":1.8,"15min":1.8},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83199999999999996,"5min":1.837,"15min":1.837},"last":0.65900000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81799999999999995,"5min":1.671,"15min":1.671},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.865,"15min":1.865},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18632,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353208,"statfs":{"total":96636764160,"available":96617684992,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21704,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":20096,"kb_avail":94350136,"statfs":{"total":96636764160,"available":96614539264,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20578304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.438},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.621}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:27:00.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:27:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.534+0000 7fd4c1faf700 1 Processor -- start 2023-05-10T01:27:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.534+0000 7fd4c1faf700 1 -- start start 2023-05-10T01:27:00.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c1faf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4bc154e40 0x7fd4bc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c1faf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc158960 con 0x7fd4bc0c7370 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c1faf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc1552f0 con 0x7fd4bc0ad030 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c1faf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc157d50 con 0x7fd4bc154e40 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c0fad700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd4bc0c7370 0x7fd4bc0c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48768/0 (socket says 172.21.15.52:48768) 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4c0fad700 1 -- 172.21.15.52:0/1952507930 learned_addr learned my addr 172.21.15.52:0/1952507930 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586634944 0 0) 0x7fd4bc158960 con 0x7fd4bc0c7370 2023-05-10T01:27:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/1952507930 >> v2:172.21.15.172:3300/0 conn(0x7fd4bc154e40 0x7fd4bc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd49c0033f0 con 0x7fd4bc0c7370 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 185486005 0 0) 0x7fd49c0033f0 con 0x7fd4bc0c7370 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 >> v2:172.21.15.172:3300/0 conn(0x7fd4bc154e40 msgr2=0x7fd4bc0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 --2- 172.21.15.52:0/1952507930 >> v2:172.21.15.172:3300/0 conn(0x7fd4bc154e40 0x7fd4bc0acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 >> v1:172.21.15.172:6789/0 conn(0x7fd4bc0ad030 legacy=0x7fd4bc14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc158030 con 0x7fd4bc0c7370 2023-05-10T01:27:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.535+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd4b4001470 con 0x7fd4bc0c7370 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 >> v1:172.21.15.52:6789/0 conn(0x7fd4bc0c7370 legacy=0x7fd4bc0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c0038e0 0x7fd49c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd49c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c005000 0x7fd49c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc157d50 con 0x7fd49c004690 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c00beb0 con 0x7fd49c0038e0 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c00c070 con 0x7fd49c005000 2023-05-10T01:27:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd49c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4c0fad700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c0038e0 0x7fd49c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4c17ae700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c005000 0x7fd49c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 -- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c005000 msgr2=0x7fd49c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c005000 0x7fd49c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 -- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c0038e0 msgr2=0x7fd49c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c0038e0 0x7fd49c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 -- 172.21.15.52:0/1952507930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0033f0 con 0x7fd49c004690 2023-05-10T01:27:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4c17ae700 1 -- 172.21.15.52:0/1952507930 reap_dead start 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd49c004b10 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fd4ac00e210 tx=0x7fd4ac00b040).ready entity=mon.0 client_cookie=baf7214601793d34 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac009ac0 con 0x7fd49c004690 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f040 con 0x7fd49c004690 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.536+0000 7fd4bb7fe700 1 -- 172.21.15.52:0/1952507930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00ecd0 con 0x7fd49c004690 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 -- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 msgr2=0x7fd49c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd49c004b10 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fd4ac00e210 tx=0x7fd4ac00b040).stop 2023-05-10T01:27:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 -- 172.21.15.52:0/1952507930 shutdown_connections 2023-05-10T01:27:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/1952507930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd49c004b10 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 -- 172.21.15.52:0/1952507930 >> 172.21.15.52:0/1952507930 conn(0x7fd4bc068320 msgr2=0x7fd4bc068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 -- 172.21.15.52:0/1952507930 shutdown_connections 2023-05-10T01:27:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.537+0000 7fd4c1faf700 1 -- 172.21.15.52:0/1952507930 wait complete. 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.538+0000 7fd4c1faf700 1 Processor -- start 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.538+0000 7fd4c1faf700 1 -- start start 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4bc0c2920 0x7fd4bc14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 0x7fd4bc0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c9ba0 con 0x7fd49c004690 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c2da0 con 0x7fd4bc0c2920 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c8f90 con 0x7fd4bc14f1b0 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39764/0 (socket says 172.21.15.52:39764) 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 -- 172.21.15.52:0/3762701838 learned_addr learned my addr 172.21.15.52:0/3762701838 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4bc0c2920 0x7fd4bc14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c17ae700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 0x7fd4bc0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 -- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 msgr2=0x7fd4bc0ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 0x7fd4bc0ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 -- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4bc0c2920 msgr2=0x7fd4bc14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4bc0c2920 0x7fd4bc14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 -- 172.21.15.52:0/3762701838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0c9270 con 0x7fd49c004690 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c17ae700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 0x7fd4bc0ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c0fad700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fd4b40049e0 tx=0x7fd4b4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400f660 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400f7c0 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400fb40 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.539+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc0c9550 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.540+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0ca520 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.541+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc0c99f0 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.541+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd4b401c360 con 0x7fd49c004690 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.541+0000 7fd4b8ff9700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 0x7fd4a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.541+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fd4b4079330 con 0x7fd49c004690 2023-05-10T01:27:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.542+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 0x7fd4a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.542+0000 7fd4bbfff700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 0x7fd4a0061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd4ac00afd0 tx=0x7fd4ac01a000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.545+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4b40498f0 con 0x7fd49c004690 2023-05-10T01:27:00.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.715+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4bc0c9ce0 con 0x7fd4a005ed60 2023-05-10T01:27:00.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.725+0000 7fd4b8ff9700 1 -- 172.21.15.52:0/3762701838 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352980 (secure 0 0 0) 0x7fd4ac00e9f0 con 0x7fd4a005ed60 2023-05-10T01:27:00.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 msgr2=0x7fd4a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 0x7fd4a0061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd4ac00afd0 tx=0x7fd4ac01a000).stop 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 msgr2=0x7fd4bc0c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fd4b40049e0 tx=0x7fd4b4001e50).stop 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 shutdown_connections 2023-05-10T01:27:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fd4a005ed60 0x7fd4a0061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4bc14f1b0 0x7fd4bc0ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c004690 0x7fd4bc0c88d0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 --2- 172.21.15.52:0/3762701838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4bc0c2920 0x7fd4bc14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 >> 172.21.15.52:0/3762701838 conn(0x7fd4bc068320 msgr2=0x7fd4bc068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 shutdown_connections 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.728+0000 7fd4c1faf700 1 -- 172.21.15.52:0/3762701838 wait complete. 2023-05-10T01:27:00.734 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:27:00.743 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:27:00.593052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":167600,"kb_used_data":12848,"kb_used_omap":0,"kb_used_meta":154688,"kb_avail":754807120,"statfs":{"total":773094113280,"available":772922490880,"internally_reserved":0,"allocated":13156352,"data_stored":6686828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":158400512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.199281"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915541+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911698+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919833+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917887+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913242+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912009+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914955+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.918649+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915155+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916594+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912230+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917525+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916632+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916929+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911208+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916127+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913057+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917655+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919457+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913561+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913940+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914842+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911662+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915732+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912526+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915487+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911495+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915110+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913496+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914332+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917101+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911227+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916961+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911220+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919033+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912354+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913041+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914714+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914432+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915758+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911214+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913154+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917385+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916781+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915035+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916431+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915203+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917377+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914709+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917157+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916633+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917114+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911669+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911796+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916723+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916554+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916444+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919790+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:52.919790+0000","last_peered":"2023-05-10T01:26:52.919790+0000","last_clean":"2023-05-10T01:26:52.919790+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:52.919790+0000","last_undegraded":"2023-05-10T01:26:52.919790+0000","last_fullsized":"2023-05-10T01:26:52.919790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915568+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920186+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:52.920186+0000","last_peered":"2023-05-10T01:26:52.920186+0000","last_clean":"2023-05-10T01:26:52.920186+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:52.920186+0000","last_undegraded":"2023-05-10T01:26:52.920186+0000","last_fullsized":"2023-05-10T01:26:52.920186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914323+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919529+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:52.919529+0000","last_peered":"2023-05-10T01:26:52.919529+0000","last_clean":"2023-05-10T01:26:52.919529+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:52.919529+0000","last_undegraded":"2023-05-10T01:26:52.919529+0000","last_fullsized":"2023-05-10T01:26:52.919529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914199+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920135+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:52.920135+0000","last_peered":"2023-05-10T01:26:52.920135+0000","last_clean":"2023-05-10T01:26:52.920135+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:52.920135+0000","last_undegraded":"2023-05-10T01:26:52.920135+0000","last_fullsized":"2023-05-10T01:26:52.920135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920481+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:52.920481+0000","last_peered":"2023-05-10T01:26:52.920481+0000","last_clean":"2023-05-10T01:26:52.920481+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:52.920481+0000","last_undegraded":"2023-05-10T01:26:52.920481+0000","last_fullsized":"2023-05-10T01:26:52.920481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914222+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920493+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:52.920493+0000","last_peered":"2023-05-10T01:26:52.920493+0000","last_clean":"2023-05-10T01:26:52.920493+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:52.920493+0000","last_undegraded":"2023-05-10T01:26:52.920493+0000","last_fullsized":"2023-05-10T01:26:52.920493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914437+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920522+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:52.920522+0000","last_peered":"2023-05-10T01:26:52.920522+0000","last_clean":"2023-05-10T01:26:52.920522+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:52.920522+0000","last_undegraded":"2023-05-10T01:26:52.920522+0000","last_fullsized":"2023-05-10T01:26:52.920522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914386+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919778+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:52.919778+0000","last_peered":"2023-05-10T01:26:52.919778+0000","last_clean":"2023-05-10T01:26:52.919778+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:52.919778+0000","last_undegraded":"2023-05-10T01:26:52.919778+0000","last_fullsized":"2023-05-10T01:26:52.919778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914746+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920310+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:52.920310+0000","last_peered":"2023-05-10T01:26:52.920310+0000","last_clean":"2023-05-10T01:26:52.920310+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:52.920310+0000","last_undegraded":"2023-05-10T01:26:52.920310+0000","last_fullsized":"2023-05-10T01:26:52.920310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18760,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353080,"statfs":{"total":96636764160,"available":96617553920,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18324,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353516,"statfs":{"total":96636764160,"available":96618000384,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22420,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349420,"statfs":{"total":96636764160,"available":96613806080,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.378}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18004,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94353836,"statfs":{"total":96636764160,"available":96618328064,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23444,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":21824,"kb_avail":94348396,"statfs":{"total":96636764160,"available":96612757504,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22347776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26312,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":94345528,"statfs":{"total":96636764160,"available":96609820672,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":1.742,"15min":1.742},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":1.76,"15min":1.76},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.379,"15min":0.39400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":1.893,"15min":1.893},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.441},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":1.772,"15min":1.772},"last":0.34200000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":1.921,"15min":1.921},"last":0.443},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58199999999999996,"5min":1.8,"15min":1.8},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83199999999999996,"5min":1.837,"15min":1.837},"last":0.65900000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81799999999999995,"5min":1.671,"15min":1.671},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.865,"15min":1.865},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18632,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353208,"statfs":{"total":96636764160,"available":96617684992,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21704,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":20096,"kb_avail":94350136,"statfs":{"total":96636764160,"available":96614539264,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20578304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.438},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.621}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:27:00.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:27:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.897+0000 7f23ea8c0700 1 Processor -- start 2023-05-10T01:27:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.897+0000 7f23ea8c0700 1 -- start start 2023-05-10T01:27:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.898+0000 7f23ea8c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 0x7f23e4156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.898+0000 7f23ea8c0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 0x7f23e4065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.898+0000 7f23ea8c0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e40bbb40 con 0x7f23e40660b0 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.898+0000 7f23ea8c0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e40c2940 con 0x7f23e4152160 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.898+0000 7f23ea8c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40c2c20 con 0x7f23e4151d80 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 0x7f23e4156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e37fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 0x7f23e4065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e8e5d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f23e40660b0 0x7f23e4155ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:51330/0 (socket says 172.21.15.52:51330) 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e8e5d700 1 -- 172.21.15.52:0/3645496966 learned_addr learned my addr 172.21.15.52:0/3645496966 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e2ffd700 1 -- 172.21.15.52:0/3645496966 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410241399 0 0) 0x7f23e40bbb40 con 0x7f23e40660b0 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e2ffd700 1 -- 172.21.15.52:0/3645496966 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d00033f0 con 0x7f23e40660b0 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 -- 172.21.15.52:0/3645496966 >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 msgr2=0x7f23e4065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 --2- 172.21.15.52:0/3645496966 >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 0x7f23e4065bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 -- 172.21.15.52:0/3645496966 >> v1:172.21.15.172:6789/0 conn(0x7f23e40660b0 legacy=0x7f23e4155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 -- 172.21.15.52:0/3645496966 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40c2f00 con 0x7f23e4151d80 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e37fe700 1 --2- 172.21.15.52:0/3645496966 >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 0x7f23e4065bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:27:00.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e3fff700 1 --2- 172.21.15.52:0/3645496966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 0x7f23e4156690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f23d4009760 tx=0x7f23d4009060).ready entity=mon.2 client_cookie=915ac8cef902597a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e2ffd700 1 -- 172.21.15.52:0/3645496966 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400d4a0 con 0x7f23e4151d80 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e2ffd700 1 -- 172.21.15.52:0/3645496966 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400d600 con 0x7f23e4151d80 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.899+0000 7f23e2ffd700 1 -- 172.21.15.52:0/3645496966 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400d980 con 0x7f23e4151d80 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 -- 172.21.15.52:0/3645496966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 msgr2=0x7f23e4156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/3645496966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 0x7f23e4156690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f23d4009760 tx=0x7f23d4009060).stop 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 -- 172.21.15.52:0/3645496966 shutdown_connections 2023-05-10T01:27:00.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/3645496966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e4151d80 0x7f23e4156690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/3645496966 >> v2:172.21.15.172:3300/0 conn(0x7f23e4152160 0x7f23e4065bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 -- 172.21.15.52:0/3645496966 >> 172.21.15.52:0/3645496966 conn(0x7f23e40c7340 msgr2=0x7f23e40c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:00.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 -- 172.21.15.52:0/3645496966 shutdown_connections 2023-05-10T01:27:00.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.900+0000 7f23ea8c0700 1 -- 172.21.15.52:0/3645496966 wait complete. 2023-05-10T01:27:00.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.901+0000 7f23ea8c0700 1 Processor -- start 2023-05-10T01:27:00.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.901+0000 7f23ea8c0700 1 -- start start 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23e4152160 0x7f23e40beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4152ab0 con 0x7f23e4151d80 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41541e0 con 0x7f23e4152160 2023-05-10T01:27:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23ea8c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4152cc0 con 0x7f23e40660b0 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:59414/0 (socket says 172.21.15.52:59414) 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e3fff700 1 -- 172.21.15.52:0/2671013425 learned_addr learned my addr 172.21.15.52:0/2671013425 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39780/0 (socket says 172.21.15.52:39780) 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e8e5d700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23e4152160 0x7f23e40beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 -- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 msgr2=0x7f23e40a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 -- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23e4152160 msgr2=0x7f23e40beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23e4152160 0x7f23e40beaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e37fe700 1 -- 172.21.15.52:0/2671013425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80092a0 con 0x7f23e4151d80 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.902+0000 7f23e3fff700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:27:00.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23e37fe700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f23e40a5e40 tx=0x7f23d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8009580 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8012600 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d40092a0 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80129a0 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.903+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e4153280 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.904+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e41535c0 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.904+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f23d8022070 con 0x7f23e4151d80 2023-05-10T01:27:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.904+0000 7f23cbfff700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 0x7f23c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.905+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f23d8079e70 con 0x7f23e4151d80 2023-05-10T01:27:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.905+0000 7f23e3fff700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 0x7f23c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.905+0000 7f23e3fff700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 0x7f23c4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f23d400d260 tx=0x7f23d4016000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:00.909+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23d804b1f0 con 0x7f23e4151d80 2023-05-10T01:27:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.080+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23e40bb7d0 con 0x7f23c405ed90 2023-05-10T01:27:01.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.090+0000 7f23cbfff700 1 -- 172.21.15.52:0/2671013425 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352980 (secure 0 0 0) 0x7f23e40bb7d0 con 0x7f23c405ed90 2023-05-10T01:27:01.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 msgr2=0x7f23c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 0x7f23c4061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f23d400d260 tx=0x7f23d4016000).stop 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 msgr2=0x7f23e41525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f23e40a5e40 tx=0x7f23d8009060).stop 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 shutdown_connections 2023-05-10T01:27:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f23c405ed90 0x7f23c4061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23e4152160 0x7f23e40beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23e40660b0 0x7f23e40a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 --2- 172.21.15.52:0/2671013425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4151d80 0x7f23e41525c0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.093+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 >> 172.21.15.52:0/2671013425 conn(0x7f23e40c7340 msgr2=0x7f23e40c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.094+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 shutdown_connections 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.094+0000 7f23ea8c0700 1 -- 172.21.15.52:0/2671013425 wait complete. 2023-05-10T01:27:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:27:01.108 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:27:00.593052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":167600,"kb_used_data":12848,"kb_used_omap":0,"kb_used_meta":154688,"kb_avail":754807120,"statfs":{"total":773094113280,"available":772922490880,"internally_reserved":0,"allocated":13156352,"data_stored":6686828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":158400512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.199281"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915541+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911698+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919833+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917887+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913242+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912009+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914955+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.918649+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915155+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916594+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912230+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917525+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916632+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916929+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911208+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916127+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913057+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917655+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919457+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913561+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913940+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914842+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911662+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915732+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912526+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915487+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911495+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915110+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913496+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914332+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917101+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911227+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916961+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911220+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919033+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912354+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913041+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914714+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914432+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915758+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911214+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913154+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917385+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916781+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915035+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916431+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915203+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917377+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914709+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917157+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916633+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917114+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911669+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911796+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916723+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916554+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916444+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919790+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:52.919790+0000","last_peered":"2023-05-10T01:26:52.919790+0000","last_clean":"2023-05-10T01:26:52.919790+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:52.919790+0000","last_undegraded":"2023-05-10T01:26:52.919790+0000","last_fullsized":"2023-05-10T01:26:52.919790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915568+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920186+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:52.920186+0000","last_peered":"2023-05-10T01:26:52.920186+0000","last_clean":"2023-05-10T01:26:52.920186+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:52.920186+0000","last_undegraded":"2023-05-10T01:26:52.920186+0000","last_fullsized":"2023-05-10T01:26:52.920186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914323+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919529+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:52.919529+0000","last_peered":"2023-05-10T01:26:52.919529+0000","last_clean":"2023-05-10T01:26:52.919529+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:52.919529+0000","last_undegraded":"2023-05-10T01:26:52.919529+0000","last_fullsized":"2023-05-10T01:26:52.919529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914199+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920135+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:52.920135+0000","last_peered":"2023-05-10T01:26:52.920135+0000","last_clean":"2023-05-10T01:26:52.920135+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:52.920135+0000","last_undegraded":"2023-05-10T01:26:52.920135+0000","last_fullsized":"2023-05-10T01:26:52.920135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920481+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:52.920481+0000","last_peered":"2023-05-10T01:26:52.920481+0000","last_clean":"2023-05-10T01:26:52.920481+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:52.920481+0000","last_undegraded":"2023-05-10T01:26:52.920481+0000","last_fullsized":"2023-05-10T01:26:52.920481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914222+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920493+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:52.920493+0000","last_peered":"2023-05-10T01:26:52.920493+0000","last_clean":"2023-05-10T01:26:52.920493+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:52.920493+0000","last_undegraded":"2023-05-10T01:26:52.920493+0000","last_fullsized":"2023-05-10T01:26:52.920493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914437+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920522+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:52.920522+0000","last_peered":"2023-05-10T01:26:52.920522+0000","last_clean":"2023-05-10T01:26:52.920522+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:52.920522+0000","last_undegraded":"2023-05-10T01:26:52.920522+0000","last_fullsized":"2023-05-10T01:26:52.920522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914386+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919778+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:52.919778+0000","last_peered":"2023-05-10T01:26:52.919778+0000","last_clean":"2023-05-10T01:26:52.919778+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:52.919778+0000","last_undegraded":"2023-05-10T01:26:52.919778+0000","last_fullsized":"2023-05-10T01:26:52.919778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914746+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920310+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:52.920310+0000","last_peered":"2023-05-10T01:26:52.920310+0000","last_clean":"2023-05-10T01:26:52.920310+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:52.920310+0000","last_undegraded":"2023-05-10T01:26:52.920310+0000","last_fullsized":"2023-05-10T01:26:52.920310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18760,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353080,"statfs":{"total":96636764160,"available":96617553920,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18324,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353516,"statfs":{"total":96636764160,"available":96618000384,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22420,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349420,"statfs":{"total":96636764160,"available":96613806080,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.378}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18004,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94353836,"statfs":{"total":96636764160,"available":96618328064,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23444,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":21824,"kb_avail":94348396,"statfs":{"total":96636764160,"available":96612757504,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22347776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26312,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":94345528,"statfs":{"total":96636764160,"available":96609820672,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":1.742,"15min":1.742},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":1.76,"15min":1.76},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.379,"15min":0.39400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":1.893,"15min":1.893},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.441},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":1.772,"15min":1.772},"last":0.34200000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":1.921,"15min":1.921},"last":0.443},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58199999999999996,"5min":1.8,"15min":1.8},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83199999999999996,"5min":1.837,"15min":1.837},"last":0.65900000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81799999999999995,"5min":1.671,"15min":1.671},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.865,"15min":1.865},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18632,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353208,"statfs":{"total":96636764160,"available":96617684992,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21704,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":20096,"kb_avail":94350136,"statfs":{"total":96636764160,"available":96614539264,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20578304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.438},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.621}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:27:01.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-05-10T01:27:01.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-05-10T01:27:01.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915541+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-05-10T01:27:01.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-05-10T01:27:01.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911698+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-05-10T01:27:01.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-05-10T01:27:01.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.919833+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-05-10T01:27:01.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-05-10T01:27:01.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917887+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-05-10T01:27:01.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-05-10T01:27:01.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913242+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:27:01.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-05-10T01:27:01.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-05-10T01:27:01.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.912009+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-05-10T01:27:01.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-05-10T01:27:01.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914955+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:27:01.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-05-10T01:27:01.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-05-10T01:27:01.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.918649+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-05-10T01:27:01.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-05-10T01:27:01.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915155+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-05-10T01:27:01.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-05-10T01:27:01.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916594+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-05-10T01:27:01.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-05-10T01:27:01.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.912230+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-05-10T01:27:01.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-05-10T01:27:01.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917525+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-05-10T01:27:01.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-05-10T01:27:01.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916632+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-05-10T01:27:01.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-05-10T01:27:01.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916929+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-05-10T01:27:01.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-05-10T01:27:01.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911208+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-05-10T01:27:01.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-05-10T01:27:01.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916127+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-05-10T01:27:01.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-05-10T01:27:01.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913057+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-05-10T01:27:01.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-05-10T01:27:01.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917655+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:27:01.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-05-10T01:27:01.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-05-10T01:27:01.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.919457+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-05-10T01:27:01.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-05-10T01:27:01.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913561+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-05-10T01:27:01.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-05-10T01:27:01.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913940+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-05-10T01:27:01.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-05-10T01:27:01.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914842+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-05-10T01:27:01.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-05-10T01:27:01.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911662+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-05-10T01:27:01.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-05-10T01:27:01.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915732+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-05-10T01:27:01.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-05-10T01:27:01.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.912526+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-05-10T01:27:01.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-05-10T01:27:01.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915487+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-05-10T01:27:01.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-05-10T01:27:01.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911495+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-05-10T01:27:01.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-05-10T01:27:01.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915110+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-05-10T01:27:01.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-05-10T01:27:01.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913496+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-05-10T01:27:01.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-05-10T01:27:01.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914332+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:27:01.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-05-10T01:27:01.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-05-10T01:27:01.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917101+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-05-10T01:27:01.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-05-10T01:27:01.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911227+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-05-10T01:27:01.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-05-10T01:27:01.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916961+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:27:01.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-05-10T01:27:01.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-05-10T01:27:01.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911220+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-05-10T01:27:01.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-05-10T01:27:01.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.919033+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-05-10T01:27:01.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-05-10T01:27:01.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.912354+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-05-10T01:27:01.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-05-10T01:27:01.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913041+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-05-10T01:27:01.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-05-10T01:27:01.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914714+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-05-10T01:27:01.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-05-10T01:27:01.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914432+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:27:01.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-05-10T01:27:01.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-05-10T01:27:01.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915758+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-05-10T01:27:01.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-05-10T01:27:01.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911214+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:27:01.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-05-10T01:27:01.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-05-10T01:27:01.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.913154+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:27:01.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-05-10T01:27:01.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-05-10T01:27:01.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917385+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-05-10T01:27:01.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-05-10T01:27:01.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916781+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-05-10T01:27:01.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-05-10T01:27:01.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915035+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-05-10T01:27:01.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-05-10T01:27:01.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916431+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-05-10T01:27:01.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-05-10T01:27:01.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915203+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-05-10T01:27:01.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-05-10T01:27:01.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917377+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-05-10T01:27:01.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-05-10T01:27:01.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914709+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-05-10T01:27:01.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-05-10T01:27:01.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917157+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:27:01.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-05-10T01:27:01.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-05-10T01:27:01.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916633+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:27:01.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-05-10T01:27:01.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-05-10T01:27:01.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.917114+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-05-10T01:27:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-05-10T01:27:01.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911669+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-05-10T01:27:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-05-10T01:27:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.911796+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:27:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-05-10T01:27:01.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-05-10T01:27:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916723+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:27:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-05-10T01:27:01.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-05-10T01:27:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916554+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:27:01.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-05-10T01:27:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-05-10T01:27:01.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.916444+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:27:01.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-05-10T01:27:01.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-05-10T01:27:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.915568+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-05-10T01:27:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-05-10T01:27:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914323+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-05-10T01:27:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-05-10T01:27:01.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914199+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-05-10T01:27:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-05-10T01:27:01.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914222+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-05-10T01:27:01.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-05-10T01:27:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914437+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:27:01.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-05-10T01:27:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-05-10T01:27:01.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914386+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:27:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-05-10T01:27:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-10T01:26:55.908809+0000', 'last_change': '2023-05-10T01:26:55.908809+0000', 'last_active': '2023-05-10T01:26:55.908809+0000', 'last_peered': '2023-05-10T01:26:55.908809+0000', 'last_clean': '2023-05-10T01:26:55.908809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:55.908809+0000', 'last_undegraded': '2023-05-10T01:26:55.908809+0000', 'last_fullsized': '2023-05-10T01:26:55.908809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:55.908809+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-10T01:27:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-05-10T01:27:01.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:26:54.907139+0000', 'last_change': '2023-05-10T01:26:54.914746+0000', 'last_active': '2023-05-10T01:26:54.907139+0000', 'last_peered': '2023-05-10T01:26:54.907139+0000', 'last_clean': '2023-05-10T01:26:54.907139+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:26:54.907139+0000', 'last_undegraded': '2023-05-10T01:26:54.907139+0000', 'last_fullsized': '2023-05-10T01:26:54.907139+0000', 'mapping_epoch': 133, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 133, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'last_clean_scrub_stamp': '2023-05-10T01:26:54.907139+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:27:01.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:27:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.315+0000 7f7c06fe3700 1 Processor -- start 2023-05-10T01:27:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.315+0000 7f7c06fe3700 1 -- start start 2023-05-10T01:27:01.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c06fe3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c00151e20 0x7f7c00155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c06fe3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c00155e00 0x7f7c000c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c06fe3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c00069550 con 0x7f7c00151a40 2023-05-10T01:27:01.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c06fe3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0006a6b0 con 0x7f7c00151e20 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c06fe3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c00069b10 con 0x7f7c00155e00 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c00151e20 0x7f7c00155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c00151e20 0x7f7c00155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39790/0 (socket says 172.21.15.52:39790) 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 -- 172.21.15.52:0/2290517242 learned_addr learned my addr 172.21.15.52:0/2290517242 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c067e2700 1 --2- 172.21.15.52:0/2290517242 >> v2:172.21.15.172:3300/0 conn(0x7f7c00155e00 0x7f7c000c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 -- 172.21.15.52:0/2290517242 >> v2:172.21.15.172:3300/0 conn(0x7f7c00155e00 msgr2=0x7f7c000c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:01.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 --2- 172.21.15.52:0/2290517242 >> v2:172.21.15.172:3300/0 conn(0x7f7c00155e00 0x7f7c000c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 -- 172.21.15.52:0/2290517242 >> v1:172.21.15.172:6789/0 conn(0x7f7c00151a40 legacy=0x7f7c00069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c04fdf700 1 -- 172.21.15.52:0/2290517242 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638830030 0 0) 0x7f7c00069550 con 0x7f7c00151a40 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.316+0000 7f7c057e0700 1 -- 172.21.15.52:0/2290517242 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00065500 con 0x7f7c00151e20 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c057e0700 1 --2- 172.21.15.52:0/2290517242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151e20 0x7f7c00155910 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f7c000c40d0 tx=0x7f7bf00090f0).ready entity=mon.0 client_cookie=466b52e4c6723261 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c04fdf700 1 -- 172.21.15.52:0/2290517242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000b520 con 0x7f7c00151e20 2023-05-10T01:27:01.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c04fdf700 1 -- 172.21.15.52:0/2290517242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf000b680 con 0x7f7c00151e20 2023-05-10T01:27:01.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c04fdf700 1 -- 172.21.15.52:0/2290517242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000ba20 con 0x7f7c00151e20 2023-05-10T01:27:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 -- 172.21.15.52:0/2290517242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151e20 msgr2=0x7f7c00155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/2290517242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151e20 0x7f7c00155910 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f7c000c40d0 tx=0x7f7bf00090f0).stop 2023-05-10T01:27:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 -- 172.21.15.52:0/2290517242 shutdown_connections 2023-05-10T01:27:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/2290517242 >> v2:172.21.15.172:3300/0 conn(0x7f7c00155e00 0x7f7c000c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/2290517242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151e20 0x7f7c00155910 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 -- 172.21.15.52:0/2290517242 >> 172.21.15.52:0/2290517242 conn(0x7f7c00067f50 msgr2=0x7f7c00068360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 -- 172.21.15.52:0/2290517242 shutdown_connections 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.317+0000 7f7c06fe3700 1 -- 172.21.15.52:0/2290517242 wait complete. 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.318+0000 7f7c06fe3700 1 Processor -- start 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 -- start start 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c00151e20 0x7f7c000c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c00155e00 0x7f7c000c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c3df0 con 0x7f7c00151a40 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c25c0 con 0x7f7c00155e00 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c06fe3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c28a0 con 0x7f7c00151e20 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c05fe1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c05fe1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39792/0 (socket says 172.21.15.52:39792) 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.319+0000 7f7c05fe1700 1 -- 172.21.15.52:0/217018184 learned_addr learned my addr 172.21.15.52:0/217018184 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c067e2700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c00155e00 0x7f7c000c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c057e0700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c00151e20 0x7f7c000c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 -- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c00151e20 msgr2=0x7f7c000c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c00151e20 0x7f7c000c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 -- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c00155e00 msgr2=0x7f7c000c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c00155e00 0x7f7c000c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 -- 172.21.15.52:0/217018184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0009370 con 0x7f7c00151a40 2023-05-10T01:27:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c05fe1700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f7bfc001eb0 tx=0x7f7bfc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00f470 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00f5f0 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c000c2b80 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00f9b0 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.320+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000c22d0 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.321+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c00153a20 con 0x7f7c00151a40 2023-05-10T01:27:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.321+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7bfc019030 con 0x7f7c00151a40 2023-05-10T01:27:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.322+0000 7f7bedffb700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 0x7f7be0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.322+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f7bfc079180 con 0x7f7c00151a40 2023-05-10T01:27:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.322+0000 7f7c057e0700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 0x7f7be0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.322+0000 7f7c057e0700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 0x7f7be0061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7c000c0400 tx=0x7f7bf0017000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.326+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7bfc04a610 con 0x7f7c00151a40 2023-05-10T01:27:01.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.572+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7c00047150 con 0x7f7c00151a40 2023-05-10T01:27:01.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.572+0000 7f7bedffb700 1 -- 172.21.15.52:0/217018184 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f7bfc04dc30 con 0x7f7c00151a40 2023-05-10T01:27:01.575 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:01.576 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1045,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":171622400,"bytes_avail":772922490880,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":62,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8091}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-05-10T01:23:14.899867+0000","services":{}},"progress_events":{}} 2023-05-10T01:27:01.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 msgr2=0x7f7be0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 0x7f7be0061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7c000c0400 tx=0x7f7bf0017000).stop 2023-05-10T01:27:01.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 msgr2=0x7f7c000ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f7bfc001eb0 tx=0x7f7bfc007c70).stop 2023-05-10T01:27:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 shutdown_connections 2023-05-10T01:27:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f7be005ed60 0x7f7be0061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c00155e00 0x7f7c000c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c00151a40 0x7f7c000ac9a0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 --2- 172.21.15.52:0/217018184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c00151e20 0x7f7c000c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 >> 172.21.15.52:0/217018184 conn(0x7f7c00067f50 msgr2=0x7f7c000bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 shutdown_connections 2023-05-10T01:27:01.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.574+0000 7f7c06fe3700 1 -- 172.21.15.52:0/217018184 wait complete. 2023-05-10T01:27:01.589 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:27:01.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:27:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.703+0000 7f2943a1b700 1 Processor -- start 2023-05-10T01:27:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 -- start start 2023-05-10T01:27:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f293c154540 0x7f293c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f293c069b80 0x7f293c0c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0c0650 con 0x7f293c154160 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c069fb0 con 0x7f293c154540 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.704+0000 7f2943a1b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0bfd20 con 0x7f293c069b80 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f293c154540 0x7f293c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f29417b7700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f293c154160 0x7f293c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48816/0 (socket says 172.21.15.52:48816) 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f29417b7700 1 -- 172.21.15.52:0/3879599422 learned_addr learned my addr 172.21.15.52:0/3879599422 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 -- 172.21.15.52:0/3879599422 >> v2:172.21.15.172:3300/0 conn(0x7f293c069b80 msgr2=0x7f293c0c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 --2- 172.21.15.52:0/3879599422 >> v2:172.21.15.172:3300/0 conn(0x7f293c069b80 0x7f293c0c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 -- 172.21.15.52:0/3879599422 >> v1:172.21.15.52:6789/0 conn(0x7f293c154160 legacy=0x7f293c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f292bfff700 1 -- 172.21.15.52:0/3879599422 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662045555 0 0) 0x7f293c0c0650 con 0x7f293c154160 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 -- 172.21.15.52:0/3879599422 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0c0000 con 0x7f293c154540 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f2940fb6700 1 --2- 172.21.15.52:0/3879599422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154540 0x7f293c069690 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f293c0c5200 tx=0x7f292c009060).ready entity=mon.0 client_cookie=cee922e51c42a9ec server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f292bfff700 1 -- 172.21.15.52:0/3879599422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0090d0 con 0x7f293c154540 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f292bfff700 1 -- 172.21.15.52:0/3879599422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00b580 con 0x7f293c154540 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.705+0000 7f292bfff700 1 -- 172.21.15.52:0/3879599422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00b900 con 0x7f293c154540 2023-05-10T01:27:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 -- 172.21.15.52:0/3879599422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154540 msgr2=0x7f293c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 --2- 172.21.15.52:0/3879599422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154540 0x7f293c069690 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f293c0c5200 tx=0x7f292c009060).stop 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 -- 172.21.15.52:0/3879599422 shutdown_connections 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 --2- 172.21.15.52:0/3879599422 >> v2:172.21.15.172:3300/0 conn(0x7f293c069b80 0x7f293c0c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 --2- 172.21.15.52:0/3879599422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154540 0x7f293c069690 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 -- 172.21.15.52:0/3879599422 >> 172.21.15.52:0/3879599422 conn(0x7f293c0cb6f0 msgr2=0x7f293c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 -- 172.21.15.52:0/3879599422 shutdown_connections 2023-05-10T01:27:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.706+0000 7f2943a1b700 1 -- 172.21.15.52:0/3879599422 wait complete. 2023-05-10T01:27:01.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.707+0000 7f2943a1b700 1 Processor -- start 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.707+0000 7f2943a1b700 1 -- start start 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 0x7f293c1640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 0x7f293c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c167470 con 0x7f293c154160 2023-05-10T01:27:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1586a0 con 0x7f293c069b80 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2943a1b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c157a60 con 0x7f293c154540 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39806/0 (socket says 172.21.15.52:39806) 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 -- 172.21.15.52:0/4158207244 learned_addr learned my addr 172.21.15.52:0/4158207244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f29417b7700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 0x7f293c1640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2941fb8700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 0x7f293c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 -- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 msgr2=0x7f293c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 0x7f293c158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 -- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 msgr2=0x7f293c1640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 0x7f293c1640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 -- 172.21.15.52:0/4158207244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0092a0 con 0x7f293c154160 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f29417b7700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 0x7f293c1640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2941fb8700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 0x7f293c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f2940fb6700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f293c083050 tx=0x7f292c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.708+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00b900 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.709+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00bcc0 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.709+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c157d00 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.709+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c01b440 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.709+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c1582c0 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.710+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c0666b0 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.710+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f292c02a070 con 0x7f293c154160 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.710+0000 7f29297fa700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 0x7f291c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.710+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f292c07b4a0 con 0x7f293c154160 2023-05-10T01:27:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.710+0000 7f29417b7700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 0x7f291c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.711+0000 7f29417b7700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 0x7f291c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2938001560 tx=0x7f2938009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.714+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f292c04c7c0 con 0x7f293c154160 2023-05-10T01:27:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.886+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f293c06c340 con 0x7f291c05ed90 2023-05-10T01:27:01.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.896+0000 7f29297fa700 1 -- 172.21.15.52:0/4158207244 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352980 (secure 0 0 0) 0x7f293c06c340 con 0x7f291c05ed90 2023-05-10T01:27:01.903 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:01.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 msgr2=0x7f291c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 0x7f291c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2938001560 tx=0x7f2938009040).stop 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 msgr2=0x7f293c0af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f293c083050 tx=0x7f292c017000).stop 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 shutdown_connections 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f291c05ed90 0x7f291c061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c154540 0x7f293c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293c069b80 0x7f293c1640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 --2- 172.21.15.52:0/4158207244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f293c154160 0x7f293c0af6b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 >> 172.21.15.52:0/4158207244 conn(0x7f293c0cb6f0 msgr2=0x7f293c14d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 shutdown_connections 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:01.899+0000 7f2943a1b700 1 -- 172.21.15.52:0/4158207244 wait complete. 2023-05-10T01:27:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:27:01.914 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:27:00.593052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":167600,"kb_used_data":12848,"kb_used_omap":0,"kb_used_meta":154688,"kb_avail":754807120,"statfs":{"total":773094113280,"available":772922490880,"internally_reserved":0,"allocated":13156352,"data_stored":6686828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":158400512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.199281"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915541+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911698+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919833+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917887+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913242+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912009+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914955+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.918649+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915155+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916594+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912230+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917525+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916632+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916929+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911208+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916127+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913057+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917655+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919457+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913561+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913940+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914842+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911662+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915732+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912526+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915487+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911495+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915110+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913496+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914332+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917101+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911227+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916961+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911220+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.919033+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.912354+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913041+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914714+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914432+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915758+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911214+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.913154+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917385+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916781+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915035+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916431+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915203+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917377+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914709+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917157+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916633+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.917114+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911669+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.911796+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916723+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916554+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.916444+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919790+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:52.919790+0000","last_peered":"2023-05-10T01:26:52.919790+0000","last_clean":"2023-05-10T01:26:52.919790+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:52.919790+0000","last_undegraded":"2023-05-10T01:26:52.919790+0000","last_fullsized":"2023-05-10T01:26:52.919790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.915568+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920186+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:52.920186+0000","last_peered":"2023-05-10T01:26:52.920186+0000","last_clean":"2023-05-10T01:26:52.920186+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:52.920186+0000","last_undegraded":"2023-05-10T01:26:52.920186+0000","last_fullsized":"2023-05-10T01:26:52.920186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914323+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":108,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919529+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:52.919529+0000","last_peered":"2023-05-10T01:26:52.919529+0000","last_clean":"2023-05-10T01:26:52.919529+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:52.919529+0000","last_undegraded":"2023-05-10T01:26:52.919529+0000","last_fullsized":"2023-05-10T01:26:52.919529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914199+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920135+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:52.920135+0000","last_peered":"2023-05-10T01:26:52.920135+0000","last_clean":"2023-05-10T01:26:52.920135+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:52.920135+0000","last_undegraded":"2023-05-10T01:26:52.920135+0000","last_fullsized":"2023-05-10T01:26:52.920135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920481+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:52.920481+0000","last_peered":"2023-05-10T01:26:52.920481+0000","last_clean":"2023-05-10T01:26:52.920481+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:52.920481+0000","last_undegraded":"2023-05-10T01:26:52.920481+0000","last_fullsized":"2023-05-10T01:26:52.920481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914222+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920493+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:52.920493+0000","last_peered":"2023-05-10T01:26:52.920493+0000","last_clean":"2023-05-10T01:26:52.920493+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:52.920493+0000","last_undegraded":"2023-05-10T01:26:52.920493+0000","last_fullsized":"2023-05-10T01:26:52.920493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914437+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920522+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:52.920522+0000","last_peered":"2023-05-10T01:26:52.920522+0000","last_clean":"2023-05-10T01:26:52.920522+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:52.920522+0000","last_undegraded":"2023-05-10T01:26:52.920522+0000","last_fullsized":"2023-05-10T01:26:52.920522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914386+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.919778+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:52.919778+0000","last_peered":"2023-05-10T01:26:52.919778+0000","last_clean":"2023-05-10T01:26:52.919778+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:52.919778+0000","last_undegraded":"2023-05-10T01:26:52.919778+0000","last_fullsized":"2023-05-10T01:26:52.919778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T01:26:55.908809+0000","last_change":"2023-05-10T01:26:55.908809+0000","last_active":"2023-05-10T01:26:55.908809+0000","last_peered":"2023-05-10T01:26:55.908809+0000","last_clean":"2023-05-10T01:26:55.908809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:55.908809+0000","last_undegraded":"2023-05-10T01:26:55.908809+0000","last_fullsized":"2023-05-10T01:26:55.908809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:26:54.907139+0000","last_change":"2023-05-10T01:26:54.914746+0000","last_active":"2023-05-10T01:26:54.907139+0000","last_peered":"2023-05-10T01:26:54.907139+0000","last_clean":"2023-05-10T01:26:54.907139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:26:54.907139+0000","last_undegraded":"2023-05-10T01:26:54.907139+0000","last_fullsized":"2023-05-10T01:26:54.907139+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":132,"state":"active+clean","last_fresh":"2023-05-10T01:26:52.920310+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:52.920310+0000","last_peered":"2023-05-10T01:26:52.920310+0000","last_clean":"2023-05-10T01:26:52.920310+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:52.920310+0000","last_undegraded":"2023-05-10T01:26:52.920310+0000","last_fullsized":"2023-05-10T01:26:52.920310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18760,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17152,"kb_avail":94353080,"statfs":{"total":96636764160,"available":96617553920,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17563648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.65800000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18324,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16704,"kb_avail":94353516,"statfs":{"total":96636764160,"available":96618000384,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17104896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22420,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94349420,"statfs":{"total":96636764160,"available":96613806080,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.41299999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.378}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18004,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":94353836,"statfs":{"total":96636764160,"available":96618328064,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23444,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":21824,"kb_avail":94348396,"statfs":{"total":96636764160,"available":96612757504,"internally_reserved":0,"allocated":1650688,"data_stored":839096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22347776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26312,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":94345528,"statfs":{"total":96636764160,"available":96609820672,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":1.742,"15min":1.742},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":1.76,"15min":1.76},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.379,"15min":0.39400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":1.893,"15min":1.893},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.441},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":1.772,"15min":1.772},"last":0.34200000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":1.921,"15min":1.921},"last":0.443},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58199999999999996,"5min":1.8,"15min":1.8},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83199999999999996,"5min":1.837,"15min":1.837},"last":0.65900000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81799999999999995,"5min":1.671,"15min":1.671},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.865,"15min":1.865},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18632,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":17024,"kb_avail":94353208,"statfs":{"total":96636764160,"available":96617684992,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17432576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.754},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21704,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":20096,"kb_avail":94350136,"statfs":{"total":96636764160,"available":96614539264,"internally_reserved":0,"allocated":1638400,"data_stored":832611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20578304},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.438},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.621}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.55100000000000005}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:27:04.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:27:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.051+0000 7f6010e27700 1 Processor -- start 2023-05-10T01:27:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.051+0000 7f6010e27700 1 -- start start 2023-05-10T01:27:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6010e27700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f600c154160 0x7f600c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6010e27700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f600c154540 0x7f600c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6010e27700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0c0650 con 0x7f600c069690 2023-05-10T01:27:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6010e27700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0c1af0 con 0x7f600c154160 2023-05-10T01:27:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6010e27700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0bfd20 con 0x7f600c154540 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f600c154160 0x7f600c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f600c069690 0x7f600c157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48830/0 (socket says 172.21.15.52:48830) 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600ad9d700 1 -- 172.21.15.52:0/2162499255 learned_addr learned my addr 172.21.15.52:0/2162499255 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f6009d9b700 1 --2- 172.21.15.52:0/2162499255 >> v2:172.21.15.172:3300/0 conn(0x7f600c154540 0x7f600c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600a59c700 1 -- 172.21.15.52:0/2162499255 >> v2:172.21.15.172:3300/0 conn(0x7f600c154540 msgr2=0x7f600c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600a59c700 1 --2- 172.21.15.52:0/2162499255 >> v2:172.21.15.172:3300/0 conn(0x7f600c154540 0x7f600c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600a59c700 1 -- 172.21.15.52:0/2162499255 >> v1:172.21.15.52:6789/0 conn(0x7f600c069690 legacy=0x7f600c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600959a700 1 -- 172.21.15.52:0/2162499255 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805890922 0 0) 0x7f600c0c0650 con 0x7f600c069690 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.052+0000 7f600a59c700 1 -- 172.21.15.52:0/2162499255 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0c0000 con 0x7f600c154160 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f600a59c700 1 --2- 172.21.15.52:0/2162499255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c154160 0x7f600c0c5c60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f600c06a780 tx=0x7f6004009060).ready entity=mon.0 client_cookie=64f06844b2dae115 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f600959a700 1 -- 172.21.15.52:0/2162499255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400f510 con 0x7f600c154160 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f600959a700 1 -- 172.21.15.52:0/2162499255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400f670 con 0x7f600c154160 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f600959a700 1 -- 172.21.15.52:0/2162499255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400f9f0 con 0x7f600c154160 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 -- 172.21.15.52:0/2162499255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c154160 msgr2=0x7f600c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 --2- 172.21.15.52:0/2162499255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c154160 0x7f600c0c5c60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f600c06a780 tx=0x7f6004009060).stop 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 -- 172.21.15.52:0/2162499255 shutdown_connections 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 --2- 172.21.15.52:0/2162499255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c154160 0x7f600c0c5c60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 --2- 172.21.15.52:0/2162499255 >> v2:172.21.15.172:3300/0 conn(0x7f600c154540 0x7f600c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 -- 172.21.15.52:0/2162499255 >> 172.21.15.52:0/2162499255 conn(0x7f600c0cb740 msgr2=0x7f600c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 -- 172.21.15.52:0/2162499255 shutdown_connections 2023-05-10T01:27:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.053+0000 7f6010e27700 1 -- 172.21.15.52:0/2162499255 wait complete. 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.054+0000 7f6010e27700 1 Processor -- start 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.054+0000 7f6010e27700 1 -- start start 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 0x7f600c0c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f600c154540 0x7f600c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c158e00 con 0x7f600c069690 2023-05-10T01:27:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c1dd0 con 0x7f600c154160 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f6010e27700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c2040 con 0x7f600c154540 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f600a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f600a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39820/0 (socket says 172.21.15.52:39820) 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.055+0000 7f600a59c700 1 -- 172.21.15.52:0/3837902000 learned_addr learned my addr 172.21.15.52:0/3837902000 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600ad9d700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f600c154540 0x7f600c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f6009d9b700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 0x7f600c0c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 -- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f600c154540 msgr2=0x7f600c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f600c154540 0x7f600c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 -- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 msgr2=0x7f600c0c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 0x7f600c0c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 -- 172.21.15.52:0/3837902000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040092a0 con 0x7f600c069690 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f6009d9b700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 0x7f600c0c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f600a59c700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f6004009dd0 tx=0x7f6004017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400f7e0 con 0x7f600c069690 2023-05-10T01:27:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400f940 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c0c2320 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600401b660 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.056+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c0c2b80 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.057+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c1539a0 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.057+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f600402b070 con 0x7f600c069690 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.058+0000 7f60027fc700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 0x7f5ff0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.058+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f600407b3d0 con 0x7f600c069690 2023-05-10T01:27:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.058+0000 7f6009d9b700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 0x7f5ff0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.058+0000 7f6009d9b700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 0x7f5ff0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f600c0afbc0 tx=0x7f5ff400b040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.062+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f600404c910 con 0x7f600c069690 2023-05-10T01:27:05.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.228+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f600c158f40 con 0x7f5ff005ed90 2023-05-10T01:27:05.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.239+0000 7f60027fc700 1 -- 172.21.15.52:0/3837902000 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361721 (secure 0 0 0) 0x7f5ff4013370 con 0x7f5ff005ed90 2023-05-10T01:27:05.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:05.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 msgr2=0x7f5ff0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 0x7f5ff0061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f600c0afbc0 tx=0x7f5ff400b040).stop 2023-05-10T01:27:05.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 msgr2=0x7f600c159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f6004009dd0 tx=0x7f6004017000).stop 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 shutdown_connections 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5ff005ed90 0x7f5ff0061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f600c154540 0x7f600c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f600c069690 0x7f600c159580 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 --2- 172.21.15.52:0/3837902000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f600c154160 0x7f600c0c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 >> 172.21.15.52:0/3837902000 conn(0x7f600c0cb740 msgr2=0x7f600c0aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:05.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 shutdown_connections 2023-05-10T01:27:05.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.242+0000 7f6010e27700 1 -- 172.21.15.52:0/3837902000 wait complete. 2023-05-10T01:27:05.249 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:27:05.256 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:27:04.594154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":169408,"kb_used_data":13248,"kb_used_omap":0,"kb_used_meta":156096,"kb_avail":754805312,"statfs":{"total":773094113280,"available":772920639488,"internally_reserved":0,"allocated":13565952,"data_stored":6888212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":159842304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.199961"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341410+0000","last_change":"2023-05-10T01:26:56.334089+0000","last_active":"2023-05-10T01:26:56.341410+0000","last_peered":"2023-05-10T01:26:56.341410+0000","last_clean":"2023-05-10T01:26:56.341410+0000","last_became_active":"2023-05-10T01:26:56.333811+0000","last_became_peered":"2023-05-10T01:26:56.333811+0000","last_unstale":"2023-05-10T01:26:56.341410+0000","last_undegraded":"2023-05-10T01:26:56.341410+0000","last_fullsized":"2023-05-10T01:26:56.341410+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337571+0000","last_change":"2023-05-10T01:26:55.939887+0000","last_active":"2023-05-10T01:26:56.337571+0000","last_peered":"2023-05-10T01:26:56.337571+0000","last_clean":"2023-05-10T01:26:56.337571+0000","last_became_active":"2023-05-10T01:26:55.939406+0000","last_became_peered":"2023-05-10T01:26:55.939406+0000","last_unstale":"2023-05-10T01:26:56.337571+0000","last_undegraded":"2023-05-10T01:26:56.337571+0000","last_fullsized":"2023-05-10T01:26:56.337571+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330055+0000","last_change":"2023-05-10T01:26:56.325942+0000","last_active":"2023-05-10T01:26:56.330055+0000","last_peered":"2023-05-10T01:26:56.330055+0000","last_clean":"2023-05-10T01:26:56.330055+0000","last_became_active":"2023-05-10T01:26:56.325660+0000","last_became_peered":"2023-05-10T01:26:56.325660+0000","last_unstale":"2023-05-10T01:26:56.330055+0000","last_undegraded":"2023-05-10T01:26:56.330055+0000","last_fullsized":"2023-05-10T01:26:56.330055+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315891+0000","last_change":"2023-05-10T01:26:55.936131+0000","last_active":"2023-05-10T01:26:56.315891+0000","last_peered":"2023-05-10T01:26:56.315891+0000","last_clean":"2023-05-10T01:26:56.315891+0000","last_became_active":"2023-05-10T01:26:55.932953+0000","last_became_peered":"2023-05-10T01:26:55.932953+0000","last_unstale":"2023-05-10T01:26:56.315891+0000","last_undegraded":"2023-05-10T01:26:56.315891+0000","last_fullsized":"2023-05-10T01:26:56.315891+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.338425+0000","last_change":"2023-05-10T01:26:56.335733+0000","last_active":"2023-05-10T01:26:56.338425+0000","last_peered":"2023-05-10T01:26:56.338425+0000","last_clean":"2023-05-10T01:26:56.338425+0000","last_became_active":"2023-05-10T01:26:56.335460+0000","last_became_peered":"2023-05-10T01:26:56.335460+0000","last_unstale":"2023-05-10T01:26:56.338425+0000","last_undegraded":"2023-05-10T01:26:56.338425+0000","last_fullsized":"2023-05-10T01:26:56.338425+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.327739+0000","last_change":"2023-05-10T01:26:55.941449+0000","last_active":"2023-05-10T01:26:56.327739+0000","last_peered":"2023-05-10T01:26:56.327739+0000","last_clean":"2023-05-10T01:26:56.327739+0000","last_became_active":"2023-05-10T01:26:55.941101+0000","last_became_peered":"2023-05-10T01:26:55.941101+0000","last_unstale":"2023-05-10T01:26:56.327739+0000","last_undegraded":"2023-05-10T01:26:56.327739+0000","last_fullsized":"2023-05-10T01:26:56.327739+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.334484+0000","last_change":"2023-05-10T01:26:56.331133+0000","last_active":"2023-05-10T01:26:56.334484+0000","last_peered":"2023-05-10T01:26:56.334484+0000","last_clean":"2023-05-10T01:26:56.334484+0000","last_became_active":"2023-05-10T01:26:56.330817+0000","last_became_peered":"2023-05-10T01:26:56.330817+0000","last_unstale":"2023-05-10T01:26:56.334484+0000","last_undegraded":"2023-05-10T01:26:56.334484+0000","last_fullsized":"2023-05-10T01:26:56.334484+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.339099+0000","last_change":"2023-05-10T01:26:55.944393+0000","last_active":"2023-05-10T01:26:56.339099+0000","last_peered":"2023-05-10T01:26:56.339099+0000","last_clean":"2023-05-10T01:26:56.339099+0000","last_became_active":"2023-05-10T01:26:55.943857+0000","last_became_peered":"2023-05-10T01:26:55.943857+0000","last_unstale":"2023-05-10T01:26:56.339099+0000","last_undegraded":"2023-05-10T01:26:56.339099+0000","last_fullsized":"2023-05-10T01:26:56.339099+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337728+0000","last_change":"2023-05-10T01:26:56.332361+0000","last_active":"2023-05-10T01:26:56.337728+0000","last_peered":"2023-05-10T01:26:56.337728+0000","last_clean":"2023-05-10T01:26:56.337728+0000","last_became_active":"2023-05-10T01:26:56.332092+0000","last_became_peered":"2023-05-10T01:26:56.332092+0000","last_unstale":"2023-05-10T01:26:56.337728+0000","last_undegraded":"2023-05-10T01:26:56.337728+0000","last_fullsized":"2023-05-10T01:26:56.337728+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.339502+0000","last_change":"2023-05-10T01:26:55.936960+0000","last_active":"2023-05-10T01:26:56.339502+0000","last_peered":"2023-05-10T01:26:56.339502+0000","last_clean":"2023-05-10T01:26:56.339502+0000","last_became_active":"2023-05-10T01:26:55.936693+0000","last_became_peered":"2023-05-10T01:26:55.936693+0000","last_unstale":"2023-05-10T01:26:56.339502+0000","last_undegraded":"2023-05-10T01:26:56.339502+0000","last_fullsized":"2023-05-10T01:26:56.339502+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331360+0000","last_change":"2023-05-10T01:26:56.327900+0000","last_active":"2023-05-10T01:26:56.331360+0000","last_peered":"2023-05-10T01:26:56.331360+0000","last_clean":"2023-05-10T01:26:56.331360+0000","last_became_active":"2023-05-10T01:26:56.327636+0000","last_became_peered":"2023-05-10T01:26:56.327636+0000","last_unstale":"2023-05-10T01:26:56.331360+0000","last_undegraded":"2023-05-10T01:26:56.331360+0000","last_fullsized":"2023-05-10T01:26:56.331360+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330803+0000","last_change":"2023-05-10T01:26:55.925146+0000","last_active":"2023-05-10T01:26:56.330803+0000","last_peered":"2023-05-10T01:26:56.330803+0000","last_clean":"2023-05-10T01:26:56.330803+0000","last_became_active":"2023-05-10T01:26:55.924877+0000","last_became_peered":"2023-05-10T01:26:55.924877+0000","last_unstale":"2023-05-10T01:26:56.330803+0000","last_undegraded":"2023-05-10T01:26:56.330803+0000","last_fullsized":"2023-05-10T01:26:56.330803+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.328210+0000","last_change":"2023-05-10T01:26:56.324938+0000","last_active":"2023-05-10T01:26:56.328210+0000","last_peered":"2023-05-10T01:26:56.328210+0000","last_clean":"2023-05-10T01:26:56.328210+0000","last_became_active":"2023-05-10T01:26:56.324698+0000","last_became_peered":"2023-05-10T01:26:56.324698+0000","last_unstale":"2023-05-10T01:26:56.328210+0000","last_undegraded":"2023-05-10T01:26:56.328210+0000","last_fullsized":"2023-05-10T01:26:56.328210+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.312809+0000","last_change":"2023-05-10T01:26:55.931462+0000","last_active":"2023-05-10T01:26:56.312809+0000","last_peered":"2023-05-10T01:26:56.312809+0000","last_clean":"2023-05-10T01:26:56.312809+0000","last_became_active":"2023-05-10T01:26:55.931138+0000","last_became_peered":"2023-05-10T01:26:55.931138+0000","last_unstale":"2023-05-10T01:26:56.312809+0000","last_undegraded":"2023-05-10T01:26:56.312809+0000","last_fullsized":"2023-05-10T01:26:56.312809+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.327070+0000","last_change":"2023-05-10T01:26:56.322577+0000","last_active":"2023-05-10T01:26:56.327070+0000","last_peered":"2023-05-10T01:26:56.327070+0000","last_clean":"2023-05-10T01:26:56.327070+0000","last_became_active":"2023-05-10T01:26:56.322169+0000","last_became_peered":"2023-05-10T01:26:56.322169+0000","last_unstale":"2023-05-10T01:26:56.327070+0000","last_undegraded":"2023-05-10T01:26:56.327070+0000","last_fullsized":"2023-05-10T01:26:56.327070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.320853+0000","last_change":"2023-05-10T01:26:55.934383+0000","last_active":"2023-05-10T01:26:56.320853+0000","last_peered":"2023-05-10T01:26:56.320853+0000","last_clean":"2023-05-10T01:26:56.320853+0000","last_became_active":"2023-05-10T01:26:55.933975+0000","last_became_peered":"2023-05-10T01:26:55.933975+0000","last_unstale":"2023-05-10T01:26:56.320853+0000","last_undegraded":"2023-05-10T01:26:56.320853+0000","last_fullsized":"2023-05-10T01:26:56.320853+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336664+0000","last_change":"2023-05-10T01:26:56.332546+0000","last_active":"2023-05-10T01:26:56.336664+0000","last_peered":"2023-05-10T01:26:56.336664+0000","last_clean":"2023-05-10T01:26:56.336664+0000","last_became_active":"2023-05-10T01:26:56.331702+0000","last_became_peered":"2023-05-10T01:26:56.331702+0000","last_unstale":"2023-05-10T01:26:56.336664+0000","last_undegraded":"2023-05-10T01:26:56.336664+0000","last_fullsized":"2023-05-10T01:26:56.336664+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315388+0000","last_change":"2023-05-10T01:26:55.939705+0000","last_active":"2023-05-10T01:26:56.315388+0000","last_peered":"2023-05-10T01:26:56.315388+0000","last_clean":"2023-05-10T01:26:56.315388+0000","last_became_active":"2023-05-10T01:26:55.938929+0000","last_became_peered":"2023-05-10T01:26:55.938929+0000","last_unstale":"2023-05-10T01:26:56.315388+0000","last_undegraded":"2023-05-10T01:26:56.315388+0000","last_fullsized":"2023-05-10T01:26:56.315388+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.333500+0000","last_change":"2023-05-10T01:26:56.329179+0000","last_active":"2023-05-10T01:26:56.333500+0000","last_peered":"2023-05-10T01:26:56.333500+0000","last_clean":"2023-05-10T01:26:56.333500+0000","last_became_active":"2023-05-10T01:26:56.328899+0000","last_became_peered":"2023-05-10T01:26:56.328899+0000","last_unstale":"2023-05-10T01:26:56.333500+0000","last_undegraded":"2023-05-10T01:26:56.333500+0000","last_fullsized":"2023-05-10T01:26:56.333500+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.321356+0000","last_change":"2023-05-10T01:26:55.939568+0000","last_active":"2023-05-10T01:26:56.321356+0000","last_peered":"2023-05-10T01:26:56.321356+0000","last_clean":"2023-05-10T01:26:56.321356+0000","last_became_active":"2023-05-10T01:26:55.939190+0000","last_became_peered":"2023-05-10T01:26:55.939190+0000","last_unstale":"2023-05-10T01:26:56.321356+0000","last_undegraded":"2023-05-10T01:26:56.321356+0000","last_fullsized":"2023-05-10T01:26:56.321356+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.335285+0000","last_change":"2023-05-10T01:26:56.333360+0000","last_active":"2023-05-10T01:26:56.335285+0000","last_peered":"2023-05-10T01:26:56.335285+0000","last_clean":"2023-05-10T01:26:56.335285+0000","last_became_active":"2023-05-10T01:26:56.333150+0000","last_became_peered":"2023-05-10T01:26:56.333150+0000","last_unstale":"2023-05-10T01:26:56.335285+0000","last_undegraded":"2023-05-10T01:26:56.335285+0000","last_fullsized":"2023-05-10T01:26:56.335285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315944+0000","last_change":"2023-05-10T01:26:55.939907+0000","last_active":"2023-05-10T01:26:56.315944+0000","last_peered":"2023-05-10T01:26:56.315944+0000","last_clean":"2023-05-10T01:26:56.315944+0000","last_became_active":"2023-05-10T01:26:55.939570+0000","last_became_peered":"2023-05-10T01:26:55.939570+0000","last_unstale":"2023-05-10T01:26:56.315944+0000","last_undegraded":"2023-05-10T01:26:56.315944+0000","last_fullsized":"2023-05-10T01:26:56.315944+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341996+0000","last_change":"2023-05-10T01:26:56.338369+0000","last_active":"2023-05-10T01:26:56.341996+0000","last_peered":"2023-05-10T01:26:56.341996+0000","last_clean":"2023-05-10T01:26:56.341996+0000","last_became_active":"2023-05-10T01:26:56.338109+0000","last_became_peered":"2023-05-10T01:26:56.338109+0000","last_unstale":"2023-05-10T01:26:56.341996+0000","last_undegraded":"2023-05-10T01:26:56.341996+0000","last_fullsized":"2023-05-10T01:26:56.341996+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341237+0000","last_change":"2023-05-10T01:26:55.944161+0000","last_active":"2023-05-10T01:26:56.341237+0000","last_peered":"2023-05-10T01:26:56.341237+0000","last_clean":"2023-05-10T01:26:56.341237+0000","last_became_active":"2023-05-10T01:26:55.943216+0000","last_became_peered":"2023-05-10T01:26:55.943216+0000","last_unstale":"2023-05-10T01:26:56.341237+0000","last_undegraded":"2023-05-10T01:26:56.341237+0000","last_fullsized":"2023-05-10T01:26:56.341237+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.335830+0000","last_change":"2023-05-10T01:26:56.331810+0000","last_active":"2023-05-10T01:26:56.335830+0000","last_peered":"2023-05-10T01:26:56.335830+0000","last_clean":"2023-05-10T01:26:56.335830+0000","last_became_active":"2023-05-10T01:26:56.331539+0000","last_became_peered":"2023-05-10T01:26:56.331539+0000","last_unstale":"2023-05-10T01:26:56.335830+0000","last_undegraded":"2023-05-10T01:26:56.335830+0000","last_fullsized":"2023-05-10T01:26:56.335830+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.339961+0000","last_change":"2023-05-10T01:26:55.938447+0000","last_active":"2023-05-10T01:26:56.339961+0000","last_peered":"2023-05-10T01:26:56.339961+0000","last_clean":"2023-05-10T01:26:56.339961+0000","last_became_active":"2023-05-10T01:26:55.938160+0000","last_became_peered":"2023-05-10T01:26:55.938160+0000","last_unstale":"2023-05-10T01:26:56.339961+0000","last_undegraded":"2023-05-10T01:26:56.339961+0000","last_fullsized":"2023-05-10T01:26:56.339961+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.324996+0000","last_change":"2023-05-10T01:26:56.321831+0000","last_active":"2023-05-10T01:26:56.324996+0000","last_peered":"2023-05-10T01:26:56.324996+0000","last_clean":"2023-05-10T01:26:56.324996+0000","last_became_active":"2023-05-10T01:26:56.321511+0000","last_became_peered":"2023-05-10T01:26:56.321511+0000","last_unstale":"2023-05-10T01:26:56.324996+0000","last_undegraded":"2023-05-10T01:26:56.324996+0000","last_fullsized":"2023-05-10T01:26:56.324996+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.320703+0000","last_change":"2023-05-10T01:26:55.935034+0000","last_active":"2023-05-10T01:26:56.320703+0000","last_peered":"2023-05-10T01:26:56.320703+0000","last_clean":"2023-05-10T01:26:56.320703+0000","last_became_active":"2023-05-10T01:26:55.934574+0000","last_became_peered":"2023-05-10T01:26:55.934574+0000","last_unstale":"2023-05-10T01:26:56.320703+0000","last_undegraded":"2023-05-10T01:26:56.320703+0000","last_fullsized":"2023-05-10T01:26:56.320703+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.329999+0000","last_change":"2023-05-10T01:26:56.325783+0000","last_active":"2023-05-10T01:26:56.329999+0000","last_peered":"2023-05-10T01:26:56.329999+0000","last_clean":"2023-05-10T01:26:56.329999+0000","last_became_active":"2023-05-10T01:26:56.325499+0000","last_became_peered":"2023-05-10T01:26:56.325499+0000","last_unstale":"2023-05-10T01:26:56.329999+0000","last_undegraded":"2023-05-10T01:26:56.329999+0000","last_fullsized":"2023-05-10T01:26:56.329999+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.311214+0000","last_change":"2023-05-10T01:26:55.932081+0000","last_active":"2023-05-10T01:26:56.311214+0000","last_peered":"2023-05-10T01:26:56.311214+0000","last_clean":"2023-05-10T01:26:56.311214+0000","last_became_active":"2023-05-10T01:26:55.931772+0000","last_became_peered":"2023-05-10T01:26:55.931772+0000","last_unstale":"2023-05-10T01:26:56.311214+0000","last_undegraded":"2023-05-10T01:26:56.311214+0000","last_fullsized":"2023-05-10T01:26:56.311214+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330156+0000","last_change":"2023-05-10T01:26:56.316332+0000","last_active":"2023-05-10T01:26:56.330156+0000","last_peered":"2023-05-10T01:26:56.330156+0000","last_clean":"2023-05-10T01:26:56.330156+0000","last_became_active":"2023-05-10T01:26:56.316070+0000","last_became_peered":"2023-05-10T01:26:56.316070+0000","last_unstale":"2023-05-10T01:26:56.330156+0000","last_undegraded":"2023-05-10T01:26:56.330156+0000","last_fullsized":"2023-05-10T01:26:56.330156+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336722+0000","last_change":"2023-05-10T01:26:55.934881+0000","last_active":"2023-05-10T01:26:56.336722+0000","last_peered":"2023-05-10T01:26:56.336722+0000","last_clean":"2023-05-10T01:26:56.336722+0000","last_became_active":"2023-05-10T01:26:55.934564+0000","last_became_peered":"2023-05-10T01:26:55.934564+0000","last_unstale":"2023-05-10T01:26:56.336722+0000","last_undegraded":"2023-05-10T01:26:56.336722+0000","last_fullsized":"2023-05-10T01:26:56.336722+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.338313+0000","last_change":"2023-05-10T01:26:56.335896+0000","last_active":"2023-05-10T01:26:56.338313+0000","last_peered":"2023-05-10T01:26:56.338313+0000","last_clean":"2023-05-10T01:26:56.338313+0000","last_became_active":"2023-05-10T01:26:56.333299+0000","last_became_peered":"2023-05-10T01:26:56.333299+0000","last_unstale":"2023-05-10T01:26:56.338313+0000","last_undegraded":"2023-05-10T01:26:56.338313+0000","last_fullsized":"2023-05-10T01:26:56.338313+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316137+0000","last_change":"2023-05-10T01:26:55.939083+0000","last_active":"2023-05-10T01:26:56.316137+0000","last_peered":"2023-05-10T01:26:56.316137+0000","last_clean":"2023-05-10T01:26:56.316137+0000","last_became_active":"2023-05-10T01:26:55.938652+0000","last_became_peered":"2023-05-10T01:26:55.938652+0000","last_unstale":"2023-05-10T01:26:56.316137+0000","last_undegraded":"2023-05-10T01:26:56.316137+0000","last_fullsized":"2023-05-10T01:26:56.316137+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341524+0000","last_change":"2023-05-10T01:26:56.335306+0000","last_active":"2023-05-10T01:26:56.341524+0000","last_peered":"2023-05-10T01:26:56.341524+0000","last_clean":"2023-05-10T01:26:56.341524+0000","last_became_active":"2023-05-10T01:26:56.334984+0000","last_became_peered":"2023-05-10T01:26:56.334984+0000","last_unstale":"2023-05-10T01:26:56.341524+0000","last_undegraded":"2023-05-10T01:26:56.341524+0000","last_fullsized":"2023-05-10T01:26:56.341524+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.322919+0000","last_change":"2023-05-10T01:26:55.942279+0000","last_active":"2023-05-10T01:26:56.322919+0000","last_peered":"2023-05-10T01:26:56.322919+0000","last_clean":"2023-05-10T01:26:56.322919+0000","last_became_active":"2023-05-10T01:26:55.941991+0000","last_became_peered":"2023-05-10T01:26:55.941991+0000","last_unstale":"2023-05-10T01:26:56.322919+0000","last_undegraded":"2023-05-10T01:26:56.322919+0000","last_fullsized":"2023-05-10T01:26:56.322919+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.338398+0000","last_change":"2023-05-10T01:26:56.335509+0000","last_active":"2023-05-10T01:26:56.338398+0000","last_peered":"2023-05-10T01:26:56.338398+0000","last_clean":"2023-05-10T01:26:56.338398+0000","last_became_active":"2023-05-10T01:26:56.335124+0000","last_became_peered":"2023-05-10T01:26:56.335124+0000","last_unstale":"2023-05-10T01:26:56.338398+0000","last_undegraded":"2023-05-10T01:26:56.338398+0000","last_fullsized":"2023-05-10T01:26:56.338398+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.339959+0000","last_change":"2023-05-10T01:26:55.938332+0000","last_active":"2023-05-10T01:26:56.339959+0000","last_peered":"2023-05-10T01:26:56.339959+0000","last_clean":"2023-05-10T01:26:56.339959+0000","last_became_active":"2023-05-10T01:26:55.938037+0000","last_became_peered":"2023-05-10T01:26:55.938037+0000","last_unstale":"2023-05-10T01:26:56.339959+0000","last_undegraded":"2023-05-10T01:26:56.339959+0000","last_fullsized":"2023-05-10T01:26:56.339959+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332771+0000","last_change":"2023-05-10T01:26:56.327111+0000","last_active":"2023-05-10T01:26:56.332771+0000","last_peered":"2023-05-10T01:26:56.332771+0000","last_clean":"2023-05-10T01:26:56.332771+0000","last_became_active":"2023-05-10T01:26:56.326840+0000","last_became_peered":"2023-05-10T01:26:56.326840+0000","last_unstale":"2023-05-10T01:26:56.332771+0000","last_undegraded":"2023-05-10T01:26:56.332771+0000","last_fullsized":"2023-05-10T01:26:56.332771+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315996+0000","last_change":"2023-05-10T01:26:55.937841+0000","last_active":"2023-05-10T01:26:56.315996+0000","last_peered":"2023-05-10T01:26:56.315996+0000","last_clean":"2023-05-10T01:26:56.315996+0000","last_became_active":"2023-05-10T01:26:55.937458+0000","last_became_peered":"2023-05-10T01:26:55.937458+0000","last_unstale":"2023-05-10T01:26:56.315996+0000","last_undegraded":"2023-05-10T01:26:56.315996+0000","last_fullsized":"2023-05-10T01:26:56.315996+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332169+0000","last_change":"2023-05-10T01:26:56.328960+0000","last_active":"2023-05-10T01:26:56.332169+0000","last_peered":"2023-05-10T01:26:56.332169+0000","last_clean":"2023-05-10T01:26:56.332169+0000","last_became_active":"2023-05-10T01:26:56.327586+0000","last_became_peered":"2023-05-10T01:26:56.327586+0000","last_unstale":"2023-05-10T01:26:56.332169+0000","last_undegraded":"2023-05-10T01:26:56.332169+0000","last_fullsized":"2023-05-10T01:26:56.332169+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330484+0000","last_change":"2023-05-10T01:26:55.943357+0000","last_active":"2023-05-10T01:26:56.330484+0000","last_peered":"2023-05-10T01:26:56.330484+0000","last_clean":"2023-05-10T01:26:56.330484+0000","last_became_active":"2023-05-10T01:26:55.942307+0000","last_became_peered":"2023-05-10T01:26:55.942307+0000","last_unstale":"2023-05-10T01:26:56.330484+0000","last_undegraded":"2023-05-10T01:26:56.330484+0000","last_fullsized":"2023-05-10T01:26:56.330484+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336254+0000","last_change":"2023-05-10T01:26:56.328542+0000","last_active":"2023-05-10T01:26:56.336254+0000","last_peered":"2023-05-10T01:26:56.336254+0000","last_clean":"2023-05-10T01:26:56.336254+0000","last_became_active":"2023-05-10T01:26:56.326842+0000","last_became_peered":"2023-05-10T01:26:56.326842+0000","last_unstale":"2023-05-10T01:26:56.336254+0000","last_undegraded":"2023-05-10T01:26:56.336254+0000","last_fullsized":"2023-05-10T01:26:56.336254+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.318096+0000","last_change":"2023-05-10T01:26:55.937382+0000","last_active":"2023-05-10T01:26:56.318096+0000","last_peered":"2023-05-10T01:26:56.318096+0000","last_clean":"2023-05-10T01:26:56.318096+0000","last_became_active":"2023-05-10T01:26:55.934259+0000","last_became_peered":"2023-05-10T01:26:55.934259+0000","last_unstale":"2023-05-10T01:26:56.318096+0000","last_undegraded":"2023-05-10T01:26:56.318096+0000","last_fullsized":"2023-05-10T01:26:56.318096+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.329524+0000","last_change":"2023-05-10T01:26:56.324256+0000","last_active":"2023-05-10T01:26:56.329524+0000","last_peered":"2023-05-10T01:26:56.329524+0000","last_clean":"2023-05-10T01:26:56.329524+0000","last_became_active":"2023-05-10T01:26:56.323963+0000","last_became_peered":"2023-05-10T01:26:56.323963+0000","last_unstale":"2023-05-10T01:26:56.329524+0000","last_undegraded":"2023-05-10T01:26:56.329524+0000","last_fullsized":"2023-05-10T01:26:56.329524+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316468+0000","last_change":"2023-05-10T01:26:55.937648+0000","last_active":"2023-05-10T01:26:56.316468+0000","last_peered":"2023-05-10T01:26:56.316468+0000","last_clean":"2023-05-10T01:26:56.316468+0000","last_became_active":"2023-05-10T01:26:55.937307+0000","last_became_peered":"2023-05-10T01:26:55.937307+0000","last_unstale":"2023-05-10T01:26:56.316468+0000","last_undegraded":"2023-05-10T01:26:56.316468+0000","last_fullsized":"2023-05-10T01:26:56.316468+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341488+0000","last_change":"2023-05-10T01:26:56.334881+0000","last_active":"2023-05-10T01:26:56.341488+0000","last_peered":"2023-05-10T01:26:56.341488+0000","last_clean":"2023-05-10T01:26:56.341488+0000","last_became_active":"2023-05-10T01:26:56.334105+0000","last_became_peered":"2023-05-10T01:26:56.334105+0000","last_unstale":"2023-05-10T01:26:56.341488+0000","last_undegraded":"2023-05-10T01:26:56.341488+0000","last_fullsized":"2023-05-10T01:26:56.341488+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315515+0000","last_change":"2023-05-10T01:26:55.932193+0000","last_active":"2023-05-10T01:26:56.315515+0000","last_peered":"2023-05-10T01:26:56.315515+0000","last_clean":"2023-05-10T01:26:56.315515+0000","last_became_active":"2023-05-10T01:26:55.931893+0000","last_became_peered":"2023-05-10T01:26:55.931893+0000","last_unstale":"2023-05-10T01:26:56.315515+0000","last_undegraded":"2023-05-10T01:26:56.315515+0000","last_fullsized":"2023-05-10T01:26:56.315515+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331911+0000","last_change":"2023-05-10T01:26:56.327471+0000","last_active":"2023-05-10T01:26:56.331911+0000","last_peered":"2023-05-10T01:26:56.331911+0000","last_clean":"2023-05-10T01:26:56.331911+0000","last_became_active":"2023-05-10T01:26:56.327240+0000","last_became_peered":"2023-05-10T01:26:56.327240+0000","last_unstale":"2023-05-10T01:26:56.331911+0000","last_undegraded":"2023-05-10T01:26:56.331911+0000","last_fullsized":"2023-05-10T01:26:56.331911+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316272+0000","last_change":"2023-05-10T01:26:55.938761+0000","last_active":"2023-05-10T01:26:56.316272+0000","last_peered":"2023-05-10T01:26:56.316272+0000","last_clean":"2023-05-10T01:26:56.316272+0000","last_became_active":"2023-05-10T01:26:55.938270+0000","last_became_peered":"2023-05-10T01:26:55.938270+0000","last_unstale":"2023-05-10T01:26:56.316272+0000","last_undegraded":"2023-05-10T01:26:56.316272+0000","last_fullsized":"2023-05-10T01:26:56.316272+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.335716+0000","last_change":"2023-05-10T01:26:56.327764+0000","last_active":"2023-05-10T01:26:56.335716+0000","last_peered":"2023-05-10T01:26:56.335716+0000","last_clean":"2023-05-10T01:26:56.335716+0000","last_became_active":"2023-05-10T01:26:56.327014+0000","last_became_peered":"2023-05-10T01:26:56.327014+0000","last_unstale":"2023-05-10T01:26:56.335716+0000","last_undegraded":"2023-05-10T01:26:56.335716+0000","last_fullsized":"2023-05-10T01:26:56.335716+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.323086+0000","last_change":"2023-05-10T01:26:55.935959+0000","last_active":"2023-05-10T01:26:56.323086+0000","last_peered":"2023-05-10T01:26:56.323086+0000","last_clean":"2023-05-10T01:26:56.323086+0000","last_became_active":"2023-05-10T01:26:55.935550+0000","last_became_peered":"2023-05-10T01:26:55.935550+0000","last_unstale":"2023-05-10T01:26:56.323086+0000","last_undegraded":"2023-05-10T01:26:56.323086+0000","last_fullsized":"2023-05-10T01:26:56.323086+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337972+0000","last_change":"2023-05-10T01:26:56.332119+0000","last_active":"2023-05-10T01:26:56.337972+0000","last_peered":"2023-05-10T01:26:56.337972+0000","last_clean":"2023-05-10T01:26:56.337972+0000","last_became_active":"2023-05-10T01:26:56.331863+0000","last_became_peered":"2023-05-10T01:26:56.331863+0000","last_unstale":"2023-05-10T01:26:56.337972+0000","last_undegraded":"2023-05-10T01:26:56.337972+0000","last_fullsized":"2023-05-10T01:26:56.337972+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.314784+0000","last_change":"2023-05-10T01:26:55.941834+0000","last_active":"2023-05-10T01:26:56.314784+0000","last_peered":"2023-05-10T01:26:56.314784+0000","last_clean":"2023-05-10T01:26:56.314784+0000","last_became_active":"2023-05-10T01:26:55.941552+0000","last_became_peered":"2023-05-10T01:26:55.941552+0000","last_unstale":"2023-05-10T01:26:56.314784+0000","last_undegraded":"2023-05-10T01:26:56.314784+0000","last_fullsized":"2023-05-10T01:26:56.314784+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.322005+0000","last_change":"2023-05-10T01:26:56.320322+0000","last_active":"2023-05-10T01:26:56.322005+0000","last_peered":"2023-05-10T01:26:56.322005+0000","last_clean":"2023-05-10T01:26:56.322005+0000","last_became_active":"2023-05-10T01:26:56.320031+0000","last_became_peered":"2023-05-10T01:26:56.320031+0000","last_unstale":"2023-05-10T01:26:56.322005+0000","last_undegraded":"2023-05-10T01:26:56.322005+0000","last_fullsized":"2023-05-10T01:26:56.322005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.314899+0000","last_change":"2023-05-10T01:26:55.923827+0000","last_active":"2023-05-10T01:26:56.314899+0000","last_peered":"2023-05-10T01:26:56.314899+0000","last_clean":"2023-05-10T01:26:56.314899+0000","last_became_active":"2023-05-10T01:26:55.923537+0000","last_became_peered":"2023-05-10T01:26:55.923537+0000","last_unstale":"2023-05-10T01:26:56.314899+0000","last_undegraded":"2023-05-10T01:26:56.314899+0000","last_fullsized":"2023-05-10T01:26:56.314899+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332195+0000","last_change":"2023-05-10T01:26:56.327890+0000","last_active":"2023-05-10T01:26:56.332195+0000","last_peered":"2023-05-10T01:26:56.332195+0000","last_clean":"2023-05-10T01:26:56.332195+0000","last_became_active":"2023-05-10T01:26:56.327168+0000","last_became_peered":"2023-05-10T01:26:56.327168+0000","last_unstale":"2023-05-10T01:26:56.332195+0000","last_undegraded":"2023-05-10T01:26:56.332195+0000","last_fullsized":"2023-05-10T01:26:56.332195+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316191+0000","last_change":"2023-05-10T01:26:55.943712+0000","last_active":"2023-05-10T01:26:56.316191+0000","last_peered":"2023-05-10T01:26:56.316191+0000","last_clean":"2023-05-10T01:26:56.316191+0000","last_became_active":"2023-05-10T01:26:55.943443+0000","last_became_peered":"2023-05-10T01:26:55.943443+0000","last_unstale":"2023-05-10T01:26:56.316191+0000","last_undegraded":"2023-05-10T01:26:56.316191+0000","last_fullsized":"2023-05-10T01:26:56.316191+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331467+0000","last_change":"2023-05-10T01:26:56.326427+0000","last_active":"2023-05-10T01:26:56.331467+0000","last_peered":"2023-05-10T01:26:56.331467+0000","last_clean":"2023-05-10T01:26:56.331467+0000","last_became_active":"2023-05-10T01:26:56.326148+0000","last_became_peered":"2023-05-10T01:26:56.326148+0000","last_unstale":"2023-05-10T01:26:56.331467+0000","last_undegraded":"2023-05-10T01:26:56.331467+0000","last_fullsized":"2023-05-10T01:26:56.331467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.312127+0000","last_change":"2023-05-10T01:26:55.931734+0000","last_active":"2023-05-10T01:26:56.312127+0000","last_peered":"2023-05-10T01:26:56.312127+0000","last_clean":"2023-05-10T01:26:56.312127+0000","last_became_active":"2023-05-10T01:26:55.931449+0000","last_became_peered":"2023-05-10T01:26:55.931449+0000","last_unstale":"2023-05-10T01:26:56.312127+0000","last_undegraded":"2023-05-10T01:26:56.312127+0000","last_fullsized":"2023-05-10T01:26:56.312127+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337323+0000","last_change":"2023-05-10T01:26:56.328888+0000","last_active":"2023-05-10T01:26:56.337323+0000","last_peered":"2023-05-10T01:26:56.337323+0000","last_clean":"2023-05-10T01:26:56.337323+0000","last_became_active":"2023-05-10T01:26:56.328618+0000","last_became_peered":"2023-05-10T01:26:56.328618+0000","last_unstale":"2023-05-10T01:26:56.337323+0000","last_undegraded":"2023-05-10T01:26:56.337323+0000","last_fullsized":"2023-05-10T01:26:56.337323+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315951+0000","last_change":"2023-05-10T01:26:55.934469+0000","last_active":"2023-05-10T01:26:56.315951+0000","last_peered":"2023-05-10T01:26:56.315951+0000","last_clean":"2023-05-10T01:26:56.315951+0000","last_became_active":"2023-05-10T01:26:55.933946+0000","last_became_peered":"2023-05-10T01:26:55.933946+0000","last_unstale":"2023-05-10T01:26:56.315951+0000","last_undegraded":"2023-05-10T01:26:56.315951+0000","last_fullsized":"2023-05-10T01:26:56.315951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.338353+0000","last_change":"2023-05-10T01:26:56.333047+0000","last_active":"2023-05-10T01:26:56.338353+0000","last_peered":"2023-05-10T01:26:56.338353+0000","last_clean":"2023-05-10T01:26:56.338353+0000","last_became_active":"2023-05-10T01:26:56.332769+0000","last_became_peered":"2023-05-10T01:26:56.332769+0000","last_unstale":"2023-05-10T01:26:56.338353+0000","last_undegraded":"2023-05-10T01:26:56.338353+0000","last_fullsized":"2023-05-10T01:26:56.338353+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.310797+0000","last_change":"2023-05-10T01:26:55.922702+0000","last_active":"2023-05-10T01:26:56.310797+0000","last_peered":"2023-05-10T01:26:56.310797+0000","last_clean":"2023-05-10T01:26:56.310797+0000","last_became_active":"2023-05-10T01:26:55.922416+0000","last_became_peered":"2023-05-10T01:26:55.922416+0000","last_unstale":"2023-05-10T01:26:56.310797+0000","last_undegraded":"2023-05-10T01:26:56.310797+0000","last_fullsized":"2023-05-10T01:26:56.310797+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332518+0000","last_change":"2023-05-10T01:26:56.327150+0000","last_active":"2023-05-10T01:26:56.332518+0000","last_peered":"2023-05-10T01:26:56.332518+0000","last_clean":"2023-05-10T01:26:56.332518+0000","last_became_active":"2023-05-10T01:26:56.326873+0000","last_became_peered":"2023-05-10T01:26:56.326873+0000","last_unstale":"2023-05-10T01:26:56.332518+0000","last_undegraded":"2023-05-10T01:26:56.332518+0000","last_fullsized":"2023-05-10T01:26:56.332518+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336475+0000","last_change":"2023-05-10T01:26:55.934168+0000","last_active":"2023-05-10T01:26:56.336475+0000","last_peered":"2023-05-10T01:26:56.336475+0000","last_clean":"2023-05-10T01:26:56.336475+0000","last_became_active":"2023-05-10T01:26:55.933877+0000","last_became_peered":"2023-05-10T01:26:55.933877+0000","last_unstale":"2023-05-10T01:26:56.336475+0000","last_undegraded":"2023-05-10T01:26:56.336475+0000","last_fullsized":"2023-05-10T01:26:56.336475+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.328054+0000","last_change":"2023-05-10T01:26:56.324065+0000","last_active":"2023-05-10T01:26:56.328054+0000","last_peered":"2023-05-10T01:26:56.328054+0000","last_clean":"2023-05-10T01:26:56.328054+0000","last_became_active":"2023-05-10T01:26:56.323758+0000","last_became_peered":"2023-05-10T01:26:56.323758+0000","last_unstale":"2023-05-10T01:26:56.328054+0000","last_undegraded":"2023-05-10T01:26:56.328054+0000","last_fullsized":"2023-05-10T01:26:56.328054+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.334158+0000","last_change":"2023-05-10T01:26:55.922703+0000","last_active":"2023-05-10T01:26:56.334158+0000","last_peered":"2023-05-10T01:26:56.334158+0000","last_clean":"2023-05-10T01:26:56.334158+0000","last_became_active":"2023-05-10T01:26:55.922402+0000","last_became_peered":"2023-05-10T01:26:55.922402+0000","last_unstale":"2023-05-10T01:26:56.334158+0000","last_undegraded":"2023-05-10T01:26:56.334158+0000","last_fullsized":"2023-05-10T01:26:56.334158+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.338781+0000","last_change":"2023-05-10T01:26:56.334747+0000","last_active":"2023-05-10T01:26:56.338781+0000","last_peered":"2023-05-10T01:26:56.338781+0000","last_clean":"2023-05-10T01:26:56.338781+0000","last_became_active":"2023-05-10T01:26:56.334424+0000","last_became_peered":"2023-05-10T01:26:56.334424+0000","last_unstale":"2023-05-10T01:26:56.338781+0000","last_undegraded":"2023-05-10T01:26:56.338781+0000","last_fullsized":"2023-05-10T01:26:56.338781+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.339926+0000","last_change":"2023-05-10T01:26:55.938479+0000","last_active":"2023-05-10T01:26:56.339926+0000","last_peered":"2023-05-10T01:26:56.339926+0000","last_clean":"2023-05-10T01:26:56.339926+0000","last_became_active":"2023-05-10T01:26:55.938175+0000","last_became_peered":"2023-05-10T01:26:55.938175+0000","last_unstale":"2023-05-10T01:26:56.339926+0000","last_undegraded":"2023-05-10T01:26:56.339926+0000","last_fullsized":"2023-05-10T01:26:56.339926+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.342011+0000","last_change":"2023-05-10T01:26:56.340322+0000","last_active":"2023-05-10T01:26:56.342011+0000","last_peered":"2023-05-10T01:26:56.342011+0000","last_clean":"2023-05-10T01:26:56.342011+0000","last_became_active":"2023-05-10T01:26:56.340060+0000","last_became_peered":"2023-05-10T01:26:56.340060+0000","last_unstale":"2023-05-10T01:26:56.342011+0000","last_undegraded":"2023-05-10T01:26:56.342011+0000","last_fullsized":"2023-05-10T01:26:56.342011+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.313353+0000","last_change":"2023-05-10T01:26:55.931453+0000","last_active":"2023-05-10T01:26:56.313353+0000","last_peered":"2023-05-10T01:26:56.313353+0000","last_clean":"2023-05-10T01:26:56.313353+0000","last_became_active":"2023-05-10T01:26:55.931157+0000","last_became_peered":"2023-05-10T01:26:55.931157+0000","last_unstale":"2023-05-10T01:26:56.313353+0000","last_undegraded":"2023-05-10T01:26:56.313353+0000","last_fullsized":"2023-05-10T01:26:56.313353+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332580+0000","last_change":"2023-05-10T01:26:56.328663+0000","last_active":"2023-05-10T01:26:56.332580+0000","last_peered":"2023-05-10T01:26:56.332580+0000","last_clean":"2023-05-10T01:26:56.332580+0000","last_became_active":"2023-05-10T01:26:56.328373+0000","last_became_peered":"2023-05-10T01:26:56.328373+0000","last_unstale":"2023-05-10T01:26:56.332580+0000","last_undegraded":"2023-05-10T01:26:56.332580+0000","last_fullsized":"2023-05-10T01:26:56.332580+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316234+0000","last_change":"2023-05-10T01:26:55.940400+0000","last_active":"2023-05-10T01:26:56.316234+0000","last_peered":"2023-05-10T01:26:56.316234+0000","last_clean":"2023-05-10T01:26:56.316234+0000","last_became_active":"2023-05-10T01:26:55.940092+0000","last_became_peered":"2023-05-10T01:26:55.940092+0000","last_unstale":"2023-05-10T01:26:56.316234+0000","last_undegraded":"2023-05-10T01:26:56.316234+0000","last_fullsized":"2023-05-10T01:26:56.316234+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331813+0000","last_change":"2023-05-10T01:26:56.326584+0000","last_active":"2023-05-10T01:26:56.331813+0000","last_peered":"2023-05-10T01:26:56.331813+0000","last_clean":"2023-05-10T01:26:56.331813+0000","last_became_active":"2023-05-10T01:26:56.326302+0000","last_became_peered":"2023-05-10T01:26:56.326302+0000","last_unstale":"2023-05-10T01:26:56.331813+0000","last_undegraded":"2023-05-10T01:26:56.331813+0000","last_fullsized":"2023-05-10T01:26:56.331813+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315595+0000","last_change":"2023-05-10T01:26:55.929754+0000","last_active":"2023-05-10T01:26:56.315595+0000","last_peered":"2023-05-10T01:26:56.315595+0000","last_clean":"2023-05-10T01:26:56.315595+0000","last_became_active":"2023-05-10T01:26:55.927443+0000","last_became_peered":"2023-05-10T01:26:55.927443+0000","last_unstale":"2023-05-10T01:26:56.315595+0000","last_undegraded":"2023-05-10T01:26:56.315595+0000","last_fullsized":"2023-05-10T01:26:56.315595+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337675+0000","last_change":"2023-05-10T01:26:56.331780+0000","last_active":"2023-05-10T01:26:56.337675+0000","last_peered":"2023-05-10T01:26:56.337675+0000","last_clean":"2023-05-10T01:26:56.337675+0000","last_became_active":"2023-05-10T01:26:56.331542+0000","last_became_peered":"2023-05-10T01:26:56.331542+0000","last_unstale":"2023-05-10T01:26:56.337675+0000","last_undegraded":"2023-05-10T01:26:56.337675+0000","last_fullsized":"2023-05-10T01:26:56.337675+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.312920+0000","last_change":"2023-05-10T01:26:55.933417+0000","last_active":"2023-05-10T01:26:56.312920+0000","last_peered":"2023-05-10T01:26:56.312920+0000","last_clean":"2023-05-10T01:26:56.312920+0000","last_became_active":"2023-05-10T01:26:55.930695+0000","last_became_peered":"2023-05-10T01:26:55.930695+0000","last_unstale":"2023-05-10T01:26:56.312920+0000","last_undegraded":"2023-05-10T01:26:56.312920+0000","last_fullsized":"2023-05-10T01:26:56.312920+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332620+0000","last_change":"2023-05-10T01:26:56.326173+0000","last_active":"2023-05-10T01:26:56.332620+0000","last_peered":"2023-05-10T01:26:56.332620+0000","last_clean":"2023-05-10T01:26:56.332620+0000","last_became_active":"2023-05-10T01:26:56.325904+0000","last_became_peered":"2023-05-10T01:26:56.325904+0000","last_unstale":"2023-05-10T01:26:56.332620+0000","last_undegraded":"2023-05-10T01:26:56.332620+0000","last_fullsized":"2023-05-10T01:26:56.332620+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315286+0000","last_change":"2023-05-10T01:26:55.933548+0000","last_active":"2023-05-10T01:26:56.315286+0000","last_peered":"2023-05-10T01:26:56.315286+0000","last_clean":"2023-05-10T01:26:56.315286+0000","last_became_active":"2023-05-10T01:26:55.933252+0000","last_became_peered":"2023-05-10T01:26:55.933252+0000","last_unstale":"2023-05-10T01:26:56.315286+0000","last_undegraded":"2023-05-10T01:26:56.315286+0000","last_fullsized":"2023-05-10T01:26:56.315286+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336117+0000","last_change":"2023-05-10T01:26:56.332104+0000","last_active":"2023-05-10T01:26:56.336117+0000","last_peered":"2023-05-10T01:26:56.336117+0000","last_clean":"2023-05-10T01:26:56.336117+0000","last_became_active":"2023-05-10T01:26:56.331421+0000","last_became_peered":"2023-05-10T01:26:56.331421+0000","last_unstale":"2023-05-10T01:26:56.336117+0000","last_undegraded":"2023-05-10T01:26:56.336117+0000","last_fullsized":"2023-05-10T01:26:56.336117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.333709+0000","last_change":"2023-05-10T01:26:55.945200+0000","last_active":"2023-05-10T01:26:56.333709+0000","last_peered":"2023-05-10T01:26:56.333709+0000","last_clean":"2023-05-10T01:26:56.333709+0000","last_became_active":"2023-05-10T01:26:55.944858+0000","last_became_peered":"2023-05-10T01:26:55.944858+0000","last_unstale":"2023-05-10T01:26:56.333709+0000","last_undegraded":"2023-05-10T01:26:56.333709+0000","last_fullsized":"2023-05-10T01:26:56.333709+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330130+0000","last_change":"2023-05-10T01:26:56.325067+0000","last_active":"2023-05-10T01:26:56.330130+0000","last_peered":"2023-05-10T01:26:56.330130+0000","last_clean":"2023-05-10T01:26:56.330130+0000","last_became_active":"2023-05-10T01:26:56.324743+0000","last_became_peered":"2023-05-10T01:26:56.324743+0000","last_unstale":"2023-05-10T01:26:56.330130+0000","last_undegraded":"2023-05-10T01:26:56.330130+0000","last_fullsized":"2023-05-10T01:26:56.330130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.335892+0000","last_change":"2023-05-10T01:26:55.941468+0000","last_active":"2023-05-10T01:26:56.335892+0000","last_peered":"2023-05-10T01:26:56.335892+0000","last_clean":"2023-05-10T01:26:56.335892+0000","last_became_active":"2023-05-10T01:26:55.941182+0000","last_became_peered":"2023-05-10T01:26:55.941182+0000","last_unstale":"2023-05-10T01:26:56.335892+0000","last_undegraded":"2023-05-10T01:26:56.335892+0000","last_fullsized":"2023-05-10T01:26:56.335892+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332481+0000","last_change":"2023-05-10T01:26:56.330943+0000","last_active":"2023-05-10T01:26:56.332481+0000","last_peered":"2023-05-10T01:26:56.332481+0000","last_clean":"2023-05-10T01:26:56.332481+0000","last_became_active":"2023-05-10T01:26:56.330634+0000","last_became_peered":"2023-05-10T01:26:56.330634+0000","last_unstale":"2023-05-10T01:26:56.332481+0000","last_undegraded":"2023-05-10T01:26:56.332481+0000","last_fullsized":"2023-05-10T01:26:56.332481+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.326726+0000","last_change":"2023-05-10T01:26:55.933406+0000","last_active":"2023-05-10T01:26:56.326726+0000","last_peered":"2023-05-10T01:26:56.326726+0000","last_clean":"2023-05-10T01:26:56.326726+0000","last_became_active":"2023-05-10T01:26:55.933051+0000","last_became_peered":"2023-05-10T01:26:55.933051+0000","last_unstale":"2023-05-10T01:26:56.326726+0000","last_undegraded":"2023-05-10T01:26:56.326726+0000","last_fullsized":"2023-05-10T01:26:56.326726+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332393+0000","last_change":"2023-05-10T01:26:56.325976+0000","last_active":"2023-05-10T01:26:56.332393+0000","last_peered":"2023-05-10T01:26:56.332393+0000","last_clean":"2023-05-10T01:26:56.332393+0000","last_became_active":"2023-05-10T01:26:56.325700+0000","last_became_peered":"2023-05-10T01:26:56.325700+0000","last_unstale":"2023-05-10T01:26:56.332393+0000","last_undegraded":"2023-05-10T01:26:56.332393+0000","last_fullsized":"2023-05-10T01:26:56.332393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.322469+0000","last_change":"2023-05-10T01:26:55.946273+0000","last_active":"2023-05-10T01:26:56.322469+0000","last_peered":"2023-05-10T01:26:56.322469+0000","last_clean":"2023-05-10T01:26:56.322469+0000","last_became_active":"2023-05-10T01:26:55.946014+0000","last_became_peered":"2023-05-10T01:26:55.946014+0000","last_unstale":"2023-05-10T01:26:56.322469+0000","last_undegraded":"2023-05-10T01:26:56.322469+0000","last_fullsized":"2023-05-10T01:26:56.322469+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336630+0000","last_change":"2023-05-10T01:26:56.334337+0000","last_active":"2023-05-10T01:26:56.336630+0000","last_peered":"2023-05-10T01:26:56.336630+0000","last_clean":"2023-05-10T01:26:56.336630+0000","last_became_active":"2023-05-10T01:26:56.334052+0000","last_became_peered":"2023-05-10T01:26:56.334052+0000","last_unstale":"2023-05-10T01:26:56.336630+0000","last_undegraded":"2023-05-10T01:26:56.336630+0000","last_fullsized":"2023-05-10T01:26:56.336630+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336729+0000","last_change":"2023-05-10T01:26:55.935401+0000","last_active":"2023-05-10T01:26:56.336729+0000","last_peered":"2023-05-10T01:26:56.336729+0000","last_clean":"2023-05-10T01:26:56.336729+0000","last_became_active":"2023-05-10T01:26:55.934433+0000","last_became_peered":"2023-05-10T01:26:55.934433+0000","last_unstale":"2023-05-10T01:26:56.336729+0000","last_undegraded":"2023-05-10T01:26:56.336729+0000","last_fullsized":"2023-05-10T01:26:56.336729+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337344+0000","last_change":"2023-05-10T01:26:56.331149+0000","last_active":"2023-05-10T01:26:56.337344+0000","last_peered":"2023-05-10T01:26:56.337344+0000","last_clean":"2023-05-10T01:26:56.337344+0000","last_became_active":"2023-05-10T01:26:56.330913+0000","last_became_peered":"2023-05-10T01:26:56.330913+0000","last_unstale":"2023-05-10T01:26:56.337344+0000","last_undegraded":"2023-05-10T01:26:56.337344+0000","last_fullsized":"2023-05-10T01:26:56.337344+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.320840+0000","last_change":"2023-05-10T01:26:55.940765+0000","last_active":"2023-05-10T01:26:56.320840+0000","last_peered":"2023-05-10T01:26:56.320840+0000","last_clean":"2023-05-10T01:26:56.320840+0000","last_became_active":"2023-05-10T01:26:55.940490+0000","last_became_peered":"2023-05-10T01:26:55.940490+0000","last_unstale":"2023-05-10T01:26:56.320840+0000","last_undegraded":"2023-05-10T01:26:56.320840+0000","last_fullsized":"2023-05-10T01:26:56.320840+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330121+0000","last_change":"2023-05-10T01:26:56.326265+0000","last_active":"2023-05-10T01:26:56.330121+0000","last_peered":"2023-05-10T01:26:56.330121+0000","last_clean":"2023-05-10T01:26:56.330121+0000","last_became_active":"2023-05-10T01:26:56.326045+0000","last_became_peered":"2023-05-10T01:26:56.326045+0000","last_unstale":"2023-05-10T01:26:56.330121+0000","last_undegraded":"2023-05-10T01:26:56.330121+0000","last_fullsized":"2023-05-10T01:26:56.330121+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.318817+0000","last_change":"2023-05-10T01:26:55.939305+0000","last_active":"2023-05-10T01:26:56.318817+0000","last_peered":"2023-05-10T01:26:56.318817+0000","last_clean":"2023-05-10T01:26:56.318817+0000","last_became_active":"2023-05-10T01:26:55.938986+0000","last_became_peered":"2023-05-10T01:26:55.938986+0000","last_unstale":"2023-05-10T01:26:56.318817+0000","last_undegraded":"2023-05-10T01:26:56.318817+0000","last_fullsized":"2023-05-10T01:26:56.318817+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336145+0000","last_change":"2023-05-10T01:26:56.332835+0000","last_active":"2023-05-10T01:26:56.336145+0000","last_peered":"2023-05-10T01:26:56.336145+0000","last_clean":"2023-05-10T01:26:56.336145+0000","last_became_active":"2023-05-10T01:26:56.332176+0000","last_became_peered":"2023-05-10T01:26:56.332176+0000","last_unstale":"2023-05-10T01:26:56.336145+0000","last_undegraded":"2023-05-10T01:26:56.336145+0000","last_fullsized":"2023-05-10T01:26:56.336145+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.320976+0000","last_change":"2023-05-10T01:26:55.940670+0000","last_active":"2023-05-10T01:26:56.320976+0000","last_peered":"2023-05-10T01:26:56.320976+0000","last_clean":"2023-05-10T01:26:56.320976+0000","last_became_active":"2023-05-10T01:26:55.940350+0000","last_became_peered":"2023-05-10T01:26:55.940350+0000","last_unstale":"2023-05-10T01:26:56.320976+0000","last_undegraded":"2023-05-10T01:26:56.320976+0000","last_fullsized":"2023-05-10T01:26:56.320976+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336682+0000","last_change":"2023-05-10T01:26:56.332818+0000","last_active":"2023-05-10T01:26:56.336682+0000","last_peered":"2023-05-10T01:26:56.336682+0000","last_clean":"2023-05-10T01:26:56.336682+0000","last_became_active":"2023-05-10T01:26:56.332278+0000","last_became_peered":"2023-05-10T01:26:56.332278+0000","last_unstale":"2023-05-10T01:26:56.336682+0000","last_undegraded":"2023-05-10T01:26:56.336682+0000","last_fullsized":"2023-05-10T01:26:56.336682+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.334176+0000","last_change":"2023-05-10T01:26:55.943872+0000","last_active":"2023-05-10T01:26:56.334176+0000","last_peered":"2023-05-10T01:26:56.334176+0000","last_clean":"2023-05-10T01:26:56.334176+0000","last_became_active":"2023-05-10T01:26:55.943577+0000","last_became_peered":"2023-05-10T01:26:55.943577+0000","last_unstale":"2023-05-10T01:26:56.334176+0000","last_undegraded":"2023-05-10T01:26:56.334176+0000","last_fullsized":"2023-05-10T01:26:56.334176+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332552+0000","last_change":"2023-05-10T01:26:56.327409+0000","last_active":"2023-05-10T01:26:56.332552+0000","last_peered":"2023-05-10T01:26:56.332552+0000","last_clean":"2023-05-10T01:26:56.332552+0000","last_became_active":"2023-05-10T01:26:56.327162+0000","last_became_peered":"2023-05-10T01:26:56.327162+0000","last_unstale":"2023-05-10T01:26:56.332552+0000","last_undegraded":"2023-05-10T01:26:56.332552+0000","last_fullsized":"2023-05-10T01:26:56.332552+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.322951+0000","last_change":"2023-05-10T01:26:55.942463+0000","last_active":"2023-05-10T01:26:56.322951+0000","last_peered":"2023-05-10T01:26:56.322951+0000","last_clean":"2023-05-10T01:26:56.322951+0000","last_became_active":"2023-05-10T01:26:55.941974+0000","last_became_peered":"2023-05-10T01:26:55.941974+0000","last_unstale":"2023-05-10T01:26:56.322951+0000","last_undegraded":"2023-05-10T01:26:56.322951+0000","last_fullsized":"2023-05-10T01:26:56.322951+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341969+0000","last_change":"2023-05-10T01:26:56.337065+0000","last_active":"2023-05-10T01:26:56.341969+0000","last_peered":"2023-05-10T01:26:56.341969+0000","last_clean":"2023-05-10T01:26:56.341969+0000","last_became_active":"2023-05-10T01:26:56.336725+0000","last_became_peered":"2023-05-10T01:26:56.336725+0000","last_unstale":"2023-05-10T01:26:56.341969+0000","last_undegraded":"2023-05-10T01:26:56.341969+0000","last_fullsized":"2023-05-10T01:26:56.341969+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.321352+0000","last_change":"2023-05-10T01:26:55.942004+0000","last_active":"2023-05-10T01:26:56.321352+0000","last_peered":"2023-05-10T01:26:56.321352+0000","last_clean":"2023-05-10T01:26:56.321352+0000","last_became_active":"2023-05-10T01:26:55.941686+0000","last_became_peered":"2023-05-10T01:26:55.941686+0000","last_unstale":"2023-05-10T01:26:56.321352+0000","last_undegraded":"2023-05-10T01:26:56.321352+0000","last_fullsized":"2023-05-10T01:26:56.321352+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331111+0000","last_change":"2023-05-10T01:26:56.324094+0000","last_active":"2023-05-10T01:26:56.331111+0000","last_peered":"2023-05-10T01:26:56.331111+0000","last_clean":"2023-05-10T01:26:56.331111+0000","last_became_active":"2023-05-10T01:26:56.323826+0000","last_became_peered":"2023-05-10T01:26:56.323826+0000","last_unstale":"2023-05-10T01:26:56.331111+0000","last_undegraded":"2023-05-10T01:26:56.331111+0000","last_fullsized":"2023-05-10T01:26:56.331111+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.318606+0000","last_change":"2023-05-10T01:26:55.943574+0000","last_active":"2023-05-10T01:26:56.318606+0000","last_peered":"2023-05-10T01:26:56.318606+0000","last_clean":"2023-05-10T01:26:56.318606+0000","last_became_active":"2023-05-10T01:26:55.942810+0000","last_became_peered":"2023-05-10T01:26:55.942810+0000","last_unstale":"2023-05-10T01:26:56.318606+0000","last_undegraded":"2023-05-10T01:26:56.318606+0000","last_fullsized":"2023-05-10T01:26:56.318606+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.334832+0000","last_change":"2023-05-10T01:26:56.330382+0000","last_active":"2023-05-10T01:26:56.334832+0000","last_peered":"2023-05-10T01:26:56.334832+0000","last_clean":"2023-05-10T01:26:56.334832+0000","last_became_active":"2023-05-10T01:26:56.328310+0000","last_became_peered":"2023-05-10T01:26:56.328310+0000","last_unstale":"2023-05-10T01:26:56.334832+0000","last_undegraded":"2023-05-10T01:26:56.334832+0000","last_fullsized":"2023-05-10T01:26:56.334832+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316300+0000","last_change":"2023-05-10T01:26:55.938957+0000","last_active":"2023-05-10T01:26:56.316300+0000","last_peered":"2023-05-10T01:26:56.316300+0000","last_clean":"2023-05-10T01:26:56.316300+0000","last_became_active":"2023-05-10T01:26:55.938629+0000","last_became_peered":"2023-05-10T01:26:55.938629+0000","last_unstale":"2023-05-10T01:26:56.316300+0000","last_undegraded":"2023-05-10T01:26:56.316300+0000","last_fullsized":"2023-05-10T01:26:56.316300+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.330185+0000","last_change":"2023-05-10T01:26:56.326006+0000","last_active":"2023-05-10T01:26:56.330185+0000","last_peered":"2023-05-10T01:26:56.330185+0000","last_clean":"2023-05-10T01:26:56.330185+0000","last_became_active":"2023-05-10T01:26:56.325711+0000","last_became_peered":"2023-05-10T01:26:56.325711+0000","last_unstale":"2023-05-10T01:26:56.330185+0000","last_undegraded":"2023-05-10T01:26:56.330185+0000","last_fullsized":"2023-05-10T01:26:56.330185+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.315632+0000","last_change":"2023-05-10T01:26:55.937765+0000","last_active":"2023-05-10T01:26:56.315632+0000","last_peered":"2023-05-10T01:26:56.315632+0000","last_clean":"2023-05-10T01:26:56.315632+0000","last_became_active":"2023-05-10T01:26:55.937413+0000","last_became_peered":"2023-05-10T01:26:55.937413+0000","last_unstale":"2023-05-10T01:26:56.315632+0000","last_undegraded":"2023-05-10T01:26:56.315632+0000","last_fullsized":"2023-05-10T01:26:56.315632+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.336815+0000","last_change":"2023-05-10T01:26:56.330572+0000","last_active":"2023-05-10T01:26:56.336815+0000","last_peered":"2023-05-10T01:26:56.336815+0000","last_clean":"2023-05-10T01:26:56.336815+0000","last_became_active":"2023-05-10T01:26:56.330233+0000","last_became_peered":"2023-05-10T01:26:56.330233+0000","last_unstale":"2023-05-10T01:26:56.336815+0000","last_undegraded":"2023-05-10T01:26:56.336815+0000","last_fullsized":"2023-05-10T01:26:56.336815+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.316048+0000","last_change":"2023-05-10T01:26:55.935608+0000","last_active":"2023-05-10T01:26:56.316048+0000","last_peered":"2023-05-10T01:26:56.316048+0000","last_clean":"2023-05-10T01:26:56.316048+0000","last_became_active":"2023-05-10T01:26:55.935279+0000","last_became_peered":"2023-05-10T01:26:55.935279+0000","last_unstale":"2023-05-10T01:26:56.316048+0000","last_undegraded":"2023-05-10T01:26:56.316048+0000","last_fullsized":"2023-05-10T01:26:56.316048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332630+0000","last_change":"2023-05-10T01:26:56.328068+0000","last_active":"2023-05-10T01:26:56.332630+0000","last_peered":"2023-05-10T01:26:56.332630+0000","last_clean":"2023-05-10T01:26:56.332630+0000","last_became_active":"2023-05-10T01:26:56.327804+0000","last_became_peered":"2023-05-10T01:26:56.327804+0000","last_unstale":"2023-05-10T01:26:56.332630+0000","last_undegraded":"2023-05-10T01:26:56.332630+0000","last_fullsized":"2023-05-10T01:26:56.332630+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.321083+0000","last_change":"2023-05-10T01:26:55.940877+0000","last_active":"2023-05-10T01:26:56.321083+0000","last_peered":"2023-05-10T01:26:56.321083+0000","last_clean":"2023-05-10T01:26:56.321083+0000","last_became_active":"2023-05-10T01:26:55.934817+0000","last_became_peered":"2023-05-10T01:26:55.934817+0000","last_unstale":"2023-05-10T01:26:56.321083+0000","last_undegraded":"2023-05-10T01:26:56.321083+0000","last_fullsized":"2023-05-10T01:26:56.321083+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.335393+0000","last_change":"2023-05-10T01:26:56.328769+0000","last_active":"2023-05-10T01:26:56.335393+0000","last_peered":"2023-05-10T01:26:56.335393+0000","last_clean":"2023-05-10T01:26:56.335393+0000","last_became_active":"2023-05-10T01:26:56.328479+0000","last_became_peered":"2023-05-10T01:26:56.328479+0000","last_unstale":"2023-05-10T01:26:56.335393+0000","last_undegraded":"2023-05-10T01:26:56.335393+0000","last_fullsized":"2023-05-10T01:26:56.335393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.325512+0000","last_change":"2023-05-10T01:26:55.941138+0000","last_active":"2023-05-10T01:26:56.325512+0000","last_peered":"2023-05-10T01:26:56.325512+0000","last_clean":"2023-05-10T01:26:56.325512+0000","last_became_active":"2023-05-10T01:26:55.940843+0000","last_became_peered":"2023-05-10T01:26:55.940843+0000","last_unstale":"2023-05-10T01:26:56.325512+0000","last_undegraded":"2023-05-10T01:26:56.325512+0000","last_fullsized":"2023-05-10T01:26:56.325512+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.314851+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:26:56.314851+0000","last_peered":"2023-05-10T01:26:56.314851+0000","last_clean":"2023-05-10T01:26:56.314851+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:26:56.314851+0000","last_undegraded":"2023-05-10T01:26:56.314851+0000","last_fullsized":"2023-05-10T01:26:56.314851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332750+0000","last_change":"2023-05-10T01:26:56.326769+0000","last_active":"2023-05-10T01:26:56.332750+0000","last_peered":"2023-05-10T01:26:56.332750+0000","last_clean":"2023-05-10T01:26:56.332750+0000","last_became_active":"2023-05-10T01:26:56.326497+0000","last_became_peered":"2023-05-10T01:26:56.326497+0000","last_unstale":"2023-05-10T01:26:56.332750+0000","last_undegraded":"2023-05-10T01:26:56.332750+0000","last_fullsized":"2023-05-10T01:26:56.332750+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.318714+0000","last_change":"2023-05-10T01:26:55.941294+0000","last_active":"2023-05-10T01:26:56.318714+0000","last_peered":"2023-05-10T01:26:56.318714+0000","last_clean":"2023-05-10T01:26:56.318714+0000","last_became_active":"2023-05-10T01:26:55.940852+0000","last_became_peered":"2023-05-10T01:26:55.940852+0000","last_unstale":"2023-05-10T01:26:56.318714+0000","last_undegraded":"2023-05-10T01:26:56.318714+0000","last_fullsized":"2023-05-10T01:26:56.318714+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.313162+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:26:56.313162+0000","last_peered":"2023-05-10T01:26:56.313162+0000","last_clean":"2023-05-10T01:26:56.313162+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:26:56.313162+0000","last_undegraded":"2023-05-10T01:26:56.313162+0000","last_fullsized":"2023-05-10T01:26:56.313162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332605+0000","last_change":"2023-05-10T01:26:56.326947+0000","last_active":"2023-05-10T01:26:56.332605+0000","last_peered":"2023-05-10T01:26:56.332605+0000","last_clean":"2023-05-10T01:26:56.332605+0000","last_became_active":"2023-05-10T01:26:56.326663+0000","last_became_peered":"2023-05-10T01:26:56.326663+0000","last_unstale":"2023-05-10T01:26:56.332605+0000","last_undegraded":"2023-05-10T01:26:56.332605+0000","last_fullsized":"2023-05-10T01:26:56.332605+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.318188+0000","last_change":"2023-05-10T01:26:55.933482+0000","last_active":"2023-05-10T01:26:56.318188+0000","last_peered":"2023-05-10T01:26:56.318188+0000","last_clean":"2023-05-10T01:26:56.318188+0000","last_became_active":"2023-05-10T01:26:55.932726+0000","last_became_peered":"2023-05-10T01:26:55.932726+0000","last_unstale":"2023-05-10T01:26:56.318188+0000","last_undegraded":"2023-05-10T01:26:56.318188+0000","last_fullsized":"2023-05-10T01:26:56.318188+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.322235+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:26:56.322235+0000","last_peered":"2023-05-10T01:26:56.322235+0000","last_clean":"2023-05-10T01:26:56.322235+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:26:56.322235+0000","last_undegraded":"2023-05-10T01:26:56.322235+0000","last_fullsized":"2023-05-10T01:26:56.322235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.341467+0000","last_change":"2023-05-10T01:26:56.334162+0000","last_active":"2023-05-10T01:26:56.341467+0000","last_peered":"2023-05-10T01:26:56.341467+0000","last_clean":"2023-05-10T01:26:56.341467+0000","last_became_active":"2023-05-10T01:26:56.333861+0000","last_became_peered":"2023-05-10T01:26:56.333861+0000","last_unstale":"2023-05-10T01:26:56.341467+0000","last_undegraded":"2023-05-10T01:26:56.341467+0000","last_fullsized":"2023-05-10T01:26:56.341467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337498+0000","last_change":"2023-05-10T01:26:55.929990+0000","last_active":"2023-05-10T01:26:56.337498+0000","last_peered":"2023-05-10T01:26:56.337498+0000","last_clean":"2023-05-10T01:26:56.337498+0000","last_became_active":"2023-05-10T01:26:55.928554+0000","last_became_peered":"2023-05-10T01:26:55.928554+0000","last_unstale":"2023-05-10T01:26:56.337498+0000","last_undegraded":"2023-05-10T01:26:56.337498+0000","last_fullsized":"2023-05-10T01:26:56.337498+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.313323+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:26:56.313323+0000","last_peered":"2023-05-10T01:26:56.313323+0000","last_clean":"2023-05-10T01:26:56.313323+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:26:56.313323+0000","last_undegraded":"2023-05-10T01:26:56.313323+0000","last_fullsized":"2023-05-10T01:26:56.313323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.321286+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:26:56.321286+0000","last_peered":"2023-05-10T01:26:56.321286+0000","last_clean":"2023-05-10T01:26:56.321286+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:26:56.321286+0000","last_undegraded":"2023-05-10T01:26:56.321286+0000","last_fullsized":"2023-05-10T01:26:56.321286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.333447+0000","last_change":"2023-05-10T01:26:56.326650+0000","last_active":"2023-05-10T01:26:56.333447+0000","last_peered":"2023-05-10T01:26:56.333447+0000","last_clean":"2023-05-10T01:26:56.333447+0000","last_became_active":"2023-05-10T01:26:56.326224+0000","last_became_peered":"2023-05-10T01:26:56.326224+0000","last_unstale":"2023-05-10T01:26:56.333447+0000","last_undegraded":"2023-05-10T01:26:56.333447+0000","last_fullsized":"2023-05-10T01:26:56.333447+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337301+0000","last_change":"2023-05-10T01:26:55.934982+0000","last_active":"2023-05-10T01:26:56.337301+0000","last_peered":"2023-05-10T01:26:56.337301+0000","last_clean":"2023-05-10T01:26:56.337301+0000","last_became_active":"2023-05-10T01:26:55.934706+0000","last_became_peered":"2023-05-10T01:26:55.934706+0000","last_unstale":"2023-05-10T01:26:56.337301+0000","last_undegraded":"2023-05-10T01:26:56.337301+0000","last_fullsized":"2023-05-10T01:26:56.337301+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":106,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.321376+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:26:56.321376+0000","last_peered":"2023-05-10T01:26:56.321376+0000","last_clean":"2023-05-10T01:26:56.321376+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:26:56.321376+0000","last_undegraded":"2023-05-10T01:26:56.321376+0000","last_fullsized":"2023-05-10T01:26:56.321376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331270+0000","last_change":"2023-05-10T01:26:56.324249+0000","last_active":"2023-05-10T01:26:56.331270+0000","last_peered":"2023-05-10T01:26:56.331270+0000","last_clean":"2023-05-10T01:26:56.331270+0000","last_became_active":"2023-05-10T01:26:56.323968+0000","last_became_peered":"2023-05-10T01:26:56.323968+0000","last_unstale":"2023-05-10T01:26:56.331270+0000","last_undegraded":"2023-05-10T01:26:56.331270+0000","last_fullsized":"2023-05-10T01:26:56.331270+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.313724+0000","last_change":"2023-05-10T01:26:55.936982+0000","last_active":"2023-05-10T01:26:56.313724+0000","last_peered":"2023-05-10T01:26:56.313724+0000","last_clean":"2023-05-10T01:26:56.313724+0000","last_became_active":"2023-05-10T01:26:55.936690+0000","last_became_peered":"2023-05-10T01:26:55.936690+0000","last_unstale":"2023-05-10T01:26:56.313724+0000","last_undegraded":"2023-05-10T01:26:56.313724+0000","last_fullsized":"2023-05-10T01:26:56.313724+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.326826+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:26:56.326826+0000","last_peered":"2023-05-10T01:26:56.326826+0000","last_clean":"2023-05-10T01:26:56.326826+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:26:56.326826+0000","last_undegraded":"2023-05-10T01:26:56.326826+0000","last_fullsized":"2023-05-10T01:26:56.326826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337233+0000","last_change":"2023-05-10T01:26:56.329111+0000","last_active":"2023-05-10T01:26:56.337233+0000","last_peered":"2023-05-10T01:26:56.337233+0000","last_clean":"2023-05-10T01:26:56.337233+0000","last_became_active":"2023-05-10T01:26:56.328804+0000","last_became_peered":"2023-05-10T01:26:56.328804+0000","last_unstale":"2023-05-10T01:26:56.337233+0000","last_undegraded":"2023-05-10T01:26:56.337233+0000","last_fullsized":"2023-05-10T01:26:56.337233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.337172+0000","last_change":"2023-05-10T01:26:55.931142+0000","last_active":"2023-05-10T01:26:56.337172+0000","last_peered":"2023-05-10T01:26:56.337172+0000","last_clean":"2023-05-10T01:26:56.337172+0000","last_became_active":"2023-05-10T01:26:55.930906+0000","last_became_peered":"2023-05-10T01:26:55.930906+0000","last_unstale":"2023-05-10T01:26:56.337172+0000","last_undegraded":"2023-05-10T01:26:56.337172+0000","last_fullsized":"2023-05-10T01:26:56.337172+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.319127+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:26:56.319127+0000","last_peered":"2023-05-10T01:26:56.319127+0000","last_clean":"2023-05-10T01:26:56.319127+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:26:56.319127+0000","last_undegraded":"2023-05-10T01:26:56.319127+0000","last_fullsized":"2023-05-10T01:26:56.319127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.332373+0000","last_change":"2023-05-10T01:26:56.325658+0000","last_active":"2023-05-10T01:26:56.332373+0000","last_peered":"2023-05-10T01:26:56.332373+0000","last_clean":"2023-05-10T01:26:56.332373+0000","last_became_active":"2023-05-10T01:26:56.325311+0000","last_became_peered":"2023-05-10T01:26:56.325311+0000","last_unstale":"2023-05-10T01:26:56.332373+0000","last_undegraded":"2023-05-10T01:26:56.332373+0000","last_fullsized":"2023-05-10T01:26:56.332373+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:55.908809+0000","last_clean_scrub_stamp":"2023-05-10T01:26:55.908809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.331217+0000","last_change":"2023-05-10T01:26:55.943150+0000","last_active":"2023-05-10T01:26:56.331217+0000","last_peered":"2023-05-10T01:26:56.331217+0000","last_clean":"2023-05-10T01:26:56.331217+0000","last_became_active":"2023-05-10T01:26:55.942845+0000","last_became_peered":"2023-05-10T01:26:55.942845+0000","last_unstale":"2023-05-10T01:26:56.331217+0000","last_undegraded":"2023-05-10T01:26:56.331217+0000","last_fullsized":"2023-05-10T01:26:56.331217+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:26:54.907139+0000","last_clean_scrub_stamp":"2023-05-10T01:26:54.907139+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-05-10T01:26:56.325600+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:26:56.325600+0000","last_peered":"2023-05-10T01:26:56.325600+0000","last_clean":"2023-05-10T01:26:56.325600+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:26:56.325600+0000","last_undegraded":"2023-05-10T01:26:56.325600+0000","last_fullsized":"2023-05-10T01:26:56.325600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19076,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":17408,"kb_avail":94352764,"statfs":{"total":96636764160,"available":96617230336,"internally_reserved":0,"allocated":1699840,"data_stored":860644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17825792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.314,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.81599999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.747},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59199999999999997,"15min":0.61699999999999999},"min":{"1min":0.42499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":3.016,"15min":3.016},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.753},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70199999999999996}]},{"osd":4,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.442,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.751},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.748,"15min":0.83399999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18492,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":16832,"kb_avail":94353348,"statfs":{"total":96636764160,"available":96617828352,"internally_reserved":0,"allocated":1691648,"data_stored":861004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17235968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.67600000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.439},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54000000000000004,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90600000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"max":{"1min":0.753,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.83599999999999997,"15min":0.86299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.55300000000000005,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.627},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.81699999999999995},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28799999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.496,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53000000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86799999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22588,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":20928,"kb_avail":94349252,"statfs":{"total":96636764160,"available":96613634048,"internally_reserved":0,"allocated":1691648,"data_stored":860472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21430272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36099999999999999,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47599999999999998,"5min":0.64100000000000001,"15min":0.65000000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.63500000000000001,"15min":0.77800000000000002},"last":0.248}]},{"osd":2,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.245,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55100000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.59399999999999997,"5min":0.70999999999999996,"15min":0.84999999999999998},"last":0.32800000000000001}]},{"osd":3,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56200000000000006,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39300000000000002,"15min":0.42499999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.71499999999999997},"last":0.311}]},{"osd":4,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":1.117},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":1.05},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.93600000000000005,"15min":1.3839999999999999},"last":0.5}]},{"osd":6,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":1.319},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86799999999999999,"5min":0.97799999999999998,"15min":1.079},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed May 10 01:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63300000000000001,"15min":0.66600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":1.024,"15min":1.0960000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":1.3600000000000001},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":16576,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":1699840,"data_stored":861918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16973824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.751,"15min":0.751},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39000000000000001,"15min":0.41799999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59899999999999998,"5min":0.66800000000000004,"15min":0.72399999999999998},"last":0.318}]},{"osd":2,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84099999999999997},"last":0.41999999999999998}]},{"osd":3,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.85799999999999998},"last":0.437}]},{"osd":4,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.374},"max":{"1min":0.83599999999999997,"5min":0.94099999999999995,"15min":1.2729999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.82999999999999996,"5min":0.89700000000000002,"15min":1.2989999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.2470000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":1.224},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.68400000000000005},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88700000000000001,"5min":1.0800000000000001,"15min":1.1559999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.68700000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":1.3200000000000001},"last":0.627}]},{"osd":7,"last update":"Wed May 10 01:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83599999999999997,"5min":0.98599999999999999,"15min":1.139},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":0.93600000000000005,"15min":1.353},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23616,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94348224,"statfs":{"total":96636764160,"available":96612581376,"internally_reserved":0,"allocated":1695744,"data_stored":861412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.499,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.249},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42599999999999999,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.26500000000000001},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.76500000000000001},"last":0.379}]},{"osd":1,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.65600000000000003,"15min":0.70199999999999996},"last":0.309},{"interface":"front","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.69799999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.45200000000000001,"15min":0.47299999999999998},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55100000000000005,"5min":0.72499999999999998,"15min":0.75},"last":0.441}]},{"osd":4,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.012},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.94699999999999995},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.626,"15min":0.65500000000000003},"min":{"1min":0.42299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.1899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.90700000000000003,"15min":0.94799999999999995},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.93300000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.67800000000000005},"min":{"1min":0.45100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed May 10 01:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64000000000000001,"15min":0.66800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":1.034},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.67800000000000005},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26628,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":24960,"kb_avail":94345212,"statfs":{"total":96636764160,"available":96609497088,"internally_reserved":0,"allocated":1699840,"data_stored":861128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25559040},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.55300000000000005,"5min":1.742,"15min":1.742},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.57399999999999995,"5min":1.76,"15min":1.76},"last":0.35899999999999999}]},{"osd":1,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.379,"15min":0.39400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":1.893,"15min":1.893},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.441},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":1.772,"15min":1.772},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.29499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":1.921,"15min":1.921},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58199999999999996,"5min":1.8,"15min":1.8},"last":0.315}]},{"osd":4,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83199999999999996,"5min":1.837,"15min":1.837},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.50700000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81799999999999995,"5min":1.671,"15min":1.671},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.865,"15min":1.865},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Wed May 10 01:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18880,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":17216,"kb_avail":94352960,"statfs":{"total":96636764160,"available":96617431040,"internally_reserved":0,"allocated":1695744,"data_stored":861094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17629184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.76000000000000001,"5min":0.81699999999999995,"15min":0.86399999999999999},"last":1.821},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54300000000000004,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.313},"max":{"1min":0.63400000000000001,"5min":1.337,"15min":1.337},"last":0.70999999999999996}]},{"osd":1,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.782},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":1.758}]},{"osd":2,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.8380000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.63200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64800000000000002,"5min":0.748,"15min":0.83099999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.82199999999999995,"15min":0.84899999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76400000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.751,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.82699999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.83899999999999997,"15min":0.89400000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed May 10 01:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.871,"15min":0.871},"last":0.60799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575051,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21884,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":20224,"kb_avail":94349956,"statfs":{"total":96636764160,"available":96614354944,"internally_reserved":0,"allocated":1691648,"data_stored":860540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20709376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":1.716,"15min":1.716},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":1.946,"15min":1.946},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.372,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.86299999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.81699999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84699999999999998,"5min":1.615,"15min":1.615},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81499999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.625}]},{"osd":4,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61399999999999999,"5min":0.70499999999999996,"15min":0.82799999999999996},"last":0.372},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.48799999999999999},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64000000000000001,"5min":0.69399999999999995,"15min":0.75900000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.28599999999999998,"15min":0.28399999999999997},"max":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed May 10 01:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79100000000000004,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.46600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:27:05.265 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:27:05.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:27:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.417+0000 7fa811755700 1 Processor -- start 2023-05-10T01:27:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.417+0000 7fa811755700 1 -- start start 2023-05-10T01:27:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c154110 0x7fa80c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa80c0cb410 0x7fa80c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa80c155570 0x7fa80c068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0c6830 con 0x7fa80c0cb410 2023-05-10T01:27:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c1550e0 con 0x7fa80c155570 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa811755700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0c6550 con 0x7fa80c154110 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa80c0cb410 0x7fa80c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa80c0cb410 0x7fa80c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39828/0 (socket says 172.21.15.52:39828) 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 -- 172.21.15.52:0/3925409064 learned_addr learned my addr 172.21.15.52:0/3925409064 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80affd700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c154110 0x7fa80c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 -- 172.21.15.52:0/3925409064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c154110 msgr2=0x7fa80c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c154110 0x7fa80c1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80b7fe700 1 --2- 172.21.15.52:0/3925409064 >> v2:172.21.15.172:3300/0 conn(0x7fa80c155570 0x7fa80c068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 -- 172.21.15.52:0/3925409064 >> v2:172.21.15.172:3300/0 conn(0x7fa80c155570 msgr2=0x7fa80c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/3925409064 >> v2:172.21.15.172:3300/0 conn(0x7fa80c155570 0x7fa80c068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.418+0000 7fa80a7fc700 1 -- 172.21.15.52:0/3925409064 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c154a90 con 0x7fa80c0cb410 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c0cb410 0x7fa80c0c5c00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa80c0cb9d0 tx=0x7fa7f40090f0).ready entity=mon.0 client_cookie=d3b1bd9fa56cd83d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa809ffb700 1 -- 172.21.15.52:0/3925409064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b600 con 0x7fa80c0cb410 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa809ffb700 1 -- 172.21.15.52:0/3925409064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b760 con 0x7fa80c0cb410 2023-05-10T01:27:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa809ffb700 1 -- 172.21.15.52:0/3925409064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400bae0 con 0x7fa80c0cb410 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 -- 172.21.15.52:0/3925409064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c0cb410 msgr2=0x7fa80c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c0cb410 0x7fa80c0c5c00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fa80c0cb9d0 tx=0x7fa7f40090f0).stop 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 -- 172.21.15.52:0/3925409064 shutdown_connections 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 --2- 172.21.15.52:0/3925409064 >> v2:172.21.15.172:3300/0 conn(0x7fa80c155570 0x7fa80c068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c154110 0x7fa80c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 --2- 172.21.15.52:0/3925409064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c0cb410 0x7fa80c0c5c00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 -- 172.21.15.52:0/3925409064 >> 172.21.15.52:0/3925409064 conn(0x7fa80c0678d0 msgr2=0x7fa80c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 -- 172.21.15.52:0/3925409064 shutdown_connections 2023-05-10T01:27:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.419+0000 7fa811755700 1 -- 172.21.15.52:0/3925409064 wait complete. 2023-05-10T01:27:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.420+0000 7fa811755700 1 Processor -- start 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 -- start start 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c0cb410 0x7fa80c0a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa80c155570 0x7fa80c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0aa520 con 0x7fa80c154110 2023-05-10T01:27:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0a2a20 con 0x7fa80c155570 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa811755700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c1644e0 con 0x7fa80c0cb410 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa80a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa80a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39834/0 (socket says 172.21.15.52:39834) 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.421+0000 7fa80a7fc700 1 -- 172.21.15.52:0/2613367295 learned_addr learned my addr 172.21.15.52:0/2613367295 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80affd700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c0cb410 0x7fa80c0a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80b7fe700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa80c155570 0x7fa80c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 -- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c0cb410 msgr2=0x7fa80c0a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c0cb410 0x7fa80c0a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 -- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa80c155570 msgr2=0x7fa80c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa80c155570 0x7fa80c0aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 -- 172.21.15.52:0/2613367295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009370 con 0x7fa80c154110 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa80a7fc700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fa7f4009130 tx=0x7fa7f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400bae0 con 0x7fa80c154110 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4000c90 con 0x7fa80c154110 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c0a1eb0 con 0x7fa80c154110 2023-05-10T01:27:05.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f401c670 con 0x7fa80c154110 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.422+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c0a2460 con 0x7fa80c154110 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.423+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c066720 con 0x7fa80c154110 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.423+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa7f402c070 con 0x7fa80c154110 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.424+0000 7fa802ffd700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 0x7fa7f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.424+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fa7f407ba30 con 0x7fa80c154110 2023-05-10T01:27:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.424+0000 7fa80affd700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 0x7fa7f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.425+0000 7fa80affd700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 0x7fa7f0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa80400d430 tx=0x7fa804007560).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.428+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7f404cdb0 con 0x7fa80c154110 2023-05-10T01:27:05.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.665+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa80c06c340 con 0x7fa80c154110 2023-05-10T01:27:05.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.669+0000 7fa802ffd700 1 -- 172.21.15.52:0/2613367295 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa7f402a020 con 0x7fa80c154110 2023-05-10T01:27:05.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 msgr2=0x7fa7f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 0x7fa7f0061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa80400d430 tx=0x7fa804007560).stop 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 msgr2=0x7fa80c1522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fa7f4009130 tx=0x7fa7f4017000).stop 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 shutdown_connections 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fa7f005ed90 0x7fa7f0061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa80c155570 0x7fa80c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa80c0cb410 0x7fa80c0a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 --2- 172.21.15.52:0/2613367295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa80c154110 0x7fa80c1522b0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 >> 172.21.15.52:0/2613367295 conn(0x7fa80c0678d0 msgr2=0x7fa80c0c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 shutdown_connections 2023-05-10T01:27:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.671+0000 7fa811755700 1 -- 172.21.15.52:0/2613367295 wait complete. 2023-05-10T01:27:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:27:05.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:27:05.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.799+0000 7fb8f71b6700 1 Processor -- start 2023-05-10T01:27:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.799+0000 7fb8f71b6700 1 -- start start 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f71b6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8f00c1090 0x7fb8f0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f71b6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f01588f0 con 0x7fb8f00c76d0 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f71b6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f0157ce0 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f71b6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f0157fc0 con 0x7fb8f00c1090 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f69b5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8f00c1090 0x7fb8f0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f61b4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb8f00c76d0 0x7fb8f00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48856/0 (socket says 172.21.15.52:48856) 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f61b4700 1 -- 172.21.15.52:0/2035202070 learned_addr learned my addr 172.21.15.52:0/2035202070 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2035202070 >> v1:172.21.15.172:6789/0 conn(0x7fb8f00c7ab0 legacy=0x7fb8f0153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2035202070 >> v1:172.21.15.52:6789/0 conn(0x7fb8f00c76d0 legacy=0x7fb8f00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f51b2700 1 -- 172.21.15.52:0/2035202070 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370411894 0 0) 0x7fb8f01588f0 con 0x7fb8f00c76d0 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2035202070 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f01582a0 con 0x7fb8f00c1090 2023-05-10T01:27:05.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f69b5700 1 --2- 172.21.15.52:0/2035202070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c1090 0x7fb8f0153f20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fb8e0009760 tx=0x7fb8e0009060).ready entity=mon.0 client_cookie=71edd7eca4402cf8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.800+0000 7fb8f51b2700 1 -- 172.21.15.52:0/2035202070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000b520 con 0x7fb8f00c1090 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f51b2700 1 -- 172.21.15.52:0/2035202070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000b680 con 0x7fb8f00c1090 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f51b2700 1 -- 172.21.15.52:0/2035202070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000ba00 con 0x7fb8f00c1090 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2035202070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c1090 msgr2=0x7fb8f0153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2035202070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c1090 0x7fb8f0153f20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fb8e0009760 tx=0x7fb8e0009060).stop 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2035202070 shutdown_connections 2023-05-10T01:27:05.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2035202070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c1090 0x7fb8f0153f20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2035202070 >> 172.21.15.52:0/2035202070 conn(0x7fb8f0068320 msgr2=0x7fb8f0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2035202070 shutdown_connections 2023-05-10T01:27:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.801+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2035202070 wait complete. 2023-05-10T01:27:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.802+0000 7fb8f71b6700 1 Processor -- start 2023-05-10T01:27:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.802+0000 7fb8f71b6700 1 -- start start 2023-05-10T01:27:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f00c1090 0x7fb8f00c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f00c76d0 0x7fb8f00ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00c33b0 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00c27a0 con 0x7fb8f00c76d0 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f71b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00c2a80 con 0x7fb8f00c1090 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39850/0 (socket says 172.21.15.52:39850) 2023-05-10T01:27:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2594135546 learned_addr learned my addr 172.21.15.52:0/2594135546 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f61b4700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f00c1090 0x7fb8f00c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f59b3700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f00c76d0 0x7fb8f00ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f00c1090 msgr2=0x7fb8f00c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f00c1090 0x7fb8f00c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f00c76d0 msgr2=0x7fb8f00ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f00c76d0 0x7fb8f00ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 -- 172.21.15.52:0/2594135546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00092a0 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.803+0000 7fb8f69b5700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fb8e0009eb0 tx=0x7fb8e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000ba00 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e0022400 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00227a0 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f00c2d60 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f00acb10 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.804+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f00c3520 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.805+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb8e0029070 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.805+0000 7fb8ee7fc700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 0x7fb8d0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.805+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb8e007b2c0 con 0x7fb8f00c7ab0 2023-05-10T01:27:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.806+0000 7fb8f61b4700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 0x7fb8d0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.806+0000 7fb8f61b4700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 0x7fb8d0061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb8e8001560 tx=0x7fb8e8009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:05.810+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8e004c750 con 0x7fb8f00c7ab0 2023-05-10T01:27:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.023+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f0047150 con 0x7fb8f00c7ab0 2023-05-10T01:27:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.024+0000 7fb8ee7fc700 1 -- 172.21.15.52:0/2594135546 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fb8e0027020 con 0x7fb8f00c7ab0 2023-05-10T01:27:06.027 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:27:06.028 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:27:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.025+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 msgr2=0x7fb8d0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.025+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 0x7fb8d0061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb8e8001560 tx=0x7fb8e8009040).stop 2023-05-10T01:27:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.025+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 msgr2=0x7fb8f0149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.025+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7fb8e0009eb0 tx=0x7fb8e0017000).stop 2023-05-10T01:27:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 shutdown_connections 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fb8d005ed60 0x7fb8d0061220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8f00c7ab0 0x7fb8f0149560 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f00c1090 0x7fb8f00c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 --2- 172.21.15.52:0/2594135546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f00c76d0 0x7fb8f00ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 >> 172.21.15.52:0/2594135546 conn(0x7fb8f0068320 msgr2=0x7fb8f01535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 shutdown_connections 2023-05-10T01:27:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.026+0000 7fb8f71b6700 1 -- 172.21.15.52:0/2594135546 wait complete. 2023-05-10T01:27:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:27:06.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:26:56.307221+0000', 'modified': '2023-05-10T01:26:59.315319+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/2633450550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 2633450550}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2633450550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:27:06.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:27:06.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-10T01:27:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.561+0000 7f254bd95700 1 Processor -- start 2023-05-10T01:27:06.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.561+0000 7f254bd95700 1 -- start start 2023-05-10T01:27:06.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254bd95700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2544154540 0x7f2544069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254bd95700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544069b80 0x7f25440c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254bd95700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25440c0650 con 0x7f2544154160 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254bd95700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2544069ff0 con 0x7f2544154540 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254bd95700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440bfd20 con 0x7f2544069b80 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2544154540 0x7f2544069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2544154540 0x7f2544069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39856/0 (socket says 172.21.15.52:39856) 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 -- 172.21.15.52:0/4028104249 learned_addr learned my addr 172.21.15.52:0/4028104249 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f254a332700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544069b80 0x7f25440c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 -- 172.21.15.52:0/4028104249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544069b80 msgr2=0x7f25440c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544069b80 0x7f25440c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.562+0000 7f2549330700 1 -- 172.21.15.52:0/4028104249 >> v1:172.21.15.172:6789/0 conn(0x7f2544154160 legacy=0x7f25440c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f2549330700 1 -- 172.21.15.52:0/4028104249 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440c0000 con 0x7f2544154540 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f2549330700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f2544069690 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f2538006fd0 tx=0x7f25380090f0).ready entity=mon.0 client_cookie=4f321178036acc85 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f2548b2f700 1 -- 172.21.15.52:0/4028104249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800b580 con 0x7f2544154540 2023-05-10T01:27:06.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f2548b2f700 1 -- 172.21.15.52:0/4028104249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800b6e0 con 0x7f2544154540 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f2548b2f700 1 -- 172.21.15.52:0/4028104249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800ba80 con 0x7f2544154540 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 -- 172.21.15.52:0/4028104249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 msgr2=0x7f2544069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f2544069690 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f2538006fd0 tx=0x7f25380090f0).stop 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 -- 172.21.15.52:0/4028104249 shutdown_connections 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544069b80 0x7f25440c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 --2- 172.21.15.52:0/4028104249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f2544069690 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 -- 172.21.15.52:0/4028104249 >> 172.21.15.52:0/4028104249 conn(0x7f25440cb6f0 msgr2=0x7f25440c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 -- 172.21.15.52:0/4028104249 shutdown_connections 2023-05-10T01:27:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.563+0000 7f254bd95700 1 -- 172.21.15.52:0/4028104249 wait complete. 2023-05-10T01:27:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 Processor -- start 2023-05-10T01:27:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 -- start start 2023-05-10T01:27:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 0x7f25440af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544154160 0x7f254413d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544156db0 con 0x7f2544154540 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440c2270 con 0x7f2544069b80 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254bd95700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2544154d30 con 0x7f2544154160 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39864/0 (socket says 172.21.15.52:39864) 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f254a332700 1 -- 172.21.15.52:0/1043274848 learned_addr learned my addr 172.21.15.52:0/1043274848 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.565+0000 7f2549330700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544154160 0x7f254413d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f2549b31700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 0x7f25440af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 -- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544154160 msgr2=0x7f254413d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544154160 0x7f254413d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 -- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 msgr2=0x7f25440af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 0x7f25440af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 -- 172.21.15.52:0/1043274848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009370 con 0x7f2544154540 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f2549b31700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 0x7f25440af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254a332700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f2534009df0 tx=0x7f253400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f2541ffb700 1 -- 172.21.15.52:0/1043274848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400cb50 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f2541ffb700 1 -- 172.21.15.52:0/1043274848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253400f040 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25441566f0 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f2541ffb700 1 -- 172.21.15.52:0/1043274848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400cec0 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.566+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2544155010 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.567+0000 7f2541ffb700 1 -- 172.21.15.52:0/1043274848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2534013610 con 0x7f2544154540 2023-05-10T01:27:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.568+0000 7f2541ffb700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 0x7f2524061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.568+0000 7f2541ffb700 1 -- 172.21.15.52:0/1043274848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f253407a650 con 0x7f2544154540 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.568+0000 7f2549b31700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 0x7f2524061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.568+0000 7f2549b31700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 0x7f2524061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f253c001730 tx=0x7f253c009040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.570+0000 7f255d727b80 1 Processor -- start 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.570+0000 7f255d727b80 1 -- start start 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5086480 0x561ee5081940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5037710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee50025e0 con 0x561ee5081560 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee4f798a0 con 0x561ee503d300 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee4f8e900 con 0x561ee5086480 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39868/0 (socket says 172.21.15.52:39868) 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 -- 172.21.15.52:0/421098283 learned_addr learned my addr 172.21.15.52:0/421098283 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f254a332700 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5037710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549330700 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5086480 0x561ee5081940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 -- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5086480 msgr2=0x561ee5081940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5086480 0x561ee5081940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 -- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 msgr2=0x561ee5037710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5037710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 -- 172.21.15.52:0/421098283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ee4e31310 con 0x561ee5081560 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f2549b31700 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f253c00e6f0 tx=0x7f253c003000).ready entity=mon.0 client_cookie=c048d154d82e15a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f252affd700 1 -- 172.21.15.52:0/421098283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0186f0 con 0x561ee5081560 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f252affd700 1 -- 172.21.15.52:0/421098283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c018850 con 0x561ee5081560 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.571+0000 7f252affd700 1 -- 172.21.15.52:0/421098283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c018bd0 con 0x561ee5081560 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 -- 172.21.15.52:0/421098283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 msgr2=0x561ee5064c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f253c00e6f0 tx=0x7f253c003000).stop 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 -- 172.21.15.52:0/421098283 shutdown_connections 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5037710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5081560 0x561ee5064c50 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 --2- 172.21.15.52:0/421098283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5086480 0x561ee5081940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 -- 172.21.15.52:0/421098283 >> 172.21.15.52:0/421098283 conn(0x561ee4df9e40 msgr2=0x561ee50859d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 -- 172.21.15.52:0/421098283 shutdown_connections 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.572+0000 7f255d727b80 1 -- 172.21.15.52:0/421098283 wait complete. 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.573+0000 7f255d727b80 1 -- start start 2023-05-10T01:27:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.573+0000 7f255d727b80 1 Processor -- start 2023-05-10T01:27:06.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.573+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee506b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5087d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee4f55ed0 con 0x561ee5086480 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee5088960 con 0x561ee503d300 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee5069de0 con 0x561ee5081560 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 10 client.0 ll_register_callbacks cb 0x561ee4ffc200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39878/0 (socket says 172.21.15.52:39878) 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 -- 172.21.15.52:0/2627480125 learned_addr learned my addr 172.21.15.52:0/2627480125 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f2549330700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5087d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f2549b31700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee506b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 -- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 msgr2=0x561ee5087d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5087d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 -- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 msgr2=0x561ee506b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee506b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 -- 172.21.15.52:0/2627480125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c00f040 con 0x561ee5086480 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f2549b31700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee506b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f254a332700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f2534009dc0 tx=0x7f253401f040).ready entity=mon.0 client_cookie=21ccb1b5841be4ef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f251ffff700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253404db00 con 0x561ee5086480 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f253404ed90 con 0x561ee5086480 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ee5030460 con 0x561ee5086480 2023-05-10T01:27:06.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f253404b690 con 0x561ee5086480 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 10 client.8271 fetch_fsmap learned FSMap version 62 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x561ee4f87880 con 0x561ee5086480 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.574+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ee5030460 con 0x561ee5086480 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f253407a0a0 con 0x561ee5086480 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 10 client.8271 fetch_fsmap finished waiting for FSMap version 62 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 10 client.8271 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 20 client.8271 populate_metadata read hostname 'smithi052' 2023-05-10T01:27:06.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee5088240 0x561ee5066630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 4 client.8271 mds_command: new command op to 8091 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 --> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ee4df5ca0 con 0x561ee5088240 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f2549b31700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee5088240 0x561ee5066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f251ffff700 10 client.8271 ms_handle_connect on v2:172.21.15.52:6833/2633450550 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.575+0000 7f2549b31700 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee5088240 0x561ee5066630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=713428b369e95ac0 server_cookie=a063e5127b1b1ee9 in_seq=0 out_seq=0 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f251ffff700 1 -- 172.21.15.52:0/2627480125 <== mds.0 v2:172.21.15.52:6833/2633450550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x561ee4df5ca0 con 0x561ee5088240 2023-05-10T01:27:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f251ffff700 10 client.8271 handle_command_reply: tid=0 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 client.8271 shutdown 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 msgr2=0x561ee5069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f2534009dc0 tx=0x7f253401f040).stop 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 shutdown_connections 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee5088240 0x561ee5066630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5069350 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f251ffff700 0 client.8271 ms_handle_reset on v2:172.21.15.52:6833/2633450550 2023-05-10T01:27:06.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee506b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 --2- 172.21.15.52:0/2627480125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5087d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 >> 172.21.15.52:0/2627480125 conn(0x561ee4df9e40 msgr2=0x561ee503c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 shutdown_connections 2023-05-10T01:27:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 1 -- 172.21.15.52:0/2627480125 wait complete. 2023-05-10T01:27:06.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.576+0000 7f255d727b80 20 client.8271 trim_cache size 0 max 16384 2023-05-10T01:27:06.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.592+0000 7f255d727b80 1 Processor -- start 2023-05-10T01:27:06.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.592+0000 7f255d727b80 1 -- start start 2023-05-10T01:27:06.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5080640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5080b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee5081e30 con 0x561ee5086480 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee5081020 con 0x561ee503d300 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee5030020 con 0x561ee5081560 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39886/0 (socket says 172.21.15.52:39886) 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 -- 172.21.15.52:0/2887092720 learned_addr learned my addr 172.21.15.52:0/2887092720 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f2549330700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5080b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f2549b31700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5080640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 -- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 msgr2=0x561ee5080b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5080b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 -- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 msgr2=0x561ee5080640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5080640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.593+0000 7f254a332700 1 -- 172.21.15.52:0/2887092720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ee4f83070 con 0x561ee5086480 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f2549330700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5080b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f2549b31700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5080640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:06.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f254a332700 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f25340094d0 tx=0x7f2534055000).ready entity=mon.0 client_cookie=5eedd5cea52a22cf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f252b7fe700 1 -- 172.21.15.52:0/2887092720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253404db00 con 0x561ee5086480 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f252b7fe700 1 -- 172.21.15.52:0/2887092720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253400c940 con 0x561ee5086480 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f252b7fe700 1 -- 172.21.15.52:0/2887092720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253407a0a0 con 0x561ee5086480 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 -- 172.21.15.52:0/2887092720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 msgr2=0x561ee5066630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f25340094d0 tx=0x7f2534055000).stop 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 -- 172.21.15.52:0/2887092720 shutdown_connections 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee5066630 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee503d300 0x561ee5080640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 --2- 172.21.15.52:0/2887092720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee5081560 0x561ee5080b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 -- 172.21.15.52:0/2887092720 >> 172.21.15.52:0/2887092720 conn(0x561ee4df9e40 msgr2=0x561ee503b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 -- 172.21.15.52:0/2887092720 shutdown_connections 2023-05-10T01:27:06.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.594+0000 7f255d727b80 1 -- 172.21.15.52:0/2887092720 wait complete. 2023-05-10T01:27:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.595+0000 7f255d727b80 1 -- start start 2023-05-10T01:27:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.596+0000 7f255d727b80 1 Processor -- start 2023-05-10T01:27:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 0x561ee50e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 0x561ee50e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee50ea2a0 con 0x561ee5086480 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee507c800 con 0x561ee5081560 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee507ca50 con 0x561ee503d300 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f255d727b80 10 client.0 ll_register_callbacks cb 0x561ee4ffc200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f254a332700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39890/0 (socket says 172.21.15.52:39890) 2023-05-10T01:27:06.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f254a332700 1 -- 172.21.15.52:0/1818710367 learned_addr learned my addr 172.21.15.52:0/1818710367 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f2549330700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 0x561ee50e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.597+0000 7f2549b31700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 0x561ee50e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 -- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 msgr2=0x561ee50e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 0x561ee50e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 -- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 msgr2=0x561ee50e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 0x561ee50e8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 -- 172.21.15.52:0/1818710367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ee4f87880 con 0x561ee5086480 2023-05-10T01:27:06.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f2549330700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 0x561ee50e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f2549b31700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 0x561ee50e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f254a332700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f2534078bf0 tx=0x7f253401f040).ready entity=mon.0 client_cookie=a5922170235cb166 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253404db00 con 0x561ee5086480 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f253404e5f0 con 0x561ee5086480 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f253c018850 con 0x561ee5086480 2023-05-10T01:27:06.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f253404e9c0 con 0x561ee5086480 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 10 client.8277 fetch_fsmap learned FSMap version 62 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x561ee4f82dc0 con 0x561ee5086480 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c018850 con 0x561ee5086480 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f253404f8c0 con 0x561ee5086480 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 10 client.8277 fetch_fsmap finished waiting for FSMap version 62 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 10 client.8277 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 20 client.8277 populate_metadata read hostname 'smithi052' 2023-05-10T01:27:06.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee50827f0 0x561ee50eab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 4 client.8277 mds_command: new command op to 8091 tid=0[{"prefix": "status"}] 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 --> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ee4e2cca0 con 0x561ee50827f0 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.598+0000 7f2549b31700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee50827f0 0x561ee50eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f251ffff700 10 client.8277 ms_handle_connect on v2:172.21.15.52:6833/2633450550 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f2549b31700 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee50827f0 0x561ee50eab60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0345a3a395084b2 server_cookie=4e830adcc071505e in_seq=0 out_seq=0 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f251ffff700 1 -- 172.21.15.52:0/1818710367 <== mds.0 v2:172.21.15.52:6833/2633450550 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x561ee4e2cca0 con 0x561ee50827f0 2023-05-10T01:27:06.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f251ffff700 10 client.8277 handle_command_reply: tid=0 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 client.8277 shutdown 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 msgr2=0x561ee50822b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f2534078bf0 tx=0x7f253401f040).stop 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 shutdown_connections 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:6833/2633450550,v1:172.21.15.52:6835/2633450550] conn(0x561ee50827f0 0x561ee50eab60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ee5086480 0x561ee50822b0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f251ffff700 0 client.8277 ms_handle_reset on v2:172.21.15.52:6833/2633450550 2023-05-10T01:27:06.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561ee503d300 0x561ee50e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 --2- 172.21.15.52:0/1818710367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561ee5081560 0x561ee50e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 >> 172.21.15.52:0/1818710367 conn(0x561ee4df9e40 msgr2=0x561ee503b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 shutdown_connections 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 1 -- 172.21.15.52:0/1818710367 wait complete. 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.599+0000 7f255d727b80 20 client.8277 trim_cache size 0 max 16384 2023-05-10T01:27:06.611 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 8091, 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:27:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.290774702, 2023-05-10T01:27:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 62, 2023-05-10T01:27:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 136, 2023-05-10T01:27:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 136, 2023-05-10T01:27:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 14.879183972 2023-05-10T01:27:06.613 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:27:06.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 msgr2=0x7f2524061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 0x7f2524061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f253c001730 tx=0x7f253c009040).stop 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 msgr2=0x7f254414e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f2534009df0 tx=0x7f253400b040).stop 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 shutdown_connections 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f252405ed90 0x7f2524061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2544154540 0x7f254414e9b0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544069b80 0x7f25440af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 --2- 172.21.15.52:0/1043274848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2544154160 0x7f254413d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 >> 172.21.15.52:0/1043274848 conn(0x7f25440cb6f0 msgr2=0x7f254414dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 shutdown_connections 2023-05-10T01:27:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.600+0000 7f254bd95700 1 -- 172.21.15.52:0/1043274848 wait complete. 2023-05-10T01:27:06.616 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:27:06.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.717+0000 7f3206e0b700 1 Processor -- start 2023-05-10T01:27:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.717+0000 7f3206e0b700 1 -- start start 2023-05-10T01:27:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3206e0b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32000c1450 0x7f32000a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3206e0b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3200154a50 con 0x7f3200065120 2023-05-10T01:27:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3206e0b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3200154d30 con 0x7f32001545a0 2023-05-10T01:27:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3206e0b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3200155010 con 0x7f32000c1450 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3205e09700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f32000c1450 0x7f32000a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f320660a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3200065120 0x7f32000bfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48916/0 (socket says 172.21.15.52:48916) 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f320660a700 1 -- 172.21.15.52:0/2944459571 learned_addr learned my addr 172.21.15.52:0/2944459571 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3205e09700 1 -- 172.21.15.52:0/2944459571 >> v1:172.21.15.172:6789/0 conn(0x7f32001545a0 legacy=0x7f3200064a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3205e09700 1 -- 172.21.15.52:0/2944459571 >> v1:172.21.15.52:6789/0 conn(0x7f3200065120 legacy=0x7f32000bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3204e07700 1 -- 172.21.15.52:0/2944459571 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614420477 0 0) 0x7f3200154a50 con 0x7f3200065120 2023-05-10T01:27:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3205e09700 1 -- 172.21.15.52:0/2944459571 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32001552f0 con 0x7f32000c1450 2023-05-10T01:27:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.718+0000 7f3205e09700 1 --2- 172.21.15.52:0/2944459571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32000c1450 0x7f32000a9c00 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f31fc009760 tx=0x7f31fc009060).ready entity=mon.0 client_cookie=6e81ded5669363d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3204e07700 1 -- 172.21.15.52:0/2944459571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00b520 con 0x7f32000c1450 2023-05-10T01:27:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3204e07700 1 -- 172.21.15.52:0/2944459571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00b680 con 0x7f32000c1450 2023-05-10T01:27:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3204e07700 1 -- 172.21.15.52:0/2944459571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00ba00 con 0x7f32000c1450 2023-05-10T01:27:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 -- 172.21.15.52:0/2944459571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32000c1450 msgr2=0x7f32000a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 --2- 172.21.15.52:0/2944459571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32000c1450 0x7f32000a9c00 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f31fc009760 tx=0x7f31fc009060).stop 2023-05-10T01:27:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 -- 172.21.15.52:0/2944459571 shutdown_connections 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 --2- 172.21.15.52:0/2944459571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32000c1450 0x7f32000a9c00 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 -- 172.21.15.52:0/2944459571 >> 172.21.15.52:0/2944459571 conn(0x7f32000cb5f0 msgr2=0x7f32000c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 -- 172.21.15.52:0/2944459571 shutdown_connections 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.719+0000 7f3206e0b700 1 -- 172.21.15.52:0/2944459571 wait complete. 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.720+0000 7f3206e0b700 1 Processor -- start 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.720+0000 7f3206e0b700 1 -- start start 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32000c1450 0x7f3200168150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32001545a0 0x7f3200168640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200168b30 con 0x7f3200065120 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c2f90 con 0x7f32001545a0 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3206e0b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c3270 con 0x7f32000c1450 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39902/0 (socket says 172.21.15.52:39902) 2023-05-10T01:27:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 -- 172.21.15.52:0/1221678435 learned_addr learned my addr 172.21.15.52:0/1221678435 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f320660a700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32001545a0 0x7f3200168640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205608700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32000c1450 0x7f3200168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 -- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32000c1450 msgr2=0x7f3200168150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32000c1450 0x7f3200168150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 -- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32001545a0 msgr2=0x7f3200168640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32001545a0 0x7f3200168640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.721+0000 7f3205e09700 1 -- 172.21.15.52:0/1221678435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0092a0 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f3205e09700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f31fc009eb0 tx=0x7f31fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00b7f0 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00b950 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32000c3550 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc01b660 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.722+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32000c3b10 con 0x7f3200065120 2023-05-10T01:27:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.723+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32000834e0 con 0x7f3200065120 2023-05-10T01:27:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.723+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f31fc00f070 con 0x7f3200065120 2023-05-10T01:27:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.724+0000 7f31edffb700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 0x7f31e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.724+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f31fc07b1e0 con 0x7f3200065120 2023-05-10T01:27:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.724+0000 7f3205608700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 0x7f31e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.724+0000 7f3205608700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 0x7f31e0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f32001680b0 tx=0x7f31f0008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.728+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31fc04c670 con 0x7f3200065120 2023-05-10T01:27:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.948+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f320005ef90 con 0x7f3200065120 2023-05-10T01:27:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.949+0000 7f31edffb700 1 -- 172.21.15.52:0/1221678435 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31fc04fc90 con 0x7f3200065120 2023-05-10T01:27:06.952 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:27:06.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.950+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 msgr2=0x7f31e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.950+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 0x7f31e0061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f32001680b0 tx=0x7f31f0008040).stop 2023-05-10T01:27:06.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.950+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 msgr2=0x7f32000a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.950+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f31fc009eb0 tx=0x7f31fc017000).stop 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 shutdown_connections 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f31e005ed90 0x7f31e0061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32001545a0 0x7f3200168640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3200065120 0x7f32000a97a0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 --2- 172.21.15.52:0/1221678435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32000c1450 0x7f3200168150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 >> 172.21.15.52:0/1221678435 conn(0x7f32000cb5f0 msgr2=0x7f32000ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:06.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 shutdown_connections 2023-05-10T01:27:06.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:06.951+0000 7f3206e0b700 1 -- 172.21.15.52:0/1221678435 wait complete. 2023-05-10T01:27:06.964 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:27:06.964 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:27:06.964 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:27:06.965 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:27:06.965 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:27:06.965 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:27:06.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:27:06.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:27:06.969 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:27:06.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:06.970 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:27:06.985 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:27:06.986 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:27:06.986 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:27:06.986 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.986 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:27:06.986 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41209sec preferred_lft 41209sec 2023-05-10T01:27:06.987 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:27:06.988 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:27:06.989 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.990 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:27:06.990 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:27:06.990 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:27:06.990 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:27:06.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:06.991 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:27:07.048 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:27:07.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.051 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:27:07.106 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:27:07.106 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:27:07.107 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:27:07.107 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:27:07.107 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:27:07.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.108 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:27:07.108 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:27:07.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:27:07.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:27:07.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:27:07.109 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:27:07.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.209 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:27:07.223 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:27:07.223 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:27:07.224 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:27:07.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:27:07.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.288 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:27:07.343 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:27:07.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:27:07.422 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:27:07.423 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:27:07.466 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:27:07.466 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:27:07.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:27:07.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:27:07.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:27:07.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:27:07.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.689+0000 7f8960bc2700 1 Processor -- start 2023-05-10T01:27:07.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.689+0000 7f8960bc2700 1 -- start start 2023-05-10T01:27:07.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f8960bc2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f895c069740 0x7f895c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f8960bc2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f895c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f8960bc2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c06a910 con 0x7f895c0aab30 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f8960bc2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c0c65e0 con 0x7f895c069740 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f8960bc2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0bfa20 con 0x7f895c153af0 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f895c0aab30 0x7f895c0c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48934/0 (socket says 172.21.15.52:48934) 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895affd700 1 -- 172.21.15.52:0/2375777416 learned_addr learned my addr 172.21.15.52:0/2375777416 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:07.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895bfff700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f895c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895b7fe700 1 --2- 172.21.15.52:0/2375777416 >> v2:172.21.15.172:3300/0 conn(0x7f895c069740 0x7f895c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346548431 0 0) 0x7f895c06a910 con 0x7f895c0aab30 2023-05-10T01:27:07.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89480033f0 con 0x7f895c0aab30 2023-05-10T01:27:07.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629535764 0 0) 0x7f89480033f0 con 0x7f895c0aab30 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 msgr2=0x7f895c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f895c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 >> v2:172.21.15.172:3300/0 conn(0x7f895c069740 msgr2=0x7f895c069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 --2- 172.21.15.52:0/2375777416 >> v2:172.21.15.172:3300/0 conn(0x7f895c069740 0x7f895c069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0bfc70 con 0x7f895c0aab30 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f8950001470 con 0x7f895c0aab30 2023-05-10T01:27:07.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 >> v1:172.21.15.52:6789/0 conn(0x7f895c0aab30 legacy=0x7f895c0c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89480038e0 0x7f8948003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.690+0000 7f895a7fc700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8948004690 0x7f8948004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f8948005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0c65e0 con 0x7f8948004690 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0bfa20 con 0x7f89480038e0 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894800b8e0 con 0x7f895c153af0 2023-05-10T01:27:07.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8948004690 0x7f8948004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895bfff700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f8948005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895b7fe700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89480038e0 0x7f8948003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 -- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 msgr2=0x7f8948005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f895c153af0 0x7f8948005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 -- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89480038e0 msgr2=0x7f8948003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89480038e0 0x7f8948003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 -- 172.21.15.52:0/2375777416 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480033f0 con 0x7f8948004690 2023-05-10T01:27:07.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895b7fe700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89480038e0 0x7f8948003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895affd700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8948004690 0x7f8948004b10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f895000c1e0 tx=0x7f8950001e90).ready entity=mon.0 client_cookie=80436a8c1304bf94 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950007a60 con 0x7f8948004690 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000cab0 con 0x7f8948004690 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.691+0000 7f895a7fc700 1 -- 172.21.15.52:0/2375777416 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ce30 con 0x7f8948004690 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 -- 172.21.15.52:0/2375777416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8948004690 msgr2=0x7f8948004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 --2- 172.21.15.52:0/2375777416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8948004690 0x7f8948004b10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f895000c1e0 tx=0x7f8950001e90).stop 2023-05-10T01:27:07.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f895bfff700 1 -- 172.21.15.52:0/2375777416 reap_dead start 2023-05-10T01:27:07.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 -- 172.21.15.52:0/2375777416 shutdown_connections 2023-05-10T01:27:07.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 -- 172.21.15.52:0/2375777416 >> 172.21.15.52:0/2375777416 conn(0x7f895c0cb540 msgr2=0x7f895c0c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:07.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 -- 172.21.15.52:0/2375777416 shutdown_connections 2023-05-10T01:27:07.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.692+0000 7f8960bc2700 1 -- 172.21.15.52:0/2375777416 wait complete. 2023-05-10T01:27:07.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.693+0000 7f8960bc2700 1 Processor -- start 2023-05-10T01:27:07.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.693+0000 7f8960bc2700 1 -- start start 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8948004690 0x7f895c13c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895c0c3220 0x7f895c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c14fd40 con 0x7f895c13ca50 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c150020 con 0x7f895c0c3220 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0b0310 con 0x7f8948004690 2023-05-10T01:27:07.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39930/0 (socket says 172.21.15.52:39930) 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 -- 172.21.15.52:0/1317583281 learned_addr learned my addr 172.21.15.52:0/1317583281 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895b7fe700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8948004690 0x7f895c13c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895bfff700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895c0c3220 0x7f895c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 -- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8948004690 msgr2=0x7f895c13c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8948004690 0x7f895c13c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 -- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895c0c3220 msgr2=0x7f895c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895c0c3220 0x7f895c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 -- 172.21.15.52:0/1317583281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0b05f0 con 0x7f895c13ca50 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f895affd700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8948004480 tx=0x7f8950015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500074f0 con 0x7f895c13ca50 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950007650 con 0x7f895c13ca50 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c0b08d0 con 0x7f895c13ca50 2023-05-10T01:27:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950004900 con 0x7f895c13ca50 2023-05-10T01:27:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.694+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c0afa90 con 0x7f895c13ca50 2023-05-10T01:27:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.695+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c1501d0 con 0x7f895c13ca50 2023-05-10T01:27:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.696+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8950028030 con 0x7f895c13ca50 2023-05-10T01:27:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.696+0000 7f89437fe700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 0x7f893c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:07.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.696+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f895007aab0 con 0x7f895c13ca50 2023-05-10T01:27:07.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.696+0000 7f895b7fe700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 0x7f893c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:07.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.697+0000 7f895b7fe700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 0x7f893c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f894c009d60 tx=0x7f894c008040).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:07.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.700+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f895c1501d0 con 0x7f895c13ca50 2023-05-10T01:27:07.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.899+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f895c0b00a0 con 0x7f893c05ed90 2023-05-10T01:27:07.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.901+0000 7f89437fe700 1 -- 172.21.15.52:0/1317583281 <== mgr.6620 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f895c0b00a0 con 0x7f893c05ed90 2023-05-10T01:27:07.904 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:27:07.904 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:27:07.904 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:27:07.904 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:27:07.904 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:27:07.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.902+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 msgr2=0x7f893c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.902+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 0x7f893c061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f894c009d60 tx=0x7f894c008040).stop 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.902+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 msgr2=0x7f895c0c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.902+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8948004480 tx=0x7f8950015000).stop 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.902+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 shutdown_connections 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f893c05ed90 0x7f893c061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895c0c3220 0x7f895c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8948004690 0x7f895c13c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 --2- 172.21.15.52:0/1317583281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c13ca50 0x7f895c0c2d30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:07.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 >> 172.21.15.52:0/1317583281 conn(0x7f895c0cb540 msgr2=0x7f895c0c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:07.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 shutdown_connections 2023-05-10T01:27:07.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:07.903+0000 7f8960bc2700 1 -- 172.21.15.52:0/1317583281 wait complete. 2023-05-10T01:27:07.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:27:08.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.033+0000 7f30fcaa8700 1 Processor -- start 2023-05-10T01:27:08.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.033+0000 7f30fcaa8700 1 -- start start 2023-05-10T01:27:08.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30fcaa8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30f8154080 0x7f30f80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30fcaa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8154460 0x7f30f80a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30fcaa8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f80c94c0 con 0x7f30f80aa140 2023-05-10T01:27:08.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30fcaa8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80aa5b0 con 0x7f30f8154080 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30fcaa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80cb7d0 con 0x7f30f8154460 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30f659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30f8154080 0x7f30f80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30f6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f30f80aa140 0x7f30f8068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48952/0 (socket says 172.21.15.52:48952) 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30f6d9d700 1 -- 172.21.15.52:0/1610713168 learned_addr learned my addr 172.21.15.52:0/1610713168 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.034+0000 7f30f5d9b700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8154460 0x7f30f80a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f659c700 1 -- 172.21.15.52:0/1610713168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8154460 msgr2=0x7f30f80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f659c700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8154460 0x7f30f80a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f659c700 1 -- 172.21.15.52:0/1610713168 >> v1:172.21.15.52:6789/0 conn(0x7f30f80aa140 legacy=0x7f30f8068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f559a700 1 -- 172.21.15.52:0/1610713168 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779888099 0 0) 0x7f30f80c94c0 con 0x7f30f80aa140 2023-05-10T01:27:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f659c700 1 -- 172.21.15.52:0/1610713168 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80c88b0 con 0x7f30f8154080 2023-05-10T01:27:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f659c700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154080 0x7f30f80aac90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f30f0009760 tx=0x7f30f0009060).ready entity=mon.0 client_cookie=731e6981d6cb8f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f559a700 1 -- 172.21.15.52:0/1610713168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000f510 con 0x7f30f8154080 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f559a700 1 -- 172.21.15.52:0/1610713168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000f670 con 0x7f30f8154080 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30f559a700 1 -- 172.21.15.52:0/1610713168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000f9f0 con 0x7f30f8154080 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1610713168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154080 msgr2=0x7f30f80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.035+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154080 0x7f30f80aac90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f30f0009760 tx=0x7f30f0009060).stop 2023-05-10T01:27:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1610713168 shutdown_connections 2023-05-10T01:27:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154080 0x7f30f80aac90 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1610713168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8154460 0x7f30f80a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1610713168 >> 172.21.15.52:0/1610713168 conn(0x7f30f8067910 msgr2=0x7f30f80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1610713168 shutdown_connections 2023-05-10T01:27:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.036+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1610713168 wait complete. 2023-05-10T01:27:08.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 Processor -- start 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 -- start start 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f80aa140 0x7f30f80c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f8154080 0x7f30f814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80c3930 con 0x7f30f8154460 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80afcb0 con 0x7f30f8154080 2023-05-10T01:27:08.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.037+0000 7f30fcaa8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80af410 con 0x7f30f80aa140 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39940/0 (socket says 172.21.15.52:39940) 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 -- 172.21.15.52:0/1630395452 learned_addr learned my addr 172.21.15.52:0/1630395452 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f659c700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f80aa140 0x7f30f80c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f5d9b700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f8154080 0x7f30f814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 -- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f80aa140 msgr2=0x7f30f80c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f80aa140 0x7f30f80c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 -- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f8154080 msgr2=0x7f30f814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f8154080 0x7f30f814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 -- 172.21.15.52:0/1630395452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00092a0 con 0x7f30f8154460 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30f6d9d700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f30e800c760 tx=0x7f30e8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005d30 con 0x7f30f8154460 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8005e90 con 0x7f30f8154460 2023-05-10T01:27:08.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8007300 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f80af750 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.038+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80c2300 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.039+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f8066720 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.039+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 55) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f30e8010070 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.040+0000 7f30ee7fc700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 0x7f30dc061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.040+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f30e8079490 con 0x7f30f8154460 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.040+0000 7f30f659c700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 0x7f30dc061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.040+0000 7f30f659c700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 0x7f30dc061280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f30f0009fd0 tx=0x7f30f0017000).ready entity=mgr.6620 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:08.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.044+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30e804a920 con 0x7f30f8154460 2023-05-10T01:27:08.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.262+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f30f806bd30 con 0x7f30f8154460 2023-05-10T01:27:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.563+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 56) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f30e8077280 con 0x7f30f8154460 2023-05-10T01:27:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.564+0000 7f30ee7fc700 1 -- 172.21.15.52:0/1630395452 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v56) v1 ==== 92+0+0 (secure 0 0 0) 0x7f30e8072600 con 0x7f30f8154460 2023-05-10T01:27:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 msgr2=0x7f30dc061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 0x7f30dc061280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f30f0009fd0 tx=0x7f30f0017000).stop 2023-05-10T01:27:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 msgr2=0x7f30f80ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f30e800c760 tx=0x7f30e8001520).stop 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 shutdown_connections 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f30dc05edc0 0x7f30dc061280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f8154460 0x7f30f80ae380 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f80aa140 0x7f30f80c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 --2- 172.21.15.52:0/1630395452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f8154080 0x7f30f814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 >> 172.21.15.52:0/1630395452 conn(0x7f30f8067910 msgr2=0x7f30f80ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:08.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 shutdown_connections 2023-05-10T01:27:08.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.566+0000 7f30fcaa8700 1 -- 172.21.15.52:0/1630395452 wait complete. 2023-05-10T01:27:08.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:27:08.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.702+0000 7fbd7b640700 1 Processor -- start 2023-05-10T01:27:08.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.702+0000 7fbd7b640700 1 -- start start 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd7b640700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd74068860 0x7fbd740aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd7b640700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd740c94c0 con 0x7fbd74154460 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd7b640700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd740cb7d0 con 0x7fbd74154080 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd7b640700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740c88b0 con 0x7fbd74068860 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd78bdb700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd74154460 0x7fbd74068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48988/0 (socket says 172.21.15.52:48988) 2023-05-10T01:27:08.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd78bdb700 1 -- 172.21.15.52:0/2937292573 learned_addr learned my addr 172.21.15.52:0/2937292573 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.703+0000 7fbd79bdd700 1 --2- 172.21.15.52:0/2937292573 >> v2:172.21.15.172:3300/0 conn(0x7fbd74068860 0x7fbd740aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750730108 0 0) 0x7fbd740c94c0 con 0x7fbd74154460 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd5c0033f0 con 0x7fbd74154460 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd79bdd700 1 -- 172.21.15.52:0/2937292573 >> v1:172.21.15.172:6789/0 conn(0x7fbd74154080 legacy=0x7fbd740a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942905061 0 0) 0x7fbd740cb7d0 con 0x7fbd74154080 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd79bdd700 1 -- 172.21.15.52:0/2937292573 >> v1:172.21.15.52:6789/0 conn(0x7fbd74154460 legacy=0x7fbd74068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd79bdd700 1 -- 172.21.15.52:0/2937292573 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740c8b90 con 0x7fbd74068860 2023-05-10T01:27:08.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd79bdd700 1 --2- 172.21.15.52:0/2937292573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74068860 0x7fbd740aac90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbd6c009e60 tx=0x7fbd6c009780).ready entity=mon.1 client_cookie=d694c33ba6eb8ff1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:08.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00e070 con 0x7fbd74068860 2023-05-10T01:27:08.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00bb60 con 0x7fbd74068860 2023-05-10T01:27:08.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.704+0000 7fbd63fff700 1 -- 172.21.15.52:0/2937292573 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00bee0 con 0x7fbd74068860 2023-05-10T01:27:08.710 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:08.705+0000 7faa86993680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:27:08.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 -- 172.21.15.52:0/2937292573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74068860 msgr2=0x7fbd740aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 --2- 172.21.15.52:0/2937292573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74068860 0x7fbd740aac90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbd6c009e60 tx=0x7fbd6c009780).stop 2023-05-10T01:27:08.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 -- 172.21.15.52:0/2937292573 shutdown_connections 2023-05-10T01:27:08.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 --2- 172.21.15.52:0/2937292573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74068860 0x7fbd740aac90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 -- 172.21.15.52:0/2937292573 >> 172.21.15.52:0/2937292573 conn(0x7fbd74067910 msgr2=0x7fbd740cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 -- 172.21.15.52:0/2937292573 shutdown_connections 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.705+0000 7fbd7b640700 1 -- 172.21.15.52:0/2937292573 wait complete. 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.706+0000 7fbd7b640700 1 Processor -- start 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.706+0000 7fbd7b640700 1 -- start start 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74154080 0x7fbd7414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd74154460 0x7fbd7413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74150020 con 0x7fbd74068860 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74154ed0 con 0x7fbd74154080 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd7b640700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c36a0 con 0x7fbd74154460 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd793dc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd793dc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39976/0 (socket says 172.21.15.52:39976) 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd793dc700 1 -- 172.21.15.52:0/3679725903 learned_addr learned my addr 172.21.15.52:0/3679725903 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:08.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd78bdb700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74154080 0x7fbd7414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fbd79bdd700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd74154460 0x7fbd7413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:08.714 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:08.707+0000 7fb93f5c4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:27:08.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 -- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd74154460 msgr2=0x7fbd7413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd74154460 0x7fbd7413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 -- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74154080 msgr2=0x7fbd7414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74154080 0x7fbd7414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 -- 172.21.15.52:0/3679725903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009a20 con 0x7fbd74068860 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd793dc700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fbd70001eb0 tx=0x7fbd70007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000ce60 con 0x7fbd74068860 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000f470 con 0x7fbd74068860 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740c3980 con 0x7fbd74068860 2023-05-10T01:27:08.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000f810 con 0x7fbd74068860 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.708+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740c3f40 con 0x7fbd74068860 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.709+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd740c42b0 con 0x7fbd74068860 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.709+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 56) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fbd70019030 con 0x7fbd74068860 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.710+0000 7fbd617fa700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 0x7fbd540612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.710+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fbd70079100 con 0x7fbd74068860 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.710+0000 7fbd78bdb700 1 -- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 msgr2=0x7fbd540612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.710+0000 7fbd78bdb700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 0x7fbd540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:27:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.714+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd7004a590 con 0x7fbd74068860 2023-05-10T01:27:08.771 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:08.768+0000 7faa86993680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:27:08.777 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:08.774+0000 7fb93f5c4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:27:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.888+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fbd7406c340 con 0x7fbd74068860 2023-05-10T01:27:08.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.891+0000 7fbd617fa700 1 -- 172.21.15.52:0/3679725903 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd7004dbb0 con 0x7fbd74068860 2023-05-10T01:27:08.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 msgr2=0x7fbd540612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 0x7fbd540612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 msgr2=0x7fbd74154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fbd70001eb0 tx=0x7fbd70007c70).stop 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 shutdown_connections 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7fbd5405ede0 0x7fbd540612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd74154460 0x7fbd7413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd74068860 0x7fbd74154840 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 --2- 172.21.15.52:0/3679725903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74154080 0x7fbd7414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:08.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 >> 172.21.15.52:0/3679725903 conn(0x7fbd74067910 msgr2=0x7fbd740abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:08.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 shutdown_connections 2023-05-10T01:27:08.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:08.893+0000 7fbd7b640700 1 -- 172.21.15.52:0/3679725903 wait complete. 2023-05-10T01:27:08.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:27:08.908 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:27:08.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:27:08.929 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-05-10T01:27:08.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-10T01:27:09.041 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:09.038+0000 7faa86993680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:27:09.068 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:09.065+0000 7fb93f5c4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:27:09.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.146+0000 7faa82574700 1 Processor -- start 2023-05-10T01:27:09.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.146+0000 7faa82574700 1 -- start start 2023-05-10T01:27:09.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa82574700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa7c154080 0x7faa7c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa82574700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0c94c0 con 0x7faa7c068150 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa82574700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0cb7d0 con 0x7faa7c154460 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa82574700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0c88b0 con 0x7faa7c154080 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa80b11700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faa7c068150 0x7faa7c0c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49046/0 (socket says 172.21.15.52:49046) 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa80b11700 1 -- 172.21.15.52:0/756516070 learned_addr learned my addr 172.21.15.52:0/756516070 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:27:09.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa7bfff700 1 --2- 172.21.15.52:0/756516070 >> v2:172.21.15.172:3300/0 conn(0x7faa7c154080 0x7faa7c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa7affd700 1 -- 172.21.15.52:0/756516070 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860581723 0 0) 0x7faa7c0c94c0 con 0x7faa7c068150 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.147+0000 7faa7affd700 1 -- 172.21.15.52:0/756516070 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa680033f0 con 0x7faa7c068150 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7bfff700 1 -- 172.21.15.52:0/756516070 >> v1:172.21.15.172:6789/0 conn(0x7faa7c154460 legacy=0x7faa7c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7bfff700 1 -- 172.21.15.52:0/756516070 >> v1:172.21.15.52:6789/0 conn(0x7faa7c068150 legacy=0x7faa7c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7bfff700 1 -- 172.21.15.52:0/756516070 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0c8b90 con 0x7faa7c154080 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7bfff700 1 --2- 172.21.15.52:0/756516070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c0aac90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7faa6c009760 tx=0x7faa6c009060).ready entity=mon.1 client_cookie=b1297aa86fc4711f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:09.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7affd700 1 -- 172.21.15.52:0/756516070 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00f510 con 0x7faa7c154080 2023-05-10T01:27:09.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7affd700 1 -- 172.21.15.52:0/756516070 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00f670 con 0x7faa7c154080 2023-05-10T01:27:09.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.148+0000 7faa7affd700 1 -- 172.21.15.52:0/756516070 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00f9f0 con 0x7faa7c154080 2023-05-10T01:27:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 -- 172.21.15.52:0/756516070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 msgr2=0x7faa7c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 --2- 172.21.15.52:0/756516070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c0aac90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7faa6c009760 tx=0x7faa6c009060).stop 2023-05-10T01:27:09.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 -- 172.21.15.52:0/756516070 shutdown_connections 2023-05-10T01:27:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 --2- 172.21.15.52:0/756516070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c0aac90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 -- 172.21.15.52:0/756516070 >> 172.21.15.52:0/756516070 conn(0x7faa7c067910 msgr2=0x7faa7c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 -- 172.21.15.52:0/756516070 shutdown_connections 2023-05-10T01:27:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.149+0000 7faa82574700 1 -- 172.21.15.52:0/756516070 wait complete. 2023-05-10T01:27:09.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.150+0000 7faa82574700 1 Processor -- start 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.150+0000 7faa82574700 1 -- start start 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa7c154460 0x7faa7c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c165370 con 0x7faa7c068150 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c167a20 con 0x7faa7c154080 2023-05-10T01:27:09.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa82574700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c167d00 con 0x7faa7c154460 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40034/0 (socket says 172.21.15.52:40034) 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 -- 172.21.15.52:0/2281626194 learned_addr learned my addr 172.21.15.52:0/2281626194 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa80b11700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa7c154460 0x7faa7c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa7c154460 msgr2=0x7faa7c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa7c154460 0x7faa7c0ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:09.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 msgr2=0x7faa7c14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0092a0 con 0x7faa7c068150 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.151+0000 7faa7bfff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7faa6c009e00 tx=0x7faa6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.152+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00f7e0 con 0x7faa7c068150 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.152+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00f940 con 0x7faa7c068150 2023-05-10T01:27:09.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.152+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c167fe0 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.152+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c01b660 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.152+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c1685a0 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.153+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c066720 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.153+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 56) v1 ==== 75259+0+0 (secure 0 0 0) 0x7faa6c00f070 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.154+0000 7faa63fff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.154+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6385+0+0 (secure 0 0 0) 0x7faa6c07b4f0 con 0x7faa7c068150 2023-05-10T01:27:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.154+0000 7faa7b7fe700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.154+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:27:09.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.161+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa6c04c980 con 0x7faa7c068150 2023-05-10T01:27:09.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.355+0000 7faa7b7fe700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:09.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.355+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:27:09.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.362+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7c0c8e70 con 0x7faa5c05edb0 2023-05-10T01:27:09.646 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:09.643+0000 7faa86993680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:27:09.717 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:09.714+0000 7faa86993680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:27:09.731 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:09.729+0000 7fb93f5c4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:27:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.756+0000 7faa7b7fe700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:09.756+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:27:09.799 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:09.797+0000 7fb93f5c4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:27:09.902 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:09.899+0000 7faa86993680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:27:09.992 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:09.990+0000 7fb93f5c4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:27:10.317 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.314+0000 7faa86993680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:27:10.419 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.416+0000 7faa86993680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:27:10.427 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:10.424+0000 7fb93f5c4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:27:10.534 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:10.532+0000 7fb93f5c4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:27:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:10.557+0000 7faa7b7fe700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:10.557+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:27:10.574 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.571+0000 7faa86993680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:27:10.647 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.644+0000 7faa86993680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:27:10.693 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:10.691+0000 7fb93f5c4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:27:10.713 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.710+0000 7faa86993680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:27:10.771 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:10.768+0000 7fb93f5c4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:27:10.841 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:10.838+0000 7fb93f5c4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:27:10.967 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:10.964+0000 7faa86993680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:27:11.111 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:11.109+0000 7fb93f5c4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:27:11.149 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:11.146+0000 7faa86993680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:27:11.301 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:11.299+0000 7fb93f5c4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:27:11.791 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:11.788+0000 7faa86993680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:27:11.858 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:11.855+0000 7faa86993680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:27:11.932 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:11.929+0000 7faa86993680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:27:11.981 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:11.979+0000 7fb93f5c4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:27:12.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.050+0000 7fb93f5c4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:27:12.079 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.076+0000 7faa86993680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:27:12.130 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.127+0000 7fb93f5c4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:27:12.147 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.144+0000 7faa86993680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:27:12.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:12.158+0000 7faa7b7fe700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/116173 2023-05-10T01:27:12.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:12.158+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:27:12.260 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.257+0000 7faa86993680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:27:12.281 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.279+0000 7fb93f5c4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:27:12.356 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.354+0000 7fb93f5c4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:27:12.369 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.366+0000 7faa86993680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:27:12.476 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.473+0000 7fb93f5c4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:27:12.587 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.584+0000 7fb93f5c4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:27:12.657 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.654+0000 7faa86993680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:27:12.726 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.723+0000 7faa86993680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:27:12.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:12.794+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 57) v1 ==== 75109+0+0 (secure 0 0 0) 0x7faa6c0792e0 con 0x7faa7c068150 2023-05-10T01:27:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:12.794+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:27:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:12.794+0000 7faa63fff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:27:12.859 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa05175700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.860 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa0216f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.860 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa05175700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.860 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa0216f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.860 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa05175700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.860 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa0216f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.861 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa05175700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.861 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa0216f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.861 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa05175700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.861 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:27:12.856+0000 7faa0216f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:27:12.895 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.893+0000 7fb93f5c4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:27:12.969 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:27:12.966+0000 7fb93f5c4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:27:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.809+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 58) v1 ==== 75179+0+0 (secure 0 0 0) 0x7faa6c03e9b0 con 0x7faa7c068150 2023-05-10T01:27:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.810+0000 7faa63fff700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c02fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.810+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7c0c8e70 con 0x7faa5c05edb0 2023-05-10T01:27:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.811+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c02fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.820+0000 7faa7b7fe700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c02fd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faa7c0aa3b0 tx=0x7faa70007d40).ready entity=mgr.7654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.827+0000 7faa63fff700 1 -- 172.21.15.52:0/2281626194 <== mgr.7654 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7faa7c0c8e70 con 0x7faa5c05edb0 2023-05-10T01:27:13.830 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-05-10T01:27:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 msgr2=0x7faa5c02fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c02fd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faa7c0aa3b0 tx=0x7faa70007d40).stop 2023-05-10T01:27:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 msgr2=0x7faa7c164e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7faa6c009e00 tx=0x7faa6c017000).stop 2023-05-10T01:27:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 shutdown_connections 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7faa5c05edb0 0x7faa5c02fd10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa7c154460 0x7faa7c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa7c068150 0x7faa7c164e80 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 --2- 172.21.15.52:0/2281626194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa7c154080 0x7faa7c14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 >> 172.21.15.52:0/2281626194 conn(0x7faa7c067910 msgr2=0x7faa7c14d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 shutdown_connections 2023-05-10T01:27:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:13.829+0000 7faa82574700 1 -- 172.21.15.52:0/2281626194 wait complete. 2023-05-10T01:27:13.847 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-05-10T01:27:13.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-10T01:27:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.017+0000 7f056a83e700 1 Processor -- start 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.017+0000 7f056a83e700 1 -- start start 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f056a83e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0564154460 0x7f05640aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f056a83e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 0x7f05640685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f056a83e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640c94c0 con 0x7f0564154080 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f056a83e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640cb7d0 con 0x7f0564154460 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f056a83e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0564068a90 con 0x7f0564068150 2023-05-10T01:27:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0564154460 0x7f05640aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0564154460 0x7f05640aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40160/0 (socket says 172.21.15.52:40160) 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 -- 172.21.15.52:0/1038092628 learned_addr learned my addr 172.21.15.52:0/1038092628 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f0568ddb700 1 --2- 172.21.15.52:0/1038092628 >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 0x7f05640685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 -- 172.21.15.52:0/1038092628 >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 msgr2=0x7f05640685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 --2- 172.21.15.52:0/1038092628 >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 0x7f05640685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.018+0000 7f05637fe700 1 -- 172.21.15.52:0/1038092628 >> v1:172.21.15.172:6789/0 conn(0x7f0564154080 legacy=0x7f05640a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:27:14.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f05637fe700 1 -- 172.21.15.52:0/1038092628 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640c88b0 con 0x7f0564154460 2023-05-10T01:27:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f0568ddb700 1 --2- 172.21.15.52:0/1038092628 >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 0x7f05640685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:27:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f05637fe700 1 --2- 172.21.15.52:0/1038092628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564154460 0x7f05640aac90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f056405f9d0 tx=0x7f05540090f0).ready entity=mon.0 client_cookie=c11f47a754b881db server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f0562ffd700 1 -- 172.21.15.52:0/1038092628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400b5a0 con 0x7f0564154460 2023-05-10T01:27:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f0562ffd700 1 -- 172.21.15.52:0/1038092628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400b700 con 0x7f0564154460 2023-05-10T01:27:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f0562ffd700 1 -- 172.21.15.52:0/1038092628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400ba80 con 0x7f0564154460 2023-05-10T01:27:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 -- 172.21.15.52:0/1038092628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564154460 msgr2=0x7f05640aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 --2- 172.21.15.52:0/1038092628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564154460 0x7f05640aac90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f056405f9d0 tx=0x7f05540090f0).stop 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 -- 172.21.15.52:0/1038092628 shutdown_connections 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 --2- 172.21.15.52:0/1038092628 >> v2:172.21.15.172:3300/0 conn(0x7f0564068150 0x7f05640685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 --2- 172.21.15.52:0/1038092628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564154460 0x7f05640aac90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 -- 172.21.15.52:0/1038092628 >> 172.21.15.52:0/1038092628 conn(0x7f0564067910 msgr2=0x7f05640cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 -- 172.21.15.52:0/1038092628 shutdown_connections 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.019+0000 7f056a83e700 1 -- 172.21.15.52:0/1038092628 wait complete. 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 Processor -- start 2023-05-10T01:27:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 -- start start 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0564154080 0x7f0564152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0564154460 0x7f0564164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640af4d0 con 0x7f0564068150 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0564153450 con 0x7f0564154080 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.021+0000 7f056a83e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640aeba0 con 0x7f0564154460 2023-05-10T01:27:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40164/0 (socket says 172.21.15.52:40164) 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 -- 172.21.15.52:0/2918412072 learned_addr learned my addr 172.21.15.52:0/2918412072 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f05637fe700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0564154080 0x7f0564152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0568ddb700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0564154460 0x7f0564164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 -- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0564154460 msgr2=0x7f0564164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0564154460 0x7f0564164d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 -- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0564154080 msgr2=0x7f0564152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0564154080 0x7f0564152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 -- 172.21.15.52:0/2918412072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009370 con 0x7f0564068150 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f0563fff700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f054c00c440 tx=0x7f054c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c012400 con 0x7f0564068150 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c012580 con 0x7f0564068150 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640aee80 con 0x7f0564068150 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c012940 con 0x7f0564068150 2023-05-10T01:27:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.022+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640af960 con 0x7f0564068150 2023-05-10T01:27:14.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.023+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05640af7b0 con 0x7f0564068150 2023-05-10T01:27:14.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.024+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 58) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f054c019030 con 0x7f0564068150 2023-05-10T01:27:14.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.024+0000 7f055bfff700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 0x7f0548061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:27:14.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.024+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f054c078ec0 con 0x7f0564068150 2023-05-10T01:27:14.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.024+0000 7f05637fe700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 0x7f0548061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:27:14.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.025+0000 7f05637fe700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 0x7f0548061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0554009130 tx=0x7f0554015000).ready entity=mgr.7654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:27:14.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.028+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f054c0488f0 con 0x7f0564068150 2023-05-10T01:27:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.227+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0564066720 con 0x7f054805ed40 2023-05-10T01:27:14.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.233+0000 7f055bfff700 1 -- 172.21.15.52:0/2918412072 <== mgr.7654 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f0564066720 con 0x7f054805ed40 2023-05-10T01:27:14.236 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-05-10T01:27:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 msgr2=0x7f0548061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 0x7f0548061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0554009130 tx=0x7f0554015000).stop 2023-05-10T01:27:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 msgr2=0x7f05641529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:27:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f054c00c440 tx=0x7f054c007de0).stop 2023-05-10T01:27:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 shutdown_connections 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f054805ed40 0x7f0548061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0564154460 0x7f0564164d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0564068150 0x7f05641529b0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 --2- 172.21.15.52:0/2918412072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0564154080 0x7f0564152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 >> 172.21.15.52:0/2918412072 conn(0x7f0564067910 msgr2=0x7f05640cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 shutdown_connections 2023-05-10T01:27:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:27:14.235+0000 7f056a83e700 1 -- 172.21.15.52:0/2918412072 wait complete. 2023-05-10T01:27:14.250 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-05-10T01:27:29.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:27:29.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:27:59.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:27:59.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:28:00.240 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:28:00.237+0000 7fa9f4954700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:28:00.240 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:28:00.237+0000 7fa9f4954700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:28:00.241 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:28:00.237+0000 7fa9f4954700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:28:00.241 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:28:00.237+0000 7fa9f4954700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:28:00.241 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:28:00.237+0000 7fa9f4954700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:28:29.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:28:29.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:28:59.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:28:59.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:29:29.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:29:29.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:29:59.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:29:59.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:30:29.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:30:29.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:30:59.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:30:59.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:31:29.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:31:29.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:32:00.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:32:00.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:32:30.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:32:30.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:33:00.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:33:00.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:33:30.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:33:30.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:34:00.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:34:00.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:34:30.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:34:30.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:35:00.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:35:00.843 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:35:31.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:35:31.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:36:01.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:36:01.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:36:31.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:36:31.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:37:01.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:37:01.368 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:37:31.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:37:31.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:38:01.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:38:01.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:38:16.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:38:16.251 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-10T01:38:16.271 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_28_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_29_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_30_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_31_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_32_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_33_00_UTC 2023-05-10T01:38:16.272 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_34_00_UTC 2023-05-10T01:38:16.273 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_35_00_UTC 2023-05-10T01:38:16.273 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_36_00_UTC 2023-05-10T01:38:16.273 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_37_00_UTC 2023-05-10T01:38:16.273 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_38_00_UTC 2023-05-10T01:38:16.274 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_28_00_UTC', 'scheduled-2023-05-10-01_29_00_UTC', 'scheduled-2023-05-10-01_30_00_UTC', 'scheduled-2023-05-10-01_31_00_UTC', 'scheduled-2023-05-10-01_32_00_UTC', 'scheduled-2023-05-10-01_33_00_UTC', 'scheduled-2023-05-10-01_34_00_UTC', 'scheduled-2023-05-10-01_35_00_UTC', 'scheduled-2023-05-10-01_36_00_UTC', 'scheduled-2023-05-10-01_37_00_UTC', 'scheduled-2023-05-10-01_38_00_UTC'] 2023-05-10T01:38:16.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-05-10T01:38:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.447+0000 7f5c562e9700 1 Processor -- start 2023-05-10T01:38:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.447+0000 7f5c562e9700 1 -- start start 2023-05-10T01:38:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c562e9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c50153cf0 0x7f5c50063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c562e9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c501540d0 0x7f5c500bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c562e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c500a7c80 con 0x7f5c500622a0 2023-05-10T01:38:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c562e9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c50067f50 con 0x7f5c501540d0 2023-05-10T01:38:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c562e9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c500a7ef0 con 0x7f5c50153cf0 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c501540d0 0x7f5c500bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c501540d0 0x7f5c500bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40174/0 (socket says 172.21.15.52:40174) 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 -- 172.21.15.52:0/3887108106 learned_addr learned my addr 172.21.15.52:0/3887108106 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c4ffff700 1 --2- 172.21.15.52:0/3887108106 >> v2:172.21.15.172:3300/0 conn(0x7f5c50153cf0 0x7f5c50063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 -- 172.21.15.52:0/3887108106 >> v2:172.21.15.172:3300/0 conn(0x7f5c50153cf0 msgr2=0x7f5c50063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 --2- 172.21.15.52:0/3887108106 >> v2:172.21.15.172:3300/0 conn(0x7f5c50153cf0 0x7f5c50063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 -- 172.21.15.52:0/3887108106 >> v1:172.21.15.52:6789/0 conn(0x7f5c500622a0 legacy=0x7f5c50157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 -- 172.21.15.52:0/3887108106 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500a81d0 con 0x7f5c501540d0 2023-05-10T01:38:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c4f7fe700 1 -- 172.21.15.52:0/3887108106 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240653653 0 0) 0x7f5c500a7c80 con 0x7f5c500622a0 2023-05-10T01:38:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c47fff700 1 --2- 172.21.15.52:0/3887108106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c501540d0 0x7f5c500bf230 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f5c5005ec80 tx=0x7f5c380090f0).ready entity=mon.0 client_cookie=c6ff6e42bb454355 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.448+0000 7f5c4f7fe700 1 -- 172.21.15.52:0/3887108106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800b600 con 0x7f5c501540d0 2023-05-10T01:38:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c4f7fe700 1 -- 172.21.15.52:0/3887108106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b760 con 0x7f5c501540d0 2023-05-10T01:38:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c4f7fe700 1 -- 172.21.15.52:0/3887108106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bae0 con 0x7f5c501540d0 2023-05-10T01:38:16.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 -- 172.21.15.52:0/3887108106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c501540d0 msgr2=0x7f5c500bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 --2- 172.21.15.52:0/3887108106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c501540d0 0x7f5c500bf230 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f5c5005ec80 tx=0x7f5c380090f0).stop 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 -- 172.21.15.52:0/3887108106 shutdown_connections 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 --2- 172.21.15.52:0/3887108106 >> v2:172.21.15.172:3300/0 conn(0x7f5c50153cf0 0x7f5c50063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 --2- 172.21.15.52:0/3887108106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c501540d0 0x7f5c500bf230 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 -- 172.21.15.52:0/3887108106 >> 172.21.15.52:0/3887108106 conn(0x7f5c5005e810 msgr2=0x7f5c500c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 -- 172.21.15.52:0/3887108106 shutdown_connections 2023-05-10T01:38:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.449+0000 7f5c562e9700 1 -- 172.21.15.52:0/3887108106 wait complete. 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.450+0000 7f5c562e9700 1 Processor -- start 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.450+0000 7f5c562e9700 1 -- start start 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 0x7f5c5014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 0x7f5c500c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500c5130 con 0x7f5c50153cf0 2023-05-10T01:38:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c500a84e0 con 0x7f5c500622a0 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c562e9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50168770 con 0x7f5c501540d0 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40180/0 (socket says 172.21.15.52:40180) 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 -- 172.21.15.52:0/1233169743 learned_addr learned my addr 172.21.15.52:0/1233169743 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c4ffff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 0x7f5c5014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c54886700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 0x7f5c500c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 -- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 msgr2=0x7f5c500c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 0x7f5c500c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 -- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 msgr2=0x7f5c5014d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 0x7f5c5014d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c47fff700 1 -- 172.21.15.52:0/1233169743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009370 con 0x7f5c50153cf0 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c4ffff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 0x7f5c5014d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.451+0000 7f5c54886700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 0x7f5c500c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c47fff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5c38009130 tx=0x7f5c38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800b8d0 con 0x7f5c50153cf0 2023-05-10T01:38:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800ba30 con 0x7f5c50153cf0 2023-05-10T01:38:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c500a8730 con 0x7f5c50153cf0 2023-05-10T01:38:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3801b660 con 0x7f5c50153cf0 2023-05-10T01:38:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.452+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c500a8cf0 con 0x7f5c50153cf0 2023-05-10T01:38:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.453+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5006c340 con 0x7f5c50153cf0 2023-05-10T01:38:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.453+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 61) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f5c3800f070 con 0x7f5c50153cf0 2023-05-10T01:38:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.454+0000 7f5c4cff9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 0x7f5c34061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.454+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6615+0+0 (secure 0 0 0) 0x7f5c3807b560 con 0x7f5c50153cf0 2023-05-10T01:38:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.454+0000 7f5c4ffff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 0x7f5c34061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.454+0000 7f5c4ffff700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 0x7f5c34061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5c400098c0 tx=0x7f5c40008040).ready entity=mgr.7654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.458+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c3804c8f0 con 0x7f5c50153cf0 2023-05-10T01:38:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.657+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 --> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c50064550 con 0x7f5c3405ee70 2023-05-10T01:38:16.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.659+0000 7f5c4cff9700 1 -- 172.21.15.52:0/1233169743 <== mgr.7654 v2:172.21.15.172:6832/116173 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f5c50064550 con 0x7f5c3405ee70 2023-05-10T01:38:16.662 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:38:16.662 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:27:13", "first": "2023-05-10T01:28:00", "last": "2023-05-10T01:38:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-05-10T01:38:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 msgr2=0x7f5c34061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 0x7f5c34061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5c400098c0 tx=0x7f5c40008040).stop 2023-05-10T01:38:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 msgr2=0x7f5c500c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5c38009130 tx=0x7f5c38017000).stop 2023-05-10T01:38:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 shutdown_connections 2023-05-10T01:38:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f5c3405ee70 0x7f5c34061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c501540d0 0x7f5c500c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c500622a0 0x7f5c5014d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 --2- 172.21.15.52:0/1233169743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c50153cf0 0x7f5c500c4750 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 >> 172.21.15.52:0/1233169743 conn(0x7f5c5005e810 msgr2=0x7f5c50151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:38:16.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 shutdown_connections 2023-05-10T01:38:16.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.661+0000 7f5c562e9700 1 -- 172.21.15.52:0/1233169743 wait complete. 2023-05-10T01:38:16.675 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:27:13", "first": "2023-05-10T01:28:00", "last": "2023-05-10T01:38:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-05-10T01:38:16.675 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:27:13', 'first': '2023-05-10T01:28:00', 'last': '2023-05-10T01:38:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-05-10T01:38:16.676 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-10T01:38:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.791+0000 7f8c90a75700 1 Processor -- start 2023-05-10T01:38:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.791+0000 7f8c90a75700 1 -- start start 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c90a75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154160 0x7f8c8c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c90a75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c8c069da0 0x7f8c8c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c90a75700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0c0650 con 0x7f8c8c154540 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c90a75700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c0c1af0 con 0x7f8c8c069da0 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c90a75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c0bfd20 con 0x7f8c8c154160 2023-05-10T01:38:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c8c069da0 0x7f8c8c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c8c069da0 0x7f8c8c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40190/0 (socket says 172.21.15.52:40190) 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 -- 172.21.15.52:0/1034576446 learned_addr learned my addr 172.21.15.52:0/1034576446 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8a59c700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154160 0x7f8c8c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 -- 172.21.15.52:0/1034576446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154160 msgr2=0x7f8c8c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154160 0x7f8c8c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 -- 172.21.15.52:0/1034576446 >> v1:172.21.15.172:6789/0 conn(0x7f8c8c154540 legacy=0x7f8c8c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 -- 172.21.15.52:0/1034576446 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0c0000 con 0x7f8c8c069da0 2023-05-10T01:38:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8ad9d700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c069da0 0x7f8c8c0c6150 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f8c84009f20 tx=0x7f8c84009840).ready entity=mon.0 client_cookie=d993cf9007f41f4b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8959a700 1 -- 172.21.15.52:0/1034576446 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400e070 con 0x7f8c8c069da0 2023-05-10T01:38:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8959a700 1 -- 172.21.15.52:0/1034576446 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400b9d0 con 0x7f8c8c069da0 2023-05-10T01:38:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.792+0000 7f8c8959a700 1 -- 172.21.15.52:0/1034576446 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bd50 con 0x7f8c8c069da0 2023-05-10T01:38:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 -- 172.21.15.52:0/1034576446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c069da0 msgr2=0x7f8c8c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c069da0 0x7f8c8c0c6150 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f8c84009f20 tx=0x7f8c84009840).stop 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 -- 172.21.15.52:0/1034576446 shutdown_connections 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154160 0x7f8c8c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 --2- 172.21.15.52:0/1034576446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c069da0 0x7f8c8c0c6150 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 -- 172.21.15.52:0/1034576446 >> 172.21.15.52:0/1034576446 conn(0x7f8c8c0cb6f0 msgr2=0x7f8c8c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 -- 172.21.15.52:0/1034576446 shutdown_connections 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.793+0000 7f8c90a75700 1 -- 172.21.15.52:0/1034576446 wait complete. 2023-05-10T01:38:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.794+0000 7f8c90a75700 1 Processor -- start 2023-05-10T01:38:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.794+0000 7f8c90a75700 1 -- start start 2023-05-10T01:38:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8c069da0 0x7f8c8c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 0x7f8c8c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c154af0 con 0x7f8c8c154160 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c154dd0 con 0x7f8c8c069da0 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c90a75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c1550b0 con 0x7f8c8c154540 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40192/0 (socket says 172.21.15.52:40192) 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 -- 172.21.15.52:0/2655895867 learned_addr learned my addr 172.21.15.52:0/2655895867 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c8a59c700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8c069da0 0x7f8c8c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c8ad9d700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 0x7f8c8c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 -- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 msgr2=0x7f8c8c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 0x7f8c8c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 -- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8c069da0 msgr2=0x7f8c8c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8c069da0 0x7f8c8c158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 -- 172.21.15.52:0/2655895867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84009ae0 con 0x7f8c8c154160 2023-05-10T01:38:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c8ad9d700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 0x7f8c8c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:38:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c89d9b700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f8c8c154920 tx=0x7f8c74007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.795+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740123f0 con 0x7f8c8c154160 2023-05-10T01:38:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.796+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74012550 con 0x7f8c8c154160 2023-05-10T01:38:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.796+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c157a80 con 0x7f8c8c154160 2023-05-10T01:38:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.796+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740128d0 con 0x7f8c8c154160 2023-05-10T01:38:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.796+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c158770 con 0x7f8c8c154160 2023-05-10T01:38:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.797+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c157fa0 con 0x7f8c8c154160 2023-05-10T01:38:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.797+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 61) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f8c74010070 con 0x7f8c8c154160 2023-05-10T01:38:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.797+0000 7f8c827fc700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 0x7f8c70061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:38:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.797+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6615+0+0 (secure 0 0 0) 0x7f8c740792f0 con 0x7f8c8c154160 2023-05-10T01:38:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.798+0000 7f8c8a59c700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 0x7f8c70061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:38:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.798+0000 7f8c8a59c700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 0x7f8c70061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8c7c009c30 tx=0x7f8c7c009060).ready entity=mgr.7654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:38:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:16.802+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c740478f0 con 0x7f8c8c154160 2023-05-10T01:38:17.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.021+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8c8c0666b0 con 0x7f8c8c154160 2023-05-10T01:38:17.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.024+0000 7f8c827fc700 1 -- 172.21.15.52:0/2655895867 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v61) v1 ==== 74+0+148689 (secure 0 0 0) 0x7f8c740444f0 con 0x7f8c8c154160 2023-05-10T01:38:17.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:38:17.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 msgr2=0x7f8c70061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:17.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 0x7f8c70061330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8c7c009c30 tx=0x7f8c7c009060).stop 2023-05-10T01:38:17.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 msgr2=0x7f8c8c14cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f8c8c154920 tx=0x7f8c74007d20).stop 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 shutdown_connections 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:6832/116173,v1:172.21.15.172:6833/116173] conn(0x7f8c7005ee70 0x7f8c70061330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8c154540 0x7f8c8c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8c069da0 0x7f8c8c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 --2- 172.21.15.52:0/2655895867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c8c154160 0x7f8c8c14cc50 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 >> 172.21.15.52:0/2655895867 conn(0x7f8c8c0cb6f0 msgr2=0x7f8c8c14d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:38:17.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 shutdown_connections 2023-05-10T01:38:17.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:38:17.026+0000 7f8c90a75700 1 -- 172.21.15.52:0/2655895867 wait complete. 2023-05-10T01:38:17.040 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":61,"active_gid":7654,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":116173},{"type":"v1","addr":"172.21.15.172:6833","nonce":116173}]},"active_addr":"172.21.15.172:6833/116173","active_change":"2023-05-10T01:27:12.738647+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":8304,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":137,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2908438126}]},{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1724176885}]},{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1877904913}]},{"addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1365175850}]}]} 2023-05-10T01:38:17.044 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-05-10T01:38:17.045 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-10T01:38:17.045 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-05-10T01:38:17.045 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-10T01:38:17.046 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:38:17.074 INFO:tasks.ceph.mgr.x:Stopped 2023-05-10T01:38:17.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-10T01:38:17.117 INFO:tasks.ceph.mgr.x:Started 2023-05-10T01:38:17.299 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:17.296+0000 7fb3f4875680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:38:17.360 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:17.358+0000 7fb3f4875680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:38:17.627 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:17.624+0000 7fb3f4875680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:38:18.230 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:18.227+0000 7fb3f4875680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:38:18.301 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:18.298+0000 7fb3f4875680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:38:18.485 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:18.483+0000 7fb3f4875680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:38:18.900 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:18.895+0000 7fb3f4875680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:38:19.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:18.997+0000 7fb3f4875680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:38:19.151 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:19.149+0000 7fb3f4875680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:38:19.225 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:19.222+0000 7fb3f4875680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:38:19.290 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:19.288+0000 7fb3f4875680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:38:19.542 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:19.540+0000 7fb3f4875680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:38:19.723 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:19.720+0000 7fb3f4875680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:38:20.362 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.360+0000 7fb3f4875680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:38:20.429 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.426+0000 7fb3f4875680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:38:20.501 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.499+0000 7fb3f4875680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:38:20.646 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.643+0000 7fb3f4875680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:38:20.715 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.712+0000 7fb3f4875680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:38:20.827 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.824+0000 7fb3f4875680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:38:20.933 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:20.930+0000 7fb3f4875680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:38:21.220 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.217+0000 7fb3f4875680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:38:21.289 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.286+0000 7fb3f4875680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:38:21.779 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb372055700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.779 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb372055700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb372055700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb372055700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb372055700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb36f850700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb36f850700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb36f850700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.780 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb36f850700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:21.781 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:38:21.776+0000 7fb36f850700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:38:31.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:38:31.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:39:00.772 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:39:00.769+0000 7fb379063700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:39:00.772 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:39:00.769+0000 7fb379063700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:39:00.773 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:39:00.769+0000 7fb379063700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:39:00.773 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:39:00.769+0000 7fb379063700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:39:00.774 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:39:00.769+0000 7fb379063700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:39:02.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:39:02.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:39:32.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:39:32.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:40:02.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:40:02.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:40:33.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:40:33.041 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:41:03.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:41:03.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:41:33.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:41:33.259 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:42:03.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:42:33.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:42:33.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:43:03.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:43:03.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:43:17.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-10T01:43:17.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.251+0000 7fca4de93700 1 Processor -- start 2023-05-10T01:43:17.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.251+0000 7fca4de93700 1 -- start start 2023-05-10T01:43:17.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca4de93700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca480c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca4de93700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca480ca5f0 con 0x7fca48153a90 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca4de93700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca48154610 con 0x7fca480c5d20 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca4de93700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c8820 con 0x7fca480aa200 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca47fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca48153a90 0x7fca48153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49470/0 (socket says 172.21.15.52:49470) 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.252+0000 7fca47fff700 1 -- 172.21.15.52:0/2510890401 learned_addr learned my addr 172.21.15.52:0/2510890401 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca480c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916286476 0 0) 0x7fca480ca5f0 con 0x7fca48153a90 2023-05-10T01:43:17.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca340033f0 con 0x7fca48153a90 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2041923657 0 0) 0x7fca340033f0 con 0x7fca48153a90 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 msgr2=0x7fca480c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca480c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 >> v1:172.21.15.172:6789/0 conn(0x7fca480c5d20 legacy=0x7fca48069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480c8b00 con 0x7fca48153a90 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fca400017f0 con 0x7fca48153a90 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 >> v1:172.21.15.52:6789/0 conn(0x7fca48153a90 legacy=0x7fca48153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca34003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003e00 0x7fca34004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34004b80 0x7fca34005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c8820 con 0x7fca34003e00 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3400b8e0 con 0x7fca34004b80 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3400baa0 con 0x7fca480aa200 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003e00 0x7fca34004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca477fe700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca34003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca47fff700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34004b80 0x7fca34005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 -- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 msgr2=0x7fca34003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca480aa200 0x7fca34003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 -- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34004b80 msgr2=0x7fca34005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34004b80 0x7fca34005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.253+0000 7fca46ffd700 1 -- 172.21.15.52:0/2510890401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340033f0 con 0x7fca34003e00 2023-05-10T01:43:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca46ffd700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003e00 0x7fca34004690 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fca3c009a60 tx=0x7fca3c009060).ready entity=mon.0 client_cookie=aad7437289bfd307 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c009ea0 con 0x7fca34003e00 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c009430 con 0x7fca34003e00 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca467fc700 1 -- 172.21.15.52:0/2510890401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00e870 con 0x7fca34003e00 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 -- 172.21.15.52:0/2510890401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003e00 msgr2=0x7fca34004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 --2- 172.21.15.52:0/2510890401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34003e00 0x7fca34004690 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fca3c009a60 tx=0x7fca3c009060).stop 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca47fff700 1 -- 172.21.15.52:0/2510890401 reap_dead start 2023-05-10T01:43:17.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 -- 172.21.15.52:0/2510890401 shutdown_connections 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 -- 172.21.15.52:0/2510890401 >> 172.21.15.52:0/2510890401 conn(0x7fca480cb6f0 msgr2=0x7fca480c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 -- 172.21.15.52:0/2510890401 shutdown_connections 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.254+0000 7fca4de93700 1 -- 172.21.15.52:0/2510890401 wait complete. 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.255+0000 7fca4de93700 1 Processor -- start 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 -- start start 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34003e00 0x7fca48150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 0x7fca481647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480afec0 con 0x7fca48158a40 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480af2b0 con 0x7fca34003e00 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca4de93700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480af590 con 0x7fca48158ec0 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca46ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca46ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40464/0 (socket says 172.21.15.52:40464) 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca46ffd700 1 -- 172.21.15.52:0/284246605 learned_addr learned my addr 172.21.15.52:0/284246605 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:17.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.256+0000 7fca477fe700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34003e00 0x7fca48150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca47fff700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 0x7fca481647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 -- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 msgr2=0x7fca481647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 0x7fca481647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 -- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34003e00 msgr2=0x7fca48150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34003e00 0x7fca48150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 -- 172.21.15.52:0/284246605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480af870 con 0x7fca48158a40 2023-05-10T01:43:17.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca47fff700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 0x7fca481647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca46ffd700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fca34004610 tx=0x7fca3c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c020070 con 0x7fca48158a40 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c01b9b0 con 0x7fca48158a40 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca480afb50 con 0x7fca48158a40 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c01bd70 con 0x7fca48158a40 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.257+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca48150af0 con 0x7fca48158a40 2023-05-10T01:43:17.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.258+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca48150d10 con 0x7fca48158a40 2023-05-10T01:43:17.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.259+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 66) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fca3c025670 con 0x7fca48158a40 2023-05-10T01:43:17.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.259+0000 7fca2f7fe700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 0x7fca28061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.259+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6787+0+0 (secure 0 0 0) 0x7fca3c07b650 con 0x7fca48158a40 2023-05-10T01:43:17.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.259+0000 7fca477fe700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 0x7fca28061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.260+0000 7fca477fe700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 0x7fca28061330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fca380037c0 tx=0x7fca38009040).ready entity=mgr.7729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.263+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca3c04c9b0 con 0x7fca48158a40 2023-05-10T01:43:17.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.465+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fca48066720 con 0x7fca2805ee70 2023-05-10T01:43:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.470+0000 7fca2f7fe700 1 -- 172.21.15.52:0/284246605 <== mgr.7729 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fca48066720 con 0x7fca2805ee70 2023-05-10T01:43:17.473 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-05-10T01:43:17.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 msgr2=0x7fca28061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 0x7fca28061330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fca380037c0 tx=0x7fca38009040).stop 2023-05-10T01:43:17.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 msgr2=0x7fca481642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fca34004610 tx=0x7fca3c01a000).stop 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 shutdown_connections 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca2805ee70 0x7fca28061330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca48158ec0 0x7fca481647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca34003e00 0x7fca48150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 --2- 172.21.15.52:0/284246605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca48158a40 0x7fca481642e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 >> 172.21.15.52:0/284246605 conn(0x7fca480cb6f0 msgr2=0x7fca480c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 shutdown_connections 2023-05-10T01:43:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.472+0000 7fca4de93700 1 -- 172.21.15.52:0/284246605 wait complete. 2023-05-10T01:43:17.486 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-05-10T01:43:17.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:17.487 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-10T01:43:17.502 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_28_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_29_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_30_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_31_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_32_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_33_00_UTC 2023-05-10T01:43:17.503 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_34_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_35_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_36_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_37_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_38_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_39_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_40_00_UTC 2023-05-10T01:43:17.504 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_41_00_UTC 2023-05-10T01:43:17.505 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_42_00_UTC 2023-05-10T01:43:17.505 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_43_00_UTC 2023-05-10T01:43:17.505 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-05-10-01_28_00_UTC', 'scheduled-2023-05-10-01_29_00_UTC', 'scheduled-2023-05-10-01_30_00_UTC', 'scheduled-2023-05-10-01_31_00_UTC', 'scheduled-2023-05-10-01_32_00_UTC', 'scheduled-2023-05-10-01_33_00_UTC', 'scheduled-2023-05-10-01_34_00_UTC', 'scheduled-2023-05-10-01_35_00_UTC', 'scheduled-2023-05-10-01_36_00_UTC', 'scheduled-2023-05-10-01_37_00_UTC', 'scheduled-2023-05-10-01_38_00_UTC', 'scheduled-2023-05-10-01_39_00_UTC', 'scheduled-2023-05-10-01_40_00_UTC', 'scheduled-2023-05-10-01_41_00_UTC', 'scheduled-2023-05-10-01_42_00_UTC', 'scheduled-2023-05-10-01_43_00_UTC'] 2023-05-10T01:43:17.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-05-10T01:43:17.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.659+0000 7f70532ea700 1 Processor -- start 2023-05-10T01:43:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.659+0000 7f70532ea700 1 -- start start 2023-05-10T01:43:17.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f70532ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f704c0aa200 0x7f704c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f70532ea700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c153a90 0x7f704c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f70532ea700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c0c8820 con 0x7f704c0c5d20 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f70532ea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c0ca5f0 con 0x7f704c0aa200 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f70532ea700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0c8b00 con 0x7f704c153a90 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f704c0aa200 0x7f704c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f704c0aa200 0x7f704c0c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40472/0 (socket says 172.21.15.52:40472) 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 -- 172.21.15.52:0/799435516 learned_addr learned my addr 172.21.15.52:0/799435516 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7051887700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c153a90 0x7f704c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 -- 172.21.15.52:0/799435516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c153a90 msgr2=0x7f704c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c153a90 0x7f704c153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 -- 172.21.15.52:0/799435516 >> v1:172.21.15.172:6789/0 conn(0x7f704c0c5d20 legacy=0x7f704c069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 -- 172.21.15.52:0/799435516 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c0c8de0 con 0x7f704c0aa200 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f7050885700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c0aa200 0x7f704c0c6100 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f7040006fd0 tx=0x7f70400090f0).ready entity=mon.0 client_cookie=358c3e3abe62e848 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f704bfff700 1 -- 172.21.15.52:0/799435516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000b600 con 0x7f704c0aa200 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f704bfff700 1 -- 172.21.15.52:0/799435516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000b760 con 0x7f704c0aa200 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.660+0000 7f704bfff700 1 -- 172.21.15.52:0/799435516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000bae0 con 0x7f704c0aa200 2023-05-10T01:43:17.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 -- 172.21.15.52:0/799435516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c0aa200 msgr2=0x7f704c0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c0aa200 0x7f704c0c6100 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f7040006fd0 tx=0x7f70400090f0).stop 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 -- 172.21.15.52:0/799435516 shutdown_connections 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c153a90 0x7f704c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 --2- 172.21.15.52:0/799435516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c0aa200 0x7f704c0c6100 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 -- 172.21.15.52:0/799435516 >> 172.21.15.52:0/799435516 conn(0x7f704c0cb6f0 msgr2=0x7f704c0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 -- 172.21.15.52:0/799435516 shutdown_connections 2023-05-10T01:43:17.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.661+0000 7f70532ea700 1 -- 172.21.15.52:0/799435516 wait complete. 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.662+0000 7f70532ea700 1 Processor -- start 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.662+0000 7f70532ea700 1 -- start start 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f704c0aa200 0x7f704c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 0x7f704c13b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0c1cc0 con 0x7f704c153a90 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0c2b20 con 0x7f704c0aa200 2023-05-10T01:43:17.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f70532ea700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c14fb60 con 0x7f704c0c5d20 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40480/0 (socket says 172.21.15.52:40480) 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 -- 172.21.15.52:0/1853935590 learned_addr learned my addr 172.21.15.52:0/1853935590 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051086700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f704c0aa200 0x7f704c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7050885700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 0x7f704c13b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 -- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 msgr2=0x7f704c13b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 0x7f704c13b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 -- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f704c0aa200 msgr2=0x7f704c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f704c0aa200 0x7f704c14f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7051887700 1 -- 172.21.15.52:0/1853935590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009370 con 0x7f704c153a90 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.663+0000 7f7050885700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 0x7f704c13b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f7051887700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f703c00d630 tx=0x7f703c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c011590 con 0x7f704c153a90 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0116f0 con 0x7f704c153a90 2023-05-10T01:43:17.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c0c1f10 con 0x7f704c153a90 2023-05-10T01:43:17.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c011a70 con 0x7f704c153a90 2023-05-10T01:43:17.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.664+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c0c24d0 con 0x7f704c153a90 2023-05-10T01:43:17.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.665+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c066720 con 0x7f704c153a90 2023-05-10T01:43:17.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.665+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 66) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f703c01c460 con 0x7f704c153a90 2023-05-10T01:43:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.665+0000 7f70497fa700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 0x7f702c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.666+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f703c079e10 con 0x7f704c153a90 2023-05-10T01:43:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.666+0000 7f7051086700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 0x7f702c061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.666+0000 7f7051086700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 0x7f702c061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7044004290 tx=0x7f7044001560).ready entity=mgr.7729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:17.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.670+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f703c07d030 con 0x7f704c153a90 2023-05-10T01:43:17.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.866+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f704c0c90c0 con 0x7f702c05ee70 2023-05-10T01:43:17.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.868+0000 7f70497fa700 1 -- 172.21.15.52:0/1853935590 <== mgr.7729 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f704c0c90c0 con 0x7f702c05ee70 2023-05-10T01:43:17.871 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:17.871 INFO:teuthology.orchestra.run.smithi052.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:27:13", "first": "2023-05-10T01:28:00", "last": "2023-05-10T01:43:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-05-10T01:43:17.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 msgr2=0x7f702c061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 0x7f702c061330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7044004290 tx=0x7f7044001560).stop 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 msgr2=0x7f704c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f703c00d630 tx=0x7f703c008040).stop 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 shutdown_connections 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f702c05ee70 0x7f702c061330 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f704c153a90 0x7f704c152280 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f704c0aa200 0x7f704c14f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 --2- 172.21.15.52:0/1853935590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f704c0c5d20 0x7f704c13b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:17.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 >> 172.21.15.52:0/1853935590 conn(0x7f704c0cb6f0 msgr2=0x7f704c0b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:17.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 shutdown_connections 2023-05-10T01:43:17.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:17.870+0000 7f70532ea700 1 -- 172.21.15.52:0/1853935590 wait complete. 2023-05-10T01:43:17.885 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-05-10T00:00:00", "created": "2023-05-10T01:27:13", "first": "2023-05-10T01:28:00", "last": "2023-05-10T01:43:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-05-10T01:43:17.885 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-05-10T00:00:00', 'created': '2023-05-10T01:27:13', 'first': '2023-05-10T01:28:00', 'last': '2023-05-10T01:43:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-05-10T01:43:17.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-05-10T01:43:18.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.004+0000 7f3e2924a700 1 Processor -- start 2023-05-10T01:43:18.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.004+0000 7f3e2924a700 1 -- start start 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2924a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e24154080 0x7f3e240aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2924a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e24154460 0x7f3e240a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2924a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240c94c0 con 0x7f3e240aa140 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2924a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240aa5b0 con 0x7f3e24154080 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2924a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240cb7d0 con 0x7f3e24154460 2023-05-10T01:43:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e22d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e24154080 0x7f3e240aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2359e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e240aa140 0x7f3e24068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49502/0 (socket says 172.21.15.52:49502) 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e2359e700 1 -- 172.21.15.52:0/2910600247 learned_addr learned my addr 172.21.15.52:0/2910600247 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e22d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e24154080 0x7f3e240aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40484/0 (socket says 172.21.15.52:40484) 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e22d9d700 1 -- 172.21.15.52:0/2910600247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e24154460 msgr2=0x7f3e240a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e22d9d700 1 --2- 172.21.15.52:0/2910600247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e24154460 0x7f3e240a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e22d9d700 1 -- 172.21.15.52:0/2910600247 >> v1:172.21.15.52:6789/0 conn(0x7f3e240aa140 legacy=0x7f3e24068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e22d9d700 1 -- 172.21.15.52:0/2910600247 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240c88b0 con 0x7f3e24154080 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.005+0000 7f3e21d9b700 1 -- 172.21.15.52:0/2910600247 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202668437 0 0) 0x7f3e240c94c0 con 0x7f3e240aa140 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e22d9d700 1 --2- 172.21.15.52:0/2910600247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e240aac90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f3e1c009760 tx=0x7f3e1c009060).ready entity=mon.0 client_cookie=690139e6fafda5ba server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e21d9b700 1 -- 172.21.15.52:0/2910600247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00b580 con 0x7f3e24154080 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e21d9b700 1 -- 172.21.15.52:0/2910600247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00b6e0 con 0x7f3e24154080 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e21d9b700 1 -- 172.21.15.52:0/2910600247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00ba60 con 0x7f3e24154080 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 -- 172.21.15.52:0/2910600247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 msgr2=0x7f3e240aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 --2- 172.21.15.52:0/2910600247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e240aac90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f3e1c009760 tx=0x7f3e1c009060).stop 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 -- 172.21.15.52:0/2910600247 shutdown_connections 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 --2- 172.21.15.52:0/2910600247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e240aac90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 --2- 172.21.15.52:0/2910600247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e24154460 0x7f3e240a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 -- 172.21.15.52:0/2910600247 >> 172.21.15.52:0/2910600247 conn(0x7f3e24067910 msgr2=0x7f3e240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 -- 172.21.15.52:0/2910600247 shutdown_connections 2023-05-10T01:43:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.006+0000 7f3e2924a700 1 -- 172.21.15.52:0/2910600247 wait complete. 2023-05-10T01:43:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 Processor -- start 2023-05-10T01:43:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 -- start start 2023-05-10T01:43:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e240aa140 0x7f3e24156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e24154460 0x7f3e240c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241558b0 con 0x7f3e24154080 2023-05-10T01:43:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24155b90 con 0x7f3e24154460 2023-05-10T01:43:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2924a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24155e70 con 0x7f3e240aa140 2023-05-10T01:43:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40490/0 (socket says 172.21.15.52:40490) 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.008+0000 7f3e2259c700 1 -- 172.21.15.52:0/270885826 learned_addr learned my addr 172.21.15.52:0/270885826 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2359e700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e24154460 0x7f3e240c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e22d9d700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e240aa140 0x7f3e24156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 -- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e240aa140 msgr2=0x7f3e24156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e240aa140 0x7f3e24156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 -- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e24154460 msgr2=0x7f3e240c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e24154460 0x7f3e240c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 -- 172.21.15.52:0/270885826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0092a0 con 0x7f3e24154080 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2259c700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f3e1800b530 tx=0x7f3e180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800d4a0 con 0x7f3e24154080 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1800d620 con 0x7f3e24154080 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e24156150 con 0x7f3e24154080 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800d9e0 con 0x7f3e24154080 2023-05-10T01:43:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.009+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e24156e40 con 0x7f3e24154080 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.010+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24156670 con 0x7f3e24154080 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.010+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 66) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f3e1800f030 con 0x7f3e24154080 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.011+0000 7f3e0affd700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 0x7f3e04061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.011+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6787+0+0 (secure 0 0 0) 0x7f3e18079c70 con 0x7f3e24154080 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.011+0000 7f3e22d9d700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 0x7f3e04061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.011+0000 7f3e22d9d700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 0x7f3e04061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3e1c00b340 tx=0x7f3e1c017000).ready entity=mgr.7729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:18.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.015+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e24156670 con 0x7f3e24154080 2023-05-10T01:43:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.213+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e24156670 con 0x7f3e0405ee70 2023-05-10T01:43:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.218+0000 7f3e0affd700 1 -- 172.21.15.52:0/270885826 <== mgr.7729 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f3e24156670 con 0x7f3e0405ee70 2023-05-10T01:43:18.221 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-05-10T01:43:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.219+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 msgr2=0x7f3e04061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.219+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 0x7f3e04061330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3e1c00b340 tx=0x7f3e1c017000).stop 2023-05-10T01:43:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 msgr2=0x7f3e2413a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f3e1800b530 tx=0x7f3e180090f0).stop 2023-05-10T01:43:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 shutdown_connections 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e0405ee70 0x7f3e04061330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e24154460 0x7f3e240c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e240aa140 0x7f3e24156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 --2- 172.21.15.52:0/270885826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e24154080 0x7f3e2413a130 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 >> 172.21.15.52:0/270885826 conn(0x7f3e24067910 msgr2=0x7f3e240cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 shutdown_connections 2023-05-10T01:43:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:18.220+0000 7f3e2924a700 1 -- 172.21.15.52:0/270885826 wait complete. 2023-05-10T01:43:18.234 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-05-10T01:43:18.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.235 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-05-10T01:43:18.251 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_28_00_UTC 2023-05-10T01:43:18.251 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_29_00_UTC 2023-05-10T01:43:18.251 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_30_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_31_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_32_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_33_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_34_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_35_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_36_00_UTC 2023-05-10T01:43:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_37_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_38_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_39_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_40_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_41_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_42_00_UTC 2023-05-10T01:43:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_43_00_UTC 2023-05-10T01:43:18.253 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_28_00_UTC 2023-05-10T01:43:18.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.254 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_28_00_UTC) 2023-05-10T01:43:18.310 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_29_00_UTC 2023-05-10T01:43:18.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.312 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_29_00_UTC) 2023-05-10T01:43:18.370 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_30_00_UTC 2023-05-10T01:43:18.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.371 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_30_00_UTC) 2023-05-10T01:43:18.430 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_31_00_UTC 2023-05-10T01:43:18.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.431 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_31_00_UTC) 2023-05-10T01:43:18.490 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_32_00_UTC 2023-05-10T01:43:18.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.491 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_32_00_UTC) 2023-05-10T01:43:18.549 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_33_00_UTC 2023-05-10T01:43:18.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.550 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_33_00_UTC) 2023-05-10T01:43:18.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_34_00_UTC 2023-05-10T01:43:18.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.609 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_34_00_UTC) 2023-05-10T01:43:18.668 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_35_00_UTC 2023-05-10T01:43:18.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.669 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_35_00_UTC) 2023-05-10T01:43:18.728 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_36_00_UTC 2023-05-10T01:43:18.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.729 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_36_00_UTC) 2023-05-10T01:43:18.788 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_37_00_UTC 2023-05-10T01:43:18.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.789 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_37_00_UTC) 2023-05-10T01:43:18.848 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_38_00_UTC 2023-05-10T01:43:18.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.849 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_38_00_UTC) 2023-05-10T01:43:18.908 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_39_00_UTC 2023-05-10T01:43:18.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.909 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_39_00_UTC) 2023-05-10T01:43:18.967 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_40_00_UTC 2023-05-10T01:43:18.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:18.968 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_40_00_UTC) 2023-05-10T01:43:19.027 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_41_00_UTC 2023-05-10T01:43:19.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:19.028 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_41_00_UTC) 2023-05-10T01:43:19.087 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_42_00_UTC 2023-05-10T01:43:19.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:19.088 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_42_00_UTC) 2023-05-10T01:43:19.147 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_43_00_UTC 2023-05-10T01:43:19.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:19.148 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-05-10-01_43_00_UTC) 2023-05-10T01:43:19.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:19.208 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-05-10T01:43:19.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:43:19.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.420+0000 7fe91b749700 1 Processor -- start 2023-05-10T01:43:19.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.420+0000 7fe91b749700 1 -- start start 2023-05-10T01:43:19.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9140c5d20 0x7fe9140aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe914069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe914153a90 0x7fe914153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140c8820 con 0x7fe914153a90 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140c8b00 con 0x7fe9140c5d20 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe91b749700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c8de0 con 0x7fe9140c6100 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe914153a90 0x7fe914153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe914153a90 0x7fe914153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40500/0 (socket says 172.21.15.52:40500) 2023-05-10T01:43:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 -- 172.21.15.52:0/671835931 learned_addr learned my addr 172.21.15.52:0/671835931 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe918ce4700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe914069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe9194e5700 1 --2- 172.21.15.52:0/671835931 >> v2:172.21.15.172:3300/0 conn(0x7fe9140c5d20 0x7fe9140aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 -- 172.21.15.52:0/671835931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 msgr2=0x7fe914069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe914069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 -- 172.21.15.52:0/671835931 >> v2:172.21.15.172:3300/0 conn(0x7fe9140c5d20 msgr2=0x7fe9140aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:19.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 --2- 172.21.15.52:0/671835931 >> v2:172.21.15.172:3300/0 conn(0x7fe9140c5d20 0x7fe9140aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 -- 172.21.15.52:0/671835931 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140c90c0 con 0x7fe914153a90 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe919ce6700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe914153f00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fe91406c000 tx=0x7fe904009840).ready entity=mon.0 client_cookie=c149e53dafae1308 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe913fff700 1 -- 172.21.15.52:0/671835931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400e070 con 0x7fe914153a90 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe913fff700 1 -- 172.21.15.52:0/671835931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400ba50 con 0x7fe914153a90 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.421+0000 7fe913fff700 1 -- 172.21.15.52:0/671835931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400bdd0 con 0x7fe914153a90 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 -- 172.21.15.52:0/671835931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 msgr2=0x7fe914153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe914153f00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fe91406c000 tx=0x7fe904009840).stop 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 -- 172.21.15.52:0/671835931 shutdown_connections 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe914153f00 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 --2- 172.21.15.52:0/671835931 >> v2:172.21.15.172:3300/0 conn(0x7fe9140c5d20 0x7fe9140aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 --2- 172.21.15.52:0/671835931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe914069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 -- 172.21.15.52:0/671835931 >> 172.21.15.52:0/671835931 conn(0x7fe9140cb6f0 msgr2=0x7fe9140c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 -- 172.21.15.52:0/671835931 shutdown_connections 2023-05-10T01:43:19.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.422+0000 7fe91b749700 1 -- 172.21.15.52:0/671835931 wait complete. 2023-05-10T01:43:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.423+0000 7fe91b749700 1 Processor -- start 2023-05-10T01:43:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.423+0000 7fe91b749700 1 -- start start 2023-05-10T01:43:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 0x7fe91414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe9140a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c1cc0 con 0x7fe914153a90 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c1fa0 con 0x7fe9140c5d20 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe91b749700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c2280 con 0x7fe9140c6100 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe919ce6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe919ce6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40506/0 (socket says 172.21.15.52:40506) 2023-05-10T01:43:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe919ce6700 1 -- 172.21.15.52:0/3107903019 learned_addr learned my addr 172.21.15.52:0/3107903019 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.424+0000 7fe9194e5700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 0x7fe91414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe918ce4700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe9140a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 -- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 msgr2=0x7fe9140a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe9140a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 -- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 msgr2=0x7fe91414cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 0x7fe91414cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 -- 172.21.15.52:0/3107903019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904009ae0 con 0x7fe914153a90 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe9194e5700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 0x7fe91414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe919ce6700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fe914083c40 tx=0x7fe9140c7050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040092e0 con 0x7fe914153a90 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90401e470 con 0x7fe914153a90 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9140c2560 con 0x7fe914153a90 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90401e810 con 0x7fe914153a90 2023-05-10T01:43:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.425+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91414d470 con 0x7fe914153a90 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.426+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe914066720 con 0x7fe914153a90 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.426+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 66) v1 ==== 75339+0+0 (secure 0 0 0) 0x7fe904025030 con 0x7fe914153a90 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.426+0000 7fe9117fa700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 0x7fe8f4061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.427+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6787+0+0 (secure 0 0 0) 0x7fe90407b6c0 con 0x7fe914153a90 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.427+0000 7fe9194e5700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 0x7fe8f4061330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.427+0000 7fe9194e5700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 0x7fe8f4061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe90c009810 tx=0x7fe90c008040).ready entity=mgr.7729 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:19.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.431+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe90404c940 con 0x7fe914153a90 2023-05-10T01:43:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.652+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe91406c340 con 0x7fe914153a90 2023-05-10T01:43:19.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.869+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe90401b040 con 0x7fe914153a90 2023-05-10T01:43:19.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.870+0000 7fe9117fa700 1 -- 172.21.15.52:0/3107903019 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v67) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe904042b10 con 0x7fe914153a90 2023-05-10T01:43:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 msgr2=0x7fe8f4061330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 0x7fe8f4061330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe90c009810 tx=0x7fe90c008040).stop 2023-05-10T01:43:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 msgr2=0x7fe9140ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fe914083c40 tx=0x7fe9140c7050).stop 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 shutdown_connections 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe8f405ee70 0x7fe8f4061330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe914153a90 0x7fe9140ae5e0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9140c5d20 0x7fe91414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 --2- 172.21.15.52:0/3107903019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9140c6100 0x7fe9140a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 >> 172.21.15.52:0/3107903019 conn(0x7fe9140cb6f0 msgr2=0x7fe9140bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 shutdown_connections 2023-05-10T01:43:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:19.872+0000 7fe91b749700 1 -- 172.21.15.52:0/3107903019 wait complete. 2023-05-10T01:43:19.887 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:43:19.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:43:19.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:43:19.946 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:43:19.947 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:43:19.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:19.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:43:20.018 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:20.015+0000 7f359d60b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:43:20.021 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:20.019+0000 7f007b53c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:43:20.083 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:20.081+0000 7f007b53c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:43:20.084 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:20.080+0000 7f359d60b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:43:20.353 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:20.351+0000 7f007b53c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:43:20.372 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:20.366+0000 7f359d60b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:43:20.965 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:20.958+0000 7f007b53c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:43:21.027 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:21.024+0000 7f359d60b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:43:21.031 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.029+0000 7f007b53c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:43:21.095 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:21.092+0000 7f359d60b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:43:21.216 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.214+0000 7f007b53c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:43:21.290 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:21.286+0000 7f359d60b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:43:21.629 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.627+0000 7f007b53c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:43:21.726 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:21.723+0000 7f359d60b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:43:21.732 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.729+0000 7f007b53c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:21.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:43:21.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:21.756 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:43:21.771 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:21.838 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:21.835+0000 7f359d60b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:21.894 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.891+0000 7f007b53c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:21.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.949+0000 7f3900593700 1 Processor -- start 2023-05-10T01:43:21.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.950+0000 7f3900593700 1 -- start start 2023-05-10T01:43:21.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.950+0000 7f3900593700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8068c60 0x7f38f8154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.950+0000 7f3900593700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38f8064ff0 0x7f38f80654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.950+0000 7f3900593700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f8067550 con 0x7f38f8153ea0 2023-05-10T01:43:21.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.950+0000 7f3900593700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f8065990 con 0x7f38f8064ff0 2023-05-10T01:43:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f3900593700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80bc9a0 con 0x7f38f8068c60 2023-05-10T01:43:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38f8064ff0 0x7f38f80654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38f8064ff0 0x7f38f80654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40592/0 (socket says 172.21.15.52:40592) 2023-05-10T01:43:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 -- 172.21.15.52:0/449015595 learned_addr learned my addr 172.21.15.52:0/449015595 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38fdb2e700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8068c60 0x7f38f8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 -- 172.21.15.52:0/449015595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8068c60 msgr2=0x7f38f8154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8068c60 0x7f38f8154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 -- 172.21.15.52:0/449015595 >> v1:172.21.15.172:6789/0 conn(0x7f38f8153ea0 legacy=0x7f38f8066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 -- 172.21.15.52:0/449015595 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80bcc80 con 0x7f38f8064ff0 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38feb30700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80654a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f38f0006fd0 tx=0x7f38f00090f0).ready entity=mon.0 client_cookie=c23fcdc6ccc3b58 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38fd32d700 1 -- 172.21.15.52:0/449015595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000b580 con 0x7f38f8064ff0 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38fd32d700 1 -- 172.21.15.52:0/449015595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000b6e0 con 0x7f38f8064ff0 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.951+0000 7f38fd32d700 1 -- 172.21.15.52:0/449015595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000ba60 con 0x7f38f8064ff0 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 -- 172.21.15.52:0/449015595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 msgr2=0x7f38f80654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80654a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f38f0006fd0 tx=0x7f38f00090f0).stop 2023-05-10T01:43:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 -- 172.21.15.52:0/449015595 shutdown_connections 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80654a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 --2- 172.21.15.52:0/449015595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8068c60 0x7f38f8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 -- 172.21.15.52:0/449015595 >> 172.21.15.52:0/449015595 conn(0x7f38f80c4420 msgr2=0x7f38f80c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 -- 172.21.15.52:0/449015595 shutdown_connections 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.952+0000 7f3900593700 1 -- 172.21.15.52:0/449015595 wait complete. 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.953+0000 7f3900593700 1 Processor -- start 2023-05-10T01:43:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.953+0000 7f3900593700 1 -- start start 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f8153ea0 0x7f38f8156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8156d20 0x7f38f80abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80ad8a0 con 0x7f38f8064ff0 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81571a0 con 0x7f38f8153ea0 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f3900593700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80acc90 con 0x7f38f8156d20 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40594/0 (socket says 172.21.15.52:40594) 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 -- 172.21.15.52:0/2228222485 learned_addr learned my addr 172.21.15.52:0/2228222485 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fdb2e700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f8153ea0 0x7f38f8156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38feb30700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8156d20 0x7f38f80abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8156d20 msgr2=0x7f38f80abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8156d20 0x7f38f80abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f8153ea0 msgr2=0x7f38f8156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f8153ea0 0x7f38f8156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.954+0000 7f38fe32f700 1 -- 172.21.15.52:0/2228222485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009370 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f38fe32f700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f38e800c7c0 tx=0x7f38e80015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8006a20 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8006b80 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8007020 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f80acf70 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.955+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f80ad530 con 0x7f38f8064ff0 2023-05-10T01:43:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.956+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f806c340 con 0x7f38f8064ff0 2023-05-10T01:43:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.956+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f38e8003030 con 0x7f38f8064ff0 2023-05-10T01:43:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.957+0000 7f38f67fc700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 0x7f38d80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.957+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f38e8079d60 con 0x7f38f8064ff0 2023-05-10T01:43:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.957+0000 7f38fdb2e700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 msgr2=0x7f38d80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.957+0000 7f38fdb2e700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 0x7f38d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:21.961+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38e804aee0 con 0x7f38f8064ff0 2023-05-10T01:43:21.977 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:21.975+0000 7f007b53c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:43:22.017 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:22.014+0000 7f359d60b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:22.058 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:22.055+0000 7f007b53c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:43:22.101 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:22.098+0000 7f359d60b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:43:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.158+0000 7f38fdb2e700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 msgr2=0x7f38d80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.158+0000 7f38fdb2e700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 0x7f38d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:43:22.174 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:22.171+0000 7f359d60b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:43:22.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.189+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38f8067550 con 0x7f38f8064ff0 2023-05-10T01:43:22.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.190+0000 7f38f67fc700 1 -- 172.21.15.52:0/2228222485 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f38f8067550 con 0x7f38f8064ff0 2023-05-10T01:43:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:22.194 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:43:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 msgr2=0x7f38d80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 0x7f38d80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 msgr2=0x7f38f80c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f38e800c7c0 tx=0x7f38e80015c0).stop 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 shutdown_connections 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f38d805ee20 0x7f38d80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38f8156d20 0x7f38f80abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38f8064ff0 0x7f38f80c31a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 --2- 172.21.15.52:0/2228222485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f8153ea0 0x7f38f8156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 >> 172.21.15.52:0/2228222485 conn(0x7f38f80c4420 msgr2=0x7f38f81533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 shutdown_connections 2023-05-10T01:43:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.192+0000 7f3900593700 1 -- 172.21.15.52:0/2228222485 wait complete. 2023-05-10T01:43:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:43:22.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:22.338 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:22.335+0000 7f007b53c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:43:22.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.380+0000 7f2cf8063700 1 Processor -- start 2023-05-10T01:43:22.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.380+0000 7f2cf8063700 1 -- start start 2023-05-10T01:43:22.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf8063700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2cf0154540 0x7f2cf0069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf8063700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cf0069b80 0x7f2cf00c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf8063700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00c0650 con 0x7f2cf0154160 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf8063700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf0069fb0 con 0x7f2cf0069b80 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf8063700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00bfd20 con 0x7f2cf0154540 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cf0069b80 0x7f2cf00c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2cf0069b80 0x7f2cf00c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40608/0 (socket says 172.21.15.52:40608) 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 -- 172.21.15.52:0/596513086 learned_addr learned my addr 172.21.15.52:0/596513086 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf55fe700 1 --2- 172.21.15.52:0/596513086 >> v2:172.21.15.172:3300/0 conn(0x7f2cf0154540 0x7f2cf0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 -- 172.21.15.52:0/596513086 >> v2:172.21.15.172:3300/0 conn(0x7f2cf0154540 msgr2=0x7f2cf0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:22.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 --2- 172.21.15.52:0/596513086 >> v2:172.21.15.172:3300/0 conn(0x7f2cf0154540 0x7f2cf0069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 -- 172.21.15.52:0/596513086 >> v1:172.21.15.172:6789/0 conn(0x7f2cf0154160 legacy=0x7f2cf00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 -- 172.21.15.52:0/596513086 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00c0000 con 0x7f2cf0069b80 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf6600700 1 --2- 172.21.15.52:0/596513086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf00c0ae0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f2cf00844d0 tx=0x7f2ce8009840).ready entity=mon.0 client_cookie=7d5d37b97077d0f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf4dfd700 1 -- 172.21.15.52:0/596513086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800e070 con 0x7f2cf0069b80 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf4dfd700 1 -- 172.21.15.52:0/596513086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800ba20 con 0x7f2cf0069b80 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.381+0000 7f2cf4dfd700 1 -- 172.21.15.52:0/596513086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800bda0 con 0x7f2cf0069b80 2023-05-10T01:43:22.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 -- 172.21.15.52:0/596513086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 msgr2=0x7f2cf00c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 --2- 172.21.15.52:0/596513086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf00c0ae0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f2cf00844d0 tx=0x7f2ce8009840).stop 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 -- 172.21.15.52:0/596513086 shutdown_connections 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 --2- 172.21.15.52:0/596513086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf00c0ae0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 --2- 172.21.15.52:0/596513086 >> v2:172.21.15.172:3300/0 conn(0x7f2cf0154540 0x7f2cf0069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 -- 172.21.15.52:0/596513086 >> 172.21.15.52:0/596513086 conn(0x7f2cf00cb6f0 msgr2=0x7f2cf00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 -- 172.21.15.52:0/596513086 shutdown_connections 2023-05-10T01:43:22.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.382+0000 7f2cf8063700 1 -- 172.21.15.52:0/596513086 wait complete. 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.383+0000 7f2cf8063700 1 Processor -- start 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.383+0000 7f2cf8063700 1 -- start start 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cf0154160 0x7f2cf0145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cf0154540 0x7f2cf00aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01475e0 con 0x7f2cf0069b80 2023-05-10T01:43:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01466f0 con 0x7f2cf0154540 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf8063700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01469d0 con 0x7f2cf0154160 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40610/0 (socket says 172.21.15.52:40610) 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 -- 172.21.15.52:0/3352956163 learned_addr learned my addr 172.21.15.52:0/3352956163 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf55fe700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cf0154160 0x7f2cf0145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf6600700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cf0154540 0x7f2cf00aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 -- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cf0154160 msgr2=0x7f2cf0145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cf0154160 0x7f2cf0145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 -- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cf0154540 msgr2=0x7f2cf00aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cf0154540 0x7f2cf00aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.384+0000 7f2cf5dff700 1 -- 172.21.15.52:0/3352956163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009ae0 con 0x7f2cf0069b80 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cf5dff700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f2cec00c4c0 tx=0x7f2cec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00ce70 con 0x7f2cf0069b80 2023-05-10T01:43:22.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec001e90 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0146cb0 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec007250 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.385+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0147270 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.386+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf01478c0 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.386+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2cec010070 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.387+0000 7f2cddffb700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 0x7f2cd00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.387+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f2cec0795b0 con 0x7f2cf0069b80 2023-05-10T01:43:22.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.387+0000 7f2cf55fe700 1 -- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 msgr2=0x7f2cd00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:22.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.387+0000 7f2cf55fe700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 0x7f2cd00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:22.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.391+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2cec04a840 con 0x7f2cf0069b80 2023-05-10T01:43:22.485 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:22.482+0000 7f359d60b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:43:22.525 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:22.523+0000 7f007b53c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:22.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.565+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cf00666b0 con 0x7f2cf0069b80 2023-05-10T01:43:22.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.566+0000 7f2cddffb700 1 -- 172.21.15.52:0/3352956163 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18205 (secure 0 0 0) 0x7f2cec04de60 con 0x7f2cf0069b80 2023-05-10T01:43:22.569 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:22.569 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:21.868085+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":141,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/1724176885":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1877904913":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1365175850":"2023-05-11T01:38:21.301276+0000","172.21.15.172:6833/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:6832/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2908438126":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/2781526674":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2889441413":"2023-05-11T01:27:12.738244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 msgr2=0x7f2cd00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 0x7f2cd00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 msgr2=0x7f2cf0147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f2cec00c4c0 tx=0x7f2cec007e00).stop 2023-05-10T01:43:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 shutdown_connections 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2cd005ee20 0x7f2cd00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cf0154540 0x7f2cf00aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0069b80 0x7f2cf0147a70 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 --2- 172.21.15.52:0/3352956163 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2cf0154160 0x7f2cf0145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 >> 172.21.15.52:0/3352956163 conn(0x7f2cf00cb6f0 msgr2=0x7f2cf00aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 shutdown_connections 2023-05-10T01:43:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.568+0000 7f2cf8063700 1 -- 172.21.15.52:0/3352956163 wait complete. 2023-05-10T01:43:22.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:26:54.856983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:26:55.277609+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 141, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:43:22.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:43:22.689 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:22.686+0000 7f359d60b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:22.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.729+0000 7f362b59e700 1 Processor -- start 2023-05-10T01:43:22.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.729+0000 7f362b59e700 1 -- start start 2023-05-10T01:43:22.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f362c153ba0 0x7f362c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f362c153f80 0x7f362c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c0bd800 0x7f362c0bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c05e750 con 0x7f362c153ba0 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c069ee0 con 0x7f362c153f80 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0bf530 con 0x7f362c0bd800 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f362c153ba0 0x7f362c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f362c153ba0 0x7f362c0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40618/0 (socket says 172.21.15.52:40618) 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 -- 172.21.15.52:0/2793289410 learned_addr learned my addr 172.21.15.52:0/2793289410 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f3629d9b700 1 --2- 172.21.15.52:0/2793289410 >> v2:172.21.15.172:3300/0 conn(0x7f362c153f80 0x7f362c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362ad9d700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c0bd800 0x7f362c0bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 -- 172.21.15.52:0/2793289410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c0bd800 msgr2=0x7f362c0bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c0bd800 0x7f362c0bdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 -- 172.21.15.52:0/2793289410 >> v2:172.21.15.172:3300/0 conn(0x7f362c153f80 msgr2=0x7f362c067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 --2- 172.21.15.52:0/2793289410 >> v2:172.21.15.172:3300/0 conn(0x7f362c153f80 0x7f362c067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 -- 172.21.15.52:0/2793289410 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0be180 con 0x7f362c153ba0 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362a59c700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c153ba0 0x7f362c0698b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f362c0be7e0 tx=0x7f361c0090f0).ready entity=mon.0 client_cookie=187cc5deed52aa3b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.730+0000 7f362959a700 1 -- 172.21.15.52:0/2793289410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00f510 con 0x7f362c153ba0 2023-05-10T01:43:22.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362959a700 1 -- 172.21.15.52:0/2793289410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c00f670 con 0x7f362c153ba0 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362959a700 1 -- 172.21.15.52:0/2793289410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00f9f0 con 0x7f362c153ba0 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 -- 172.21.15.52:0/2793289410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c153ba0 msgr2=0x7f362c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c153ba0 0x7f362c0698b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f362c0be7e0 tx=0x7f361c0090f0).stop 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 -- 172.21.15.52:0/2793289410 shutdown_connections 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c0bd800 0x7f362c0bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 --2- 172.21.15.52:0/2793289410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c153ba0 0x7f362c0698b0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 --2- 172.21.15.52:0/2793289410 >> v2:172.21.15.172:3300/0 conn(0x7f362c153f80 0x7f362c067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 -- 172.21.15.52:0/2793289410 >> 172.21.15.52:0/2793289410 conn(0x7f362c062d70 msgr2=0x7f362c05dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:22.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 -- 172.21.15.52:0/2793289410 shutdown_connections 2023-05-10T01:43:22.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.731+0000 7f362b59e700 1 -- 172.21.15.52:0/2793289410 wait complete. 2023-05-10T01:43:22.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.732+0000 7f362b59e700 1 Processor -- start 2023-05-10T01:43:22.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.732+0000 7f362b59e700 1 -- start start 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c153ba0 0x7f362c163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c153f80 0x7f362c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0ad8c0 con 0x7f362c0bd800 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0accb0 con 0x7f362c153f80 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0acf90 con 0x7f362c153ba0 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40624/0 (socket says 172.21.15.52:40624) 2023-05-10T01:43:22.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 -- 172.21.15.52:0/2921025091 learned_addr learned my addr 172.21.15.52:0/2921025091 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:22.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f3629d9b700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c153ba0 0x7f362c163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362ad9d700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c153f80 0x7f362c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:22.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 -- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c153ba0 msgr2=0x7f362c163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c153ba0 0x7f362c163f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 -- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c153f80 msgr2=0x7f362c152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c153f80 0x7f362c152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.733+0000 7f362a59c700 1 -- 172.21.15.52:0/2921025091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009370 con 0x7f362c0bd800 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f362a59c700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f362c0656f0 tx=0x7f361c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:22.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00f7e0 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c00f940 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c0ad270 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c01b660 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.734+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c14a580 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.735+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c0be810 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.735+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f361c02b070 con 0x7f362c0bd800 2023-05-10T01:43:22.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.736+0000 7f361a7fc700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 0x7f36080612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:22.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.736+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6875+0+0 (secure 0 0 0) 0x7f361c07b6d0 con 0x7f362c0bd800 2023-05-10T01:43:22.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.736+0000 7f3629d9b700 1 -- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 msgr2=0x7f36080612b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:22.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.736+0000 7f3629d9b700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 0x7f36080612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:22.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.740+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f361c04ca10 con 0x7f362c0bd800 2023-05-10T01:43:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.919+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f362c047150 con 0x7f362c0bd800 2023-05-10T01:43:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.919+0000 7f361a7fc700 1 -- 172.21.15.52:0/2921025091 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7f361c01f0b0 con 0x7f362c0bd800 2023-05-10T01:43:22.923 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:43:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 msgr2=0x7f36080612b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 0x7f36080612b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 msgr2=0x7f362c14a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f362c0656f0 tx=0x7f361c017000).stop 2023-05-10T01:43:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 shutdown_connections 2023-05-10T01:43:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f360805edf0 0x7f36080612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c153f80 0x7f362c152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f362c0bd800 0x7f362c14a090 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 --2- 172.21.15.52:0/2921025091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f362c153ba0 0x7f362c163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 >> 172.21.15.52:0/2921025091 conn(0x7f362c062d70 msgr2=0x7f362c0bed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 shutdown_connections 2023-05-10T01:43:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:22.921+0000 7f362b59e700 1 -- 172.21.15.52:0/2921025091 wait complete. 2023-05-10T01:43:22.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:43:23.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.060+0000 7fe378ced700 1 Processor -- start 2023-05-10T01:43:23.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.060+0000 7fe378ced700 1 -- start start 2023-05-10T01:43:23.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe378ced700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe374153cf0 0x7fe374063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe378ced700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe378ced700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740a7c80 con 0x7fe3740622a0 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe378ced700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe374067f50 con 0x7fe374153cf0 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe378ced700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740a7ef0 con 0x7fe3741540d0 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe37259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe374153cf0 0x7fe374063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe372d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe3740622a0 0x7fe374157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49670/0 (socket says 172.21.15.52:49670) 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe372d9d700 1 -- 172.21.15.52:0/1162809056 learned_addr learned my addr 172.21.15.52:0/1162809056 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe371d9b700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe37259c700 1 -- 172.21.15.52:0/1162809056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 msgr2=0x7fe3740bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe37259c700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe37259c700 1 -- 172.21.15.52:0/1162809056 >> v1:172.21.15.52:6789/0 conn(0x7fe3740622a0 legacy=0x7fe374157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.061+0000 7fe37259c700 1 -- 172.21.15.52:0/1162809056 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740a81d0 con 0x7fe374153cf0 2023-05-10T01:43:23.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe37259c700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe374063fa0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fe35c009760 tx=0x7fe35c009060).ready entity=mon.0 client_cookie=2b1ef5954e9eeb99 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe37159a700 1 -- 172.21.15.52:0/1162809056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00b580 con 0x7fe374153cf0 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe37159a700 1 -- 172.21.15.52:0/1162809056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00b6e0 con 0x7fe374153cf0 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe37159a700 1 -- 172.21.15.52:0/1162809056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00ba60 con 0x7fe374153cf0 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 -- 172.21.15.52:0/1162809056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 msgr2=0x7fe374063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe374063fa0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fe35c009760 tx=0x7fe35c009060).stop 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 -- 172.21.15.52:0/1162809056 shutdown_connections 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe374063fa0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 --2- 172.21.15.52:0/1162809056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.062+0000 7fe378ced700 1 -- 172.21.15.52:0/1162809056 >> 172.21.15.52:0/1162809056 conn(0x7fe37405e810 msgr2=0x7fe3740c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.063+0000 7fe378ced700 1 -- 172.21.15.52:0/1162809056 shutdown_connections 2023-05-10T01:43:23.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.063+0000 7fe378ced700 1 -- 172.21.15.52:0/1162809056 wait complete. 2023-05-10T01:43:23.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 Processor -- start 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 -- start start 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3740622a0 0x7fe3741648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c0bd0 con 0x7fe374153cf0 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740ad3e0 con 0x7fe3740622a0 2023-05-10T01:43:23.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe378ced700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c29c0 con 0x7fe3741540d0 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.064+0000 7fe371d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40658/0 (socket says 172.21.15.52:40658) 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 -- 172.21.15.52:0/1357544297 learned_addr learned my addr 172.21.15.52:0/1357544297 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe372d9d700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe37259c700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3740622a0 0x7fe3741648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 -- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 msgr2=0x7fe3740acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 -- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3740622a0 msgr2=0x7fe3741648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3740622a0 0x7fe3741648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 -- 172.21.15.52:0/1357544297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0092a0 con 0x7fe374153cf0 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe371d9b700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fe36400d890 tx=0x7fe364008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640125f0 con 0x7fe374153cf0 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364012750 con 0x7fe374153cf0 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740a9890 con 0x7fe374153cf0 2023-05-10T01:43:23.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364012ad0 con 0x7fe374153cf0 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.065+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3740a9010 con 0x7fe374153cf0 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.066+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3740a9a20 con 0x7fe374153cf0 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.067+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fe364013480 con 0x7fe374153cf0 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.067+0000 7fe36a7fc700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 0x7fe3580612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.067+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6859+0+0 (secure 0 0 0) 0x7fe36407a060 con 0x7fe374153cf0 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.067+0000 7fe37259c700 1 -- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 msgr2=0x7fe3580612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:23.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.067+0000 7fe37259c700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 0x7fe3580612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.071+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe36404b2a0 con 0x7fe374153cf0 2023-05-10T01:43:23.197 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.195+0000 7f007b53c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:43:23.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.245+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe374064550 con 0x7fe374153cf0 2023-05-10T01:43:23.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.245+0000 7fe36a7fc700 1 -- 172.21.15.52:0/1357544297 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe36404e8c0 con 0x7fe374153cf0 2023-05-10T01:43:23.249 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:43:23.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 msgr2=0x7fe3580612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 0x7fe3580612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 msgr2=0x7fe3740aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fe36400d890 tx=0x7fe364008040).stop 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 shutdown_connections 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe35805ee20 0x7fe3580612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3741540d0 0x7fe3740acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3740622a0 0x7fe3741648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 --2- 172.21.15.52:0/1357544297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe374153cf0 0x7fe3740aca00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 >> 172.21.15.52:0/1357544297 conn(0x7fe37405e810 msgr2=0x7fe3740c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 shutdown_connections 2023-05-10T01:43:23.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.247+0000 7fe378ced700 1 -- 172.21.15.52:0/1357544297 wait complete. 2023-05-10T01:43:23.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:43:23.265 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.262+0000 7f007b53c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:43:23.338 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.336+0000 7f007b53c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:43:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.384+0000 7f50f88c4700 1 Processor -- start 2023-05-10T01:43:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.384+0000 7f50f88c4700 1 -- start start 2023-05-10T01:43:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50f4154460 0x7f50f40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f50f40aa140 0x7f50f4068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40aa560 con 0x7f50f4154460 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40c94c0 con 0x7f50f40aa140 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.385+0000 7f50f88c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40cb7d0 con 0x7f50f4154080 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50f4154460 0x7f50f40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50f4154460 0x7f50f40a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40666/0 (socket says 172.21.15.52:40666) 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 -- 172.21.15.52:0/3895506008 learned_addr learned my addr 172.21.15.52:0/3895506008 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f2d9d700 1 --2- 172.21.15.52:0/3895506008 >> v2:172.21.15.172:3300/0 conn(0x7f50f40aa140 0x7f50f4068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f259c700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 -- 172.21.15.52:0/3895506008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 msgr2=0x7f50f40aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f40aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 -- 172.21.15.52:0/3895506008 >> v2:172.21.15.172:3300/0 conn(0x7f50f40aa140 msgr2=0x7f50f4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 --2- 172.21.15.52:0/3895506008 >> v2:172.21.15.172:3300/0 conn(0x7f50f40aa140 0x7f50f4068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 -- 172.21.15.52:0/3895506008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40c88b0 con 0x7f50f4154460 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f259c700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f40aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f1d9b700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f4154460 0x7f50f40a9c50 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f50f405f9a0 tx=0x7f50e80090f0).ready entity=mon.0 client_cookie=dad94bb2748faa12 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f159a700 1 -- 172.21.15.52:0/3895506008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800b520 con 0x7f50f4154460 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f159a700 1 -- 172.21.15.52:0/3895506008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800b680 con 0x7f50f4154460 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.386+0000 7f50f159a700 1 -- 172.21.15.52:0/3895506008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800ba00 con 0x7f50f4154460 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 -- 172.21.15.52:0/3895506008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f4154460 msgr2=0x7f50f40a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f4154460 0x7f50f40a9c50 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f50f405f9a0 tx=0x7f50e80090f0).stop 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 -- 172.21.15.52:0/3895506008 shutdown_connections 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3895506008 >> v2:172.21.15.172:3300/0 conn(0x7f50f40aa140 0x7f50f4068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f40aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3895506008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f4154460 0x7f50f40a9c50 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 -- 172.21.15.52:0/3895506008 >> 172.21.15.52:0/3895506008 conn(0x7f50f4067910 msgr2=0x7f50f40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 -- 172.21.15.52:0/3895506008 shutdown_connections 2023-05-10T01:43:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.387+0000 7f50f88c4700 1 -- 172.21.15.52:0/3895506008 wait complete. 2023-05-10T01:43:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.388+0000 7f50f88c4700 1 Processor -- start 2023-05-10T01:43:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.388+0000 7f50f88c4700 1 -- start start 2023-05-10T01:43:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50f4154460 0x7f50f4163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4154e80 con 0x7f50f40aa140 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f414f310 con 0x7f50f4154460 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f414f5f0 con 0x7f50f4154080 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40670/0 (socket says 172.21.15.52:40670) 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 -- 172.21.15.52:0/3718313104 learned_addr learned my addr 172.21.15.52:0/3718313104 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f1d9b700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f2d9d700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50f4154460 0x7f50f4163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 -- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 msgr2=0x7f50f414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 -- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50f4154460 msgr2=0x7f50f4163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50f4154460 0x7f50f4163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 -- 172.21.15.52:0/3718313104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8009370 con 0x7f50f40aa140 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f259c700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f50e400d860 tx=0x7f50e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400f520 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400f680 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f414f8d0 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.389+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400fa00 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.390+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f414efe0 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.390+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f4155290 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.391+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f50e401a030 con 0x7f50f40aa140 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.391+0000 7f50e27fc700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 0x7f50d00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.391+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6859+0+0 (secure 0 0 0) 0x7f50e4079950 con 0x7f50f40aa140 2023-05-10T01:43:23.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.391+0000 7f50f1d9b700 1 -- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 msgr2=0x7f50d00612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:23.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.391+0000 7f50f1d9b700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 0x7f50d00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:23.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.395+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50e404abf0 con 0x7f50f40aa140 2023-05-10T01:43:23.406 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.403+0000 7f359d60b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:43:23.479 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.476+0000 7f359d60b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:43:23.483 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.481+0000 7f007b53c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:43:23.552 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.549+0000 7f007b53c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:43:23.558 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.555+0000 7f359d60b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:43:23.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.570+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50f4155440 con 0x7f50f40aa140 2023-05-10T01:43:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.571+0000 7f50e27fc700 1 -- 172.21.15.52:0/3718313104 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50e404e210 con 0x7f50f40aa140 2023-05-10T01:43:23.574 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:43:23.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 msgr2=0x7f50d00612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 0x7f50d00612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 msgr2=0x7f50f40b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f50e400d860 tx=0x7f50e4008040).stop 2023-05-10T01:43:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 shutdown_connections 2023-05-10T01:43:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f50d005ee20 0x7f50d00612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50f4154460 0x7f50f4163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50f40aa140 0x7f50f40b0860 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 --2- 172.21.15.52:0/3718313104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50f4154080 0x7f50f414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 >> 172.21.15.52:0/3718313104 conn(0x7f50f4067910 msgr2=0x7f50f41592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 shutdown_connections 2023-05-10T01:43:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.573+0000 7f50f88c4700 1 -- 172.21.15.52:0/3718313104 wait complete. 2023-05-10T01:43:23.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:43:23.665 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.662+0000 7f007b53c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:43:23.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.706+0000 7f382759e700 1 Processor -- start 2023-05-10T01:43:23.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.706+0000 7f382759e700 1 -- start start 2023-05-10T01:43:23.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3828153f80 0x7f38280a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f38280c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38280c0140 0x7f38280c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3828069f50 con 0x7f3828153f80 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382806a9d0 con 0x7f38280c0140 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280c6660 con 0x7f38280c5cf0 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3828153f80 0x7f38280a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3828153f80 0x7f38280a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40678/0 (socket says 172.21.15.52:40678) 2023-05-10T01:43:23.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 -- 172.21.15.52:0/3274018468 learned_addr learned my addr 172.21.15.52:0/3274018468 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f3825d9b700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f38280c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f3826d9d700 1 --2- 172.21.15.52:0/3274018468 >> v2:172.21.15.172:3300/0 conn(0x7f38280c0140 0x7f38280c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 -- 172.21.15.52:0/3274018468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 msgr2=0x7f38280c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f38280c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 -- 172.21.15.52:0/3274018468 >> v2:172.21.15.172:3300/0 conn(0x7f38280c0140 msgr2=0x7f38280c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 --2- 172.21.15.52:0/3274018468 >> v2:172.21.15.172:3300/0 conn(0x7f38280c0140 0x7f38280c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 -- 172.21.15.52:0/3274018468 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382806a130 con 0x7f3828153f80 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.707+0000 7f382659c700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3828153f80 0x7f38280a9d10 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f382806bdc0 tx=0x7f38180090f0).ready entity=mon.0 client_cookie=16c40a6ae6001cef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382559a700 1 -- 172.21.15.52:0/3274018468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800f510 con 0x7f3828153f80 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382559a700 1 -- 172.21.15.52:0/3274018468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800f670 con 0x7f3828153f80 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382559a700 1 -- 172.21.15.52:0/3274018468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800f9f0 con 0x7f3828153f80 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 -- 172.21.15.52:0/3274018468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3828153f80 msgr2=0x7f38280a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3828153f80 0x7f38280a9d10 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f382806bdc0 tx=0x7f38180090f0).stop 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 -- 172.21.15.52:0/3274018468 shutdown_connections 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 --2- 172.21.15.52:0/3274018468 >> v2:172.21.15.172:3300/0 conn(0x7f38280c0140 0x7f38280c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3828153f80 0x7f38280a9d10 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 --2- 172.21.15.52:0/3274018468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f38280c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 -- 172.21.15.52:0/3274018468 >> 172.21.15.52:0/3274018468 conn(0x7f38280cb5f0 msgr2=0x7f38280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 -- 172.21.15.52:0/3274018468 shutdown_connections 2023-05-10T01:43:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.708+0000 7f382759e700 1 -- 172.21.15.52:0/3274018468 wait complete. 2023-05-10T01:43:23.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.709+0000 7f382759e700 1 Processor -- start 2023-05-10T01:43:23.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.709+0000 7f382759e700 1 -- start start 2023-05-10T01:43:23.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f382814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828153f80 0x7f38280aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280aeac0 con 0x7f38280c0140 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280adeb0 con 0x7f3828153f80 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280ae190 con 0x7f38280c5cf0 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40684/0 (socket says 172.21.15.52:40684) 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f382659c700 1 -- 172.21.15.52:0/1733351252 learned_addr learned my addr 172.21.15.52:0/1733351252 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f3825d9b700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f382814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.710+0000 7f3826d9d700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828153f80 0x7f38280aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 -- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 msgr2=0x7f382814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f382814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 -- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828153f80 msgr2=0x7f38280aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828153f80 0x7f38280aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 -- 172.21.15.52:0/1733351252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009370 con 0x7f38280c0140 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382659c700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f38280668b0 tx=0x7f3818017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800f7e0 con 0x7f38280c0140 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800f940 con 0x7f38280c0140 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38280ae470 con 0x7f38280c0140 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381801b660 con 0x7f38280c0140 2023-05-10T01:43:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.711+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38280adad0 con 0x7f38280c0140 2023-05-10T01:43:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.712+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38280aeda0 con 0x7f38280c0140 2023-05-10T01:43:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.712+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f381802b070 con 0x7f38280c0140 2023-05-10T01:43:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.712+0000 7f38167fc700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 0x7f38040612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.713+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6859+0+0 (secure 0 0 0) 0x7f381807b6c0 con 0x7f38280c0140 2023-05-10T01:43:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.713+0000 7f3825d9b700 1 -- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 msgr2=0x7f38040612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.713+0000 7f3825d9b700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 0x7f38040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:23.747 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.714+0000 7f359d60b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:43:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.717+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f381804ca10 con 0x7f38280c0140 2023-05-10T01:43:23.772 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:23.770+0000 7f007b53c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:23.792 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.789+0000 7f359d60b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:43:23.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.893+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3828083110 con 0x7f38280c0140 2023-05-10T01:43:23.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.893+0000 7f38167fc700 1 -- 172.21.15.52:0/1733351252 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f381801f0a0 con 0x7f38280c0140 2023-05-10T01:43:23.897 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:43:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 msgr2=0x7f38040612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 0x7f38040612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 msgr2=0x7f38280a22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f38280668b0 tx=0x7f3818017000).stop 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 shutdown_connections 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f380405ee20 0x7f38040612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828153f80 0x7f38280aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38280c0140 0x7f38280a22a0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 --2- 172.21.15.52:0/1733351252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38280c5cf0 0x7f382814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 >> 172.21.15.52:0/1733351252 conn(0x7f38280cb5f0 msgr2=0x7f38280c1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 shutdown_connections 2023-05-10T01:43:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:23.895+0000 7f382759e700 1 -- 172.21.15.52:0/1733351252 wait complete. 2023-05-10T01:43:23.910 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:23.914 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:23.911+0000 7f359d60b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:43:24.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.025+0000 7ff928837700 1 Processor -- start 2023-05-10T01:43:24.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.026+0000 7ff928837700 1 -- start start 2023-05-10T01:43:24.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff928837700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff924069da0 0x7ff92415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff928837700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240c0650 con 0x7ff924154540 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff928837700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240c1af0 con 0x7ff924154160 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff928837700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240bfd20 con 0x7ff924069da0 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff921d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff924154540 0x7ff924069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49710/0 (socket says 172.21.15.52:49710) 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff921d9b700 1 -- 172.21.15.52:0/2964327053 learned_addr learned my addr 172.21.15.52:0/2964327053 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff922d9d700 1 --2- 172.21.15.52:0/2964327053 >> v2:172.21.15.172:3300/0 conn(0x7ff924069da0 0x7ff92415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306594778 0 0) 0x7ff9240c0650 con 0x7ff924154540 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9040033f0 con 0x7ff924154540 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24367300 0 0) 0x7ff9240c1af0 con 0x7ff924154160 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9240c0650 con 0x7ff924154160 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff922d9d700 1 -- 172.21.15.52:0/2964327053 >> v1:172.21.15.172:6789/0 conn(0x7ff924154160 legacy=0x7ff9240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff922d9d700 1 -- 172.21.15.52:0/2964327053 >> v1:172.21.15.52:6789/0 conn(0x7ff924154540 legacy=0x7ff924069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff922d9d700 1 -- 172.21.15.52:0/2964327053 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240c0000 con 0x7ff924069da0 2023-05-10T01:43:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.027+0000 7ff922d9d700 1 --2- 172.21.15.52:0/2964327053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff92415f1f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff91c009e60 tx=0x7ff91c009780).ready entity=mon.1 client_cookie=ad281d421493f9e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00e070 con 0x7ff924069da0 2023-05-10T01:43:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00bab0 con 0x7ff924069da0 2023-05-10T01:43:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff92159a700 1 -- 172.21.15.52:0/2964327053 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00be30 con 0x7ff924069da0 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 -- 172.21.15.52:0/2964327053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 msgr2=0x7ff92415f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 --2- 172.21.15.52:0/2964327053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff92415f1f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff91c009e60 tx=0x7ff91c009780).stop 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 -- 172.21.15.52:0/2964327053 shutdown_connections 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 --2- 172.21.15.52:0/2964327053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff92415f1f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 -- 172.21.15.52:0/2964327053 >> 172.21.15.52:0/2964327053 conn(0x7ff9240cb6f0 msgr2=0x7ff9240c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 -- 172.21.15.52:0/2964327053 shutdown_connections 2023-05-10T01:43:24.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.028+0000 7ff928837700 1 -- 172.21.15.52:0/2964327053 wait complete. 2023-05-10T01:43:24.035 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:24.029+0000 7f359d60b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.029+0000 7ff928837700 1 Processor -- start 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.029+0000 7ff928837700 1 -- start start 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff9240b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff924154160 0x7ff9240c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240c2710 con 0x7ff924154540 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240aeb40 con 0x7ff924069da0 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff928837700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240b0d80 con 0x7ff924154160 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40702/0 (socket says 172.21.15.52:40702) 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 -- 172.21.15.52:0/3665115448 learned_addr learned my addr 172.21.15.52:0/3665115448 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff92259c700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff9240b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff921d9b700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff924154160 0x7ff9240c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff924154160 msgr2=0x7ff9240c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff924154160 0x7ff9240c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 msgr2=0x7ff9240b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff9240b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.030+0000 7ff922d9d700 1 -- 172.21.15.52:0/3665115448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009a20 con 0x7ff924154540 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff922d9d700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7ff91c013cc0 tx=0x7ff91c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c013ea0 con 0x7ff924154540 2023-05-10T01:43:24.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c01d630 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924152460 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c01d9f0 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.031+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924152a20 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.032+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924158ca0 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.032+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff91c01dd60 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.033+0000 7ff91a7fc700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 0x7ff9080612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.033+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6859+0+0 (secure 0 0 0) 0x7ff91c07bf10 con 0x7ff924154540 2023-05-10T01:43:24.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.033+0000 7ff92259c700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 msgr2=0x7ff9080612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:24.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.033+0000 7ff92259c700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 0x7ff9080612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:24.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.037+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff91c04d1b0 con 0x7ff924154540 2023-05-10T01:43:24.063 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.061+0000 7f007b53c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:43:24.132 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.130+0000 7f007b53c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:43:24.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.234+0000 7ff92259c700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 msgr2=0x7ff9080612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:24.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.234+0000 7ff92259c700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 0x7ff9080612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:43:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.258+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9240aecd0 con 0x7ff924154540 2023-05-10T01:43:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.258+0000 7ff91a7fc700 1 -- 172.21.15.52:0/3665115448 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff91c0507d0 con 0x7ff924154540 2023-05-10T01:43:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:24.262 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:43:24.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 msgr2=0x7ff9080612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 0x7ff9080612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 msgr2=0x7ff9240c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7ff91c013cc0 tx=0x7ff91c009780).stop 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 shutdown_connections 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff90805ee20 0x7ff9080612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff924154540 0x7ff9240c2220 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff924069da0 0x7ff9240b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 --2- 172.21.15.52:0/3665115448 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff924154160 0x7ff9240c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 >> 172.21.15.52:0/3665115448 conn(0x7ff9240cb6f0 msgr2=0x7ff9240c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 shutdown_connections 2023-05-10T01:43:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.260+0000 7ff928837700 1 -- 172.21.15.52:0/3665115448 wait complete. 2023-05-10T01:43:24.265 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:43:24.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:24.340 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:24.337+0000 7f359d60b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:43:24.417 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:24.414+0000 7f359d60b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:43:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.430+0000 7fa8da9dc700 1 Processor -- start 2023-05-10T01:43:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.430+0000 7fa8da9dc700 1 -- start start 2023-05-10T01:43:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 0x7fa8d40c7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d4065ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8d4151150 0x7fa8d41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40bc5e0 con 0x7fa8d4151150 2023-05-10T01:43:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d4066660 con 0x7fa8d4150d70 2023-05-10T01:43:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da9dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40bbfd0 con 0x7fa8d40c1540 2023-05-10T01:43:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da1db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8d4151150 0x7fa8d41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da1db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8d4151150 0x7fa8d41515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40714/0 (socket says 172.21.15.52:40714) 2023-05-10T01:43:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8da1db700 1 -- 172.21.15.52:0/1381335397 learned_addr learned my addr 172.21.15.52:0/1381335397 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:24.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8d99da700 1 --2- 172.21.15.52:0/1381335397 >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 0x7fa8d40c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.431+0000 7fa8d91d9700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d4065ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 -- 172.21.15.52:0/1381335397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 msgr2=0x7fa8d4065ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d4065ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 -- 172.21.15.52:0/1381335397 >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 msgr2=0x7fa8d40c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 --2- 172.21.15.52:0/1381335397 >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 0x7fa8d40c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 -- 172.21.15.52:0/1381335397 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4066380 con 0x7fa8d4151150 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8d99da700 1 --2- 172.21.15.52:0/1381335397 >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 0x7fa8d40c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:24.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da1db700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4151150 0x7fa8d41515e0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fa8d4063700 tx=0x7fa8cc009840).ready entity=mon.0 client_cookie=5e96dd1e0ac3edf1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8d89d8700 1 -- 172.21.15.52:0/1381335397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00e070 con 0x7fa8d4151150 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8d89d8700 1 -- 172.21.15.52:0/1381335397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00ba50 con 0x7fa8d4151150 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8d89d8700 1 -- 172.21.15.52:0/1381335397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00bdd0 con 0x7fa8d4151150 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 -- 172.21.15.52:0/1381335397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4151150 msgr2=0x7fa8d41515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4151150 0x7fa8d41515e0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fa8d4063700 tx=0x7fa8cc009840).stop 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 -- 172.21.15.52:0/1381335397 shutdown_connections 2023-05-10T01:43:24.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4151150 0x7fa8d41515e0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/1381335397 >> v2:172.21.15.172:3300/0 conn(0x7fa8d4150d70 0x7fa8d40c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/1381335397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d4065ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.432+0000 7fa8da9dc700 1 -- 172.21.15.52:0/1381335397 >> 172.21.15.52:0/1381335397 conn(0x7fa8d4069930 msgr2=0x7fa8d40c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.433+0000 7fa8da9dc700 1 -- 172.21.15.52:0/1381335397 shutdown_connections 2023-05-10T01:43:24.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.433+0000 7fa8da9dc700 1 -- 172.21.15.52:0/1381335397 wait complete. 2023-05-10T01:43:24.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.434+0000 7fa8da9dc700 1 Processor -- start 2023-05-10T01:43:24.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.434+0000 7fa8da9dc700 1 -- start start 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.434+0000 7fa8da9dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d40ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8d4151150 0x7fa8d4142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40bedd0 con 0x7fa8d4150d70 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41430b0 con 0x7fa8d4151150 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40c6b80 con 0x7fa8d40c1540 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40718/0 (socket says 172.21.15.52:40718) 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 -- 172.21.15.52:0/2525348873 learned_addr learned my addr 172.21.15.52:0/2525348873 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d99da700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d40ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da1db700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8d4151150 0x7fa8d4142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 -- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 msgr2=0x7fa8d40ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d40ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 -- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8d4151150 msgr2=0x7fa8d4142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8d4151150 0x7fa8d4142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 -- 172.21.15.52:0/2525348873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc009ae0 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8d91d9700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa8d000d890 tx=0x7fa8d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0011590 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d00116f0 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40be430 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.435+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0011a70 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.436+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40be9f0 con 0x7fa8d4150d70 2023-05-10T01:43:24.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.436+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4047150 con 0x7fa8d4150d70 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.437+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fa8d001c460 con 0x7fa8d4150d70 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.437+0000 7fa8c5ffb700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 0x7fa8b40612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.437+0000 7fa8d99da700 1 -- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 msgr2=0x7fa8b40612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.437+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7073+0+0 (secure 0 0 0) 0x7fa8d0079db0 con 0x7fa8d4150d70 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.437+0000 7fa8d99da700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 0x7fa8b40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:24.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.441+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8d004af10 con 0x7fa8d4150d70 2023-05-10T01:43:24.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.614+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d40bc270 con 0x7fa8d4150d70 2023-05-10T01:43:24.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.615+0000 7fa8c5ffb700 1 -- 172.21.15.52:0/2525348873 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18483 (secure 0 0 0) 0x7fa8d004e530 con 0x7fa8d4150d70 2023-05-10T01:43:24.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:24.618 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":143,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:24.144400+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":142,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/14794975":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/3706130910":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/4240697296":"2023-05-11T01:43:24.144367+0000","172.21.15.172:6833/125557":"2023-05-11T01:43:24.144367+0000","172.21.15.172:6832/125557":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/354828560":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/2889441413":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2781526674":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2908438126":"2023-05-11T01:38:21.301276+0000","172.21.15.172:6832/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:6833/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/1365175850":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1877904913":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1724176885":"2023-05-11T01:38:21.301276+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 msgr2=0x7fa8b40612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 0x7fa8b40612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 msgr2=0x7fa8d41426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa8d000d890 tx=0x7fa8d0008040).stop 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 shutdown_connections 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa8b405ee20 0x7fa8b40612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8d4151150 0x7fa8d4142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8d40c1540 0x7fa8d40ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 --2- 172.21.15.52:0/2525348873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d4150d70 0x7fa8d41426d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 >> 172.21.15.52:0/2525348873 conn(0x7fa8d4069930 msgr2=0x7fa8d4153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 shutdown_connections 2023-05-10T01:43:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.617+0000 7fa8da9dc700 1 -- 172.21.15.52:0/2525348873 wait complete. 2023-05-10T01:43:24.632 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:43:24.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.787+0000 7f26e88c0700 1 Processor -- start 2023-05-10T01:43:24.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.787+0000 7f26e88c0700 1 -- start start 2023-05-10T01:43:24.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e88c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7370 0x7f26e4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e88c0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e40ad250 0x7f26e414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e88c0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e4158960 con 0x7f26e40c7750 2023-05-10T01:43:24.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e88c0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40ad6d0 con 0x7f26e40ad250 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e88c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4155330 con 0x7f26e40c7370 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e40ad250 0x7f26e414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e40ad250 0x7f26e414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40728/0 (socket says 172.21.15.52:40728) 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 -- 172.21.15.52:0/67053864 learned_addr learned my addr 172.21.15.52:0/67053864 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e2d9d700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7370 0x7f26e4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 -- 172.21.15.52:0/67053864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7370 msgr2=0x7f26e4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7370 0x7f26e4154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 -- 172.21.15.52:0/67053864 >> v1:172.21.15.172:6789/0 conn(0x7f26e40c7750 legacy=0x7f26e40acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 -- 172.21.15.52:0/67053864 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4157d50 con 0x7f26e40ad250 2023-05-10T01:43:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e359e700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40ad250 0x7f26e414dd60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f26d4006fd0 tx=0x7f26d40090f0).ready entity=mon.0 client_cookie=30ebec7f5e3850d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e1d9b700 1 -- 172.21.15.52:0/67053864 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400b580 con 0x7f26e40ad250 2023-05-10T01:43:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e1d9b700 1 -- 172.21.15.52:0/67053864 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400b6e0 con 0x7f26e40ad250 2023-05-10T01:43:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.788+0000 7f26e1d9b700 1 -- 172.21.15.52:0/67053864 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400ba60 con 0x7f26e40ad250 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 -- 172.21.15.52:0/67053864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40ad250 msgr2=0x7f26e414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40ad250 0x7f26e414dd60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f26d4006fd0 tx=0x7f26d40090f0).stop 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 -- 172.21.15.52:0/67053864 shutdown_connections 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7370 0x7f26e4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 --2- 172.21.15.52:0/67053864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40ad250 0x7f26e414dd60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 -- 172.21.15.52:0/67053864 >> 172.21.15.52:0/67053864 conn(0x7f26e4068320 msgr2=0x7f26e4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 -- 172.21.15.52:0/67053864 shutdown_connections 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.789+0000 7f26e88c0700 1 -- 172.21.15.52:0/67053864 wait complete. 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.790+0000 7f26e88c0700 1 Processor -- start 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.790+0000 7f26e88c0700 1 -- start start 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e40ad250 0x7f26e4143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 0x7f26e40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40c8970 con 0x7f26e40c7370 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40aee40 con 0x7f26e40ad250 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e88c0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40af120 con 0x7f26e40c7750 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40734/0 (socket says 172.21.15.52:40734) 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 -- 172.21.15.52:0/1624650020 learned_addr learned my addr 172.21.15.52:0/1624650020 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e2d9d700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e40ad250 0x7f26e4143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e359e700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 0x7f26e40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 -- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 msgr2=0x7f26e40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 0x7f26e40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 -- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e40ad250 msgr2=0x7f26e4143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e40ad250 0x7f26e4143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e259c700 1 -- 172.21.15.52:0/1624650020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4009370 con 0x7f26e40c7370 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.791+0000 7f26e359e700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 0x7f26e40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26e259c700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f26cc00c7c0 tx=0x7f26cc001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc006a20 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc006b80 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e40c8c10 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc007020 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.792+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e4143a50 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.793+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e40a9af0 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.793+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 67) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f26cc018030 con 0x7f26e40c7370 2023-05-10T01:43:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.793+0000 7f26daffd700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 0x7f26c80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:24.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.793+0000 7f26e2d9d700 1 -- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 msgr2=0x7f26c80612e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:24.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.794+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7073+0+0 (secure 0 0 0) 0x7f26cc0796c0 con 0x7f26e40c7370 2023-05-10T01:43:24.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.794+0000 7f26e2d9d700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 0x7f26c80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:24.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.797+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f26cc0478f0 con 0x7f26e40c7370 2023-05-10T01:43:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.882+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 68) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f26cc010070 con 0x7f26e40c7370 2023-05-10T01:43:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.882+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 msgr2=0x7f26c80612e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:24.882+0000 7f26daffd700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 0x7f26c80612e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:24.935 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffe527700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.935 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffb521700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffe527700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffb521700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffb521700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffb521700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffb521700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.936 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffe527700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.937 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffe527700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:24.937 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:24.933+0000 7efffe527700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:25.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.019+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26e40c8e00 con 0x7f26e40c7370 2023-05-10T01:43:25.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.019+0000 7f26daffd700 1 -- 172.21.15.52:0/1624650020 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f26cc0715b0 con 0x7f26e40c7370 2023-05-10T01:43:25.023 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:25.023 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:43:25.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 msgr2=0x7f26e40ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f26cc00c7c0 tx=0x7f26cc001570).stop 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 shutdown_connections 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f26c805ee20 0x7f26c80612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f26e40c7750 0x7f26e40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e40ad250 0x7f26e4143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 --2- 172.21.15.52:0/1624650020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40c7370 0x7f26e40ae4a0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 >> 172.21.15.52:0/1624650020 conn(0x7f26e4068320 msgr2=0x7f26e414f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 shutdown_connections 2023-05-10T01:43:25.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.021+0000 7f26e88c0700 1 -- 172.21.15.52:0/1624650020 wait complete. 2023-05-10T01:43:25.026 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:43:25.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.149+0000 7f02e759e700 1 Processor -- start 2023-05-10T01:43:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.149+0000 7f02e759e700 1 -- start start 2023-05-10T01:43:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02e80c1090 0x7f02e80ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e759e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8158960 con 0x7f02e8154e40 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e81552f0 con 0x7f02e80c7370 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e759e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e8157d50 con 0x7f02e80c1090 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e6d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02e80c1090 0x7f02e80ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e5d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f02e8154e40 0x7f02e80acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49758/0 (socket says 172.21.15.52:49758) 2023-05-10T01:43:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e5d9b700 1 -- 172.21.15.52:0/2710867773 learned_addr learned my addr 172.21.15.52:0/2710867773 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e6d9d700 1 -- 172.21.15.52:0/2710867773 >> v1:172.21.15.172:6789/0 conn(0x7f02e80c7370 legacy=0x7f02e80c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e6d9d700 1 -- 172.21.15.52:0/2710867773 >> v1:172.21.15.52:6789/0 conn(0x7f02e8154e40 legacy=0x7f02e80acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e6d9d700 1 -- 172.21.15.52:0/2710867773 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8158030 con 0x7f02e80c1090 2023-05-10T01:43:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e559a700 1 -- 172.21.15.52:0/2710867773 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838545448 0 0) 0x7f02e8158960 con 0x7f02e8154e40 2023-05-10T01:43:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.150+0000 7f02e6d9d700 1 --2- 172.21.15.52:0/2710867773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c1090 0x7f02e80ad250 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f02e8158910 tx=0x7f02d8009060).ready entity=mon.0 client_cookie=dedbf539fa1505da server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e559a700 1 -- 172.21.15.52:0/2710867773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800b580 con 0x7f02e80c1090 2023-05-10T01:43:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e559a700 1 -- 172.21.15.52:0/2710867773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800b6e0 con 0x7f02e80c1090 2023-05-10T01:43:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e559a700 1 -- 172.21.15.52:0/2710867773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800ba60 con 0x7f02e80c1090 2023-05-10T01:43:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 -- 172.21.15.52:0/2710867773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c1090 msgr2=0x7f02e80ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 --2- 172.21.15.52:0/2710867773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c1090 0x7f02e80ad250 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f02e8158910 tx=0x7f02d8009060).stop 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 -- 172.21.15.52:0/2710867773 shutdown_connections 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 --2- 172.21.15.52:0/2710867773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c1090 0x7f02e80ad250 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 -- 172.21.15.52:0/2710867773 >> 172.21.15.52:0/2710867773 conn(0x7f02e8068320 msgr2=0x7f02e8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 -- 172.21.15.52:0/2710867773 shutdown_connections 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.151+0000 7f02e759e700 1 -- 172.21.15.52:0/2710867773 wait complete. 2023-05-10T01:43:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.152+0000 7f02e759e700 1 Processor -- start 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.152+0000 7f02e759e700 1 -- start start 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 0x7f02e8141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 0x7f02e80c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c91e0 con 0x7f02e80c7370 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c88d0 con 0x7f02e8154e40 2023-05-10T01:43:25.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8164f00 con 0x7f02e80c1090 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40746/0 (socket says 172.21.15.52:40746) 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 -- 172.21.15.52:0/3151051474 learned_addr learned my addr 172.21.15.52:0/3151051474 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e6d9d700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 0x7f02e80c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e659c700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 0x7f02e8141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 -- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 msgr2=0x7f02e8141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 0x7f02e8141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 -- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 msgr2=0x7f02e80c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 0x7f02e80c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.153+0000 7f02e5d9b700 1 -- 172.21.15.52:0/3151051474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80092a0 con 0x7f02e80c7370 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02e6d9d700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 0x7f02e80c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02e659c700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 0x7f02e8141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02e5d9b700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f02d000c810 tx=0x7f02d0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0005d30 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0005e90 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80c8b90 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0007340 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.154+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e8141870 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.155+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8141af0 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.155+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 68) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f02d0010030 con 0x7f02e80c7370 2023-05-10T01:43:25.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.155+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7073+0+0 (secure 0 0 0) 0x7f02d0079d00 con 0x7f02e80c7370 2023-05-10T01:43:25.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.159+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f02d007d030 con 0x7f02e80c7370 2023-05-10T01:43:25.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.374+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e8047150 con 0x7f02e80c7370 2023-05-10T01:43:25.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.374+0000 7f02de7fc700 1 -- 172.21.15.52:0/3151051474 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f02d004af80 con 0x7f02e80c7370 2023-05-10T01:43:25.378 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:25.378 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:26:56.307221+0000","modified":"2023-05-10T01:26:59.315319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2633450550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2633450550},{"type":"v1","addr":"172.21.15.52:6835","nonce":2633450550}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-05-10T01:43:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 msgr2=0x7f02e80c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f02d000c810 tx=0x7f02d0007f90).stop 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 shutdown_connections 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e8154e40 0x7f02e80c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e80c1090 0x7f02e8141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 --2- 172.21.15.52:0/3151051474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e80c7370 0x7f02e80c9670 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 >> 172.21.15.52:0/3151051474 conn(0x7f02e8068320 msgr2=0x7f02e81505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 shutdown_connections 2023-05-10T01:43:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.376+0000 7f02e759e700 1 -- 172.21.15.52:0/3151051474 wait complete. 2023-05-10T01:43:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 62 2023-05-10T01:43:25.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:25.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.503+0000 7f8c26b2b700 1 Processor -- start 2023-05-10T01:43:25.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.503+0000 7f8c26b2b700 1 -- start start 2023-05-10T01:43:25.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c26b2b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c2013b540 0x7f8c200c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c26b2b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c20063e20 0x7f8c200abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c26b2b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c200bdc20 con 0x7f8c2013b920 2023-05-10T01:43:25.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c26b2b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200c53f0 con 0x7f8c20063e20 2023-05-10T01:43:25.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c26b2b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200c4e30 con 0x7f8c2013b540 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c250c8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c20063e20 0x7f8c200abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c1ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8c2013b920 0x7f8c20063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49768/0 (socket says 172.21.15.52:49768) 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c1ffff700 1 -- 172.21.15.52:0/688495388 learned_addr learned my addr 172.21.15.52:0/688495388 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.504+0000 7f8c248c7700 1 --2- 172.21.15.52:0/688495388 >> v2:172.21.15.172:3300/0 conn(0x7f8c2013b540 0x7f8c200c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c250c8700 1 -- 172.21.15.52:0/688495388 >> v2:172.21.15.172:3300/0 conn(0x7f8c2013b540 msgr2=0x7f8c200c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c250c8700 1 --2- 172.21.15.52:0/688495388 >> v2:172.21.15.172:3300/0 conn(0x7f8c2013b540 0x7f8c200c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c250c8700 1 -- 172.21.15.52:0/688495388 >> v1:172.21.15.52:6789/0 conn(0x7f8c2013b920 legacy=0x7f8c20063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c250c8700 1 -- 172.21.15.52:0/688495388 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200c5110 con 0x7f8c20063e20 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c1f7fe700 1 -- 172.21.15.52:0/688495388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829631751 0 0) 0x7f8c200bdc20 con 0x7f8c2013b920 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c250c8700 1 --2- 172.21.15.52:0/688495388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c20063e20 0x7f8c200abb10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f8c20067b00 tx=0x7f8c10009060).ready entity=mon.0 client_cookie=f4cab1847b71eb08 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c1f7fe700 1 -- 172.21.15.52:0/688495388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000f510 con 0x7f8c20063e20 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c1f7fe700 1 -- 172.21.15.52:0/688495388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000f670 con 0x7f8c20063e20 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c1f7fe700 1 -- 172.21.15.52:0/688495388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000f9f0 con 0x7f8c20063e20 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c26b2b700 1 -- 172.21.15.52:0/688495388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c20063e20 msgr2=0x7f8c200abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.505+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/688495388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c20063e20 0x7f8c200abb10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f8c20067b00 tx=0x7f8c10009060).stop 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 -- 172.21.15.52:0/688495388 shutdown_connections 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/688495388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c20063e20 0x7f8c200abb10 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/688495388 >> v2:172.21.15.172:3300/0 conn(0x7f8c2013b540 0x7f8c200c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 -- 172.21.15.52:0/688495388 >> 172.21.15.52:0/688495388 conn(0x7f8c200c8a90 msgr2=0x7f8c200c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 -- 172.21.15.52:0/688495388 shutdown_connections 2023-05-10T01:43:25.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.506+0000 7f8c26b2b700 1 -- 172.21.15.52:0/688495388 wait complete. 2023-05-10T01:43:25.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.507+0000 7f8c26b2b700 1 Processor -- start 2023-05-10T01:43:25.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.507+0000 7f8c26b2b700 1 -- start start 2023-05-10T01:43:25.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c20063e20 0x7f8c20151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2013b540 0x7f8c200c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200c3530 con 0x7f8c2013b920 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200c3250 con 0x7f8c2013b540 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200c70b0 con 0x7f8c20063e20 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40760/0 (socket says 172.21.15.52:40760) 2023-05-10T01:43:25.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 -- 172.21.15.52:0/1983160771 learned_addr learned my addr 172.21.15.52:0/1983160771 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c248c7700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c20063e20 0x7f8c20151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c1ffff700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2013b540 0x7f8c200c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 -- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c20063e20 msgr2=0x7f8c20151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c20063e20 0x7f8c20151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 -- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2013b540 msgr2=0x7f8c200c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2013b540 0x7f8c200c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 -- 172.21.15.52:0/1983160771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100092a0 con 0x7f8c2013b920 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c250c8700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f8c10009dd0 tx=0x7f8c10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000f9f0 con 0x7f8c2013b920 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000fe80 con 0x7f8c2013b920 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1001b660 con 0x7f8c2013b920 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c200c7390 con 0x7f8c2013b920 2023-05-10T01:43:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.508+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20137550 con 0x7f8c2013b920 2023-05-10T01:43:25.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.509+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c200c6f10 con 0x7f8c2013b920 2023-05-10T01:43:25.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.510+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 68) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f8c1000f070 con 0x7f8c2013b920 2023-05-10T01:43:25.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.510+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7073+0+0 (secure 0 0 0) 0x7f8c1007b7d0 con 0x7f8c2013b920 2023-05-10T01:43:25.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.514+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c200c6f10 con 0x7f8c2013b920 2023-05-10T01:43:25.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.688+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c200c6f10 con 0x7f8c2013b920 2023-05-10T01:43:25.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.689+0000 7f8c1cff9700 1 -- 172.21.15.52:0/1983160771 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18483 (secure 0 0 0) 0x7f8c200c6f10 con 0x7f8c2013b920 2023-05-10T01:43:25.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":143,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:24.144400+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:26:54.856983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-05-10T01:26:55.277609+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":142,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/14794975":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/3706130910":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/4240697296":"2023-05-11T01:43:24.144367+0000","172.21.15.172:6833/125557":"2023-05-11T01:43:24.144367+0000","172.21.15.172:6832/125557":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/354828560":"2023-05-11T01:43:24.144367+0000","172.21.15.172:0/2889441413":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2781526674":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/2908438126":"2023-05-11T01:38:21.301276+0000","172.21.15.172:6832/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:6833/116173":"2023-05-11T01:27:12.738244+0000","172.21.15.172:0/1365175850":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1877904913":"2023-05-11T01:38:21.301276+0000","172.21.15.172:0/1724176885":"2023-05-11T01:38:21.301276+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 msgr2=0x7f8c200c0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f8c10009dd0 tx=0x7f8c10017000).stop 2023-05-10T01:43:25.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 shutdown_connections 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c2013b920 0x7f8c200c0960 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c20063e20 0x7f8c20151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 --2- 172.21.15.52:0/1983160771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2013b540 0x7f8c200c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 >> 172.21.15.52:0/1983160771 conn(0x7f8c200c8a90 msgr2=0x7f8c2013a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 shutdown_connections 2023-05-10T01:43:25.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.691+0000 7f8c26b2b700 1 -- 172.21.15.52:0/1983160771 wait complete. 2023-05-10T01:43:25.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:43:25.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.821+0000 7f2237713700 1 Processor -- start 2023-05-10T01:43:25.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.821+0000 7f2237713700 1 -- start start 2023-05-10T01:43:25.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2237713700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2230154160 0x7f22300c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2237713700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230069da0 0x7f22300c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2237713700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22300c0650 con 0x7f2230154540 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2237713700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300c1af0 con 0x7f2230154160 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2237713700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22300bfd20 con 0x7f2230069da0 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2230154160 0x7f22300c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2230154160 0x7f22300c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40762/0 (socket says 172.21.15.52:40762) 2023-05-10T01:43:25.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 -- 172.21.15.52:0/136525285 learned_addr learned my addr 172.21.15.52:0/136525285 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f2235cb0700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230069da0 0x7f22300c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 -- 172.21.15.52:0/136525285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230069da0 msgr2=0x7f22300c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230069da0 0x7f22300c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.822+0000 7f22354af700 1 -- 172.21.15.52:0/136525285 >> v1:172.21.15.172:6789/0 conn(0x7f2230154540 legacy=0x7f2230069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f22354af700 1 -- 172.21.15.52:0/136525285 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300c0000 con 0x7f2230154160 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f22354af700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230154160 0x7f22300c5c60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f2228006fd0 tx=0x7f22280090f0).ready entity=mon.0 client_cookie=2207789028db2fd4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f222ffff700 1 -- 172.21.15.52:0/136525285 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800b600 con 0x7f2230154160 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f222ffff700 1 -- 172.21.15.52:0/136525285 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800b760 con 0x7f2230154160 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f222ffff700 1 -- 172.21.15.52:0/136525285 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800bb00 con 0x7f2230154160 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 -- 172.21.15.52:0/136525285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230154160 msgr2=0x7f22300c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230154160 0x7f22300c5c60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f2228006fd0 tx=0x7f22280090f0).stop 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 -- 172.21.15.52:0/136525285 shutdown_connections 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230069da0 0x7f22300c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 --2- 172.21.15.52:0/136525285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230154160 0x7f22300c5c60 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 -- 172.21.15.52:0/136525285 >> 172.21.15.52:0/136525285 conn(0x7f22300cb6f0 msgr2=0x7f22300c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 -- 172.21.15.52:0/136525285 shutdown_connections 2023-05-10T01:43:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.823+0000 7f2237713700 1 -- 172.21.15.52:0/136525285 wait complete. 2023-05-10T01:43:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.824+0000 7f2237713700 1 Processor -- start 2023-05-10T01:43:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 -- start start 2023-05-10T01:43:25.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230154160 0x7f2230145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2230154540 0x7f2230147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c31c0 con 0x7f2230069da0 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c44c0 con 0x7f2230154540 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f2237713700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c38b0 con 0x7f2230154160 2023-05-10T01:43:25.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.825+0000 7f22354af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40768/0 (socket says 172.21.15.52:40768) 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 -- 172.21.15.52:0/391200938 learned_addr learned my addr 172.21.15.52:0/391200938 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f2235cb0700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2230154540 0x7f2230147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f2234cae700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230154160 0x7f2230145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 -- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230154160 msgr2=0x7f2230145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230154160 0x7f2230145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 -- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2230154540 msgr2=0x7f2230147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:25.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2230154540 0x7f2230147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 -- 172.21.15.52:0/391200938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228009370 con 0x7f2230069da0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f22354af700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f2230083050 tx=0x7f2228017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800b600 con 0x7f2230069da0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800bec0 con 0x7f2230069da0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22300c3b90 con 0x7f2230069da0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228006930 con 0x7f2230069da0 2023-05-10T01:43:25.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.826+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22300c4150 con 0x7f2230069da0 2023-05-10T01:43:25.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.827+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300666b0 con 0x7f2230069da0 2023-05-10T01:43:25.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.827+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 68) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f222800f070 con 0x7f2230069da0 2023-05-10T01:43:25.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.828+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7073+0+0 (secure 0 0 0) 0x7f222807b8a0 con 0x7f2230069da0 2023-05-10T01:43:25.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.832+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f222804cb20 con 0x7f2230069da0 2023-05-10T01:43:25.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.885+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 69) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f2228079480 con 0x7f2230069da0 2023-05-10T01:43:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.885+0000 7f222d7fa700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 0x7f2210067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.886+0000 7f2234cae700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 0x7f2210067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:25.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:25.889+0000 7f2234cae700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 0x7f2210067b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2230154920 tx=0x7f2224007d40).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:26.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.058+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f223006c340 con 0x7f2230069da0 2023-05-10T01:43:26.749 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-05-10T01:43:26.746+0000 7ffa0a820700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:43:26.765 INFO:tasks.ceph.mds.c.smithi052.stderr: -1> 2023-05-10T01:43:26.746+0000 7ffa0a820700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:43:26.787 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:43:26.891 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:43:26.888+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:43:26.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.898+0000 7f222d7fa700 1 -- 172.21.15.52:0/391200938 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22280545b0 con 0x7f2230069da0 2023-05-10T01:43:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.900+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 msgr2=0x7f2210067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.900+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 0x7f2210067b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2230154920 tx=0x7f2224007d40).stop 2023-05-10T01:43:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 msgr2=0x7f22300c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f2230083050 tx=0x7f2228017000).stop 2023-05-10T01:43:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 shutdown_connections 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2210030180 0x7f2210067b70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2230154540 0x7f2230147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230069da0 0x7f22300c4950 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 --2- 172.21.15.52:0/391200938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2230154160 0x7f2230145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 >> 172.21.15.52:0/391200938 conn(0x7f22300cb6f0 msgr2=0x7f22300abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 shutdown_connections 2023-05-10T01:43:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:26.901+0000 7f2237713700 1 -- 172.21.15.52:0/391200938 wait complete. 2023-05-10T01:43:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:43:26.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.043+0000 7f3afbf0c700 1 Processor -- start 2023-05-10T01:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.043+0000 7f3afbf0c700 1 -- start start 2023-05-10T01:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3afbf0c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3af4154080 0x7f3af40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3afbf0c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3af4154460 0x7f3af40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3afbf0c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af40c94c0 con 0x7f3af40aa140 2023-05-10T01:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3afbf0c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af40aa590 con 0x7f3af4154080 2023-05-10T01:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3afbf0c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af40cb7d0 con 0x7f3af4154460 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af9ca8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3af4154080 0x7f3af40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af9ca8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3af4154080 0x7f3af40aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40806/0 (socket says 172.21.15.52:40806) 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af9ca8700 1 -- 172.21.15.52:0/3350880440 learned_addr learned my addr 172.21.15.52:0/3350880440 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af94a7700 1 --2- 172.21.15.52:0/3350880440 >> v2:172.21.15.172:3300/0 conn(0x7f3af4154460 0x7f3af40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af9ca8700 1 -- 172.21.15.52:0/3350880440 >> v2:172.21.15.172:3300/0 conn(0x7f3af4154460 msgr2=0x7f3af40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.044+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/3350880440 >> v2:172.21.15.172:3300/0 conn(0x7f3af4154460 0x7f3af40a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af9ca8700 1 -- 172.21.15.52:0/3350880440 >> v1:172.21.15.172:6789/0 conn(0x7f3af40aa140 legacy=0x7f3af4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af9ca8700 1 -- 172.21.15.52:0/3350880440 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40c88b0 con 0x7f3af4154080 2023-05-10T01:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/3350880440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af40aac90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f3af4084310 tx=0x7f3aec009840).ready entity=mon.0 client_cookie=68ab8d5c0aeea434 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af8ca6700 1 -- 172.21.15.52:0/3350880440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00e070 con 0x7f3af4154080 2023-05-10T01:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af8ca6700 1 -- 172.21.15.52:0/3350880440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec00ba10 con 0x7f3af4154080 2023-05-10T01:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3af8ca6700 1 -- 172.21.15.52:0/3350880440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00bd90 con 0x7f3af4154080 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 -- 172.21.15.52:0/3350880440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 msgr2=0x7f3af40aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/3350880440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af40aac90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f3af4084310 tx=0x7f3aec009840).stop 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 -- 172.21.15.52:0/3350880440 shutdown_connections 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/3350880440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af40aac90 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/3350880440 >> v2:172.21.15.172:3300/0 conn(0x7f3af4154460 0x7f3af40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 -- 172.21.15.52:0/3350880440 >> 172.21.15.52:0/3350880440 conn(0x7f3af4067910 msgr2=0x7f3af40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:27.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 -- 172.21.15.52:0/3350880440 shutdown_connections 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.045+0000 7f3afbf0c700 1 -- 172.21.15.52:0/3350880440 wait complete. 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 Processor -- start 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 -- start start 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 0x7f3af40c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 0x7f3af414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af414cf00 con 0x7f3af4154080 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4167e30 con 0x7f3af4154460 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3afbf0c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4168110 con 0x7f3af40aa140 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3af94a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3af94a7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40814/0 (socket says 172.21.15.52:40814) 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.047+0000 7f3af94a7700 1 -- 172.21.15.52:0/507705383 learned_addr learned my addr 172.21.15.52:0/507705383 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 0x7f3af40c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3afa4a9700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 0x7f3af414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 -- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 msgr2=0x7f3af40c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 0x7f3af40c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 -- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 msgr2=0x7f3af414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 0x7f3af414c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 -- 172.21.15.52:0/507705383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009ae0 con 0x7f3af4154080 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3afa4a9700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 0x7f3af414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 0x7f3af40c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:27.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af94a7700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f3ae800c650 tx=0x7f3ae8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8010580 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae80106e0 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af41683f0 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8010a60 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.048+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af4167ae0 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.049+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af40adbd0 con 0x7f3af4154080 2023-05-10T01:43:27.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.050+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 69) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f3ae801b460 con 0x7f3af4154080 2023-05-10T01:43:27.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.050+0000 7f3af1ffb700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 0x7f3ad40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:27.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.050+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 7159+0+0 (secure 0 0 0) 0x7f3ae8079f30 con 0x7f3af4154080 2023-05-10T01:43:27.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.050+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 0x7f3ad40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:27.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.051+0000 7f3af9ca8700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 0x7f3ad40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3aec00b9e0 tx=0x7f3aec009840).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:27.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.054+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ae80a88f0 con 0x7f3af4154080 2023-05-10T01:43:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.070+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f3ae8077aa0 con 0x7f3af4154080 2023-05-10T01:43:27.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:27.276+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3af40adbd0 con 0x7f3af4154080 2023-05-10T01:43:28.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.070+0000 7f3af1ffb700 1 -- 172.21.15.52:0/507705383 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3af40adbd0 con 0x7f3af4154080 2023-05-10T01:43:28.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 msgr2=0x7f3ad40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 0x7f3ad40611b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3aec00b9e0 tx=0x7f3aec009840).stop 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 msgr2=0x7f3af414ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f3ae800c650 tx=0x7f3ae8008040).stop 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 shutdown_connections 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ad405ecf0 0x7f3ad40611b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4154460 0x7f3af414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3af40aa140 0x7f3af40c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 --2- 172.21.15.52:0/507705383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3af4154080 0x7f3af414ca10 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 >> 172.21.15.52:0/507705383 conn(0x7f3af4067910 msgr2=0x7f3af40ab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:28.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 shutdown_connections 2023-05-10T01:43:28.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.073+0000 7f3afbf0c700 1 -- 172.21.15.52:0/507705383 wait complete. 2023-05-10T01:43:28.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:43:28.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.217+0000 7f7b15716700 1 Processor -- start 2023-05-10T01:43:28.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.217+0000 7f7b15716700 1 -- start start 2023-05-10T01:43:28.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b15716700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b10157700 0x7f7b100a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b15716700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7b100c62b0 0x7f7b1015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b15716700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b100bfcb0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b15716700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1006a990 con 0x7f7b10157700 2023-05-10T01:43:28.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b15716700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1006a130 con 0x7f7b100c62b0 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b10157700 0x7f7b100a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b10157700 0x7f7b100a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40820/0 (socket says 172.21.15.52:40820) 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 -- 172.21.15.52:0/2980636995 learned_addr learned my addr 172.21.15.52:0/2980636995 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b14f15700 1 --2- 172.21.15.52:0/2980636995 >> v2:172.21.15.172:3300/0 conn(0x7f7b100c62b0 0x7f7b1015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 -- 172.21.15.52:0/2980636995 >> v2:172.21.15.172:3300/0 conn(0x7f7b100c62b0 msgr2=0x7f7b1015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 --2- 172.21.15.52:0/2980636995 >> v2:172.21.15.172:3300/0 conn(0x7f7b100c62b0 0x7f7b1015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 -- 172.21.15.52:0/2980636995 >> v1:172.21.15.172:6789/0 conn(0x7f7b100aa1e0 legacy=0x7f7b100c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 -- 172.21.15.52:0/2980636995 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1006a3d0 con 0x7f7b10157700 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0ffff700 1 --2- 172.21.15.52:0/2980636995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b10157700 0x7f7b100a9cf0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f7b100600b0 tx=0x7f7b000090f0).ready entity=mon.0 client_cookie=b0e6e9e64c7352c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0effd700 1 -- 172.21.15.52:0/2980636995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000b5a0 con 0x7f7b10157700 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0effd700 1 -- 172.21.15.52:0/2980636995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000b700 con 0x7f7b10157700 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.218+0000 7f7b0effd700 1 -- 172.21.15.52:0/2980636995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ba80 con 0x7f7b10157700 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 -- 172.21.15.52:0/2980636995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b10157700 msgr2=0x7f7b100a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 --2- 172.21.15.52:0/2980636995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b10157700 0x7f7b100a9cf0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f7b100600b0 tx=0x7f7b000090f0).stop 2023-05-10T01:43:28.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 -- 172.21.15.52:0/2980636995 shutdown_connections 2023-05-10T01:43:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 --2- 172.21.15.52:0/2980636995 >> v2:172.21.15.172:3300/0 conn(0x7f7b100c62b0 0x7f7b1015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 --2- 172.21.15.52:0/2980636995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b10157700 0x7f7b100a9cf0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 -- 172.21.15.52:0/2980636995 >> 172.21.15.52:0/2980636995 conn(0x7f7b100cb5f0 msgr2=0x7f7b100c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 -- 172.21.15.52:0/2980636995 shutdown_connections 2023-05-10T01:43:28.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.219+0000 7f7b15716700 1 -- 172.21.15.52:0/2980636995 wait complete. 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.220+0000 7f7b15716700 1 Processor -- start 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.220+0000 7f7b15716700 1 -- start start 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 0x7f7b10153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 0x7f7b10154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b101559b0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10155520 con 0x7f7b10157700 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b15716700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10154910 con 0x7f7b100c62b0 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b0ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b0ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40822/0 (socket says 172.21.15.52:40822) 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b0ffff700 1 -- 172.21.15.52:0/1902985717 learned_addr learned my addr 172.21.15.52:0/1902985717 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b14f15700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 0x7f7b10154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b0f7fe700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 0x7f7b10153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.221+0000 7f7b0ffff700 1 -- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 msgr2=0x7f7b10153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0ffff700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 0x7f7b10153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0ffff700 1 -- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 msgr2=0x7f7b10154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0ffff700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 0x7f7b10154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0ffff700 1 -- 172.21.15.52:0/1902985717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009370 con 0x7f7b100aa1e0 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b14f15700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 0x7f7b10154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0f7fe700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 0x7f7b10153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b0ffff700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f7b00009130 tx=0x7f7b00015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000b870 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000b9d0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10154bf0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0001b640 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.222+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b101551b0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.223+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10155800 con 0x7f7b100aa1e0 2023-05-10T01:43:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.223+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7b0000f070 con 0x7f7b100aa1e0 2023-05-10T01:43:28.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.224+0000 7f7af7fff700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 0x7f7af00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:28.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.224+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 7159+0+0 (secure 0 0 0) 0x7f7b0007b7a0 con 0x7f7b100aa1e0 2023-05-10T01:43:28.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.224+0000 7f7b0f7fe700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 0x7f7af00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:28.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.224+0000 7f7b0f7fe700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 0x7f7af00612e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7b100bff40 tx=0x7f7b04008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.228+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b0004c910 con 0x7f7b100aa1e0 2023-05-10T01:43:28.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:28.403+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7b10083110 con 0x7f7b100aa1e0 2023-05-10T01:43:29.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.074+0000 7f7af7fff700 1 -- 172.21.15.52:0/1902985717 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7b0004ff30 con 0x7f7b100aa1e0 2023-05-10T01:43:29.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.077+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 msgr2=0x7f7af00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.077+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 0x7f7af00612e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7b100bff40 tx=0x7f7b04008040).stop 2023-05-10T01:43:29.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.077+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 msgr2=0x7f7b10147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.077+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f7b00009130 tx=0x7f7b00015000).stop 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 shutdown_connections 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f7af005ee20 0x7f7af00612e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b10157700 0x7f7b10154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b100aa1e0 0x7f7b10147ca0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 --2- 172.21.15.52:0/1902985717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7b100c62b0 0x7f7b10153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.078+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 >> 172.21.15.52:0/1902985717 conn(0x7f7b100cb5f0 msgr2=0x7f7b100c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:29.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.079+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 shutdown_connections 2023-05-10T01:43:29.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.079+0000 7f7b15716700 1 -- 172.21.15.52:0/1902985717 wait complete. 2023-05-10T01:43:29.083 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:43:29.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:43:29.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.220+0000 7f9efce50700 1 Processor -- start 2023-05-10T01:43:29.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.220+0000 7f9efce50700 1 -- start start 2023-05-10T01:43:29.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9efce50700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9ef8154080 0x7f9ef80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9efce50700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef80685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9efce50700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80c94c0 con 0x7f9ef8154460 2023-05-10T01:43:29.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9efce50700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80cb7d0 con 0x7f9ef8154080 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9efce50700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8068a90 con 0x7f9ef8068150 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9ef6d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef80685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9ef659c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9ef8154080 0x7f9ef80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.221+0000 7f9ef5d9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9ef8154460 0x7f9ef80a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:52386/0 (socket says 172.21.15.52:52386) 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef5d9b700 1 -- 172.21.15.52:0/1013342170 learned_addr learned my addr 172.21.15.52:0/1013342170 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef659c700 1 -- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 msgr2=0x7f9ef80685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef659c700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef80685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef659c700 1 -- 172.21.15.52:0/1013342170 >> v1:172.21.15.172:6789/0 conn(0x7f9ef8154460 legacy=0x7f9ef80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef659c700 1 -- 172.21.15.52:0/1013342170 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80c88b0 con 0x7f9ef8154080 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef559a700 1 -- 172.21.15.52:0/1013342170 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963270635 0 0) 0x7f9ef80c94c0 con 0x7f9ef8154460 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef6d9d700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef659c700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef80aac90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9ef0009e60 tx=0x7f9ef0009780).ready entity=mon.1 client_cookie=32afb66391205a8d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef559a700 1 -- 172.21.15.52:0/1013342170 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000e070 con 0x7f9ef8154080 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef559a700 1 -- 172.21.15.52:0/1013342170 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef000bb60 con 0x7f9ef8154080 2023-05-10T01:43:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.222+0000 7f9ef559a700 1 -- 172.21.15.52:0/1013342170 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0012410 con 0x7f9ef8154080 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 -- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 msgr2=0x7f9ef80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef80aac90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9ef0009e60 tx=0x7f9ef0009780).stop 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 -- 172.21.15.52:0/1013342170 shutdown_connections 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef80685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 --2- 172.21.15.52:0/1013342170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef80aac90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 -- 172.21.15.52:0/1013342170 >> 172.21.15.52:0/1013342170 conn(0x7f9ef8067910 msgr2=0x7f9ef80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 -- 172.21.15.52:0/1013342170 shutdown_connections 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.223+0000 7f9efce50700 1 -- 172.21.15.52:0/1013342170 wait complete. 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.224+0000 7f9efce50700 1 Processor -- start 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.224+0000 7f9efce50700 1 -- start start 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef8141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8155be0 con 0x7f9ef8154460 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8154fd0 con 0x7f9ef8154080 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9efce50700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81552b0 con 0x7f9ef8068150 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40838/0 (socket says 172.21.15.52:40838) 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 -- 172.21.15.52:0/741855733 learned_addr learned my addr 172.21.15.52:0/741855733 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef5d9b700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef8141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef659c700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 -- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 msgr2=0x7f9ef81549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef81549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 -- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 msgr2=0x7f9ef8141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef8141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 -- 172.21.15.52:0/741855733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80092a0 con 0x7f9ef8154460 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9ef6d9d700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f9ee800e980 tx=0x7f9ee8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.225+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800c610 con 0x7f9ef8154460 2023-05-10T01:43:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.226+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800c770 con 0x7f9ef8154460 2023-05-10T01:43:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.226+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0009a20 con 0x7f9ef8154460 2023-05-10T01:43:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.226+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800cb10 con 0x7f9ef8154460 2023-05-10T01:43:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.226+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef8155870 con 0x7f9ef8154460 2023-05-10T01:43:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.226+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8155d90 con 0x7f9ef8154460 2023-05-10T01:43:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.227+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9ee8022070 con 0x7f9ef8154460 2023-05-10T01:43:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.227+0000 7f9eee7fc700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 0x7f9edc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.227+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ee807a0e0 con 0x7f9ef8154460 2023-05-10T01:43:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.228+0000 7f9ef659c700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 0x7f9edc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.228+0000 7f9ef659c700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 0x7f9edc0612e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ef0009e60 tx=0x7f9ef0009780).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.232+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ee804b440 con 0x7f9ef8154460 2023-05-10T01:43:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:29.406+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ef80c8b90 con 0x7f9ef8154460 2023-05-10T01:43:30.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.076+0000 7f9eee7fc700 1 -- 172.21.15.52:0/741855733 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9ee80160d0 con 0x7f9ef8154460 2023-05-10T01:43:30.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 msgr2=0x7f9edc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 0x7f9edc0612e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ef0009e60 tx=0x7f9ef0009780).stop 2023-05-10T01:43:30.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 msgr2=0x7f9ef80c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f9ee800e980 tx=0x7f9ee8009060).stop 2023-05-10T01:43:30.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 shutdown_connections 2023-05-10T01:43:30.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9edc05ee20 0x7f9edc0612e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ef8154460 0x7f9ef80c4520 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ef8068150 0x7f9ef81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 --2- 172.21.15.52:0/741855733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef8154080 0x7f9ef8141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.080+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 >> 172.21.15.52:0/741855733 conn(0x7f9ef8067910 msgr2=0x7f9ef814fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.081+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 shutdown_connections 2023-05-10T01:43:30.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.081+0000 7f9efce50700 1 -- 172.21.15.52:0/741855733 wait complete. 2023-05-10T01:43:30.086 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:43:30.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:43:30.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.227+0000 7f99e7fff700 1 Processor -- start 2023-05-10T01:43:30.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.227+0000 7f99e7fff700 1 -- start start 2023-05-10T01:43:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99e80c62b0 0x7f99e815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e7fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80bfcb0 con 0x7f99e80c1150 2023-05-10T01:43:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e7fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80aa400 con 0x7f99e8157700 2023-05-10T01:43:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e7fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e806a990 con 0x7f99e80c62b0 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e67fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99e80c1150 0x7f99e80c5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49862/0 (socket says 172.21.15.52:49862) 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e67fc700 1 -- 172.21.15.52:0/3047067672 learned_addr learned my addr 172.21.15.52:0/3047067672 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e77fe700 1 --2- 172.21.15.52:0/3047067672 >> v2:172.21.15.52:3300/0 conn(0x7f99e80c62b0 0x7f99e815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e5ffb700 1 -- 172.21.15.52:0/3047067672 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701891178 0 0) 0x7f99e80bfcb0 con 0x7f99e80c1150 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e5ffb700 1 -- 172.21.15.52:0/3047067672 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d40033f0 con 0x7f99e80c1150 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e77fe700 1 -- 172.21.15.52:0/3047067672 >> v1:172.21.15.172:6789/0 conn(0x7f99e8157700 legacy=0x7f99e80a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e77fe700 1 -- 172.21.15.52:0/3047067672 >> v1:172.21.15.52:6789/0 conn(0x7f99e80c1150 legacy=0x7f99e80c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e77fe700 1 -- 172.21.15.52:0/3047067672 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e806a130 con 0x7f99e80c62b0 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e77fe700 1 --2- 172.21.15.52:0/3047067672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c62b0 0x7f99e815ee60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f99d8009760 tx=0x7f99d8009060).ready entity=mon.0 client_cookie=5c105e4bfcfd8b00 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.228+0000 7f99e5ffb700 1 -- 172.21.15.52:0/3047067672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800f510 con 0x7f99e80c62b0 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e5ffb700 1 -- 172.21.15.52:0/3047067672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800f670 con 0x7f99e80c62b0 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e5ffb700 1 -- 172.21.15.52:0/3047067672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800f9f0 con 0x7f99e80c62b0 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 -- 172.21.15.52:0/3047067672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c62b0 msgr2=0x7f99e815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3047067672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c62b0 0x7f99e815ee60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f99d8009760 tx=0x7f99d8009060).stop 2023-05-10T01:43:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 -- 172.21.15.52:0/3047067672 shutdown_connections 2023-05-10T01:43:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3047067672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c62b0 0x7f99e815ee60 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 -- 172.21.15.52:0/3047067672 >> 172.21.15.52:0/3047067672 conn(0x7f99e80cb5f0 msgr2=0x7f99e80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 -- 172.21.15.52:0/3047067672 shutdown_connections 2023-05-10T01:43:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.229+0000 7f99e7fff700 1 -- 172.21.15.52:0/3047067672 wait complete. 2023-05-10T01:43:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.230+0000 7f99e7fff700 1 Processor -- start 2023-05-10T01:43:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.230+0000 7f99e7fff700 1 -- start start 2023-05-10T01:43:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99e80c62b0 0x7f99e80c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e8157700 0x7f99e814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80c3cf0 con 0x7f99e80c1150 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80adc50 con 0x7f99e8157700 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80adf30 con 0x7f99e80c62b0 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40850/0 (socket says 172.21.15.52:40850) 2023-05-10T01:43:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 -- 172.21.15.52:0/3163576963 learned_addr learned my addr 172.21.15.52:0/3163576963 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e77fe700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e8157700 0x7f99e814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e67fc700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99e80c62b0 0x7f99e80c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 -- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99e80c62b0 msgr2=0x7f99e80c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99e80c62b0 0x7f99e80c2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 -- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e8157700 msgr2=0x7f99e814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e8157700 0x7f99e814b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.231+0000 7f99e6ffd700 1 -- 172.21.15.52:0/3163576963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80092a0 con 0x7f99e80c1150 2023-05-10T01:43:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99e6ffd700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f99e000b7e0 tx=0x7f99e0009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000d620 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000d7c0 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80ae210 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000db80 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.232+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e814b880 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.233+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8083110 con 0x7f99e80c1150 2023-05-10T01:43:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.233+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f99e000f480 con 0x7f99e80c1150 2023-05-10T01:43:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.233+0000 7f99ceffd700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 0x7f99c80612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.233+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f99e0079fc0 con 0x7f99e80c1150 2023-05-10T01:43:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.234+0000 7f99e67fc700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 0x7f99c80612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.234+0000 7f99e67fc700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 0x7f99c80612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f99dc005750 tx=0x7f99dc009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.237+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99e004b4c0 con 0x7f99e80c1150 2023-05-10T01:43:30.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.410+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f99e8047150 con 0x7f99e80c1150 2023-05-10T01:43:30.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.414+0000 7f99ceffd700 1 -- 172.21.15.52:0/3163576963 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v28) v1 ==== 120+0+0 (secure 0 0 0) 0x7f99e004eae0 con 0x7f99e80c1150 2023-05-10T01:43:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 msgr2=0x7f99c80612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 0x7f99c80612e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f99dc005750 tx=0x7f99dc009040).stop 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 msgr2=0x7f99e80c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f99e000b7e0 tx=0x7f99e0009310).stop 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 shutdown_connections 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f99c805ee20 0x7f99c80612e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e8157700 0x7f99e814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e80c1150 0x7f99e80c3710 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 --2- 172.21.15.52:0/3163576963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99e80c62b0 0x7f99e80c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 >> 172.21.15.52:0/3163576963 conn(0x7f99e80cb5f0 msgr2=0x7f99e80aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 shutdown_connections 2023-05-10T01:43:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.416+0000 7f99e7fff700 1 -- 172.21.15.52:0/3163576963 wait complete. 2023-05-10T01:43:30.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:43:30.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.545+0000 7f5bed00b700 1 Processor -- start 2023-05-10T01:43:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.545+0000 7f5bed00b700 1 -- start start 2023-05-10T01:43:30.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5bed00b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5be8157bd0 0x7f5be8158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5bed00b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5be8068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5bed00b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be8158540 con 0x7f5be814e200 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5bed00b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be806a460 con 0x7f5be8157bd0 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5bed00b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8137660 con 0x7f5be8068b90 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5be814e200 0x7f5be814e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49874/0 (socket says 172.21.15.52:49874) 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be6d9d700 1 -- 172.21.15.52:0/2303193043 learned_addr learned my addr 172.21.15.52:0/2303193043 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be659c700 1 --2- 172.21.15.52:0/2303193043 >> v2:172.21.15.172:3300/0 conn(0x7f5be8157bd0 0x7f5be8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be759e700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5be8068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541265765 0 0) 0x7f5be8158540 con 0x7f5be814e200 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.546+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc80033f0 con 0x7f5be814e200 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 797793622 0 0) 0x7f5bc80033f0 con 0x7f5be814e200 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 msgr2=0x7f5be8068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5be8068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 >> v2:172.21.15.172:3300/0 conn(0x7f5be8157bd0 msgr2=0x7f5be8158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 --2- 172.21.15.52:0/2303193043 >> v2:172.21.15.172:3300/0 conn(0x7f5be8157bd0 0x7f5be8158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80697e0 con 0x7f5be814e200 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f5be0001470 con 0x7f5be814e200 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 >> v1:172.21.15.52:6789/0 conn(0x7f5be814e200 legacy=0x7f5be814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc8003910 0x7f5bc8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5bc8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc8004b80 0x7f5bc8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be806a460 con 0x7f5bc8004b80 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80044f0 con 0x7f5bc8003910 2023-05-10T01:43:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800b960 con 0x7f5be8068b90 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc8004b80 0x7f5bc8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be6d9d700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc8003910 0x7f5bc8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be659c700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5bc8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 -- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 msgr2=0x7f5bc8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8068b90 0x7f5bc8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 -- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc8003910 msgr2=0x7f5bc8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc8003910 0x7f5bc8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 -- 172.21.15.52:0/2303193043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80033f0 con 0x7f5bc8004b80 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be759e700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc8004b80 0x7f5bc8005000 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f5bd800e210 tx=0x7f5bd800b040).ready entity=mon.0 client_cookie=28d8854c1acd192a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8009ac0 con 0x7f5bc8004b80 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800f040 con 0x7f5bc8004b80 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.547+0000 7f5be5d9b700 1 -- 172.21.15.52:0/2303193043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800ecd0 con 0x7f5bc8004b80 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 -- 172.21.15.52:0/2303193043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc8004b80 msgr2=0x7f5bc8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2303193043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bc8004b80 0x7f5bc8005000 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f5bd800e210 tx=0x7f5bd800b040).stop 2023-05-10T01:43:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5be759e700 1 -- 172.21.15.52:0/2303193043 reap_dead start 2023-05-10T01:43:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 -- 172.21.15.52:0/2303193043 shutdown_connections 2023-05-10T01:43:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 -- 172.21.15.52:0/2303193043 >> 172.21.15.52:0/2303193043 conn(0x7f5be80c45f0 msgr2=0x7f5be8066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 -- 172.21.15.52:0/2303193043 shutdown_connections 2023-05-10T01:43:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.548+0000 7f5bed00b700 1 -- 172.21.15.52:0/2303193043 wait complete. 2023-05-10T01:43:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.549+0000 7f5bed00b700 1 Processor -- start 2023-05-10T01:43:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.549+0000 7f5bed00b700 1 -- start start 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be8135f90 0x7f5be80ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 0x7f5be80c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80aae00 con 0x7f5be80aba80 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80aa1f0 con 0x7f5be8135f90 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5bed00b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80aa4d0 con 0x7f5be8136370 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40872/0 (socket says 172.21.15.52:40872) 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 -- 172.21.15.52:0/2290415989 learned_addr learned my addr 172.21.15.52:0/2290415989 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be6d9d700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be8135f90 0x7f5be80ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be759e700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 0x7f5be80c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 -- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 msgr2=0x7f5be80c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 0x7f5be80c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 -- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be8135f90 msgr2=0x7f5be80ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be8135f90 0x7f5be80ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 -- 172.21.15.52:0/2290415989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80aa7b0 con 0x7f5be80aba80 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be759e700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 0x7f5be80c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.550+0000 7f5be659c700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f5bd00119c0 tx=0x7f5bd0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.551+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0011e50 con 0x7f5be80aba80 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.551+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000f940 con 0x7f5be80aba80 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.551+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000fcc0 con 0x7f5be80aba80 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.551+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be80aaa90 con 0x7f5be80aba80 2023-05-10T01:43:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.551+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be80c3090 con 0x7f5be80aba80 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.552+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be80aaf70 con 0x7f5be80aba80 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.552+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f5bd0024070 con 0x7f5be80aba80 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.552+0000 7f5bdeffd700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 0x7f5bcc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.552+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f5bd007a5a0 con 0x7f5be80aba80 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.553+0000 7f5be6d9d700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 0x7f5bcc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.553+0000 7f5be6d9d700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 0x7f5bcc0612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5be00015a0 tx=0x7f5be0001e50).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.556+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bd004baa0 con 0x7f5be80aba80 2023-05-10T01:43:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.729+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5be806c340 con 0x7f5be80aba80 2023-05-10T01:43:30.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.732+0000 7f5bdeffd700 1 -- 172.21.15.52:0/2290415989 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bd004f0c0 con 0x7f5be80aba80 2023-05-10T01:43:30.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 msgr2=0x7f5bcc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 0x7f5bcc0612e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5be00015a0 tx=0x7f5be0001e50).stop 2023-05-10T01:43:30.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 msgr2=0x7f5be80ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f5bd00119c0 tx=0x7f5bd0009060).stop 2023-05-10T01:43:30.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 shutdown_connections 2023-05-10T01:43:30.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5bcc05ee20 0x7f5bcc0612e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5be8136370 0x7f5be80c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be8135f90 0x7f5be80ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 --2- 172.21.15.52:0/2290415989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5be80aba80 0x7f5be80ac880 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 >> 172.21.15.52:0/2290415989 conn(0x7f5be80c45f0 msgr2=0x7f5be8136ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 shutdown_connections 2023-05-10T01:43:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.734+0000 7f5bed00b700 1 -- 172.21.15.52:0/2290415989 wait complete. 2023-05-10T01:43:30.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-05-10T01:43:30.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 Processor -- start 2023-05-10T01:43:30.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 -- start start 2023-05-10T01:43:30.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154160 0x7f74980c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7498154540 0x7f74980c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7498069690 0x7f7498069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980c0650 con 0x7f7498069690 2023-05-10T01:43:30.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7498069ff0 con 0x7f7498154540 2023-05-10T01:43:30.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.863+0000 7f749d5c5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74980bfd20 con 0x7f7498154160 2023-05-10T01:43:30.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7498069690 0x7f7498069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7498069690 0x7f7498069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40882/0 (socket says 172.21.15.52:40882) 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 -- 172.21.15.52:0/3347777347 learned_addr learned my addr 172.21.15.52:0/3347777347 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f7496ffd700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154160 0x7f74980c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74967fc700 1 --2- 172.21.15.52:0/3347777347 >> v2:172.21.15.172:3300/0 conn(0x7f7498154540 0x7f74980c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 -- 172.21.15.52:0/3347777347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154160 msgr2=0x7f74980c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154160 0x7f74980c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 -- 172.21.15.52:0/3347777347 >> v2:172.21.15.172:3300/0 conn(0x7f7498154540 msgr2=0x7f74980c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 --2- 172.21.15.52:0/3347777347 >> v2:172.21.15.172:3300/0 conn(0x7f7498154540 0x7f74980c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 -- 172.21.15.52:0/3347777347 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980c0000 con 0x7f7498069690 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f74977fe700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f7498069b00 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f7498083fd0 tx=0x7f7488009840).ready entity=mon.0 client_cookie=e910cbc4f7247726 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f7495ffb700 1 -- 172.21.15.52:0/3347777347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800e070 con 0x7f7498069690 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f7495ffb700 1 -- 172.21.15.52:0/3347777347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748800ba50 con 0x7f7498069690 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.864+0000 7f7495ffb700 1 -- 172.21.15.52:0/3347777347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800bdd0 con 0x7f7498069690 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 -- 172.21.15.52:0/3347777347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 msgr2=0x7f7498069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f7498069b00 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f7498083fd0 tx=0x7f7488009840).stop 2023-05-10T01:43:30.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 -- 172.21.15.52:0/3347777347 shutdown_connections 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f7498069b00 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 --2- 172.21.15.52:0/3347777347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154160 0x7f74980c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 --2- 172.21.15.52:0/3347777347 >> v2:172.21.15.172:3300/0 conn(0x7f7498154540 0x7f74980c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 -- 172.21.15.52:0/3347777347 >> 172.21.15.52:0/3347777347 conn(0x7f74980cb740 msgr2=0x7f74980c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 -- 172.21.15.52:0/3347777347 shutdown_connections 2023-05-10T01:43:30.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.865+0000 7f749d5c5700 1 -- 172.21.15.52:0/3347777347 wait complete. 2023-05-10T01:43:30.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.866+0000 7f749d5c5700 1 Processor -- start 2023-05-10T01:43:30.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.866+0000 7f749d5c5700 1 -- start start 2023-05-10T01:43:30.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7498154160 0x7f74980afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154540 0x7f74980b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980b05b0 con 0x7f7498069690 2023-05-10T01:43:30.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980c1d30 con 0x7f7498154160 2023-05-10T01:43:30.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f749d5c5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74980c1f80 con 0x7f7498154540 2023-05-10T01:43:30.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40884/0 (socket says 172.21.15.52:40884) 2023-05-10T01:43:30.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 -- 172.21.15.52:0/775489281 learned_addr learned my addr 172.21.15.52:0/775489281 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:30.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f74967fc700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7498154160 0x7f74980afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f74977fe700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154540 0x7f74980b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 -- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154540 msgr2=0x7f74980b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154540 0x7f74980b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 -- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7498154160 msgr2=0x7f74980afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:30.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7498154160 0x7f74980afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:30.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 -- 172.21.15.52:0/775489281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009ae0 con 0x7f7498069690 2023-05-10T01:43:30.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.867+0000 7f7496ffd700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f749000d8c0 tx=0x7f7490008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.868+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490011590 con 0x7f7498069690 2023-05-10T01:43:30.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.868+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900116f0 con 0x7f7498069690 2023-05-10T01:43:30.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.868+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74980c2260 con 0x7f7498069690 2023-05-10T01:43:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.868+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490011a70 con 0x7f7498069690 2023-05-10T01:43:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.868+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74980c2820 con 0x7f7498069690 2023-05-10T01:43:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.869+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74980666b0 con 0x7f7498069690 2023-05-10T01:43:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.869+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f7490012420 con 0x7f7498069690 2023-05-10T01:43:30.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.869+0000 7f748effd700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 0x7f747c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:30.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.869+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f7490079730 con 0x7f7498069690 2023-05-10T01:43:30.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.870+0000 7f74967fc700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 0x7f747c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:30.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.870+0000 7f74967fc700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 0x7f747c0612e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f74980aed60 tx=0x7f7480008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:30.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:30.874+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f749004abd0 con 0x7f7498069690 2023-05-10T01:43:31.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:31.128+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f749806c340 con 0x7f7498069690 2023-05-10T01:43:32.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.079+0000 7f748effd700 1 -- 172.21.15.52:0/775489281 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1168) v1 ==== 165+0+0 (secure 0 0 0) 0x7f749004e1f0 con 0x7f7498069690 2023-05-10T01:43:32.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 msgr2=0x7f747c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 0x7f747c0612e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f74980aed60 tx=0x7f7480008040).stop 2023-05-10T01:43:32.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 msgr2=0x7f74981418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f749000d8c0 tx=0x7f7490008040).stop 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 shutdown_connections 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f747c05ee20 0x7f747c0612e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7498154540 0x7f74980b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7498069690 0x7f74981418a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 --2- 172.21.15.52:0/775489281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7498154160 0x7f74980afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 >> 172.21.15.52:0/775489281 conn(0x7f74980cb740 msgr2=0x7f749814faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 shutdown_connections 2023-05-10T01:43:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.082+0000 7f749d5c5700 1 -- 172.21.15.52:0/775489281 wait complete. 2023-05-10T01:43:32.099 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-05-10T01:43:32.100 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-05-10T01:43:32.100 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-05-10T01:43:32.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-05-10T01:43:32.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.221+0000 7f66aa7f2700 1 Processor -- start 2023-05-10T01:43:32.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.221+0000 7f66aa7f2700 1 -- start start 2023-05-10T01:43:32.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66aa7f2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66a40c7370 0x7f66a4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66aa7f2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66a40ad250 0x7f66a414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66aa7f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a4158960 con 0x7f66a40c7750 2023-05-10T01:43:32.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66aa7f2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4155330 con 0x7f66a40ad250 2023-05-10T01:43:32.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66aa7f2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4157d50 con 0x7f66a40c7370 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66a9ff1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66a40ad250 0x7f66a414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66a8fef700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66a40c7750 0x7f66a40acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49908/0 (socket says 172.21.15.52:49908) 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66a9ff1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66a40ad250 0x7f66a414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40896/0 (socket says 172.21.15.52:40896) 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.222+0000 7f66a8fef700 1 -- 172.21.15.52:0/379101697 learned_addr learned my addr 172.21.15.52:0/379101697 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a97f0700 1 --2- 172.21.15.52:0/379101697 >> v2:172.21.15.172:3300/0 conn(0x7f66a40c7370 0x7f66a4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a9ff1700 1 -- 172.21.15.52:0/379101697 >> v2:172.21.15.172:3300/0 conn(0x7f66a40c7370 msgr2=0x7f66a4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:32.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a9ff1700 1 --2- 172.21.15.52:0/379101697 >> v2:172.21.15.172:3300/0 conn(0x7f66a40c7370 0x7f66a4154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a9ff1700 1 -- 172.21.15.52:0/379101697 >> v1:172.21.15.52:6789/0 conn(0x7f66a40c7750 legacy=0x7f66a40acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a3fff700 1 -- 172.21.15.52:0/379101697 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233798335 0 0) 0x7f66a4158960 con 0x7f66a40c7750 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a9ff1700 1 -- 172.21.15.52:0/379101697 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40ad6b0 con 0x7f66a40ad250 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a9ff1700 1 --2- 172.21.15.52:0/379101697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40ad250 0x7f66a414dd60 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f66a4083b90 tx=0x7f6694009060).ready entity=mon.0 client_cookie=76ac16465d2645da server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a3fff700 1 -- 172.21.15.52:0/379101697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400b580 con 0x7f66a40ad250 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a3fff700 1 -- 172.21.15.52:0/379101697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b6e0 con 0x7f66a40ad250 2023-05-10T01:43:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66a3fff700 1 -- 172.21.15.52:0/379101697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400ba60 con 0x7f66a40ad250 2023-05-10T01:43:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66aa7f2700 1 -- 172.21.15.52:0/379101697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40ad250 msgr2=0x7f66a414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/379101697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40ad250 0x7f66a414dd60 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f66a4083b90 tx=0x7f6694009060).stop 2023-05-10T01:43:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66aa7f2700 1 -- 172.21.15.52:0/379101697 shutdown_connections 2023-05-10T01:43:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/379101697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40ad250 0x7f66a414dd60 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.223+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/379101697 >> v2:172.21.15.172:3300/0 conn(0x7f66a40c7370 0x7f66a4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.224+0000 7f66aa7f2700 1 -- 172.21.15.52:0/379101697 >> 172.21.15.52:0/379101697 conn(0x7f66a4068320 msgr2=0x7f66a4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.224+0000 7f66aa7f2700 1 -- 172.21.15.52:0/379101697 shutdown_connections 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.224+0000 7f66aa7f2700 1 -- 172.21.15.52:0/379101697 wait complete. 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.225+0000 7f66aa7f2700 1 Processor -- start 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.225+0000 7f66aa7f2700 1 -- start start 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66a40ad250 0x7f66a40c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a40c7750 0x7f66a40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40c8fc0 con 0x7f66a40c7370 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40afae0 con 0x7f66a40c7750 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40afdc0 con 0x7f66a40ad250 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40900/0 (socket says 172.21.15.52:40900) 2023-05-10T01:43:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 -- 172.21.15.52:0/800446469 learned_addr learned my addr 172.21.15.52:0/800446469 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a9ff1700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a40c7750 0x7f66a40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a97f0700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66a40ad250 0x7f66a40c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 -- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66a40ad250 msgr2=0x7f66a40c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66a40ad250 0x7f66a40c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 -- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a40c7750 msgr2=0x7f66a40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a40c7750 0x7f66a40ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 -- 172.21.15.52:0/800446469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940092a0 con 0x7f66a40c7370 2023-05-10T01:43:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a8fef700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f6698001eb0 tx=0x7f6698007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980070d0 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698007230 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a40c8970 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980075d0 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.226+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a414fee0 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.228+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a40c9130 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.228+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f669801a060 con 0x7f66a40c7370 2023-05-10T01:43:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.228+0000 7f66a17fa700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 0x7f66840612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.228+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f66980794a0 con 0x7f66a40c7370 2023-05-10T01:43:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.228+0000 7f66a97f0700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 0x7f66840612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.229+0000 7f66a97f0700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 0x7f66840612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f669c009fd0 tx=0x7f669c009880).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.232+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f669804a9a0 con 0x7f66a40c7370 2023-05-10T01:43:32.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:32.471+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f66a4158030 con 0x7f66a40c7370 2023-05-10T01:43:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.084+0000 7f66a17fa700 1 -- 172.21.15.52:0/800446469 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1169) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6698018020 con 0x7f66a40c7370 2023-05-10T01:43:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 msgr2=0x7f66840612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 0x7f66840612e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f669c009fd0 tx=0x7f669c009880).stop 2023-05-10T01:43:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 msgr2=0x7f66a414f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f6698001eb0 tx=0x7f6698007e90).stop 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 shutdown_connections 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f668405ee20 0x7f66840612e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a40c7750 0x7f66a40ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66a40ad250 0x7f66a40c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 --2- 172.21.15.52:0/800446469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a40c7370 0x7f66a414f9f0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 >> 172.21.15.52:0/800446469 conn(0x7f66a4068320 msgr2=0x7f66a4153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:33.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 shutdown_connections 2023-05-10T01:43:33.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.086+0000 7f66aa7f2700 1 -- 172.21.15.52:0/800446469 wait complete. 2023-05-10T01:43:33.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:43:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.227+0000 7f4343908700 1 Processor -- start 2023-05-10T01:43:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.228+0000 7f4343908700 1 -- start start 2023-05-10T01:43:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4343908700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f433c154460 0x7f433c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4343908700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c0c94c0 con 0x7f433c068150 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4343908700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c0cb7d0 con 0x7f433c154080 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4343908700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c0c88b0 con 0x7f433c154460 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4341ea5700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f433c068150 0x7f433c0c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49924/0 (socket says 172.21.15.52:49924) 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4340ea3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f433c154460 0x7f433c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4341ea5700 1 -- 172.21.15.52:0/2178807656 learned_addr learned my addr 172.21.15.52:0/2178807656 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4340ea3700 1 -- 172.21.15.52:0/2178807656 >> v1:172.21.15.172:6789/0 conn(0x7f433c154080 legacy=0x7f433c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4340ea3700 1 -- 172.21.15.52:0/2178807656 >> v1:172.21.15.52:6789/0 conn(0x7f433c068150 legacy=0x7f433c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f432bfff700 1 -- 172.21.15.52:0/2178807656 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153767363 0 0) 0x7f433c0c94c0 con 0x7f433c068150 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4340ea3700 1 -- 172.21.15.52:0/2178807656 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0c8b90 con 0x7f433c154460 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f4340ea3700 1 --2- 172.21.15.52:0/2178807656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c0aac90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f432c009760 tx=0x7f432c009060).ready entity=mon.0 client_cookie=84d4dd2cd2b80828 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f432bfff700 1 -- 172.21.15.52:0/2178807656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00b580 con 0x7f433c154460 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f432bfff700 1 -- 172.21.15.52:0/2178807656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00b6e0 con 0x7f433c154460 2023-05-10T01:43:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.229+0000 7f432bfff700 1 -- 172.21.15.52:0/2178807656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00ba60 con 0x7f433c154460 2023-05-10T01:43:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 -- 172.21.15.52:0/2178807656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 msgr2=0x7f433c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 --2- 172.21.15.52:0/2178807656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c0aac90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f432c009760 tx=0x7f432c009060).stop 2023-05-10T01:43:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 -- 172.21.15.52:0/2178807656 shutdown_connections 2023-05-10T01:43:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 --2- 172.21.15.52:0/2178807656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c0aac90 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 -- 172.21.15.52:0/2178807656 >> 172.21.15.52:0/2178807656 conn(0x7f433c067910 msgr2=0x7f433c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:33.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 -- 172.21.15.52:0/2178807656 shutdown_connections 2023-05-10T01:43:33.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.230+0000 7f4343908700 1 -- 172.21.15.52:0/2178807656 wait complete. 2023-05-10T01:43:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.231+0000 7f4343908700 1 Processor -- start 2023-05-10T01:43:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.231+0000 7f4343908700 1 -- start start 2023-05-10T01:43:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 0x7f433c154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 0x7f433c0aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c155ca0 con 0x7f433c154460 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c155f80 con 0x7f433c068150 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4343908700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c155090 con 0x7f433c154080 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4341ea5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4341ea5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40914/0 (socket says 172.21.15.52:40914) 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4341ea5700 1 -- 172.21.15.52:0/1486497792 learned_addr learned my addr 172.21.15.52:0/1486497792 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f4340ea3700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 0x7f433c0aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.232+0000 7f43416a4700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 0x7f433c154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 -- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 msgr2=0x7f433c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 0x7f433c0aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 -- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 msgr2=0x7f433c154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 0x7f433c154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 -- 172.21.15.52:0/1486497792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0092a0 con 0x7f433c154460 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4340ea3700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 0x7f433c0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f43416a4700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 0x7f433c154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4341ea5700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f433400c810 tx=0x7f4334007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334005d30 con 0x7f433c154460 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334005e90 con 0x7f433c154460 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c155370 con 0x7f433c154460 2023-05-10T01:43:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334007320 con 0x7f433c154460 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.233+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c154d30 con 0x7f433c154460 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.234+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c066720 con 0x7f433c154460 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.234+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f4334010030 con 0x7f433c154460 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.234+0000 7f43297fa700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 0x7f431c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.235+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7f4334079b40 con 0x7f433c154460 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.235+0000 7f43416a4700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 0x7f431c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.235+0000 7f43416a4700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 0x7f431c0612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4338001710 tx=0x7f4338009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.239+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f433404afe0 con 0x7f433c154460 2023-05-10T01:43:33.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.413+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f433c06c340 con 0x7f433c154460 2023-05-10T01:43:33.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.416+0000 7f43297fa700 1 -- 172.21.15.52:0/1486497792 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f433404e600 con 0x7f433c154460 2023-05-10T01:43:33.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 msgr2=0x7f431c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 0x7f431c0612e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4338001710 tx=0x7f4338009040).stop 2023-05-10T01:43:33.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 msgr2=0x7f433c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f433400c810 tx=0x7f4334007f90).stop 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 shutdown_connections 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f431c05ee20 0x7f431c0612e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c154460 0x7f433c13f420 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f433c068150 0x7f433c154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 --2- 172.21.15.52:0/1486497792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f433c154080 0x7f433c0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 >> 172.21.15.52:0/1486497792 conn(0x7f433c067910 msgr2=0x7f433c0c1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:33.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 shutdown_connections 2023-05-10T01:43:33.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.418+0000 7f4343908700 1 -- 172.21.15.52:0/1486497792 wait complete. 2023-05-10T01:43:33.433 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:43:33.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:43:33.462 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:43:33.494 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:43:33.494 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:43:33.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:33.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.615+0000 7fb2e711e700 1 Processor -- start 2023-05-10T01:43:33.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.615+0000 7fb2e711e700 1 -- start start 2023-05-10T01:43:33.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e711e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb2e00c8460 0x7fb2e00c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e711e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2e00a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e711e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00c6900 con 0x7fb2e00aad90 2023-05-10T01:43:33.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e711e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e0155ee0 con 0x7fb2e00c8460 2023-05-10T01:43:33.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e711e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01561c0 con 0x7fb2e00c7280 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e611c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2e00aad90 0x7fb2e0155600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49934/0 (socket says 172.21.15.52:49934) 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e611c700 1 -- 172.21.15.52:0/4216101426 learned_addr learned my addr 172.21.15.52:0/4216101426 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e591b700 1 --2- 172.21.15.52:0/4216101426 >> v2:172.21.15.172:3300/0 conn(0x7fb2e00c8460 0x7fb2e00c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e691d700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2e00a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683868308 0 0) 0x7fb2e00c6900 con 0x7fb2e00aad90 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2cc0033f0 con 0x7fb2e00aad90 2023-05-10T01:43:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955221827 0 0) 0x7fb2cc0033f0 con 0x7fb2e00aad90 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 msgr2=0x7fb2e00a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2e00a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 >> v2:172.21.15.172:3300/0 conn(0x7fb2e00c8460 msgr2=0x7fb2e00c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 --2- 172.21.15.52:0/4216101426 >> v2:172.21.15.172:3300/0 conn(0x7fb2e00c8460 0x7fb2e00c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00c6590 con 0x7fb2e00aad90 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.616+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fb2d8001470 con 0x7fb2e00aad90 2023-05-10T01:43:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 >> v1:172.21.15.52:6789/0 conn(0x7fb2e00aad90 legacy=0x7fb2e0155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0038e0 0x7fb2cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2cc004b80 0x7fb2cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0155ee0 con 0x7fb2cc0038e0 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01561c0 con 0x7fb2cc004b80 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc00b8e0 con 0x7fb2e00c7280 2023-05-10T01:43:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e591b700 1 --2- 172.21.15.52:0/4216101426 >> v2:172.21.15.172:3300/0 conn(0x7fb2e00c8460 0x7fb2e00c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0038e0 0x7fb2cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e591b700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e691d700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2cc004b80 0x7fb2cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 -- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 msgr2=0x7fb2cc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2e00c7280 0x7fb2cc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 -- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2cc004b80 msgr2=0x7fb2cc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:33.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2cc004b80 0x7fb2cc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 -- 172.21.15.52:0/4216101426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0033f0 con 0x7fb2cc0038e0 2023-05-10T01:43:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e611c700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0038e0 0x7fb2cc003d00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fb2d800c210 tx=0x7fb2d8001e90).ready entity=mon.0 client_cookie=6916a758f8309ec4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8007a60 con 0x7fb2cc0038e0 2023-05-10T01:43:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800cae0 con 0x7fb2cc0038e0 2023-05-10T01:43:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.617+0000 7fb2e511a700 1 -- 172.21.15.52:0/4216101426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800ce60 con 0x7fb2cc0038e0 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 -- 172.21.15.52:0/4216101426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0038e0 msgr2=0x7fb2cc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 --2- 172.21.15.52:0/4216101426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2cc0038e0 0x7fb2cc003d00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fb2d800c210 tx=0x7fb2d8001e90).stop 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e691d700 1 -- 172.21.15.52:0/4216101426 reap_dead start 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 -- 172.21.15.52:0/4216101426 shutdown_connections 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 -- 172.21.15.52:0/4216101426 >> 172.21.15.52:0/4216101426 conn(0x7fb2e005e810 msgr2=0x7fb2e00622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 -- 172.21.15.52:0/4216101426 shutdown_connections 2023-05-10T01:43:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.618+0000 7fb2e711e700 1 -- 172.21.15.52:0/4216101426 wait complete. 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.619+0000 7fb2e711e700 1 Processor -- start 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.619+0000 7fb2e711e700 1 -- start start 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0038e0 0x7fb2e01452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e00ab8a0 0x7fb2e00abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0151110 con 0x7fb2e01507c0 2023-05-10T01:43:33.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00ac320 con 0x7fb2e00ab8a0 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00ac600 con 0x7fb2cc0038e0 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40934/0 (socket says 172.21.15.52:40934) 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 -- 172.21.15.52:0/237150456 learned_addr learned my addr 172.21.15.52:0/237150456 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e611c700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0038e0 0x7fb2e01452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e591b700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e00ab8a0 0x7fb2e00abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 -- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0038e0 msgr2=0x7fb2e01452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0038e0 0x7fb2e01452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 -- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e00ab8a0 msgr2=0x7fb2e00abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e00ab8a0 0x7fb2e00abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 -- 172.21.15.52:0/237150456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00ac8e0 con 0x7fb2e01507c0 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e691d700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb2e00aeac0 tx=0x7fb2d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0015440 con 0x7fb2e01507c0 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d00155a0 con 0x7fb2e01507c0 2023-05-10T01:43:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0015920 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e0152eb0 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.620+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e0152ad0 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.621+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0047150 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.622+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb2d001d030 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.622+0000 7fb2de7fc700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 0x7fb2c00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.622+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fb2d00795b0 con 0x7fb2e01507c0 2023-05-10T01:43:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.622+0000 7fb2e611c700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 0x7fb2c00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:33.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.623+0000 7fb2e611c700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 0x7fb2c00612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb2d8001ed0 tx=0x7fb2d8015000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:33.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.626+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2d004ab60 con 0x7fb2e01507c0 2023-05-10T01:43:33.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:43:33.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:43:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.840+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e00aa990 con 0x7fb2e01507c0 2023-05-10T01:43:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.840+0000 7fb2de7fc700 1 -- 172.21.15.52:0/237150456 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb2d004e180 con 0x7fb2e01507c0 2023-05-10T01:43:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:33.844 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1054443317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054443317},{"type":"v1","addr":"172.21.15.172:6836","nonce":1054443317}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4134924027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4134924027},{"type":"v1","addr":"172.21.15.172:6837","nonce":4134924027}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3829985938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3829985938},{"type":"v1","addr":"172.21.15.52:6834","nonce":3829985938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8559,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/800950016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":800950016},{"type":"v1","addr":"172.21.15.52:6835","nonce":800950016}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-05-10T01:43:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 msgr2=0x7fb2c00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 0x7fb2c00612e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb2d8001ed0 tx=0x7fb2d8015000).stop 2023-05-10T01:43:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 msgr2=0x7fb2e0150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fb2e00aeac0 tx=0x7fb2d0008040).stop 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 shutdown_connections 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb2c005ee20 0x7fb2c00612e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e01507c0 0x7fb2e0150c20 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2cc0038e0 0x7fb2e01452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 --2- 172.21.15.52:0/237150456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e00ab8a0 0x7fb2e00abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 >> 172.21.15.52:0/237150456 conn(0x7fb2e005e810 msgr2=0x7fb2e00bea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 shutdown_connections 2023-05-10T01:43:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:33.842+0000 7fb2e711e700 1 -- 172.21.15.52:0/237150456 wait complete. 2023-05-10T01:43:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 64 2023-05-10T01:43:33.857 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:43:33.857 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:43:33.858 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:43:33.858 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:43:33.858 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:43:33.858 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:43:33.859 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:43:33.859 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:43:33.859 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:43:33.859 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:43:33.860 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:43:33.860 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:43:33.860 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:43:33.860 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:43:33.860 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:43:33.861 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:43:33.866 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:43:33.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:43:33.870 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:43:33.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:43:33.871 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:43:33.871 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:43:33.873 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:43:33.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:43:33.912 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:43:33.913 DEBUG:teuthology.parallel:result is None 2023-05-10T01:43:33.914 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:43:33.915 DEBUG:teuthology.parallel:result is None 2023-05-10T01:43:33.916 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:43:33.916 DEBUG:teuthology.parallel:result is None 2023-05-10T01:43:33.917 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:43:33.917 DEBUG:teuthology.parallel:result is None 2023-05-10T01:43:33.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:43:33.990 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:43:33.990 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:43:33.991 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:43:33.992 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:43:34.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.038+0000 7fb628b3c700 1 Processor -- start 2023-05-10T01:43:34.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.038+0000 7fb628b3c700 1 -- start start 2023-05-10T01:43:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb628b3c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb624154160 0x7fb6240c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb628b3c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240c0650 con 0x7fb624069da0 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb628b3c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240bfd20 con 0x7fb624154540 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb628b3c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240c0000 con 0x7fb624154160 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb622d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb624069da0 0x7fb6240c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49976/0 (socket says 172.21.15.52:49976) 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb622d9d700 1 -- 172.21.15.52:0/3875528280 learned_addr learned my addr 172.21.15.52:0/3875528280 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb62259c700 1 --2- 172.21.15.52:0/3875528280 >> v2:172.21.15.172:3300/0 conn(0x7fb624154160 0x7fb6240c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053052563 0 0) 0x7fb6240c0650 con 0x7fb624069da0 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.039+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6040033f0 con 0x7fb624069da0 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357346586 0 0) 0x7fb6040033f0 con 0x7fb624069da0 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 >> v2:172.21.15.172:3300/0 conn(0x7fb624154160 msgr2=0x7fb6240c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 --2- 172.21.15.52:0/3875528280 >> v2:172.21.15.172:3300/0 conn(0x7fb624154160 0x7fb6240c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 >> v1:172.21.15.172:6789/0 conn(0x7fb624154540 legacy=0x7fb624069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240c02e0 con 0x7fb624069da0 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fb614001470 con 0x7fb624069da0 2023-05-10T01:43:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 >> v1:172.21.15.52:6789/0 conn(0x7fb624069da0 legacy=0x7fb6240c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040038e0 0x7fb604003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604004690 0x7fb604004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 0x7fb60400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240c0000 con 0x7fb604005050 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60400bfe0 con 0x7fb6040038e0 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60400c1a0 con 0x7fb604004690 2023-05-10T01:43:34.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 0x7fb60400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62259c700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040038e0 0x7fb604003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb621d9b700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604004690 0x7fb604004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 -- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604004690 msgr2=0x7fb604004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604004690 0x7fb604004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 -- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040038e0 msgr2=0x7fb604003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040038e0 0x7fb604003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 -- 172.21.15.52:0/3875528280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040033f0 con 0x7fb604005050 2023-05-10T01:43:34.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62259c700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040038e0 0x7fb604003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 -- 172.21.15.52:0/3875528280 reap_dead start 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb622d9d700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 0x7fb60400b8e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fb61400c160 tx=0x7fb614001e50).ready entity=mon.0 client_cookie=24f832fdb1d71eff server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.040+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614007a20 con 0x7fb604005050 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400ca90 con 0x7fb604005050 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb62159a700 1 -- 172.21.15.52:0/3875528280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400ce10 con 0x7fb604005050 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 -- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 msgr2=0x7fb60400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:34.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 0x7fb60400b8e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fb61400c160 tx=0x7fb614001e50).stop 2023-05-10T01:43:34.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 -- 172.21.15.52:0/3875528280 shutdown_connections 2023-05-10T01:43:34.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 --2- 172.21.15.52:0/3875528280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb604005050 0x7fb60400b8e0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 -- 172.21.15.52:0/3875528280 >> 172.21.15.52:0/3875528280 conn(0x7fb6240cb6f0 msgr2=0x7fb6240c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:34.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 -- 172.21.15.52:0/3875528280 shutdown_connections 2023-05-10T01:43:34.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.041+0000 7fb628b3c700 1 -- 172.21.15.52:0/3875528280 wait complete. 2023-05-10T01:43:34.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.042+0000 7fb628b3c700 1 Processor -- start 2023-05-10T01:43:34.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.042+0000 7fb628b3c700 1 -- start start 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604005050 0x7fb6241679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6241553b0 0x7fb62414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241517b0 con 0x7fb6240accd0 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240ad600 con 0x7fb604005050 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb628b3c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241682a0 con 0x7fb6241553b0 2023-05-10T01:43:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40974/0 (socket says 172.21.15.52:40974) 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 -- 172.21.15.52:0/2950007745 learned_addr learned my addr 172.21.15.52:0/2950007745 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb62259c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604005050 0x7fb6241679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb621d9b700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6241553b0 0x7fb62414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 -- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6241553b0 msgr2=0x7fb62414fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6241553b0 0x7fb62414fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 -- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604005050 msgr2=0x7fb6241679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604005050 0x7fb6241679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.043+0000 7fb622d9d700 1 -- 172.21.15.52:0/2950007745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624168580 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb622d9d700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fb61400c160 tx=0x7fb614015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140048c0 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614004a20 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624151a50 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614004dc0 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.044+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb624167e90 con 0x7fb6240accd0 2023-05-10T01:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.045+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6240666b0 con 0x7fb6240accd0 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.045+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fb614027070 con 0x7fb6240accd0 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.045+0000 7fb61a7fc700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 0x7fb6080612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.046+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6249+0+0 (secure 0 0 0) 0x7fb61407a8e0 con 0x7fb6240accd0 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.046+0000 7fb62259c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 0x7fb6080612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.046+0000 7fb62259c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 0x7fb6080612b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb61c009750 tx=0x7fb61c00b040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.050+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb61404bde0 con 0x7fb6240accd0 2023-05-10T01:43:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:34.243+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb624151c40 con 0x7fb6240accd0 2023-05-10T01:43:35.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.090+0000 7fb61a7fc700 1 -- 172.21.15.52:0/2950007745 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb614025070 con 0x7fb6240accd0 2023-05-10T01:43:35.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 msgr2=0x7fb6080612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 0x7fb6080612b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb61c009750 tx=0x7fb61c00b040).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 msgr2=0x7fb6240ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fb61400c160 tx=0x7fb614015000).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 shutdown_connections 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb60805edf0 0x7fb6080612b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6240accd0 0x7fb6240ad110 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604005050 0x7fb6241679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 --2- 172.21.15.52:0/2950007745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6241553b0 0x7fb62414fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 >> 172.21.15.52:0/2950007745 conn(0x7fb6240cb6f0 msgr2=0x7fb6240abfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 shutdown_connections 2023-05-10T01:43:35.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.093+0000 7fb628b3c700 1 -- 172.21.15.52:0/2950007745 wait complete. 2023-05-10T01:43:35.100 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:43:35.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:43:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.232+0000 7fa095be8700 1 Processor -- start 2023-05-10T01:43:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.232+0000 7fa095be8700 1 -- start start 2023-05-10T01:43:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154160 0x7fa0900aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 0x7fa0900a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0900aa1f0 0x7fa0900c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900ab1f0 con 0x7fa0900aa1f0 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900c08a0 con 0x7fa090154540 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa095be8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900bfc90 con 0x7fa090154160 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0900aa1f0 0x7fa0900c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0900aa1f0 0x7fa0900c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40986/0 (socket says 172.21.15.52:40986) 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 -- 172.21.15.52:0/4209333512 learned_addr learned my addr 172.21.15.52:0/4209333512 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08effd700 1 --2- 172.21.15.52:0/4209333512 >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 0x7fa0900a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08f7fe700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154160 0x7fa0900aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 -- 172.21.15.52:0/4209333512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154160 msgr2=0x7fa0900aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154160 0x7fa0900aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 -- 172.21.15.52:0/4209333512 >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 msgr2=0x7fa0900a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 --2- 172.21.15.52:0/4209333512 >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 0x7fa0900a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 -- 172.21.15.52:0/4209333512 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900bff70 con 0x7fa0900aa1f0 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08effd700 1 --2- 172.21.15.52:0/4209333512 >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 0x7fa0900a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08ffff700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0900aa1f0 0x7fa0900c5ca0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fa090082f90 tx=0x7fa088009840).ready entity=mon.0 client_cookie=3bed407c3a951a42 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.233+0000 7fa08e7fc700 1 -- 172.21.15.52:0/4209333512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800e070 con 0x7fa0900aa1f0 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa08e7fc700 1 -- 172.21.15.52:0/4209333512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800ba50 con 0x7fa0900aa1f0 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa08e7fc700 1 -- 172.21.15.52:0/4209333512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800bdd0 con 0x7fa0900aa1f0 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 -- 172.21.15.52:0/4209333512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0900aa1f0 msgr2=0x7fa0900c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0900aa1f0 0x7fa0900c5ca0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fa090082f90 tx=0x7fa088009840).stop 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 -- 172.21.15.52:0/4209333512 shutdown_connections 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0900aa1f0 0x7fa0900c5ca0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 --2- 172.21.15.52:0/4209333512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154160 0x7fa0900aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 --2- 172.21.15.52:0/4209333512 >> v2:172.21.15.172:3300/0 conn(0x7fa090154540 0x7fa0900a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 -- 172.21.15.52:0/4209333512 >> 172.21.15.52:0/4209333512 conn(0x7fa0900cb6c0 msgr2=0x7fa0900c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 -- 172.21.15.52:0/4209333512 shutdown_connections 2023-05-10T01:43:35.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.234+0000 7fa095be8700 1 -- 172.21.15.52:0/4209333512 wait complete. 2023-05-10T01:43:35.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.235+0000 7fa095be8700 1 Processor -- start 2023-05-10T01:43:35.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.235+0000 7fa095be8700 1 -- start start 2023-05-10T01:43:35.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0900aa1f0 0x7fa0901641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154540 0x7fa0901459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901651f0 con 0x7fa090154160 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901465b0 con 0x7fa0900aa1f0 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa095be8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901646a0 con 0x7fa090154540 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40990/0 (socket says 172.21.15.52:40990) 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08effd700 1 -- 172.21.15.52:0/1447971880 learned_addr learned my addr 172.21.15.52:0/1447971880 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08f7fe700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0900aa1f0 0x7fa0901641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08ffff700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154540 0x7fa0901459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.236+0000 7fa08effd700 1 -- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154540 msgr2=0x7fa0901459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa08effd700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154540 0x7fa0901459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa08effd700 1 -- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0900aa1f0 msgr2=0x7fa0901641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa08effd700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0900aa1f0 0x7fa0901641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa08effd700 1 -- 172.21.15.52:0/1447971880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088009ae0 con 0x7fa090154160 2023-05-10T01:43:35.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa08effd700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fa08000d860 tx=0x7fa080008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080011590 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0800116f0 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0900b0d40 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080011a70 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.237+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa090164c30 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.238+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa090146380 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.238+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fa080012420 con 0x7fa090154160 2023-05-10T01:43:35.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.238+0000 7fa0877fe700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 0x7fa0740612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.239+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7fa0800793c0 con 0x7fa090154160 2023-05-10T01:43:35.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.239+0000 7fa08f7fe700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 0x7fa0740612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.239+0000 7fa08f7fe700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 0x7fa0740612b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa07800bbc0 tx=0x7fa078008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.243+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa090146380 con 0x7fa090154160 2023-05-10T01:43:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.481+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa090146380 con 0x7fa090154160 2023-05-10T01:43:35.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.482+0000 7fa0877fe700 1 -- 172.21.15.52:0/1447971880 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa08004ab10 con 0x7fa090154160 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:43:35.489 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:43:35.491 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:43:35.493 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.494 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.495 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.496 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:43:35.498 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:43:35.499 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.500 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.501 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.502 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:43:35.503 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:43:35.505 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.506 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.507 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:43:35.508 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:43:35.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:43:35.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:43:35.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.510 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.511 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.511 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:43:35.511 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:43:35.511 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:35.512 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:35.513 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:43:35.514 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:43:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 msgr2=0x7fa0740612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 0x7fa0740612b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa07800bbc0 tx=0x7fa078008040).stop 2023-05-10T01:43:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 msgr2=0x7fa0900b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fa08000d860 tx=0x7fa080008040).stop 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 shutdown_connections 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa07405edf0 0x7fa0740612b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa090154540 0x7fa0901459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0900aa1f0 0x7fa0901641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 --2- 172.21.15.52:0/1447971880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090154160 0x7fa0900b0850 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 >> 172.21.15.52:0/1447971880 conn(0x7fa0900cb6c0 msgr2=0x7fa0900c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 shutdown_connections 2023-05-10T01:43:35.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.484+0000 7fa095be8700 1 -- 172.21.15.52:0/1447971880 wait complete. 2023-05-10T01:43:35.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:35.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.630+0000 7fad7d952700 1 Processor -- start 2023-05-10T01:43:35.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.630+0000 7fad7d952700 1 -- start start 2023-05-10T01:43:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad7d952700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad78154540 0x7fad78069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad7d952700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780c0650 con 0x7fad78069b80 2023-05-10T01:43:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad7d952700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad78069fb0 con 0x7fad78154160 2023-05-10T01:43:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad7d952700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780bfd20 con 0x7fad78154540 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad767fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad78154540 0x7fad78069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad767fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad78154540 0x7fad78069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41000/0 (socket says 172.21.15.52:41000) 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad767fc700 1 -- 172.21.15.52:0/2384414569 learned_addr learned my addr 172.21.15.52:0/2384414569 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.631+0000 7fad777fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad78069b80 0x7fad780c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50014/0 (socket says 172.21.15.52:50014) 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad767fc700 1 -- 172.21.15.52:0/2384414569 >> v1:172.21.15.172:6789/0 conn(0x7fad78154160 legacy=0x7fad780c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad767fc700 1 -- 172.21.15.52:0/2384414569 >> v1:172.21.15.52:6789/0 conn(0x7fad78069b80 legacy=0x7fad780c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad767fc700 1 -- 172.21.15.52:0/2384414569 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780c0000 con 0x7fad78154540 2023-05-10T01:43:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad75ffb700 1 -- 172.21.15.52:0/2384414569 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410402250 0 0) 0x7fad780c0650 con 0x7fad78069b80 2023-05-10T01:43:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad767fc700 1 --2- 172.21.15.52:0/2384414569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154540 0x7fad78069690 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fad60006fd0 tx=0x7fad600090f0).ready entity=mon.0 client_cookie=3c8476fec72fa416 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad75ffb700 1 -- 172.21.15.52:0/2384414569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000b600 con 0x7fad78154540 2023-05-10T01:43:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad75ffb700 1 -- 172.21.15.52:0/2384414569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000b760 con 0x7fad78154540 2023-05-10T01:43:35.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad75ffb700 1 -- 172.21.15.52:0/2384414569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000bb00 con 0x7fad78154540 2023-05-10T01:43:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad7d952700 1 -- 172.21.15.52:0/2384414569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154540 msgr2=0x7fad78069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.632+0000 7fad7d952700 1 --2- 172.21.15.52:0/2384414569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154540 0x7fad78069690 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fad60006fd0 tx=0x7fad600090f0).stop 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.633+0000 7fad7d952700 1 -- 172.21.15.52:0/2384414569 shutdown_connections 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.633+0000 7fad7d952700 1 --2- 172.21.15.52:0/2384414569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154540 0x7fad78069690 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.633+0000 7fad7d952700 1 -- 172.21.15.52:0/2384414569 >> 172.21.15.52:0/2384414569 conn(0x7fad780cb6f0 msgr2=0x7fad780c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.633+0000 7fad7d952700 1 -- 172.21.15.52:0/2384414569 shutdown_connections 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.633+0000 7fad7d952700 1 -- 172.21.15.52:0/2384414569 wait complete. 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.634+0000 7fad7d952700 1 Processor -- start 2023-05-10T01:43:35.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.634+0000 7fad7d952700 1 -- start start 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 0x7fad780c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad78154540 0x7fad7814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7814fc40 con 0x7fad78154160 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7814ff20 con 0x7fad78154540 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad78168370 con 0x7fad78069b80 2023-05-10T01:43:35.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41004/0 (socket says 172.21.15.52:41004) 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 -- 172.21.15.52:0/787136589 learned_addr learned my addr 172.21.15.52:0/787136589 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad777fe700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad78154540 0x7fad7814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad76ffd700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 0x7fad780c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 -- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 msgr2=0x7fad780c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 0x7fad780c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 -- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad78154540 msgr2=0x7fad7814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad78154540 0x7fad7814d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 -- 172.21.15.52:0/787136589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60009370 con 0x7fad78154160 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad76ffd700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 0x7fad780c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad767fc700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fad78083050 tx=0x7fad60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600069b0 con 0x7fad78154160 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000b8d0 con 0x7fad78154160 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78168650 con 0x7fad78154160 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60024470 con 0x7fad78154160 2023-05-10T01:43:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.635+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78168080 con 0x7fad78154160 2023-05-10T01:43:35.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.636+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad780666b0 con 0x7fad78154160 2023-05-10T01:43:35.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.636+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fad6000f070 con 0x7fad78154160 2023-05-10T01:43:35.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.637+0000 7fad6effd700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 0x7fad5c0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.637+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7fad6007b5b0 con 0x7fad78154160 2023-05-10T01:43:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.637+0000 7fad76ffd700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 0x7fad5c0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.637+0000 7fad76ffd700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 0x7fad5c0612e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fad70007fd0 tx=0x7fad70009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.641+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad6004cd60 con 0x7fad78154160 2023-05-10T01:43:35.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.815+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad7806c340 con 0x7fad78154160 2023-05-10T01:43:35.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.816+0000 7fad6effd700 1 -- 172.21.15.52:0/787136589 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14268 (secure 0 0 0) 0x7fad60050380 con 0x7fad78154160 2023-05-10T01:43:35.819 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:35.820 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":152,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:35.085725+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:35.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 msgr2=0x7fad5c0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 0x7fad5c0612e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fad70007fd0 tx=0x7fad70009040).stop 2023-05-10T01:43:35.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 msgr2=0x7fad78167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fad78083050 tx=0x7fad60017000).stop 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 shutdown_connections 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad5c05ee20 0x7fad5c0612e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad78154540 0x7fad7814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad78069b80 0x7fad780c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 --2- 172.21.15.52:0/787136589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad78154160 0x7fad78167b90 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 >> 172.21.15.52:0/787136589 conn(0x7fad780cb6f0 msgr2=0x7fad78153360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 shutdown_connections 2023-05-10T01:43:35.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.818+0000 7fad7d952700 1 -- 172.21.15.52:0/787136589 wait complete. 2023-05-10T01:43:35.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:43:35.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:43:35.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.950+0000 7f1eb0cce700 1 Processor -- start 2023-05-10T01:43:35.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.950+0000 7f1eb0cce700 1 -- start start 2023-05-10T01:43:35.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154080 0x7f1eac0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 0x7f1eac0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1eac0aa140 0x7f1eac068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0aa560 con 0x7f1eac0aa140 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0c94c0 con 0x7f1eac154460 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eb0cce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0cb7d0 con 0x7f1eac154080 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eaad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1eac0aa140 0x7f1eac068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eaad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1eac0aa140 0x7f1eac068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41014/0 (socket says 172.21.15.52:41014) 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.951+0000 7f1eaad9d700 1 -- 172.21.15.52:0/3889939280 learned_addr learned my addr 172.21.15.52:0/3889939280 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaa59c700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154080 0x7f1eac0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1ea9d9b700 1 --2- 172.21.15.52:0/3889939280 >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 0x7f1eac0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 -- 172.21.15.52:0/3889939280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154080 msgr2=0x7f1eac0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154080 0x7f1eac0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 -- 172.21.15.52:0/3889939280 >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 msgr2=0x7f1eac0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 --2- 172.21.15.52:0/3889939280 >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 0x7f1eac0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 -- 172.21.15.52:0/3889939280 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac0c88b0 con 0x7f1eac0aa140 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1ea9d9b700 1 --2- 172.21.15.52:0/3889939280 >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 0x7f1eac0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eaad9d700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac068150 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f1eac083c40 tx=0x7f1e9c009840).ready entity=mon.0 client_cookie=9d9e63901cbe267e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1ea959a700 1 -- 172.21.15.52:0/3889939280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00e070 con 0x7f1eac0aa140 2023-05-10T01:43:35.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1ea959a700 1 -- 172.21.15.52:0/3889939280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00ba20 con 0x7f1eac0aa140 2023-05-10T01:43:35.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1ea959a700 1 -- 172.21.15.52:0/3889939280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00bda0 con 0x7f1eac0aa140 2023-05-10T01:43:35.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eb0cce700 1 -- 172.21.15.52:0/3889939280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 msgr2=0x7f1eac068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.952+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac068150 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f1eac083c40 tx=0x7f1e9c009840).stop 2023-05-10T01:43:35.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 -- 172.21.15.52:0/3889939280 shutdown_connections 2023-05-10T01:43:35.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac068150 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/3889939280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154080 0x7f1eac0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/3889939280 >> v2:172.21.15.172:3300/0 conn(0x7f1eac154460 0x7f1eac0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 -- 172.21.15.52:0/3889939280 >> 172.21.15.52:0/3889939280 conn(0x7f1eac067910 msgr2=0x7f1eac0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 -- 172.21.15.52:0/3889939280 shutdown_connections 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.953+0000 7f1eb0cce700 1 -- 172.21.15.52:0/3889939280 wait complete. 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 Processor -- start 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 -- start start 2023-05-10T01:43:35.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eac154080 0x7f1eac1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154460 0x7f1eac141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac141e80 con 0x7f1eac0aa140 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0c3070 con 0x7f1eac154080 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.954+0000 7f1eb0cce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0c32a0 con 0x7f1eac154460 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41018/0 (socket says 172.21.15.52:41018) 2023-05-10T01:43:35.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 -- 172.21.15.52:0/4066969856 learned_addr learned my addr 172.21.15.52:0/4066969856 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1ea9d9b700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eac154080 0x7f1eac1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaad9d700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154460 0x7f1eac141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 -- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154460 msgr2=0x7f1eac141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154460 0x7f1eac141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 -- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eac154080 msgr2=0x7f1eac1414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eac154080 0x7f1eac1414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:35.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 -- 172.21.15.52:0/4066969856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c009ae0 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eaa59c700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f1ea400e980 tx=0x7f1ea4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4012600 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4012760 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac0c35e0 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4012ae0 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.955+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac0c3e20 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.956+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac066720 con 0x7f1eac0aa140 2023-05-10T01:43:35.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.957+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f1ea4022070 con 0x7f1eac0aa140 2023-05-10T01:43:35.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.957+0000 7f1e9a7fc700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 0x7f1e880612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:35.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.957+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f1ea4079d00 con 0x7f1eac0aa140 2023-05-10T01:43:35.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.957+0000 7f1ea9d9b700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 0x7f1e880612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:35.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.957+0000 7f1ea9d9b700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 0x7f1e880612b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1ea0006fd0 tx=0x7f1ea0008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:35.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:35.961+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ea407d030 con 0x7f1eac0aa140 2023-05-10T01:43:36.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.132+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1eac0c37c0 con 0x7f1eac0aa140 2023-05-10T01:43:36.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.132+0000 7f1e9a7fc700 1 -- 172.21.15.52:0/4066969856 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ea4016070 con 0x7f1eac0aa140 2023-05-10T01:43:36.136 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:43:36.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 msgr2=0x7f1e880612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 0x7f1e880612b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1ea0006fd0 tx=0x7f1ea0008040).stop 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 msgr2=0x7f1eac0bfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f1ea400e980 tx=0x7f1ea4009060).stop 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 shutdown_connections 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e8805edf0 0x7f1e880612b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1eac154460 0x7f1eac141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eac0aa140 0x7f1eac0bfdf0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 --2- 172.21.15.52:0/4066969856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eac154080 0x7f1eac1414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 >> 172.21.15.52:0/4066969856 conn(0x7f1eac067910 msgr2=0x7f1eac0c1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 shutdown_connections 2023-05-10T01:43:36.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.134+0000 7f1eb0cce700 1 -- 172.21.15.52:0/4066969856 wait complete. 2023-05-10T01:43:36.149 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:43:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.265+0000 7feb8e369700 1 Processor -- start 2023-05-10T01:43:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 -- start start 2023-05-10T01:43:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feb88155130 0x7feb880622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb88062790 0x7feb880635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8814eac0 con 0x7feb8814e6e0 2023-05-10T01:43:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb88154ca0 con 0x7feb88062790 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.266+0000 7feb8e369700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880c6010 con 0x7feb88155130 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb88062790 0x7feb880635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb88062790 0x7feb880635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41028/0 (socket says 172.21.15.52:41028) 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 -- 172.21.15.52:0/1720792064 learned_addr learned my addr 172.21.15.52:0/1720792064 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb877fe700 1 --2- 172.21.15.52:0/1720792064 >> v2:172.21.15.172:3300/0 conn(0x7feb88155130 0x7feb880622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 -- 172.21.15.52:0/1720792064 >> v2:172.21.15.172:3300/0 conn(0x7feb88155130 msgr2=0x7feb880622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 --2- 172.21.15.52:0/1720792064 >> v2:172.21.15.172:3300/0 conn(0x7feb88155130 0x7feb880622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 -- 172.21.15.52:0/1720792064 >> v1:172.21.15.172:6789/0 conn(0x7feb8814e6e0 legacy=0x7feb880c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 -- 172.21.15.52:0/1720792064 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88154650 con 0x7feb88062790 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb8c906700 1 --2- 172.21.15.52:0/1720792064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88062790 0x7feb880635f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7feb880660b0 tx=0x7feb80009840).ready entity=mon.0 client_cookie=b23c8d6881e1e95 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb86ffd700 1 -- 172.21.15.52:0/1720792064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000e070 con 0x7feb88062790 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb86ffd700 1 -- 172.21.15.52:0/1720792064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000ba20 con 0x7feb88062790 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.267+0000 7feb86ffd700 1 -- 172.21.15.52:0/1720792064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000bda0 con 0x7feb88062790 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 -- 172.21.15.52:0/1720792064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88062790 msgr2=0x7feb880635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 --2- 172.21.15.52:0/1720792064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88062790 0x7feb880635f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7feb880660b0 tx=0x7feb80009840).stop 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 -- 172.21.15.52:0/1720792064 shutdown_connections 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 --2- 172.21.15.52:0/1720792064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88062790 0x7feb880635f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 --2- 172.21.15.52:0/1720792064 >> v2:172.21.15.172:3300/0 conn(0x7feb88155130 0x7feb880622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 -- 172.21.15.52:0/1720792064 >> 172.21.15.52:0/1720792064 conn(0x7feb8805e810 msgr2=0x7feb880c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 -- 172.21.15.52:0/1720792064 shutdown_connections 2023-05-10T01:43:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.268+0000 7feb8e369700 1 -- 172.21.15.52:0/1720792064 wait complete. 2023-05-10T01:43:36.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.269+0000 7feb8e369700 1 Processor -- start 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.269+0000 7feb8e369700 1 -- start start 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb88062790 0x7feb8814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb8814e6e0 0x7feb88168740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88168c30 con 0x7feb88155130 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88150200 con 0x7feb8814e6e0 2023-05-10T01:43:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8e369700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb881504e0 con 0x7feb88062790 2023-05-10T01:43:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41034/0 (socket says 172.21.15.52:41034) 2023-05-10T01:43:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 -- 172.21.15.52:0/3613270681 learned_addr learned my addr 172.21.15.52:0/3613270681 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb877fe700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb8814e6e0 0x7feb88168740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb87fff700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb88062790 0x7feb8814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 -- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb88062790 msgr2=0x7feb8814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb88062790 0x7feb8814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 -- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb8814e6e0 msgr2=0x7feb88168740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb8814e6e0 0x7feb88168740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 -- 172.21.15.52:0/3613270681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009ae0 con 0x7feb88155130 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb8c906700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7feb8000b6c0 tx=0x7feb80009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.270+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800092e0 con 0x7feb88155130 2023-05-10T01:43:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.271+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb881507c0 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.271+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8001e470 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.271+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8001e830 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.271+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb88150d80 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.271+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8806c340 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.272+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7feb80025030 con 0x7feb88155130 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.272+0000 7feb6ffff700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 0x7feb680612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.272+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7feb8007afe0 con 0x7feb88155130 2023-05-10T01:43:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.272+0000 7feb87fff700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 0x7feb680612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.273+0000 7feb87fff700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 0x7feb680612e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7feb78003900 tx=0x7feb78007d40).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.276+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb800a98f0 con 0x7feb88155130 2023-05-10T01:43:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.449+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb88067980 con 0x7feb88155130 2023-05-10T01:43:36.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.450+0000 7feb6ffff700 1 -- 172.21.15.52:0/3613270681 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb80023030 con 0x7feb88155130 2023-05-10T01:43:36.453 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:43:36.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 msgr2=0x7feb680612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 0x7feb680612e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7feb78003900 tx=0x7feb78007d40).stop 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 msgr2=0x7feb880a8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7feb8000b6c0 tx=0x7feb80009840).stop 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 shutdown_connections 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7feb6805ee20 0x7feb680612e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88155130 0x7feb880a8720 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb88062790 0x7feb8814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 --2- 172.21.15.52:0/3613270681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb8814e6e0 0x7feb88168740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 >> 172.21.15.52:0/3613270681 conn(0x7feb8805e810 msgr2=0x7feb88069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 shutdown_connections 2023-05-10T01:43:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.451+0000 7feb8e369700 1 -- 172.21.15.52:0/3613270681 wait complete. 2023-05-10T01:43:36.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:43:36.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.580+0000 7f6998eeb700 1 Processor -- start 2023-05-10T01:43:36.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.580+0000 7f6998eeb700 1 -- start start 2023-05-10T01:43:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6998eeb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6994154540 0x7f6994069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6998eeb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994069b80 0x7f69940c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6998eeb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69940c0650 con 0x7f6994154160 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6998eeb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6994069ff0 con 0x7f6994154540 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6998eeb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940bfd20 con 0x7f6994069b80 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6994154540 0x7f6994069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6994154540 0x7f6994069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41040/0 (socket says 172.21.15.52:41040) 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 -- 172.21.15.52:0/178462487 learned_addr learned my addr 172.21.15.52:0/178462487 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6992d9d700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994069b80 0x7f69940c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 -- 172.21.15.52:0/178462487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994069b80 msgr2=0x7f69940c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994069b80 0x7f69940c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 -- 172.21.15.52:0/178462487 >> v1:172.21.15.172:6789/0 conn(0x7f6994154160 legacy=0x7f69940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 -- 172.21.15.52:0/178462487 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940c0000 con 0x7f6994154540 2023-05-10T01:43:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f6991d9b700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994154540 0x7f6994069690 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f6988006fd0 tx=0x7f69880090f0).ready entity=mon.0 client_cookie=baee9dc323b771f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f699159a700 1 -- 172.21.15.52:0/178462487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800b600 con 0x7f6994154540 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f699159a700 1 -- 172.21.15.52:0/178462487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800b760 con 0x7f6994154540 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.581+0000 7f699159a700 1 -- 172.21.15.52:0/178462487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800bae0 con 0x7f6994154540 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 -- 172.21.15.52:0/178462487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994154540 msgr2=0x7f6994069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994154540 0x7f6994069690 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f6988006fd0 tx=0x7f69880090f0).stop 2023-05-10T01:43:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 -- 172.21.15.52:0/178462487 shutdown_connections 2023-05-10T01:43:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994069b80 0x7f69940c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 --2- 172.21.15.52:0/178462487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994154540 0x7f6994069690 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 -- 172.21.15.52:0/178462487 >> 172.21.15.52:0/178462487 conn(0x7f69940cb740 msgr2=0x7f69940c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 -- 172.21.15.52:0/178462487 shutdown_connections 2023-05-10T01:43:36.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.582+0000 7f6998eeb700 1 -- 172.21.15.52:0/178462487 wait complete. 2023-05-10T01:43:36.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.583+0000 7f6998eeb700 1 Processor -- start 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.583+0000 7f6998eeb700 1 -- start start 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 0x7f69940afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994154540 0x7f6994151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699414f6e0 con 0x7f6994069b80 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6994151610 con 0x7f6994154160 2023-05-10T01:43:36.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6998eeb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6994150a00 con 0x7f6994154540 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41044/0 (socket says 172.21.15.52:41044) 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 -- 172.21.15.52:0/2553173438 learned_addr learned my addr 172.21.15.52:0/2553173438 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6991d9b700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 0x7f69940afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6992d9d700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994154540 0x7f6994151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 -- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994154540 msgr2=0x7f6994151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994154540 0x7f6994151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 -- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 msgr2=0x7f69940afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 0x7f69940afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 -- 172.21.15.52:0/2553173438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6988009370 con 0x7f6994069b80 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f6991d9b700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 0x7f69940afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.584+0000 7f699259c700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f698400b460 tx=0x7f6984006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984012410 con 0x7f6994069b80 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984012590 con 0x7f6994069b80 2023-05-10T01:43:36.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984012950 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6994150ce0 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69941512a0 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.585+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69941518f0 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.586+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f698400f030 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.586+0000 7f69827fc700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 0x7f69700612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.586+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f6984079670 con 0x7f6994069b80 2023-05-10T01:43:36.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.587+0000 7f6991d9b700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 0x7f69700612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.587+0000 7f6991d9b700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 0x7f69700612b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6994154920 tx=0x7f6988017000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.590+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f698404ae20 con 0x7f6994069b80 2023-05-10T01:43:36.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.766+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6994066680 con 0x7f6994069b80 2023-05-10T01:43:36.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.766+0000 7f69827fc700 1 -- 172.21.15.52:0/2553173438 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+143 (secure 0 0 0) 0x7f698404e440 con 0x7f6994069b80 2023-05-10T01:43:36.770 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:36.771 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:43:36.772 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:43:36.772 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:36.772 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:43:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 msgr2=0x7f69700612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 0x7f69700612b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6994154920 tx=0x7f6988017000).stop 2023-05-10T01:43:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 msgr2=0x7f699414f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f698400b460 tx=0x7f6984006f20).stop 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 shutdown_connections 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f697005edf0 0x7f69700612b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6994154540 0x7f6994151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994069b80 0x7f699414f1f0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 --2- 172.21.15.52:0/2553173438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6994154160 0x7f69940afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 >> 172.21.15.52:0/2553173438 conn(0x7f69940cb740 msgr2=0x7f69940ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 shutdown_connections 2023-05-10T01:43:36.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.768+0000 7f6998eeb700 1 -- 172.21.15.52:0/2553173438 wait complete. 2023-05-10T01:43:36.783 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:43:36.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:43:36.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.901+0000 7f069693d700 1 Processor -- start 2023-05-10T01:43:36.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.902+0000 7f069693d700 1 -- start start 2023-05-10T01:43:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.902+0000 7f069693d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06900bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069693d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06900a4870 0x7f06900a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069693d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0690068740 con 0x7f06900bd5d0 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069693d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900bdea0 con 0x7f06900a4870 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069693d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900a51d0 con 0x7f0690158130 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06900a4870 0x7f06900a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06900a4870 0x7f06900a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41054/0 (socket says 172.21.15.52:41054) 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 -- 172.21.15.52:0/831228697 learned_addr learned my addr 172.21.15.52:0/831228697 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069513a700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06900bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 -- 172.21.15.52:0/831228697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 msgr2=0x7f06900bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06900bd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 -- 172.21.15.52:0/831228697 >> v1:172.21.15.172:6789/0 conn(0x7f06900bd5d0 legacy=0x7f0690157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 -- 172.21.15.52:0/831228697 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690067b30 con 0x7f06900a4870 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f069613c700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900a4870 0x7f06900a4ce0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f0680009f20 tx=0x7f0680009840).ready entity=mon.0 client_cookie=a670e871e397fd39 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f0694939700 1 -- 172.21.15.52:0/831228697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000e070 con 0x7f06900a4870 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f0694939700 1 -- 172.21.15.52:0/831228697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068000ba40 con 0x7f06900a4870 2023-05-10T01:43:36.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.903+0000 7f0694939700 1 -- 172.21.15.52:0/831228697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000bdc0 con 0x7f06900a4870 2023-05-10T01:43:36.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 -- 172.21.15.52:0/831228697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900a4870 msgr2=0x7f06900a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900a4870 0x7f06900a4ce0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f0680009f20 tx=0x7f0680009840).stop 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 -- 172.21.15.52:0/831228697 shutdown_connections 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900a4870 0x7f06900a4ce0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 --2- 172.21.15.52:0/831228697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06900bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 -- 172.21.15.52:0/831228697 >> 172.21.15.52:0/831228697 conn(0x7f06900c7a70 msgr2=0x7f06900c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:36.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 -- 172.21.15.52:0/831228697 shutdown_connections 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.904+0000 7f069693d700 1 -- 172.21.15.52:0/831228697 wait complete. 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.905+0000 7f069693d700 1 Processor -- start 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.905+0000 7f069693d700 1 -- start start 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 0x7f06900a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06901362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06901648c0 con 0x7f06900bd5d0 2023-05-10T01:43:36.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900a99d0 con 0x7f06900a4870 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900a9410 con 0x7f0690158130 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41060/0 (socket says 172.21.15.52:41060) 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 -- 172.21.15.52:0/1414842392 learned_addr learned my addr 172.21.15.52:0/1414842392 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069613c700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06901362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069593b700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 0x7f06900a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 -- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 msgr2=0x7f06901362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06901362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 -- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 msgr2=0x7f06900a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 0x7f06900a8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 -- 172.21.15.52:0/1414842392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009ae0 con 0x7f06900bd5d0 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069593b700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 0x7f06900a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069513a700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f068400c650 tx=0x7f0684008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684010580 con 0x7f06900bd5d0 2023-05-10T01:43:36.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06840106e0 con 0x7f06900bd5d0 2023-05-10T01:43:36.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06900a96f0 con 0x7f06900bd5d0 2023-05-10T01:43:36.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.906+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684010a60 con 0x7f06900bd5d0 2023-05-10T01:43:36.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.907+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900a9120 con 0x7f06900bd5d0 2023-05-10T01:43:36.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.907+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0690047150 con 0x7f06900bd5d0 2023-05-10T01:43:36.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.908+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f068401b460 con 0x7f06900bd5d0 2023-05-10T01:43:36.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.908+0000 7f068dffb700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 0x7f0670061310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:36.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.908+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f06840798d0 con 0x7f06900bd5d0 2023-05-10T01:43:36.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.908+0000 7f069593b700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 0x7f0670061310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:36.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.909+0000 7f069593b700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 0x7f0670061310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0688002780 tx=0x7f0688009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:36.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:36.912+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f068404b020 con 0x7f06900bd5d0 2023-05-10T01:43:37.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.088+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f0690067e10 con 0x7f06900bd5d0 2023-05-10T01:43:37.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.179+0000 7f068dffb700 1 -- 172.21.15.52:0/1414842392 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) v1 ==== 152+0+0 (secure 0 0 0) 0x7f068404e640 con 0x7f06900bd5d0 2023-05-10T01:43:37.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 msgr2=0x7f0670061310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:37.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 0x7f0670061310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0688002780 tx=0x7f0688009040).stop 2023-05-10T01:43:37.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 msgr2=0x7f0690164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:37.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f068400c650 tx=0x7f0684008040).stop 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 shutdown_connections 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f067005ee50 0x7f0670061310 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0690158130 0x7f06901362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06900a4870 0x7f06900a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 --2- 172.21.15.52:0/1414842392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06900bd5d0 0x7f0690164d50 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 >> 172.21.15.52:0/1414842392 conn(0x7f06900c7a70 msgr2=0x7f0690065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:37.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 shutdown_connections 2023-05-10T01:43:37.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.182+0000 7f069693d700 1 -- 172.21.15.52:0/1414842392 wait complete. 2023-05-10T01:43:37.190 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:43:37.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:43:37.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.321+0000 7f2f800d9700 1 Processor -- start 2023-05-10T01:43:37.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.321+0000 7f2f800d9700 1 -- start start 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f800d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f78154080 0x7f2f780aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f800d9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 0x7f2f780685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f800d9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f780c94c0 con 0x7f2f78154460 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f800d9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780cb7d0 con 0x7f2f78154080 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f800d9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f78068a90 con 0x7f2f78068150 2023-05-10T01:43:37.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f78154080 0x7f2f780aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f78154080 0x7f2f780aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41066/0 (socket says 172.21.15.52:41066) 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 -- 172.21.15.52:0/989571102 learned_addr learned my addr 172.21.15.52:0/989571102 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7e676700 1 --2- 172.21.15.52:0/989571102 >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 0x7f2f780685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 -- 172.21.15.52:0/989571102 >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 msgr2=0x7f2f780685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 --2- 172.21.15.52:0/989571102 >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 0x7f2f780685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 -- 172.21.15.52:0/989571102 >> v1:172.21.15.172:6789/0 conn(0x7f2f78154460 legacy=0x7f2f780a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:37.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 -- 172.21.15.52:0/989571102 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780c88b0 con 0x7f2f78154080 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7e676700 1 --2- 172.21.15.52:0/989571102 >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 0x7f2f780685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.322+0000 7f2f7de75700 1 --2- 172.21.15.52:0/989571102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f780aac90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f2f7805f9d0 tx=0x7f2f70009840).ready entity=mon.0 client_cookie=68b96b47a7804cd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f7ce73700 1 -- 172.21.15.52:0/989571102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000e070 con 0x7f2f78154080 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f7ce73700 1 -- 172.21.15.52:0/989571102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7000ba10 con 0x7f2f78154080 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f7ce73700 1 -- 172.21.15.52:0/989571102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000bd90 con 0x7f2f78154080 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 -- 172.21.15.52:0/989571102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 msgr2=0x7f2f780aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:37.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 --2- 172.21.15.52:0/989571102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f780aac90 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f2f7805f9d0 tx=0x7f2f70009840).stop 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 -- 172.21.15.52:0/989571102 shutdown_connections 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 --2- 172.21.15.52:0/989571102 >> v2:172.21.15.172:3300/0 conn(0x7f2f78068150 0x7f2f780685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 --2- 172.21.15.52:0/989571102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f780aac90 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 -- 172.21.15.52:0/989571102 >> 172.21.15.52:0/989571102 conn(0x7f2f78067910 msgr2=0x7f2f780cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 -- 172.21.15.52:0/989571102 shutdown_connections 2023-05-10T01:43:37.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.323+0000 7f2f800d9700 1 -- 172.21.15.52:0/989571102 wait complete. 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.324+0000 7f2f800d9700 1 Processor -- start 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.324+0000 7f2f800d9700 1 -- start start 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f78068150 0x7f2f78167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78154460 0x7f2f78154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78168ab0 con 0x7f2f78154080 2023-05-10T01:43:37.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78151e60 con 0x7f2f78154460 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f800d9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78152130 con 0x7f2f78068150 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7d674700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7d674700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41072/0 (socket says 172.21.15.52:41072) 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7d674700 1 -- 172.21.15.52:0/3304408047 learned_addr learned my addr 172.21.15.52:0/3304408047 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7e676700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78154460 0x7f2f78154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7de75700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f78068150 0x7f2f78167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.325+0000 7f2f7d674700 1 -- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f78068150 msgr2=0x7f2f78167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f7d674700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f78068150 0x7f2f78167de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f7d674700 1 -- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78154460 msgr2=0x7f2f78154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f7d674700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78154460 0x7f2f78154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f7d674700 1 -- 172.21.15.52:0/3304408047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009ae0 con 0x7f2f78154080 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f7d674700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f2f6800b460 tx=0x7f2f68006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68012410 con 0x7f2f78154080 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68012590 con 0x7f2f78154080 2023-05-10T01:43:37.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f78152410 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68012950 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.326+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f78152cb0 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.327+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f78066720 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.327+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2f6800f030 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.328+0000 7f2f65ffb700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 0x7f2f580612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.328+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5931+0+0 (secure 0 0 0) 0x7f2f680797e0 con 0x7f2f78154080 2023-05-10T01:43:37.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.328+0000 7f2f7de75700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 0x7f2f580612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:37.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.328+0000 7f2f7de75700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 0x7f2f580612e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f70009540 tx=0x7f2f70009840).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:37.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.332+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f6804ae20 con 0x7f2f78154080 2023-05-10T01:43:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:37.506+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2f7806c340 con 0x7f2f78154080 2023-05-10T01:43:38.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.184+0000 7f2f65ffb700 1 -- 172.21.15.52:0/3304408047 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2f6804e440 con 0x7f2f78154080 2023-05-10T01:43:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 msgr2=0x7f2f580612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 0x7f2f580612e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f70009540 tx=0x7f2f70009840).stop 2023-05-10T01:43:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 msgr2=0x7f2f78154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f2f6800b460 tx=0x7f2f68006f20).stop 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 shutdown_connections 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2f5805ee20 0x7f2f580612e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78154460 0x7f2f78154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f78068150 0x7f2f78167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 --2- 172.21.15.52:0/3304408047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f78154080 0x7f2f78154840 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.188+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 >> 172.21.15.52:0/3304408047 conn(0x7f2f78067910 msgr2=0x7f2f780ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.189+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 shutdown_connections 2023-05-10T01:43:38.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.189+0000 7f2f800d9700 1 -- 172.21.15.52:0/3304408047 wait complete. 2023-05-10T01:43:38.205 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:43:38.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:43:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.345+0000 7fcbf53f3700 1 Processor -- start 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.345+0000 7fcbf53f3700 1 -- start start 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.345+0000 7fcbf53f3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 0x7fcbf00aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.345+0000 7fcbf53f3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcbf0154460 0x7fcbf00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbf53f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf00aa140 0x7fcbf0068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbf53f3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf00aa590 con 0x7fcbf0154460 2023-05-10T01:43:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbf53f3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf00c94c0 con 0x7fcbf0154080 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbf53f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf00cb7d0 con 0x7fcbf00aa140 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcbf0154460 0x7fcbf00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcbf0154460 0x7fcbf00a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41080/0 (socket says 172.21.15.52:41080) 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 -- 172.21.15.52:0/3458524978 learned_addr learned my addr 172.21.15.52:0/3458524978 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbef7fe700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf00aa140 0x7fcbf0068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbeeffd700 1 --2- 172.21.15.52:0/3458524978 >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 0x7fcbf00aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 -- 172.21.15.52:0/3458524978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf00aa140 msgr2=0x7fcbf0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf00aa140 0x7fcbf0068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 -- 172.21.15.52:0/3458524978 >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 msgr2=0x7fcbf00aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3458524978 >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 0x7fcbf00aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 -- 172.21.15.52:0/3458524978 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00c88b0 con 0x7fcbf0154460 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbeeffd700 1 --2- 172.21.15.52:0/3458524978 >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 0x7fcbf00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf0154460 0x7fcbf00a9c50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fcbf006bd00 tx=0x7fcbe40090f0).ready entity=mon.0 client_cookie=eb67d0082b79fdea server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbedffb700 1 -- 172.21.15.52:0/3458524978 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400b600 con 0x7fcbf0154460 2023-05-10T01:43:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbedffb700 1 -- 172.21.15.52:0/3458524978 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400b760 con 0x7fcbf0154460 2023-05-10T01:43:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.346+0000 7fcbedffb700 1 -- 172.21.15.52:0/3458524978 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400bae0 con 0x7fcbf0154460 2023-05-10T01:43:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3458524978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf0154460 msgr2=0x7fcbf00a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf0154460 0x7fcbf00a9c50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fcbf006bd00 tx=0x7fcbe40090f0).stop 2023-05-10T01:43:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3458524978 shutdown_connections 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf00aa140 0x7fcbf0068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3458524978 >> v2:172.21.15.172:3300/0 conn(0x7fcbf0154080 0x7fcbf00aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3458524978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf0154460 0x7fcbf00a9c50 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3458524978 >> 172.21.15.52:0/3458524978 conn(0x7fcbf0067910 msgr2=0x7fcbf00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3458524978 shutdown_connections 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.347+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3458524978 wait complete. 2023-05-10T01:43:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.348+0000 7fcbf53f3700 1 Processor -- start 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.348+0000 7fcbf53f3700 1 -- start start 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf0154080 0x7fcbf0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf0154460 0x7fcbf00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01555f0 con 0x7fcbf00aa140 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01549e0 con 0x7fcbf0154080 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbf53f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0154cc0 con 0x7fcbf0154460 2023-05-10T01:43:38.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41084/0 (socket says 172.21.15.52:41084) 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 -- 172.21.15.52:0/3790753131 learned_addr learned my addr 172.21.15.52:0/3790753131 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbef7fe700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf0154460 0x7fcbf00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf0154080 0x7fcbf0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 -- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf0154460 msgr2=0x7fcbf00c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf0154460 0x7fcbf00c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 -- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf0154080 msgr2=0x7fcbf0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf0154080 0x7fcbf0150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 -- 172.21.15.52:0/3790753131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4009370 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.349+0000 7fcbeeffd700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fcbe000c880 tx=0x7fcbe0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.350+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0010580 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.350+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00106e0 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.350+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf0154fa0 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.350+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0010a60 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.350+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf01517c0 con 0x7fcbf00aa140 2023-05-10T01:43:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.351+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf01558d0 con 0x7fcbf00aa140 2023-05-10T01:43:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.351+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fcbe001b460 con 0x7fcbf00aa140 2023-05-10T01:43:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.351+0000 7fcbd6ffd700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 0x7fcbd00612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.351+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6313+0+0 (secure 0 0 0) 0x7fcbe0079d20 con 0x7fcbf00aa140 2023-05-10T01:43:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.352+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 0x7fcbd00612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.352+0000 7fcbee7fc700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 0x7fcbd00612e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcbe4009130 tx=0x7fcbe4017000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.356+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbe004b180 con 0x7fcbf00aa140 2023-05-10T01:43:38.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.579+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcbf0066720 con 0x7fcbf00aa140 2023-05-10T01:43:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.584+0000 7fcbd6ffd700 1 -- 172.21.15.52:0/3790753131 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcbe004e7a0 con 0x7fcbf00aa140 2023-05-10T01:43:38.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.588+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 msgr2=0x7fcbd00612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.588+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 0x7fcbd00612e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcbe4009130 tx=0x7fcbe4017000).stop 2023-05-10T01:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.588+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 msgr2=0x7fcbf01686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.588+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fcbe000c880 tx=0x7fcbe0008040).stop 2023-05-10T01:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 shutdown_connections 2023-05-10T01:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcbd005ee20 0x7fcbd00612e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcbf0154460 0x7fcbf00c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbf00aa140 0x7fcbf01686e0 secure :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0x7fcbe000c880 tx=0x7fcbe0008040).stop 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 --2- 172.21.15.52:0/3790753131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf0154080 0x7fcbf0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 >> 172.21.15.52:0/3790753131 conn(0x7fcbf0067910 msgr2=0x7fcbf0152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.589+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 shutdown_connections 2023-05-10T01:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.590+0000 7fcbf53f3700 1 -- 172.21.15.52:0/3790753131 wait complete. 2023-05-10T01:43:38.598 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 19 and data pool 20 2023-05-10T01:43:38.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.729+0000 7f845aa86700 1 Processor -- start 2023-05-10T01:43:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.729+0000 7f845aa86700 1 -- start start 2023-05-10T01:43:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f845aa86700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454154160 0x7f84540c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f845aa86700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8454069da0 0x7f84540c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f845aa86700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540c0650 con 0x7f8454154540 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f845aa86700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540c1af0 con 0x7f8454069da0 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f845aa86700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540bfd20 con 0x7f8454154160 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8454069da0 0x7f84540c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8454069da0 0x7f84540c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41094/0 (socket says 172.21.15.52:41094) 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 -- 172.21.15.52:0/2751165464 learned_addr learned my addr 172.21.15.52:0/2751165464 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8458822700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454154160 0x7f84540c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 -- 172.21.15.52:0/2751165464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454154160 msgr2=0x7f84540c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454154160 0x7f84540c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 -- 172.21.15.52:0/2751165464 >> v1:172.21.15.172:6789/0 conn(0x7f8454154540 legacy=0x7f8454069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 -- 172.21.15.52:0/2751165464 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540c0000 con 0x7f8454069da0 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.730+0000 7f8459023700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454069da0 0x7f84540c6150 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f843c006fd0 tx=0x7f843c0090f0).ready entity=mon.0 client_cookie=ce49bdcedd752eed server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f84537fe700 1 -- 172.21.15.52:0/2751165464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00b600 con 0x7f8454069da0 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f84537fe700 1 -- 172.21.15.52:0/2751165464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c00b760 con 0x7f8454069da0 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f84537fe700 1 -- 172.21.15.52:0/2751165464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00bb00 con 0x7f8454069da0 2023-05-10T01:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 -- 172.21.15.52:0/2751165464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454069da0 msgr2=0x7f84540c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454069da0 0x7f84540c6150 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f843c006fd0 tx=0x7f843c0090f0).stop 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 -- 172.21.15.52:0/2751165464 shutdown_connections 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454154160 0x7f84540c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 --2- 172.21.15.52:0/2751165464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454069da0 0x7f84540c6150 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 -- 172.21.15.52:0/2751165464 >> 172.21.15.52:0/2751165464 conn(0x7f84540cb6f0 msgr2=0x7f84540c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 -- 172.21.15.52:0/2751165464 shutdown_connections 2023-05-10T01:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.731+0000 7f845aa86700 1 -- 172.21.15.52:0/2751165464 wait complete. 2023-05-10T01:43:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.732+0000 7f845aa86700 1 Processor -- start 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.732+0000 7f845aa86700 1 -- start start 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454069da0 0x7f8454157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454154540 0x7f8454141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c4800 con 0x7f8454154160 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541579f0 con 0x7f8454154540 2023-05-10T01:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f845aa86700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845413f1f0 con 0x7f8454069da0 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f8453fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f8453fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41100/0 (socket says 172.21.15.52:41100) 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f8453fff700 1 -- 172.21.15.52:0/2703882867 learned_addr learned my addr 172.21.15.52:0/2703882867 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f8458822700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454069da0 0x7f8454157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.733+0000 7f8459023700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454154540 0x7f8454141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 -- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454069da0 msgr2=0x7f8454157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454069da0 0x7f8454157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 -- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454154540 msgr2=0x7f8454141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454154540 0x7f8454141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 -- 172.21.15.52:0/2703882867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009370 con 0x7f8454154160 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8453fff700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f8454154920 tx=0x7f8444009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400c740 con 0x7f8454154160 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400c8a0 con 0x7f8454154160 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8454155980 con 0x7f8454154160 2023-05-10T01:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400ca10 con 0x7f8454154160 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.734+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454155330 con 0x7f8454154160 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.735+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540666b0 con 0x7f8454154160 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.735+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f8444015420 con 0x7f8454154160 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.735+0000 7f8450ff9700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 0x7f84380612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.736+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f8444079ce0 con 0x7f8454154160 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.736+0000 7f8458822700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 0x7f84380612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.736+0000 7f8458822700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 0x7f84380612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f844c00ab30 tx=0x7f844c008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.740+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f844404b0e0 con 0x7f8454154160 2023-05-10T01:43:38.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.912+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845406c370 con 0x7f8454154160 2023-05-10T01:43:38.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.913+0000 7f8450ff9700 1 -- 172.21.15.52:0/2703882867 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+17501 (secure 0 0 0) 0x7f844404e700 con 0x7f8454154160 2023-05-10T01:43:38.916 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:38.916 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":155,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:38.581289+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 msgr2=0x7f84380612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 0x7f84380612e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f844c00ab30 tx=0x7f844c008040).stop 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 msgr2=0x7f8454157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f8454154920 tx=0x7f8444009780).stop 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 shutdown_connections 2023-05-10T01:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f843805ee20 0x7f84380612e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454154540 0x7f8454141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8454069da0 0x7f8454157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 --2- 172.21.15.52:0/2703882867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8454154160 0x7f8454157500 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.914+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 >> 172.21.15.52:0/2703882867 conn(0x7f84540cb6f0 msgr2=0x7f8454069690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.915+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 shutdown_connections 2023-05-10T01:43:38.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:38.915+0000 7f845aa86700 1 -- 172.21.15.52:0/2703882867 wait complete. 2023-05-10T01:43:38.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 Processor -- start 2023-05-10T01:43:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 -- start start 2023-05-10T01:43:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 0x7fbdac0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbdac069da0 0x7fbdac0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac0c0650 con 0x7fbdac154540 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0c1af0 con 0x7fbdac069da0 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.043+0000 7fbdb1692700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0bfd20 con 0x7fbdac154160 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbdac069da0 0x7fbdac0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbdac069da0 0x7fbdac0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41108/0 (socket says 172.21.15.52:41108) 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 -- 172.21.15.52:0/2857102579 learned_addr learned my addr 172.21.15.52:0/2857102579 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdaaffd700 1 --2- 172.21.15.52:0/2857102579 >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 0x7fbdac0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 -- 172.21.15.52:0/2857102579 >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 msgr2=0x7fbdac0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 --2- 172.21.15.52:0/2857102579 >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 0x7fbdac0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 -- 172.21.15.52:0/2857102579 >> v1:172.21.15.172:6789/0 conn(0x7fbdac154540 legacy=0x7fbdac069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 -- 172.21.15.52:0/2857102579 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0c0000 con 0x7fbdac069da0 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdaaffd700 1 --2- 172.21.15.52:0/2857102579 >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 0x7fbdac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbdab7fe700 1 --2- 172.21.15.52:0/2857102579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac0c6150 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbdac083020 tx=0x7fbd9c0090f0).ready entity=mon.0 client_cookie=bb709e3ecf8ac8ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbda9ffb700 1 -- 172.21.15.52:0/2857102579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00b600 con 0x7fbdac069da0 2023-05-10T01:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbda9ffb700 1 -- 172.21.15.52:0/2857102579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00b760 con 0x7fbdac069da0 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.044+0000 7fbda9ffb700 1 -- 172.21.15.52:0/2857102579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00bb00 con 0x7fbdac069da0 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 -- 172.21.15.52:0/2857102579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 msgr2=0x7fbdac0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 --2- 172.21.15.52:0/2857102579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac0c6150 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbdac083020 tx=0x7fbd9c0090f0).stop 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 -- 172.21.15.52:0/2857102579 shutdown_connections 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 --2- 172.21.15.52:0/2857102579 >> v2:172.21.15.172:3300/0 conn(0x7fbdac154160 0x7fbdac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 --2- 172.21.15.52:0/2857102579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac0c6150 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 -- 172.21.15.52:0/2857102579 >> 172.21.15.52:0/2857102579 conn(0x7fbdac0cb6f0 msgr2=0x7fbdac0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 -- 172.21.15.52:0/2857102579 shutdown_connections 2023-05-10T01:43:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.045+0000 7fbdb1692700 1 -- 172.21.15.52:0/2857102579 wait complete. 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.046+0000 7fbdb1692700 1 Processor -- start 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.046+0000 7fbdb1692700 1 -- start start 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 0x7fbdac14c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdac154540 0x7fbdac151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0ae310 con 0x7fbdac069da0 2023-05-10T01:43:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac14ca80 con 0x7fbdac154540 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdb1692700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac151b40 con 0x7fbdac154160 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41110/0 (socket says 172.21.15.52:41110) 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 -- 172.21.15.52:0/3627833454 learned_addr learned my addr 172.21.15.52:0/3627833454 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaa7fc700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 0x7fbdac14c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdab7fe700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdac154540 0x7fbdac151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 -- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 msgr2=0x7fbdac14c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 0x7fbdac14c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 -- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdac154540 msgr2=0x7fbdac151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdac154540 0x7fbdac151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 -- 172.21.15.52:0/3627833454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009370 con 0x7fbdac069da0 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaa7fc700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 0x7fbdac14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.047+0000 7fbdaaffd700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbda400d860 tx=0x7fbda4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011590 con 0x7fbdac069da0 2023-05-10T01:43:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda40116f0 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac151e20 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011a70 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0adfa0 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.048+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0ae5f0 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.049+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fbda4012420 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.049+0000 7fbda2ffd700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 0x7fbd900612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.049+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fbda4079990 con 0x7fbdac069da0 2023-05-10T01:43:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.049+0000 7fbdaa7fc700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 0x7fbd900612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.050+0000 7fbdaa7fc700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 0x7fbd900612e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbdac14d2b0 tx=0x7fbd94009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.053+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbda404ad90 con 0x7fbdac069da0 2023-05-10T01:43:39.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.225+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdac0666b0 con 0x7fbdac069da0 2023-05-10T01:43:39.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.226+0000 7fbda2ffd700 1 -- 172.21.15.52:0/3627833454 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+17501 (secure 0 0 0) 0x7fbda404e3b0 con 0x7fbdac069da0 2023-05-10T01:43:39.232 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":155,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:38.581289+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 msgr2=0x7fbd900612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 0x7fbd900612e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbdac14d2b0 tx=0x7fbd94009040).stop 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 msgr2=0x7fbdac1655d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbda400d860 tx=0x7fbda4008040).stop 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 shutdown_connections 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbd9005ee20 0x7fbd900612e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdac154540 0x7fbdac151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac069da0 0x7fbdac1655d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 --2- 172.21.15.52:0/3627833454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbdac154160 0x7fbdac14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 >> 172.21.15.52:0/3627833454 conn(0x7fbdac0cb6f0 msgr2=0x7fbdac0ab070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:39.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 shutdown_connections 2023-05-10T01:43:39.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.228+0000 7fbdb1692700 1 -- 172.21.15.52:0/3627833454 wait complete. 2023-05-10T01:43:39.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:43:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.360+0000 7f217a7b6700 1 Processor -- start 2023-05-10T01:43:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.360+0000 7f217a7b6700 1 -- start start 2023-05-10T01:43:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2174157700 0x7f21740a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21740aa1e0 0x7f21740c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21740c6090 0x7f21740c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217406a990 con 0x7f21740aa1e0 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740bfcb0 con 0x7f21740c6090 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f217a7b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217406a130 con 0x7f2174157700 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21740aa1e0 0x7f21740c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21740aa1e0 0x7f21740c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41120/0 (socket says 172.21.15.52:41120) 2023-05-10T01:43:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 -- 172.21.15.52:0/2607568152 learned_addr learned my addr 172.21.15.52:0/2607568152 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f21797b4700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2174157700 0x7f21740a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2179fb5700 1 --2- 172.21.15.52:0/2607568152 >> v2:172.21.15.172:3300/0 conn(0x7f21740c6090 0x7f21740c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 -- 172.21.15.52:0/2607568152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2174157700 msgr2=0x7f21740a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2174157700 0x7f21740a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 -- 172.21.15.52:0/2607568152 >> v2:172.21.15.172:3300/0 conn(0x7f21740c6090 msgr2=0x7f21740c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 --2- 172.21.15.52:0/2607568152 >> v2:172.21.15.172:3300/0 conn(0x7f21740c6090 0x7f21740c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 -- 172.21.15.52:0/2607568152 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217406a3d0 con 0x7f21740aa1e0 2023-05-10T01:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.361+0000 7f2178fb3700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21740aa1e0 0x7f21740c5ba0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f21740c81f0 tx=0x7f21680090f0).ready entity=mon.0 client_cookie=88f101e5e9a5967f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f2173fff700 1 -- 172.21.15.52:0/2607568152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800f510 con 0x7f21740aa1e0 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f2173fff700 1 -- 172.21.15.52:0/2607568152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800f670 con 0x7f21740aa1e0 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f2173fff700 1 -- 172.21.15.52:0/2607568152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800f9f0 con 0x7f21740aa1e0 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 -- 172.21.15.52:0/2607568152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21740aa1e0 msgr2=0x7f21740c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21740aa1e0 0x7f21740c5ba0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f21740c81f0 tx=0x7f21680090f0).stop 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 -- 172.21.15.52:0/2607568152 shutdown_connections 2023-05-10T01:43:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2607568152 >> v2:172.21.15.172:3300/0 conn(0x7f21740c6090 0x7f21740c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2174157700 0x7f21740a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2607568152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21740aa1e0 0x7f21740c5ba0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 -- 172.21.15.52:0/2607568152 >> 172.21.15.52:0/2607568152 conn(0x7f21740cb5f0 msgr2=0x7f21740c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 -- 172.21.15.52:0/2607568152 shutdown_connections 2023-05-10T01:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.362+0000 7f217a7b6700 1 -- 172.21.15.52:0/2607568152 wait complete. 2023-05-10T01:43:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.363+0000 7f217a7b6700 1 Processor -- start 2023-05-10T01:43:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.363+0000 7f217a7b6700 1 -- start start 2023-05-10T01:43:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21740aa1e0 0x7f21740adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 0x7f2174150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740aef20 con 0x7f2174157700 2023-05-10T01:43:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174150710 con 0x7f21740c6090 2023-05-10T01:43:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f217a7b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740ae120 con 0x7f21740aa1e0 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f2179fb5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f2179fb5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41128/0 (socket says 172.21.15.52:41128) 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f2179fb5700 1 -- 172.21.15.52:0/2847152792 learned_addr learned my addr 172.21.15.52:0/2847152792 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.364+0000 7f21797b4700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21740aa1e0 0x7f21740adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2178fb3700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 0x7f2174150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 -- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21740aa1e0 msgr2=0x7f21740adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21740aa1e0 0x7f21740adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 -- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 msgr2=0x7f2174150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 0x7f2174150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 -- 172.21.15.52:0/2847152792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168009370 con 0x7f2174157700 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2178fb3700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 0x7f2174150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f2179fb5700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f2164009e90 tx=0x7f216400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400cb50 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400f040 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740ae400 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400cec0 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.365+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740ae9c0 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.366+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2174083110 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.366+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2164013610 con 0x7f2174157700 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.367+0000 7f21717fa700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 0x7f21540612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.367+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f216407a820 con 0x7f2174157700 2023-05-10T01:43:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.367+0000 7f21797b4700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 0x7f21540612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.367+0000 7f21797b4700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 0x7f21540612e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f216c009b00 tx=0x7f216c009060).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.371+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f216404bb70 con 0x7f2174157700 2023-05-10T01:43:39.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:39.590+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2174047150 con 0x7f2174157700 2023-05-10T01:43:40.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.598+0000 7f21717fa700 1 -- 172.21.15.52:0/2847152792 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f216404f190 con 0x7f2174157700 2023-05-10T01:43:40.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 msgr2=0x7f21540612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 0x7f21540612e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f216c009b00 tx=0x7f216c009060).stop 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 msgr2=0x7f21741569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f2164009e90 tx=0x7f216400b040).stop 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 shutdown_connections 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f215405ee20 0x7f21540612e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2174157700 0x7f21741569c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21740aa1e0 0x7f21740adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:40.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 --2- 172.21.15.52:0/2847152792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21740c6090 0x7f2174150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:40.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 >> 172.21.15.52:0/2847152792 conn(0x7f21740cb5f0 msgr2=0x7f21740c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:40.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 shutdown_connections 2023-05-10T01:43:40.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.601+0000 7f217a7b6700 1 -- 172.21.15.52:0/2847152792 wait complete. 2023-05-10T01:43:40.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:43:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.742+0000 7fd9968b6700 1 Processor -- start 2023-05-10T01:43:40.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.742+0000 7fd9968b6700 1 -- start start 2023-05-10T01:43:40.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd9968b6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd990154080 0x7fd9900aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd9968b6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900c94c0 con 0x7fd990068150 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd9968b6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900cb7d0 con 0x7fd990154460 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd9968b6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9900c88b0 con 0x7fd990154080 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd990154080 0x7fd9900aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd994e53700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd990068150 0x7fd9900c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50150/0 (socket says 172.21.15.52:50150) 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd990154080 0x7fd9900aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41132/0 (socket says 172.21.15.52:41132) 2023-05-10T01:43:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd994e53700 1 -- 172.21.15.52:0/3287346013 learned_addr learned my addr 172.21.15.52:0/3287346013 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98ffff700 1 -- 172.21.15.52:0/3287346013 >> v1:172.21.15.172:6789/0 conn(0x7fd990154460 legacy=0x7fd9900a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98ffff700 1 -- 172.21.15.52:0/3287346013 >> v1:172.21.15.52:6789/0 conn(0x7fd990068150 legacy=0x7fd9900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98f7fe700 1 -- 172.21.15.52:0/3287346013 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95261659 0 0) 0x7fd9900c94c0 con 0x7fd990068150 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.743+0000 7fd98ffff700 1 -- 172.21.15.52:0/3287346013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900c8b90 con 0x7fd990154080 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd98ffff700 1 --2- 172.21.15.52:0/3287346013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990154080 0x7fd9900aac90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fd980009760 tx=0x7fd980009060).ready entity=mon.0 client_cookie=10bbcb03ef2c0df9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd98f7fe700 1 -- 172.21.15.52:0/3287346013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000b520 con 0x7fd990154080 2023-05-10T01:43:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd98f7fe700 1 -- 172.21.15.52:0/3287346013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000b680 con 0x7fd990154080 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd98f7fe700 1 -- 172.21.15.52:0/3287346013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000ba00 con 0x7fd990154080 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 -- 172.21.15.52:0/3287346013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990154080 msgr2=0x7fd9900aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 --2- 172.21.15.52:0/3287346013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990154080 0x7fd9900aac90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fd980009760 tx=0x7fd980009060).stop 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 -- 172.21.15.52:0/3287346013 shutdown_connections 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 --2- 172.21.15.52:0/3287346013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990154080 0x7fd9900aac90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 -- 172.21.15.52:0/3287346013 >> 172.21.15.52:0/3287346013 conn(0x7fd990067910 msgr2=0x7fd9900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 -- 172.21.15.52:0/3287346013 shutdown_connections 2023-05-10T01:43:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.744+0000 7fd9968b6700 1 -- 172.21.15.52:0/3287346013 wait complete. 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.745+0000 7fd9968b6700 1 Processor -- start 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.745+0000 7fd9968b6700 1 -- start start 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd990154080 0x7fd9901674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd990154460 0x7fd9901517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900ae5a0 con 0x7fd990068150 2023-05-10T01:43:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990150850 con 0x7fd990154460 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd9968b6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd990152390 con 0x7fd990154080 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd98ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd98ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41138/0 (socket says 172.21.15.52:41138) 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.746+0000 7fd98ffff700 1 -- 172.21.15.52:0/112972504 learned_addr learned my addr 172.21.15.52:0/112972504 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 -- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd990154080 msgr2=0x7fd9901674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd990154080 0x7fd9901674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 -- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd990154460 msgr2=0x7fd9901517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd990154460 0x7fd9901517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 -- 172.21.15.52:0/112972504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800092a0 con 0x7fd990068150 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98ffff700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fd980009eb0 tx=0x7fd980017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000b7f0 con 0x7fd990068150 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000b950 con 0x7fd990068150 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98001b620 con 0x7fd990068150 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9900adc70 con 0x7fd990068150 2023-05-10T01:43:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.747+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9900ae230 con 0x7fd990068150 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.748+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd990066720 con 0x7fd990068150 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.748+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd98000f070 con 0x7fd990068150 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.749+0000 7fd98cff9700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 0x7fd9740612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.749+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fd98007b8f0 con 0x7fd990068150 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.749+0000 7fd987fff700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 0x7fd9740612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.749+0000 7fd987fff700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 0x7fd9740612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd9900aa7a0 tx=0x7fd978006ac0).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:40.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.753+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd98004cd50 con 0x7fd990068150 2023-05-10T01:43:40.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:40.974+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd990152100 con 0x7fd990068150 2023-05-10T01:43:41.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.775+0000 7fd98cff9700 1 -- 172.21.15.52:0/112972504 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd980050370 con 0x7fd990068150 2023-05-10T01:43:41.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 msgr2=0x7fd9740612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 0x7fd9740612e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd9900aa7a0 tx=0x7fd978006ac0).stop 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 msgr2=0x7fd990164780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fd980009eb0 tx=0x7fd980017000).stop 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 shutdown_connections 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd97405ee20 0x7fd9740612e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd990154460 0x7fd9901517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:41.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd990068150 0x7fd990164780 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 --2- 172.21.15.52:0/112972504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd990154080 0x7fd9901674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:41.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 >> 172.21.15.52:0/112972504 conn(0x7fd990067910 msgr2=0x7fd9901531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:41.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 shutdown_connections 2023-05-10T01:43:41.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.778+0000 7fd9968b6700 1 -- 172.21.15.52:0/112972504 wait complete. 2023-05-10T01:43:41.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.916+0000 7fd96ab30700 1 Processor -- start 2023-05-10T01:43:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.916+0000 7fd96ab30700 1 -- start start 2023-05-10T01:43:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd964154160 0x7fd9640c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154540 0x7fd9640c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd964069690 0x7fd964069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640c0650 con 0x7fd964069690 2023-05-10T01:43:41.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96406a010 con 0x7fd964154160 2023-05-10T01:43:41.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd96ab30700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640bfd20 con 0x7fd964154540 2023-05-10T01:43:41.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd9690cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd964069690 0x7fd964069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd9690cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd964069690 0x7fd964069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41146/0 (socket says 172.21.15.52:41146) 2023-05-10T01:43:41.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd9690cd700 1 -- 172.21.15.52:0/2617146616 learned_addr learned my addr 172.21.15.52:0/2617146616 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:41.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd963fff700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154540 0x7fd9640c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.917+0000 7fd9688cc700 1 --2- 172.21.15.52:0/2617146616 >> v2:172.21.15.172:3300/0 conn(0x7fd964154160 0x7fd9640c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 -- 172.21.15.52:0/2617146616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154540 msgr2=0x7fd9640c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154540 0x7fd9640c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 -- 172.21.15.52:0/2617146616 >> v2:172.21.15.172:3300/0 conn(0x7fd964154160 msgr2=0x7fd9640c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 --2- 172.21.15.52:0/2617146616 >> v2:172.21.15.172:3300/0 conn(0x7fd964154160 0x7fd9640c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 -- 172.21.15.52:0/2617146616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640c0000 con 0x7fd964069690 2023-05-10T01:43:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9690cd700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964069b20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fd964083020 tx=0x7fd94c0090f0).ready entity=mon.0 client_cookie=c3eada06cf77b2d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:41.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9637fe700 1 -- 172.21.15.52:0/2617146616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00f510 con 0x7fd964069690 2023-05-10T01:43:41.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9637fe700 1 -- 172.21.15.52:0/2617146616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00f670 con 0x7fd964069690 2023-05-10T01:43:41.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd9637fe700 1 -- 172.21.15.52:0/2617146616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00fa10 con 0x7fd964069690 2023-05-10T01:43:41.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 -- 172.21.15.52:0/2617146616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 msgr2=0x7fd964069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:41.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964069b20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fd964083020 tx=0x7fd94c0090f0).stop 2023-05-10T01:43:41.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 -- 172.21.15.52:0/2617146616 shutdown_connections 2023-05-10T01:43:41.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964069b20 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2617146616 >> v2:172.21.15.172:3300/0 conn(0x7fd964154160 0x7fd9640c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2617146616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154540 0x7fd9640c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 -- 172.21.15.52:0/2617146616 >> 172.21.15.52:0/2617146616 conn(0x7fd9640cb6f0 msgr2=0x7fd9640c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 -- 172.21.15.52:0/2617146616 shutdown_connections 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.918+0000 7fd96ab30700 1 -- 172.21.15.52:0/2617146616 wait complete. 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.920+0000 7fd96ab30700 1 Processor -- start 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.920+0000 7fd96ab30700 1 -- start start 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.920+0000 7fd96ab30700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154160 0x7fd9641648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd964154540 0x7fd964068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964165800 con 0x7fd964069690 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964145f40 con 0x7fd964154540 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96414dac0 con 0x7fd964154160 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41152/0 (socket says 172.21.15.52:41152) 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 -- 172.21.15.52:0/2317277836 learned_addr learned my addr 172.21.15.52:0/2317277836 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:41.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd963fff700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154160 0x7fd9641648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9690cd700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd964154540 0x7fd964068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 -- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154160 msgr2=0x7fd9641648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154160 0x7fd9641648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 -- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd964154540 msgr2=0x7fd964068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd964154540 0x7fd964068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 -- 172.21.15.52:0/2317277836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009370 con 0x7fd964069690 2023-05-10T01:43:41.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd9688cc700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fd95c00e960 tx=0x7fd95c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c012600 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c012760 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9641512c0 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c012ae0 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.921+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964165490 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.922+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964165ae0 con 0x7fd964069690 2023-05-10T01:43:41.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.923+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fd95c022070 con 0x7fd964069690 2023-05-10T01:43:41.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.923+0000 7fd960ff9700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 0x7fd9480612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:41.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.923+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fd95c079f30 con 0x7fd964069690 2023-05-10T01:43:41.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.923+0000 7fd963fff700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 0x7fd9480612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:41.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.923+0000 7fd963fff700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 0x7fd9480612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd954009fd0 tx=0x7fd95400b040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:41.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:41.927+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd95c0a88f0 con 0x7fd964069690 2023-05-10T01:43:42.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.145+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9640666b0 con 0x7fd964069690 2023-05-10T01:43:42.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.145+0000 7fd960ff9700 1 -- 172.21.15.52:0/2317277836 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fd95c04b390 con 0x7fd964069690 2023-05-10T01:43:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:42.149 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 msgr2=0x7fd9480612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 0x7fd9480612e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd954009fd0 tx=0x7fd95400b040).stop 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 msgr2=0x7fd964145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fd95c00e960 tx=0x7fd95c009060).stop 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 shutdown_connections 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd94805ee20 0x7fd9480612e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd964154540 0x7fd964068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd964069690 0x7fd964145a50 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 --2- 172.21.15.52:0/2317277836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd964154160 0x7fd9641648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.147+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 >> 172.21.15.52:0/2317277836 conn(0x7fd9640cb6f0 msgr2=0x7fd9640ab6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.148+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 shutdown_connections 2023-05-10T01:43:42.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.148+0000 7fd96ab30700 1 -- 172.21.15.52:0/2317277836 wait complete. 2023-05-10T01:43:42.153 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:43:42.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:43:42.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.276+0000 7fbbb982f700 1 Processor -- start 2023-05-10T01:43:42.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.276+0000 7fbbb982f700 1 -- start start 2023-05-10T01:43:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb982f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb40aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb982f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbb40c5ca0 0x7fbbb40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb982f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40c08a0 con 0x7fbbb4154540 2023-05-10T01:43:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb982f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb40ab1f0 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb982f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c6620 con 0x7fbbb4154160 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbb40c5ca0 0x7fbbb40c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.277+0000 7fbbb37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbb40c5ca0 0x7fbbb40c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41164/0 (socket says 172.21.15.52:41164) 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3127021541 learned_addr learned my addr 172.21.15.52:0/3127021541 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb2ffd700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb40aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3127021541 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 msgr2=0x7fbbb40aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb40aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3127021541 >> v1:172.21.15.172:6789/0 conn(0x7fbbb4154540 legacy=0x7fbbb40a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3127021541 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40bfc90 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb2ffd700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb40aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb37fe700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c6130 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fbba4009f20 tx=0x7fbba4009840).ready entity=mon.0 client_cookie=309a42877ca346d2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb1ffb700 1 -- 172.21.15.52:0/3127021541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400e070 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb1ffb700 1 -- 172.21.15.52:0/3127021541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400ba40 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb1ffb700 1 -- 172.21.15.52:0/3127021541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400bdc0 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb982f700 1 -- 172.21.15.52:0/3127021541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb40c5ca0 msgr2=0x7fbbb40c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.278+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c6130 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fbba4009f20 tx=0x7fbba4009840).stop 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 -- 172.21.15.52:0/3127021541 shutdown_connections 2023-05-10T01:43:42.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb40aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3127021541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c6130 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 -- 172.21.15.52:0/3127021541 >> 172.21.15.52:0/3127021541 conn(0x7fbbb40cb6c0 msgr2=0x7fbbb40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 -- 172.21.15.52:0/3127021541 shutdown_connections 2023-05-10T01:43:42.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.279+0000 7fbbb982f700 1 -- 172.21.15.52:0/3127021541 wait complete. 2023-05-10T01:43:42.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.280+0000 7fbbb982f700 1 Processor -- start 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.280+0000 7fbbb982f700 1 -- start start 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb4143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c1d30 con 0x7fbbb4154540 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c2870 con 0x7fbbb40c5ca0 2023-05-10T01:43:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c1f40 con 0x7fbbb4154160 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41170/0 (socket says 172.21.15.52:41170) 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3048653257 learned_addr learned my addr 172.21.15.52:0/3048653257 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb2ffd700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb27fc700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb4143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 msgr2=0x7fbbb4143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb4143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb40c5ca0 msgr2=0x7fbbb40c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 -- 172.21.15.52:0/3048653257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009ae0 con 0x7fbbb4154540 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb37fe700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fbba400bee0 tx=0x7fbba4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40092e0 con 0x7fbbb4154540 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba401e470 con 0x7fbbb4154540 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb40c2220 con 0x7fbbb4154540 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.281+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba401e830 con 0x7fbbb4154540 2023-05-10T01:43:42.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.282+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb40c31f0 con 0x7fbbb4154540 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.282+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb40666b0 con 0x7fbbb4154540 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.283+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fbba4025030 con 0x7fbbb4154540 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.283+0000 7fbbaaffd700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 0x7fbb980612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.283+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fbba407bd30 con 0x7fbbb4154540 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.284+0000 7fbbb2ffd700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 0x7fbb980612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.284+0000 7fbbb2ffd700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 0x7fbb980612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbbac00abd0 tx=0x7fbbac008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.287+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbba404d2c0 con 0x7fbbb4154540 2023-05-10T01:43:42.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.461+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbb40c2a00 con 0x7fbbb4154540 2023-05-10T01:43:42.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.462+0000 7fbbaaffd700 1 -- 172.21.15.52:0/3048653257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+17488 (secure 0 0 0) 0x7fbba4023070 con 0x7fbbb4154540 2023-05-10T01:43:42.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:42.466 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":156,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:43:39.583528+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.463+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 msgr2=0x7fbb980612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.463+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 0x7fbb980612e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbbac00abd0 tx=0x7fbbac008040).stop 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 msgr2=0x7fbbb4157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fbba400bee0 tx=0x7fbba4009840).stop 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 shutdown_connections 2023-05-10T01:43:42.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbb9805ee20 0x7fbb980612e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb4154540 0x7fbbb4157030 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb40c5ca0 0x7fbbb40c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 --2- 172.21.15.52:0/3048653257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb4154160 0x7fbbb4143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 >> 172.21.15.52:0/3048653257 conn(0x7fbbb40cb6c0 msgr2=0x7fbbb414e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 shutdown_connections 2023-05-10T01:43:42.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.464+0000 7fbbb982f700 1 -- 172.21.15.52:0/3048653257 wait complete. 2023-05-10T01:43:42.479 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:43:42.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:43:42.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.593+0000 7f146f411700 1 Processor -- start 2023-05-10T01:43:42.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.593+0000 7f146f411700 1 -- start start 2023-05-10T01:43:42.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146f411700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f14680c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146f411700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680c0650 con 0x7f1468154540 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146f411700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680bfd20 con 0x7f1468069da0 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146f411700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680c0000 con 0x7f1468154160 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146c9ac700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1468154540 0x7f1468069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50190/0 (socket says 172.21.15.52:50190) 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.594+0000 7f146c9ac700 1 -- 172.21.15.52:0/669969861 learned_addr learned my addr 172.21.15.52:0/669969861 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f14680c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798715435 0 0) 0x7f14680c0650 con 0x7f1468154540 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14540033f0 con 0x7f1468154540 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994287078 0 0) 0x7f14540033f0 con 0x7f1468154540 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 msgr2=0x7f14680c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f14680c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 >> v1:172.21.15.172:6789/0 conn(0x7f1468069da0 legacy=0x7f14680c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680c02e0 con 0x7f1468154540 2023-05-10T01:43:42.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f145c001470 con 0x7f1468154540 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 >> v1:172.21.15.52:6789/0 conn(0x7f1468154540 legacy=0x7f1468069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1454003910 0x7f1454003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f1454004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454004b80 0x7f1454005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680c0000 con 0x7f1454003910 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145400b9c0 con 0x7f1454004b80 2023-05-10T01:43:42.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145400bb80 con 0x7f1468154160 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1454003910 0x7f1454003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146c9ac700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f1454004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d9ae700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454004b80 0x7f1454005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 -- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 msgr2=0x7f1454004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468154160 0x7f1454004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 -- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454004b80 msgr2=0x7f1454005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454004b80 0x7f1454005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 -- 172.21.15.52:0/669969861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540033f0 con 0x7f1454003910 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.595+0000 7f146d1ad700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1454003910 0x7f1454003d30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f1460006d80 tx=0x7f1460009060).ready entity=mon.0 client_cookie=1db45e9ae28d09ed server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460009e90 con 0x7f1454003910 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460009430 con 0x7f1454003910 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f1467fff700 1 -- 172.21.15.52:0/669969861 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000e850 con 0x7f1454003910 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 -- 172.21.15.52:0/669969861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1454003910 msgr2=0x7f1454003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 --2- 172.21.15.52:0/669969861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1454003910 0x7f1454003d30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f1460006d80 tx=0x7f1460009060).stop 2023-05-10T01:43:42.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146d9ae700 1 -- 172.21.15.52:0/669969861 reap_dead start 2023-05-10T01:43:42.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 -- 172.21.15.52:0/669969861 shutdown_connections 2023-05-10T01:43:42.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 -- 172.21.15.52:0/669969861 >> 172.21.15.52:0/669969861 conn(0x7f14680cb6f0 msgr2=0x7f14680c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 -- 172.21.15.52:0/669969861 shutdown_connections 2023-05-10T01:43:42.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.596+0000 7f146f411700 1 -- 172.21.15.52:0/669969861 wait complete. 2023-05-10T01:43:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.597+0000 7f146f411700 1 Processor -- start 2023-05-10T01:43:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.597+0000 7f146f411700 1 -- start start 2023-05-10T01:43:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454003910 0x7f146814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468152fd0 0x7f1468153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468165660 con 0x7f1468156730 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468153940 con 0x7f1454003910 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146f411700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14681647d0 con 0x7f1468152fd0 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146d9ae700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146d9ae700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41190/0 (socket says 172.21.15.52:41190) 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.598+0000 7f146d9ae700 1 -- 172.21.15.52:0/1150286067 learned_addr learned my addr 172.21.15.52:0/1150286067 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146c9ac700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468152fd0 0x7f1468153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d1ad700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454003910 0x7f146814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 -- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468152fd0 msgr2=0x7f1468153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468152fd0 0x7f1468153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 -- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454003910 msgr2=0x7f146814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454003910 0x7f146814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 -- 172.21.15.52:0/1150286067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468164a50 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146d9ae700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f14680c8a90 tx=0x7f1458009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800eeb0 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458003030 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580033d0 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1468164d30 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.599+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14681652f0 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.600+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14681657d0 con 0x7f1468156730 2023-05-10T01:43:42.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.600+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f145801e070 con 0x7f1468156730 2023-05-10T01:43:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.601+0000 7f14657fa700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 0x7f14480612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.601+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f1458078e50 con 0x7f1468156730 2023-05-10T01:43:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.601+0000 7f146d1ad700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 0x7f14480612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.601+0000 7f146d1ad700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 0x7f14480612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f14600095a0 tx=0x7f146001a000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.605+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f145804a250 con 0x7f1468156730 2023-05-10T01:43:42.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.772+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14680666b0 con 0x7f144805ee20 2023-05-10T01:43:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.784+0000 7f14657fa700 1 -- 172.21.15.52:0/1150286067 <== mgr.7792 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361991 (secure 0 0 0) 0x7f14680666b0 con 0x7f144805ee20 2023-05-10T01:43:42.791 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 msgr2=0x7f14480612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 0x7f14480612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f14600095a0 tx=0x7f146001a000).stop 2023-05-10T01:43:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 msgr2=0x7f1468156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f14680c8a90 tx=0x7f1458009040).stop 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 shutdown_connections 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f144805ee20 0x7f14480612e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1468156730 0x7f1468156bb0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1454003910 0x7f146814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 --2- 172.21.15.52:0/1150286067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1468152fd0 0x7f1468153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 >> 172.21.15.52:0/1150286067 conn(0x7f14680cb6f0 msgr2=0x7f14680a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 shutdown_connections 2023-05-10T01:43:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.787+0000 7f146f411700 1 -- 172.21.15.52:0/1150286067 wait complete. 2023-05-10T01:43:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:43:42.802 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:43:40.896187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":188788,"kb_used_data":15220,"kb_used_omap":0,"kb_used_meta":173504,"kb_avail":754785932,"statfs":{"total":773094113280,"available":772900794368,"internally_reserved":0,"allocated":15585280,"data_stored":8002312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":177668096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594749,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.181646"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618872+0000","last_change":"2023-05-10T01:43:38.612459+0000","last_active":"2023-05-10T01:43:38.618872+0000","last_peered":"2023-05-10T01:43:38.618872+0000","last_clean":"2023-05-10T01:43:38.618872+0000","last_became_active":"2023-05-10T01:43:38.611604+0000","last_became_peered":"2023-05-10T01:43:38.611604+0000","last_unstale":"2023-05-10T01:43:38.618872+0000","last_undegraded":"2023-05-10T01:43:38.618872+0000","last_fullsized":"2023-05-10T01:43:38.618872+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.613008+0000","last_change":"2023-05-10T01:43:38.205731+0000","last_active":"2023-05-10T01:43:38.613008+0000","last_peered":"2023-05-10T01:43:38.613008+0000","last_clean":"2023-05-10T01:43:38.613008+0000","last_became_active":"2023-05-10T01:43:38.205428+0000","last_became_peered":"2023-05-10T01:43:38.205428+0000","last_unstale":"2023-05-10T01:43:38.613008+0000","last_undegraded":"2023-05-10T01:43:38.613008+0000","last_fullsized":"2023-05-10T01:43:38.613008+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608595+0000","last_change":"2023-05-10T01:43:38.604400+0000","last_active":"2023-05-10T01:43:38.608595+0000","last_peered":"2023-05-10T01:43:38.608595+0000","last_clean":"2023-05-10T01:43:38.608595+0000","last_became_active":"2023-05-10T01:43:38.604114+0000","last_became_peered":"2023-05-10T01:43:38.604114+0000","last_unstale":"2023-05-10T01:43:38.608595+0000","last_undegraded":"2023-05-10T01:43:38.608595+0000","last_fullsized":"2023-05-10T01:43:38.608595+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585560+0000","last_change":"2023-05-10T01:43:38.207348+0000","last_active":"2023-05-10T01:43:38.585560+0000","last_peered":"2023-05-10T01:43:38.585560+0000","last_clean":"2023-05-10T01:43:38.585560+0000","last_became_active":"2023-05-10T01:43:38.206882+0000","last_became_peered":"2023-05-10T01:43:38.206882+0000","last_unstale":"2023-05-10T01:43:38.585560+0000","last_undegraded":"2023-05-10T01:43:38.585560+0000","last_fullsized":"2023-05-10T01:43:38.585560+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618954+0000","last_change":"2023-05-10T01:43:38.618419+0000","last_active":"2023-05-10T01:43:38.618954+0000","last_peered":"2023-05-10T01:43:38.618954+0000","last_clean":"2023-05-10T01:43:38.618954+0000","last_became_active":"2023-05-10T01:43:38.618165+0000","last_became_peered":"2023-05-10T01:43:38.618165+0000","last_unstale":"2023-05-10T01:43:38.618954+0000","last_undegraded":"2023-05-10T01:43:38.618954+0000","last_fullsized":"2023-05-10T01:43:38.618954+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604636+0000","last_change":"2023-05-10T01:43:38.202221+0000","last_active":"2023-05-10T01:43:38.604636+0000","last_peered":"2023-05-10T01:43:38.604636+0000","last_clean":"2023-05-10T01:43:38.604636+0000","last_became_active":"2023-05-10T01:43:38.201948+0000","last_became_peered":"2023-05-10T01:43:38.201948+0000","last_unstale":"2023-05-10T01:43:38.604636+0000","last_undegraded":"2023-05-10T01:43:38.604636+0000","last_fullsized":"2023-05-10T01:43:38.604636+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618017+0000","last_change":"2023-05-10T01:43:38.616800+0000","last_active":"2023-05-10T01:43:38.618017+0000","last_peered":"2023-05-10T01:43:38.618017+0000","last_clean":"2023-05-10T01:43:38.618017+0000","last_became_active":"2023-05-10T01:43:38.616451+0000","last_became_peered":"2023-05-10T01:43:38.616451+0000","last_unstale":"2023-05-10T01:43:38.618017+0000","last_undegraded":"2023-05-10T01:43:38.618017+0000","last_fullsized":"2023-05-10T01:43:38.618017+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604987+0000","last_change":"2023-05-10T01:43:38.196374+0000","last_active":"2023-05-10T01:43:38.604987+0000","last_peered":"2023-05-10T01:43:38.604987+0000","last_clean":"2023-05-10T01:43:38.604987+0000","last_became_active":"2023-05-10T01:43:38.196080+0000","last_became_peered":"2023-05-10T01:43:38.196080+0000","last_unstale":"2023-05-10T01:43:38.604987+0000","last_undegraded":"2023-05-10T01:43:38.604987+0000","last_fullsized":"2023-05-10T01:43:38.604987+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600692+0000","last_change":"2023-05-10T01:43:38.594463+0000","last_active":"2023-05-10T01:43:38.600692+0000","last_peered":"2023-05-10T01:43:38.600692+0000","last_clean":"2023-05-10T01:43:38.600692+0000","last_became_active":"2023-05-10T01:43:38.594150+0000","last_became_peered":"2023-05-10T01:43:38.594150+0000","last_unstale":"2023-05-10T01:43:38.600692+0000","last_undegraded":"2023-05-10T01:43:38.600692+0000","last_fullsized":"2023-05-10T01:43:38.600692+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603841+0000","last_change":"2023-05-10T01:43:38.204054+0000","last_active":"2023-05-10T01:43:38.603841+0000","last_peered":"2023-05-10T01:43:38.603841+0000","last_clean":"2023-05-10T01:43:38.603841+0000","last_became_active":"2023-05-10T01:43:38.203519+0000","last_became_peered":"2023-05-10T01:43:38.203519+0000","last_unstale":"2023-05-10T01:43:38.603841+0000","last_undegraded":"2023-05-10T01:43:38.603841+0000","last_fullsized":"2023-05-10T01:43:38.603841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621828+0000","last_change":"2023-05-10T01:43:38.616103+0000","last_active":"2023-05-10T01:43:38.621828+0000","last_peered":"2023-05-10T01:43:38.621828+0000","last_clean":"2023-05-10T01:43:38.621828+0000","last_became_active":"2023-05-10T01:43:38.615248+0000","last_became_peered":"2023-05-10T01:43:38.615248+0000","last_unstale":"2023-05-10T01:43:38.621828+0000","last_undegraded":"2023-05-10T01:43:38.621828+0000","last_fullsized":"2023-05-10T01:43:38.621828+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.613270+0000","last_change":"2023-05-10T01:43:38.200008+0000","last_active":"2023-05-10T01:43:38.613270+0000","last_peered":"2023-05-10T01:43:38.613270+0000","last_clean":"2023-05-10T01:43:38.613270+0000","last_became_active":"2023-05-10T01:43:38.199703+0000","last_became_peered":"2023-05-10T01:43:38.199703+0000","last_unstale":"2023-05-10T01:43:38.613270+0000","last_undegraded":"2023-05-10T01:43:38.613270+0000","last_fullsized":"2023-05-10T01:43:38.613270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615085+0000","last_change":"2023-05-10T01:43:38.612216+0000","last_active":"2023-05-10T01:43:38.615085+0000","last_peered":"2023-05-10T01:43:38.615085+0000","last_clean":"2023-05-10T01:43:38.615085+0000","last_became_active":"2023-05-10T01:43:38.611844+0000","last_became_peered":"2023-05-10T01:43:38.611844+0000","last_unstale":"2023-05-10T01:43:38.615085+0000","last_undegraded":"2023-05-10T01:43:38.615085+0000","last_fullsized":"2023-05-10T01:43:38.615085+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.607092+0000","last_change":"2023-05-10T01:43:38.198633+0000","last_active":"2023-05-10T01:43:38.607092+0000","last_peered":"2023-05-10T01:43:38.607092+0000","last_clean":"2023-05-10T01:43:38.607092+0000","last_became_active":"2023-05-10T01:43:38.198357+0000","last_became_peered":"2023-05-10T01:43:38.198357+0000","last_unstale":"2023-05-10T01:43:38.607092+0000","last_undegraded":"2023-05-10T01:43:38.607092+0000","last_fullsized":"2023-05-10T01:43:38.607092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604825+0000","last_change":"2023-05-10T01:43:38.599160+0000","last_active":"2023-05-10T01:43:38.604825+0000","last_peered":"2023-05-10T01:43:38.604825+0000","last_clean":"2023-05-10T01:43:38.604825+0000","last_became_active":"2023-05-10T01:43:38.594365+0000","last_became_peered":"2023-05-10T01:43:38.594365+0000","last_unstale":"2023-05-10T01:43:38.604825+0000","last_undegraded":"2023-05-10T01:43:38.604825+0000","last_fullsized":"2023-05-10T01:43:38.604825+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598369+0000","last_change":"2023-05-10T01:43:38.209073+0000","last_active":"2023-05-10T01:43:38.598369+0000","last_peered":"2023-05-10T01:43:38.598369+0000","last_clean":"2023-05-10T01:43:38.598369+0000","last_became_active":"2023-05-10T01:43:38.208642+0000","last_became_peered":"2023-05-10T01:43:38.208642+0000","last_unstale":"2023-05-10T01:43:38.598369+0000","last_undegraded":"2023-05-10T01:43:38.598369+0000","last_fullsized":"2023-05-10T01:43:38.598369+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604877+0000","last_change":"2023-05-10T01:43:38.595629+0000","last_active":"2023-05-10T01:43:38.604877+0000","last_peered":"2023-05-10T01:43:38.604877+0000","last_clean":"2023-05-10T01:43:38.604877+0000","last_became_active":"2023-05-10T01:43:38.595366+0000","last_became_peered":"2023-05-10T01:43:38.595366+0000","last_unstale":"2023-05-10T01:43:38.604877+0000","last_undegraded":"2023-05-10T01:43:38.604877+0000","last_fullsized":"2023-05-10T01:43:38.604877+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601483+0000","last_change":"2023-05-10T01:43:38.203611+0000","last_active":"2023-05-10T01:43:38.601483+0000","last_peered":"2023-05-10T01:43:38.601483+0000","last_clean":"2023-05-10T01:43:38.601483+0000","last_became_active":"2023-05-10T01:43:38.203301+0000","last_became_peered":"2023-05-10T01:43:38.203301+0000","last_unstale":"2023-05-10T01:43:38.601483+0000","last_undegraded":"2023-05-10T01:43:38.601483+0000","last_fullsized":"2023-05-10T01:43:38.601483+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606454+0000","last_change":"2023-05-10T01:43:38.604627+0000","last_active":"2023-05-10T01:43:38.606454+0000","last_peered":"2023-05-10T01:43:38.606454+0000","last_clean":"2023-05-10T01:43:38.606454+0000","last_became_active":"2023-05-10T01:43:38.604096+0000","last_became_peered":"2023-05-10T01:43:38.604096+0000","last_unstale":"2023-05-10T01:43:38.606454+0000","last_undegraded":"2023-05-10T01:43:38.606454+0000","last_fullsized":"2023-05-10T01:43:38.606454+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585637+0000","last_change":"2023-05-10T01:43:38.207172+0000","last_active":"2023-05-10T01:43:38.585637+0000","last_peered":"2023-05-10T01:43:38.585637+0000","last_clean":"2023-05-10T01:43:38.585637+0000","last_became_active":"2023-05-10T01:43:38.206111+0000","last_became_peered":"2023-05-10T01:43:38.206111+0000","last_unstale":"2023-05-10T01:43:38.585637+0000","last_undegraded":"2023-05-10T01:43:38.585637+0000","last_fullsized":"2023-05-10T01:43:38.585637+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605154+0000","last_change":"2023-05-10T01:43:38.603235+0000","last_active":"2023-05-10T01:43:38.605154+0000","last_peered":"2023-05-10T01:43:38.605154+0000","last_clean":"2023-05-10T01:43:38.605154+0000","last_became_active":"2023-05-10T01:43:38.602989+0000","last_became_peered":"2023-05-10T01:43:38.602989+0000","last_unstale":"2023-05-10T01:43:38.605154+0000","last_undegraded":"2023-05-10T01:43:38.605154+0000","last_fullsized":"2023-05-10T01:43:38.605154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588609+0000","last_change":"2023-05-10T01:43:38.209540+0000","last_active":"2023-05-10T01:43:38.588609+0000","last_peered":"2023-05-10T01:43:38.588609+0000","last_clean":"2023-05-10T01:43:38.588609+0000","last_became_active":"2023-05-10T01:43:38.209243+0000","last_became_peered":"2023-05-10T01:43:38.209243+0000","last_unstale":"2023-05-10T01:43:38.588609+0000","last_undegraded":"2023-05-10T01:43:38.588609+0000","last_fullsized":"2023-05-10T01:43:38.588609+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618645+0000","last_change":"2023-05-10T01:43:38.617905+0000","last_active":"2023-05-10T01:43:38.618645+0000","last_peered":"2023-05-10T01:43:38.618645+0000","last_clean":"2023-05-10T01:43:38.618645+0000","last_became_active":"2023-05-10T01:43:38.617678+0000","last_became_peered":"2023-05-10T01:43:38.617678+0000","last_unstale":"2023-05-10T01:43:38.618645+0000","last_undegraded":"2023-05-10T01:43:38.618645+0000","last_fullsized":"2023-05-10T01:43:38.618645+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619448+0000","last_change":"2023-05-10T01:43:38.203681+0000","last_active":"2023-05-10T01:43:38.619448+0000","last_peered":"2023-05-10T01:43:38.619448+0000","last_clean":"2023-05-10T01:43:38.619448+0000","last_became_active":"2023-05-10T01:43:38.203352+0000","last_became_peered":"2023-05-10T01:43:38.203352+0000","last_unstale":"2023-05-10T01:43:38.619448+0000","last_undegraded":"2023-05-10T01:43:38.619448+0000","last_fullsized":"2023-05-10T01:43:38.619448+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604904+0000","last_change":"2023-05-10T01:43:38.602490+0000","last_active":"2023-05-10T01:43:38.604904+0000","last_peered":"2023-05-10T01:43:38.604904+0000","last_clean":"2023-05-10T01:43:38.604904+0000","last_became_active":"2023-05-10T01:43:38.599833+0000","last_became_peered":"2023-05-10T01:43:38.599833+0000","last_unstale":"2023-05-10T01:43:38.604904+0000","last_undegraded":"2023-05-10T01:43:38.604904+0000","last_fullsized":"2023-05-10T01:43:38.604904+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616301+0000","last_change":"2023-05-10T01:43:38.206664+0000","last_active":"2023-05-10T01:43:38.616301+0000","last_peered":"2023-05-10T01:43:38.616301+0000","last_clean":"2023-05-10T01:43:38.616301+0000","last_became_active":"2023-05-10T01:43:38.206373+0000","last_became_peered":"2023-05-10T01:43:38.206373+0000","last_unstale":"2023-05-10T01:43:38.616301+0000","last_undegraded":"2023-05-10T01:43:38.616301+0000","last_fullsized":"2023-05-10T01:43:38.616301+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621775+0000","last_change":"2023-05-10T01:43:38.616489+0000","last_active":"2023-05-10T01:43:38.621775+0000","last_peered":"2023-05-10T01:43:38.621775+0000","last_clean":"2023-05-10T01:43:38.621775+0000","last_became_active":"2023-05-10T01:43:38.616207+0000","last_became_peered":"2023-05-10T01:43:38.616207+0000","last_unstale":"2023-05-10T01:43:38.621775+0000","last_undegraded":"2023-05-10T01:43:38.621775+0000","last_fullsized":"2023-05-10T01:43:38.621775+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.586257+0000","last_change":"2023-05-10T01:43:38.206885+0000","last_active":"2023-05-10T01:43:38.586257+0000","last_peered":"2023-05-10T01:43:38.586257+0000","last_clean":"2023-05-10T01:43:38.586257+0000","last_became_active":"2023-05-10T01:43:38.206566+0000","last_became_peered":"2023-05-10T01:43:38.206566+0000","last_unstale":"2023-05-10T01:43:38.586257+0000","last_undegraded":"2023-05-10T01:43:38.586257+0000","last_fullsized":"2023-05-10T01:43:38.586257+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612693+0000","last_change":"2023-05-10T01:43:38.611899+0000","last_active":"2023-05-10T01:43:38.612693+0000","last_peered":"2023-05-10T01:43:38.612693+0000","last_clean":"2023-05-10T01:43:38.612693+0000","last_became_active":"2023-05-10T01:43:38.611587+0000","last_became_peered":"2023-05-10T01:43:38.611587+0000","last_unstale":"2023-05-10T01:43:38.612693+0000","last_undegraded":"2023-05-10T01:43:38.612693+0000","last_fullsized":"2023-05-10T01:43:38.612693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589721+0000","last_change":"2023-05-10T01:43:38.211165+0000","last_active":"2023-05-10T01:43:38.589721+0000","last_peered":"2023-05-10T01:43:38.589721+0000","last_clean":"2023-05-10T01:43:38.589721+0000","last_became_active":"2023-05-10T01:43:38.210853+0000","last_became_peered":"2023-05-10T01:43:38.210853+0000","last_unstale":"2023-05-10T01:43:38.589721+0000","last_undegraded":"2023-05-10T01:43:38.589721+0000","last_fullsized":"2023-05-10T01:43:38.589721+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605094+0000","last_change":"2023-05-10T01:43:38.598843+0000","last_active":"2023-05-10T01:43:38.605094+0000","last_peered":"2023-05-10T01:43:38.605094+0000","last_clean":"2023-05-10T01:43:38.605094+0000","last_became_active":"2023-05-10T01:43:38.598573+0000","last_became_peered":"2023-05-10T01:43:38.598573+0000","last_unstale":"2023-05-10T01:43:38.605094+0000","last_undegraded":"2023-05-10T01:43:38.605094+0000","last_fullsized":"2023-05-10T01:43:38.605094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606075+0000","last_change":"2023-05-10T01:43:38.200935+0000","last_active":"2023-05-10T01:43:38.606075+0000","last_peered":"2023-05-10T01:43:38.606075+0000","last_clean":"2023-05-10T01:43:38.606075+0000","last_became_active":"2023-05-10T01:43:38.200634+0000","last_became_peered":"2023-05-10T01:43:38.200634+0000","last_unstale":"2023-05-10T01:43:38.606075+0000","last_undegraded":"2023-05-10T01:43:38.606075+0000","last_fullsized":"2023-05-10T01:43:38.606075+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604909+0000","last_change":"2023-05-10T01:43:38.596446+0000","last_active":"2023-05-10T01:43:38.604909+0000","last_peered":"2023-05-10T01:43:38.604909+0000","last_clean":"2023-05-10T01:43:38.604909+0000","last_became_active":"2023-05-10T01:43:38.596152+0000","last_became_peered":"2023-05-10T01:43:38.596152+0000","last_unstale":"2023-05-10T01:43:38.604909+0000","last_undegraded":"2023-05-10T01:43:38.604909+0000","last_fullsized":"2023-05-10T01:43:38.604909+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608612+0000","last_change":"2023-05-10T01:43:38.202139+0000","last_active":"2023-05-10T01:43:38.608612+0000","last_peered":"2023-05-10T01:43:38.608612+0000","last_clean":"2023-05-10T01:43:38.608612+0000","last_became_active":"2023-05-10T01:43:38.199782+0000","last_became_peered":"2023-05-10T01:43:38.199782+0000","last_unstale":"2023-05-10T01:43:38.608612+0000","last_undegraded":"2023-05-10T01:43:38.608612+0000","last_fullsized":"2023-05-10T01:43:38.608612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600928+0000","last_change":"2023-05-10T01:43:38.597429+0000","last_active":"2023-05-10T01:43:38.600928+0000","last_peered":"2023-05-10T01:43:38.600928+0000","last_clean":"2023-05-10T01:43:38.600928+0000","last_became_active":"2023-05-10T01:43:38.597164+0000","last_became_peered":"2023-05-10T01:43:38.597164+0000","last_unstale":"2023-05-10T01:43:38.600928+0000","last_undegraded":"2023-05-10T01:43:38.600928+0000","last_fullsized":"2023-05-10T01:43:38.600928+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594163+0000","last_change":"2023-05-10T01:43:38.203673+0000","last_active":"2023-05-10T01:43:38.594163+0000","last_peered":"2023-05-10T01:43:38.594163+0000","last_clean":"2023-05-10T01:43:38.594163+0000","last_became_active":"2023-05-10T01:43:38.203361+0000","last_became_peered":"2023-05-10T01:43:38.203361+0000","last_unstale":"2023-05-10T01:43:38.594163+0000","last_undegraded":"2023-05-10T01:43:38.594163+0000","last_fullsized":"2023-05-10T01:43:38.594163+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606409+0000","last_change":"2023-05-10T01:43:38.604994+0000","last_active":"2023-05-10T01:43:38.606409+0000","last_peered":"2023-05-10T01:43:38.606409+0000","last_clean":"2023-05-10T01:43:38.606409+0000","last_became_active":"2023-05-10T01:43:38.604575+0000","last_became_peered":"2023-05-10T01:43:38.604575+0000","last_unstale":"2023-05-10T01:43:38.606409+0000","last_undegraded":"2023-05-10T01:43:38.606409+0000","last_fullsized":"2023-05-10T01:43:38.606409+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615618+0000","last_change":"2023-05-10T01:43:38.203461+0000","last_active":"2023-05-10T01:43:38.615618+0000","last_peered":"2023-05-10T01:43:38.615618+0000","last_clean":"2023-05-10T01:43:38.615618+0000","last_became_active":"2023-05-10T01:43:38.203147+0000","last_became_peered":"2023-05-10T01:43:38.203147+0000","last_unstale":"2023-05-10T01:43:38.615618+0000","last_undegraded":"2023-05-10T01:43:38.615618+0000","last_fullsized":"2023-05-10T01:43:38.615618+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.602292+0000","last_change":"2023-05-10T01:43:38.593618+0000","last_active":"2023-05-10T01:43:38.602292+0000","last_peered":"2023-05-10T01:43:38.602292+0000","last_clean":"2023-05-10T01:43:38.602292+0000","last_became_active":"2023-05-10T01:43:38.593325+0000","last_became_peered":"2023-05-10T01:43:38.593325+0000","last_unstale":"2023-05-10T01:43:38.602292+0000","last_undegraded":"2023-05-10T01:43:38.602292+0000","last_fullsized":"2023-05-10T01:43:38.602292+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594148+0000","last_change":"2023-05-10T01:43:38.209184+0000","last_active":"2023-05-10T01:43:38.594148+0000","last_peered":"2023-05-10T01:43:38.594148+0000","last_clean":"2023-05-10T01:43:38.594148+0000","last_became_active":"2023-05-10T01:43:38.208349+0000","last_became_peered":"2023-05-10T01:43:38.208349+0000","last_unstale":"2023-05-10T01:43:38.594148+0000","last_undegraded":"2023-05-10T01:43:38.594148+0000","last_fullsized":"2023-05-10T01:43:38.594148+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601574+0000","last_change":"2023-05-10T01:43:38.597492+0000","last_active":"2023-05-10T01:43:38.601574+0000","last_peered":"2023-05-10T01:43:38.601574+0000","last_clean":"2023-05-10T01:43:38.601574+0000","last_became_active":"2023-05-10T01:43:38.597118+0000","last_became_peered":"2023-05-10T01:43:38.597118+0000","last_unstale":"2023-05-10T01:43:38.601574+0000","last_undegraded":"2023-05-10T01:43:38.601574+0000","last_fullsized":"2023-05-10T01:43:38.601574+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603871+0000","last_change":"2023-05-10T01:43:38.203819+0000","last_active":"2023-05-10T01:43:38.603871+0000","last_peered":"2023-05-10T01:43:38.603871+0000","last_clean":"2023-05-10T01:43:38.603871+0000","last_became_active":"2023-05-10T01:43:38.203216+0000","last_became_peered":"2023-05-10T01:43:38.203216+0000","last_unstale":"2023-05-10T01:43:38.603871+0000","last_undegraded":"2023-05-10T01:43:38.603871+0000","last_fullsized":"2023-05-10T01:43:38.603871+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619363+0000","last_change":"2023-05-10T01:43:38.616580+0000","last_active":"2023-05-10T01:43:38.619363+0000","last_peered":"2023-05-10T01:43:38.619363+0000","last_clean":"2023-05-10T01:43:38.619363+0000","last_became_active":"2023-05-10T01:43:38.616299+0000","last_became_peered":"2023-05-10T01:43:38.616299+0000","last_unstale":"2023-05-10T01:43:38.619363+0000","last_undegraded":"2023-05-10T01:43:38.619363+0000","last_fullsized":"2023-05-10T01:43:38.619363+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589342+0000","last_change":"2023-05-10T01:43:38.209464+0000","last_active":"2023-05-10T01:43:38.589342+0000","last_peered":"2023-05-10T01:43:38.589342+0000","last_clean":"2023-05-10T01:43:38.589342+0000","last_became_active":"2023-05-10T01:43:38.209149+0000","last_became_peered":"2023-05-10T01:43:38.209149+0000","last_unstale":"2023-05-10T01:43:38.589342+0000","last_undegraded":"2023-05-10T01:43:38.589342+0000","last_fullsized":"2023-05-10T01:43:38.589342+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612820+0000","last_change":"2023-05-10T01:43:38.611949+0000","last_active":"2023-05-10T01:43:38.612820+0000","last_peered":"2023-05-10T01:43:38.612820+0000","last_clean":"2023-05-10T01:43:38.612820+0000","last_became_active":"2023-05-10T01:43:38.611608+0000","last_became_peered":"2023-05-10T01:43:38.611608+0000","last_unstale":"2023-05-10T01:43:38.612820+0000","last_undegraded":"2023-05-10T01:43:38.612820+0000","last_fullsized":"2023-05-10T01:43:38.612820+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600152+0000","last_change":"2023-05-10T01:43:38.204823+0000","last_active":"2023-05-10T01:43:38.600152+0000","last_peered":"2023-05-10T01:43:38.600152+0000","last_clean":"2023-05-10T01:43:38.600152+0000","last_became_active":"2023-05-10T01:43:38.204393+0000","last_became_peered":"2023-05-10T01:43:38.204393+0000","last_unstale":"2023-05-10T01:43:38.600152+0000","last_undegraded":"2023-05-10T01:43:38.600152+0000","last_fullsized":"2023-05-10T01:43:38.600152+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605072+0000","last_change":"2023-05-10T01:43:38.598811+0000","last_active":"2023-05-10T01:43:38.605072+0000","last_peered":"2023-05-10T01:43:38.605072+0000","last_clean":"2023-05-10T01:43:38.605072+0000","last_became_active":"2023-05-10T01:43:38.598513+0000","last_became_peered":"2023-05-10T01:43:38.598513+0000","last_unstale":"2023-05-10T01:43:38.605072+0000","last_undegraded":"2023-05-10T01:43:38.605072+0000","last_fullsized":"2023-05-10T01:43:38.605072+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589082+0000","last_change":"2023-05-10T01:43:38.201686+0000","last_active":"2023-05-10T01:43:38.589082+0000","last_peered":"2023-05-10T01:43:38.589082+0000","last_clean":"2023-05-10T01:43:38.589082+0000","last_became_active":"2023-05-10T01:43:38.201376+0000","last_became_peered":"2023-05-10T01:43:38.201376+0000","last_unstale":"2023-05-10T01:43:38.589082+0000","last_undegraded":"2023-05-10T01:43:38.589082+0000","last_fullsized":"2023-05-10T01:43:38.589082+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601669+0000","last_change":"2023-05-10T01:43:38.600225+0000","last_active":"2023-05-10T01:43:38.601669+0000","last_peered":"2023-05-10T01:43:38.601669+0000","last_clean":"2023-05-10T01:43:38.601669+0000","last_became_active":"2023-05-10T01:43:38.599936+0000","last_became_peered":"2023-05-10T01:43:38.599936+0000","last_unstale":"2023-05-10T01:43:38.601669+0000","last_undegraded":"2023-05-10T01:43:38.601669+0000","last_fullsized":"2023-05-10T01:43:38.601669+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.586716+0000","last_change":"2023-05-10T01:43:38.206663+0000","last_active":"2023-05-10T01:43:38.586716+0000","last_peered":"2023-05-10T01:43:38.586716+0000","last_clean":"2023-05-10T01:43:38.586716+0000","last_became_active":"2023-05-10T01:43:38.206351+0000","last_became_peered":"2023-05-10T01:43:38.206351+0000","last_unstale":"2023-05-10T01:43:38.586716+0000","last_undegraded":"2023-05-10T01:43:38.586716+0000","last_fullsized":"2023-05-10T01:43:38.586716+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612735+0000","last_change":"2023-05-10T01:43:38.607605+0000","last_active":"2023-05-10T01:43:38.612735+0000","last_peered":"2023-05-10T01:43:38.612735+0000","last_clean":"2023-05-10T01:43:38.612735+0000","last_became_active":"2023-05-10T01:43:38.607326+0000","last_became_peered":"2023-05-10T01:43:38.607326+0000","last_unstale":"2023-05-10T01:43:38.612735+0000","last_undegraded":"2023-05-10T01:43:38.612735+0000","last_fullsized":"2023-05-10T01:43:38.612735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594268+0000","last_change":"2023-05-10T01:43:38.211946+0000","last_active":"2023-05-10T01:43:38.594268+0000","last_peered":"2023-05-10T01:43:38.594268+0000","last_clean":"2023-05-10T01:43:38.594268+0000","last_became_active":"2023-05-10T01:43:38.211663+0000","last_became_peered":"2023-05-10T01:43:38.211663+0000","last_unstale":"2023-05-10T01:43:38.594268+0000","last_undegraded":"2023-05-10T01:43:38.594268+0000","last_fullsized":"2023-05-10T01:43:38.594268+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.624383+0000","last_change":"2023-05-10T01:43:38.619645+0000","last_active":"2023-05-10T01:43:38.624383+0000","last_peered":"2023-05-10T01:43:38.624383+0000","last_clean":"2023-05-10T01:43:38.624383+0000","last_became_active":"2023-05-10T01:43:38.619429+0000","last_became_peered":"2023-05-10T01:43:38.619429+0000","last_unstale":"2023-05-10T01:43:38.624383+0000","last_undegraded":"2023-05-10T01:43:38.624383+0000","last_fullsized":"2023-05-10T01:43:38.624383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.591998+0000","last_change":"2023-05-10T01:43:38.206282+0000","last_active":"2023-05-10T01:43:38.591998+0000","last_peered":"2023-05-10T01:43:38.591998+0000","last_clean":"2023-05-10T01:43:38.591998+0000","last_became_active":"2023-05-10T01:43:38.205877+0000","last_became_peered":"2023-05-10T01:43:38.205877+0000","last_unstale":"2023-05-10T01:43:38.591998+0000","last_undegraded":"2023-05-10T01:43:38.591998+0000","last_fullsized":"2023-05-10T01:43:38.591998+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617649+0000","last_change":"2023-05-10T01:43:38.606948+0000","last_active":"2023-05-10T01:43:38.617649+0000","last_peered":"2023-05-10T01:43:38.617649+0000","last_clean":"2023-05-10T01:43:38.617649+0000","last_became_active":"2023-05-10T01:43:38.606510+0000","last_became_peered":"2023-05-10T01:43:38.606510+0000","last_unstale":"2023-05-10T01:43:38.617649+0000","last_undegraded":"2023-05-10T01:43:38.617649+0000","last_fullsized":"2023-05-10T01:43:38.617649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587611+0000","last_change":"2023-05-10T01:43:38.206449+0000","last_active":"2023-05-10T01:43:38.587611+0000","last_peered":"2023-05-10T01:43:38.587611+0000","last_clean":"2023-05-10T01:43:38.587611+0000","last_became_active":"2023-05-10T01:43:38.205997+0000","last_became_peered":"2023-05-10T01:43:38.205997+0000","last_unstale":"2023-05-10T01:43:38.587611+0000","last_undegraded":"2023-05-10T01:43:38.587611+0000","last_fullsized":"2023-05-10T01:43:38.587611+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612707+0000","last_change":"2023-05-10T01:43:38.611989+0000","last_active":"2023-05-10T01:43:38.612707+0000","last_peered":"2023-05-10T01:43:38.612707+0000","last_clean":"2023-05-10T01:43:38.612707+0000","last_became_active":"2023-05-10T01:43:38.611515+0000","last_became_peered":"2023-05-10T01:43:38.611515+0000","last_unstale":"2023-05-10T01:43:38.612707+0000","last_undegraded":"2023-05-10T01:43:38.612707+0000","last_fullsized":"2023-05-10T01:43:38.612707+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590664+0000","last_change":"2023-05-10T01:43:38.211678+0000","last_active":"2023-05-10T01:43:38.590664+0000","last_peered":"2023-05-10T01:43:38.590664+0000","last_clean":"2023-05-10T01:43:38.590664+0000","last_became_active":"2023-05-10T01:43:38.211165+0000","last_became_peered":"2023-05-10T01:43:38.211165+0000","last_unstale":"2023-05-10T01:43:38.590664+0000","last_undegraded":"2023-05-10T01:43:38.590664+0000","last_fullsized":"2023-05-10T01:43:38.590664+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.609383+0000","last_change":"2023-05-10T01:43:38.607890+0000","last_active":"2023-05-10T01:43:38.609383+0000","last_peered":"2023-05-10T01:43:38.609383+0000","last_clean":"2023-05-10T01:43:38.609383+0000","last_became_active":"2023-05-10T01:43:38.607554+0000","last_became_peered":"2023-05-10T01:43:38.607554+0000","last_unstale":"2023-05-10T01:43:38.609383+0000","last_undegraded":"2023-05-10T01:43:38.609383+0000","last_fullsized":"2023-05-10T01:43:38.609383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590392+0000","last_change":"2023-05-10T01:43:38.212206+0000","last_active":"2023-05-10T01:43:38.590392+0000","last_peered":"2023-05-10T01:43:38.590392+0000","last_clean":"2023-05-10T01:43:38.590392+0000","last_became_active":"2023-05-10T01:43:38.211655+0000","last_became_peered":"2023-05-10T01:43:38.211655+0000","last_unstale":"2023-05-10T01:43:38.590392+0000","last_undegraded":"2023-05-10T01:43:38.590392+0000","last_fullsized":"2023-05-10T01:43:38.590392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615224+0000","last_change":"2023-05-10T01:43:38.603605+0000","last_active":"2023-05-10T01:43:38.615224+0000","last_peered":"2023-05-10T01:43:38.615224+0000","last_clean":"2023-05-10T01:43:38.615224+0000","last_became_active":"2023-05-10T01:43:38.603333+0000","last_became_peered":"2023-05-10T01:43:38.603333+0000","last_unstale":"2023-05-10T01:43:38.615224+0000","last_undegraded":"2023-05-10T01:43:38.615224+0000","last_fullsized":"2023-05-10T01:43:38.615224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594879+0000","last_change":"2023-05-10T01:43:38.207293+0000","last_active":"2023-05-10T01:43:38.594879+0000","last_peered":"2023-05-10T01:43:38.594879+0000","last_clean":"2023-05-10T01:43:38.594879+0000","last_became_active":"2023-05-10T01:43:38.206994+0000","last_became_peered":"2023-05-10T01:43:38.206994+0000","last_unstale":"2023-05-10T01:43:38.594879+0000","last_undegraded":"2023-05-10T01:43:38.594879+0000","last_fullsized":"2023-05-10T01:43:38.594879+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617658+0000","last_change":"2023-05-10T01:43:38.612128+0000","last_active":"2023-05-10T01:43:38.617658+0000","last_peered":"2023-05-10T01:43:38.617658+0000","last_clean":"2023-05-10T01:43:38.617658+0000","last_became_active":"2023-05-10T01:43:38.611893+0000","last_became_peered":"2023-05-10T01:43:38.611893+0000","last_unstale":"2023-05-10T01:43:38.617658+0000","last_undegraded":"2023-05-10T01:43:38.617658+0000","last_fullsized":"2023-05-10T01:43:38.617658+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606546+0000","last_change":"2023-05-10T01:43:38.202876+0000","last_active":"2023-05-10T01:43:38.606546+0000","last_peered":"2023-05-10T01:43:38.606546+0000","last_clean":"2023-05-10T01:43:38.606546+0000","last_became_active":"2023-05-10T01:43:38.202014+0000","last_became_peered":"2023-05-10T01:43:38.202014+0000","last_unstale":"2023-05-10T01:43:38.606546+0000","last_undegraded":"2023-05-10T01:43:38.606546+0000","last_fullsized":"2023-05-10T01:43:38.606546+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616916+0000","last_change":"2023-05-10T01:43:38.612266+0000","last_active":"2023-05-10T01:43:38.616916+0000","last_peered":"2023-05-10T01:43:38.616916+0000","last_clean":"2023-05-10T01:43:38.616916+0000","last_became_active":"2023-05-10T01:43:38.611947+0000","last_became_peered":"2023-05-10T01:43:38.611947+0000","last_unstale":"2023-05-10T01:43:38.616916+0000","last_undegraded":"2023-05-10T01:43:38.616916+0000","last_fullsized":"2023-05-10T01:43:38.616916+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606273+0000","last_change":"2023-05-10T01:43:38.201540+0000","last_active":"2023-05-10T01:43:38.606273+0000","last_peered":"2023-05-10T01:43:38.606273+0000","last_clean":"2023-05-10T01:43:38.606273+0000","last_became_active":"2023-05-10T01:43:38.200902+0000","last_became_peered":"2023-05-10T01:43:38.200902+0000","last_unstale":"2023-05-10T01:43:38.606273+0000","last_undegraded":"2023-05-10T01:43:38.606273+0000","last_fullsized":"2023-05-10T01:43:38.606273+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604190+0000","last_change":"2023-05-10T01:43:38.594473+0000","last_active":"2023-05-10T01:43:38.604190+0000","last_peered":"2023-05-10T01:43:38.604190+0000","last_clean":"2023-05-10T01:43:38.604190+0000","last_became_active":"2023-05-10T01:43:38.594173+0000","last_became_peered":"2023-05-10T01:43:38.594173+0000","last_unstale":"2023-05-10T01:43:38.604190+0000","last_undegraded":"2023-05-10T01:43:38.604190+0000","last_fullsized":"2023-05-10T01:43:38.604190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604577+0000","last_change":"2023-05-10T01:43:38.203082+0000","last_active":"2023-05-10T01:43:38.604577+0000","last_peered":"2023-05-10T01:43:38.604577+0000","last_clean":"2023-05-10T01:43:38.604577+0000","last_became_active":"2023-05-10T01:43:38.202793+0000","last_became_peered":"2023-05-10T01:43:38.202793+0000","last_unstale":"2023-05-10T01:43:38.604577+0000","last_undegraded":"2023-05-10T01:43:38.604577+0000","last_fullsized":"2023-05-10T01:43:38.604577+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601058+0000","last_change":"2023-05-10T01:43:38.598614+0000","last_active":"2023-05-10T01:43:38.601058+0000","last_peered":"2023-05-10T01:43:38.601058+0000","last_clean":"2023-05-10T01:43:38.601058+0000","last_became_active":"2023-05-10T01:43:38.598360+0000","last_became_peered":"2023-05-10T01:43:38.598360+0000","last_unstale":"2023-05-10T01:43:38.601058+0000","last_undegraded":"2023-05-10T01:43:38.601058+0000","last_fullsized":"2023-05-10T01:43:38.601058+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.607327+0000","last_change":"2023-05-10T01:43:38.208930+0000","last_active":"2023-05-10T01:43:38.607327+0000","last_peered":"2023-05-10T01:43:38.607327+0000","last_clean":"2023-05-10T01:43:38.607327+0000","last_became_active":"2023-05-10T01:43:38.208624+0000","last_became_peered":"2023-05-10T01:43:38.208624+0000","last_unstale":"2023-05-10T01:43:38.607327+0000","last_undegraded":"2023-05-10T01:43:38.607327+0000","last_fullsized":"2023-05-10T01:43:38.607327+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604788+0000","last_change":"2023-05-10T01:43:38.603223+0000","last_active":"2023-05-10T01:43:38.604788+0000","last_peered":"2023-05-10T01:43:38.604788+0000","last_clean":"2023-05-10T01:43:38.604788+0000","last_became_active":"2023-05-10T01:43:38.602941+0000","last_became_peered":"2023-05-10T01:43:38.602941+0000","last_unstale":"2023-05-10T01:43:38.604788+0000","last_undegraded":"2023-05-10T01:43:38.604788+0000","last_fullsized":"2023-05-10T01:43:38.604788+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594992+0000","last_change":"2023-05-10T01:43:38.204813+0000","last_active":"2023-05-10T01:43:38.594992+0000","last_peered":"2023-05-10T01:43:38.594992+0000","last_clean":"2023-05-10T01:43:38.594992+0000","last_became_active":"2023-05-10T01:43:38.204317+0000","last_became_peered":"2023-05-10T01:43:38.204317+0000","last_unstale":"2023-05-10T01:43:38.594992+0000","last_undegraded":"2023-05-10T01:43:38.594992+0000","last_fullsized":"2023-05-10T01:43:38.594992+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612767+0000","last_change":"2023-05-10T01:43:38.607953+0000","last_active":"2023-05-10T01:43:38.612767+0000","last_peered":"2023-05-10T01:43:38.612767+0000","last_clean":"2023-05-10T01:43:38.612767+0000","last_became_active":"2023-05-10T01:43:38.607300+0000","last_became_peered":"2023-05-10T01:43:38.607300+0000","last_unstale":"2023-05-10T01:43:38.612767+0000","last_undegraded":"2023-05-10T01:43:38.612767+0000","last_fullsized":"2023-05-10T01:43:38.612767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608065+0000","last_change":"2023-05-10T01:43:38.200373+0000","last_active":"2023-05-10T01:43:38.608065+0000","last_peered":"2023-05-10T01:43:38.608065+0000","last_clean":"2023-05-10T01:43:38.608065+0000","last_became_active":"2023-05-10T01:43:38.200100+0000","last_became_peered":"2023-05-10T01:43:38.200100+0000","last_unstale":"2023-05-10T01:43:38.608065+0000","last_undegraded":"2023-05-10T01:43:38.608065+0000","last_fullsized":"2023-05-10T01:43:38.608065+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.614675+0000","last_change":"2023-05-10T01:43:38.609647+0000","last_active":"2023-05-10T01:43:38.614675+0000","last_peered":"2023-05-10T01:43:38.614675+0000","last_clean":"2023-05-10T01:43:38.614675+0000","last_became_active":"2023-05-10T01:43:38.609466+0000","last_became_peered":"2023-05-10T01:43:38.609466+0000","last_unstale":"2023-05-10T01:43:38.614675+0000","last_undegraded":"2023-05-10T01:43:38.614675+0000","last_fullsized":"2023-05-10T01:43:38.614675+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.593916+0000","last_change":"2023-05-10T01:43:38.204375+0000","last_active":"2023-05-10T01:43:38.593916+0000","last_peered":"2023-05-10T01:43:38.593916+0000","last_clean":"2023-05-10T01:43:38.593916+0000","last_became_active":"2023-05-10T01:43:38.204078+0000","last_became_peered":"2023-05-10T01:43:38.204078+0000","last_unstale":"2023-05-10T01:43:38.593916+0000","last_undegraded":"2023-05-10T01:43:38.593916+0000","last_fullsized":"2023-05-10T01:43:38.593916+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604673+0000","last_change":"2023-05-10T01:43:38.601013+0000","last_active":"2023-05-10T01:43:38.604673+0000","last_peered":"2023-05-10T01:43:38.604673+0000","last_clean":"2023-05-10T01:43:38.604673+0000","last_became_active":"2023-05-10T01:43:38.600727+0000","last_became_peered":"2023-05-10T01:43:38.600727+0000","last_unstale":"2023-05-10T01:43:38.604673+0000","last_undegraded":"2023-05-10T01:43:38.604673+0000","last_fullsized":"2023-05-10T01:43:38.604673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585002+0000","last_change":"2023-05-10T01:43:38.206882+0000","last_active":"2023-05-10T01:43:38.585002+0000","last_peered":"2023-05-10T01:43:38.585002+0000","last_clean":"2023-05-10T01:43:38.585002+0000","last_became_active":"2023-05-10T01:43:38.206172+0000","last_became_peered":"2023-05-10T01:43:38.206172+0000","last_unstale":"2023-05-10T01:43:38.585002+0000","last_undegraded":"2023-05-10T01:43:38.585002+0000","last_fullsized":"2023-05-10T01:43:38.585002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611285+0000","last_change":"2023-05-10T01:43:38.608524+0000","last_active":"2023-05-10T01:43:38.611285+0000","last_peered":"2023-05-10T01:43:38.611285+0000","last_clean":"2023-05-10T01:43:38.611285+0000","last_became_active":"2023-05-10T01:43:38.608080+0000","last_became_peered":"2023-05-10T01:43:38.608080+0000","last_unstale":"2023-05-10T01:43:38.611285+0000","last_undegraded":"2023-05-10T01:43:38.611285+0000","last_fullsized":"2023-05-10T01:43:38.611285+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598487+0000","last_change":"2023-05-10T01:43:38.205866+0000","last_active":"2023-05-10T01:43:38.598487+0000","last_peered":"2023-05-10T01:43:38.598487+0000","last_clean":"2023-05-10T01:43:38.598487+0000","last_became_active":"2023-05-10T01:43:38.205573+0000","last_became_peered":"2023-05-10T01:43:38.205573+0000","last_unstale":"2023-05-10T01:43:38.598487+0000","last_undegraded":"2023-05-10T01:43:38.598487+0000","last_fullsized":"2023-05-10T01:43:38.598487+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617733+0000","last_change":"2023-05-10T01:43:38.614089+0000","last_active":"2023-05-10T01:43:38.617733+0000","last_peered":"2023-05-10T01:43:38.617733+0000","last_clean":"2023-05-10T01:43:38.617733+0000","last_became_active":"2023-05-10T01:43:38.613758+0000","last_became_peered":"2023-05-10T01:43:38.613758+0000","last_unstale":"2023-05-10T01:43:38.617733+0000","last_undegraded":"2023-05-10T01:43:38.617733+0000","last_fullsized":"2023-05-10T01:43:38.617733+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603299+0000","last_change":"2023-05-10T01:43:38.202045+0000","last_active":"2023-05-10T01:43:38.603299+0000","last_peered":"2023-05-10T01:43:38.603299+0000","last_clean":"2023-05-10T01:43:38.603299+0000","last_became_active":"2023-05-10T01:43:38.201756+0000","last_became_peered":"2023-05-10T01:43:38.201756+0000","last_unstale":"2023-05-10T01:43:38.603299+0000","last_undegraded":"2023-05-10T01:43:38.603299+0000","last_fullsized":"2023-05-10T01:43:38.603299+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608481+0000","last_change":"2023-05-10T01:43:38.603686+0000","last_active":"2023-05-10T01:43:38.608481+0000","last_peered":"2023-05-10T01:43:38.608481+0000","last_clean":"2023-05-10T01:43:38.608481+0000","last_became_active":"2023-05-10T01:43:38.603417+0000","last_became_peered":"2023-05-10T01:43:38.603417+0000","last_unstale":"2023-05-10T01:43:38.608481+0000","last_undegraded":"2023-05-10T01:43:38.608481+0000","last_fullsized":"2023-05-10T01:43:38.608481+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617053+0000","last_change":"2023-05-10T01:43:38.201286+0000","last_active":"2023-05-10T01:43:38.617053+0000","last_peered":"2023-05-10T01:43:38.617053+0000","last_clean":"2023-05-10T01:43:38.617053+0000","last_became_active":"2023-05-10T01:43:38.200660+0000","last_became_peered":"2023-05-10T01:43:38.200660+0000","last_unstale":"2023-05-10T01:43:38.617053+0000","last_undegraded":"2023-05-10T01:43:38.617053+0000","last_fullsized":"2023-05-10T01:43:38.617053+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611310+0000","last_change":"2023-05-10T01:43:38.608624+0000","last_active":"2023-05-10T01:43:38.611310+0000","last_peered":"2023-05-10T01:43:38.611310+0000","last_clean":"2023-05-10T01:43:38.611310+0000","last_became_active":"2023-05-10T01:43:38.607883+0000","last_became_peered":"2023-05-10T01:43:38.607883+0000","last_unstale":"2023-05-10T01:43:38.611310+0000","last_undegraded":"2023-05-10T01:43:38.611310+0000","last_fullsized":"2023-05-10T01:43:38.611310+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585826+0000","last_change":"2023-05-10T01:43:38.207304+0000","last_active":"2023-05-10T01:43:38.585826+0000","last_peered":"2023-05-10T01:43:38.585826+0000","last_clean":"2023-05-10T01:43:38.585826+0000","last_became_active":"2023-05-10T01:43:38.207047+0000","last_became_peered":"2023-05-10T01:43:38.207047+0000","last_unstale":"2023-05-10T01:43:38.585826+0000","last_undegraded":"2023-05-10T01:43:38.585826+0000","last_fullsized":"2023-05-10T01:43:38.585826+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.614351+0000","last_change":"2023-05-10T01:43:38.613646+0000","last_active":"2023-05-10T01:43:38.614351+0000","last_peered":"2023-05-10T01:43:38.614351+0000","last_clean":"2023-05-10T01:43:38.614351+0000","last_became_active":"2023-05-10T01:43:38.613329+0000","last_became_peered":"2023-05-10T01:43:38.613329+0000","last_unstale":"2023-05-10T01:43:38.614351+0000","last_undegraded":"2023-05-10T01:43:38.614351+0000","last_fullsized":"2023-05-10T01:43:38.614351+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594218+0000","last_change":"2023-05-10T01:43:38.214783+0000","last_active":"2023-05-10T01:43:38.594218+0000","last_peered":"2023-05-10T01:43:38.594218+0000","last_clean":"2023-05-10T01:43:38.594218+0000","last_became_active":"2023-05-10T01:43:38.214373+0000","last_became_peered":"2023-05-10T01:43:38.214373+0000","last_unstale":"2023-05-10T01:43:38.594218+0000","last_undegraded":"2023-05-10T01:43:38.594218+0000","last_fullsized":"2023-05-10T01:43:38.594218+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601554+0000","last_change":"2023-05-10T01:43:38.597321+0000","last_active":"2023-05-10T01:43:38.601554+0000","last_peered":"2023-05-10T01:43:38.601554+0000","last_clean":"2023-05-10T01:43:38.601554+0000","last_became_active":"2023-05-10T01:43:38.596813+0000","last_became_peered":"2023-05-10T01:43:38.596813+0000","last_unstale":"2023-05-10T01:43:38.601554+0000","last_undegraded":"2023-05-10T01:43:38.601554+0000","last_fullsized":"2023-05-10T01:43:38.601554+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617963+0000","last_change":"2023-05-10T01:43:38.203587+0000","last_active":"2023-05-10T01:43:38.617963+0000","last_peered":"2023-05-10T01:43:38.617963+0000","last_clean":"2023-05-10T01:43:38.617963+0000","last_became_active":"2023-05-10T01:43:38.202361+0000","last_became_peered":"2023-05-10T01:43:38.202361+0000","last_unstale":"2023-05-10T01:43:38.617963+0000","last_undegraded":"2023-05-10T01:43:38.617963+0000","last_fullsized":"2023-05-10T01:43:38.617963+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606516+0000","last_change":"2023-05-10T01:43:38.603782+0000","last_active":"2023-05-10T01:43:38.606516+0000","last_peered":"2023-05-10T01:43:38.606516+0000","last_clean":"2023-05-10T01:43:38.606516+0000","last_became_active":"2023-05-10T01:43:38.603292+0000","last_became_peered":"2023-05-10T01:43:38.603292+0000","last_unstale":"2023-05-10T01:43:38.606516+0000","last_undegraded":"2023-05-10T01:43:38.606516+0000","last_fullsized":"2023-05-10T01:43:38.606516+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590475+0000","last_change":"2023-05-10T01:43:38.204827+0000","last_active":"2023-05-10T01:43:38.590475+0000","last_peered":"2023-05-10T01:43:38.590475+0000","last_clean":"2023-05-10T01:43:38.590475+0000","last_became_active":"2023-05-10T01:43:38.204541+0000","last_became_peered":"2023-05-10T01:43:38.204541+0000","last_unstale":"2023-05-10T01:43:38.590475+0000","last_undegraded":"2023-05-10T01:43:38.590475+0000","last_fullsized":"2023-05-10T01:43:38.590475+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616356+0000","last_change":"2023-05-10T01:43:38.615446+0000","last_active":"2023-05-10T01:43:38.616356+0000","last_peered":"2023-05-10T01:43:38.616356+0000","last_clean":"2023-05-10T01:43:38.616356+0000","last_became_active":"2023-05-10T01:43:38.615235+0000","last_became_peered":"2023-05-10T01:43:38.615235+0000","last_unstale":"2023-05-10T01:43:38.616356+0000","last_undegraded":"2023-05-10T01:43:38.616356+0000","last_fullsized":"2023-05-10T01:43:38.616356+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.595092+0000","last_change":"2023-05-10T01:43:38.207193+0000","last_active":"2023-05-10T01:43:38.595092+0000","last_peered":"2023-05-10T01:43:38.595092+0000","last_clean":"2023-05-10T01:43:38.595092+0000","last_became_active":"2023-05-10T01:43:38.206679+0000","last_became_peered":"2023-05-10T01:43:38.206679+0000","last_unstale":"2023-05-10T01:43:38.595092+0000","last_undegraded":"2023-05-10T01:43:38.595092+0000","last_fullsized":"2023-05-10T01:43:38.595092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619190+0000","last_change":"2023-05-10T01:43:38.614310+0000","last_active":"2023-05-10T01:43:38.619190+0000","last_peered":"2023-05-10T01:43:38.619190+0000","last_clean":"2023-05-10T01:43:38.619190+0000","last_became_active":"2023-05-10T01:43:38.614020+0000","last_became_peered":"2023-05-10T01:43:38.614020+0000","last_unstale":"2023-05-10T01:43:38.619190+0000","last_undegraded":"2023-05-10T01:43:38.619190+0000","last_fullsized":"2023-05-10T01:43:38.619190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585083+0000","last_change":"2023-05-10T01:43:38.208737+0000","last_active":"2023-05-10T01:43:38.585083+0000","last_peered":"2023-05-10T01:43:38.585083+0000","last_clean":"2023-05-10T01:43:38.585083+0000","last_became_active":"2023-05-10T01:43:38.208458+0000","last_became_peered":"2023-05-10T01:43:38.208458+0000","last_unstale":"2023-05-10T01:43:38.585083+0000","last_undegraded":"2023-05-10T01:43:38.585083+0000","last_fullsized":"2023-05-10T01:43:38.585083+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603589+0000","last_change":"2023-05-10T01:43:38.599267+0000","last_active":"2023-05-10T01:43:38.603589+0000","last_peered":"2023-05-10T01:43:38.603589+0000","last_clean":"2023-05-10T01:43:38.603589+0000","last_became_active":"2023-05-10T01:43:38.599007+0000","last_became_peered":"2023-05-10T01:43:38.599007+0000","last_unstale":"2023-05-10T01:43:38.603589+0000","last_undegraded":"2023-05-10T01:43:38.603589+0000","last_fullsized":"2023-05-10T01:43:38.603589+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611895+0000","last_change":"2023-05-10T01:43:38.212733+0000","last_active":"2023-05-10T01:43:38.611895+0000","last_peered":"2023-05-10T01:43:38.611895+0000","last_clean":"2023-05-10T01:43:38.611895+0000","last_became_active":"2023-05-10T01:43:38.212462+0000","last_became_peered":"2023-05-10T01:43:38.212462+0000","last_unstale":"2023-05-10T01:43:38.611895+0000","last_undegraded":"2023-05-10T01:43:38.611895+0000","last_fullsized":"2023-05-10T01:43:38.611895+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617692+0000","last_change":"2023-05-10T01:43:38.613639+0000","last_active":"2023-05-10T01:43:38.617692+0000","last_peered":"2023-05-10T01:43:38.617692+0000","last_clean":"2023-05-10T01:43:38.617692+0000","last_became_active":"2023-05-10T01:43:38.613344+0000","last_became_peered":"2023-05-10T01:43:38.613344+0000","last_unstale":"2023-05-10T01:43:38.617692+0000","last_undegraded":"2023-05-10T01:43:38.617692+0000","last_fullsized":"2023-05-10T01:43:38.617692+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608416+0000","last_change":"2023-05-10T01:43:38.205002+0000","last_active":"2023-05-10T01:43:38.608416+0000","last_peered":"2023-05-10T01:43:38.608416+0000","last_clean":"2023-05-10T01:43:38.608416+0000","last_became_active":"2023-05-10T01:43:38.202378+0000","last_became_peered":"2023-05-10T01:43:38.202378+0000","last_unstale":"2023-05-10T01:43:38.608416+0000","last_undegraded":"2023-05-10T01:43:38.608416+0000","last_fullsized":"2023-05-10T01:43:38.608416+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619036+0000","last_change":"2023-05-10T01:43:38.615748+0000","last_active":"2023-05-10T01:43:38.619036+0000","last_peered":"2023-05-10T01:43:38.619036+0000","last_clean":"2023-05-10T01:43:38.619036+0000","last_became_active":"2023-05-10T01:43:38.615449+0000","last_became_peered":"2023-05-10T01:43:38.615449+0000","last_unstale":"2023-05-10T01:43:38.619036+0000","last_undegraded":"2023-05-10T01:43:38.619036+0000","last_fullsized":"2023-05-10T01:43:38.619036+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.609297+0000","last_change":"2023-05-10T01:43:38.199956+0000","last_active":"2023-05-10T01:43:38.609297+0000","last_peered":"2023-05-10T01:43:38.609297+0000","last_clean":"2023-05-10T01:43:38.609297+0000","last_became_active":"2023-05-10T01:43:38.199622+0000","last_became_peered":"2023-05-10T01:43:38.199622+0000","last_unstale":"2023-05-10T01:43:38.609297+0000","last_undegraded":"2023-05-10T01:43:38.609297+0000","last_fullsized":"2023-05-10T01:43:38.609297+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617672+0000","last_change":"2023-05-10T01:43:38.616725+0000","last_active":"2023-05-10T01:43:38.617672+0000","last_peered":"2023-05-10T01:43:38.617672+0000","last_clean":"2023-05-10T01:43:38.617672+0000","last_became_active":"2023-05-10T01:43:38.616449+0000","last_became_peered":"2023-05-10T01:43:38.616449+0000","last_unstale":"2023-05-10T01:43:38.617672+0000","last_undegraded":"2023-05-10T01:43:38.617672+0000","last_fullsized":"2023-05-10T01:43:38.617672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585584+0000","last_change":"2023-05-10T01:43:38.206383+0000","last_active":"2023-05-10T01:43:38.585584+0000","last_peered":"2023-05-10T01:43:38.585584+0000","last_clean":"2023-05-10T01:43:38.585584+0000","last_became_active":"2023-05-10T01:43:38.206014+0000","last_became_peered":"2023-05-10T01:43:38.206014+0000","last_unstale":"2023-05-10T01:43:38.585584+0000","last_undegraded":"2023-05-10T01:43:38.585584+0000","last_fullsized":"2023-05-10T01:43:38.585584+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605162+0000","last_change":"2023-05-10T01:43:38.598150+0000","last_active":"2023-05-10T01:43:38.605162+0000","last_peered":"2023-05-10T01:43:38.605162+0000","last_clean":"2023-05-10T01:43:38.605162+0000","last_became_active":"2023-05-10T01:43:38.597907+0000","last_became_peered":"2023-05-10T01:43:38.597907+0000","last_unstale":"2023-05-10T01:43:38.605162+0000","last_undegraded":"2023-05-10T01:43:38.605162+0000","last_fullsized":"2023-05-10T01:43:38.605162+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587809+0000","last_change":"2023-05-10T01:43:38.205378+0000","last_active":"2023-05-10T01:43:38.587809+0000","last_peered":"2023-05-10T01:43:38.587809+0000","last_clean":"2023-05-10T01:43:38.587809+0000","last_became_active":"2023-05-10T01:43:38.204515+0000","last_became_peered":"2023-05-10T01:43:38.204515+0000","last_unstale":"2023-05-10T01:43:38.587809+0000","last_undegraded":"2023-05-10T01:43:38.587809+0000","last_fullsized":"2023-05-10T01:43:38.587809+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.602122+0000","last_change":"2023-05-10T01:43:38.595360+0000","last_active":"2023-05-10T01:43:38.602122+0000","last_peered":"2023-05-10T01:43:38.602122+0000","last_clean":"2023-05-10T01:43:38.602122+0000","last_became_active":"2023-05-10T01:43:38.595045+0000","last_became_peered":"2023-05-10T01:43:38.595045+0000","last_unstale":"2023-05-10T01:43:38.602122+0000","last_undegraded":"2023-05-10T01:43:38.602122+0000","last_fullsized":"2023-05-10T01:43:38.602122+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.595114+0000","last_change":"2023-05-10T01:43:38.204493+0000","last_active":"2023-05-10T01:43:38.595114+0000","last_peered":"2023-05-10T01:43:38.595114+0000","last_clean":"2023-05-10T01:43:38.595114+0000","last_became_active":"2023-05-10T01:43:38.204152+0000","last_became_peered":"2023-05-10T01:43:38.204152+0000","last_unstale":"2023-05-10T01:43:38.595114+0000","last_undegraded":"2023-05-10T01:43:38.595114+0000","last_fullsized":"2023-05-10T01:43:38.595114+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605144+0000","last_change":"2023-05-10T01:43:38.599961+0000","last_active":"2023-05-10T01:43:38.605144+0000","last_peered":"2023-05-10T01:43:38.605144+0000","last_clean":"2023-05-10T01:43:38.605144+0000","last_became_active":"2023-05-10T01:43:38.599696+0000","last_became_peered":"2023-05-10T01:43:38.599696+0000","last_unstale":"2023-05-10T01:43:38.605144+0000","last_undegraded":"2023-05-10T01:43:38.605144+0000","last_fullsized":"2023-05-10T01:43:38.605144+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585107+0000","last_change":"2023-05-10T01:43:38.205021+0000","last_active":"2023-05-10T01:43:38.585107+0000","last_peered":"2023-05-10T01:43:38.585107+0000","last_clean":"2023-05-10T01:43:38.585107+0000","last_became_active":"2023-05-10T01:43:38.204612+0000","last_became_peered":"2023-05-10T01:43:38.204612+0000","last_unstale":"2023-05-10T01:43:38.585107+0000","last_undegraded":"2023-05-10T01:43:38.585107+0000","last_fullsized":"2023-05-10T01:43:38.585107+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618919+0000","last_change":"2023-05-10T01:43:38.615249+0000","last_active":"2023-05-10T01:43:38.618919+0000","last_peered":"2023-05-10T01:43:38.618919+0000","last_clean":"2023-05-10T01:43:38.618919+0000","last_became_active":"2023-05-10T01:43:38.613483+0000","last_became_peered":"2023-05-10T01:43:38.613483+0000","last_unstale":"2023-05-10T01:43:38.618919+0000","last_undegraded":"2023-05-10T01:43:38.618919+0000","last_fullsized":"2023-05-10T01:43:38.618919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594098+0000","last_change":"2023-05-10T01:43:38.203904+0000","last_active":"2023-05-10T01:43:38.594098+0000","last_peered":"2023-05-10T01:43:38.594098+0000","last_clean":"2023-05-10T01:43:38.594098+0000","last_became_active":"2023-05-10T01:43:38.203317+0000","last_became_peered":"2023-05-10T01:43:38.203317+0000","last_unstale":"2023-05-10T01:43:38.594098+0000","last_undegraded":"2023-05-10T01:43:38.594098+0000","last_fullsized":"2023-05-10T01:43:38.594098+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621766+0000","last_change":"2023-05-10T01:43:38.613567+0000","last_active":"2023-05-10T01:43:38.621766+0000","last_peered":"2023-05-10T01:43:38.621766+0000","last_clean":"2023-05-10T01:43:38.621766+0000","last_became_active":"2023-05-10T01:43:38.613279+0000","last_became_peered":"2023-05-10T01:43:38.613279+0000","last_unstale":"2023-05-10T01:43:38.621766+0000","last_undegraded":"2023-05-10T01:43:38.621766+0000","last_fullsized":"2023-05-10T01:43:38.621766+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618143+0000","last_change":"2023-05-10T01:43:38.209491+0000","last_active":"2023-05-10T01:43:38.618143+0000","last_peered":"2023-05-10T01:43:38.618143+0000","last_clean":"2023-05-10T01:43:38.618143+0000","last_became_active":"2023-05-10T01:43:38.209198+0000","last_became_peered":"2023-05-10T01:43:38.209198+0000","last_unstale":"2023-05-10T01:43:38.618143+0000","last_undegraded":"2023-05-10T01:43:38.618143+0000","last_fullsized":"2023-05-10T01:43:38.618143+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585674+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:43:38.585674+0000","last_peered":"2023-05-10T01:43:38.585674+0000","last_clean":"2023-05-10T01:43:38.585674+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:43:38.585674+0000","last_undegraded":"2023-05-10T01:43:38.585674+0000","last_fullsized":"2023-05-10T01:43:38.585674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598522+0000","last_change":"2023-05-10T01:43:38.596721+0000","last_active":"2023-05-10T01:43:38.598522+0000","last_peered":"2023-05-10T01:43:38.598522+0000","last_clean":"2023-05-10T01:43:38.598522+0000","last_became_active":"2023-05-10T01:43:38.596437+0000","last_became_peered":"2023-05-10T01:43:38.596437+0000","last_unstale":"2023-05-10T01:43:38.598522+0000","last_undegraded":"2023-05-10T01:43:38.598522+0000","last_fullsized":"2023-05-10T01:43:38.598522+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605683+0000","last_change":"2023-05-10T01:43:38.200349+0000","last_active":"2023-05-10T01:43:38.605683+0000","last_peered":"2023-05-10T01:43:38.605683+0000","last_clean":"2023-05-10T01:43:38.605683+0000","last_became_active":"2023-05-10T01:43:38.200036+0000","last_became_peered":"2023-05-10T01:43:38.200036+0000","last_unstale":"2023-05-10T01:43:38.605683+0000","last_undegraded":"2023-05-10T01:43:38.605683+0000","last_fullsized":"2023-05-10T01:43:38.605683+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587235+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:43:38.587235+0000","last_peered":"2023-05-10T01:43:38.587235+0000","last_clean":"2023-05-10T01:43:38.587235+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:43:38.587235+0000","last_undegraded":"2023-05-10T01:43:38.587235+0000","last_fullsized":"2023-05-10T01:43:38.587235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601631+0000","last_change":"2023-05-10T01:43:38.594881+0000","last_active":"2023-05-10T01:43:38.601631+0000","last_peered":"2023-05-10T01:43:38.601631+0000","last_clean":"2023-05-10T01:43:38.601631+0000","last_became_active":"2023-05-10T01:43:38.594594+0000","last_became_peered":"2023-05-10T01:43:38.594594+0000","last_unstale":"2023-05-10T01:43:38.601631+0000","last_undegraded":"2023-05-10T01:43:38.601631+0000","last_fullsized":"2023-05-10T01:43:38.601631+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617106+0000","last_change":"2023-05-10T01:43:38.209295+0000","last_active":"2023-05-10T01:43:38.617106+0000","last_peered":"2023-05-10T01:43:38.617106+0000","last_clean":"2023-05-10T01:43:38.617106+0000","last_became_active":"2023-05-10T01:43:38.209018+0000","last_became_peered":"2023-05-10T01:43:38.209018+0000","last_unstale":"2023-05-10T01:43:38.617106+0000","last_undegraded":"2023-05-10T01:43:38.617106+0000","last_fullsized":"2023-05-10T01:43:38.617106+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589781+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:43:38.589781+0000","last_peered":"2023-05-10T01:43:38.589781+0000","last_clean":"2023-05-10T01:43:38.589781+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:43:38.589781+0000","last_undegraded":"2023-05-10T01:43:38.589781+0000","last_fullsized":"2023-05-10T01:43:38.589781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621805+0000","last_change":"2023-05-10T01:43:38.615930+0000","last_active":"2023-05-10T01:43:38.621805+0000","last_peered":"2023-05-10T01:43:38.621805+0000","last_clean":"2023-05-10T01:43:38.621805+0000","last_became_active":"2023-05-10T01:43:38.615584+0000","last_became_peered":"2023-05-10T01:43:38.615584+0000","last_unstale":"2023-05-10T01:43:38.621805+0000","last_undegraded":"2023-05-10T01:43:38.621805+0000","last_fullsized":"2023-05-10T01:43:38.621805+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594997+0000","last_change":"2023-05-10T01:43:38.206997+0000","last_active":"2023-05-10T01:43:38.594997+0000","last_peered":"2023-05-10T01:43:38.594997+0000","last_clean":"2023-05-10T01:43:38.594997+0000","last_became_active":"2023-05-10T01:43:38.206487+0000","last_became_peered":"2023-05-10T01:43:38.206487+0000","last_unstale":"2023-05-10T01:43:38.594997+0000","last_undegraded":"2023-05-10T01:43:38.594997+0000","last_fullsized":"2023-05-10T01:43:38.594997+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587892+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:43:38.587892+0000","last_peered":"2023-05-10T01:43:38.587892+0000","last_clean":"2023-05-10T01:43:38.587892+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:43:38.587892+0000","last_undegraded":"2023-05-10T01:43:38.587892+0000","last_fullsized":"2023-05-10T01:43:38.587892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":125,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594050+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:43:38.594050+0000","last_peered":"2023-05-10T01:43:38.594050+0000","last_clean":"2023-05-10T01:43:38.594050+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:43:38.594050+0000","last_undegraded":"2023-05-10T01:43:38.594050+0000","last_fullsized":"2023-05-10T01:43:38.594050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608436+0000","last_change":"2023-05-10T01:43:38.603372+0000","last_active":"2023-05-10T01:43:38.608436+0000","last_peered":"2023-05-10T01:43:38.608436+0000","last_clean":"2023-05-10T01:43:38.608436+0000","last_became_active":"2023-05-10T01:43:38.602302+0000","last_became_peered":"2023-05-10T01:43:38.602302+0000","last_unstale":"2023-05-10T01:43:38.608436+0000","last_undegraded":"2023-05-10T01:43:38.608436+0000","last_fullsized":"2023-05-10T01:43:38.608436+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600249+0000","last_change":"2023-05-10T01:43:38.204656+0000","last_active":"2023-05-10T01:43:38.600249+0000","last_peered":"2023-05-10T01:43:38.600249+0000","last_clean":"2023-05-10T01:43:38.600249+0000","last_became_active":"2023-05-10T01:43:38.204020+0000","last_became_peered":"2023-05-10T01:43:38.204020+0000","last_unstale":"2023-05-10T01:43:38.600249+0000","last_undegraded":"2023-05-10T01:43:38.600249+0000","last_fullsized":"2023-05-10T01:43:38.600249+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594211+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:43:38.594211+0000","last_peered":"2023-05-10T01:43:38.594211+0000","last_clean":"2023-05-10T01:43:38.594211+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:43:38.594211+0000","last_undegraded":"2023-05-10T01:43:38.594211+0000","last_fullsized":"2023-05-10T01:43:38.594211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617624+0000","last_change":"2023-05-10T01:43:38.606770+0000","last_active":"2023-05-10T01:43:38.617624+0000","last_peered":"2023-05-10T01:43:38.617624+0000","last_clean":"2023-05-10T01:43:38.617624+0000","last_became_active":"2023-05-10T01:43:38.606164+0000","last_became_peered":"2023-05-10T01:43:38.606164+0000","last_unstale":"2023-05-10T01:43:38.617624+0000","last_undegraded":"2023-05-10T01:43:38.617624+0000","last_fullsized":"2023-05-10T01:43:38.617624+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604044+0000","last_change":"2023-05-10T01:43:38.204630+0000","last_active":"2023-05-10T01:43:38.604044+0000","last_peered":"2023-05-10T01:43:38.604044+0000","last_clean":"2023-05-10T01:43:38.604044+0000","last_became_active":"2023-05-10T01:43:38.203893+0000","last_became_peered":"2023-05-10T01:43:38.203893+0000","last_unstale":"2023-05-10T01:43:38.604044+0000","last_undegraded":"2023-05-10T01:43:38.604044+0000","last_fullsized":"2023-05-10T01:43:38.604044+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594998+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:43:38.594998+0000","last_peered":"2023-05-10T01:43:38.594998+0000","last_clean":"2023-05-10T01:43:38.594998+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:43:38.594998+0000","last_undegraded":"2023-05-10T01:43:38.594998+0000","last_fullsized":"2023-05-10T01:43:38.594998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606480+0000","last_change":"2023-05-10T01:43:38.605222+0000","last_active":"2023-05-10T01:43:38.606480+0000","last_peered":"2023-05-10T01:43:38.606480+0000","last_clean":"2023-05-10T01:43:38.606480+0000","last_became_active":"2023-05-10T01:43:38.604885+0000","last_became_peered":"2023-05-10T01:43:38.604885+0000","last_unstale":"2023-05-10T01:43:38.606480+0000","last_undegraded":"2023-05-10T01:43:38.606480+0000","last_fullsized":"2023-05-10T01:43:38.606480+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588564+0000","last_change":"2023-05-10T01:43:38.206412+0000","last_active":"2023-05-10T01:43:38.588564+0000","last_peered":"2023-05-10T01:43:38.588564+0000","last_clean":"2023-05-10T01:43:38.588564+0000","last_became_active":"2023-05-10T01:43:38.206103+0000","last_became_peered":"2023-05-10T01:43:38.206103+0000","last_unstale":"2023-05-10T01:43:38.588564+0000","last_undegraded":"2023-05-10T01:43:38.588564+0000","last_fullsized":"2023-05-10T01:43:38.588564+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585722+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:43:38.585722+0000","last_peered":"2023-05-10T01:43:38.585722+0000","last_clean":"2023-05-10T01:43:38.585722+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:43:38.585722+0000","last_undegraded":"2023-05-10T01:43:38.585722+0000","last_fullsized":"2023-05-10T01:43:38.585722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.597833+0000","last_change":"2023-05-10T01:43:38.592288+0000","last_active":"2023-05-10T01:43:38.597833+0000","last_peered":"2023-05-10T01:43:38.597833+0000","last_clean":"2023-05-10T01:43:38.597833+0000","last_became_active":"2023-05-10T01:43:38.592085+0000","last_became_peered":"2023-05-10T01:43:38.592085+0000","last_unstale":"2023-05-10T01:43:38.597833+0000","last_undegraded":"2023-05-10T01:43:38.597833+0000","last_fullsized":"2023-05-10T01:43:38.597833+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588988+0000","last_change":"2023-05-10T01:43:38.199743+0000","last_active":"2023-05-10T01:43:38.588988+0000","last_peered":"2023-05-10T01:43:38.588988+0000","last_clean":"2023-05-10T01:43:38.588988+0000","last_became_active":"2023-05-10T01:43:38.199400+0000","last_became_peered":"2023-05-10T01:43:38.199400+0000","last_unstale":"2023-05-10T01:43:38.588988+0000","last_undegraded":"2023-05-10T01:43:38.588988+0000","last_fullsized":"2023-05-10T01:43:38.588988+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601601+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:43:38.601601+0000","last_peered":"2023-05-10T01:43:38.601601+0000","last_clean":"2023-05-10T01:43:38.601601+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:43:38.601601+0000","last_undegraded":"2023-05-10T01:43:38.601601+0000","last_fullsized":"2023-05-10T01:43:38.601601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575248,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20348,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351492,"statfs":{"total":96636764160,"available":96615927808,"internally_reserved":0,"allocated":1953792,"data_stored":1001321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74199999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.81999999999999995,"15min":0.82699999999999996},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":1.127,"15min":1.127},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.43099999999999999,"15min":0.40799999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.50600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.024,"15min":1.024},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":1.006,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.27900000000000003},"max":{"1min":0.58899999999999997,"5min":1.155,"15min":1.155},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.36699999999999999},"max":{"1min":0.67100000000000004,"5min":1.167,"15min":1.167},"last":0.629}]},{"osd":5,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.56999999999999995,"5min":1.597,"15min":1.597},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.65500000000000003,"5min":1.292,"15min":1.292},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":1.248,"15min":1.248},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575247,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19820,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352020,"statfs":{"total":96636764160,"available":96616468480,"internally_reserved":0,"allocated":1937408,"data_stored":994573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.26600000000000001},"max":{"1min":0.76100000000000001,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39600000000000002,"15min":0.32800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":1.284},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.84799999999999998,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.83299999999999996,"15min":1.2350000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":1.3360000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":1.3620000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":1.3120000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.2729999999999999},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575247,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23664,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94348176,"statfs":{"total":96636764160,"available":96612532224,"internally_reserved":0,"allocated":1941504,"data_stored":1000587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61799999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.377},{"interface":"front","average":{"1min":0.434,"5min":0.44,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59999999999999998,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90000000000000002,"5min":1.1200000000000001,"15min":1.357},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.171,"15min":1.226},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94899999999999995,"15min":1.3380000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.008,"15min":1.008},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.92200000000000004,"5min":1.1830000000000001,"15min":1.403},"last":0.65600000000000003}]},{"osd":7,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0289999999999999,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.47199999999999998,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575247,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24252,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":22336,"kb_avail":94347588,"statfs":{"total":96636764160,"available":96611930112,"internally_reserved":0,"allocated":1953792,"data_stored":1000713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22872064},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42899999999999999,"15min":0.42499999999999999},"min":{"1min":0.30399999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.75,"15min":0.75},"last":0.373}]},{"osd":2,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.60699999999999998,"5min":0.64900000000000002,"15min":0.70599999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.32800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61799999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.52700000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64600000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42799999999999999},"max":{"1min":0.80200000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66400000000000003,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.41399999999999998},"max":{"1min":0.876,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.77500000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82699999999999996,"5min":1.0349999999999999,"15min":1.0589999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.45300000000000001},"max":{"1min":0.85599999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.432},"max":{"1min":0.81200000000000006,"5min":1.165,"15min":1.165},"last":0.72899999999999998}]},{"osd":7,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.84699999999999998,"5min":1.117,"15min":1.117},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.83099999999999996,"5min":1.141,"15min":1.141},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575247,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25336,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":23424,"kb_avail":94346504,"statfs":{"total":96636764160,"available":96610820096,"internally_reserved":0,"allocated":1949696,"data_stored":1001175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23986176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41399999999999998,"15min":0.42299999999999999},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.747},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.311},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.52500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94999999999999996,"5min":1.0660000000000001,"15min":1.085},"last":4.0129999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.68700000000000006},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.028},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.133},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71599999999999997,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":0.97199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92100000000000004,"5min":0.98599999999999999,"15min":1.026},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575247,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1949696,"data_stored":1001231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.441,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.26500000000000001},"max":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.68600000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.73999999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.439},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.28899999999999998},"max":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.75900000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.65100000000000002},"min":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.40699999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.62}]},{"osd":5,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":0.97099999999999997,"15min":1.05},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.008},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.52900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.048},"last":0.75}]},{"osd":7,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95199999999999996,"15min":1.0429999999999999},"last":0.82599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575247,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20088,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":18176,"kb_avail":94351752,"statfs":{"total":96636764160,"available":96616194048,"internally_reserved":0,"allocated":1949696,"data_stored":1001211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18612224},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":1.468,"15min":1.468},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.307},"max":{"1min":0.754,"5min":1.214,"15min":1.431},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.88,"15min":1.044},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":1.4910000000000001,"15min":1.51},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.82799999999999996,"5min":0.89400000000000002,"15min":1.494},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84999999999999998,"5min":1.4410000000000001,"15min":1.462},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40500000000000003},"max":{"1min":0.78800000000000003,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.434,"15min":0.41299999999999998},"max":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.1020000000000001},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46899999999999997,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.413,"15min":1.413},"last":0.313},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.34699999999999998}]},{"osd":6,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.48799999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.82799999999999996},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":1.266,"15min":1.266},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575249,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23096,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":21184,"kb_avail":94348744,"statfs":{"total":96636764160,"available":96613113856,"internally_reserved":0,"allocated":1949696,"data_stored":1001501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21692416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":1.21},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.76400000000000001,"15min":0.79500000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":1.375},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.42799999999999999,"15min":0.35199999999999998},"max":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":1.1850000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.78700000000000003,"5min":0.80400000000000005,"15min":1.194},"last":0.505},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":1.2849999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.3360000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70199999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.48699999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.503},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:43:42.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:43:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.955+0000 7f6775161700 1 Processor -- start 2023-05-10T01:43:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.955+0000 7f6775161700 1 -- start start 2023-05-10T01:43:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6775161700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6770154e40 0x7f67700acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6775161700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 0x7f677014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6775161700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6770158960 con 0x7f67700c7370 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6775161700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67701552f0 con 0x7f6770154e40 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6775161700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6770157d50 con 0x7f67700ad030 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6770154e40 0x7f67700acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f676ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f67700c7370 0x7f67700c7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50210/0 (socket says 172.21.15.52:50210) 2023-05-10T01:43:42.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6770154e40 0x7f67700acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41196/0 (socket says 172.21.15.52:41196) 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f676ffff700 1 -- 172.21.15.52:0/308178458 learned_addr learned my addr 172.21.15.52:0/308178458 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 -- 172.21.15.52:0/308178458 >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 msgr2=0x7f677014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6774960700 1 --2- 172.21.15.52:0/308178458 >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 0x7f677014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f676f7fe700 1 -- 172.21.15.52:0/308178458 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273211945 0 0) 0x7f6770158960 con 0x7f67700c7370 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 --2- 172.21.15.52:0/308178458 >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 0x7f677014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 -- 172.21.15.52:0/308178458 >> v1:172.21.15.52:6789/0 conn(0x7f67700c7370 legacy=0x7f67700c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6767fff700 1 -- 172.21.15.52:0/308178458 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770158030 con 0x7f6770154e40 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.956+0000 7f6774960700 1 --2- 172.21.15.52:0/308178458 >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 0x7f677014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6767fff700 1 --2- 172.21.15.52:0/308178458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700acb40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f677005ee90 tx=0x7f6758009060).ready entity=mon.0 client_cookie=c2658c8b28491912 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f676f7fe700 1 -- 172.21.15.52:0/308178458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800b580 con 0x7f6770154e40 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f676f7fe700 1 -- 172.21.15.52:0/308178458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675800b6e0 con 0x7f6770154e40 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f676f7fe700 1 -- 172.21.15.52:0/308178458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800ba60 con 0x7f6770154e40 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 -- 172.21.15.52:0/308178458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 msgr2=0x7f67700acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 --2- 172.21.15.52:0/308178458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700acb40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f677005ee90 tx=0x7f6758009060).stop 2023-05-10T01:43:42.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 -- 172.21.15.52:0/308178458 shutdown_connections 2023-05-10T01:43:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 --2- 172.21.15.52:0/308178458 >> v2:172.21.15.172:3300/0 conn(0x7f67700ad030 0x7f677014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 --2- 172.21.15.52:0/308178458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700acb40 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 -- 172.21.15.52:0/308178458 >> 172.21.15.52:0/308178458 conn(0x7f6770068320 msgr2=0x7f6770068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 -- 172.21.15.52:0/308178458 shutdown_connections 2023-05-10T01:43:42.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.957+0000 7f6775161700 1 -- 172.21.15.52:0/308178458 wait complete. 2023-05-10T01:43:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.958+0000 7f6775161700 1 Processor -- start 2023-05-10T01:43:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.958+0000 7f6775161700 1 -- start start 2023-05-10T01:43:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67700ad030 0x7f67700adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 0x7f677014e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770168500 con 0x7f6770154e40 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67700ae120 con 0x7f67700c7370 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6775161700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67701678f0 con 0x7f67700ad030 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6774960700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6774960700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41204/0 (socket says 172.21.15.52:41204) 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.959+0000 7f6774960700 1 -- 172.21.15.52:0/1586990355 learned_addr learned my addr 172.21.15.52:0/1586990355 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 -- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67700ad030 msgr2=0x7f67700adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67700ad030 0x7f67700adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6767fff700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 0x7f677014e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 -- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 msgr2=0x7f677014e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 0x7f677014e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 -- 172.21.15.52:0/1586990355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580092a0 con 0x7f6770154e40 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6767fff700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 0x7f677014e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6774960700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f676800a380 tx=0x7f6768007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800ae10 con 0x7f6770154e40 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800d650 con 0x7f6770154e40 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6770167bd0 con 0x7f6770154e40 2023-05-10T01:43:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800d9d0 con 0x7f6770154e40 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.960+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6770168190 con 0x7f6770154e40 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.961+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6770047150 con 0x7f6770154e40 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.961+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f676801d060 con 0x7f6770154e40 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.962+0000 7f676cff9700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 0x7f67540612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.962+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f676807a5b0 con 0x7f6770154e40 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.962+0000 7f676ffff700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 0x7f67540612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.962+0000 7f676ffff700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 0x7f67540612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f67600011e0 tx=0x7f6760007850).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:42.966+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f676804ba10 con 0x7f6770154e40 2023-05-10T01:43:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.134+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67700ace10 con 0x7f675405ee20 2023-05-10T01:43:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.144+0000 7f676cff9700 1 -- 172.21.15.52:0/1586990355 <== mgr.7792 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361991 (secure 0 0 0) 0x7f67700ace10 con 0x7f675405ee20 2023-05-10T01:43:43.152 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:43.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 msgr2=0x7f67540612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 0x7f67540612e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f67600011e0 tx=0x7f6760007850).stop 2023-05-10T01:43:43.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 msgr2=0x7f67700c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f676800a380 tx=0x7f6768007900).stop 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 shutdown_connections 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f675405ee20 0x7f67540612e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6770154e40 0x7f67700c9f00 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67700ad030 0x7f67700adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 --2- 172.21.15.52:0/1586990355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67700c7370 0x7f677014e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 >> 172.21.15.52:0/1586990355 conn(0x7f6770068320 msgr2=0x7f6770152010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:43.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 shutdown_connections 2023-05-10T01:43:43.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.148+0000 7f6775161700 1 -- 172.21.15.52:0/1586990355 wait complete. 2023-05-10T01:43:43.156 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:43:43.163 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-10T01:43:42.896734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":188788,"kb_used_data":15220,"kb_used_omap":0,"kb_used_meta":173504,"kb_avail":754785932,"statfs":{"total":773094113280,"available":772900794368,"internally_reserved":0,"allocated":15585280,"data_stored":8002312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":177668096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-594749,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.182193"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618872+0000","last_change":"2023-05-10T01:43:38.612459+0000","last_active":"2023-05-10T01:43:38.618872+0000","last_peered":"2023-05-10T01:43:38.618872+0000","last_clean":"2023-05-10T01:43:38.618872+0000","last_became_active":"2023-05-10T01:43:38.611604+0000","last_became_peered":"2023-05-10T01:43:38.611604+0000","last_unstale":"2023-05-10T01:43:38.618872+0000","last_undegraded":"2023-05-10T01:43:38.618872+0000","last_fullsized":"2023-05-10T01:43:38.618872+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.613008+0000","last_change":"2023-05-10T01:43:38.205731+0000","last_active":"2023-05-10T01:43:38.613008+0000","last_peered":"2023-05-10T01:43:38.613008+0000","last_clean":"2023-05-10T01:43:38.613008+0000","last_became_active":"2023-05-10T01:43:38.205428+0000","last_became_peered":"2023-05-10T01:43:38.205428+0000","last_unstale":"2023-05-10T01:43:38.613008+0000","last_undegraded":"2023-05-10T01:43:38.613008+0000","last_fullsized":"2023-05-10T01:43:38.613008+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608595+0000","last_change":"2023-05-10T01:43:38.604400+0000","last_active":"2023-05-10T01:43:38.608595+0000","last_peered":"2023-05-10T01:43:38.608595+0000","last_clean":"2023-05-10T01:43:38.608595+0000","last_became_active":"2023-05-10T01:43:38.604114+0000","last_became_peered":"2023-05-10T01:43:38.604114+0000","last_unstale":"2023-05-10T01:43:38.608595+0000","last_undegraded":"2023-05-10T01:43:38.608595+0000","last_fullsized":"2023-05-10T01:43:38.608595+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585560+0000","last_change":"2023-05-10T01:43:38.207348+0000","last_active":"2023-05-10T01:43:38.585560+0000","last_peered":"2023-05-10T01:43:38.585560+0000","last_clean":"2023-05-10T01:43:38.585560+0000","last_became_active":"2023-05-10T01:43:38.206882+0000","last_became_peered":"2023-05-10T01:43:38.206882+0000","last_unstale":"2023-05-10T01:43:38.585560+0000","last_undegraded":"2023-05-10T01:43:38.585560+0000","last_fullsized":"2023-05-10T01:43:38.585560+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618954+0000","last_change":"2023-05-10T01:43:38.618419+0000","last_active":"2023-05-10T01:43:38.618954+0000","last_peered":"2023-05-10T01:43:38.618954+0000","last_clean":"2023-05-10T01:43:38.618954+0000","last_became_active":"2023-05-10T01:43:38.618165+0000","last_became_peered":"2023-05-10T01:43:38.618165+0000","last_unstale":"2023-05-10T01:43:38.618954+0000","last_undegraded":"2023-05-10T01:43:38.618954+0000","last_fullsized":"2023-05-10T01:43:38.618954+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604636+0000","last_change":"2023-05-10T01:43:38.202221+0000","last_active":"2023-05-10T01:43:38.604636+0000","last_peered":"2023-05-10T01:43:38.604636+0000","last_clean":"2023-05-10T01:43:38.604636+0000","last_became_active":"2023-05-10T01:43:38.201948+0000","last_became_peered":"2023-05-10T01:43:38.201948+0000","last_unstale":"2023-05-10T01:43:38.604636+0000","last_undegraded":"2023-05-10T01:43:38.604636+0000","last_fullsized":"2023-05-10T01:43:38.604636+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618017+0000","last_change":"2023-05-10T01:43:38.616800+0000","last_active":"2023-05-10T01:43:38.618017+0000","last_peered":"2023-05-10T01:43:38.618017+0000","last_clean":"2023-05-10T01:43:38.618017+0000","last_became_active":"2023-05-10T01:43:38.616451+0000","last_became_peered":"2023-05-10T01:43:38.616451+0000","last_unstale":"2023-05-10T01:43:38.618017+0000","last_undegraded":"2023-05-10T01:43:38.618017+0000","last_fullsized":"2023-05-10T01:43:38.618017+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604987+0000","last_change":"2023-05-10T01:43:38.196374+0000","last_active":"2023-05-10T01:43:38.604987+0000","last_peered":"2023-05-10T01:43:38.604987+0000","last_clean":"2023-05-10T01:43:38.604987+0000","last_became_active":"2023-05-10T01:43:38.196080+0000","last_became_peered":"2023-05-10T01:43:38.196080+0000","last_unstale":"2023-05-10T01:43:38.604987+0000","last_undegraded":"2023-05-10T01:43:38.604987+0000","last_fullsized":"2023-05-10T01:43:38.604987+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600692+0000","last_change":"2023-05-10T01:43:38.594463+0000","last_active":"2023-05-10T01:43:38.600692+0000","last_peered":"2023-05-10T01:43:38.600692+0000","last_clean":"2023-05-10T01:43:38.600692+0000","last_became_active":"2023-05-10T01:43:38.594150+0000","last_became_peered":"2023-05-10T01:43:38.594150+0000","last_unstale":"2023-05-10T01:43:38.600692+0000","last_undegraded":"2023-05-10T01:43:38.600692+0000","last_fullsized":"2023-05-10T01:43:38.600692+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603841+0000","last_change":"2023-05-10T01:43:38.204054+0000","last_active":"2023-05-10T01:43:38.603841+0000","last_peered":"2023-05-10T01:43:38.603841+0000","last_clean":"2023-05-10T01:43:38.603841+0000","last_became_active":"2023-05-10T01:43:38.203519+0000","last_became_peered":"2023-05-10T01:43:38.203519+0000","last_unstale":"2023-05-10T01:43:38.603841+0000","last_undegraded":"2023-05-10T01:43:38.603841+0000","last_fullsized":"2023-05-10T01:43:38.603841+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621828+0000","last_change":"2023-05-10T01:43:38.616103+0000","last_active":"2023-05-10T01:43:38.621828+0000","last_peered":"2023-05-10T01:43:38.621828+0000","last_clean":"2023-05-10T01:43:38.621828+0000","last_became_active":"2023-05-10T01:43:38.615248+0000","last_became_peered":"2023-05-10T01:43:38.615248+0000","last_unstale":"2023-05-10T01:43:38.621828+0000","last_undegraded":"2023-05-10T01:43:38.621828+0000","last_fullsized":"2023-05-10T01:43:38.621828+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.613270+0000","last_change":"2023-05-10T01:43:38.200008+0000","last_active":"2023-05-10T01:43:38.613270+0000","last_peered":"2023-05-10T01:43:38.613270+0000","last_clean":"2023-05-10T01:43:38.613270+0000","last_became_active":"2023-05-10T01:43:38.199703+0000","last_became_peered":"2023-05-10T01:43:38.199703+0000","last_unstale":"2023-05-10T01:43:38.613270+0000","last_undegraded":"2023-05-10T01:43:38.613270+0000","last_fullsized":"2023-05-10T01:43:38.613270+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615085+0000","last_change":"2023-05-10T01:43:38.612216+0000","last_active":"2023-05-10T01:43:38.615085+0000","last_peered":"2023-05-10T01:43:38.615085+0000","last_clean":"2023-05-10T01:43:38.615085+0000","last_became_active":"2023-05-10T01:43:38.611844+0000","last_became_peered":"2023-05-10T01:43:38.611844+0000","last_unstale":"2023-05-10T01:43:38.615085+0000","last_undegraded":"2023-05-10T01:43:38.615085+0000","last_fullsized":"2023-05-10T01:43:38.615085+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.607092+0000","last_change":"2023-05-10T01:43:38.198633+0000","last_active":"2023-05-10T01:43:38.607092+0000","last_peered":"2023-05-10T01:43:38.607092+0000","last_clean":"2023-05-10T01:43:38.607092+0000","last_became_active":"2023-05-10T01:43:38.198357+0000","last_became_peered":"2023-05-10T01:43:38.198357+0000","last_unstale":"2023-05-10T01:43:38.607092+0000","last_undegraded":"2023-05-10T01:43:38.607092+0000","last_fullsized":"2023-05-10T01:43:38.607092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604825+0000","last_change":"2023-05-10T01:43:38.599160+0000","last_active":"2023-05-10T01:43:38.604825+0000","last_peered":"2023-05-10T01:43:38.604825+0000","last_clean":"2023-05-10T01:43:38.604825+0000","last_became_active":"2023-05-10T01:43:38.594365+0000","last_became_peered":"2023-05-10T01:43:38.594365+0000","last_unstale":"2023-05-10T01:43:38.604825+0000","last_undegraded":"2023-05-10T01:43:38.604825+0000","last_fullsized":"2023-05-10T01:43:38.604825+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598369+0000","last_change":"2023-05-10T01:43:38.209073+0000","last_active":"2023-05-10T01:43:38.598369+0000","last_peered":"2023-05-10T01:43:38.598369+0000","last_clean":"2023-05-10T01:43:38.598369+0000","last_became_active":"2023-05-10T01:43:38.208642+0000","last_became_peered":"2023-05-10T01:43:38.208642+0000","last_unstale":"2023-05-10T01:43:38.598369+0000","last_undegraded":"2023-05-10T01:43:38.598369+0000","last_fullsized":"2023-05-10T01:43:38.598369+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604877+0000","last_change":"2023-05-10T01:43:38.595629+0000","last_active":"2023-05-10T01:43:38.604877+0000","last_peered":"2023-05-10T01:43:38.604877+0000","last_clean":"2023-05-10T01:43:38.604877+0000","last_became_active":"2023-05-10T01:43:38.595366+0000","last_became_peered":"2023-05-10T01:43:38.595366+0000","last_unstale":"2023-05-10T01:43:38.604877+0000","last_undegraded":"2023-05-10T01:43:38.604877+0000","last_fullsized":"2023-05-10T01:43:38.604877+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601483+0000","last_change":"2023-05-10T01:43:38.203611+0000","last_active":"2023-05-10T01:43:38.601483+0000","last_peered":"2023-05-10T01:43:38.601483+0000","last_clean":"2023-05-10T01:43:38.601483+0000","last_became_active":"2023-05-10T01:43:38.203301+0000","last_became_peered":"2023-05-10T01:43:38.203301+0000","last_unstale":"2023-05-10T01:43:38.601483+0000","last_undegraded":"2023-05-10T01:43:38.601483+0000","last_fullsized":"2023-05-10T01:43:38.601483+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606454+0000","last_change":"2023-05-10T01:43:38.604627+0000","last_active":"2023-05-10T01:43:38.606454+0000","last_peered":"2023-05-10T01:43:38.606454+0000","last_clean":"2023-05-10T01:43:38.606454+0000","last_became_active":"2023-05-10T01:43:38.604096+0000","last_became_peered":"2023-05-10T01:43:38.604096+0000","last_unstale":"2023-05-10T01:43:38.606454+0000","last_undegraded":"2023-05-10T01:43:38.606454+0000","last_fullsized":"2023-05-10T01:43:38.606454+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585637+0000","last_change":"2023-05-10T01:43:38.207172+0000","last_active":"2023-05-10T01:43:38.585637+0000","last_peered":"2023-05-10T01:43:38.585637+0000","last_clean":"2023-05-10T01:43:38.585637+0000","last_became_active":"2023-05-10T01:43:38.206111+0000","last_became_peered":"2023-05-10T01:43:38.206111+0000","last_unstale":"2023-05-10T01:43:38.585637+0000","last_undegraded":"2023-05-10T01:43:38.585637+0000","last_fullsized":"2023-05-10T01:43:38.585637+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605154+0000","last_change":"2023-05-10T01:43:38.603235+0000","last_active":"2023-05-10T01:43:38.605154+0000","last_peered":"2023-05-10T01:43:38.605154+0000","last_clean":"2023-05-10T01:43:38.605154+0000","last_became_active":"2023-05-10T01:43:38.602989+0000","last_became_peered":"2023-05-10T01:43:38.602989+0000","last_unstale":"2023-05-10T01:43:38.605154+0000","last_undegraded":"2023-05-10T01:43:38.605154+0000","last_fullsized":"2023-05-10T01:43:38.605154+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588609+0000","last_change":"2023-05-10T01:43:38.209540+0000","last_active":"2023-05-10T01:43:38.588609+0000","last_peered":"2023-05-10T01:43:38.588609+0000","last_clean":"2023-05-10T01:43:38.588609+0000","last_became_active":"2023-05-10T01:43:38.209243+0000","last_became_peered":"2023-05-10T01:43:38.209243+0000","last_unstale":"2023-05-10T01:43:38.588609+0000","last_undegraded":"2023-05-10T01:43:38.588609+0000","last_fullsized":"2023-05-10T01:43:38.588609+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618645+0000","last_change":"2023-05-10T01:43:38.617905+0000","last_active":"2023-05-10T01:43:38.618645+0000","last_peered":"2023-05-10T01:43:38.618645+0000","last_clean":"2023-05-10T01:43:38.618645+0000","last_became_active":"2023-05-10T01:43:38.617678+0000","last_became_peered":"2023-05-10T01:43:38.617678+0000","last_unstale":"2023-05-10T01:43:38.618645+0000","last_undegraded":"2023-05-10T01:43:38.618645+0000","last_fullsized":"2023-05-10T01:43:38.618645+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619448+0000","last_change":"2023-05-10T01:43:38.203681+0000","last_active":"2023-05-10T01:43:38.619448+0000","last_peered":"2023-05-10T01:43:38.619448+0000","last_clean":"2023-05-10T01:43:38.619448+0000","last_became_active":"2023-05-10T01:43:38.203352+0000","last_became_peered":"2023-05-10T01:43:38.203352+0000","last_unstale":"2023-05-10T01:43:38.619448+0000","last_undegraded":"2023-05-10T01:43:38.619448+0000","last_fullsized":"2023-05-10T01:43:38.619448+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604904+0000","last_change":"2023-05-10T01:43:38.602490+0000","last_active":"2023-05-10T01:43:38.604904+0000","last_peered":"2023-05-10T01:43:38.604904+0000","last_clean":"2023-05-10T01:43:38.604904+0000","last_became_active":"2023-05-10T01:43:38.599833+0000","last_became_peered":"2023-05-10T01:43:38.599833+0000","last_unstale":"2023-05-10T01:43:38.604904+0000","last_undegraded":"2023-05-10T01:43:38.604904+0000","last_fullsized":"2023-05-10T01:43:38.604904+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616301+0000","last_change":"2023-05-10T01:43:38.206664+0000","last_active":"2023-05-10T01:43:38.616301+0000","last_peered":"2023-05-10T01:43:38.616301+0000","last_clean":"2023-05-10T01:43:38.616301+0000","last_became_active":"2023-05-10T01:43:38.206373+0000","last_became_peered":"2023-05-10T01:43:38.206373+0000","last_unstale":"2023-05-10T01:43:38.616301+0000","last_undegraded":"2023-05-10T01:43:38.616301+0000","last_fullsized":"2023-05-10T01:43:38.616301+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621775+0000","last_change":"2023-05-10T01:43:38.616489+0000","last_active":"2023-05-10T01:43:38.621775+0000","last_peered":"2023-05-10T01:43:38.621775+0000","last_clean":"2023-05-10T01:43:38.621775+0000","last_became_active":"2023-05-10T01:43:38.616207+0000","last_became_peered":"2023-05-10T01:43:38.616207+0000","last_unstale":"2023-05-10T01:43:38.621775+0000","last_undegraded":"2023-05-10T01:43:38.621775+0000","last_fullsized":"2023-05-10T01:43:38.621775+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.586257+0000","last_change":"2023-05-10T01:43:38.206885+0000","last_active":"2023-05-10T01:43:38.586257+0000","last_peered":"2023-05-10T01:43:38.586257+0000","last_clean":"2023-05-10T01:43:38.586257+0000","last_became_active":"2023-05-10T01:43:38.206566+0000","last_became_peered":"2023-05-10T01:43:38.206566+0000","last_unstale":"2023-05-10T01:43:38.586257+0000","last_undegraded":"2023-05-10T01:43:38.586257+0000","last_fullsized":"2023-05-10T01:43:38.586257+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612693+0000","last_change":"2023-05-10T01:43:38.611899+0000","last_active":"2023-05-10T01:43:38.612693+0000","last_peered":"2023-05-10T01:43:38.612693+0000","last_clean":"2023-05-10T01:43:38.612693+0000","last_became_active":"2023-05-10T01:43:38.611587+0000","last_became_peered":"2023-05-10T01:43:38.611587+0000","last_unstale":"2023-05-10T01:43:38.612693+0000","last_undegraded":"2023-05-10T01:43:38.612693+0000","last_fullsized":"2023-05-10T01:43:38.612693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589721+0000","last_change":"2023-05-10T01:43:38.211165+0000","last_active":"2023-05-10T01:43:38.589721+0000","last_peered":"2023-05-10T01:43:38.589721+0000","last_clean":"2023-05-10T01:43:38.589721+0000","last_became_active":"2023-05-10T01:43:38.210853+0000","last_became_peered":"2023-05-10T01:43:38.210853+0000","last_unstale":"2023-05-10T01:43:38.589721+0000","last_undegraded":"2023-05-10T01:43:38.589721+0000","last_fullsized":"2023-05-10T01:43:38.589721+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605094+0000","last_change":"2023-05-10T01:43:38.598843+0000","last_active":"2023-05-10T01:43:38.605094+0000","last_peered":"2023-05-10T01:43:38.605094+0000","last_clean":"2023-05-10T01:43:38.605094+0000","last_became_active":"2023-05-10T01:43:38.598573+0000","last_became_peered":"2023-05-10T01:43:38.598573+0000","last_unstale":"2023-05-10T01:43:38.605094+0000","last_undegraded":"2023-05-10T01:43:38.605094+0000","last_fullsized":"2023-05-10T01:43:38.605094+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606075+0000","last_change":"2023-05-10T01:43:38.200935+0000","last_active":"2023-05-10T01:43:38.606075+0000","last_peered":"2023-05-10T01:43:38.606075+0000","last_clean":"2023-05-10T01:43:38.606075+0000","last_became_active":"2023-05-10T01:43:38.200634+0000","last_became_peered":"2023-05-10T01:43:38.200634+0000","last_unstale":"2023-05-10T01:43:38.606075+0000","last_undegraded":"2023-05-10T01:43:38.606075+0000","last_fullsized":"2023-05-10T01:43:38.606075+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604909+0000","last_change":"2023-05-10T01:43:38.596446+0000","last_active":"2023-05-10T01:43:38.604909+0000","last_peered":"2023-05-10T01:43:38.604909+0000","last_clean":"2023-05-10T01:43:38.604909+0000","last_became_active":"2023-05-10T01:43:38.596152+0000","last_became_peered":"2023-05-10T01:43:38.596152+0000","last_unstale":"2023-05-10T01:43:38.604909+0000","last_undegraded":"2023-05-10T01:43:38.604909+0000","last_fullsized":"2023-05-10T01:43:38.604909+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608612+0000","last_change":"2023-05-10T01:43:38.202139+0000","last_active":"2023-05-10T01:43:38.608612+0000","last_peered":"2023-05-10T01:43:38.608612+0000","last_clean":"2023-05-10T01:43:38.608612+0000","last_became_active":"2023-05-10T01:43:38.199782+0000","last_became_peered":"2023-05-10T01:43:38.199782+0000","last_unstale":"2023-05-10T01:43:38.608612+0000","last_undegraded":"2023-05-10T01:43:38.608612+0000","last_fullsized":"2023-05-10T01:43:38.608612+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600928+0000","last_change":"2023-05-10T01:43:38.597429+0000","last_active":"2023-05-10T01:43:38.600928+0000","last_peered":"2023-05-10T01:43:38.600928+0000","last_clean":"2023-05-10T01:43:38.600928+0000","last_became_active":"2023-05-10T01:43:38.597164+0000","last_became_peered":"2023-05-10T01:43:38.597164+0000","last_unstale":"2023-05-10T01:43:38.600928+0000","last_undegraded":"2023-05-10T01:43:38.600928+0000","last_fullsized":"2023-05-10T01:43:38.600928+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594163+0000","last_change":"2023-05-10T01:43:38.203673+0000","last_active":"2023-05-10T01:43:38.594163+0000","last_peered":"2023-05-10T01:43:38.594163+0000","last_clean":"2023-05-10T01:43:38.594163+0000","last_became_active":"2023-05-10T01:43:38.203361+0000","last_became_peered":"2023-05-10T01:43:38.203361+0000","last_unstale":"2023-05-10T01:43:38.594163+0000","last_undegraded":"2023-05-10T01:43:38.594163+0000","last_fullsized":"2023-05-10T01:43:38.594163+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606409+0000","last_change":"2023-05-10T01:43:38.604994+0000","last_active":"2023-05-10T01:43:38.606409+0000","last_peered":"2023-05-10T01:43:38.606409+0000","last_clean":"2023-05-10T01:43:38.606409+0000","last_became_active":"2023-05-10T01:43:38.604575+0000","last_became_peered":"2023-05-10T01:43:38.604575+0000","last_unstale":"2023-05-10T01:43:38.606409+0000","last_undegraded":"2023-05-10T01:43:38.606409+0000","last_fullsized":"2023-05-10T01:43:38.606409+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615618+0000","last_change":"2023-05-10T01:43:38.203461+0000","last_active":"2023-05-10T01:43:38.615618+0000","last_peered":"2023-05-10T01:43:38.615618+0000","last_clean":"2023-05-10T01:43:38.615618+0000","last_became_active":"2023-05-10T01:43:38.203147+0000","last_became_peered":"2023-05-10T01:43:38.203147+0000","last_unstale":"2023-05-10T01:43:38.615618+0000","last_undegraded":"2023-05-10T01:43:38.615618+0000","last_fullsized":"2023-05-10T01:43:38.615618+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.602292+0000","last_change":"2023-05-10T01:43:38.593618+0000","last_active":"2023-05-10T01:43:38.602292+0000","last_peered":"2023-05-10T01:43:38.602292+0000","last_clean":"2023-05-10T01:43:38.602292+0000","last_became_active":"2023-05-10T01:43:38.593325+0000","last_became_peered":"2023-05-10T01:43:38.593325+0000","last_unstale":"2023-05-10T01:43:38.602292+0000","last_undegraded":"2023-05-10T01:43:38.602292+0000","last_fullsized":"2023-05-10T01:43:38.602292+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594148+0000","last_change":"2023-05-10T01:43:38.209184+0000","last_active":"2023-05-10T01:43:38.594148+0000","last_peered":"2023-05-10T01:43:38.594148+0000","last_clean":"2023-05-10T01:43:38.594148+0000","last_became_active":"2023-05-10T01:43:38.208349+0000","last_became_peered":"2023-05-10T01:43:38.208349+0000","last_unstale":"2023-05-10T01:43:38.594148+0000","last_undegraded":"2023-05-10T01:43:38.594148+0000","last_fullsized":"2023-05-10T01:43:38.594148+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601574+0000","last_change":"2023-05-10T01:43:38.597492+0000","last_active":"2023-05-10T01:43:38.601574+0000","last_peered":"2023-05-10T01:43:38.601574+0000","last_clean":"2023-05-10T01:43:38.601574+0000","last_became_active":"2023-05-10T01:43:38.597118+0000","last_became_peered":"2023-05-10T01:43:38.597118+0000","last_unstale":"2023-05-10T01:43:38.601574+0000","last_undegraded":"2023-05-10T01:43:38.601574+0000","last_fullsized":"2023-05-10T01:43:38.601574+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603871+0000","last_change":"2023-05-10T01:43:38.203819+0000","last_active":"2023-05-10T01:43:38.603871+0000","last_peered":"2023-05-10T01:43:38.603871+0000","last_clean":"2023-05-10T01:43:38.603871+0000","last_became_active":"2023-05-10T01:43:38.203216+0000","last_became_peered":"2023-05-10T01:43:38.203216+0000","last_unstale":"2023-05-10T01:43:38.603871+0000","last_undegraded":"2023-05-10T01:43:38.603871+0000","last_fullsized":"2023-05-10T01:43:38.603871+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619363+0000","last_change":"2023-05-10T01:43:38.616580+0000","last_active":"2023-05-10T01:43:38.619363+0000","last_peered":"2023-05-10T01:43:38.619363+0000","last_clean":"2023-05-10T01:43:38.619363+0000","last_became_active":"2023-05-10T01:43:38.616299+0000","last_became_peered":"2023-05-10T01:43:38.616299+0000","last_unstale":"2023-05-10T01:43:38.619363+0000","last_undegraded":"2023-05-10T01:43:38.619363+0000","last_fullsized":"2023-05-10T01:43:38.619363+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589342+0000","last_change":"2023-05-10T01:43:38.209464+0000","last_active":"2023-05-10T01:43:38.589342+0000","last_peered":"2023-05-10T01:43:38.589342+0000","last_clean":"2023-05-10T01:43:38.589342+0000","last_became_active":"2023-05-10T01:43:38.209149+0000","last_became_peered":"2023-05-10T01:43:38.209149+0000","last_unstale":"2023-05-10T01:43:38.589342+0000","last_undegraded":"2023-05-10T01:43:38.589342+0000","last_fullsized":"2023-05-10T01:43:38.589342+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612820+0000","last_change":"2023-05-10T01:43:38.611949+0000","last_active":"2023-05-10T01:43:38.612820+0000","last_peered":"2023-05-10T01:43:38.612820+0000","last_clean":"2023-05-10T01:43:38.612820+0000","last_became_active":"2023-05-10T01:43:38.611608+0000","last_became_peered":"2023-05-10T01:43:38.611608+0000","last_unstale":"2023-05-10T01:43:38.612820+0000","last_undegraded":"2023-05-10T01:43:38.612820+0000","last_fullsized":"2023-05-10T01:43:38.612820+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600152+0000","last_change":"2023-05-10T01:43:38.204823+0000","last_active":"2023-05-10T01:43:38.600152+0000","last_peered":"2023-05-10T01:43:38.600152+0000","last_clean":"2023-05-10T01:43:38.600152+0000","last_became_active":"2023-05-10T01:43:38.204393+0000","last_became_peered":"2023-05-10T01:43:38.204393+0000","last_unstale":"2023-05-10T01:43:38.600152+0000","last_undegraded":"2023-05-10T01:43:38.600152+0000","last_fullsized":"2023-05-10T01:43:38.600152+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605072+0000","last_change":"2023-05-10T01:43:38.598811+0000","last_active":"2023-05-10T01:43:38.605072+0000","last_peered":"2023-05-10T01:43:38.605072+0000","last_clean":"2023-05-10T01:43:38.605072+0000","last_became_active":"2023-05-10T01:43:38.598513+0000","last_became_peered":"2023-05-10T01:43:38.598513+0000","last_unstale":"2023-05-10T01:43:38.605072+0000","last_undegraded":"2023-05-10T01:43:38.605072+0000","last_fullsized":"2023-05-10T01:43:38.605072+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589082+0000","last_change":"2023-05-10T01:43:38.201686+0000","last_active":"2023-05-10T01:43:38.589082+0000","last_peered":"2023-05-10T01:43:38.589082+0000","last_clean":"2023-05-10T01:43:38.589082+0000","last_became_active":"2023-05-10T01:43:38.201376+0000","last_became_peered":"2023-05-10T01:43:38.201376+0000","last_unstale":"2023-05-10T01:43:38.589082+0000","last_undegraded":"2023-05-10T01:43:38.589082+0000","last_fullsized":"2023-05-10T01:43:38.589082+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601669+0000","last_change":"2023-05-10T01:43:38.600225+0000","last_active":"2023-05-10T01:43:38.601669+0000","last_peered":"2023-05-10T01:43:38.601669+0000","last_clean":"2023-05-10T01:43:38.601669+0000","last_became_active":"2023-05-10T01:43:38.599936+0000","last_became_peered":"2023-05-10T01:43:38.599936+0000","last_unstale":"2023-05-10T01:43:38.601669+0000","last_undegraded":"2023-05-10T01:43:38.601669+0000","last_fullsized":"2023-05-10T01:43:38.601669+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.586716+0000","last_change":"2023-05-10T01:43:38.206663+0000","last_active":"2023-05-10T01:43:38.586716+0000","last_peered":"2023-05-10T01:43:38.586716+0000","last_clean":"2023-05-10T01:43:38.586716+0000","last_became_active":"2023-05-10T01:43:38.206351+0000","last_became_peered":"2023-05-10T01:43:38.206351+0000","last_unstale":"2023-05-10T01:43:38.586716+0000","last_undegraded":"2023-05-10T01:43:38.586716+0000","last_fullsized":"2023-05-10T01:43:38.586716+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612735+0000","last_change":"2023-05-10T01:43:38.607605+0000","last_active":"2023-05-10T01:43:38.612735+0000","last_peered":"2023-05-10T01:43:38.612735+0000","last_clean":"2023-05-10T01:43:38.612735+0000","last_became_active":"2023-05-10T01:43:38.607326+0000","last_became_peered":"2023-05-10T01:43:38.607326+0000","last_unstale":"2023-05-10T01:43:38.612735+0000","last_undegraded":"2023-05-10T01:43:38.612735+0000","last_fullsized":"2023-05-10T01:43:38.612735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594268+0000","last_change":"2023-05-10T01:43:38.211946+0000","last_active":"2023-05-10T01:43:38.594268+0000","last_peered":"2023-05-10T01:43:38.594268+0000","last_clean":"2023-05-10T01:43:38.594268+0000","last_became_active":"2023-05-10T01:43:38.211663+0000","last_became_peered":"2023-05-10T01:43:38.211663+0000","last_unstale":"2023-05-10T01:43:38.594268+0000","last_undegraded":"2023-05-10T01:43:38.594268+0000","last_fullsized":"2023-05-10T01:43:38.594268+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.624383+0000","last_change":"2023-05-10T01:43:38.619645+0000","last_active":"2023-05-10T01:43:38.624383+0000","last_peered":"2023-05-10T01:43:38.624383+0000","last_clean":"2023-05-10T01:43:38.624383+0000","last_became_active":"2023-05-10T01:43:38.619429+0000","last_became_peered":"2023-05-10T01:43:38.619429+0000","last_unstale":"2023-05-10T01:43:38.624383+0000","last_undegraded":"2023-05-10T01:43:38.624383+0000","last_fullsized":"2023-05-10T01:43:38.624383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.591998+0000","last_change":"2023-05-10T01:43:38.206282+0000","last_active":"2023-05-10T01:43:38.591998+0000","last_peered":"2023-05-10T01:43:38.591998+0000","last_clean":"2023-05-10T01:43:38.591998+0000","last_became_active":"2023-05-10T01:43:38.205877+0000","last_became_peered":"2023-05-10T01:43:38.205877+0000","last_unstale":"2023-05-10T01:43:38.591998+0000","last_undegraded":"2023-05-10T01:43:38.591998+0000","last_fullsized":"2023-05-10T01:43:38.591998+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617649+0000","last_change":"2023-05-10T01:43:38.606948+0000","last_active":"2023-05-10T01:43:38.617649+0000","last_peered":"2023-05-10T01:43:38.617649+0000","last_clean":"2023-05-10T01:43:38.617649+0000","last_became_active":"2023-05-10T01:43:38.606510+0000","last_became_peered":"2023-05-10T01:43:38.606510+0000","last_unstale":"2023-05-10T01:43:38.617649+0000","last_undegraded":"2023-05-10T01:43:38.617649+0000","last_fullsized":"2023-05-10T01:43:38.617649+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587611+0000","last_change":"2023-05-10T01:43:38.206449+0000","last_active":"2023-05-10T01:43:38.587611+0000","last_peered":"2023-05-10T01:43:38.587611+0000","last_clean":"2023-05-10T01:43:38.587611+0000","last_became_active":"2023-05-10T01:43:38.205997+0000","last_became_peered":"2023-05-10T01:43:38.205997+0000","last_unstale":"2023-05-10T01:43:38.587611+0000","last_undegraded":"2023-05-10T01:43:38.587611+0000","last_fullsized":"2023-05-10T01:43:38.587611+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612707+0000","last_change":"2023-05-10T01:43:38.611989+0000","last_active":"2023-05-10T01:43:38.612707+0000","last_peered":"2023-05-10T01:43:38.612707+0000","last_clean":"2023-05-10T01:43:38.612707+0000","last_became_active":"2023-05-10T01:43:38.611515+0000","last_became_peered":"2023-05-10T01:43:38.611515+0000","last_unstale":"2023-05-10T01:43:38.612707+0000","last_undegraded":"2023-05-10T01:43:38.612707+0000","last_fullsized":"2023-05-10T01:43:38.612707+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590664+0000","last_change":"2023-05-10T01:43:38.211678+0000","last_active":"2023-05-10T01:43:38.590664+0000","last_peered":"2023-05-10T01:43:38.590664+0000","last_clean":"2023-05-10T01:43:38.590664+0000","last_became_active":"2023-05-10T01:43:38.211165+0000","last_became_peered":"2023-05-10T01:43:38.211165+0000","last_unstale":"2023-05-10T01:43:38.590664+0000","last_undegraded":"2023-05-10T01:43:38.590664+0000","last_fullsized":"2023-05-10T01:43:38.590664+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.609383+0000","last_change":"2023-05-10T01:43:38.607890+0000","last_active":"2023-05-10T01:43:38.609383+0000","last_peered":"2023-05-10T01:43:38.609383+0000","last_clean":"2023-05-10T01:43:38.609383+0000","last_became_active":"2023-05-10T01:43:38.607554+0000","last_became_peered":"2023-05-10T01:43:38.607554+0000","last_unstale":"2023-05-10T01:43:38.609383+0000","last_undegraded":"2023-05-10T01:43:38.609383+0000","last_fullsized":"2023-05-10T01:43:38.609383+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590392+0000","last_change":"2023-05-10T01:43:38.212206+0000","last_active":"2023-05-10T01:43:38.590392+0000","last_peered":"2023-05-10T01:43:38.590392+0000","last_clean":"2023-05-10T01:43:38.590392+0000","last_became_active":"2023-05-10T01:43:38.211655+0000","last_became_peered":"2023-05-10T01:43:38.211655+0000","last_unstale":"2023-05-10T01:43:38.590392+0000","last_undegraded":"2023-05-10T01:43:38.590392+0000","last_fullsized":"2023-05-10T01:43:38.590392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.615224+0000","last_change":"2023-05-10T01:43:38.603605+0000","last_active":"2023-05-10T01:43:38.615224+0000","last_peered":"2023-05-10T01:43:38.615224+0000","last_clean":"2023-05-10T01:43:38.615224+0000","last_became_active":"2023-05-10T01:43:38.603333+0000","last_became_peered":"2023-05-10T01:43:38.603333+0000","last_unstale":"2023-05-10T01:43:38.615224+0000","last_undegraded":"2023-05-10T01:43:38.615224+0000","last_fullsized":"2023-05-10T01:43:38.615224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594879+0000","last_change":"2023-05-10T01:43:38.207293+0000","last_active":"2023-05-10T01:43:38.594879+0000","last_peered":"2023-05-10T01:43:38.594879+0000","last_clean":"2023-05-10T01:43:38.594879+0000","last_became_active":"2023-05-10T01:43:38.206994+0000","last_became_peered":"2023-05-10T01:43:38.206994+0000","last_unstale":"2023-05-10T01:43:38.594879+0000","last_undegraded":"2023-05-10T01:43:38.594879+0000","last_fullsized":"2023-05-10T01:43:38.594879+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617658+0000","last_change":"2023-05-10T01:43:38.612128+0000","last_active":"2023-05-10T01:43:38.617658+0000","last_peered":"2023-05-10T01:43:38.617658+0000","last_clean":"2023-05-10T01:43:38.617658+0000","last_became_active":"2023-05-10T01:43:38.611893+0000","last_became_peered":"2023-05-10T01:43:38.611893+0000","last_unstale":"2023-05-10T01:43:38.617658+0000","last_undegraded":"2023-05-10T01:43:38.617658+0000","last_fullsized":"2023-05-10T01:43:38.617658+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606546+0000","last_change":"2023-05-10T01:43:38.202876+0000","last_active":"2023-05-10T01:43:38.606546+0000","last_peered":"2023-05-10T01:43:38.606546+0000","last_clean":"2023-05-10T01:43:38.606546+0000","last_became_active":"2023-05-10T01:43:38.202014+0000","last_became_peered":"2023-05-10T01:43:38.202014+0000","last_unstale":"2023-05-10T01:43:38.606546+0000","last_undegraded":"2023-05-10T01:43:38.606546+0000","last_fullsized":"2023-05-10T01:43:38.606546+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616916+0000","last_change":"2023-05-10T01:43:38.612266+0000","last_active":"2023-05-10T01:43:38.616916+0000","last_peered":"2023-05-10T01:43:38.616916+0000","last_clean":"2023-05-10T01:43:38.616916+0000","last_became_active":"2023-05-10T01:43:38.611947+0000","last_became_peered":"2023-05-10T01:43:38.611947+0000","last_unstale":"2023-05-10T01:43:38.616916+0000","last_undegraded":"2023-05-10T01:43:38.616916+0000","last_fullsized":"2023-05-10T01:43:38.616916+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606273+0000","last_change":"2023-05-10T01:43:38.201540+0000","last_active":"2023-05-10T01:43:38.606273+0000","last_peered":"2023-05-10T01:43:38.606273+0000","last_clean":"2023-05-10T01:43:38.606273+0000","last_became_active":"2023-05-10T01:43:38.200902+0000","last_became_peered":"2023-05-10T01:43:38.200902+0000","last_unstale":"2023-05-10T01:43:38.606273+0000","last_undegraded":"2023-05-10T01:43:38.606273+0000","last_fullsized":"2023-05-10T01:43:38.606273+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604190+0000","last_change":"2023-05-10T01:43:38.594473+0000","last_active":"2023-05-10T01:43:38.604190+0000","last_peered":"2023-05-10T01:43:38.604190+0000","last_clean":"2023-05-10T01:43:38.604190+0000","last_became_active":"2023-05-10T01:43:38.594173+0000","last_became_peered":"2023-05-10T01:43:38.594173+0000","last_unstale":"2023-05-10T01:43:38.604190+0000","last_undegraded":"2023-05-10T01:43:38.604190+0000","last_fullsized":"2023-05-10T01:43:38.604190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604577+0000","last_change":"2023-05-10T01:43:38.203082+0000","last_active":"2023-05-10T01:43:38.604577+0000","last_peered":"2023-05-10T01:43:38.604577+0000","last_clean":"2023-05-10T01:43:38.604577+0000","last_became_active":"2023-05-10T01:43:38.202793+0000","last_became_peered":"2023-05-10T01:43:38.202793+0000","last_unstale":"2023-05-10T01:43:38.604577+0000","last_undegraded":"2023-05-10T01:43:38.604577+0000","last_fullsized":"2023-05-10T01:43:38.604577+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601058+0000","last_change":"2023-05-10T01:43:38.598614+0000","last_active":"2023-05-10T01:43:38.601058+0000","last_peered":"2023-05-10T01:43:38.601058+0000","last_clean":"2023-05-10T01:43:38.601058+0000","last_became_active":"2023-05-10T01:43:38.598360+0000","last_became_peered":"2023-05-10T01:43:38.598360+0000","last_unstale":"2023-05-10T01:43:38.601058+0000","last_undegraded":"2023-05-10T01:43:38.601058+0000","last_fullsized":"2023-05-10T01:43:38.601058+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.607327+0000","last_change":"2023-05-10T01:43:38.208930+0000","last_active":"2023-05-10T01:43:38.607327+0000","last_peered":"2023-05-10T01:43:38.607327+0000","last_clean":"2023-05-10T01:43:38.607327+0000","last_became_active":"2023-05-10T01:43:38.208624+0000","last_became_peered":"2023-05-10T01:43:38.208624+0000","last_unstale":"2023-05-10T01:43:38.607327+0000","last_undegraded":"2023-05-10T01:43:38.607327+0000","last_fullsized":"2023-05-10T01:43:38.607327+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604788+0000","last_change":"2023-05-10T01:43:38.603223+0000","last_active":"2023-05-10T01:43:38.604788+0000","last_peered":"2023-05-10T01:43:38.604788+0000","last_clean":"2023-05-10T01:43:38.604788+0000","last_became_active":"2023-05-10T01:43:38.602941+0000","last_became_peered":"2023-05-10T01:43:38.602941+0000","last_unstale":"2023-05-10T01:43:38.604788+0000","last_undegraded":"2023-05-10T01:43:38.604788+0000","last_fullsized":"2023-05-10T01:43:38.604788+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594992+0000","last_change":"2023-05-10T01:43:38.204813+0000","last_active":"2023-05-10T01:43:38.594992+0000","last_peered":"2023-05-10T01:43:38.594992+0000","last_clean":"2023-05-10T01:43:38.594992+0000","last_became_active":"2023-05-10T01:43:38.204317+0000","last_became_peered":"2023-05-10T01:43:38.204317+0000","last_unstale":"2023-05-10T01:43:38.594992+0000","last_undegraded":"2023-05-10T01:43:38.594992+0000","last_fullsized":"2023-05-10T01:43:38.594992+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.612767+0000","last_change":"2023-05-10T01:43:38.607953+0000","last_active":"2023-05-10T01:43:38.612767+0000","last_peered":"2023-05-10T01:43:38.612767+0000","last_clean":"2023-05-10T01:43:38.612767+0000","last_became_active":"2023-05-10T01:43:38.607300+0000","last_became_peered":"2023-05-10T01:43:38.607300+0000","last_unstale":"2023-05-10T01:43:38.612767+0000","last_undegraded":"2023-05-10T01:43:38.612767+0000","last_fullsized":"2023-05-10T01:43:38.612767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608065+0000","last_change":"2023-05-10T01:43:38.200373+0000","last_active":"2023-05-10T01:43:38.608065+0000","last_peered":"2023-05-10T01:43:38.608065+0000","last_clean":"2023-05-10T01:43:38.608065+0000","last_became_active":"2023-05-10T01:43:38.200100+0000","last_became_peered":"2023-05-10T01:43:38.200100+0000","last_unstale":"2023-05-10T01:43:38.608065+0000","last_undegraded":"2023-05-10T01:43:38.608065+0000","last_fullsized":"2023-05-10T01:43:38.608065+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.614675+0000","last_change":"2023-05-10T01:43:38.609647+0000","last_active":"2023-05-10T01:43:38.614675+0000","last_peered":"2023-05-10T01:43:38.614675+0000","last_clean":"2023-05-10T01:43:38.614675+0000","last_became_active":"2023-05-10T01:43:38.609466+0000","last_became_peered":"2023-05-10T01:43:38.609466+0000","last_unstale":"2023-05-10T01:43:38.614675+0000","last_undegraded":"2023-05-10T01:43:38.614675+0000","last_fullsized":"2023-05-10T01:43:38.614675+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.593916+0000","last_change":"2023-05-10T01:43:38.204375+0000","last_active":"2023-05-10T01:43:38.593916+0000","last_peered":"2023-05-10T01:43:38.593916+0000","last_clean":"2023-05-10T01:43:38.593916+0000","last_became_active":"2023-05-10T01:43:38.204078+0000","last_became_peered":"2023-05-10T01:43:38.204078+0000","last_unstale":"2023-05-10T01:43:38.593916+0000","last_undegraded":"2023-05-10T01:43:38.593916+0000","last_fullsized":"2023-05-10T01:43:38.593916+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604673+0000","last_change":"2023-05-10T01:43:38.601013+0000","last_active":"2023-05-10T01:43:38.604673+0000","last_peered":"2023-05-10T01:43:38.604673+0000","last_clean":"2023-05-10T01:43:38.604673+0000","last_became_active":"2023-05-10T01:43:38.600727+0000","last_became_peered":"2023-05-10T01:43:38.600727+0000","last_unstale":"2023-05-10T01:43:38.604673+0000","last_undegraded":"2023-05-10T01:43:38.604673+0000","last_fullsized":"2023-05-10T01:43:38.604673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585002+0000","last_change":"2023-05-10T01:43:38.206882+0000","last_active":"2023-05-10T01:43:38.585002+0000","last_peered":"2023-05-10T01:43:38.585002+0000","last_clean":"2023-05-10T01:43:38.585002+0000","last_became_active":"2023-05-10T01:43:38.206172+0000","last_became_peered":"2023-05-10T01:43:38.206172+0000","last_unstale":"2023-05-10T01:43:38.585002+0000","last_undegraded":"2023-05-10T01:43:38.585002+0000","last_fullsized":"2023-05-10T01:43:38.585002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611285+0000","last_change":"2023-05-10T01:43:38.608524+0000","last_active":"2023-05-10T01:43:38.611285+0000","last_peered":"2023-05-10T01:43:38.611285+0000","last_clean":"2023-05-10T01:43:38.611285+0000","last_became_active":"2023-05-10T01:43:38.608080+0000","last_became_peered":"2023-05-10T01:43:38.608080+0000","last_unstale":"2023-05-10T01:43:38.611285+0000","last_undegraded":"2023-05-10T01:43:38.611285+0000","last_fullsized":"2023-05-10T01:43:38.611285+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598487+0000","last_change":"2023-05-10T01:43:38.205866+0000","last_active":"2023-05-10T01:43:38.598487+0000","last_peered":"2023-05-10T01:43:38.598487+0000","last_clean":"2023-05-10T01:43:38.598487+0000","last_became_active":"2023-05-10T01:43:38.205573+0000","last_became_peered":"2023-05-10T01:43:38.205573+0000","last_unstale":"2023-05-10T01:43:38.598487+0000","last_undegraded":"2023-05-10T01:43:38.598487+0000","last_fullsized":"2023-05-10T01:43:38.598487+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617733+0000","last_change":"2023-05-10T01:43:38.614089+0000","last_active":"2023-05-10T01:43:38.617733+0000","last_peered":"2023-05-10T01:43:38.617733+0000","last_clean":"2023-05-10T01:43:38.617733+0000","last_became_active":"2023-05-10T01:43:38.613758+0000","last_became_peered":"2023-05-10T01:43:38.613758+0000","last_unstale":"2023-05-10T01:43:38.617733+0000","last_undegraded":"2023-05-10T01:43:38.617733+0000","last_fullsized":"2023-05-10T01:43:38.617733+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603299+0000","last_change":"2023-05-10T01:43:38.202045+0000","last_active":"2023-05-10T01:43:38.603299+0000","last_peered":"2023-05-10T01:43:38.603299+0000","last_clean":"2023-05-10T01:43:38.603299+0000","last_became_active":"2023-05-10T01:43:38.201756+0000","last_became_peered":"2023-05-10T01:43:38.201756+0000","last_unstale":"2023-05-10T01:43:38.603299+0000","last_undegraded":"2023-05-10T01:43:38.603299+0000","last_fullsized":"2023-05-10T01:43:38.603299+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608481+0000","last_change":"2023-05-10T01:43:38.603686+0000","last_active":"2023-05-10T01:43:38.608481+0000","last_peered":"2023-05-10T01:43:38.608481+0000","last_clean":"2023-05-10T01:43:38.608481+0000","last_became_active":"2023-05-10T01:43:38.603417+0000","last_became_peered":"2023-05-10T01:43:38.603417+0000","last_unstale":"2023-05-10T01:43:38.608481+0000","last_undegraded":"2023-05-10T01:43:38.608481+0000","last_fullsized":"2023-05-10T01:43:38.608481+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617053+0000","last_change":"2023-05-10T01:43:38.201286+0000","last_active":"2023-05-10T01:43:38.617053+0000","last_peered":"2023-05-10T01:43:38.617053+0000","last_clean":"2023-05-10T01:43:38.617053+0000","last_became_active":"2023-05-10T01:43:38.200660+0000","last_became_peered":"2023-05-10T01:43:38.200660+0000","last_unstale":"2023-05-10T01:43:38.617053+0000","last_undegraded":"2023-05-10T01:43:38.617053+0000","last_fullsized":"2023-05-10T01:43:38.617053+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611310+0000","last_change":"2023-05-10T01:43:38.608624+0000","last_active":"2023-05-10T01:43:38.611310+0000","last_peered":"2023-05-10T01:43:38.611310+0000","last_clean":"2023-05-10T01:43:38.611310+0000","last_became_active":"2023-05-10T01:43:38.607883+0000","last_became_peered":"2023-05-10T01:43:38.607883+0000","last_unstale":"2023-05-10T01:43:38.611310+0000","last_undegraded":"2023-05-10T01:43:38.611310+0000","last_fullsized":"2023-05-10T01:43:38.611310+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585826+0000","last_change":"2023-05-10T01:43:38.207304+0000","last_active":"2023-05-10T01:43:38.585826+0000","last_peered":"2023-05-10T01:43:38.585826+0000","last_clean":"2023-05-10T01:43:38.585826+0000","last_became_active":"2023-05-10T01:43:38.207047+0000","last_became_peered":"2023-05-10T01:43:38.207047+0000","last_unstale":"2023-05-10T01:43:38.585826+0000","last_undegraded":"2023-05-10T01:43:38.585826+0000","last_fullsized":"2023-05-10T01:43:38.585826+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.614351+0000","last_change":"2023-05-10T01:43:38.613646+0000","last_active":"2023-05-10T01:43:38.614351+0000","last_peered":"2023-05-10T01:43:38.614351+0000","last_clean":"2023-05-10T01:43:38.614351+0000","last_became_active":"2023-05-10T01:43:38.613329+0000","last_became_peered":"2023-05-10T01:43:38.613329+0000","last_unstale":"2023-05-10T01:43:38.614351+0000","last_undegraded":"2023-05-10T01:43:38.614351+0000","last_fullsized":"2023-05-10T01:43:38.614351+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594218+0000","last_change":"2023-05-10T01:43:38.214783+0000","last_active":"2023-05-10T01:43:38.594218+0000","last_peered":"2023-05-10T01:43:38.594218+0000","last_clean":"2023-05-10T01:43:38.594218+0000","last_became_active":"2023-05-10T01:43:38.214373+0000","last_became_peered":"2023-05-10T01:43:38.214373+0000","last_unstale":"2023-05-10T01:43:38.594218+0000","last_undegraded":"2023-05-10T01:43:38.594218+0000","last_fullsized":"2023-05-10T01:43:38.594218+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601554+0000","last_change":"2023-05-10T01:43:38.597321+0000","last_active":"2023-05-10T01:43:38.601554+0000","last_peered":"2023-05-10T01:43:38.601554+0000","last_clean":"2023-05-10T01:43:38.601554+0000","last_became_active":"2023-05-10T01:43:38.596813+0000","last_became_peered":"2023-05-10T01:43:38.596813+0000","last_unstale":"2023-05-10T01:43:38.601554+0000","last_undegraded":"2023-05-10T01:43:38.601554+0000","last_fullsized":"2023-05-10T01:43:38.601554+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617963+0000","last_change":"2023-05-10T01:43:38.203587+0000","last_active":"2023-05-10T01:43:38.617963+0000","last_peered":"2023-05-10T01:43:38.617963+0000","last_clean":"2023-05-10T01:43:38.617963+0000","last_became_active":"2023-05-10T01:43:38.202361+0000","last_became_peered":"2023-05-10T01:43:38.202361+0000","last_unstale":"2023-05-10T01:43:38.617963+0000","last_undegraded":"2023-05-10T01:43:38.617963+0000","last_fullsized":"2023-05-10T01:43:38.617963+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606516+0000","last_change":"2023-05-10T01:43:38.603782+0000","last_active":"2023-05-10T01:43:38.606516+0000","last_peered":"2023-05-10T01:43:38.606516+0000","last_clean":"2023-05-10T01:43:38.606516+0000","last_became_active":"2023-05-10T01:43:38.603292+0000","last_became_peered":"2023-05-10T01:43:38.603292+0000","last_unstale":"2023-05-10T01:43:38.606516+0000","last_undegraded":"2023-05-10T01:43:38.606516+0000","last_fullsized":"2023-05-10T01:43:38.606516+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.590475+0000","last_change":"2023-05-10T01:43:38.204827+0000","last_active":"2023-05-10T01:43:38.590475+0000","last_peered":"2023-05-10T01:43:38.590475+0000","last_clean":"2023-05-10T01:43:38.590475+0000","last_became_active":"2023-05-10T01:43:38.204541+0000","last_became_peered":"2023-05-10T01:43:38.204541+0000","last_unstale":"2023-05-10T01:43:38.590475+0000","last_undegraded":"2023-05-10T01:43:38.590475+0000","last_fullsized":"2023-05-10T01:43:38.590475+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.616356+0000","last_change":"2023-05-10T01:43:38.615446+0000","last_active":"2023-05-10T01:43:38.616356+0000","last_peered":"2023-05-10T01:43:38.616356+0000","last_clean":"2023-05-10T01:43:38.616356+0000","last_became_active":"2023-05-10T01:43:38.615235+0000","last_became_peered":"2023-05-10T01:43:38.615235+0000","last_unstale":"2023-05-10T01:43:38.616356+0000","last_undegraded":"2023-05-10T01:43:38.616356+0000","last_fullsized":"2023-05-10T01:43:38.616356+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.595092+0000","last_change":"2023-05-10T01:43:38.207193+0000","last_active":"2023-05-10T01:43:38.595092+0000","last_peered":"2023-05-10T01:43:38.595092+0000","last_clean":"2023-05-10T01:43:38.595092+0000","last_became_active":"2023-05-10T01:43:38.206679+0000","last_became_peered":"2023-05-10T01:43:38.206679+0000","last_unstale":"2023-05-10T01:43:38.595092+0000","last_undegraded":"2023-05-10T01:43:38.595092+0000","last_fullsized":"2023-05-10T01:43:38.595092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619190+0000","last_change":"2023-05-10T01:43:38.614310+0000","last_active":"2023-05-10T01:43:38.619190+0000","last_peered":"2023-05-10T01:43:38.619190+0000","last_clean":"2023-05-10T01:43:38.619190+0000","last_became_active":"2023-05-10T01:43:38.614020+0000","last_became_peered":"2023-05-10T01:43:38.614020+0000","last_unstale":"2023-05-10T01:43:38.619190+0000","last_undegraded":"2023-05-10T01:43:38.619190+0000","last_fullsized":"2023-05-10T01:43:38.619190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585083+0000","last_change":"2023-05-10T01:43:38.208737+0000","last_active":"2023-05-10T01:43:38.585083+0000","last_peered":"2023-05-10T01:43:38.585083+0000","last_clean":"2023-05-10T01:43:38.585083+0000","last_became_active":"2023-05-10T01:43:38.208458+0000","last_became_peered":"2023-05-10T01:43:38.208458+0000","last_unstale":"2023-05-10T01:43:38.585083+0000","last_undegraded":"2023-05-10T01:43:38.585083+0000","last_fullsized":"2023-05-10T01:43:38.585083+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.603589+0000","last_change":"2023-05-10T01:43:38.599267+0000","last_active":"2023-05-10T01:43:38.603589+0000","last_peered":"2023-05-10T01:43:38.603589+0000","last_clean":"2023-05-10T01:43:38.603589+0000","last_became_active":"2023-05-10T01:43:38.599007+0000","last_became_peered":"2023-05-10T01:43:38.599007+0000","last_unstale":"2023-05-10T01:43:38.603589+0000","last_undegraded":"2023-05-10T01:43:38.603589+0000","last_fullsized":"2023-05-10T01:43:38.603589+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.611895+0000","last_change":"2023-05-10T01:43:38.212733+0000","last_active":"2023-05-10T01:43:38.611895+0000","last_peered":"2023-05-10T01:43:38.611895+0000","last_clean":"2023-05-10T01:43:38.611895+0000","last_became_active":"2023-05-10T01:43:38.212462+0000","last_became_peered":"2023-05-10T01:43:38.212462+0000","last_unstale":"2023-05-10T01:43:38.611895+0000","last_undegraded":"2023-05-10T01:43:38.611895+0000","last_fullsized":"2023-05-10T01:43:38.611895+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617692+0000","last_change":"2023-05-10T01:43:38.613639+0000","last_active":"2023-05-10T01:43:38.617692+0000","last_peered":"2023-05-10T01:43:38.617692+0000","last_clean":"2023-05-10T01:43:38.617692+0000","last_became_active":"2023-05-10T01:43:38.613344+0000","last_became_peered":"2023-05-10T01:43:38.613344+0000","last_unstale":"2023-05-10T01:43:38.617692+0000","last_undegraded":"2023-05-10T01:43:38.617692+0000","last_fullsized":"2023-05-10T01:43:38.617692+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608416+0000","last_change":"2023-05-10T01:43:38.205002+0000","last_active":"2023-05-10T01:43:38.608416+0000","last_peered":"2023-05-10T01:43:38.608416+0000","last_clean":"2023-05-10T01:43:38.608416+0000","last_became_active":"2023-05-10T01:43:38.202378+0000","last_became_peered":"2023-05-10T01:43:38.202378+0000","last_unstale":"2023-05-10T01:43:38.608416+0000","last_undegraded":"2023-05-10T01:43:38.608416+0000","last_fullsized":"2023-05-10T01:43:38.608416+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.619036+0000","last_change":"2023-05-10T01:43:38.615748+0000","last_active":"2023-05-10T01:43:38.619036+0000","last_peered":"2023-05-10T01:43:38.619036+0000","last_clean":"2023-05-10T01:43:38.619036+0000","last_became_active":"2023-05-10T01:43:38.615449+0000","last_became_peered":"2023-05-10T01:43:38.615449+0000","last_unstale":"2023-05-10T01:43:38.619036+0000","last_undegraded":"2023-05-10T01:43:38.619036+0000","last_fullsized":"2023-05-10T01:43:38.619036+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.609297+0000","last_change":"2023-05-10T01:43:38.199956+0000","last_active":"2023-05-10T01:43:38.609297+0000","last_peered":"2023-05-10T01:43:38.609297+0000","last_clean":"2023-05-10T01:43:38.609297+0000","last_became_active":"2023-05-10T01:43:38.199622+0000","last_became_peered":"2023-05-10T01:43:38.199622+0000","last_unstale":"2023-05-10T01:43:38.609297+0000","last_undegraded":"2023-05-10T01:43:38.609297+0000","last_fullsized":"2023-05-10T01:43:38.609297+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617672+0000","last_change":"2023-05-10T01:43:38.616725+0000","last_active":"2023-05-10T01:43:38.617672+0000","last_peered":"2023-05-10T01:43:38.617672+0000","last_clean":"2023-05-10T01:43:38.617672+0000","last_became_active":"2023-05-10T01:43:38.616449+0000","last_became_peered":"2023-05-10T01:43:38.616449+0000","last_unstale":"2023-05-10T01:43:38.617672+0000","last_undegraded":"2023-05-10T01:43:38.617672+0000","last_fullsized":"2023-05-10T01:43:38.617672+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585584+0000","last_change":"2023-05-10T01:43:38.206383+0000","last_active":"2023-05-10T01:43:38.585584+0000","last_peered":"2023-05-10T01:43:38.585584+0000","last_clean":"2023-05-10T01:43:38.585584+0000","last_became_active":"2023-05-10T01:43:38.206014+0000","last_became_peered":"2023-05-10T01:43:38.206014+0000","last_unstale":"2023-05-10T01:43:38.585584+0000","last_undegraded":"2023-05-10T01:43:38.585584+0000","last_fullsized":"2023-05-10T01:43:38.585584+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605162+0000","last_change":"2023-05-10T01:43:38.598150+0000","last_active":"2023-05-10T01:43:38.605162+0000","last_peered":"2023-05-10T01:43:38.605162+0000","last_clean":"2023-05-10T01:43:38.605162+0000","last_became_active":"2023-05-10T01:43:38.597907+0000","last_became_peered":"2023-05-10T01:43:38.597907+0000","last_unstale":"2023-05-10T01:43:38.605162+0000","last_undegraded":"2023-05-10T01:43:38.605162+0000","last_fullsized":"2023-05-10T01:43:38.605162+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587809+0000","last_change":"2023-05-10T01:43:38.205378+0000","last_active":"2023-05-10T01:43:38.587809+0000","last_peered":"2023-05-10T01:43:38.587809+0000","last_clean":"2023-05-10T01:43:38.587809+0000","last_became_active":"2023-05-10T01:43:38.204515+0000","last_became_peered":"2023-05-10T01:43:38.204515+0000","last_unstale":"2023-05-10T01:43:38.587809+0000","last_undegraded":"2023-05-10T01:43:38.587809+0000","last_fullsized":"2023-05-10T01:43:38.587809+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.602122+0000","last_change":"2023-05-10T01:43:38.595360+0000","last_active":"2023-05-10T01:43:38.602122+0000","last_peered":"2023-05-10T01:43:38.602122+0000","last_clean":"2023-05-10T01:43:38.602122+0000","last_became_active":"2023-05-10T01:43:38.595045+0000","last_became_peered":"2023-05-10T01:43:38.595045+0000","last_unstale":"2023-05-10T01:43:38.602122+0000","last_undegraded":"2023-05-10T01:43:38.602122+0000","last_fullsized":"2023-05-10T01:43:38.602122+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.595114+0000","last_change":"2023-05-10T01:43:38.204493+0000","last_active":"2023-05-10T01:43:38.595114+0000","last_peered":"2023-05-10T01:43:38.595114+0000","last_clean":"2023-05-10T01:43:38.595114+0000","last_became_active":"2023-05-10T01:43:38.204152+0000","last_became_peered":"2023-05-10T01:43:38.204152+0000","last_unstale":"2023-05-10T01:43:38.595114+0000","last_undegraded":"2023-05-10T01:43:38.595114+0000","last_fullsized":"2023-05-10T01:43:38.595114+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605144+0000","last_change":"2023-05-10T01:43:38.599961+0000","last_active":"2023-05-10T01:43:38.605144+0000","last_peered":"2023-05-10T01:43:38.605144+0000","last_clean":"2023-05-10T01:43:38.605144+0000","last_became_active":"2023-05-10T01:43:38.599696+0000","last_became_peered":"2023-05-10T01:43:38.599696+0000","last_unstale":"2023-05-10T01:43:38.605144+0000","last_undegraded":"2023-05-10T01:43:38.605144+0000","last_fullsized":"2023-05-10T01:43:38.605144+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585107+0000","last_change":"2023-05-10T01:43:38.205021+0000","last_active":"2023-05-10T01:43:38.585107+0000","last_peered":"2023-05-10T01:43:38.585107+0000","last_clean":"2023-05-10T01:43:38.585107+0000","last_became_active":"2023-05-10T01:43:38.204612+0000","last_became_peered":"2023-05-10T01:43:38.204612+0000","last_unstale":"2023-05-10T01:43:38.585107+0000","last_undegraded":"2023-05-10T01:43:38.585107+0000","last_fullsized":"2023-05-10T01:43:38.585107+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618919+0000","last_change":"2023-05-10T01:43:38.615249+0000","last_active":"2023-05-10T01:43:38.618919+0000","last_peered":"2023-05-10T01:43:38.618919+0000","last_clean":"2023-05-10T01:43:38.618919+0000","last_became_active":"2023-05-10T01:43:38.613483+0000","last_became_peered":"2023-05-10T01:43:38.613483+0000","last_unstale":"2023-05-10T01:43:38.618919+0000","last_undegraded":"2023-05-10T01:43:38.618919+0000","last_fullsized":"2023-05-10T01:43:38.618919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594098+0000","last_change":"2023-05-10T01:43:38.203904+0000","last_active":"2023-05-10T01:43:38.594098+0000","last_peered":"2023-05-10T01:43:38.594098+0000","last_clean":"2023-05-10T01:43:38.594098+0000","last_became_active":"2023-05-10T01:43:38.203317+0000","last_became_peered":"2023-05-10T01:43:38.203317+0000","last_unstale":"2023-05-10T01:43:38.594098+0000","last_undegraded":"2023-05-10T01:43:38.594098+0000","last_fullsized":"2023-05-10T01:43:38.594098+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621766+0000","last_change":"2023-05-10T01:43:38.613567+0000","last_active":"2023-05-10T01:43:38.621766+0000","last_peered":"2023-05-10T01:43:38.621766+0000","last_clean":"2023-05-10T01:43:38.621766+0000","last_became_active":"2023-05-10T01:43:38.613279+0000","last_became_peered":"2023-05-10T01:43:38.613279+0000","last_unstale":"2023-05-10T01:43:38.621766+0000","last_undegraded":"2023-05-10T01:43:38.621766+0000","last_fullsized":"2023-05-10T01:43:38.621766+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.618143+0000","last_change":"2023-05-10T01:43:38.209491+0000","last_active":"2023-05-10T01:43:38.618143+0000","last_peered":"2023-05-10T01:43:38.618143+0000","last_clean":"2023-05-10T01:43:38.618143+0000","last_became_active":"2023-05-10T01:43:38.209198+0000","last_became_peered":"2023-05-10T01:43:38.209198+0000","last_unstale":"2023-05-10T01:43:38.618143+0000","last_undegraded":"2023-05-10T01:43:38.618143+0000","last_fullsized":"2023-05-10T01:43:38.618143+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585674+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:43:38.585674+0000","last_peered":"2023-05-10T01:43:38.585674+0000","last_clean":"2023-05-10T01:43:38.585674+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:43:38.585674+0000","last_undegraded":"2023-05-10T01:43:38.585674+0000","last_fullsized":"2023-05-10T01:43:38.585674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.598522+0000","last_change":"2023-05-10T01:43:38.596721+0000","last_active":"2023-05-10T01:43:38.598522+0000","last_peered":"2023-05-10T01:43:38.598522+0000","last_clean":"2023-05-10T01:43:38.598522+0000","last_became_active":"2023-05-10T01:43:38.596437+0000","last_became_peered":"2023-05-10T01:43:38.596437+0000","last_unstale":"2023-05-10T01:43:38.598522+0000","last_undegraded":"2023-05-10T01:43:38.598522+0000","last_fullsized":"2023-05-10T01:43:38.598522+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.605683+0000","last_change":"2023-05-10T01:43:38.200349+0000","last_active":"2023-05-10T01:43:38.605683+0000","last_peered":"2023-05-10T01:43:38.605683+0000","last_clean":"2023-05-10T01:43:38.605683+0000","last_became_active":"2023-05-10T01:43:38.200036+0000","last_became_peered":"2023-05-10T01:43:38.200036+0000","last_unstale":"2023-05-10T01:43:38.605683+0000","last_undegraded":"2023-05-10T01:43:38.605683+0000","last_fullsized":"2023-05-10T01:43:38.605683+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587235+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:43:38.587235+0000","last_peered":"2023-05-10T01:43:38.587235+0000","last_clean":"2023-05-10T01:43:38.587235+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:43:38.587235+0000","last_undegraded":"2023-05-10T01:43:38.587235+0000","last_fullsized":"2023-05-10T01:43:38.587235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601631+0000","last_change":"2023-05-10T01:43:38.594881+0000","last_active":"2023-05-10T01:43:38.601631+0000","last_peered":"2023-05-10T01:43:38.601631+0000","last_clean":"2023-05-10T01:43:38.601631+0000","last_became_active":"2023-05-10T01:43:38.594594+0000","last_became_peered":"2023-05-10T01:43:38.594594+0000","last_unstale":"2023-05-10T01:43:38.601631+0000","last_undegraded":"2023-05-10T01:43:38.601631+0000","last_fullsized":"2023-05-10T01:43:38.601631+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617106+0000","last_change":"2023-05-10T01:43:38.209295+0000","last_active":"2023-05-10T01:43:38.617106+0000","last_peered":"2023-05-10T01:43:38.617106+0000","last_clean":"2023-05-10T01:43:38.617106+0000","last_became_active":"2023-05-10T01:43:38.209018+0000","last_became_peered":"2023-05-10T01:43:38.209018+0000","last_unstale":"2023-05-10T01:43:38.617106+0000","last_undegraded":"2023-05-10T01:43:38.617106+0000","last_fullsized":"2023-05-10T01:43:38.617106+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.589781+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:43:38.589781+0000","last_peered":"2023-05-10T01:43:38.589781+0000","last_clean":"2023-05-10T01:43:38.589781+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:43:38.589781+0000","last_undegraded":"2023-05-10T01:43:38.589781+0000","last_fullsized":"2023-05-10T01:43:38.589781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.621805+0000","last_change":"2023-05-10T01:43:38.615930+0000","last_active":"2023-05-10T01:43:38.621805+0000","last_peered":"2023-05-10T01:43:38.621805+0000","last_clean":"2023-05-10T01:43:38.621805+0000","last_became_active":"2023-05-10T01:43:38.615584+0000","last_became_peered":"2023-05-10T01:43:38.615584+0000","last_unstale":"2023-05-10T01:43:38.621805+0000","last_undegraded":"2023-05-10T01:43:38.621805+0000","last_fullsized":"2023-05-10T01:43:38.621805+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594997+0000","last_change":"2023-05-10T01:43:38.206997+0000","last_active":"2023-05-10T01:43:38.594997+0000","last_peered":"2023-05-10T01:43:38.594997+0000","last_clean":"2023-05-10T01:43:38.594997+0000","last_became_active":"2023-05-10T01:43:38.206487+0000","last_became_peered":"2023-05-10T01:43:38.206487+0000","last_unstale":"2023-05-10T01:43:38.594997+0000","last_undegraded":"2023-05-10T01:43:38.594997+0000","last_fullsized":"2023-05-10T01:43:38.594997+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.587892+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:43:38.587892+0000","last_peered":"2023-05-10T01:43:38.587892+0000","last_clean":"2023-05-10T01:43:38.587892+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:43:38.587892+0000","last_undegraded":"2023-05-10T01:43:38.587892+0000","last_fullsized":"2023-05-10T01:43:38.587892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":125,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594050+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:43:38.594050+0000","last_peered":"2023-05-10T01:43:38.594050+0000","last_clean":"2023-05-10T01:43:38.594050+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:43:38.594050+0000","last_undegraded":"2023-05-10T01:43:38.594050+0000","last_fullsized":"2023-05-10T01:43:38.594050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.608436+0000","last_change":"2023-05-10T01:43:38.603372+0000","last_active":"2023-05-10T01:43:38.608436+0000","last_peered":"2023-05-10T01:43:38.608436+0000","last_clean":"2023-05-10T01:43:38.608436+0000","last_became_active":"2023-05-10T01:43:38.602302+0000","last_became_peered":"2023-05-10T01:43:38.602302+0000","last_unstale":"2023-05-10T01:43:38.608436+0000","last_undegraded":"2023-05-10T01:43:38.608436+0000","last_fullsized":"2023-05-10T01:43:38.608436+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.600249+0000","last_change":"2023-05-10T01:43:38.204656+0000","last_active":"2023-05-10T01:43:38.600249+0000","last_peered":"2023-05-10T01:43:38.600249+0000","last_clean":"2023-05-10T01:43:38.600249+0000","last_became_active":"2023-05-10T01:43:38.204020+0000","last_became_peered":"2023-05-10T01:43:38.204020+0000","last_unstale":"2023-05-10T01:43:38.600249+0000","last_undegraded":"2023-05-10T01:43:38.600249+0000","last_fullsized":"2023-05-10T01:43:38.600249+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594211+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:43:38.594211+0000","last_peered":"2023-05-10T01:43:38.594211+0000","last_clean":"2023-05-10T01:43:38.594211+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:43:38.594211+0000","last_undegraded":"2023-05-10T01:43:38.594211+0000","last_fullsized":"2023-05-10T01:43:38.594211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.617624+0000","last_change":"2023-05-10T01:43:38.606770+0000","last_active":"2023-05-10T01:43:38.617624+0000","last_peered":"2023-05-10T01:43:38.617624+0000","last_clean":"2023-05-10T01:43:38.617624+0000","last_became_active":"2023-05-10T01:43:38.606164+0000","last_became_peered":"2023-05-10T01:43:38.606164+0000","last_unstale":"2023-05-10T01:43:38.617624+0000","last_undegraded":"2023-05-10T01:43:38.617624+0000","last_fullsized":"2023-05-10T01:43:38.617624+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.604044+0000","last_change":"2023-05-10T01:43:38.204630+0000","last_active":"2023-05-10T01:43:38.604044+0000","last_peered":"2023-05-10T01:43:38.604044+0000","last_clean":"2023-05-10T01:43:38.604044+0000","last_became_active":"2023-05-10T01:43:38.203893+0000","last_became_peered":"2023-05-10T01:43:38.203893+0000","last_unstale":"2023-05-10T01:43:38.604044+0000","last_undegraded":"2023-05-10T01:43:38.604044+0000","last_fullsized":"2023-05-10T01:43:38.604044+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.594998+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:43:38.594998+0000","last_peered":"2023-05-10T01:43:38.594998+0000","last_clean":"2023-05-10T01:43:38.594998+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:43:38.594998+0000","last_undegraded":"2023-05-10T01:43:38.594998+0000","last_fullsized":"2023-05-10T01:43:38.594998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.606480+0000","last_change":"2023-05-10T01:43:38.605222+0000","last_active":"2023-05-10T01:43:38.606480+0000","last_peered":"2023-05-10T01:43:38.606480+0000","last_clean":"2023-05-10T01:43:38.606480+0000","last_became_active":"2023-05-10T01:43:38.604885+0000","last_became_peered":"2023-05-10T01:43:38.604885+0000","last_unstale":"2023-05-10T01:43:38.606480+0000","last_undegraded":"2023-05-10T01:43:38.606480+0000","last_fullsized":"2023-05-10T01:43:38.606480+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588564+0000","last_change":"2023-05-10T01:43:38.206412+0000","last_active":"2023-05-10T01:43:38.588564+0000","last_peered":"2023-05-10T01:43:38.588564+0000","last_clean":"2023-05-10T01:43:38.588564+0000","last_became_active":"2023-05-10T01:43:38.206103+0000","last_became_peered":"2023-05-10T01:43:38.206103+0000","last_unstale":"2023-05-10T01:43:38.588564+0000","last_undegraded":"2023-05-10T01:43:38.588564+0000","last_fullsized":"2023-05-10T01:43:38.588564+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.585722+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:43:38.585722+0000","last_peered":"2023-05-10T01:43:38.585722+0000","last_clean":"2023-05-10T01:43:38.585722+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:43:38.585722+0000","last_undegraded":"2023-05-10T01:43:38.585722+0000","last_fullsized":"2023-05-10T01:43:38.585722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.597833+0000","last_change":"2023-05-10T01:43:38.592288+0000","last_active":"2023-05-10T01:43:38.597833+0000","last_peered":"2023-05-10T01:43:38.597833+0000","last_clean":"2023-05-10T01:43:38.597833+0000","last_became_active":"2023-05-10T01:43:38.592085+0000","last_became_peered":"2023-05-10T01:43:38.592085+0000","last_unstale":"2023-05-10T01:43:38.597833+0000","last_undegraded":"2023-05-10T01:43:38.597833+0000","last_fullsized":"2023-05-10T01:43:38.597833+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:38.179462+0000","last_clean_scrub_stamp":"2023-05-10T01:43:38.179462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.588988+0000","last_change":"2023-05-10T01:43:38.199743+0000","last_active":"2023-05-10T01:43:38.588988+0000","last_peered":"2023-05-10T01:43:38.588988+0000","last_clean":"2023-05-10T01:43:38.588988+0000","last_became_active":"2023-05-10T01:43:38.199400+0000","last_became_peered":"2023-05-10T01:43:38.199400+0000","last_unstale":"2023-05-10T01:43:38.588988+0000","last_undegraded":"2023-05-10T01:43:38.588988+0000","last_fullsized":"2023-05-10T01:43:38.588988+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:43:37.177487+0000","last_clean_scrub_stamp":"2023-05-10T01:43:37.177487+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-05-10T01:43:38.601601+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:43:38.601601+0000","last_peered":"2023-05-10T01:43:38.601601+0000","last_clean":"2023-05-10T01:43:38.601601+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:43:38.601601+0000","last_undegraded":"2023-05-10T01:43:38.601601+0000","last_fullsized":"2023-05-10T01:43:38.601601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575248,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20348,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":18432,"kb_avail":94351492,"statfs":{"total":96636764160,"available":96615927808,"internally_reserved":0,"allocated":1953792,"data_stored":1001321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18874368},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74199999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.81999999999999995,"15min":0.82699999999999996},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":1.127,"15min":1.127},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.43099999999999999,"15min":0.40799999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.50600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73099999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.024,"15min":1.024},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":1.006,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.27900000000000003},"max":{"1min":0.58899999999999997,"5min":1.155,"15min":1.155},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.36699999999999999},"max":{"1min":0.67100000000000004,"5min":1.167,"15min":1.167},"last":0.629}]},{"osd":5,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.312},"max":{"1min":0.56999999999999995,"5min":1.597,"15min":1.597},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.65500000000000003,"5min":1.292,"15min":1.292},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed May 10 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.66100000000000003,"5min":1.248,"15min":1.248},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575247,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19820,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94352020,"statfs":{"total":96636764160,"available":96616468480,"internally_reserved":0,"allocated":1937408,"data_stored":994573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.26600000000000001},"max":{"1min":0.76100000000000001,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.54800000000000004,"5min":0.39600000000000002,"15min":0.32800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.84599999999999997,"15min":1.284},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44800000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.84799999999999998,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.50800000000000001,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.83299999999999996,"15min":1.2350000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29499999999999998},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":1.3360000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.497,"15min":0.502},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":1.3620000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 10 01:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":1.3120000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.2729999999999999},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575247,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23664,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94348176,"statfs":{"total":96636764160,"available":96612532224,"internally_reserved":0,"allocated":1941504,"data_stored":1000587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.61799999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.377},{"interface":"front","average":{"1min":0.434,"5min":0.44,"15min":0.441},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59999999999999998,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90000000000000002,"5min":1.1200000000000001,"15min":1.357},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.99199999999999999,"5min":1.171,"15min":1.226},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94899999999999995,"15min":1.3380000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.008,"15min":1.008},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.92200000000000004,"5min":1.1830000000000001,"15min":1.403},"last":0.65600000000000003}]},{"osd":7,"last update":"Wed May 10 01:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0289999999999999,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.47199999999999998,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575247,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24252,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":22336,"kb_avail":94347588,"statfs":{"total":96636764160,"available":96611930112,"internally_reserved":0,"allocated":1953792,"data_stored":1000713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22872064},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42899999999999999,"15min":0.42499999999999999},"min":{"1min":0.30399999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.75,"15min":0.75},"last":0.373}]},{"osd":2,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.60699999999999998,"5min":0.64900000000000002,"15min":0.70599999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.32800000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61799999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.52700000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64600000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42799999999999999},"max":{"1min":0.80200000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66400000000000003,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.41399999999999998},"max":{"1min":0.876,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.77500000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82699999999999996,"5min":1.0349999999999999,"15min":1.0589999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.45300000000000001},"max":{"1min":0.85599999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.432},"max":{"1min":0.81200000000000006,"5min":1.165,"15min":1.165},"last":0.72899999999999998}]},{"osd":7,"last update":"Wed May 10 01:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.84699999999999998,"5min":1.117,"15min":1.117},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.83099999999999996,"5min":1.141,"15min":1.141},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575247,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25336,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":23424,"kb_avail":94346504,"statfs":{"total":96636764160,"available":96610820096,"internally_reserved":0,"allocated":1949696,"data_stored":1001175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23986176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41399999999999998,"15min":0.42299999999999999},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.747},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.27800000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.30299999999999999,"15min":0.28499999999999998},"max":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.70999999999999996},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.438},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.311},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.52500000000000002,"5min":0.44500000000000001,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94999999999999996,"5min":1.0660000000000001,"15min":1.085},"last":4.0129999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.68700000000000006},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.028},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.442,"15min":0.442},"max":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.133},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 10 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71599999999999997,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":0.97199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92100000000000004,"5min":0.98599999999999999,"15min":1.026},"last":0.46100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575247,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1949696,"data_stored":1001231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.40100000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.23899999999999999},"max":{"1min":0.53400000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.441,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.26500000000000001},"max":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.68600000000000005},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.29299999999999998,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.73999999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.439},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.28899999999999998},"max":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.75900000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.65100000000000002},"min":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66000000000000003},"min":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.40699999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.62}]},{"osd":5,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":0.97099999999999997,"15min":1.05},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.008},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.52900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.048},"last":0.75}]},{"osd":7,"last update":"Wed May 10 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.57199999999999995,"5min":0.51300000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95199999999999996,"15min":1.0429999999999999},"last":0.82599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575247,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20088,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":18176,"kb_avail":94351752,"statfs":{"total":96636764160,"available":96616194048,"internally_reserved":0,"allocated":1949696,"data_stored":1001211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18612224},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.433,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":1.468,"15min":1.468},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.307},"max":{"1min":0.754,"5min":1.214,"15min":1.431},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.88,"15min":1.044},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.39400000000000002},"max":{"1min":0.81299999999999994,"5min":1.4910000000000001,"15min":1.51},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.82799999999999996,"5min":0.89400000000000002,"15min":1.494},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84999999999999998,"5min":1.4410000000000001,"15min":1.462},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40500000000000003},"max":{"1min":0.78800000000000003,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.49299999999999999,"5min":0.434,"15min":0.41299999999999998},"max":{"1min":0.76000000000000001,"5min":0.81000000000000005,"15min":1.1020000000000001},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46899999999999997,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":1.413,"15min":1.413},"last":0.313},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.34699999999999998}]},{"osd":6,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.48799999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51800000000000002,"15min":0.52300000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.82799999999999996},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed May 10 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":1.266,"15min":1.266},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575249,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23096,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":21184,"kb_avail":94348744,"statfs":{"total":96636764160,"available":96613113856,"internally_reserved":0,"allocated":1949696,"data_stored":1001501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21692416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74099999999999999,"5min":0.78800000000000003,"15min":1.21},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.76400000000000001,"15min":0.79500000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":1.375},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.42799999999999999,"15min":0.35199999999999998},"max":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":1.1850000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.35299999999999998},"max":{"1min":0.78700000000000003,"5min":0.80400000000000005,"15min":1.194},"last":0.505},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":1.2849999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.3360000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70199999999999996,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.48699999999999999,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.503},"min":{"1min":0.38200000000000001,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed May 10 01:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.35199999999999998,"15min":0.33500000000000002},"max":{"1min":0.71399999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:43:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:43:43.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:43:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.323+0000 7ff0b8c20700 1 Processor -- start 2023-05-10T01:43:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.323+0000 7ff0b8c20700 1 -- start start 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b8c20700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0b4154080 0x7ff0b40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b8c20700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff0b40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b8c20700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b40c94c0 con 0x7ff0b40aa140 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b8c20700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b40aa5b0 con 0x7ff0b4154080 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b8c20700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40cb7d0 con 0x7ff0b4154460 2023-05-10T01:43:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b2d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff0b40aa140 0x7ff0b4068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50228/0 (socket says 172.21.15.52:50228) 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b2d9d700 1 -- 172.21.15.52:0/2094696645 learned_addr learned my addr 172.21.15.52:0/2094696645 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> v2:172.21.15.172:3300/0 conn(0x7ff0b4154080 0x7ff0b40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff0b40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.324+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765077829 0 0) 0x7ff0b40c94c0 con 0x7ff0b40aa140 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0980033f0 con 0x7ff0b40aa140 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889518024 0 0) 0x7ff0980033f0 con 0x7ff0b40aa140 2023-05-10T01:43:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 msgr2=0x7ff0b40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff0b40a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 >> v2:172.21.15.172:3300/0 conn(0x7ff0b4154080 msgr2=0x7ff0b40aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 --2- 172.21.15.52:0/2094696645 >> v2:172.21.15.172:3300/0 conn(0x7ff0b4154080 0x7ff0b40aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40c88b0 con 0x7ff0b40aa140 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7ff0a40017f0 con 0x7ff0b40aa140 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 >> v1:172.21.15.52:6789/0 conn(0x7ff0b40aa140 legacy=0x7ff0b4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff098003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098004690 0x7ff098004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff098005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40cb7d0 con 0x7ff0980038e0 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980044b0 con 0x7ff098004690 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09800b910 con 0x7ff0b4154460 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> v2:172.21.15.172:3300/0 conn(0x7ff0b4154080 0x7ff0b40aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff098003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098004690 0x7ff098004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b2d9d700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff098005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 -- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 msgr2=0x7ff098005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b4154460 0x7ff098005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 -- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098004690 msgr2=0x7ff098004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098004690 0x7ff098004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 -- 172.21.15.52:0/2094696645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980033f0 con 0x7ff0980038e0 2023-05-10T01:43:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.325+0000 7ff0b259c700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff098003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7ff0ac009c30 tx=0x7ff0ac009060).ready entity=mon.0 client_cookie=ed7191edc0847cd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0095c0 con 0x7ff0980038e0 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00e710 con 0x7ff0980038e0 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b159a700 1 -- 172.21.15.52:0/2094696645 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00ea90 con 0x7ff0980038e0 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 -- 172.21.15.52:0/2094696645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 msgr2=0x7ff098003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/2094696645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff098003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7ff0ac009c30 tx=0x7ff0ac009060).stop 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b2d9d700 1 -- 172.21.15.52:0/2094696645 reap_dead start 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 -- 172.21.15.52:0/2094696645 shutdown_connections 2023-05-10T01:43:43.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 -- 172.21.15.52:0/2094696645 >> 172.21.15.52:0/2094696645 conn(0x7ff0b4067910 msgr2=0x7ff0b40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:43.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 -- 172.21.15.52:0/2094696645 shutdown_connections 2023-05-10T01:43:43.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.326+0000 7ff0b8c20700 1 -- 172.21.15.52:0/2094696645 wait complete. 2023-05-10T01:43:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.327+0000 7ff0b8c20700 1 Processor -- start 2023-05-10T01:43:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.327+0000 7ff0b8c20700 1 -- start start 2023-05-10T01:43:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 0x7ff0b40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b40aff30 0x7ff0b40ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b41554b0 con 0x7ff0980038e0 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b41548e0 con 0x7ff0b41478f0 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b8c20700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4154b80 con 0x7ff0b40aff30 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41220/0 (socket says 172.21.15.52:41220) 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 -- 172.21.15.52:0/1648420540 learned_addr learned my addr 172.21.15.52:0/1648420540 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b2d9d700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b40aff30 0x7ff0b40ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 0x7ff0b40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 -- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b40aff30 msgr2=0x7ff0b40ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b40aff30 0x7ff0b40ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 -- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 msgr2=0x7ff0b40afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 0x7ff0b40afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b259c700 1 -- 172.21.15.52:0/1648420540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4154e60 con 0x7ff0980038e0 2023-05-10T01:43:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.328+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 0x7ff0b40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0b259c700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ff0ac00e4b0 tx=0x7ff0ac019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00ea90 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac01b470 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b4155140 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac01b810 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.329+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b41575b0 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.330+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b4157740 con 0x7ff0980038e0 2023-05-10T01:43:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.330+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7ff0ac01bc00 con 0x7ff0980038e0 2023-05-10T01:43:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.330+0000 7ff0a27fc700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 0x7ff0900612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.331+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7ff0ac07bd90 con 0x7ff0980038e0 2023-05-10T01:43:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.331+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 0x7ff0900612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.331+0000 7ff0b1d9b700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 0x7ff0900612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff0a8009270 tx=0x7ff0a8008040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.335+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0ac04d270 con 0x7ff0980038e0 2023-05-10T01:43:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.574+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff0b4155790 con 0x7ff0980038e0 2023-05-10T01:43:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.578+0000 7ff0a27fc700 1 -- 172.21.15.52:0/1648420540 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff0ac050890 con 0x7ff0980038e0 2023-05-10T01:43:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 msgr2=0x7ff0900612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 0x7ff0900612e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff0a8009270 tx=0x7ff0a8008040).stop 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 msgr2=0x7ff0b4155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ff0ac00e4b0 tx=0x7ff0ac019000).stop 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 shutdown_connections 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff09005ee20 0x7ff0900612e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0b40aff30 0x7ff0b40ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0980038e0 0x7ff0b4155940 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 --2- 172.21.15.52:0/1648420540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0b41478f0 0x7ff0b40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 >> 172.21.15.52:0/1648420540 conn(0x7ff0b4067910 msgr2=0x7ff0b414e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:43.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 shutdown_connections 2023-05-10T01:43:43.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.580+0000 7ff0b8c20700 1 -- 172.21.15.52:0/1648420540 wait complete. 2023-05-10T01:43:43.586 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:43:43.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:43:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.708+0000 7f694dfed700 1 Processor -- start 2023-05-10T01:43:43.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.708+0000 7f694dfed700 1 -- start start 2023-05-10T01:43:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f694dfed700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f69480c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f694dfed700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6948154540 0x7f69480c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f694dfed700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480c0650 con 0x7f6948069690 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f694dfed700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480c1af0 con 0x7f6948154540 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f694dfed700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480bfd20 con 0x7f6948154160 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f6947fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6948069690 0x7f6948157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50248/0 (socket says 172.21.15.52:50248) 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f6947fff700 1 -- 172.21.15.52:0/948640471 learned_addr learned my addr 172.21.15.52:0/948640471 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f69477fe700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f69480c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.709+0000 7f6946ffd700 1 --2- 172.21.15.52:0/948640471 >> v2:172.21.15.172:3300/0 conn(0x7f6948154540 0x7f69480c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190911185 0 0) 0x7f69480c0650 con 0x7f6948069690 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69340033f0 con 0x7f6948069690 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1105040683 0 0) 0x7f69340033f0 con 0x7f6948069690 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 msgr2=0x7f69480c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f69480c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 >> v2:172.21.15.172:3300/0 conn(0x7f6948154540 msgr2=0x7f69480c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 --2- 172.21.15.52:0/948640471 >> v2:172.21.15.172:3300/0 conn(0x7f6948154540 0x7f69480c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480c0000 con 0x7f6948069690 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f69400017f0 con 0x7f6948069690 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f6946ffd700 1 --2- 172.21.15.52:0/948640471 >> v2:172.21.15.172:3300/0 conn(0x7f6948154540 0x7f69480c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 >> v1:172.21.15.52:6789/0 conn(0x7f6948069690 legacy=0x7f6948157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69340038e0 0x7f6934003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f6934004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6934004b80 0x7f6934005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480c1af0 con 0x7f69340038e0 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480bfd20 con 0x7f6934004b80 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693400b8e0 con 0x7f6948154160 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69340038e0 0x7f6934003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f6947fff700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6934004b80 0x7f6934005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f6946ffd700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f6934004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 -- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 msgr2=0x7f6934004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948154160 0x7f6934004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 -- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6934004b80 msgr2=0x7f6934005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6934004b80 0x7f6934005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 -- 172.21.15.52:0/948640471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340033f0 con 0x7f69340038e0 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.710+0000 7f69477fe700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69340038e0 0x7f6934003d00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6938009a80 tx=0x7f6938009060).ready entity=mon.0 client_cookie=1a6e2ed505d0e555 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938009430 con 0x7f69340038e0 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693800e640 con 0x7f69340038e0 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f69467fc700 1 -- 172.21.15.52:0/948640471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800e9c0 con 0x7f69340038e0 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 -- 172.21.15.52:0/948640471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69340038e0 msgr2=0x7f6934003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 --2- 172.21.15.52:0/948640471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69340038e0 0x7f6934003d00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6938009a80 tx=0x7f6938009060).stop 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f6947fff700 1 -- 172.21.15.52:0/948640471 reap_dead start 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 -- 172.21.15.52:0/948640471 shutdown_connections 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 -- 172.21.15.52:0/948640471 >> 172.21.15.52:0/948640471 conn(0x7f69480cb6f0 msgr2=0x7f69480c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:43.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 -- 172.21.15.52:0/948640471 shutdown_connections 2023-05-10T01:43:43.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.711+0000 7f694dfed700 1 -- 172.21.15.52:0/948640471 wait complete. 2023-05-10T01:43:43.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.712+0000 7f694dfed700 1 Processor -- start 2023-05-10T01:43:43.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.712+0000 7f694dfed700 1 -- start start 2023-05-10T01:43:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69340038e0 0x7f6948152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948142870 0x7f69480c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948167a80 con 0x7f69480ca390 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69481688e0 con 0x7f69340038e0 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f694dfed700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480ca810 con 0x7f6948142870 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41244/0 (socket says 172.21.15.52:41244) 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 -- 172.21.15.52:0/4207299424 learned_addr learned my addr 172.21.15.52:0/4207299424 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f69477fe700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69340038e0 0x7f6948152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6946ffd700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948142870 0x7f69480c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 -- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948142870 msgr2=0x7f69480c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948142870 0x7f69480c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 -- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69340038e0 msgr2=0x7f6948152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.713+0000 7f6947fff700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69340038e0 0x7f6948152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f6947fff700 1 -- 172.21.15.52:0/4207299424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948167cd0 con 0x7f69480ca390 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f6947fff700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6948083a90 tx=0x7f6940002190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000c7b0 con 0x7f69480ca390 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000c930 con 0x7f69480ca390 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948167fb0 con 0x7f69480ca390 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000ccf0 con 0x7f69480ca390 2023-05-10T01:43:43.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.714+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6948168570 con 0x7f69480ca390 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.715+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69480c36b0 con 0x7f69480ca390 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.715+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f694001c060 con 0x7f69480ca390 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.715+0000 7f692f7fe700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 0x7f69280612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.715+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f69400798f0 con 0x7f69480ca390 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.716+0000 7f69477fe700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 0x7f69280612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.716+0000 7f69477fe700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 0x7f69280612e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6938006d50 tx=0x7f693801a000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.720+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f694004ad50 con 0x7f69480ca390 2023-05-10T01:43:43.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.935+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69480666b0 con 0x7f69480ca390 2023-05-10T01:43:43.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.935+0000 7f692f7fe700 1 -- 172.21.15.52:0/4207299424 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f694001a090 con 0x7f69480ca390 2023-05-10T01:43:43.939 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:43.939 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 msgr2=0x7f69280612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 0x7f69280612e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6938006d50 tx=0x7f693801a000).stop 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 msgr2=0x7f69480c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6948083a90 tx=0x7f6940002190).stop 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 shutdown_connections 2023-05-10T01:43:43.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f692805ee20 0x7f69280612e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69480ca390 0x7f69480c1d30 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69340038e0 0x7f6948152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 --2- 172.21.15.52:0/4207299424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6948142870 0x7f69480c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:43.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 >> 172.21.15.52:0/4207299424 conn(0x7f69480cb6f0 msgr2=0x7f69480aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:43.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 shutdown_connections 2023-05-10T01:43:43.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:43.937+0000 7f694dfed700 1 -- 172.21.15.52:0/4207299424 wait complete. 2023-05-10T01:43:43.943 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:43:44.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:43:38.581747+0000', 'modified': '2023-05-10T01:43:41.771472+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7963}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7963': {'gid': 7963, 'name': 'd', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6836/2334239147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2334239147}, {'type': 'v1', 'addr': '172.21.15.172:6836', 'nonce': 2334239147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:43:44.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:43:44.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-10T01:43:44.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.476+0000 7f232d43e700 1 Processor -- start 2023-05-10T01:43:44.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.476+0000 7f232d43e700 1 -- start start 2023-05-10T01:43:44.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232d43e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2328069740 0x7f2328069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232d43e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23280aab30 0x7f23280c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232d43e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232806a910 con 0x7f23280c5f60 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232d43e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280c65e0 con 0x7f23280aab30 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232d43e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280bfa20 con 0x7f2328069740 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23280aab30 0x7f23280c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232cc3d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f23280c5f60 0x7f2328153af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50268/0 (socket says 172.21.15.52:50268) 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f232cc3d700 1 -- 172.21.15.52:0/4038177837 learned_addr learned my addr 172.21.15.52:0/4038177837 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f2327fff700 1 --2- 172.21.15.52:0/4038177837 >> v2:172.21.15.172:3300/0 conn(0x7f2328069740 0x7f2328069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 -- 172.21.15.52:0/4038177837 >> v2:172.21.15.172:3300/0 conn(0x7f2328069740 msgr2=0x7f2328069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 --2- 172.21.15.52:0/4038177837 >> v2:172.21.15.172:3300/0 conn(0x7f2328069740 0x7f2328069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f2326ffd700 1 -- 172.21.15.52:0/4038177837 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109801805 0 0) 0x7f232806a910 con 0x7f23280c5f60 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 -- 172.21.15.52:0/4038177837 >> v1:172.21.15.52:6789/0 conn(0x7f23280c5f60 legacy=0x7f2328153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 -- 172.21.15.52:0/4038177837 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280c6390 con 0x7f23280aab30 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.477+0000 7f23277fe700 1 --2- 172.21.15.52:0/4038177837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23280aab30 0x7f23280c5a70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f23280c74c0 tx=0x7f231c009060).ready entity=mon.0 client_cookie=ab17d287a5a0ee5b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f2326ffd700 1 -- 172.21.15.52:0/4038177837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00b580 con 0x7f23280aab30 2023-05-10T01:43:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f2326ffd700 1 -- 172.21.15.52:0/4038177837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00b6e0 con 0x7f23280aab30 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f2326ffd700 1 -- 172.21.15.52:0/4038177837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00ba60 con 0x7f23280aab30 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 -- 172.21.15.52:0/4038177837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23280aab30 msgr2=0x7f23280c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 --2- 172.21.15.52:0/4038177837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23280aab30 0x7f23280c5a70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f23280c74c0 tx=0x7f231c009060).stop 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 -- 172.21.15.52:0/4038177837 shutdown_connections 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 --2- 172.21.15.52:0/4038177837 >> v2:172.21.15.172:3300/0 conn(0x7f2328069740 0x7f2328069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 --2- 172.21.15.52:0/4038177837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23280aab30 0x7f23280c5a70 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 -- 172.21.15.52:0/4038177837 >> 172.21.15.52:0/4038177837 conn(0x7f23280cb540 msgr2=0x7f23280c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 -- 172.21.15.52:0/4038177837 shutdown_connections 2023-05-10T01:43:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.478+0000 7f232d43e700 1 -- 172.21.15.52:0/4038177837 wait complete. 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.479+0000 7f232d43e700 1 Processor -- start 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.479+0000 7f232d43e700 1 -- start start 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 0x7f23280affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 0x7f23280b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23280c4a50 con 0x7f2328069740 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23280aeab0 con 0x7f23280aab30 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232d43e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23280ae4f0 con 0x7f23280c5f60 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f2327fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f2327fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41254/0 (socket says 172.21.15.52:41254) 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f2327fff700 1 -- 172.21.15.52:0/634729233 learned_addr learned my addr 172.21.15.52:0/634729233 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f23277fe700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 0x7f23280affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f232cc3d700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 0x7f23280b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f2327fff700 1 -- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 msgr2=0x7f23280b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.480+0000 7f2327fff700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 0x7f23280b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f2327fff700 1 -- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 msgr2=0x7f23280affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f2327fff700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 0x7f23280affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f2327fff700 1 -- 172.21.15.52:0/634729233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0092a0 con 0x7f2328069740 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f23277fe700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 0x7f23280affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f232cc3d700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 0x7f23280b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f2327fff700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f231800d890 tx=0x7f2318008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f230ffff700 1 -- 172.21.15.52:0/634729233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180125f0 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f230ffff700 1 -- 172.21.15.52:0/634729233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318012750 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23280ae7d0 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f230ffff700 1 -- 172.21.15.52:0/634729233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318012ad0 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.481+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23280ade80 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.482+0000 7f230ffff700 1 -- 172.21.15.52:0/634729233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f2318013480 con 0x7f2328069740 2023-05-10T01:43:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.483+0000 7f230ffff700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 0x7f23080612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.483+0000 7f230ffff700 1 -- 172.21.15.52:0/634729233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f2318079f40 con 0x7f2328069740 2023-05-10T01:43:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.483+0000 7f23277fe700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 0x7f23080612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.483+0000 7f23277fe700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 0x7f23080612e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f23280aaf80 tx=0x7f231c017000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 Processor -- start 2023-05-10T01:43:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 -- start start 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592441ac5e0 con 0x5592441e1450 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592441238a0 con 0x55924422f210 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.485+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x559244138900 con 0x5592441e65e0 2023-05-10T01:43:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41266/0 (socket says 172.21.15.52:41266) 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 -- 172.21.15.52:0/559428200 learned_addr learned my addr 172.21.15.52:0/559428200 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f2327fff700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f23277fe700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 -- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 msgr2=0x55924420ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 -- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 msgr2=0x5592441e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 -- 172.21.15.52:0/559428200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559243fdb310 con 0x5592441e1450 2023-05-10T01:43:44.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f23277fe700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:44.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f232cc3d700 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f2320001d60 tx=0x7f2320009040).ready entity=mon.0 client_cookie=fde24e7a31973578 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f230d7fa700 1 -- 172.21.15.52:0/559428200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320005d30 con 0x5592441e1450 2023-05-10T01:43:44.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f230d7fa700 1 -- 172.21.15.52:0/559428200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320005e90 con 0x5592441e1450 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.486+0000 7f230d7fa700 1 -- 172.21.15.52:0/559428200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000d870 con 0x5592441e1450 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 -- 172.21.15.52:0/559428200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 msgr2=0x5592441e18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f2320001d60 tx=0x7f2320009040).stop 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 -- 172.21.15.52:0/559428200 shutdown_connections 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e1450 0x5592441e18d0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 --2- 172.21.15.52:0/559428200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 -- 172.21.15.52:0/559428200 >> 172.21.15.52:0/559428200 conn(0x559243fa3e40 msgr2=0x55924422f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 -- 172.21.15.52:0/559428200 shutdown_connections 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.487+0000 7f2340032b80 1 -- 172.21.15.52:0/559428200 wait complete. 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 -- start start 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 Processor -- start 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x55924423c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592440ffed0 con 0x55924422f210 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592441f9960 con 0x5592441e1450 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55924423ca20 con 0x5592441e65e0 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.488+0000 7f2340032b80 10 client.0 ll_register_callbacks cb 0x5592441a63c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41272/0 (socket says 172.21.15.52:41272) 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 -- 172.21.15.52:0/1133787350 learned_addr learned my addr 172.21.15.52:0/1133787350 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f2327fff700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x55924423c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23277fe700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 -- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 msgr2=0x55924420bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 -- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 msgr2=0x55924423c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x55924423c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 -- 172.21.15.52:0/1133787350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200018b0 con 0x55924422f210 2023-05-10T01:43:44.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23277fe700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f232cc3d700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f232000d6c0 tx=0x7f2320009040).ready entity=mon.0 client_cookie=1e3d6db92ce804cb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200072e0 con 0x55924422f210 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f2320007440 con 0x55924422f210 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592441de7e0 con 0x55924422f210 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2320007810 con 0x55924422f210 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f2340032b80 10 client.8778 fetch_fsmap learned FSMap version 70 2023-05-10T01:43:44.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x559244131880 con 0x55924422f210 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5592441de7e0 con 0x55924422f210 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.489+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2320004a30 con 0x55924422f210 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 10 client.8778 fetch_fsmap finished waiting for FSMap version 70 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 10 client.8778 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 20 client.8778 populate_metadata read hostname 'smithi052' 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924423c5c0 0x559244212d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 4 client.8778 mds_command: new command op to 7963 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:43:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 --> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559243f9fca0 con 0x55924423c5c0 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2327fff700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924423c5c0 0x559244212d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f2327fff700 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924423c5c0 0x559244212d60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=796eae5cbd39c2b0 server_cookie=d2cd51ba002f367c in_seq=0 out_seq=0 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.490+0000 7f23027fc700 10 client.8778 ms_handle_connect on v2:172.21.15.172:6834/2334239147 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f23027fc700 1 -- 172.21.15.52:0/1133787350 <== mds.0 v2:172.21.15.172:6834/2334239147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x559243f9fca0 con 0x55924423c5c0 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f23027fc700 10 client.8778 handle_command_reply: tid=0 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 client.8778 shutdown 2023-05-10T01:43:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 msgr2=0x55924422abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f232000d6c0 tx=0x7f2320009040).stop 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 shutdown_connections 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924423c5c0 0x559244212d60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924422abc0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x55924423c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 --2- 172.21.15.52:0/1133787350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f23027fc700 0 client.8778 ms_handle_reset on v2:172.21.15.172:6834/2334239147 2023-05-10T01:43:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 >> 172.21.15.52:0/1133787350 conn(0x559243fa3e40 msgr2=0x5592441e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 shutdown_connections 2023-05-10T01:43:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 1 -- 172.21.15.52:0/1133787350 wait complete. 2023-05-10T01:43:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.491+0000 7f2340032b80 20 client.8778 trim_cache size 0 max 16384 2023-05-10T01:43:44.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.508+0000 7f2340032b80 1 Processor -- start 2023-05-10T01:43:44.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.508+0000 7f2340032b80 1 -- start start 2023-05-10T01:43:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.508+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e1450 0x55924422f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2340032b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2340032b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559244225ee0 con 0x5592441e65e0 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592441e9270 con 0x55924422f210 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x55924420e0e0 con 0x5592441e1450 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41278/0 (socket says 172.21.15.52:41278) 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 -- 172.21.15.52:0/829341579 learned_addr learned my addr 172.21.15.52:0/829341579 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f2327fff700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e1450 0x55924422f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f232cc3d700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 -- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e1450 msgr2=0x55924422f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e1450 0x55924422f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 -- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 msgr2=0x5592441e0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 -- 172.21.15.52:0/829341579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55924412d070 con 0x5592441e65e0 2023-05-10T01:43:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f232cc3d700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f23277fe700 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f231c00b850 tx=0x7f231c01d000).ready entity=mon.0 client_cookie=8aa2a7944ec78687 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f230dffb700 1 -- 172.21.15.52:0/829341579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c01c8b0 con 0x5592441e65e0 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f230dffb700 1 -- 172.21.15.52:0/829341579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c01ca10 con 0x5592441e65e0 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.509+0000 7f230dffb700 1 -- 172.21.15.52:0/829341579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c01cd90 con 0x5592441e65e0 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- 172.21.15.52:0/829341579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 msgr2=0x559244212d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f231c00b850 tx=0x7f231c01d000).stop 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- 172.21.15.52:0/829341579 shutdown_connections 2023-05-10T01:43:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55924422f210 0x5592441e0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e1450 0x55924422f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 --2- 172.21.15.52:0/829341579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592441e65e0 0x559244212d60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- 172.21.15.52:0/829341579 >> 172.21.15.52:0/829341579 conn(0x559243fa3e40 msgr2=0x5592441e8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- 172.21.15.52:0/829341579 shutdown_connections 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- 172.21.15.52:0/829341579 wait complete. 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 -- start start 2023-05-10T01:43:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.510+0000 7f2340032b80 1 Processor -- start 2023-05-10T01:43:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x559244214850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x559244210f30 con 0x55924422f210 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592442151c0 con 0x5592441e1450 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x559244214d40 con 0x5592441e65e0 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2340032b80 10 client.0 ll_register_callbacks cb 0x5592441a63c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f232cc3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41286/0 (socket says 172.21.15.52:41286) 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f232cc3d700 1 -- 172.21.15.52:0/2549414028 learned_addr learned my addr 172.21.15.52:0/2549414028 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f23277fe700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.511+0000 7f2327fff700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x559244214850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 -- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 msgr2=0x55924420c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 -- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 msgr2=0x559244214850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x559244214850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 -- 172.21.15.52:0/2549414028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23280c6390 con 0x55924422f210 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f232cc3d700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f23200016c0 tx=0x7f232001d000).ready entity=mon.0 client_cookie=61b7ca84cbc40447 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320007810 con 0x55924422f210 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f232000d7a0 con 0x55924422f210 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2320005e90 con 0x55924422f210 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2320004f90 con 0x55924422f210 2023-05-10T01:43:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 10 client.8784 fetch_fsmap learned FSMap version 70 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55924412cdc0 con 0x55924422f210 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320005e90 con 0x55924422f210 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 70) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2320037400 con 0x55924422f210 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 10 client.8784 fetch_fsmap finished waiting for FSMap version 70 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 10 client.8784 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 20 client.8784 populate_metadata read hostname 'smithi052' 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924420b490 0x55924420b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 4 client.8784 mds_command: new command op to 7963 tid=0[{"prefix": "status"}] 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.512+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 --> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559243fd6ca0 con 0x55924420b490 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2327fff700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924420b490 0x55924420b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f23027fc700 10 client.8784 ms_handle_connect on v2:172.21.15.172:6834/2334239147 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2327fff700 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924420b490 0x55924420b870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1c9447f023b0d32 server_cookie=51c81a69095cb7d6 in_seq=0 out_seq=0 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f23027fc700 1 -- 172.21.15.52:0/2549414028 <== mds.0 v2:172.21.15.172:6834/2334239147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x559243fd6ca0 con 0x55924420b490 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f23027fc700 10 client.8784 handle_command_reply: tid=0 2023-05-10T01:43:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 client.8784 shutdown 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 msgr2=0x55924420cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f23200016c0 tx=0x7f232001d000).stop 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 shutdown_connections 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:6834/2334239147,v1:172.21.15.172:6836/2334239147] conn(0x55924420b490 0x55924420b870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55924422f210 0x55924420cc70 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592441e1450 0x559244214850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 --2- 172.21.15.52:0/2549414028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5592441e65e0 0x55924420c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 >> 172.21.15.52:0/2549414028 conn(0x559243fa3e40 msgr2=0x5592441e3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f23027fc700 0 client.8784 ms_handle_reset on v2:172.21.15.172:6834/2334239147 2023-05-10T01:43:44.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 shutdown_connections 2023-05-10T01:43:44.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 1 -- 172.21.15.52:0/2549414028 wait complete. 2023-05-10T01:43:44.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.513+0000 7f2340032b80 20 client.8784 trim_cache size 0 max 16384 2023-05-10T01:43:44.528 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:43:44.528 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:43:44.528 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:43:44.529 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7963, 2023-05-10T01:43:44.529 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:43:44.529 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:43:44.530 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:43:44.530 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 5.9304419240000001, 2023-05-10T01:43:44.530 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 70, 2023-05-10T01:43:44.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 156, 2023-05-10T01:43:44.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 156, 2023-05-10T01:43:44.531 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.523003369 2023-05-10T01:43:44.531 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:43:44.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 msgr2=0x7f23080612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 0x7f23080612e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f23280aaf80 tx=0x7f231c017000).stop 2023-05-10T01:43:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 msgr2=0x7f2328156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f231800d890 tx=0x7f2318008040).stop 2023-05-10T01:43:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 shutdown_connections 2023-05-10T01:43:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230805ee20 0x7f23080612e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280c5f60 0x7f23280b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2328069740 0x7f2328156460 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 --2- 172.21.15.52:0/634729233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23280aab30 0x7f23280affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 >> 172.21.15.52:0/634729233 conn(0x7f23280cb540 msgr2=0x7f2328151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 shutdown_connections 2023-05-10T01:43:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.514+0000 7f232d43e700 1 -- 172.21.15.52:0/634729233 wait complete. 2023-05-10T01:43:44.537 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:43:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.639+0000 7f9bf423a700 1 Processor -- start 2023-05-10T01:43:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.639+0000 7f9bf423a700 1 -- start start 2023-05-10T01:43:44.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf423a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec0bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf423a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bec069a80 0x7f9bec069f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf423a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec065160 con 0x7f9bec154030 2023-05-10T01:43:44.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf423a700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0c41a0 con 0x7f9bec069a80 2023-05-10T01:43:44.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf423a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0a7290 con 0x7f9bec0c3ac0 2023-05-10T01:43:44.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bec069a80 0x7f9bec069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bec069a80 0x7f9bec069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41292/0 (socket says 172.21.15.52:41292) 2023-05-10T01:43:44.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 -- 172.21.15.52:0/2432215822 learned_addr learned my addr 172.21.15.52:0/2432215822 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf17d5700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec0bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 -- 172.21.15.52:0/2432215822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 msgr2=0x7f9bec0bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec0bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 -- 172.21.15.52:0/2432215822 >> v1:172.21.15.172:6789/0 conn(0x7f9bec154030 legacy=0x7f9bec067370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 -- 172.21.15.52:0/2432215822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0c3f40 con 0x7f9bec069a80 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf27d7700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec069a80 0x7f9bec069f10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f9be4009f20 tx=0x7f9be4009840).ready entity=mon.0 client_cookie=30252821ee47b483 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.640+0000 7f9bf0fd4700 1 -- 172.21.15.52:0/2432215822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bec069a80 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf0fd4700 1 -- 172.21.15.52:0/2432215822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400ba80 con 0x7f9bec069a80 2023-05-10T01:43:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf0fd4700 1 -- 172.21.15.52:0/2432215822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400be00 con 0x7f9bec069a80 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 -- 172.21.15.52:0/2432215822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec069a80 msgr2=0x7f9bec069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec069a80 0x7f9bec069f10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f9be4009f20 tx=0x7f9be4009840).stop 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 -- 172.21.15.52:0/2432215822 shutdown_connections 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec069a80 0x7f9bec069f10 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 --2- 172.21.15.52:0/2432215822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec0bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 -- 172.21.15.52:0/2432215822 >> 172.21.15.52:0/2432215822 conn(0x7f9bec063e60 msgr2=0x7f9bec064890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 -- 172.21.15.52:0/2432215822 shutdown_connections 2023-05-10T01:43:44.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.641+0000 7f9bf423a700 1 -- 172.21.15.52:0/2432215822 wait complete. 2023-05-10T01:43:44.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.642+0000 7f9bf423a700 1 Processor -- start 2023-05-10T01:43:44.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.642+0000 7f9bf423a700 1 -- start start 2023-05-10T01:43:44.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bec069a80 0x7f9bec0c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0bff20 con 0x7f9bec154030 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0bf630 con 0x7f9bec069a80 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf423a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0bf8d0 con 0x7f9bec0c3ac0 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41298/0 (socket says 172.21.15.52:41298) 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 -- 172.21.15.52:0/1686472626 learned_addr learned my addr 172.21.15.52:0/1686472626 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf1fd6700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bec069a80 0x7f9bec0c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf17d5700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 -- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 msgr2=0x7f9bec14e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec14e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 -- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bec069a80 msgr2=0x7f9bec0c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bec069a80 0x7f9bec0c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 -- 172.21.15.52:0/1686472626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009ae0 con 0x7f9bec154030 2023-05-10T01:43:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.643+0000 7f9bf27d7700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f9be400b6c0 tx=0x7f9be4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.644+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be401d410 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.644+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be401d590 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.644+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0bfbb0 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.644+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be401d950 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.644+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0c1780 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.645+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec05ef90 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.645+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f9be401b040 con 0x7f9bec154030 2023-05-10T01:43:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.645+0000 7f9bd9ffb700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 0x7f9bcc0612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:44.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.646+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f9be407b950 con 0x7f9bec154030 2023-05-10T01:43:44.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.646+0000 7f9bf1fd6700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 0x7f9bcc0612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:44.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.646+0000 7f9bf1fd6700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 0x7f9bcc0612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9be8007fd0 tx=0x7f9be8009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:44.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.650+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9be404cdb0 con 0x7f9bec154030 2023-05-10T01:43:44.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.869+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9bec0691d0 con 0x7f9bec154030 2023-05-10T01:43:44.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.870+0000 7f9bd9ffb700 1 -- 172.21.15.52:0/1686472626 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9be40503d0 con 0x7f9bec154030 2023-05-10T01:43:44.873 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:43:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.871+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 msgr2=0x7f9bcc0612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.871+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 0x7f9bcc0612e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9be8007fd0 tx=0x7f9be8009040).stop 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 msgr2=0x7f9bec0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f9be400b6c0 tx=0x7f9be4009840).stop 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 shutdown_connections 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9bcc05ee20 0x7f9bcc0612e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bec154030 0x7f9bec0c0e10 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bec069a80 0x7f9bec0c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 --2- 172.21.15.52:0/1686472626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bec0c3ac0 0x7f9bec14e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 >> 172.21.15.52:0/1686472626 conn(0x7f9bec063e60 msgr2=0x7f9bec064890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 shutdown_connections 2023-05-10T01:43:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:44.872+0000 7f9bf423a700 1 -- 172.21.15.52:0/1686472626 wait complete. 2023-05-10T01:43:44.885 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:43:44.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:43:44.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:43:44.886 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:43:44.887 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:43:44.887 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:43:44.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:43:44.888 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:43:44.888 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:43:44.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:44.889 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:43:44.904 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:43:44.904 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:43:44.905 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 40211sec preferred_lft 40211sec 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:43:44.906 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.907 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:43:44.908 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:43:44.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:44.909 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:43:44.967 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:43:44.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:44.969 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:43:45.025 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:43:45.025 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:43:45.025 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:43:45.026 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:43:45.026 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:43:45.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:45.027 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:43:45.027 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:43:45.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:43:45.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:43:45.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:43:45.028 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:43:45.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:45.126 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:43:45.141 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:43:45.141 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:43:45.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:43:45.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:45.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:43:45.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:45.205 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:43:45.259 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:43:45.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:43:45.340 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:43:45.341 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:43:45.383 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:43:45.383 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:43:45.386 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:43:45.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:43:45.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:43:45.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:43:45.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.612+0000 7fc1b9056700 1 Processor -- start 2023-05-10T01:43:45.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.612+0000 7fc1b9056700 1 -- start start 2023-05-10T01:43:45.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b9056700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1b4068c60 0x7fc1b4154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b9056700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4064ff0 0x7fc1b40654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b9056700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b4067550 con 0x7fc1b4153ea0 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b9056700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b4065990 con 0x7fc1b4068c60 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b9056700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40bc9a0 con 0x7fc1b4064ff0 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1b4068c60 0x7fc1b4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b259c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1b4068c60 0x7fc1b4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41312/0 (socket says 172.21.15.52:41312) 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b259c700 1 -- 172.21.15.52:0/1621935075 learned_addr learned my addr 172.21.15.52:0/1621935075 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.613+0000 7fc1b359e700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4064ff0 0x7fc1b40654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b259c700 1 -- 172.21.15.52:0/1621935075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4064ff0 msgr2=0x7fc1b40654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b259c700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4064ff0 0x7fc1b40654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b259c700 1 -- 172.21.15.52:0/1621935075 >> v1:172.21.15.172:6789/0 conn(0x7fc1b4153ea0 legacy=0x7fc1b4066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b259c700 1 -- 172.21.15.52:0/1621935075 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40bcc80 con 0x7fc1b4068c60 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b259c700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4068c60 0x7fc1b4154280 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc19c006fd0 tx=0x7fc19c0090f0).ready entity=mon.0 client_cookie=288c3491f76e9518 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b1d9b700 1 -- 172.21.15.52:0/1621935075 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00b600 con 0x7fc1b4068c60 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b1d9b700 1 -- 172.21.15.52:0/1621935075 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00b760 con 0x7fc1b4068c60 2023-05-10T01:43:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b1d9b700 1 -- 172.21.15.52:0/1621935075 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00bae0 con 0x7fc1b4068c60 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 -- 172.21.15.52:0/1621935075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4068c60 msgr2=0x7fc1b4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4068c60 0x7fc1b4154280 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc19c006fd0 tx=0x7fc19c0090f0).stop 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 -- 172.21.15.52:0/1621935075 shutdown_connections 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4064ff0 0x7fc1b40654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 --2- 172.21.15.52:0/1621935075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4068c60 0x7fc1b4154280 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 -- 172.21.15.52:0/1621935075 >> 172.21.15.52:0/1621935075 conn(0x7fc1b40c4420 msgr2=0x7fc1b40c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 -- 172.21.15.52:0/1621935075 shutdown_connections 2023-05-10T01:43:45.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.614+0000 7fc1b9056700 1 -- 172.21.15.52:0/1621935075 wait complete. 2023-05-10T01:43:45.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 Processor -- start 2023-05-10T01:43:45.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 -- start start 2023-05-10T01:43:45.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4153ea0 0x7fc1b40a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 0x7fc1b40a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40a8cb0 con 0x7fc1b4064ff0 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40a9d40 con 0x7fc1b40a98c0 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b9056700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40a80a0 con 0x7fc1b4153ea0 2023-05-10T01:43:45.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.616+0000 7fc1b2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41316/0 (socket says 172.21.15.52:41316) 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 -- 172.21.15.52:0/223585308 learned_addr learned my addr 172.21.15.52:0/223585308 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b259c700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4153ea0 0x7fc1b40a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b359e700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 0x7fc1b40a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 -- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4153ea0 msgr2=0x7fc1b40a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4153ea0 0x7fc1b40a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 -- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 msgr2=0x7fc1b40a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 0x7fc1b40a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 -- 172.21.15.52:0/223585308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009370 con 0x7fc1b4064ff0 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b359e700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 0x7fc1b40a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b2d9d700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fc1ac00c4f0 tx=0x7fc1ac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac007020 con 0x7fc1b4064ff0 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac001e90 con 0x7fc1b4064ff0 2023-05-10T01:43:45.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b40a8380 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0073b0 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.617+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b40a8940 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.618+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b406c340 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.618+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7fc1ac010070 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.619+0000 7fc1aaffd700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 0x7fc1980612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.619+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fc1ac0792c0 con 0x7fc1b4064ff0 2023-05-10T01:43:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.619+0000 7fc1b259c700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 0x7fc1980612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.619+0000 7fc1b259c700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 0x7fc1980612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc19c006fd0 tx=0x7fc19c017000).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.623+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1ac04a720 con 0x7fc1b4064ff0 2023-05-10T01:43:45.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.825+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1b4067550 con 0x7fc19805ee20 2023-05-10T01:43:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.827+0000 7fc1aaffd700 1 -- 172.21.15.52:0/223585308 <== mgr.7792 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc1b4067550 con 0x7fc19805ee20 2023-05-10T01:43:45.830 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:43:45.830 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:43:45.831 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:43:45.831 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:43:45.831 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:43:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 msgr2=0x7fc1980612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 0x7fc1980612e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc19c006fd0 tx=0x7fc19c017000).stop 2023-05-10T01:43:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 msgr2=0x7fc1b4151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fc1ac00c4f0 tx=0x7fc1ac007e00).stop 2023-05-10T01:43:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 shutdown_connections 2023-05-10T01:43:45.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc19805ee20 0x7fc1980612e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b40a98c0 0x7fc1b40a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4064ff0 0x7fc1b4151620 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 --2- 172.21.15.52:0/223585308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1b4153ea0 0x7fc1b40a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 >> 172.21.15.52:0/223585308 conn(0x7fc1b40c4420 msgr2=0x7fc1b41536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:45.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 shutdown_connections 2023-05-10T01:43:45.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.829+0000 7fc1b9056700 1 -- 172.21.15.52:0/223585308 wait complete. 2023-05-10T01:43:45.844 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:43:45.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.959+0000 7f262bb59700 1 Processor -- start 2023-05-10T01:43:45.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.959+0000 7f262bb59700 1 -- start start 2023-05-10T01:43:45.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f262bb59700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2624068860 0x7f26240aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f262bb59700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240c94c0 con 0x7f2624154460 2023-05-10T01:43:45.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f262bb59700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240cb7d0 con 0x7f2624154080 2023-05-10T01:43:45.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f262bb59700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26240c88b0 con 0x7f2624068860 2023-05-10T01:43:45.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f262a0f6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2624068860 0x7f26240aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f26290f4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2624154460 0x7f2624068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50342/0 (socket says 172.21.15.52:50342) 2023-05-10T01:43:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.960+0000 7f26290f4700 1 -- 172.21.15.52:0/1283283472 learned_addr learned my addr 172.21.15.52:0/1283283472 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262a0f6700 1 -- 172.21.15.52:0/1283283472 >> v1:172.21.15.172:6789/0 conn(0x7f2624154080 legacy=0x7f26240a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262a0f6700 1 -- 172.21.15.52:0/1283283472 >> v1:172.21.15.52:6789/0 conn(0x7f2624154460 legacy=0x7f2624068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262a0f6700 1 -- 172.21.15.52:0/1283283472 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240c8b90 con 0x7f2624068860 2023-05-10T01:43:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f26288f3700 1 -- 172.21.15.52:0/1283283472 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109650601 0 0) 0x7f26240c94c0 con 0x7f2624154460 2023-05-10T01:43:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262a0f6700 1 --2- 172.21.15.52:0/1283283472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f26240aac90 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f2614009e60 tx=0x7f2614009780).ready entity=mon.0 client_cookie=912664379a63bef9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f26288f3700 1 -- 172.21.15.52:0/1283283472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400e070 con 0x7f2624068860 2023-05-10T01:43:45.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f26288f3700 1 -- 172.21.15.52:0/1283283472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400bbf0 con 0x7f2624068860 2023-05-10T01:43:45.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f26288f3700 1 -- 172.21.15.52:0/1283283472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614012410 con 0x7f2624068860 2023-05-10T01:43:45.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 -- 172.21.15.52:0/1283283472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 msgr2=0x7f26240aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 --2- 172.21.15.52:0/1283283472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f26240aac90 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f2614009e60 tx=0x7f2614009780).stop 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 -- 172.21.15.52:0/1283283472 shutdown_connections 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 --2- 172.21.15.52:0/1283283472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f26240aac90 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 -- 172.21.15.52:0/1283283472 >> 172.21.15.52:0/1283283472 conn(0x7f2624067910 msgr2=0x7f26240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 -- 172.21.15.52:0/1283283472 shutdown_connections 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.961+0000 7f262bb59700 1 -- 172.21.15.52:0/1283283472 wait complete. 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.962+0000 7f262bb59700 1 Processor -- start 2023-05-10T01:43:45.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 -- start start 2023-05-10T01:43:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2624154080 0x7f26240ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624154460 0x7f26240abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240abfd0 con 0x7f2624068860 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c2e50 con 0x7f2624154460 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f262bb59700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2624155e10 con 0x7f2624154080 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f26298f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f26298f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41330/0 (socket says 172.21.15.52:41330) 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.963+0000 7f26298f5700 1 -- 172.21.15.52:0/35352647 learned_addr learned my addr 172.21.15.52:0/35352647 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:45.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26290f4700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2624154080 0x7f26240ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f262a0f6700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624154460 0x7f26240abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 -- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2624154080 msgr2=0x7f26240ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2624154080 0x7f26240ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 -- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624154460 msgr2=0x7f26240abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624154460 0x7f26240abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 -- 172.21.15.52:0/35352647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614009a20 con 0x7f2624068860 2023-05-10T01:43:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f26298f5700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f261c00c440 tx=0x7f261c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00f470 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00f5f0 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00f9b0 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26240c2b20 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.964+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2624155b30 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.965+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624066720 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.965+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 70) v1 ==== 75322+0+0 (secure 0 0 0) 0x7f261c019030 con 0x7f2624068860 2023-05-10T01:43:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.966+0000 7f2621ffb700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 0x7f2604061310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:45.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.966+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f261c0790e0 con 0x7f2624068860 2023-05-10T01:43:45.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.966+0000 7f26290f4700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 0x7f2604061310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:45.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.966+0000 7f26290f4700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 0x7f2604061310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f26240b0660 tx=0x7f2618009040).ready entity=mgr.7792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:45.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:45.970+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f261c0488f0 con 0x7f2624068860 2023-05-10T01:43:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.189+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f26240c8e70 con 0x7f2624068860 2023-05-10T01:43:46.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.793+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 71) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f261c010070 con 0x7f2624068860 2023-05-10T01:43:46.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.794+0000 7f2621ffb700 1 -- 172.21.15.52:0/35352647 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v71) v1 ==== 92+0+0 (secure 0 0 0) 0x7f261c073d10 con 0x7f2624068860 2023-05-10T01:43:46.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.796+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 msgr2=0x7f2604061310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.796+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 0x7f2604061310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f26240b0660 tx=0x7f2618009040).stop 2023-05-10T01:43:46.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.796+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 msgr2=0x7f262414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.796+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f261c00c440 tx=0x7f261c007de0).stop 2023-05-10T01:43:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 shutdown_connections 2023-05-10T01:43:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f260405ee50 0x7f2604061310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624154460 0x7f26240abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2624068860 0x7f262414d950 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 --2- 172.21.15.52:0/35352647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2624154080 0x7f26240ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 >> 172.21.15.52:0/35352647 conn(0x7f2624067910 msgr2=0x7f262414f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:46.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 shutdown_connections 2023-05-10T01:43:46.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.797+0000 7f262bb59700 1 -- 172.21.15.52:0/35352647 wait complete. 2023-05-10T01:43:46.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:43:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.934+0000 7f84b9fa3700 1 Processor -- start 2023-05-10T01:43:46.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.934+0000 7f84b9fa3700 1 -- start start 2023-05-10T01:43:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b9fa3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84b4154080 0x7f84b40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b9fa3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 0x7f84b40685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b9fa3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40c94c0 con 0x7f84b4154460 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b9fa3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b40cb7d0 con 0x7f84b4154080 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b9fa3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4068a90 con 0x7f84b4068150 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84b4154080 0x7f84b40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84b4154460 0x7f84b40a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50378/0 (socket says 172.21.15.52:50378) 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b2ffd700 1 -- 172.21.15.52:0/42316566 learned_addr learned my addr 172.21.15.52:0/42316566 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.935+0000 7f84b3fff700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 0x7f84b40685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b37fe700 1 -- 172.21.15.52:0/42316566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 msgr2=0x7f84b40685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b37fe700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 0x7f84b40685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b37fe700 1 -- 172.21.15.52:0/42316566 >> v1:172.21.15.52:6789/0 conn(0x7f84b4154460 legacy=0x7f84b40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b37fe700 1 -- 172.21.15.52:0/42316566 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40c88b0 con 0x7f84b4154080 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b27fc700 1 -- 172.21.15.52:0/42316566 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750119112 0 0) 0x7f84b40c94c0 con 0x7f84b4154460 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b3fff700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 0x7f84b40685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b37fe700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4154080 0x7f84b40aac90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f84a4009e60 tx=0x7f84a4009780).ready entity=mon.0 client_cookie=360c5aa8f1f76a97 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b27fc700 1 -- 172.21.15.52:0/42316566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400e070 con 0x7f84b4154080 2023-05-10T01:43:46.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b27fc700 1 -- 172.21.15.52:0/42316566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400bc30 con 0x7f84b4154080 2023-05-10T01:43:46.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.936+0000 7f84b27fc700 1 -- 172.21.15.52:0/42316566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4012410 con 0x7f84b4154080 2023-05-10T01:43:46.942 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:46.937+0000 7fc455574680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:43:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 -- 172.21.15.52:0/42316566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4154080 msgr2=0x7f84b40aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4154080 0x7f84b40aac90 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f84a4009e60 tx=0x7f84a4009780).stop 2023-05-10T01:43:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 -- 172.21.15.52:0/42316566 shutdown_connections 2023-05-10T01:43:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4068150 0x7f84b40685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/42316566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4154080 0x7f84b40aac90 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 -- 172.21.15.52:0/42316566 >> 172.21.15.52:0/42316566 conn(0x7f84b4067910 msgr2=0x7f84b40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 -- 172.21.15.52:0/42316566 shutdown_connections 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.937+0000 7f84b9fa3700 1 -- 172.21.15.52:0/42316566 wait complete. 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.938+0000 7f84b9fa3700 1 Processor -- start 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.938+0000 7f84b9fa3700 1 -- start start 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4154080 0x7f84b40bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b4154460 0x7f84b40c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41529a0 con 0x7f84b4068150 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40c0690 con 0x7f84b4154460 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b9fa3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40c2a70 con 0x7f84b4154080 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41368/0 (socket says 172.21.15.52:41368) 2023-05-10T01:43:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 -- 172.21.15.52:0/3621021409 learned_addr learned my addr 172.21.15.52:0/3621021409 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b2ffd700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4154080 0x7f84b40bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b3fff700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b4154460 0x7f84b40c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 -- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4154080 msgr2=0x7f84b40bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4154080 0x7f84b40bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 -- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b4154460 msgr2=0x7f84b40c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b4154460 0x7f84b40c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 -- 172.21.15.52:0/3621021409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4009a20 con 0x7f84b4068150 2023-05-10T01:43:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84b37fe700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f84b406bb20 tx=0x7f84a4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:46.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.939+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40032f0 con 0x7f84b4068150 2023-05-10T01:43:46.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.940+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4013e80 con 0x7f84b4068150 2023-05-10T01:43:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.940+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40c1e60 con 0x7f84b4068150 2023-05-10T01:43:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.940+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a401d860 con 0x7f84b4068150 2023-05-10T01:43:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.940+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b40c24a0 con 0x7f84b4068150 2023-05-10T01:43:46.951 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:46.940+0000 7f3a2130c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:43:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.941+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4066720 con 0x7f84b4068150 2023-05-10T01:43:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.941+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 71) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f84a401dc50 con 0x7f84b4068150 2023-05-10T01:43:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.941+0000 7f84ab7fe700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 0x7f8498061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.942+0000 7f84b2ffd700 1 -- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 msgr2=0x7f8498061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.942+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f84a407bd00 con 0x7f84b4068150 2023-05-10T01:43:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.942+0000 7f84b2ffd700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 0x7f8498061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:46.946+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84a407f030 con 0x7f84b4068150 2023-05-10T01:43:47.004 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:47.000+0000 7fc455574680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:43:47.010 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:47.007+0000 7f3a2130c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:43:47.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.121+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f84b40c8b90 con 0x7f84b4068150 2023-05-10T01:43:47.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.125+0000 7f84ab7fe700 1 -- 172.21.15.52:0/3621021409 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f84a404d160 con 0x7f84b4068150 2023-05-10T01:43:47.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.126+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 msgr2=0x7f8498061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:47.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 0x7f8498061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:47.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 msgr2=0x7f84b40a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:47.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f84b406bb20 tx=0x7f84a4009780).stop 2023-05-10T01:43:47.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 shutdown_connections 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f849805ee70 0x7f8498061330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b4154460 0x7f84b40c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b4068150 0x7f84b40a9ed0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 --2- 172.21.15.52:0/3621021409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84b4154080 0x7f84b40bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 >> 172.21.15.52:0/3621021409 conn(0x7f84b4067910 msgr2=0x7f84b40aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 shutdown_connections 2023-05-10T01:43:47.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.127+0000 7f84b9fa3700 1 -- 172.21.15.52:0/3621021409 wait complete. 2023-05-10T01:43:47.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:47.142 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:43:47.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-10T01:43:47.278 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:47.274+0000 7fc455574680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:43:47.395 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:47.296+0000 7f3a2130c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:43:47.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 Processor -- start 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 -- start start 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9738155370 0x7f97380c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380c6660 con 0x7f97380c5cf0 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9738069f50 con 0x7f9738155370 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.325+0000 7f973d1a1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973806a9d0 con 0x7f9738153f80 2023-05-10T01:43:47.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f97377fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97380c5cf0 0x7f97380c0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50438/0 (socket says 172.21.15.52:50438) 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f97377fe700 1 -- 172.21.15.52:0/2924868251 learned_addr learned my addr 172.21.15.52:0/2924868251 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 --2- 172.21.15.52:0/2924868251 >> v2:172.21.15.172:3300/0 conn(0x7f9738155370 0x7f97380c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9737fff700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9736ffd700 1 -- 172.21.15.52:0/2924868251 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721728862 0 0) 0x7f97380c6660 con 0x7f97380c5cf0 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9736ffd700 1 -- 172.21.15.52:0/2924868251 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97180033f0 con 0x7f97380c5cf0 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 -- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 msgr2=0x7f97380a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 -- 172.21.15.52:0/2924868251 >> v1:172.21.15.52:6789/0 conn(0x7f97380c5cf0 legacy=0x7f97380c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 -- 172.21.15.52:0/2924868251 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973806a130 con 0x7f9738155370 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9737fff700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f973c9a0700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9738155370 0x7f97380c6170 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f9730009e60 tx=0x7f9730009780).ready entity=mon.1 client_cookie=10bf7fc6d5be175b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9736ffd700 1 -- 172.21.15.52:0/2924868251 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000e070 con 0x7f9738155370 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9736ffd700 1 -- 172.21.15.52:0/2924868251 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000bab0 con 0x7f9738155370 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.326+0000 7f9736ffd700 1 -- 172.21.15.52:0/2924868251 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000be30 con 0x7f9738155370 2023-05-10T01:43:47.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 -- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9738155370 msgr2=0x7f97380c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9738155370 0x7f97380c6170 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f9730009e60 tx=0x7f9730009780).stop 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 -- 172.21.15.52:0/2924868251 shutdown_connections 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9738155370 0x7f97380c6170 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 --2- 172.21.15.52:0/2924868251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 -- 172.21.15.52:0/2924868251 >> 172.21.15.52:0/2924868251 conn(0x7f97380cb5f0 msgr2=0x7f97380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 -- 172.21.15.52:0/2924868251 shutdown_connections 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.327+0000 7f973d1a1700 1 -- 172.21.15.52:0/2924868251 wait complete. 2023-05-10T01:43:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.328+0000 7f973d1a1700 1 Processor -- start 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.328+0000 7f973d1a1700 1 -- start start 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97380c5cf0 0x7f973814e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380c4930 con 0x7f9738155370 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ae830 con 0x7f97380c5cf0 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973d1a1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380c2a10 con 0x7f9738153f80 2023-05-10T01:43:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973c9a0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973c9a0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41430/0 (socket says 172.21.15.52:41430) 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f973c9a0700 1 -- 172.21.15.52:0/3428251082 learned_addr learned my addr 172.21.15.52:0/3428251082 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97380c5cf0 0x7f973814e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.329+0000 7f97377fe700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 msgr2=0x7f97380c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97380c5cf0 msgr2=0x7f973814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97380c5cf0 0x7f973814e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280092a0 con 0x7f9738155370 2023-05-10T01:43:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973c9a0700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f9730009460 tx=0x7f97380aa790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730013e60 con 0x7f9738155370 2023-05-10T01:43:47.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973001d630 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730009a20 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973001d9d0 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.330+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380c2fd0 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.331+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738083110 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.331+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 71) v1 ==== 75339+0+0 (secure 0 0 0) 0x7f973001dd40 con 0x7f9738155370 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.332+0000 7f972ffff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.332+0000 7f9737fff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:47.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.332+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f973007bfc0 con 0x7f9738155370 2023-05-10T01:43:47.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.332+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:43:47.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.336+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f973004d420 con 0x7f9738155370 2023-05-10T01:43:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.533+0000 7f9737fff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.533+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:43:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.535+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9738066760 con 0x7f971c05ee70 2023-05-10T01:43:47.886 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:47.883+0000 7fc455574680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:43:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.934+0000 7f9737fff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:47.934+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:43:47.959 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:47.954+0000 7fc455574680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:43:47.960 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:47.956+0000 7f3a2130c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:43:48.027 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.024+0000 7f3a2130c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:43:48.143 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.140+0000 7fc455574680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:43:48.219 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.216+0000 7f3a2130c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:43:48.560 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.556+0000 7fc455574680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:43:48.654 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.650+0000 7f3a2130c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:43:48.663 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.660+0000 7fc455574680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:48.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:48.735+0000 7f9737fff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:48.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:48.735+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:43:48.761 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.758+0000 7f3a2130c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:48.816 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.813+0000 7fc455574680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:48.891 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.887+0000 7fc455574680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:43:48.920 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.917+0000 7f3a2130c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:48.957 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:48.954+0000 7fc455574680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:43:48.997 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:48.994+0000 7f3a2130c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:43:49.067 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:49.064+0000 7f3a2130c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:43:49.215 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:49.212+0000 7fc455574680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:43:49.336 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:49.333+0000 7f3a2130c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:43:49.400 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:49.397+0000 7fc455574680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:49.526 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:49.522+0000 7f3a2130c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:43:50.047 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.043+0000 7fc455574680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:43:50.115 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.110+0000 7fc455574680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:43:50.188 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.184+0000 7fc455574680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:43:50.200 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.197+0000 7f3a2130c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:43:50.271 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.268+0000 7f3a2130c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:43:50.332 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.329+0000 7fc455574680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:43:50.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:50.337+0000 7f9737fff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:43:50.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:50.337+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:43:50.348 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.345+0000 7f3a2130c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:43:50.403 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.399+0000 7fc455574680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:43:50.500 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.497+0000 7f3a2130c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:43:50.515 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.512+0000 7fc455574680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:43:50.574 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.571+0000 7f3a2130c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:43:50.623 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.620+0000 7fc455574680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:50.693 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.690+0000 7f3a2130c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:43:50.806 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:50.803+0000 7f3a2130c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:43:50.913 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.910+0000 7fc455574680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:43:50.983 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:50.980+0000 7fc455574680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:43:51.106 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:51.103+0000 7f3a2130c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:43:51.179 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:43:51.176+0000 7f3a2130c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:43:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:51.779+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 72) v1 ==== 75109+0+0 (secure 0 0 0) 0x7f9730079d80 con 0x7f9738155370 2023-05-10T01:43:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:51.780+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c061330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:43:51.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:51.780+0000 7f972ffff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c061330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:43:51.842 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d3d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.843 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d3d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.843 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d3d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.843 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d3d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.843 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d3d56700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.844 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d054f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.844 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d054f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.844 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d054f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.844 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d054f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:51.844 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:43:51.839+0000 7fc3d054f700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:43:52.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.789+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 73) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f9730010d70 con 0x7f9738155370 2023-05-10T01:43:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.789+0000 7f972ffff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c02fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.789+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f971c003450 con 0x7f971c05ee70 2023-05-10T01:43:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.790+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c02fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.790+0000 7f9737fff700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c02fdb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f97280096f0 tx=0x7f9728009060).ready entity=mgr.8095 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.809+0000 7f972ffff700 1 -- 172.21.15.52:0/3428251082 <== mgr.8095 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f971c003450 con 0x7f971c05ee70 2023-05-10T01:43:52.812 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:43:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 msgr2=0x7f971c02fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c02fdb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f97280096f0 tx=0x7f9728009060).stop 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 msgr2=0x7f97380c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f9730009460 tx=0x7f97380aa790).stop 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 shutdown_connections 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f971c05ee70 0x7f971c02fdb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9738155370 0x7f97380c4440 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97380c5cf0 0x7f973814e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 --2- 172.21.15.52:0/3428251082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9738153f80 0x7f97380c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 >> 172.21.15.52:0/3428251082 conn(0x7f97380cb5f0 msgr2=0x7f97380c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 shutdown_connections 2023-05-10T01:43:52.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.811+0000 7f973d1a1700 1 -- 172.21.15.52:0/3428251082 wait complete. 2023-05-10T01:43:52.829 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:43:52.830 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-05-10T01:43:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.956+0000 7fe0a3fff700 1 Processor -- start 2023-05-10T01:43:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.956+0000 7fe0a3fff700 1 -- start start 2023-05-10T01:43:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0a4153f80 0x7fe0a40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c5cf0 0x7fe0a40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0a40c0140 0x7fe0a40c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a4069f50 con 0x7fe0a4153f80 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a406a9d0 con 0x7fe0a40c0140 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c6660 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0a4153f80 0x7fe0a40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0a4153f80 0x7fe0a40a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41572/0 (socket says 172.21.15.52:41572) 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 -- 172.21.15.52:0/2276258820 learned_addr learned my addr 172.21.15.52:0/2276258820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a37fe700 1 --2- 172.21.15.52:0/2276258820 >> v2:172.21.15.172:3300/0 conn(0x7fe0a40c0140 0x7fe0a40c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a27fc700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c5cf0 0x7fe0a40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 -- 172.21.15.52:0/2276258820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c5cf0 msgr2=0x7fe0a40c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c5cf0 0x7fe0a40c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 -- 172.21.15.52:0/2276258820 >> v2:172.21.15.172:3300/0 conn(0x7fe0a40c0140 msgr2=0x7fe0a40c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/2276258820 >> v2:172.21.15.172:3300/0 conn(0x7fe0a40c0140 0x7fe0a40c0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 -- 172.21.15.52:0/2276258820 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a406a130 con 0x7fe0a4153f80 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a4153f80 0x7fe0a40a9d10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fe0a406bdc0 tx=0x7fe09c009840).ready entity=mon.0 client_cookie=49be1e919a9cebb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.957+0000 7fe0a1ffb700 1 -- 172.21.15.52:0/2276258820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00e070 con 0x7fe0a4153f80 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a1ffb700 1 -- 172.21.15.52:0/2276258820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c00b970 con 0x7fe0a4153f80 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a1ffb700 1 -- 172.21.15.52:0/2276258820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00bcf0 con 0x7fe0a4153f80 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 -- 172.21.15.52:0/2276258820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a4153f80 msgr2=0x7fe0a40a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a4153f80 0x7fe0a40a9d10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fe0a406bdc0 tx=0x7fe09c009840).stop 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 -- 172.21.15.52:0/2276258820 shutdown_connections 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/2276258820 >> v2:172.21.15.172:3300/0 conn(0x7fe0a40c0140 0x7fe0a40c0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a4153f80 0x7fe0a40a9d10 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/2276258820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c5cf0 0x7fe0a40c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 -- 172.21.15.52:0/2276258820 >> 172.21.15.52:0/2276258820 conn(0x7fe0a40cb5f0 msgr2=0x7fe0a40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:52.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 -- 172.21.15.52:0/2276258820 shutdown_connections 2023-05-10T01:43:52.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.958+0000 7fe0a3fff700 1 -- 172.21.15.52:0/2276258820 wait complete. 2023-05-10T01:43:52.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.959+0000 7fe0a3fff700 1 Processor -- start 2023-05-10T01:43:52.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.959+0000 7fe0a3fff700 1 -- start start 2023-05-10T01:43:52.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c0140 0x7fe0a40af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a4153f80 0x7fe0a4154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40af3a0 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4167740 con 0x7fe0a4153f80 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4168560 con 0x7fe0a40c0140 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a27fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41578/0 (socket says 172.21.15.52:41578) 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a27fc700 1 -- 172.21.15.52:0/3760901669 learned_addr learned my addr 172.21.15.52:0/3760901669 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a37fe700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a4153f80 0x7fe0a4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.960+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c0140 0x7fe0a40af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 -- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c0140 msgr2=0x7fe0a40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c0140 0x7fe0a40af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 -- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a4153f80 msgr2=0x7fe0a4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:52.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a4153f80 0x7fe0a4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 -- 172.21.15.52:0/3760901669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009ae0 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a27fc700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fe08c00e950 tx=0x7fe08c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c012600 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c012760 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a4167950 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c012ae0 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.961+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a4167f10 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.962+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a41686a0 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.962+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 73) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fe08c022070 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.963+0000 7fe09affd700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 0x7fe088061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:52.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.963+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fe08c07a050 con 0x7fe0a40c5cf0 2023-05-10T01:43:52.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.963+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 0x7fe088061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:52.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.963+0000 7fe0a2ffd700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 0x7fe088061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe0a40aeff0 tx=0x7fe09c009840).ready entity=mgr.8095 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:52.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:52.967+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe0a41686a0 con 0x7fe0a40c5cf0 2023-05-10T01:43:53.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.166+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a41686a0 con 0x7fe08805ed40 2023-05-10T01:43:53.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.171+0000 7fe09affd700 1 -- 172.21.15.52:0/3760901669 <== mgr.8095 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fe0a41686a0 con 0x7fe08805ed40 2023-05-10T01:43:53.175 INFO:teuthology.orchestra.run.smithi052.stdout:Retention added to path snap_test_dir1 2023-05-10T01:43:53.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 msgr2=0x7fe088061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 0x7fe088061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe0a40aeff0 tx=0x7fe09c009840).stop 2023-05-10T01:43:53.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 msgr2=0x7fe0a41506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fe08c00e950 tx=0x7fe08c009060).stop 2023-05-10T01:43:53.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 shutdown_connections 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe08805ed40 0x7fe088061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a4153f80 0x7fe0a4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a40c0140 0x7fe0a40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 --2- 172.21.15.52:0/3760901669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0a40c5cf0 0x7fe0a41506c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 >> 172.21.15.52:0/3760901669 conn(0x7fe0a40cb5f0 msgr2=0x7fe0a40ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 shutdown_connections 2023-05-10T01:43:53.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.173+0000 7fe0a3fff700 1 -- 172.21.15.52:0/3760901669 wait complete. 2023-05-10T01:43:53.188 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-05-10T01:43:53.189 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-10-01_44_00 in ~7s... 2023-05-10T01:43:53.189 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-05-10T01:43:53.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-10T01:43:53.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.307+0000 7f0b032f9700 1 Processor -- start 2023-05-10T01:43:53.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.307+0000 7f0b032f9700 1 -- start start 2023-05-10T01:43:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b032f9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0afc0a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b032f9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0afc0c62b0 0x7f0afc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b032f9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0bfcb0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b032f9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc06a990 con 0x7f0afc0c62b0 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b032f9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06a130 con 0x7f0afc157700 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b01af6700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0afc0aa1e0 0x7f0afc0c5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50602/0 (socket says 172.21.15.52:50602) 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b01af6700 1 -- 172.21.15.52:0/3398041837 learned_addr learned my addr 172.21.15.52:0/3398041837 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> v2:172.21.15.172:3300/0 conn(0x7f0afc0c62b0 0x7f0afc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b022f7700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0afc0a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050686684 0 0) 0x7f0afc0bfcb0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae80033f0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431796974 0 0) 0x7f0ae80033f0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 msgr2=0x7f0afc0a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0afc0a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.308+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 >> v2:172.21.15.172:3300/0 conn(0x7f0afc0c62b0 msgr2=0x7f0afc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 --2- 172.21.15.52:0/3398041837 >> v2:172.21.15.172:3300/0 conn(0x7f0afc0c62b0 0x7f0afc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc06a3d0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0af00017f0 con 0x7f0afc0aa1e0 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b022f7700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0afc0a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> v2:172.21.15.172:3300/0 conn(0x7f0afc0c62b0 0x7f0afc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 >> v1:172.21.15.52:6789/0 conn(0x7f0afc0aa1e0 legacy=0x7f0afc0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80038e0 0x7f0ae8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0ae8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0ae8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06a990 con 0x7f0ae8004b80 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc06a130 con 0x7f0ae80038e0 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8004500 con 0x7f0afc157700 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0ae8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b022f7700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80038e0 0x7f0ae8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b01af6700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0ae8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 -- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 msgr2=0x7f0ae8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:53.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc157700 0x7f0ae8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 -- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80038e0 msgr2=0x7f0ae8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80038e0 0x7f0ae8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 -- 172.21.15.52:0/3398041837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40092a0 con 0x7f0ae8004b80 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b02af8700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0ae8005000 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f0aec009c70 tx=0x7f0aec009060).ready entity=mon.0 client_cookie=7d63d2b3d3aecce5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0095c0 con 0x7f0ae8004b80 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec00e6f0 con 0x7f0ae8004b80 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.309+0000 7f0b012f5700 1 -- 172.21.15.52:0/3398041837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00ea70 con 0x7f0ae8004b80 2023-05-10T01:43:53.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 -- 172.21.15.52:0/3398041837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 msgr2=0x7f0ae8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 --2- 172.21.15.52:0/3398041837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0ae8005000 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f0aec009c70 tx=0x7f0aec009060).stop 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b02af8700 1 -- 172.21.15.52:0/3398041837 reap_dead start 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 -- 172.21.15.52:0/3398041837 shutdown_connections 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 -- 172.21.15.52:0/3398041837 >> 172.21.15.52:0/3398041837 conn(0x7f0afc0cb5f0 msgr2=0x7f0afc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 -- 172.21.15.52:0/3398041837 shutdown_connections 2023-05-10T01:43:53.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.310+0000 7f0b032f9700 1 -- 172.21.15.52:0/3398041837 wait complete. 2023-05-10T01:43:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.311+0000 7f0b032f9700 1 Processor -- start 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.311+0000 7f0b032f9700 1 -- start start 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 0x7f0afc167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc167c00 0x7f0afc0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc14e650 con 0x7f0ae8004b80 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc168080 con 0x7f0afc13c6a0 2023-05-10T01:43:53.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b032f9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc13cb20 con 0x7f0afc167c00 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41596/0 (socket says 172.21.15.52:41596) 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 -- 172.21.15.52:0/1743266278 learned_addr learned my addr 172.21.15.52:0/1743266278 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b01af6700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 0x7f0afc167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b02af8700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc167c00 0x7f0afc0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 -- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc167c00 msgr2=0x7f0afc0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc167c00 0x7f0afc0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 -- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 msgr2=0x7f0afc167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 0x7f0afc167710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 -- 172.21.15.52:0/1743266278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc14d9d0 con 0x7f0ae8004b80 2023-05-10T01:43:53.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b01af6700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 0x7f0afc167710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:43:53.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0b022f7700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f0af4011b10 tx=0x7f0af4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.312+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400f9f0 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.313+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400fb50 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.313+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc14dcb0 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.313+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400fed0 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.313+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc14e270 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.313+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc083110 con 0x7f0ae8004b80 2023-05-10T01:43:53.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.314+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 73) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f0af4024070 con 0x7f0ae8004b80 2023-05-10T01:43:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.314+0000 7f0afa7fc700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 0x7f0adc061230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:43:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.314+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f0af407a870 con 0x7f0ae8004b80 2023-05-10T01:43:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.315+0000 7f0b01af6700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 0x7f0adc061230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:43:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.315+0000 7f0b01af6700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 0x7f0adc061230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0af0001920 tx=0x7f0af0009040).ready entity=mgr.8095 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:43:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.319+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0af404bc90 con 0x7f0ae8004b80 2023-05-10T01:43:53.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.516+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0afc047150 con 0x7f0adc05ed70 2023-05-10T01:43:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.519+0000 7f0afa7fc700 1 -- 172.21.15.52:0/1743266278 <== mgr.8095 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f0afc047150 con 0x7f0adc05ed70 2023-05-10T01:43:53.522 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:43:53.522 INFO:teuthology.orchestra.run.smithi052.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-10T01:43:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 msgr2=0x7f0adc061230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 0x7f0adc061230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0af0001920 tx=0x7f0af0009040).stop 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 msgr2=0x7f0afc139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f0af4011b10 tx=0x7f0af4009060).stop 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 shutdown_connections 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0adc05ed70 0x7f0adc061230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0afc167c00 0x7f0afc0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8004b80 0x7f0afc139be0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 --2- 172.21.15.52:0/1743266278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0afc13c6a0 0x7f0afc167710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:43:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 >> 172.21.15.52:0/1743266278 conn(0x7f0afc0cb5f0 msgr2=0x7f0afc152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:43:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 shutdown_connections 2023-05-10T01:43:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:43:53.520+0000 7f0b032f9700 1 -- 172.21.15.52:0/1743266278 wait complete. 2023-05-10T01:43:53.535 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-10T01:43:53.536 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-05-10T01:43:53.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:53.537 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:54.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:54.555 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:55.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:55.576 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:56.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:56.597 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:57.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:57.618 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:58.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:58.639 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:43:59.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:43:59.663 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:00.179 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:44:00.176+0000 7fc3c3535700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:44:00.179 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:44:00.176+0000 7fc3c3535700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:44:00.180 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:44:00.176+0000 7fc3c3535700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:44:00.180 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:44:00.176+0000 7fc3c3535700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:44:00.180 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:44:00.176+0000 7fc3c3535700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:44:00.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:00.685 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:00.704 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:00.705 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-05-10-01_44_00_UTC'] 2023-05-10T01:44:00.706 DEBUG:tasks.cephfs.test_snap_schedules:exec=1683683033.1891716, now = 1683683040.7059898, timo = 7 2023-05-10T01:44:01.707 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-05-10-01_44_00 in ~67s... 2023-05-10T01:44:01.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:01.708 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:01.728 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:02.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:02.730 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:02.750 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:03.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:03.752 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:03.772 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:03.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:44:03.865 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:44:04.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:04.774 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:04.793 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:05.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:05.796 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:05.815 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:06.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:06.817 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:06.837 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:07.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:07.838 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:07.858 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:08.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:08.860 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:08.879 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:09.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:09.880 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:09.900 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:10.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:10.901 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:10.921 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:11.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:11.922 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:11.942 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:12.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:12.944 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:12.964 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:13.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:13.966 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:13.987 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:14.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:14.989 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:15.008 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:16.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:16.010 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:16.030 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:17.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:17.031 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:17.051 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:18.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:18.053 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:18.072 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:19.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:19.074 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:19.093 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:20.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:20.095 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:20.117 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:21.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:21.119 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:21.139 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:22.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:22.141 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:22.161 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:23.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:23.164 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:23.184 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:24.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:24.185 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:24.205 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:25.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:25.207 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:25.226 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:26.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:26.229 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:26.247 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:27.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:27.249 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:27.268 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:28.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:28.270 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:28.289 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:29.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:29.292 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:29.311 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:30.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:30.313 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:30.333 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:31.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:31.335 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:31.354 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:32.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:32.357 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:32.375 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:33.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:33.378 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:33.397 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:33.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:44:33.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:44:34.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:34.400 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:34.419 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:35.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:35.421 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:35.440 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:36.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:36.442 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:36.461 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:37.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:37.462 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:37.481 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:38.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:38.483 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:38.502 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:39.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:39.505 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:39.524 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:40.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:40.526 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:40.544 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:41.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:41.547 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:41.574 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:42.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:42.576 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:42.595 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:43.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:43.597 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:43.616 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:44.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:44.618 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:44.638 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:45.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:45.640 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:45.659 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:46.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:46.662 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:46.681 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:47.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:47.683 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:47.703 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:48.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:48.705 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:48.725 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:49.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:49.728 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:49.747 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:50.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:50.749 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:50.768 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:51.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:51.769 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:51.788 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:52.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:52.790 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:52.810 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:53.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:53.811 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:53.831 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:54.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:54.833 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:54.852 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:55.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:55.854 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:55.873 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:56.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:56.875 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:56.895 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:57.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:57.897 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:57.918 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:58.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:58.920 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:58.940 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:44:59.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:44:59.942 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:44:59.961 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_44_00_UTC 2023-05-10T01:45:00.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:00.964 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:45:00.983 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_45_00_UTC 2023-05-10T01:45:00.984 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-05-10-01_44_00_UTC'] 2023-05-10T01:45:00.984 DEBUG:tasks.cephfs.test_snap_schedules:exec=1683683033.1891716, now = 1683683100.9848022, timo = 67 2023-05-10T01:45:01.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-10T01:45:02.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.116+0000 7f3ef7c9a700 1 Processor -- start 2023-05-10T01:45:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.117+0000 7f3ef7c9a700 1 -- start start 2023-05-10T01:45:02.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.117+0000 7f3ef7c9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3ef00aa200 0x7f3ef00c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.117+0000 7f3ef7c9a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00ca5f0 con 0x7f3ef0153a90 2023-05-10T01:45:02.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.117+0000 7f3ef7c9a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef01545f0 con 0x7f3ef00c5d20 2023-05-10T01:45:02.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.117+0000 7f3ef7c9a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00c8820 con 0x7f3ef00aa200 2023-05-10T01:45:02.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef6237700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3ef0153a90 0x7f3ef0153ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50624/0 (socket says 172.21.15.52:50624) 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef6237700 1 -- 172.21.15.52:0/1620473969 learned_addr learned my addr 172.21.15.52:0/1620473969 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef5235700 1 --2- 172.21.15.52:0/1620473969 >> v2:172.21.15.172:3300/0 conn(0x7f3ef00aa200 0x7f3ef00c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004181988 0 0) 0x7f3ef00ca5f0 con 0x7f3ef0153a90 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3edc0033f0 con 0x7f3ef0153a90 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1954214763 0 0) 0x7f3edc0033f0 con 0x7f3ef0153a90 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 >> v2:172.21.15.172:3300/0 conn(0x7f3ef00aa200 msgr2=0x7f3ef00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:02.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 --2- 172.21.15.52:0/1620473969 >> v2:172.21.15.172:3300/0 conn(0x7f3ef00aa200 0x7f3ef00c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 >> v1:172.21.15.172:6789/0 conn(0x7f3ef00c5d20 legacy=0x7f3ef0069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00c8b00 con 0x7f3ef0153a90 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f3ee00017f0 con 0x7f3ef0153a90 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 >> v1:172.21.15.52:6789/0 conn(0x7f3ef0153a90 legacy=0x7f3ef0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc0038e0 0x7f3edc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 0x7f3edc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3edc005000 0x7f3edc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c8820 con 0x7f3edc004690 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc00beb0 con 0x7f3edc0038e0 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc00c070 con 0x7f3edc005000 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.118+0000 7f3ef5235700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 0x7f3edc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5a36700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc0038e0 0x7f3edc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef6237700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3edc005000 0x7f3edc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 -- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3edc005000 msgr2=0x7f3edc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:02.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3edc005000 0x7f3edc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 -- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc0038e0 msgr2=0x7f3edc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc0038e0 0x7f3edc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 -- 172.21.15.52:0/1620473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0033f0 con 0x7f3edc004690 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef6237700 1 -- 172.21.15.52:0/1620473969 reap_dead start 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef5235700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 0x7f3edc004b10 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f3ee4009a80 tx=0x7f3ee4009060).ready entity=mon.0 client_cookie=98cbdd58fd34ef00 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4009430 con 0x7f3edc004690 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400e640 con 0x7f3edc004690 2023-05-10T01:45:02.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.119+0000 7f3ef4a34700 1 -- 172.21.15.52:0/1620473969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400e9c0 con 0x7f3edc004690 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 msgr2=0x7f3edc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 0x7f3edc004b10 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f3ee4009a80 tx=0x7f3ee4009060).stop 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/1620473969 shutdown_connections 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/1620473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3edc004690 0x7f3edc004b10 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/1620473969 >> 172.21.15.52:0/1620473969 conn(0x7f3ef00cb6f0 msgr2=0x7f3ef00c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/1620473969 shutdown_connections 2023-05-10T01:45:02.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.120+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/1620473969 wait complete. 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.121+0000 7f3ef7c9a700 1 Processor -- start 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.121+0000 7f3ef7c9a700 1 -- start start 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.121+0000 7f3ef7c9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc004690 0x7f3ef013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ef00c0fb0 0x7f3ef00c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0165480 con 0x7f3ef0164710 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef013c480 con 0x7f3edc004690 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0165640 con 0x7f3ef00c0fb0 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41620/0 (socket says 172.21.15.52:41620) 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 -- 172.21.15.52:0/3644126578 learned_addr learned my addr 172.21.15.52:0/3644126578 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef5235700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ef00c0fb0 0x7f3ef00c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef5a36700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc004690 0x7f3ef013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 -- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ef00c0fb0 msgr2=0x7f3ef00c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ef00c0fb0 0x7f3ef00c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 -- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc004690 msgr2=0x7f3ef013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc004690 0x7f3ef013bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 -- 172.21.15.52:0/3644126578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0168560 con 0x7f3ef0164710 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef6237700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f3ef006c030 tx=0x7f3ee0001730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000f670 con 0x7f3ef0164710 2023-05-10T01:45:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee000f7d0 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef00c1920 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.122+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000fb50 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.123+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef0167f10 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.123+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef0066720 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.124+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 75) v1 ==== 75419+0+0 (secure 0 0 0) 0x7f3ee0015410 con 0x7f3ef0164710 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.124+0000 7f3eedffb700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 0x7f3ed00613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.124+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7f3ee0079740 con 0x7f3ef0164710 2023-05-10T01:45:02.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.124+0000 7f3ef5a36700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 0x7f3ed00613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.125+0000 7f3ef5a36700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 0x7f3ed00613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3ee8007fd0 tx=0x7f3ee8007bb0).ready entity=mgr.8095 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.128+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ee004a9a0 con 0x7f3ef0164710 2023-05-10T01:45:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.329+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ef006c340 con 0x7f3ed005ef00 2023-05-10T01:45:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.333+0000 7f3eedffb700 1 -- 172.21.15.52:0/3644126578 <== mgr.8095 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3ef006c340 con 0x7f3ed005ef00 2023-05-10T01:45:02.336 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path snap_test_dir1 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 msgr2=0x7f3ed00613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 0x7f3ed00613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3ee8007fd0 tx=0x7f3ee8007bb0).stop 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 msgr2=0x7f3ef0164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f3ef006c030 tx=0x7f3ee0001730).stop 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 shutdown_connections 2023-05-10T01:45:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3ed005ef00 0x7f3ed00613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef0164710 0x7f3ef0164b90 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3edc004690 0x7f3ef013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 --2- 172.21.15.52:0/3644126578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ef00c0fb0 0x7f3ef00c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 >> 172.21.15.52:0/3644126578 conn(0x7f3ef00cb6f0 msgr2=0x7f3ef00bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 shutdown_connections 2023-05-10T01:45:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.335+0000 7f3ef7c9a700 1 -- 172.21.15.52:0/3644126578 wait complete. 2023-05-10T01:45:02.349 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-10T01:45:02.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:02.350 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:45:02.365 INFO:teuthology.orchestra.run.smithi052.stdout:scheduled-2023-05-10-01_45_00_UTC 2023-05-10T01:45:02.365 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-05-10-01_45_00_UTC 2023-05-10T01:45:02.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:02.366 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-05-10-01_45_00_UTC) 2023-05-10T01:45:02.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:02.425 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:45:02.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:45:02.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.637+0000 7fe9fcf22700 1 Processor -- start 2023-05-10T01:45:02.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.637+0000 7fe9fcf22700 1 -- start start 2023-05-10T01:45:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.638+0000 7fe9fcf22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9f80c5d20 0x7fe9f80aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.638+0000 7fe9fcf22700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 0x7fe9f8069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.638+0000 7fe9fcf22700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f8154610 con 0x7fe9f8153a90 2023-05-10T01:45:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.638+0000 7fe9fcf22700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80ca5f0 con 0x7fe9f80c5d20 2023-05-10T01:45:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.638+0000 7fe9fcf22700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80c8820 con 0x7fe9f80c6100 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9f80c5d20 0x7fe9f80aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe9f8153a90 0x7fe9f8153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50644/0 (socket says 172.21.15.52:50644) 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9f80c5d20 0x7fe9f80aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41624/0 (socket says 172.21.15.52:41624) 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f6d9d700 1 -- 172.21.15.52:0/729126662 learned_addr learned my addr 172.21.15.52:0/729126662 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f5d9b700 1 --2- 172.21.15.52:0/729126662 >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 0x7fe9f8069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 -- 172.21.15.52:0/729126662 >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 msgr2=0x7fe9f8069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 --2- 172.21.15.52:0/729126662 >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 0x7fe9f8069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 -- 172.21.15.52:0/729126662 >> v1:172.21.15.52:6789/0 conn(0x7fe9f8153a90 legacy=0x7fe9f8153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f559a700 1 -- 172.21.15.52:0/729126662 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589391668 0 0) 0x7fe9f8154610 con 0x7fe9f8153a90 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 -- 172.21.15.52:0/729126662 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80c8b00 con 0x7fe9f80c5d20 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f5d9b700 1 --2- 172.21.15.52:0/729126662 >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 0x7fe9f8069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f659c700 1 --2- 172.21.15.52:0/729126662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f80c5d20 0x7fe9f80aa200 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fe9f80c6780 tx=0x7fe9f0009060).ready entity=mon.0 client_cookie=d9c99f7fa0ea0ae3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f559a700 1 -- 172.21.15.52:0/729126662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000b580 con 0x7fe9f80c5d20 2023-05-10T01:45:02.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f559a700 1 -- 172.21.15.52:0/729126662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000b6e0 con 0x7fe9f80c5d20 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.639+0000 7fe9f559a700 1 -- 172.21.15.52:0/729126662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000ba60 con 0x7fe9f80c5d20 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 -- 172.21.15.52:0/729126662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f80c5d20 msgr2=0x7fe9f80aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/729126662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f80c5d20 0x7fe9f80aa200 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fe9f80c6780 tx=0x7fe9f0009060).stop 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 -- 172.21.15.52:0/729126662 shutdown_connections 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/729126662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f80c5d20 0x7fe9f80aa200 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/729126662 >> v2:172.21.15.172:3300/0 conn(0x7fe9f80c6100 0x7fe9f8069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 -- 172.21.15.52:0/729126662 >> 172.21.15.52:0/729126662 conn(0x7fe9f80cb6f0 msgr2=0x7fe9f80c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 -- 172.21.15.52:0/729126662 shutdown_connections 2023-05-10T01:45:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.640+0000 7fe9fcf22700 1 -- 172.21.15.52:0/729126662 wait complete. 2023-05-10T01:45:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.641+0000 7fe9fcf22700 1 Processor -- start 2023-05-10T01:45:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.641+0000 7fe9fcf22700 1 -- start start 2023-05-10T01:45:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f80c5d20 0x7fe9f8158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6100 0x7fe9f80acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c1cc0 con 0x7fe9f8153a90 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8153020 con 0x7fe9f80c5d20 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9fcf22700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c1f10 con 0x7fe9f80c6100 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41634/0 (socket says 172.21.15.52:41634) 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 -- 172.21.15.52:0/3877165487 learned_addr learned my addr 172.21.15.52:0/3877165487 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f659c700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f80c5d20 0x7fe9f8158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f5d9b700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6100 0x7fe9f80acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 -- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6100 msgr2=0x7fe9f80acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6100 0x7fe9f80acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 -- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f80c5d20 msgr2=0x7fe9f8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f80c5d20 0x7fe9f8158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 -- 172.21.15.52:0/3877165487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00092a0 con 0x7fe9f8153a90 2023-05-10T01:45:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9f6d9d700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fe9e800c730 tx=0x7fe9e8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8005d30 con 0x7fe9f8153a90 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.642+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8005e90 con 0x7fe9f8153a90 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.643+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8007300 con 0x7fe9f8153a90 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.643+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f80c21f0 con 0x7fe9f8153a90 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.643+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80c2a90 con 0x7fe9f8153a90 2023-05-10T01:45:02.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.643+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80c25f0 con 0x7fe9f8153a90 2023-05-10T01:45:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.644+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 75) v1 ==== 75419+0+0 (secure 0 0 0) 0x7fe9e8010070 con 0x7fe9f8153a90 2023-05-10T01:45:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.644+0000 7fe9ee7fc700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 0x7fe9dc0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.644+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7fe9e8079780 con 0x7fe9f8153a90 2023-05-10T01:45:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.644+0000 7fe9f659c700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 0x7fe9dc0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.645+0000 7fe9f659c700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 0x7fe9dc0613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe9f000b340 tx=0x7fe9f0017000).ready entity=mgr.8095 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:02.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.648+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe9e804aa40 con 0x7fe9f8153a90 2023-05-10T01:45:02.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.870+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe9f806c3a0 con 0x7fe9f8153a90 2023-05-10T01:45:02.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.907+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fe9e80773a0 con 0x7fe9f8153a90 2023-05-10T01:45:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.909+0000 7fe9ee7fc700 1 -- 172.21.15.52:0/3877165487 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v76) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe9e8072780 con 0x7fe9f8153a90 2023-05-10T01:45:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 msgr2=0x7fe9dc0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 0x7fe9dc0613c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe9f000b340 tx=0x7fe9f0017000).stop 2023-05-10T01:45:02.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 msgr2=0x7fe9f8156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:02.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7fe9e800c730 tx=0x7fe9e8001520).stop 2023-05-10T01:45:02.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 shutdown_connections 2023-05-10T01:45:02.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe9dc05ef00 0x7fe9dc0613c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9f8153a90 0x7fe9f8156a60 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f80c5d20 0x7fe9f8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 --2- 172.21.15.52:0/3877165487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6100 0x7fe9f80acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 >> 172.21.15.52:0/3877165487 conn(0x7fe9f80cb6f0 msgr2=0x7fe9f80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 shutdown_connections 2023-05-10T01:45:02.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:02.911+0000 7fe9fcf22700 1 -- 172.21.15.52:0/3877165487 wait complete. 2023-05-10T01:45:02.927 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:45:02.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:02.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:02.987 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:45:02.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:45:02.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:02.989 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:45:03.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:45:03.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:03.051 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:45:03.053 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:03.050+0000 7f6770236680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:03.064 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:03.062+0000 7f2a8ebe8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:03.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:03.120 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:03.117+0000 7f6770236680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:03.126 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:03.124+0000 7f2a8ebe8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.222+0000 7f917f3b4700 1 Processor -- start 2023-05-10T01:45:03.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.222+0000 7f917f3b4700 1 -- start start 2023-05-10T01:45:03.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917f3b4700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9178154540 0x7f9178069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917f3b4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 0x7f91780c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917f3b4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780c0650 con 0x7f9178154160 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917f3b4700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9178069ff0 con 0x7f9178154540 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917f3b4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780bfd20 con 0x7f9178069b80 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917c94f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9178154540 0x7f9178069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.223+0000 7f917d951700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 0x7f91780c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917d150700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9178154160 0x7f91780c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:53242/0 (socket says 172.21.15.52:53242) 2023-05-10T01:45:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9178154540 0x7f9178069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:40014/0 (socket says 172.21.15.52:40014) 2023-05-10T01:45:03.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 -- 172.21.15.52:0/1030141805 learned_addr learned my addr 172.21.15.52:0/1030141805 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:03.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 -- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 msgr2=0x7f91780c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:03.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 0x7f91780c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 -- 172.21.15.52:0/1030141805 >> v1:172.21.15.172:6789/0 conn(0x7f9178154160 legacy=0x7f91780c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 -- 172.21.15.52:0/1030141805 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780c0000 con 0x7f9178154540 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f916bfff700 1 -- 172.21.15.52:0/1030141805 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873218153 0 0) 0x7f91780c0650 con 0x7f9178154160 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917d951700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 0x7f91780c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f917c94f700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f9178069690 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9174006fd0 tx=0x7f91740090f0).ready entity=mon.1 client_cookie=7066ce601954834a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f916bfff700 1 -- 172.21.15.52:0/1030141805 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400b580 con 0x7f9178154540 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f916bfff700 1 -- 172.21.15.52:0/1030141805 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400b6e0 con 0x7f9178154540 2023-05-10T01:45:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.224+0000 7f916bfff700 1 -- 172.21.15.52:0/1030141805 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400ba80 con 0x7f9178154540 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 -- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 msgr2=0x7f9178069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f9178069690 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9174006fd0 tx=0x7f91740090f0).stop 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 -- 172.21.15.52:0/1030141805 shutdown_connections 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178069b80 0x7f91780c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 --2- 172.21.15.52:0/1030141805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f9178069690 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 -- 172.21.15.52:0/1030141805 >> 172.21.15.52:0/1030141805 conn(0x7f91780cb6f0 msgr2=0x7f91780c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 -- 172.21.15.52:0/1030141805 shutdown_connections 2023-05-10T01:45:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.225+0000 7f917f3b4700 1 -- 172.21.15.52:0/1030141805 wait complete. 2023-05-10T01:45:03.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.226+0000 7f917f3b4700 1 Processor -- start 2023-05-10T01:45:03.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.226+0000 7f917f3b4700 1 -- start start 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178154160 0x7f9178154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f91780aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178157510 con 0x7f9178069b80 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781683a0 con 0x7f9178154540 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917f3b4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9178168680 con 0x7f9178154160 2023-05-10T01:45:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41694/0 (socket says 172.21.15.52:41694) 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 -- 172.21.15.52:0/2585781584 learned_addr learned my addr 172.21.15.52:0/2585781584 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917c94f700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178154160 0x7f9178154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d951700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f91780aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178154160 msgr2=0x7f9178154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178154160 0x7f9178154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 msgr2=0x7f91780aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f91780aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.227+0000 7f917d150700 1 -- 172.21.15.52:0/2585781584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009a20 con 0x7f9178069b80 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f917d150700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f916c00c560 tx=0x7f916c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0072e0 con 0x7f9178069b80 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c007440 con 0x7f9178069b80 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9174009370 con 0x7f9178069b80 2023-05-10T01:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0058f0 con 0x7f9178069b80 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.228+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9178168c40 con 0x7f9178069b80 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.229+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91780666b0 con 0x7f9178069b80 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.230+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f916c010070 con 0x7f9178069b80 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.230+0000 7f91697fa700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.230+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7f916c079c60 con 0x7f9178069b80 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.230+0000 7f917c94f700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 msgr2=0x7f9158061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.230+0000 7f917c94f700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:03.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.234+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f916c04ae90 con 0x7f9178069b80 2023-05-10T01:45:03.399 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:03.396+0000 7f2a8ebe8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:03.411 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:03.408+0000 7f6770236680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:03.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.431+0000 7f917c94f700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 msgr2=0x7f9158061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:03.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.431+0000 7f917c94f700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:03.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.452+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9178157650 con 0x7f9178069b80 2023-05-10T01:45:03.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.453+0000 7f91697fa700 1 -- 172.21.15.52:0/2585781584 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f916c077ef0 con 0x7f9178069b80 2023-05-10T01:45:03.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:03.456 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:45:03.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 msgr2=0x7f9158061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:03.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 msgr2=0x7f91780c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f916c00c560 tx=0x7f916c007c90).stop 2023-05-10T01:45:03.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 shutdown_connections 2023-05-10T01:45:03.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f915805eeb0 0x7f9158061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9178154540 0x7f91780aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178069b80 0x7f91780c3410 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 --2- 172.21.15.52:0/2585781584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9178154160 0x7f9178154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 >> 172.21.15.52:0/2585781584 conn(0x7f91780cb6f0 msgr2=0x7f917814daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 shutdown_connections 2023-05-10T01:45:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.455+0000 7f917f3b4700 1 -- 172.21.15.52:0/2585781584 wait complete. 2023-05-10T01:45:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:45:03.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:03.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.625+0000 7f47b54ee700 1 Processor -- start 2023-05-10T01:45:03.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.625+0000 7f47b54ee700 1 -- start start 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47b54ee700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b013b540 0x7f47b00c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47b54ee700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47b0063e20 0x7f47b00abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47b54ee700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00bdc20 con 0x7f47b013b920 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47b54ee700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00c53f0 con 0x7f47b0063e20 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47b54ee700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c4e30 con 0x7f47b013b540 2023-05-10T01:45:03.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47af7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47b0063e20 0x7f47b00abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47af7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47b0063e20 0x7f47b00abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41724/0 (socket says 172.21.15.52:41724) 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47af7fe700 1 -- 172.21.15.52:0/1439409572 learned_addr learned my addr 172.21.15.52:0/1439409572 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.626+0000 7f47aeffd700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b013b540 0x7f47b00c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47af7fe700 1 -- 172.21.15.52:0/1439409572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b013b540 msgr2=0x7f47b00c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47af7fe700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b013b540 0x7f47b00c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47adffb700 1 -- 172.21.15.52:0/1439409572 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597047043 0 0) 0x7f47b00bdc20 con 0x7f47b013b920 2023-05-10T01:45:03.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47af7fe700 1 -- 172.21.15.52:0/1439409572 >> v1:172.21.15.172:6789/0 conn(0x7f47b013b920 legacy=0x7f47b0063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47af7fe700 1 -- 172.21.15.52:0/1439409572 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00c5110 con 0x7f47b0063e20 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47af7fe700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b0063e20 0x7f47b00abb10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f47a8009f20 tx=0x7f47a8009840).ready entity=mon.0 client_cookie=61dc79451bcb0992 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47adffb700 1 -- 172.21.15.52:0/1439409572 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800e070 con 0x7f47b0063e20 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47adffb700 1 -- 172.21.15.52:0/1439409572 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800b9d0 con 0x7f47b0063e20 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.627+0000 7f47adffb700 1 -- 172.21.15.52:0/1439409572 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800bd50 con 0x7f47b0063e20 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 -- 172.21.15.52:0/1439409572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b0063e20 msgr2=0x7f47b00abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b0063e20 0x7f47b00abb10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f47a8009f20 tx=0x7f47a8009840).stop 2023-05-10T01:45:03.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 -- 172.21.15.52:0/1439409572 shutdown_connections 2023-05-10T01:45:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b013b540 0x7f47b00c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1439409572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b0063e20 0x7f47b00abb10 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 -- 172.21.15.52:0/1439409572 >> 172.21.15.52:0/1439409572 conn(0x7f47b00c8a90 msgr2=0x7f47b00c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 -- 172.21.15.52:0/1439409572 shutdown_connections 2023-05-10T01:45:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.628+0000 7f47b54ee700 1 -- 172.21.15.52:0/1439409572 wait complete. 2023-05-10T01:45:03.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.629+0000 7f47b54ee700 1 Processor -- start 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.629+0000 7f47b54ee700 1 -- start start 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 0x7f47b0139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b013b920 0x7f47b00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c2bf0 con 0x7f47b013b540 2023-05-10T01:45:03.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0165110 con 0x7f47b013b920 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47b54ee700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01581d0 con 0x7f47b0063e20 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47aeffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 0x7f47b0139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41728/0 (socket says 172.21.15.52:41728) 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 -- 172.21.15.52:0/1709630005 learned_addr learned my addr 172.21.15.52:0/1709630005 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47af7fe700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b013b920 0x7f47b00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 -- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 msgr2=0x7f47b0139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 0x7f47b0139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 -- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b013b920 msgr2=0x7f47b00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b013b920 0x7f47b00c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 -- 172.21.15.52:0/1709630005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009ae0 con 0x7f47b013b540 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47aeffd700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 0x7f47b0139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:03.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.630+0000 7f47ae7fc700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f47a400c490 tx=0x7f47a4007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.631+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40123f0 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.631+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4012550 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.631+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40128f0 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.631+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b00c02b0 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.631+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00bfc60 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.632+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00c77f0 con 0x7f47b013b540 2023-05-10T01:45:03.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.632+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f47a4010070 con 0x7f47b013b540 2023-05-10T01:45:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.632+0000 7f4796ffd700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 0x7f4790061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.633+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7f47a4079450 con 0x7f47b013b540 2023-05-10T01:45:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.633+0000 7f47aeffd700 1 -- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 msgr2=0x7f4790061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.633+0000 7f47aeffd700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 0x7f4790061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.637+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47a40478f0 con 0x7f47b013b540 2023-05-10T01:45:03.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.810+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b00c0440 con 0x7f47b013b540 2023-05-10T01:45:03.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.811+0000 7f4796ffd700 1 -- 172.21.15.52:0/1709630005 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+17959 (secure 0 0 0) 0x7f47a404a710 con 0x7f47b013b540 2023-05-10T01:45:03.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:03.814 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":159,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:44:52.854207+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.c","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3028926924":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/182619327":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6833/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6832/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/2579392615":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/4028064579":"2023-05-11T01:43:50.995332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:03.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 msgr2=0x7f4790061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:03.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 0x7f4790061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 msgr2=0x7f47b00c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f47a400c490 tx=0x7f47a4007d20).stop 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 shutdown_connections 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f479005ee80 0x7f4790061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b013b920 0x7f47b00c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47b0063e20 0x7f47b0139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 --2- 172.21.15.52:0/1709630005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47b013b540 0x7f47b00c2210 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 >> 172.21.15.52:0/1709630005 conn(0x7f47b00c8a90 msgr2=0x7f47b00c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 shutdown_connections 2023-05-10T01:45:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.813+0000 7f47b54ee700 1 -- 172.21.15.52:0/1709630005 wait complete. 2023-05-10T01:45:03.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:43:37.127268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:43:37.545123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:45:03.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:45:03.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.949+0000 7f6608369700 1 Processor -- start 2023-05-10T01:45:03.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.949+0000 7f6608369700 1 -- start start 2023-05-10T01:45:03.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.950+0000 7f6608369700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6600155130 0x7f66000622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.950+0000 7f6608369700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6600062790 0x7f66000635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.950+0000 7f6608369700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660014eac0 con 0x7f660014e6e0 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.950+0000 7f6608369700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6600154ca0 con 0x7f6600062790 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.950+0000 7f6608369700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000c6010 con 0x7f6600155130 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6600062790 0x7f66000635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606105700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f660014e6e0 0x7f66000c4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50750/0 (socket says 172.21.15.52:50750) 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6600062790 0x7f66000635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41734/0 (socket says 172.21.15.52:41734) 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606105700 1 -- 172.21.15.52:0/1101524973 learned_addr learned my addr 172.21.15.52:0/1101524973 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:03.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 -- 172.21.15.52:0/1101524973 >> v2:172.21.15.172:3300/0 conn(0x7f6600155130 msgr2=0x7f66000622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 --2- 172.21.15.52:0/1101524973 >> v2:172.21.15.172:3300/0 conn(0x7f6600155130 0x7f66000622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 -- 172.21.15.52:0/1101524973 >> v1:172.21.15.52:6789/0 conn(0x7f660014e6e0 legacy=0x7f66000c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6605103700 1 -- 172.21.15.52:0/1101524973 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102401070 0 0) 0x7f660014eac0 con 0x7f660014e6e0 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 -- 172.21.15.52:0/1101524973 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600154650 con 0x7f6600062790 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6606906700 1 --2- 172.21.15.52:0/1101524973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f66000635f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f66000660b0 tx=0x7f65f8009780).ready entity=mon.0 client_cookie=213b5351f6c96f71 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6605103700 1 -- 172.21.15.52:0/1101524973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800e070 con 0x7f6600062790 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6605103700 1 -- 172.21.15.52:0/1101524973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f800bc30 con 0x7f6600062790 2023-05-10T01:45:03.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.951+0000 7f6605103700 1 -- 172.21.15.52:0/1101524973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8012410 con 0x7f6600062790 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 -- 172.21.15.52:0/1101524973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 msgr2=0x7f66000635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 --2- 172.21.15.52:0/1101524973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f66000635f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f66000660b0 tx=0x7f65f8009780).stop 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 -- 172.21.15.52:0/1101524973 shutdown_connections 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 --2- 172.21.15.52:0/1101524973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f66000635f0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 --2- 172.21.15.52:0/1101524973 >> v2:172.21.15.172:3300/0 conn(0x7f6600155130 0x7f66000622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 -- 172.21.15.52:0/1101524973 >> 172.21.15.52:0/1101524973 conn(0x7f660005e810 msgr2=0x7f66000c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 -- 172.21.15.52:0/1101524973 shutdown_connections 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.952+0000 7f6608369700 1 -- 172.21.15.52:0/1101524973 wait complete. 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.953+0000 7f6608369700 1 Processor -- start 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.953+0000 7f6608369700 1 -- start start 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f660014e6e0 0x7f66000aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6600155130 0x7f660013ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66000c0400 con 0x7f6600062790 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66000ae380 con 0x7f6600155130 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6608369700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66000ae660 con 0x7f660014e6e0 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41738/0 (socket says 172.21.15.52:41738) 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 -- 172.21.15.52:0/3427187073 learned_addr learned my addr 172.21.15.52:0/3427187073 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6605904700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f660014e6e0 0x7f66000aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:03.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f660014e6e0 msgr2=0x7f66000aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f660014e6e0 0x7f66000aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6600155130 msgr2=0x7f660013ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6600155130 0x7f660013ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 -- 172.21.15.52:0/3427187073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8009a20 con 0x7f6600062790 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f6606105700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f65fc00c4e0 tx=0x7f65fc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.954+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0072e0 con 0x7f6600062790 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.955+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc007440 con 0x7f6600062790 2023-05-10T01:45:03.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.955+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0057a0 con 0x7f6600062790 2023-05-10T01:45:03.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.955+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66000abf20 con 0x7f6600062790 2023-05-10T01:45:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.955+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66000ae940 con 0x7f6600062790 2023-05-10T01:45:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660006c340 con 0x7f6600062790 2023-05-10T01:45:03.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f65fc010070 con 0x7f6600062790 2023-05-10T01:45:03.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f65f27fc700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 0x7f65e0061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:03.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7f65fc079680 con 0x7f6600062790 2023-05-10T01:45:03.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f6605904700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 msgr2=0x7f65e0061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:03.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.956+0000 7f6605904700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 0x7f65e0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:03.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:03.960+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65fc04a940 con 0x7f6600062790 2023-05-10T01:45:04.009 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.006+0000 7f2a8ebe8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:04.079 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:04.075+0000 7f6770236680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:04.079 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.077+0000 7f2a8ebe8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:04.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:45:04.107 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:45:04.149 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:04.146+0000 7f6770236680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:04.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.157+0000 7f6605904700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 msgr2=0x7f65e0061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:04.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.157+0000 7f6605904700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 0x7f65e0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:04.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.183+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f66000c6690 con 0x7f6600062790 2023-05-10T01:45:04.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.183+0000 7f65f27fc700 1 -- 172.21.15.52:0/3427187073 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7f65fc04df60 con 0x7f6600062790 2023-05-10T01:45:04.187 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:45:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 msgr2=0x7f65e0061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 0x7f65e0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 msgr2=0x7f660014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f65fc00c4e0 tx=0x7f65fc007c70).stop 2023-05-10T01:45:04.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 shutdown_connections 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f65e005ee80 0x7f65e0061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6600155130 0x7f660013ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6600062790 0x7f660014ccf0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 --2- 172.21.15.52:0/3427187073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f660014e6e0 0x7f66000aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 >> 172.21.15.52:0/3427187073 conn(0x7f660005e810 msgr2=0x7f66000a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 shutdown_connections 2023-05-10T01:45:04.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.185+0000 7f6608369700 1 -- 172.21.15.52:0/3427187073 wait complete. 2023-05-10T01:45:04.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:45:04.268 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.265+0000 7f2a8ebe8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:04.346 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:04.343+0000 7f6770236680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.359+0000 7fcf24a1a700 1 Processor -- start 2023-05-10T01:45:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.359+0000 7fcf24a1a700 1 -- start start 2023-05-10T01:45:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.360+0000 7fcf24a1a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf200a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.360+0000 7fcf24a1a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2014e930 con 0x7fcf201549d0 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.360+0000 7fcf24a1a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2006a380 con 0x7fcf20068a60 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.360+0000 7fcf24a1a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20137420 con 0x7fcf200a4a30 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1dd9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcf201549d0 0x7fcf20154e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50778/0 (socket says 172.21.15.52:50778) 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1dd9b700 1 -- 172.21.15.52:0/1110927060 learned_addr learned my addr 172.21.15.52:0/1110927060 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf200a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211009193 0 0) 0x7fcf2014e930 con 0x7fcf201549d0 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf000033f0 con 0x7fcf201549d0 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41252125 0 0) 0x7fcf2006a380 con 0x7fcf20068a60 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2014e930 con 0x7fcf20068a60 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622828927 0 0) 0x7fcf000033f0 con 0x7fcf201549d0 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 msgr2=0x7fcf200a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf200a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 >> v1:172.21.15.172:6789/0 conn(0x7fcf20068a60 legacy=0x7fcf20068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20069770 con 0x7fcf201549d0 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fcf08001470 con 0x7fcf201549d0 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 >> v1:172.21.15.52:6789/0 conn(0x7fcf201549d0 legacy=0x7fcf20154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf00003ad0 0x7fcf00003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf00004690 0x7fcf00004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf00005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180015b0 con 0x7fcf00003ad0 2023-05-10T01:45:04.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20137420 con 0x7fcf00004690 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0000b930 con 0x7fcf200a4a30 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.361+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf00003ad0 0x7fcf00003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1dd9b700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf00004690 0x7fcf00004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1ed9d700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf00005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 -- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 msgr2=0x7fcf00005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf00005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 -- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf00004690 msgr2=0x7fcf00004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf00004690 0x7fcf00004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 -- 172.21.15.52:0/1110927060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000033f0 con 0x7fcf00003ad0 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1ed9d700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf200a4a30 0x7fcf00005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf00003ad0 0x7fcf00003eb0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fcf10009a80 tx=0x7fcf10009060).ready entity=mon.0 client_cookie=51d6059dacbe9291 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10009430 con 0x7fcf00003ad0 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000e640 con 0x7fcf00003ad0 2023-05-10T01:45:04.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.362+0000 7fcf1d59a700 1 -- 172.21.15.52:0/1110927060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000e9c0 con 0x7fcf00003ad0 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 -- 172.21.15.52:0/1110927060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf00003ad0 msgr2=0x7fcf00003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/1110927060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf00003ad0 0x7fcf00003eb0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fcf10009a80 tx=0x7fcf10009060).stop 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf1ed9d700 1 -- 172.21.15.52:0/1110927060 reap_dead start 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 -- 172.21.15.52:0/1110927060 shutdown_connections 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 -- 172.21.15.52:0/1110927060 >> 172.21.15.52:0/1110927060 conn(0x7fcf200c4610 msgr2=0x7fcf20066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 -- 172.21.15.52:0/1110927060 shutdown_connections 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.363+0000 7fcf24a1a700 1 -- 172.21.15.52:0/1110927060 wait complete. 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.364+0000 7fcf24a1a700 1 Processor -- start 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.364+0000 7fcf24a1a700 1 -- start start 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 0x7fcf200a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf20163bc0 0x7fcf200a8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200a6b60 con 0x7fcf201368b0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20164110 con 0x7fcf20163bc0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf24a1a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201643f0 con 0x7fcf00003ad0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41776/0 (socket says 172.21.15.52:41776) 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 -- 172.21.15.52:0/3854351909 learned_addr learned my addr 172.21.15.52:0/3854351909 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 0x7fcf200a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1dd9b700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf20163bc0 0x7fcf200a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 -- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 msgr2=0x7fcf200a7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 0x7fcf200a7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 -- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf20163bc0 msgr2=0x7fcf200a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf20163bc0 0x7fcf200a8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 -- 172.21.15.52:0/3854351909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf201646d0 con 0x7fcf201368b0 2023-05-10T01:45:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 0x7fcf200a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.365+0000 7fcf1ed9d700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fcf18007fd0 tx=0x7fcf18007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.366+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18006c10 con 0x7fcf201368b0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.366+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18006d70 con 0x7fcf201368b0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.366+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf201649b0 con 0x7fcf201368b0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.366+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800dc10 con 0x7fcf201368b0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.366+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200a8d50 con 0x7fcf201368b0 2023-05-10T01:45:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.367+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf200a6cd0 con 0x7fcf201368b0 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.368+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fcf18007030 con 0x7fcf201368b0 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.368+0000 7fcf167fc700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 0x7fcf04061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.368+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7fcf1807aec0 con 0x7fcf201368b0 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.368+0000 7fcf1e59c700 1 -- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 msgr2=0x7fcf04061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.368+0000 7fcf1e59c700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 0x7fcf04061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.372+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf1804c0f0 con 0x7fcf201368b0 2023-05-10T01:45:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.547+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf20069a50 con 0x7fcf201368b0 2023-05-10T01:45:04.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.548+0000 7fcf167fc700 1 -- 172.21.15.52:0/3854351909 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf18079150 con 0x7fcf201368b0 2023-05-10T01:45:04.551 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:45:04.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 msgr2=0x7fcf04061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:04.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 0x7fcf04061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 msgr2=0x7fcf200aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7fcf18007fd0 tx=0x7fcf18007e90).stop 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 shutdown_connections 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcf0405eeb0 0x7fcf04061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf201368b0 0x7fcf200aacc0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf00003ad0 0x7fcf200a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 --2- 172.21.15.52:0/3854351909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf20163bc0 0x7fcf200a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 >> 172.21.15.52:0/3854351909 conn(0x7fcf200c4610 msgr2=0x7fcf200c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:04.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 shutdown_connections 2023-05-10T01:45:04.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.550+0000 7fcf24a1a700 1 -- 172.21.15.52:0/3854351909 wait complete. 2023-05-10T01:45:04.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:45:04.687 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.685+0000 7f2a8ebe8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:04.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.685+0000 7f20eb4ce700 1 Processor -- start 2023-05-10T01:45:04.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.685+0000 7f20eb4ce700 1 -- start start 2023-05-10T01:45:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eb4ce700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20e4153f80 0x7f20e40a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eb4ce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f20e40c5cf0 0x7f20e40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eb4ce700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e40c6690 con 0x7f20e40c0140 2023-05-10T01:45:04.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eb4ce700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e4069f50 con 0x7f20e4153f80 2023-05-10T01:45:04.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eb4ce700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e406a9d0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20e4153f80 0x7f20e40a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eaccd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20e40c0140 0x7f20e40c0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50800/0 (socket says 172.21.15.52:50800) 2023-05-10T01:45:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20eaccd700 1 -- 172.21.15.52:0/689152553 learned_addr learned my addr 172.21.15.52:0/689152553 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20e9ccb700 1 --2- 172.21.15.52:0/689152553 >> v2:172.21.15.172:3300/0 conn(0x7f20e40c5cf0 0x7f20e40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 -- 172.21.15.52:0/689152553 >> v2:172.21.15.172:3300/0 conn(0x7f20e40c5cf0 msgr2=0x7f20e40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 --2- 172.21.15.52:0/689152553 >> v2:172.21.15.172:3300/0 conn(0x7f20e40c5cf0 0x7f20e40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 -- 172.21.15.52:0/689152553 >> v1:172.21.15.52:6789/0 conn(0x7f20e40c0140 legacy=0x7f20e40c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20e94ca700 1 -- 172.21.15.52:0/689152553 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020359738 0 0) 0x7f20dc001490 con 0x7f20e40c0140 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 -- 172.21.15.52:0/689152553 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e406a130 con 0x7f20e4153f80 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.686+0000 7f20ea4cc700 1 --2- 172.21.15.52:0/689152553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e4153f80 0x7f20e40a9d10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f20e40c8230 tx=0x7f20e0009060).ready entity=mon.0 client_cookie=e76e43f652aa46a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:04.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20e94ca700 1 -- 172.21.15.52:0/689152553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f510 con 0x7f20e4153f80 2023-05-10T01:45:04.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20e94ca700 1 -- 172.21.15.52:0/689152553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000f670 con 0x7f20e4153f80 2023-05-10T01:45:04.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20e94ca700 1 -- 172.21.15.52:0/689152553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f9f0 con 0x7f20e4153f80 2023-05-10T01:45:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 -- 172.21.15.52:0/689152553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e4153f80 msgr2=0x7f20e40a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/689152553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e4153f80 0x7f20e40a9d10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f20e40c8230 tx=0x7f20e0009060).stop 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 -- 172.21.15.52:0/689152553 shutdown_connections 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/689152553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e4153f80 0x7f20e40a9d10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/689152553 >> v2:172.21.15.172:3300/0 conn(0x7f20e40c5cf0 0x7f20e40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 -- 172.21.15.52:0/689152553 >> 172.21.15.52:0/689152553 conn(0x7f20e40cb5f0 msgr2=0x7f20e40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 -- 172.21.15.52:0/689152553 shutdown_connections 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.687+0000 7f20eb4ce700 1 -- 172.21.15.52:0/689152553 wait complete. 2023-05-10T01:45:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.688+0000 7f20eb4ce700 1 Processor -- start 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.688+0000 7f20eb4ce700 1 -- start start 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20e40c0140 0x7f20e414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e4153f80 0x7f20e4152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c37a0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c2b90 con 0x7f20e4153f80 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eb4ce700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c2e70 con 0x7f20e40c0140 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20e9ccb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20e9ccb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41788/0 (socket says 172.21.15.52:41788) 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20e9ccb700 1 -- 172.21.15.52:0/2829229785 learned_addr learned my addr 172.21.15.52:0/2829229785 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20ea4cc700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20e40c0140 0x7f20e414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.689+0000 7f20eaccd700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e4153f80 0x7f20e4152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 -- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20e40c0140 msgr2=0x7f20e414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20e40c0140 0x7f20e414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 -- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e4153f80 msgr2=0x7f20e4152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e4153f80 0x7f20e4152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 -- 172.21.15.52:0/2829229785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00092a0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20e9ccb700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f20d400e930 tx=0x7f20d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4012600 con 0x7f20e40c5cf0 2023-05-10T01:45:04.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4012760 con 0x7f20e40c5cf0 2023-05-10T01:45:04.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e40c3150 con 0x7f20e40c5cf0 2023-05-10T01:45:04.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4012ae0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.690+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e40c3c30 con 0x7f20e40c5cf0 2023-05-10T01:45:04.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.691+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4083110 con 0x7f20e40c5cf0 2023-05-10T01:45:04.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.691+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f20d4022070 con 0x7f20e40c5cf0 2023-05-10T01:45:04.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.692+0000 7f20d27fc700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 0x7f20c4061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:04.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.692+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6729+0+0 (secure 0 0 0) 0x7f20d407a1d0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.692+0000 7f20ea4cc700 1 -- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 msgr2=0x7f20c4061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:04.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.692+0000 7f20ea4cc700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 0x7f20c4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:04.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.696+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20d404b490 con 0x7f20e40c5cf0 2023-05-10T01:45:04.791 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.789+0000 7f2a8ebe8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:04.793 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:04.790+0000 7f6770236680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:04.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.870+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20e4047150 con 0x7f20e40c5cf0 2023-05-10T01:45:04.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.870+0000 7f20d27fc700 1 -- 172.21.15.52:0/2829229785 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20d404eab0 con 0x7f20e40c5cf0 2023-05-10T01:45:04.874 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:45:04.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.872+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 msgr2=0x7f20c4061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:04.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.872+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 0x7f20c4061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.872+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 msgr2=0x7f20e4164990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:04.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.872+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f20d400e930 tx=0x7f20d4009060).stop 2023-05-10T01:45:04.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.872+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 shutdown_connections 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f20c405ee80 0x7f20c4061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e4153f80 0x7f20e4152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20e40c0140 0x7f20e414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 --2- 172.21.15.52:0/2829229785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e40c5cf0 0x7f20e4164990 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 >> 172.21.15.52:0/2829229785 conn(0x7f20e40cb5f0 msgr2=0x7f20e40aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 shutdown_connections 2023-05-10T01:45:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:04.873+0000 7f20eb4ce700 1 -- 172.21.15.52:0/2829229785 wait complete. 2023-05-10T01:45:04.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:45:04.903 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:04.900+0000 7f6770236680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:04.948 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:04.946+0000 7f2a8ebe8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:05.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.011+0000 7f4903790700 1 Processor -- start 2023-05-10T01:45:05.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.011+0000 7f4903790700 1 -- start start 2023-05-10T01:45:05.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4903790700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 0x7f48fc068a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4903790700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 0x7f48fc066480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4903790700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc069c50 con 0x7f48fc155830 2023-05-10T01:45:05.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4903790700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc135370 con 0x7f48fc064a40 2023-05-10T01:45:05.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4903790700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc069040 con 0x7f48fc06a0e0 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4901d2d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f48fc155830 0x7f48fc0bc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50814/0 (socket says 172.21.15.52:50814) 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4901d2d700 1 -- 172.21.15.52:0/2638497880 learned_addr learned my addr 172.21.15.52:0/2638497880 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f490152c700 1 --2- 172.21.15.52:0/2638497880 >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 0x7f48fc068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.012+0000 7f4900d2b700 1 --2- 172.21.15.52:0/2638497880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 0x7f48fc066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f48ebfff700 1 -- 172.21.15.52:0/2638497880 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608332014 0 0) 0x7f48fc069c50 con 0x7f48fc155830 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f48ebfff700 1 -- 172.21.15.52:0/2638497880 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e40033f0 con 0x7f48fc155830 2023-05-10T01:45:05.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f4900d2b700 1 -- 172.21.15.52:0/2638497880 >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 msgr2=0x7f48fc068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f4900d2b700 1 --2- 172.21.15.52:0/2638497880 >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 0x7f48fc068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f4900d2b700 1 -- 172.21.15.52:0/2638497880 >> v1:172.21.15.52:6789/0 conn(0x7f48fc155830 legacy=0x7f48fc0bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f4900d2b700 1 -- 172.21.15.52:0/2638497880 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc069320 con 0x7f48fc06a0e0 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f490152c700 1 --2- 172.21.15.52:0/2638497880 >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 0x7f48fc068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f4900d2b700 1 --2- 172.21.15.52:0/2638497880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 0x7f48fc066480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f48f8009760 tx=0x7f48f8009060).ready entity=mon.2 client_cookie=b61529c6f681b07c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f48ebfff700 1 -- 172.21.15.52:0/2638497880 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800d4a0 con 0x7f48fc06a0e0 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f48ebfff700 1 -- 172.21.15.52:0/2638497880 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800d600 con 0x7f48fc06a0e0 2023-05-10T01:45:05.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.013+0000 7f48ebfff700 1 -- 172.21.15.52:0/2638497880 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800d980 con 0x7f48fc06a0e0 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 -- 172.21.15.52:0/2638497880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 msgr2=0x7f48fc066480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 --2- 172.21.15.52:0/2638497880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 0x7f48fc066480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f48f8009760 tx=0x7f48f8009060).stop 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 -- 172.21.15.52:0/2638497880 shutdown_connections 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 --2- 172.21.15.52:0/2638497880 >> v2:172.21.15.172:3300/0 conn(0x7f48fc064a40 0x7f48fc068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 --2- 172.21.15.52:0/2638497880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc06a0e0 0x7f48fc066480 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 -- 172.21.15.52:0/2638497880 >> 172.21.15.52:0/2638497880 conn(0x7f48fc0c4610 msgr2=0x7f48fc066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 -- 172.21.15.52:0/2638497880 shutdown_connections 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.014+0000 7f4903790700 1 -- 172.21.15.52:0/2638497880 wait complete. 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.015+0000 7f4903790700 1 Processor -- start 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.015+0000 7f4903790700 1 -- start start 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc064a40 0x7f48fc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48fc06a0e0 0x7f48fc164e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc165350 con 0x7f48fc155830 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc164be0 con 0x7f48fc06a0e0 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4903790700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0acf30 con 0x7f48fc064a40 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4901d2d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4901d2d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41804/0 (socket says 172.21.15.52:41804) 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4901d2d700 1 -- 172.21.15.52:0/369923165 learned_addr learned my addr 172.21.15.52:0/369923165 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f4900d2b700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48fc06a0e0 0x7f48fc164e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.016+0000 7f490152c700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc064a40 0x7f48fc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 -- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc064a40 msgr2=0x7f48fc0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc064a40 0x7f48fc0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 -- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48fc06a0e0 msgr2=0x7f48fc164e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48fc06a0e0 0x7f48fc164e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 -- 172.21.15.52:0/369923165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0092a0 con 0x7f48fc155830 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f4901d2d700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f48f4005ad0 tx=0x7f48f40015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005d30 con 0x7f48fc155830 2023-05-10T01:45:05.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4005e90 con 0x7f48fc155830 2023-05-10T01:45:05.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.017+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40072e0 con 0x7f48fc155830 2023-05-10T01:45:05.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.018+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80092a0 con 0x7f48fc155830 2023-05-10T01:45:05.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.018+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc0a8800 con 0x7f48fc155830 2023-05-10T01:45:05.025 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:05.021+0000 7f2a8ebe8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc06c340 con 0x7f48fc155830 2023-05-10T01:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f48f4010070 con 0x7f48fc155830 2023-05-10T01:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f48e97fa700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 0x7f48dc061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f48f4079660 con 0x7f48fc155830 2023-05-10T01:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f490152c700 1 -- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 msgr2=0x7f48dc061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.019+0000 7f490152c700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 0x7f48dc061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.023+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48f404a8e0 con 0x7f48fc155830 2023-05-10T01:45:05.069 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:05.066+0000 7f6770236680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:05.091 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:05.089+0000 7f2a8ebe8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:05.148 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:05.145+0000 7f6770236680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.200+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48fc0a8e40 con 0x7f48fc155830 2023-05-10T01:45:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.200+0000 7f48e97fa700 1 -- 172.21.15.52:0/369923165 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48fc0a8e40 con 0x7f48fc155830 2023-05-10T01:45:05.204 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:45:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 msgr2=0x7f48dc061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 0x7f48dc061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 msgr2=0x7f48fc1646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f48f4005ad0 tx=0x7f48f40015b0).stop 2023-05-10T01:45:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 shutdown_connections 2023-05-10T01:45:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f48dc05eeb0 0x7f48dc061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48fc155830 0x7f48fc1646f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48fc064a40 0x7f48fc0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.202+0000 7f4903790700 1 --2- 172.21.15.52:0/369923165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48fc06a0e0 0x7f48fc164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.203+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 >> 172.21.15.52:0/369923165 conn(0x7f48fc0c4610 msgr2=0x7f48fc154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.203+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 shutdown_connections 2023-05-10T01:45:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.203+0000 7f4903790700 1 -- 172.21.15.52:0/369923165 wait complete. 2023-05-10T01:45:05.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:05.224 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:05.220+0000 7f6770236680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:05.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.339+0000 7f963abe9700 1 Processor -- start 2023-05-10T01:45:05.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.339+0000 7f963abe9700 1 -- start start 2023-05-10T01:45:05.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f963abe9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9634154030 0x7f9634069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f963abe9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f9634062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f963abe9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9634062950 con 0x7f9634063710 2023-05-10T01:45:05.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f963abe9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9634154410 con 0x7f9634154030 2023-05-10T01:45:05.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f963abe9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9634069fa0 con 0x7f96340bf4e0 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9634154030 0x7f9634069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9634154030 0x7f9634069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41808/0 (socket says 172.21.15.52:41808) 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 -- 172.21.15.52:0/2174668479 learned_addr learned my addr 172.21.15.52:0/2174668479 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9633fff700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f9634062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 -- 172.21.15.52:0/2174668479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 msgr2=0x7f9634062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:05.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f9634062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 -- 172.21.15.52:0/2174668479 >> v1:172.21.15.172:6789/0 conn(0x7f9634063710 legacy=0x7f96340bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 -- 172.21.15.52:0/2174668479 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634062340 con 0x7f9634154030 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f9638985700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f9634069ab0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f9628006fd0 tx=0x7f96280090f0).ready entity=mon.0 client_cookie=6f09ec522ccdffd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f96337fe700 1 -- 172.21.15.52:0/2174668479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800b580 con 0x7f9634154030 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.340+0000 7f96337fe700 1 -- 172.21.15.52:0/2174668479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b6e0 con 0x7f9634154030 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f96337fe700 1 -- 172.21.15.52:0/2174668479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800ba60 con 0x7f9634154030 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 -- 172.21.15.52:0/2174668479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 msgr2=0x7f9634069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f9634069ab0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f9628006fd0 tx=0x7f96280090f0).stop 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 -- 172.21.15.52:0/2174668479 shutdown_connections 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f9634069ab0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 --2- 172.21.15.52:0/2174668479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f9634062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 -- 172.21.15.52:0/2174668479 >> 172.21.15.52:0/2174668479 conn(0x7f96340c8a90 msgr2=0x7f96340c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 -- 172.21.15.52:0/2174668479 shutdown_connections 2023-05-10T01:45:05.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.341+0000 7f963abe9700 1 -- 172.21.15.52:0/2174668479 wait complete. 2023-05-10T01:45:05.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.342+0000 7f963abe9700 1 Processor -- start 2023-05-10T01:45:05.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.342+0000 7f963abe9700 1 -- start start 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 0x7f96340a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f96340ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963414bed0 con 0x7f9634154030 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c0bd0 con 0x7f9634063710 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f963abe9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c0e20 con 0x7f96340bf4e0 2023-05-10T01:45:05.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f9639186700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f9639186700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41818/0 (socket says 172.21.15.52:41818) 2023-05-10T01:45:05.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f9639186700 1 -- 172.21.15.52:0/876383823 learned_addr learned my addr 172.21.15.52:0/876383823 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:05.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f9638985700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 0x7f96340a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.343+0000 7f9633fff700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f96340ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 msgr2=0x7f96340ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f96340ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 msgr2=0x7f96340ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 -- 172.21.15.52:0/876383823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628009370 con 0x7f9634063710 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9639186700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9638985700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 0x7f96340a7d60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f96340bf0b0 tx=0x7f9628017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628000bc0 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b850 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96340c1100 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962801c670 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.344+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96340c16c0 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.345+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96340c0f60 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.345+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f962802c070 con 0x7f9634063710 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.346+0000 7f9630ff9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 0x7f961c061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.346+0000 7f9633fff700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 msgr2=0x7f961c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.346+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f962807b900 con 0x7f9634063710 2023-05-10T01:45:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.346+0000 7f9633fff700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 0x7f961c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:05.355 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:05.348+0000 7f2a8ebe8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.350+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96340c0f60 con 0x7f9634063710 2023-05-10T01:45:05.504 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:05.501+0000 7f6770236680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:05.536 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:05.533+0000 7f2a8ebe8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.547+0000 7f9633fff700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 msgr2=0x7f961c061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.547+0000 7f9633fff700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 0x7f961c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:05.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.574+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96340c0f60 con 0x7f9634063710 2023-05-10T01:45:05.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.575+0000 7f9630ff9700 1 -- 172.21.15.52:0/876383823 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f96340c0f60 con 0x7f9634063710 2023-05-10T01:45:05.578 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:05.579 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:45:05.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 msgr2=0x7f961c061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:05.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 0x7f961c061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 msgr2=0x7f96340a7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 0x7f96340a7d60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f96340bf0b0 tx=0x7f9628017000).stop 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 shutdown_connections 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f961c05eeb0 0x7f961c061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9634154030 0x7f96340ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9634063710 0x7f96340a7d60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 --2- 172.21.15.52:0/876383823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96340bf4e0 0x7f96340ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 >> 172.21.15.52:0/876383823 conn(0x7f96340c8a90 msgr2=0x7f96340c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 shutdown_connections 2023-05-10T01:45:05.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.577+0000 7f963abe9700 1 -- 172.21.15.52:0/876383823 wait complete. 2023-05-10T01:45:05.583 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:45:05.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:05.699 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:05.696+0000 7f6770236680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:05.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.716+0000 7fcd11973700 1 Processor -- start 2023-05-10T01:45:05.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 -- start start 2023-05-10T01:45:05.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd0c154160 0x7fcd0c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c069da0 0x7fcd0c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0c0650 con 0x7fcd0c154540 2023-05-10T01:45:05.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c1af0 con 0x7fcd0c154160 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd11973700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0bfd20 con 0x7fcd0c069da0 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.717+0000 7fcd0affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd0c154160 0x7fcd0c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd0c154160 0x7fcd0c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41824/0 (socket says 172.21.15.52:41824) 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 -- 172.21.15.52:0/3402105314 learned_addr learned my addr 172.21.15.52:0/3402105314 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0b7fe700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c069da0 0x7fcd0c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 -- 172.21.15.52:0/3402105314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c069da0 msgr2=0x7fcd0c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c069da0 0x7fcd0c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 -- 172.21.15.52:0/3402105314 >> v1:172.21.15.172:6789/0 conn(0x7fcd0c154540 legacy=0x7fcd0c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 -- 172.21.15.52:0/3402105314 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0c0000 con 0x7fcd0c154160 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd0affd700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154160 0x7fcd0c0c5c60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fccfc006fd0 tx=0x7fccfc0090f0).ready entity=mon.0 client_cookie=49e25bdcb071b59f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd09ffb700 1 -- 172.21.15.52:0/3402105314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00b580 con 0x7fcd0c154160 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd09ffb700 1 -- 172.21.15.52:0/3402105314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00b6e0 con 0x7fcd0c154160 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.718+0000 7fcd09ffb700 1 -- 172.21.15.52:0/3402105314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00ba80 con 0x7fcd0c154160 2023-05-10T01:45:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 -- 172.21.15.52:0/3402105314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154160 msgr2=0x7fcd0c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154160 0x7fcd0c0c5c60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fccfc006fd0 tx=0x7fccfc0090f0).stop 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 -- 172.21.15.52:0/3402105314 shutdown_connections 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c069da0 0x7fcd0c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 --2- 172.21.15.52:0/3402105314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154160 0x7fcd0c0c5c60 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 -- 172.21.15.52:0/3402105314 >> 172.21.15.52:0/3402105314 conn(0x7fcd0c0cb6f0 msgr2=0x7fcd0c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 -- 172.21.15.52:0/3402105314 shutdown_connections 2023-05-10T01:45:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.719+0000 7fcd11973700 1 -- 172.21.15.52:0/3402105314 wait complete. 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.720+0000 7fcd11973700 1 Processor -- start 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.720+0000 7fcd11973700 1 -- start start 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c069da0 0x7fcd0c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c154160 0x7fcd0c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c31c0 con 0x7fcd0c154540 2023-05-10T01:45:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c44c0 con 0x7fcd0c069da0 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd11973700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c38b0 con 0x7fcd0c154160 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41834/0 (socket says 172.21.15.52:41834) 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 -- 172.21.15.52:0/891622419 learned_addr learned my addr 172.21.15.52:0/891622419 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0affd700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c069da0 0x7fcd0c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0a7fc700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c154160 0x7fcd0c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 -- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c154160 msgr2=0x7fcd0c145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c154160 0x7fcd0c145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 -- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c069da0 msgr2=0x7fcd0c0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c069da0 0x7fcd0c0c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 -- 172.21.15.52:0/891622419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009370 con 0x7fcd0c154540 2023-05-10T01:45:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.721+0000 7fcd0b7fe700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fcd04009ef0 tx=0x7fcd0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400cb70 con 0x7fcd0c154540 2023-05-10T01:45:05.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0400f040 con 0x7fcd0c154540 2023-05-10T01:45:05.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04013400 con 0x7fcd0c154540 2023-05-10T01:45:05.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0c3b90 con 0x7fcd0c154540 2023-05-10T01:45:05.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0c41d0 con 0x7fcd0c154540 2023-05-10T01:45:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.722+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0666b0 con 0x7fcd0c154540 2023-05-10T01:45:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.723+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fcd040137b0 con 0x7fcd0c154540 2023-05-10T01:45:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.724+0000 7fcd02ffd700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 0x7fccf0061340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.724+0000 7fcd0affd700 1 -- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 msgr2=0x7fccf0061340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.724+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcd0407a800 con 0x7fcd0c154540 2023-05-10T01:45:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.724+0000 7fcd0affd700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 0x7fccf0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.727+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd0404ba80 con 0x7fcd0c154540 2023-05-10T01:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.902+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd0c0c4630 con 0x7fcd0c154540 2023-05-10T01:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.903+0000 7fcd02ffd700 1 -- 172.21.15.52:0/891622419 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18071 (secure 0 0 0) 0x7fcd0404f0a0 con 0x7fcd0c154540 2023-05-10T01:45:05.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:05.907 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":160,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:04.917482+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":160,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.c","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3028926924":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/182619327":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6833/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6832/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/2579392615":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/4028064579":"2023-05-11T01:43:50.995332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.904+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 msgr2=0x7fccf0061340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.904+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 0x7fccf0061340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.904+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 msgr2=0x7fcd0c147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.904+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fcd04009ef0 tx=0x7fcd0400b040).stop 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.904+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 shutdown_connections 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fccf005ee80 0x7fccf0061340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c154540 0x7fcd0c147fe0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c069da0 0x7fcd0c0c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 --2- 172.21.15.52:0/891622419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd0c154160 0x7fcd0c145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 >> 172.21.15.52:0/891622419 conn(0x7fcd0c0cb6f0 msgr2=0x7fcd0c0abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 shutdown_connections 2023-05-10T01:45:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:05.905+0000 7fcd11973700 1 -- 172.21.15.52:0/891622419 wait complete. 2023-05-10T01:45:05.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:45:05.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:06.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.037+0000 7fe1ea513700 1 Processor -- start 2023-05-10T01:45:06.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.037+0000 7fe1ea513700 1 -- start start 2023-05-10T01:45:06.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1ea513700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1e40c1090 0x7fe1e40ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1ea513700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e4158960 con 0x7fe1e4154e40 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1ea513700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e41552f0 con 0x7fe1e40c7370 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1ea513700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e4157d50 con 0x7fe1e40c1090 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e8d10700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1e4154e40 0x7fe1e40acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50890/0 (socket says 172.21.15.52:50890) 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e9d12700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1e40c1090 0x7fe1e40ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e8d10700 1 -- 172.21.15.52:0/3850029525 learned_addr learned my addr 172.21.15.52:0/3850029525 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:06.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1d3fff700 1 -- 172.21.15.52:0/3850029525 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903836735 0 0) 0x7fe1e4158960 con 0x7fe1e4154e40 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1d3fff700 1 -- 172.21.15.52:0/3850029525 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc0033f0 con 0x7fe1e4154e40 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e9d12700 1 -- 172.21.15.52:0/3850029525 >> v1:172.21.15.172:6789/0 conn(0x7fe1e40c7370 legacy=0x7fe1e40c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e9d12700 1 -- 172.21.15.52:0/3850029525 >> v1:172.21.15.52:6789/0 conn(0x7fe1e4154e40 legacy=0x7fe1e40acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e9d12700 1 -- 172.21.15.52:0/3850029525 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4158030 con 0x7fe1e40c1090 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.038+0000 7fe1e9d12700 1 --2- 172.21.15.52:0/3850029525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40ad250 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fe1e4158910 tx=0x7fe1dc009780).ready entity=mon.0 client_cookie=d2394ac515d5d412 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1d3fff700 1 -- 172.21.15.52:0/3850029525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00e070 con 0x7fe1e40c1090 2023-05-10T01:45:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1d3fff700 1 -- 172.21.15.52:0/3850029525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00bb60 con 0x7fe1e40c1090 2023-05-10T01:45:06.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1d3fff700 1 -- 172.21.15.52:0/3850029525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc012410 con 0x7fe1e40c1090 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 -- 172.21.15.52:0/3850029525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 msgr2=0x7fe1e40ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 --2- 172.21.15.52:0/3850029525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40ad250 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fe1e4158910 tx=0x7fe1dc009780).stop 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 -- 172.21.15.52:0/3850029525 shutdown_connections 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 --2- 172.21.15.52:0/3850029525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40ad250 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 -- 172.21.15.52:0/3850029525 >> 172.21.15.52:0/3850029525 conn(0x7fe1e4068320 msgr2=0x7fe1e4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 -- 172.21.15.52:0/3850029525 shutdown_connections 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.039+0000 7fe1ea513700 1 -- 172.21.15.52:0/3850029525 wait complete. 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.040+0000 7fe1ea513700 1 Processor -- start 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.040+0000 7fe1ea513700 1 -- start start 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1e40c7370 0x7fe1e4168180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e4154e40 0x7fe1e4141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ca4b0 con 0x7fe1e40c1090 2023-05-10T01:45:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ca790 con 0x7fe1e4154e40 2023-05-10T01:45:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1ea513700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40caa70 con 0x7fe1e40c7370 2023-05-10T01:45:06.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1e9511700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1e9511700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41878/0 (socket says 172.21.15.52:41878) 2023-05-10T01:45:06.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.041+0000 7fe1e9511700 1 -- 172.21.15.52:0/781546400 learned_addr learned my addr 172.21.15.52:0/781546400 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:06.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e8d10700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1e40c7370 0x7fe1e4168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9d12700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e4154e40 0x7fe1e4141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1e40c7370 msgr2=0x7fe1e4168180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1e40c7370 0x7fe1e4168180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e4154e40 msgr2=0x7fe1e4141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e4154e40 0x7fe1e4141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 -- 172.21.15.52:0/781546400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009a20 con 0x7fe1e40c1090 2023-05-10T01:45:06.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1e9511700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe1e000c4c0 tx=0x7fe1e0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000ce70 con 0x7fe1e40c1090 2023-05-10T01:45:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0001e90 con 0x7fe1e40c1090 2023-05-10T01:45:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0007250 con 0x7fe1e40c1090 2023-05-10T01:45:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40cad50 con 0x7fe1e40c1090 2023-05-10T01:45:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.042+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4168670 con 0x7fe1e40c1090 2023-05-10T01:45:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.043+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4047150 con 0x7fe1e40c1090 2023-05-10T01:45:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.044+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fe1e0010070 con 0x7fe1e40c1090 2023-05-10T01:45:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.044+0000 7fe1d17fa700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 0x7fe1c4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.044+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe1e0079ca0 con 0x7fe1e40c1090 2023-05-10T01:45:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.044+0000 7fe1e8d10700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 msgr2=0x7fe1c4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.044+0000 7fe1e8d10700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 0x7fe1c4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:06.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.048+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1e004a890 con 0x7fe1e40c1090 2023-05-10T01:45:06.196 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.194+0000 7f2a8ebe8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:06.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.245+0000 7fe1e8d10700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 msgr2=0x7fe1c4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:06.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.245+0000 7fe1e8d10700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 0x7fe1c4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:06.267 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.265+0000 7f2a8ebe8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.271+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1e40bfb80 con 0x7fe1e40c1090 2023-05-10T01:45:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.272+0000 7fe1d17fa700 1 -- 172.21.15.52:0/781546400 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fe1e0079e60 con 0x7fe1e40c1090 2023-05-10T01:45:06.275 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:06.275 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:45:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 msgr2=0x7fe1c4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 0x7fe1c4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 msgr2=0x7fe1e40c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe1e000c4c0 tx=0x7fe1e0007e00).stop 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 shutdown_connections 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe1c405eeb0 0x7fe1c4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e4154e40 0x7fe1e4141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1e40c1090 0x7fe1e40c9e10 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 --2- 172.21.15.52:0/781546400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1e40c7370 0x7fe1e4168180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 >> 172.21.15.52:0/781546400 conn(0x7fe1e4068320 msgr2=0x7fe1e4069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 shutdown_connections 2023-05-10T01:45:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.275+0000 7fe1ea513700 1 -- 172.21.15.52:0/781546400 wait complete. 2023-05-10T01:45:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:45:06.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:06.341 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.339+0000 7f2a8ebe8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:06.406 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.403+0000 7f6770236680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:06.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.410+0000 7fb3d5499700 1 Processor -- start 2023-05-10T01:45:06.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.410+0000 7fb3d5499700 1 -- start start 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3d5499700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3d0154160 0x7fb3d00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3d5499700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 0x7fb3d00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3d5499700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d00c0650 con 0x7fb3d0154540 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3d5499700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00c1af0 con 0x7fb3d0154160 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3d5499700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00bfd20 con 0x7fb3d0069da0 2023-05-10T01:45:06.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3d0154160 0x7fb3d00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb3d0154160 0x7fb3d00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41888/0 (socket says 172.21.15.52:41888) 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 -- 172.21.15.52:0/1992513562 learned_addr learned my addr 172.21.15.52:0/1992513562 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3cf7fe700 1 --2- 172.21.15.52:0/1992513562 >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 0x7fb3d00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 -- 172.21.15.52:0/1992513562 >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 msgr2=0x7fb3d00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 --2- 172.21.15.52:0/1992513562 >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 0x7fb3d00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 -- 172.21.15.52:0/1992513562 >> v1:172.21.15.172:6789/0 conn(0x7fb3d0154540 legacy=0x7fb3d0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3ceffd700 1 -- 172.21.15.52:0/1992513562 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00c0000 con 0x7fb3d0154160 2023-05-10T01:45:06.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.411+0000 7fb3cf7fe700 1 --2- 172.21.15.52:0/1992513562 >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 0x7fb3d00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:06.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3ceffd700 1 --2- 172.21.15.52:0/1992513562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d00c5c60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fb3d00c5200 tx=0x7fb3c00090f0).ready entity=mon.0 client_cookie=b5655cb2cdbf2c00 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3cdffb700 1 -- 172.21.15.52:0/1992513562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000b600 con 0x7fb3d0154160 2023-05-10T01:45:06.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3cdffb700 1 -- 172.21.15.52:0/1992513562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000b760 con 0x7fb3d0154160 2023-05-10T01:45:06.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3cdffb700 1 -- 172.21.15.52:0/1992513562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000bb00 con 0x7fb3d0154160 2023-05-10T01:45:06.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 -- 172.21.15.52:0/1992513562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 msgr2=0x7fb3d00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 --2- 172.21.15.52:0/1992513562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d00c5c60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fb3d00c5200 tx=0x7fb3c00090f0).stop 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 -- 172.21.15.52:0/1992513562 shutdown_connections 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 --2- 172.21.15.52:0/1992513562 >> v2:172.21.15.172:3300/0 conn(0x7fb3d0069da0 0x7fb3d00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 --2- 172.21.15.52:0/1992513562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d00c5c60 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 -- 172.21.15.52:0/1992513562 >> 172.21.15.52:0/1992513562 conn(0x7fb3d00cb6f0 msgr2=0x7fb3d00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 -- 172.21.15.52:0/1992513562 shutdown_connections 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.412+0000 7fb3d5499700 1 -- 172.21.15.52:0/1992513562 wait complete. 2023-05-10T01:45:06.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 Processor -- start 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 -- start start 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3d0069da0 0x7fb3d00c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3d0154540 0x7fb3d0151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00c4bd0 con 0x7fb3d0154160 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0150e20 con 0x7fb3d0154540 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.414+0000 7fb3d5499700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0150210 con 0x7fb3d0069da0 2023-05-10T01:45:06.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41896/0 (socket says 172.21.15.52:41896) 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 -- 172.21.15.52:0/3182082585 learned_addr learned my addr 172.21.15.52:0/3182082585 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ceffd700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3d0069da0 0x7fb3d00c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3cf7fe700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3d0154540 0x7fb3d0151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3d0069da0 msgr2=0x7fb3d00c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3d0069da0 0x7fb3d00c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3d0154540 msgr2=0x7fb3d0151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3d0154540 0x7fb3d0151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 -- 172.21.15.52:0/3182082585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0009370 con 0x7fb3d0154160 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3ce7fc700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fb3b800c440 tx=0x7fb3b8007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80123f0 con 0x7fb3d0154160 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8012550 con 0x7fb3d0154160 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80128f0 con 0x7fb3d0154160 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d01504f0 con 0x7fb3d0154160 2023-05-10T01:45:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.415+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d0150ab0 con 0x7fb3d0154160 2023-05-10T01:45:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fb3b8010070 con 0x7fb3d0154160 2023-05-10T01:45:06.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d00666b0 con 0x7fb3d0154160 2023-05-10T01:45:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3c6ffd700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 0x7fb3b4061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fb3b8079180 con 0x7fb3d0154160 2023-05-10T01:45:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3ceffd700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 msgr2=0x7fb3b4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.417+0000 7fb3ceffd700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 0x7fb3b4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:06.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.421+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3b80478f0 con 0x7fb3d0154160 2023-05-10T01:45:06.488 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.486+0000 7f2a8ebe8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:06.492 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.490+0000 7f6770236680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:06.558 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.556+0000 7f2a8ebe8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:06.571 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.568+0000 7f6770236680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.618+0000 7fb3ceffd700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 msgr2=0x7fb3b4061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.618+0000 7fb3ceffd700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 0x7fb3b4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.656+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3d006c340 con 0x7fb3d0154160 2023-05-10T01:45:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.656+0000 7fb3c6ffd700 1 -- 172.21.15.52:0/3182082585 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fb3b804a400 con 0x7fb3d0154160 2023-05-10T01:45:06.660 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:06.660 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:43:38.581747+0000","modified":"2023-05-10T01:43:41.771472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7963":{"gid":7963,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6836/2334239147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2334239147},{"type":"v1","addr":"172.21.15.172:6836","nonce":2334239147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-05-10T01:45:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 msgr2=0x7fb3b4061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 0x7fb3b4061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 msgr2=0x7fb3d0164db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fb3b800c440 tx=0x7fb3b8007d80).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 shutdown_connections 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb3b405eeb0 0x7fb3b4061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3d0154540 0x7fb3d0151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3d0069da0 0x7fb3d00c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 --2- 172.21.15.52:0/3182082585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3d0154160 0x7fb3d0164db0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 >> 172.21.15.52:0/3182082585 conn(0x7fb3d00cb6f0 msgr2=0x7fb3d00a9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 shutdown_connections 2023-05-10T01:45:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.658+0000 7fb3d5499700 1 -- 172.21.15.52:0/3182082585 wait complete. 2023-05-10T01:45:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 70 2023-05-10T01:45:06.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:06.675 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.673+0000 7f2a8ebe8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:06.731 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.727+0000 7f6770236680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:06.783 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:06.780+0000 7f2a8ebe8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.788+0000 7f9063173700 1 Processor -- start 2023-05-10T01:45:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.788+0000 7f9063173700 1 -- start start 2023-05-10T01:45:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9063173700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 0x7f905c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9063173700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f905c064ff0 0x7f905c0654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9063173700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c067550 con 0x7f905c153ea0 2023-05-10T01:45:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9063173700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c065990 con 0x7f905c064ff0 2023-05-10T01:45:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9063173700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0bc9a0 con 0x7f905c068c60 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9061710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f905c064ff0 0x7f905c0654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9060f0f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f905c153ea0 0x7f905c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50920/0 (socket says 172.21.15.52:50920) 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9061710700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f905c064ff0 0x7f905c0654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41908/0 (socket says 172.21.15.52:41908) 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.789+0000 7f9060f0f700 1 -- 172.21.15.52:0/90860263 learned_addr learned my addr 172.21.15.52:0/90860263 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f905bfff700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 0x7f905c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f9061710700 1 -- 172.21.15.52:0/90860263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 msgr2=0x7f905c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f9061710700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 0x7f905c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f9061710700 1 -- 172.21.15.52:0/90860263 >> v1:172.21.15.52:6789/0 conn(0x7f905c153ea0 legacy=0x7f905c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f9061710700 1 -- 172.21.15.52:0/90860263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0bcc80 con 0x7f905c064ff0 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f905bfff700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 0x7f905c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f9061710700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c0654a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f9054009e60 tx=0x7f9054009780).ready entity=mon.0 client_cookie=ac4e063d3bc1c290 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f905b7fe700 1 -- 172.21.15.52:0/90860263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400e070 con 0x7f905c064ff0 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f905b7fe700 1 -- 172.21.15.52:0/90860263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400bc30 con 0x7f905c064ff0 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.790+0000 7f905b7fe700 1 -- 172.21.15.52:0/90860263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054012410 con 0x7f905c064ff0 2023-05-10T01:45:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 -- 172.21.15.52:0/90860263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 msgr2=0x7f905c0654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c0654a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f9054009e60 tx=0x7f9054009780).stop 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 -- 172.21.15.52:0/90860263 shutdown_connections 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c0654a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 --2- 172.21.15.52:0/90860263 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c068c60 0x7f905c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 -- 172.21.15.52:0/90860263 >> 172.21.15.52:0/90860263 conn(0x7f905c0c4420 msgr2=0x7f905c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 -- 172.21.15.52:0/90860263 shutdown_connections 2023-05-10T01:45:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.791+0000 7f9063173700 1 -- 172.21.15.52:0/90860263 wait complete. 2023-05-10T01:45:06.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.792+0000 7f9063173700 1 Processor -- start 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.792+0000 7f9063173700 1 -- start start 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c153ea0 0x7f905c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f905c153170 0x7f905c0ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c156b10 con 0x7f905c064ff0 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0ac950 con 0x7f905c153170 2023-05-10T01:45:06.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9063173700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c156dd0 con 0x7f905c153ea0 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41910/0 (socket says 172.21.15.52:41910) 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 -- 172.21.15.52:0/3742607102 learned_addr learned my addr 172.21.15.52:0/3742607102 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9061710700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f905c153170 0x7f905c0ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f905bfff700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c153ea0 0x7f905c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 -- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c153ea0 msgr2=0x7f905c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c153ea0 0x7f905c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 -- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f905c153170 msgr2=0x7f905c0ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f905c153170 0x7f905c0ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 -- 172.21.15.52:0/3742607102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009a20 con 0x7f905c064ff0 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9060f0f700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f905000c4c0 tx=0x7f9050007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000ce10 con 0x7f905c064ff0 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.793+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90500072e0 con 0x7f905c064ff0 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.794+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050007660 con 0x7f905c064ff0 2023-05-10T01:45:06.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.794+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c1535d0 con 0x7f905c064ff0 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.794+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c0ac390 con 0x7f905c064ff0 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.795+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c06c340 con 0x7f905c064ff0 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.795+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7f9050010070 con 0x7f905c064ff0 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.795+0000 7f9058ff9700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 0x7f9044061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.795+0000 7f905bfff700 1 -- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 msgr2=0x7f9044061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.796+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f9050079150 con 0x7f905c064ff0 2023-05-10T01:45:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.796+0000 7f905bfff700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 0x7f9044061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:06.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.800+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f905004a3d0 con 0x7f905c064ff0 2023-05-10T01:45:06.807 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.804+0000 7f6770236680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:06.930 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:06.927+0000 7f6770236680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:06.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.977+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f905c067550 con 0x7f905c064ff0 2023-05-10T01:45:06.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.978+0000 7f9058ff9700 1 -- 172.21.15.52:0/3742607102 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18071 (secure 0 0 0) 0x7f905c067550 con 0x7f905c064ff0 2023-05-10T01:45:06.982 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:06.982 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":160,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:04.917482+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:43:37.127268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-05-10T01:43:37.545123+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":160,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.c","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/3028926924":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/182619327":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6833/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:6832/125557":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/2579392615":"2023-05-11T01:43:50.995332+0000","172.21.15.172:0/4028064579":"2023-05-11T01:43:50.995332+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]},{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 msgr2=0x7f9044061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 0x7f9044061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 msgr2=0x7f905c151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f905000c4c0 tx=0x7f9050007db0).stop 2023-05-10T01:45:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 shutdown_connections 2023-05-10T01:45:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f904405eeb0 0x7f9044061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f905c153170 0x7f905c0ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f905c064ff0 0x7f905c151200 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 --2- 172.21.15.52:0/3742607102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905c153ea0 0x7f905c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 >> 172.21.15.52:0/3742607102 conn(0x7f905c0c4420 msgr2=0x7f905c0c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 shutdown_connections 2023-05-10T01:45:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:06.980+0000 7f9063173700 1 -- 172.21.15.52:0/3742607102 wait complete. 2023-05-10T01:45:06.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:45:07.046 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:07.044+0000 7f6770236680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:07.075 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.073+0000 7f2a8ebe8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:07.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.114+0000 7fd83e19f700 1 Processor -- start 2023-05-10T01:45:07.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.114+0000 7fd83e19f700 1 -- start start 2023-05-10T01:45:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83e19f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd838069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83e19f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8380aab30 0x7fd8380c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83e19f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83806a910 con 0x7fd8380c5f60 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83e19f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8380c65e0 con 0x7fd8380aab30 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83e19f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380bfa20 con 0x7fd838069740 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.115+0000 7fd83c99c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8380aab30 0x7fd8380c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8380aab30 0x7fd8380c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41918/0 (socket says 172.21.15.52:41918) 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 -- 172.21.15.52:0/3490077998 learned_addr learned my addr 172.21.15.52:0/3490077998 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83d19d700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd838069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 -- 172.21.15.52:0/3490077998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 msgr2=0x7fd838069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd838069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 -- 172.21.15.52:0/3490077998 >> v1:172.21.15.172:6789/0 conn(0x7fd8380c5f60 legacy=0x7fd838153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 -- 172.21.15.52:0/3490077998 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380c63b0 con 0x7fd8380aab30 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd83c99c700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd8380c5a70 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7fd834006fd0 tx=0x7fd8340090f0).ready entity=mon.0 client_cookie=570c79c88bee2d58 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd82bfff700 1 -- 172.21.15.52:0/3490077998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400b580 con 0x7fd8380aab30 2023-05-10T01:45:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd82bfff700 1 -- 172.21.15.52:0/3490077998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400b6e0 con 0x7fd8380aab30 2023-05-10T01:45:07.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.116+0000 7fd82bfff700 1 -- 172.21.15.52:0/3490077998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400ba60 con 0x7fd8380aab30 2023-05-10T01:45:07.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 -- 172.21.15.52:0/3490077998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 msgr2=0x7fd8380c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd8380c5a70 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7fd834006fd0 tx=0x7fd8340090f0).stop 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 -- 172.21.15.52:0/3490077998 shutdown_connections 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd838069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 --2- 172.21.15.52:0/3490077998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd8380c5a70 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 -- 172.21.15.52:0/3490077998 >> 172.21.15.52:0/3490077998 conn(0x7fd8380cb540 msgr2=0x7fd8380c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 -- 172.21.15.52:0/3490077998 shutdown_connections 2023-05-10T01:45:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.117+0000 7fd83e19f700 1 -- 172.21.15.52:0/3490077998 wait complete. 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.118+0000 7fd83e19f700 1 Processor -- start 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.118+0000 7fd83e19f700 1 -- start start 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd8381556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8380c5f60 0x7fd8380c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838155ca0 con 0x7fd8380aab30 2023-05-10T01:45:07.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838155f80 con 0x7fd8380c5f60 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83e19f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd838156260 con 0x7fd838069740 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83c99c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83c99c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41924/0 (socket says 172.21.15.52:41924) 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83c99c700 1 -- 172.21.15.52:0/2911871205 learned_addr learned my addr 172.21.15.52:0/2911871205 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83d19d700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd8381556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.119+0000 7fd83d99e700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8380c5f60 0x7fd8380c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:07.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 msgr2=0x7fd8381556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd8381556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8380c5f60 msgr2=0x7fd8380c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8380c5f60 0x7fd8380c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 -- 172.21.15.52:0/2911871205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834009370 con 0x7fd8380aab30 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83c99c700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fd834009130 tx=0x7fd834017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834000bc0 con 0x7fd8380aab30 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400b850 con 0x7fd8380aab30 2023-05-10T01:45:07.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834000d20 con 0x7fd8380aab30 2023-05-10T01:45:07.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838156540 con 0x7fd8380aab30 2023-05-10T01:45:07.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.120+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83813c710 con 0x7fd8380aab30 2023-05-10T01:45:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.121+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd838083030 con 0x7fd8380aab30 2023-05-10T01:45:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.122+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 76) v1 ==== 75402+0+0 (secure 0 0 0) 0x7fd83402c070 con 0x7fd8380aab30 2023-05-10T01:45:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.123+0000 7fd8297fa700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.123+0000 7fd83d19d700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 msgr2=0x7fd818061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.123+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fd83407c070 con 0x7fd8380aab30 2023-05-10T01:45:07.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.123+0000 7fd83d19d700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:07.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.126+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd83404d370 con 0x7fd8380aab30 2023-05-10T01:45:07.146 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.144+0000 7f2a8ebe8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:07.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.324+0000 7fd83d19d700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 msgr2=0x7fd818061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:07.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.324+0000 7fd83d19d700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.348+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd838047150 con 0x7fd8380aab30 2023-05-10T01:45:07.352 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:07.349+0000 7f6770236680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:07.427 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:07.424+0000 7f6770236680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:07.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.725+0000 7fd83d19d700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 msgr2=0x7fd818061370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:07.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.725+0000 7fd83d19d700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:45:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.936+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 77) v1 ==== 75092+0+0 (secure 0 0 0) 0x7fd834022030 con 0x7fd8380aab30 2023-05-10T01:45:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.936+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 msgr2=0x7fd818061370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:07.936+0000 7fd8297fa700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:07.999 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a11bd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:07.999 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a11bd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a11bd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a11bd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a11bd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a0ebcd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a0ebcd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a0ebcd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a0ebcd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.001 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:07.996+0000 7f2a0ebcd700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:08.004 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.004 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.004 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.004 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.005 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-05-10T01:45:08.005 INFO:tasks.ceph.mds.d.smithi172.stderr:2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:45:08.018 INFO:tasks.ceph.mds.d.smithi172.stderr: -7> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.019 INFO:tasks.ceph.mds.d.smithi172.stderr: -6> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.019 INFO:tasks.ceph.mds.d.smithi172.stderr: -5> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.019 INFO:tasks.ceph.mds.d.smithi172.stderr: -4> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:08.019 INFO:tasks.ceph.mds.d.smithi172.stderr: -3> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-05-10T01:45:08.019 INFO:tasks.ceph.mds.d.smithi172.stderr: -1> 2023-05-10T01:45:08.001+0000 7fcfe5bd8700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:45:08.037 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:45:08.161 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:45:08.158+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:45:08.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.160+0000 7fd8297fa700 1 -- 172.21.15.52:0/2911871205 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd8340471f0 con 0x7fd8380aab30 2023-05-10T01:45:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 msgr2=0x7fd83813c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fd834009130 tx=0x7fd834017000).stop 2023-05-10T01:45:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 shutdown_connections 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd81805eeb0 0x7fd818061370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8380c5f60 0x7fd8380c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd838069740 0x7fd8381556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 --2- 172.21.15.52:0/2911871205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8380aab30 0x7fd83813c220 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 >> 172.21.15.52:0/2911871205 conn(0x7fd8380cb540 msgr2=0x7fd8380c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 shutdown_connections 2023-05-10T01:45:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.163+0000 7fd83e19f700 1 -- 172.21.15.52:0/2911871205 wait complete. 2023-05-10T01:45:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:45:08.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:45:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.304+0000 7f57e464b700 1 Processor -- start 2023-05-10T01:45:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.304+0000 7f57e464b700 1 -- start start 2023-05-10T01:45:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e464b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57dc155b80 0x7f57dc064e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e464b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57dc067070 0x7f57dc065370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e464b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0bc8a0 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e464b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc1523d0 con 0x7f57dc067070 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e464b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc068810 con 0x7f57dc155b80 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e1be6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57dc067070 0x7f57dc065370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e2be8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f57dc0bd2f0 0x7f57dc0a6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50958/0 (socket says 172.21.15.52:50958) 2023-05-10T01:45:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e2be8700 1 -- 172.21.15.52:0/306418381 learned_addr learned my addr 172.21.15.52:0/306418381 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.305+0000 7f57e23e7700 1 --2- 172.21.15.52:0/306418381 >> v2:172.21.15.172:3300/0 conn(0x7f57dc155b80 0x7f57dc064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e1be6700 1 -- 172.21.15.52:0/306418381 >> v2:172.21.15.172:3300/0 conn(0x7f57dc155b80 msgr2=0x7f57dc064e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e1be6700 1 --2- 172.21.15.52:0/306418381 >> v2:172.21.15.172:3300/0 conn(0x7f57dc155b80 0x7f57dc064e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e1be6700 1 -- 172.21.15.52:0/306418381 >> v1:172.21.15.52:6789/0 conn(0x7f57dc0bd2f0 legacy=0x7f57dc0a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e1be6700 1 -- 172.21.15.52:0/306418381 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc068a90 con 0x7f57dc067070 2023-05-10T01:45:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e1be6700 1 --2- 172.21.15.52:0/306418381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc067070 0x7f57dc065370 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f57dc0c7850 tx=0x7f57d0009060).ready entity=mon.0 client_cookie=9fe732cf07d74e0c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e13e5700 1 -- 172.21.15.52:0/306418381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000b580 con 0x7f57dc067070 2023-05-10T01:45:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e13e5700 1 -- 172.21.15.52:0/306418381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d000b6e0 con 0x7f57dc067070 2023-05-10T01:45:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e13e5700 1 -- 172.21.15.52:0/306418381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000ba60 con 0x7f57dc067070 2023-05-10T01:45:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 -- 172.21.15.52:0/306418381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc067070 msgr2=0x7f57dc065370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 --2- 172.21.15.52:0/306418381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc067070 0x7f57dc065370 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f57dc0c7850 tx=0x7f57d0009060).stop 2023-05-10T01:45:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 -- 172.21.15.52:0/306418381 shutdown_connections 2023-05-10T01:45:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 --2- 172.21.15.52:0/306418381 >> v2:172.21.15.172:3300/0 conn(0x7f57dc155b80 0x7f57dc064e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 --2- 172.21.15.52:0/306418381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc067070 0x7f57dc065370 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.306+0000 7f57e464b700 1 -- 172.21.15.52:0/306418381 >> 172.21.15.52:0/306418381 conn(0x7f57dc0c8410 msgr2=0x7f57dc0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.307+0000 7f57e464b700 1 -- 172.21.15.52:0/306418381 shutdown_connections 2023-05-10T01:45:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.307+0000 7f57e464b700 1 -- 172.21.15.52:0/306418381 wait complete. 2023-05-10T01:45:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 Processor -- start 2023-05-10T01:45:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 -- start start 2023-05-10T01:45:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc067070 0x7f57dc0a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57dc155b80 0x7f57dc0c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0a0950 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0abff0 con 0x7f57dc067070 2023-05-10T01:45:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.308+0000 7f57e464b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c1600 con 0x7f57dc155b80 2023-05-10T01:45:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41944/0 (socket says 172.21.15.52:41944) 2023-05-10T01:45:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 -- 172.21.15.52:0/1983224642 learned_addr learned my addr 172.21.15.52:0/1983224642 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e23e7700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc067070 0x7f57dc0a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e2be8700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57dc155b80 0x7f57dc0c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 -- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57dc155b80 msgr2=0x7f57dc0c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57dc155b80 0x7f57dc0c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 -- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc067070 msgr2=0x7f57dc0a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc067070 0x7f57dc0a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 -- 172.21.15.52:0/1983224642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00092a0 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e1be6700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f57dc06a4a0 tx=0x7f57d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000be60 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d000b850 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0c18e0 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d001b410 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.309+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0abc80 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.310+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc06c340 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.311+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 77) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f57d002b070 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.311+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7101+0+0 (secure 0 0 0) 0x7f57d007b5c0 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.315+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57d004c830 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.531+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57dc068d70 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.938+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 78) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f57d0021030 con 0x7f57dc0bd2f0 2023-05-10T01:45:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.938+0000 7f57da7fc700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 0x7f57bc067c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.940+0000 7f57e23e7700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 0x7f57bc067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:08.940+0000 7f57e23e7700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 0x7f57bc067c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f57d400bb10 tx=0x7f57d4008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:09.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.162+0000 7f57da7fc700 1 -- 172.21.15.52:0/1983224642 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f57d00552d0 con 0x7f57dc0bd2f0 2023-05-10T01:45:09.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 msgr2=0x7f57bc067c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:09.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 0x7f57bc067c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f57d400bb10 tx=0x7f57d4008040).stop 2023-05-10T01:45:09.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 msgr2=0x7f57dc1415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f57dc06a4a0 tx=0x7f57d0017000).stop 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 shutdown_connections 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f57bc0301b0 0x7f57bc067c20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57dc155b80 0x7f57dc0c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc067070 0x7f57dc0a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 --2- 172.21.15.52:0/1983224642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0bd2f0 0x7f57dc1415d0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 >> 172.21.15.52:0/1983224642 conn(0x7f57dc0c8410 msgr2=0x7f57dc1525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:09.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 shutdown_connections 2023-05-10T01:45:09.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.164+0000 7f57e464b700 1 -- 172.21.15.52:0/1983224642 wait complete. 2023-05-10T01:45:09.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:45:09.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.302+0000 7f1a6b30c700 1 Processor -- start 2023-05-10T01:45:09.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.302+0000 7f1a6b30c700 1 -- start start 2023-05-10T01:45:09.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a64153ed0 0x7f1a641542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 0x7f1a64066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a640bdb60 0x7f1a640bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64067330 con 0x7f1a640bdb60 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64155660 con 0x7f1a64153ed0 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a6b30c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64155860 con 0x7f1a64062cb0 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a698a9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a640bdb60 0x7f1a640bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a698a9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a640bdb60 0x7f1a640bdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41968/0 (socket says 172.21.15.52:41968) 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a698a9700 1 -- 172.21.15.52:0/1092483530 learned_addr learned my addr 172.21.15.52:0/1092483530 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:09.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a690a8700 1 --2- 172.21.15.52:0/1092483530 >> v2:172.21.15.172:3300/0 conn(0x7f1a64153ed0 0x7f1a641542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a688a7700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 0x7f1a64066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a698a9700 1 -- 172.21.15.52:0/1092483530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 msgr2=0x7f1a64066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.303+0000 7f1a698a9700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 0x7f1a64066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a698a9700 1 -- 172.21.15.52:0/1092483530 >> v2:172.21.15.172:3300/0 conn(0x7f1a64153ed0 msgr2=0x7f1a641542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a698a9700 1 --2- 172.21.15.52:0/1092483530 >> v2:172.21.15.172:3300/0 conn(0x7f1a64153ed0 0x7f1a641542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a698a9700 1 -- 172.21.15.52:0/1092483530 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64063110 con 0x7f1a640bdb60 2023-05-10T01:45:09.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a688a7700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 0x7f1a64066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a698a9700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a640bdb60 0x7f1a640bdfc0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f1a640c7850 tx=0x7f1a54009840).ready entity=mon.0 client_cookie=836da550194c0b7b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a63fff700 1 -- 172.21.15.52:0/1092483530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400e070 con 0x7f1a640bdb60 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a63fff700 1 -- 172.21.15.52:0/1092483530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5400b990 con 0x7f1a640bdb60 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a63fff700 1 -- 172.21.15.52:0/1092483530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400bd10 con 0x7f1a640bdb60 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 -- 172.21.15.52:0/1092483530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a640bdb60 msgr2=0x7f1a640bdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a640bdb60 0x7f1a640bdfc0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f1a640c7850 tx=0x7f1a54009840).stop 2023-05-10T01:45:09.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 -- 172.21.15.52:0/1092483530 shutdown_connections 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a640bdb60 0x7f1a640bdfc0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/1092483530 >> v2:172.21.15.172:3300/0 conn(0x7f1a64153ed0 0x7f1a641542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/1092483530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64062cb0 0x7f1a64066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 -- 172.21.15.52:0/1092483530 >> 172.21.15.52:0/1092483530 conn(0x7f1a640c8410 msgr2=0x7f1a640c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 -- 172.21.15.52:0/1092483530 shutdown_connections 2023-05-10T01:45:09.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.304+0000 7f1a6b30c700 1 -- 172.21.15.52:0/1092483530 wait complete. 2023-05-10T01:45:09.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.305+0000 7f1a6b30c700 1 Processor -- start 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.305+0000 7f1a6b30c700 1 -- start start 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a640bdb60 0x7f1a640aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64153ed0 0x7f1a640aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640abfa0 con 0x7f1a64062cb0 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640ab390 con 0x7f1a640bdb60 2023-05-10T01:45:09.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a6b30c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640ab670 con 0x7f1a64153ed0 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a690a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a690a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41972/0 (socket says 172.21.15.52:41972) 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.306+0000 7f1a690a8700 1 -- 172.21.15.52:0/359073453 learned_addr learned my addr 172.21.15.52:0/359073453 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a688a7700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a640bdb60 0x7f1a640aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a698a9700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64153ed0 0x7f1a640aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 -- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64153ed0 msgr2=0x7f1a640aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64153ed0 0x7f1a640aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 -- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a640bdb60 msgr2=0x7f1a640aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a640bdb60 0x7f1a640aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 -- 172.21.15.52:0/359073453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009ae0 con 0x7f1a64062cb0 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a690a8700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f1a5c00e900 tx=0x7f1a5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00c6d0 con 0x7f1a64062cb0 2023-05-10T01:45:09.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00c830 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a640ab950 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00cbb0 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.307+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a640aa000 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.308+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6406c340 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.308+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 78) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f1a5c022070 con 0x7f1a64062cb0 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.309+0000 7f1a617fa700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 0x7f1a44061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:09.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.309+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7101+0+0 (secure 0 0 0) 0x7f1a5c07a160 con 0x7f1a64062cb0 2023-05-10T01:45:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.309+0000 7f1a688a7700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 0x7f1a44061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.309+0000 7f1a688a7700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 0x7f1a44061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1a640a4bc0 tx=0x7f1a58008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:09.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.313+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a5c04b3d0 con 0x7f1a64062cb0 2023-05-10T01:45:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:09.486+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a64069140 con 0x7f1a64062cb0 2023-05-10T01:45:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.166+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1a5c077d30 con 0x7f1a64062cb0 2023-05-10T01:45:10.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.172+0000 7f1a617fa700 1 -- 172.21.15.52:0/359073453 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a5c0703f0 con 0x7f1a64062cb0 2023-05-10T01:45:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 msgr2=0x7f1a44061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 0x7f1a44061180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1a640a4bc0 tx=0x7f1a58008040).stop 2023-05-10T01:45:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 msgr2=0x7f1a6414fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f1a5c00e900 tx=0x7f1a5c009060).stop 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 shutdown_connections 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1a4405ecc0 0x7f1a44061180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a64153ed0 0x7f1a640aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a64062cb0 0x7f1a6414fa30 secure :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0x7f1a5c00e900 tx=0x7f1a5c009060).stop 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 --2- 172.21.15.52:0/359073453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a640bdb60 0x7f1a640aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.176+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 >> 172.21.15.52:0/359073453 conn(0x7f1a640c8410 msgr2=0x7f1a640c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.177+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 shutdown_connections 2023-05-10T01:45:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.177+0000 7f1a6b30c700 1 -- 172.21.15.52:0/359073453 wait complete. 2023-05-10T01:45:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:45:10.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:45:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 Processor -- start 2023-05-10T01:45:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 -- start start 2023-05-10T01:45:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f804c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f804c068150 0x7f804c068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c0c94c0 con 0x7f804c154460 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0cb7d0 con 0x7f804c068150 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.318+0000 7f8052cc6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c068a60 con 0x7f804c154080 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f804c154460 0x7f804c0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50996/0 (socket says 172.21.15.52:50996) 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804bfff700 1 -- 172.21.15.52:0/1273572620 learned_addr learned my addr 172.21.15.52:0/1273572620 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f8050a62700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f804c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f8051263700 1 --2- 172.21.15.52:0/1273572620 >> v2:172.21.15.172:3300/0 conn(0x7f804c068150 0x7f804c068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056705607 0 0) 0x7f804c0c94c0 con 0x7f804c154460 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c0033f0 con 0x7f804c154460 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624422710 0 0) 0x7f802c0033f0 con 0x7f804c154460 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 msgr2=0x7f804c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f804c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 >> v2:172.21.15.172:3300/0 conn(0x7f804c068150 msgr2=0x7f804c068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 --2- 172.21.15.52:0/1273572620 >> v2:172.21.15.172:3300/0 conn(0x7f804c068150 0x7f804c068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0c88b0 con 0x7f804c154460 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f8034001470 con 0x7f804c154460 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 >> v1:172.21.15.52:6789/0 conn(0x7f804c154460 legacy=0x7f804c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f802c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f802c003e10 0x7f802c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802c004b80 0x7f802c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0cb7d0 con 0x7f802c004b80 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c068a60 con 0x7f802c003e10 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00b8e0 con 0x7f804c154080 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f8051263700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802c004b80 0x7f802c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f8050a62700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f802c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.319+0000 7f804bfff700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f802c003e10 0x7f802c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 -- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 msgr2=0x7f802c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:10.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f804c154080 0x7f802c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 -- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f802c003e10 msgr2=0x7f802c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f802c003e10 0x7f802c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 -- 172.21.15.52:0/1273572620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0033f0 con 0x7f802c004b80 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f804bfff700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f802c003e10 0x7f802c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802c004b80 0x7f802c005000 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f803c009ab0 tx=0x7f803c009060).ready entity=mon.0 client_cookie=14c58bdf17ade26b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c009430 con 0x7f802c004b80 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00e640 con 0x7f802c004b80 2023-05-10T01:45:10.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f804b7fe700 1 -- 172.21.15.52:0/1273572620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e9c0 con 0x7f802c004b80 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8052cc6700 1 -- 172.21.15.52:0/1273572620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802c004b80 msgr2=0x7f802c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8052cc6700 1 --2- 172.21.15.52:0/1273572620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802c004b80 0x7f802c005000 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f803c009ab0 tx=0x7f803c009060).stop 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8051263700 1 -- 172.21.15.52:0/1273572620 reap_dead start 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8052cc6700 1 -- 172.21.15.52:0/1273572620 shutdown_connections 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8052cc6700 1 -- 172.21.15.52:0/1273572620 >> 172.21.15.52:0/1273572620 conn(0x7f804c067910 msgr2=0x7f804c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.320+0000 7f8052cc6700 1 -- 172.21.15.52:0/1273572620 shutdown_connections 2023-05-10T01:45:10.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.321+0000 7f8052cc6700 1 -- 172.21.15.52:0/1273572620 wait complete. 2023-05-10T01:45:10.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 Processor -- start 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 -- start start 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f802c004b80 0x7f804c144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f804c14fea0 0x7f804c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0af530 con 0x7f804c0acbe0 2023-05-10T01:45:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0ad550 con 0x7f804c14fea0 2023-05-10T01:45:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.322+0000 7f8052cc6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0ae920 con 0x7f802c004b80 2023-05-10T01:45:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41994/0 (socket says 172.21.15.52:41994) 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 -- 172.21.15.52:0/3402978544 learned_addr learned my addr 172.21.15.52:0/3402978544 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f804bfff700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f804c14fea0 0x7f804c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8050a62700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f802c004b80 0x7f804c144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 -- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f802c004b80 msgr2=0x7f804c144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f802c004b80 0x7f804c144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 -- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f804c14fea0 msgr2=0x7f804c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f804c14fea0 0x7f804c0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 -- 172.21.15.52:0/3402978544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0aec00 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8051263700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f802c0045a0 tx=0x7f803c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00ed70 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00eed0 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00ea00 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c0aeee0 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.323+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c0ae570 con 0x7f804c0acbe0 2023-05-10T01:45:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.324+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c0af380 con 0x7f804c0acbe0 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.325+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f803c02f070 con 0x7f804c0acbe0 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.325+0000 7f8048ff9700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 0x7f8030061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.325+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f803c000e40 con 0x7f804c0acbe0 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.325+0000 7f8050a62700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 0x7f8030061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.326+0000 7f8050a62700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 0x7f8030061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8044009fd0 tx=0x7f804400b040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.329+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f803c04cb30 con 0x7f804c0acbe0 2023-05-10T01:45:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.503+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f804c066720 con 0x7f804c0acbe0 2023-05-10T01:45:10.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.793+0000 7f8048ff9700 1 -- 172.21.15.52:0/3402978544 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7f803c016020 con 0x7f804c0acbe0 2023-05-10T01:45:10.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 msgr2=0x7f8030061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 0x7f8030061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8044009fd0 tx=0x7f804400b040).stop 2023-05-10T01:45:10.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 msgr2=0x7f804c0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f802c0045a0 tx=0x7f803c01a000).stop 2023-05-10T01:45:10.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 shutdown_connections 2023-05-10T01:45:10.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f803005ed90 0x7f8030061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f804c0acbe0 0x7f804c0ad060 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f802c004b80 0x7f804c144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 --2- 172.21.15.52:0/3402978544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f804c14fea0 0x7f804c0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 >> 172.21.15.52:0/3402978544 conn(0x7f804c067910 msgr2=0x7f804c0c0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:10.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 shutdown_connections 2023-05-10T01:45:10.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.796+0000 7f8052cc6700 1 -- 172.21.15.52:0/3402978544 wait complete. 2023-05-10T01:45:10.802 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:45:10.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:45:10.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.927+0000 7f22b7fff700 1 Processor -- start 2023-05-10T01:45:10.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.927+0000 7f22b7fff700 1 -- start start 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b8153f80 0x7f22b80a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22b80c5cf0 0x7f22b80c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b7fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80c6660 con 0x7f22b80c0140 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b7fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b8069f50 con 0x7f22b80c5cf0 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b806a9d0 con 0x7f22b8153f80 2023-05-10T01:45:10.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22b80c5cf0 0x7f22b80c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22b80c5cf0 0x7f22b80c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41998/0 (socket says 172.21.15.52:41998) 2023-05-10T01:45:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 -- 172.21.15.52:0/3567363110 learned_addr learned my addr 172.21.15.52:0/3567363110 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b77fe700 1 --1- 172.21.15.52:0/3567363110 >> v1:172.21.15.52:6789/0 conn(0x7f22b80c0140 0x7f22b80c05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51016/0 (socket says 172.21.15.52:51016) 2023-05-10T01:45:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 -- 172.21.15.52:0/3567363110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b8153f80 msgr2=0x7f22b80a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 --2- 172.21.15.52:0/3567363110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b8153f80 0x7f22b80a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:10.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 -- 172.21.15.52:0/3567363110 >> v1:172.21.15.52:6789/0 conn(0x7f22b80c0140 legacy=0x7f22b80c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 -- 172.21.15.52:0/3567363110 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b806a130 con 0x7f22b80c5cf0 2023-05-10T01:45:10.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.928+0000 7f22b67fc700 1 --2- 172.21.15.52:0/3567363110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b80c5cf0 0x7f22b80c6170 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f22ac006fd0 tx=0x7f22ac0090f0).ready entity=mon.0 client_cookie=54b69f00f028d6c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b5ffb700 1 -- 172.21.15.52:0/3567363110 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00b600 con 0x7f22b80c5cf0 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b5ffb700 1 -- 172.21.15.52:0/3567363110 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00b760 con 0x7f22b80c5cf0 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b5ffb700 1 -- 172.21.15.52:0/3567363110 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00bae0 con 0x7f22b80c5cf0 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 -- 172.21.15.52:0/3567363110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b80c5cf0 msgr2=0x7f22b80c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 --2- 172.21.15.52:0/3567363110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b80c5cf0 0x7f22b80c6170 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f22ac006fd0 tx=0x7f22ac0090f0).stop 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 -- 172.21.15.52:0/3567363110 shutdown_connections 2023-05-10T01:45:10.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 --2- 172.21.15.52:0/3567363110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b8153f80 0x7f22b80a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:10.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 --2- 172.21.15.52:0/3567363110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b80c5cf0 0x7f22b80c6170 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 -- 172.21.15.52:0/3567363110 >> 172.21.15.52:0/3567363110 conn(0x7f22b80cb5f0 msgr2=0x7f22b80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:10.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 -- 172.21.15.52:0/3567363110 shutdown_connections 2023-05-10T01:45:10.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.929+0000 7f22b7fff700 1 -- 172.21.15.52:0/3567363110 wait complete. 2023-05-10T01:45:10.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.930+0000 7f22b7fff700 1 Processor -- start 2023-05-10T01:45:10.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.930+0000 7f22b7fff700 1 -- start start 2023-05-10T01:45:10.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b80c0140 0x7f22b814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22b80c5cf0 0x7f22b814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8154da0 con 0x7f22b8153f80 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8165530 con 0x7f22b80c5cf0 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b814dc70 con 0x7f22b80c0140 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42006/0 (socket says 172.21.15.52:42006) 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b77fe700 1 -- 172.21.15.52:0/157589194 learned_addr learned my addr 172.21.15.52:0/157589194 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b67fc700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22b80c5cf0 0x7f22b814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.931+0000 7f22b6ffd700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b80c0140 0x7f22b814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 -- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b80c0140 msgr2=0x7f22b814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b80c0140 0x7f22b814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 -- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22b80c5cf0 msgr2=0x7f22b814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22b80c5cf0 0x7f22b814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 -- 172.21.15.52:0/157589194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009370 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b77fe700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f22a800c410 tx=0x7f22a8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80072e0 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8007440 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b81649b0 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80058f0 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.932+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b8164f70 con 0x7f22b8153f80 2023-05-10T01:45:10.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.933+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b8167c30 con 0x7f22b8153f80 2023-05-10T01:45:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.933+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f22a801a060 con 0x7f22b8153f80 2023-05-10T01:45:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.934+0000 7f229effd700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.934+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f22a80792b0 con 0x7f22b8153f80 2023-05-10T01:45:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.934+0000 7f22b6ffd700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.934+0000 7f22b6ffd700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 0x7f2298061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f22b0001250 tx=0x7f22b0009620).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:10.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:10.938+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22b8167c30 con 0x7f22b8153f80 2023-05-10T01:45:11.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.116+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f22b8167c30 con 0x7f22b8153f80 2023-05-10T01:45:11.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.119+0000 7f229effd700 1 -- 172.21.15.52:0/157589194 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7f22b8167c30 con 0x7f22b8153f80 2023-05-10T01:45:11.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 msgr2=0x7f2298061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 0x7f2298061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f22b0001250 tx=0x7f22b0009620).stop 2023-05-10T01:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 msgr2=0x7f22b80adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f22a800c410 tx=0x7f22a8007d70).stop 2023-05-10T01:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 shutdown_connections 2023-05-10T01:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f229805ed90 0x7f2298061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22b8153f80 0x7f22b80adca0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22b80c0140 0x7f22b814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 --2- 172.21.15.52:0/157589194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22b80c5cf0 0x7f22b814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 >> 172.21.15.52:0/157589194 conn(0x7f22b80cb5f0 msgr2=0x7f22b8068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 shutdown_connections 2023-05-10T01:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.121+0000 7f22b7fff700 1 -- 172.21.15.52:0/157589194 wait complete. 2023-05-10T01:45:11.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:45:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.254+0000 7fef9e9b9700 1 Processor -- start 2023-05-10T01:45:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.254+0000 7fef9e9b9700 1 -- start start 2023-05-10T01:45:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.255+0000 7fef9e9b9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.255+0000 7fef9e9b9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef98068150 0x7fef980685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.255+0000 7fef9e9b9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980c94c0 con 0x7fef98154080 2023-05-10T01:45:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.255+0000 7fef9e9b9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980cb7d0 con 0x7fef98068150 2023-05-10T01:45:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.255+0000 7fef9e9b9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98068ab0 con 0x7fef98154460 2023-05-10T01:45:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef977fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef98068150 0x7fef980685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef97fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fef98154080 0x7fef980a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:53564/0 (socket says 172.21.15.52:53564) 2023-05-10T01:45:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef97fff700 1 -- 172.21.15.52:0/2640856879 learned_addr learned my addr 172.21.15.52:0/2640856879 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef96ffd700 1 -- 172.21.15.52:0/2640856879 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475056019 0 0) 0x7fef980c94c0 con 0x7fef98154080 2023-05-10T01:45:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef96ffd700 1 -- 172.21.15.52:0/2640856879 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef840033f0 con 0x7fef98154080 2023-05-10T01:45:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 -- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 msgr2=0x7fef980aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 -- 172.21.15.52:0/2640856879 >> v1:172.21.15.172:6789/0 conn(0x7fef98154080 legacy=0x7fef980a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 -- 172.21.15.52:0/2640856879 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980c88b0 con 0x7fef98068150 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef977fe700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.256+0000 7fef9cf56700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef980685c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fef90009e60 tx=0x7fef90009780).ready entity=mon.1 client_cookie=8ac01723e7607646 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef96ffd700 1 -- 172.21.15.52:0/2640856879 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000e070 con 0x7fef98068150 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef96ffd700 1 -- 172.21.15.52:0/2640856879 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9000bab0 con 0x7fef98068150 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef96ffd700 1 -- 172.21.15.52:0/2640856879 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000be30 con 0x7fef98068150 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 -- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 msgr2=0x7fef980685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef980685c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fef90009e60 tx=0x7fef90009780).stop 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 -- 172.21.15.52:0/2640856879 shutdown_connections 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef980685c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/2640856879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 -- 172.21.15.52:0/2640856879 >> 172.21.15.52:0/2640856879 conn(0x7fef98067910 msgr2=0x7fef980cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 -- 172.21.15.52:0/2640856879 shutdown_connections 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.257+0000 7fef9e9b9700 1 -- 172.21.15.52:0/2640856879 wait complete. 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.258+0000 7fef9e9b9700 1 Processor -- start 2023-05-10T01:45:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.258+0000 7fef9e9b9700 1 -- start start 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef98166890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980aa660 con 0x7fef98154080 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef981657f0 con 0x7fef98068150 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9e9b9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98165ad0 con 0x7fef98154460 2023-05-10T01:45:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef977fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef977fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42018/0 (socket says 172.21.15.52:42018) 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef977fe700 1 -- 172.21.15.52:0/1632557387 learned_addr learned my addr 172.21.15.52:0/1632557387 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef97fff700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef98166890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.259+0000 7fef9cf56700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 -- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 msgr2=0x7fef980c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 -- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 msgr2=0x7fef98166890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef98166890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 -- 172.21.15.52:0/1632557387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0092a0 con 0x7fef98154080 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef977fe700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fef8c00e980 tx=0x7fef8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00c850 con 0x7fef98154080 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00c9b0 con 0x7fef98154080 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90009a20 con 0x7fef98154080 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00cd30 con 0x7fef98154080 2023-05-10T01:45:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.260+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef98166090 con 0x7fef98154080 2023-05-10T01:45:11.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.261+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef98066720 con 0x7fef98154080 2023-05-10T01:45:11.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.261+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fef8c022070 con 0x7fef98154080 2023-05-10T01:45:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.261+0000 7fef7ffff700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 0x7fef78061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.262+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fef8c079fe0 con 0x7fef98154080 2023-05-10T01:45:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.262+0000 7fef97fff700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 0x7fef78061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.262+0000 7fef97fff700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 0x7fef78061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef980c5620 tx=0x7fef88009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.266+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef8c04b540 con 0x7fef98154080 2023-05-10T01:45:11.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.437+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fef980c8b90 con 0x7fef98154080 2023-05-10T01:45:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.441+0000 7fef7ffff700 1 -- 172.21.15.52:0/1632557387 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef8c04eb60 con 0x7fef98154080 2023-05-10T01:45:11.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 msgr2=0x7fef78061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 0x7fef78061220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef980c5620 tx=0x7fef88009040).stop 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 msgr2=0x7fef98164da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fef8c00e980 tx=0x7fef8c009060).stop 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 shutdown_connections 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fef7805ed60 0x7fef78061220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef98154460 0x7fef980c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef98068150 0x7fef98166890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 --2- 172.21.15.52:0/1632557387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef98154080 0x7fef98164da0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 >> 172.21.15.52:0/1632557387 conn(0x7fef98067910 msgr2=0x7fef980c12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:11.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 shutdown_connections 2023-05-10T01:45:11.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.443+0000 7fef9e9b9700 1 -- 172.21.15.52:0/1632557387 wait complete. 2023-05-10T01:45:11.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-05-10T01:45:11.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.574+0000 7f095e6f1700 1 Processor -- start 2023-05-10T01:45:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.574+0000 7f095e6f1700 1 -- start start 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 0x7f09580c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09580c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0958069690 0x7f0958069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580c0650 con 0x7f0958069690 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095806a010 con 0x7f0958154160 2023-05-10T01:45:11.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095e6f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580bfd20 con 0x7f0958154540 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095cc8e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0958069690 0x7f0958069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095cc8e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0958069690 0x7f0958069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42028/0 (socket says 172.21.15.52:42028) 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f095cc8e700 1 -- 172.21.15.52:0/3750512179 learned_addr learned my addr 172.21.15.52:0/3750512179 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f09577fe700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09580c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.575+0000 7f0957fff700 1 --2- 172.21.15.52:0/3750512179 >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 0x7f09580c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 -- 172.21.15.52:0/3750512179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 msgr2=0x7f09580c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09580c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 -- 172.21.15.52:0/3750512179 >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 msgr2=0x7f09580c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 --2- 172.21.15.52:0/3750512179 >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 0x7f09580c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 -- 172.21.15.52:0/3750512179 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580c0000 con 0x7f0958069690 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f09577fe700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09580c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f0957fff700 1 --2- 172.21.15.52:0/3750512179 >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 0x7f09580c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095cc8e700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f0958069b20 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f0958083020 tx=0x7f0950009840).ready entity=mon.0 client_cookie=5fd65f7f66d74242 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f0956ffd700 1 -- 172.21.15.52:0/3750512179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000e070 con 0x7f0958069690 2023-05-10T01:45:11.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f0956ffd700 1 -- 172.21.15.52:0/3750512179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095000ba50 con 0x7f0958069690 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f0956ffd700 1 -- 172.21.15.52:0/3750512179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000bdd0 con 0x7f0958069690 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 -- 172.21.15.52:0/3750512179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 msgr2=0x7f0958069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f0958069b20 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f0958083020 tx=0x7f0950009840).stop 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 -- 172.21.15.52:0/3750512179 shutdown_connections 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f0958069b20 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 --2- 172.21.15.52:0/3750512179 >> v2:172.21.15.172:3300/0 conn(0x7f0958154160 0x7f09580c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 --2- 172.21.15.52:0/3750512179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09580c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 -- 172.21.15.52:0/3750512179 >> 172.21.15.52:0/3750512179 conn(0x7f09580cb6f0 msgr2=0x7f09580c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:11.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 -- 172.21.15.52:0/3750512179 shutdown_connections 2023-05-10T01:45:11.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.576+0000 7f095e6f1700 1 -- 172.21.15.52:0/3750512179 wait complete. 2023-05-10T01:45:11.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 Processor -- start 2023-05-10T01:45:11.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 -- start start 2023-05-10T01:45:11.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 0x7f09580af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09581448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580aee30 con 0x7f0958069690 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580ae220 con 0x7f0958154160 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.578+0000 7f095e6f1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580ae500 con 0x7f0958154540 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42030/0 (socket says 172.21.15.52:42030) 2023-05-10T01:45:11.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 -- 172.21.15.52:0/210523393 learned_addr learned my addr 172.21.15.52:0/210523393 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f095cc8e700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09581448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f09577fe700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 0x7f09580af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 -- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 msgr2=0x7f09581448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09581448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 -- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 msgr2=0x7f09580af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 0x7f09580af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 -- 172.21.15.52:0/210523393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009ae0 con 0x7f0958069690 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f095cc8e700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09581448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f09577fe700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 0x7f09580af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f0957fff700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f094000d860 tx=0x7f0940008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940011590 con 0x7f0958069690 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09400116f0 con 0x7f0958069690 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940011a70 con 0x7f0958069690 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580ae7e0 con 0x7f0958069690 2023-05-10T01:45:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.579+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09581516a0 con 0x7f0958069690 2023-05-10T01:45:11.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.580+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580666b0 con 0x7f0958069690 2023-05-10T01:45:11.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.580+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f094001c460 con 0x7f0958069690 2023-05-10T01:45:11.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.581+0000 7f094ffff700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 0x7f093c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:11.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.581+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f0940079bd0 con 0x7f0958069690 2023-05-10T01:45:11.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.581+0000 7f09577fe700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 0x7f093c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:11.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.581+0000 7f09577fe700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 0x7f093c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0948006e00 tx=0x7f0948008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:11.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.586+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f094004b0d0 con 0x7f0958069690 2023-05-10T01:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.825+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f09580af110 con 0x7f0958069690 2023-05-10T01:45:11.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.958+0000 7f094ffff700 1 -- 172.21.15.52:0/210523393 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1233) v1 ==== 163+0+0 (secure 0 0 0) 0x7f094004e6f0 con 0x7f0958069690 2023-05-10T01:45:11.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 msgr2=0x7f093c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 0x7f093c061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0948006e00 tx=0x7f0948008040).stop 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 msgr2=0x7f09580adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f094000d860 tx=0x7f0940008040).stop 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 shutdown_connections 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f093c05ed90 0x7f093c061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0958154540 0x7f09581448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0958069690 0x7f09580adc40 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 --2- 172.21.15.52:0/210523393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0958154160 0x7f09580af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:11.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 >> 172.21.15.52:0/210523393 conn(0x7f09580cb6f0 msgr2=0x7f095814f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:11.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 shutdown_connections 2023-05-10T01:45:11.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:11.960+0000 7f095e6f1700 1 -- 172.21.15.52:0/210523393 wait complete. 2023-05-10T01:45:11.975 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-05-10T01:45:11.975 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-05-10T01:45:11.976 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-05-10T01:45:11.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-05-10T01:45:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.090+0000 7f7055f73700 1 Processor -- start 2023-05-10T01:45:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.090+0000 7f7055f73700 1 -- start start 2023-05-10T01:45:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 0x7f70500c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7050154540 0x7f70500c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500c0650 con 0x7f7050069690 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70500c1af0 con 0x7f7050154540 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500bfd20 con 0x7f7050154160 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7050154540 0x7f70500c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7050069690 0x7f7050157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51056/0 (socket says 172.21.15.52:51056) 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7050154540 0x7f70500c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42042/0 (socket says 172.21.15.52:42042) 2023-05-10T01:45:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704ffff700 1 -- 172.21.15.52:0/226789310 learned_addr learned my addr 172.21.15.52:0/226789310 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704f7fe700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 0x7f70500c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 -- 172.21.15.52:0/226789310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 msgr2=0x7f70500c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 0x7f70500c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 -- 172.21.15.52:0/226789310 >> v1:172.21.15.52:6789/0 conn(0x7f7050069690 legacy=0x7f7050157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704e7fc700 1 -- 172.21.15.52:0/226789310 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980390711 0 0) 0x7f70500c0650 con 0x7f7050069690 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 -- 172.21.15.52:0/226789310 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500c0000 con 0x7f7050154540 2023-05-10T01:45:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704f7fe700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 0x7f70500c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704effd700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154540 0x7f70500c6150 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7044009760 tx=0x7f7044009060).ready entity=mon.0 client_cookie=758d0ab12741b9e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704e7fc700 1 -- 172.21.15.52:0/226789310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440090d0 con 0x7f7050154540 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704e7fc700 1 -- 172.21.15.52:0/226789310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400b580 con 0x7f7050154540 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f704e7fc700 1 -- 172.21.15.52:0/226789310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704400b900 con 0x7f7050154540 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- 172.21.15.52:0/226789310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154540 msgr2=0x7f70500c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154540 0x7f70500c6150 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7044009760 tx=0x7f7044009060).stop 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- 172.21.15.52:0/226789310 shutdown_connections 2023-05-10T01:45:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050154160 0x7f70500c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 --2- 172.21.15.52:0/226789310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154540 0x7f70500c6150 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- 172.21.15.52:0/226789310 >> 172.21.15.52:0/226789310 conn(0x7f70500cb6f0 msgr2=0x7f70500c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- 172.21.15.52:0/226789310 shutdown_connections 2023-05-10T01:45:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.092+0000 7f7055f73700 1 -- 172.21.15.52:0/226789310 wait complete. 2023-05-10T01:45:12.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 Processor -- start 2023-05-10T01:45:12.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 -- start start 2023-05-10T01:45:12.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 0x7f70500c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 0x7f705014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705014e8b0 con 0x7f7050154160 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70500c1dd0 con 0x7f7050154540 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f7055f73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500c20b0 con 0x7f7050069690 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.094+0000 7f704effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42046/0 (socket says 172.21.15.52:42046) 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 -- 172.21.15.52:0/2938631461 learned_addr learned my addr 172.21.15.52:0/2938631461 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 -- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 msgr2=0x7f70500c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704ffff700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 0x7f705014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704f7fe700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 0x7f70500c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 0x7f70500c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 -- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 msgr2=0x7f705014e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 0x7f705014e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 -- 172.21.15.52:0/2938631461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440092a0 con 0x7f7050154160 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704ffff700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 0x7f705014e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704f7fe700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 0x7f70500c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f704effd700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f7050083050 tx=0x7f7044017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704400bcc0 con 0x7f7050154160 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400be20 con 0x7f7050154160 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70500c2390 con 0x7f7050154160 2023-05-10T01:45:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704401b620 con 0x7f7050154160 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.095+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70500c2950 con 0x7f7050154160 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.096+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70500666b0 con 0x7f7050154160 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.097+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f704400f070 con 0x7f7050154160 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.097+0000 7f70377fe700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 0x7f7030061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.097+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f704407b120 con 0x7f7050154160 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.097+0000 7f704f7fe700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 0x7f7030061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:12.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.098+0000 7f704f7fe700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 0x7f7030061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7040008990 tx=0x7f7040008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:12.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.101+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f704404c680 con 0x7f7050154160 2023-05-10T01:45:12.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.339+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f705006c340 con 0x7f7050154160 2023-05-10T01:45:12.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.960+0000 7f70377fe700 1 -- 172.21.15.52:0/2938631461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1234) v1 ==== 158+0+0 (secure 0 0 0) 0x7f704404fca0 con 0x7f7050154160 2023-05-10T01:45:12.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 msgr2=0x7f7030061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 0x7f7030061280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7040008990 tx=0x7f7040008040).stop 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 msgr2=0x7f705014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f7050083050 tx=0x7f7044017000).stop 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 shutdown_connections 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f703005edc0 0x7f7030061280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7050154540 0x7f705014e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7050069690 0x7f70500c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 --2- 172.21.15.52:0/2938631461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7050154160 0x7f705014ded0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.962+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 >> 172.21.15.52:0/2938631461 conn(0x7f70500cb6f0 msgr2=0x7f70500ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.963+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 shutdown_connections 2023-05-10T01:45:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:12.963+0000 7f7055f73700 1 -- 172.21.15.52:0/2938631461 wait complete. 2023-05-10T01:45:12.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T01:45:13.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.100+0000 7f1ce0824700 1 Processor -- start 2023-05-10T01:45:13.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.100+0000 7f1ce0824700 1 -- start start 2023-05-10T01:45:13.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1ce0824700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 0x7f1cdc0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1ce0824700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1cdc068150 0x7f1cdc068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1ce0824700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cdc0c94c0 con 0x7f1cdc154460 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1ce0824700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc0cb7d0 con 0x7f1cdc068150 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1ce0824700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc068a60 con 0x7f1cdc154080 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1cdad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1cdc068150 0x7f1cdc068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1cdad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1cdc068150 0x7f1cdc068570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42056/0 (socket says 172.21.15.52:42056) 2023-05-10T01:45:13.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1cd9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1cdc154460 0x7f1cdc0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51070/0 (socket says 172.21.15.52:51070) 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1cdad9d700 1 -- 172.21.15.52:0/3571601315 learned_addr learned my addr 172.21.15.52:0/3571601315 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.101+0000 7f1cda59c700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 0x7f1cdc0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cdad9d700 1 -- 172.21.15.52:0/3571601315 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 msgr2=0x7f1cdc0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cdad9d700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 0x7f1cdc0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cdad9d700 1 -- 172.21.15.52:0/3571601315 >> v1:172.21.15.52:6789/0 conn(0x7f1cdc154460 legacy=0x7f1cdc0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cdad9d700 1 -- 172.21.15.52:0/3571601315 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc0c88b0 con 0x7f1cdc068150 2023-05-10T01:45:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cd959a700 1 -- 172.21.15.52:0/3571601315 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410908747 0 0) 0x7f1cdc0c94c0 con 0x7f1cdc154460 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cda59c700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 0x7f1cdc0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cdad9d700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc068570 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f1ccc009f20 tx=0x7f1ccc009840).ready entity=mon.0 client_cookie=8a1a6f1972808313 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cd959a700 1 -- 172.21.15.52:0/3571601315 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00e070 con 0x7f1cdc068150 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cd959a700 1 -- 172.21.15.52:0/3571601315 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00ba80 con 0x7f1cdc068150 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1cd959a700 1 -- 172.21.15.52:0/3571601315 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00be00 con 0x7f1cdc068150 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 -- 172.21.15.52:0/3571601315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 msgr2=0x7f1cdc068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc068570 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f1ccc009f20 tx=0x7f1ccc009840).stop 2023-05-10T01:45:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 -- 172.21.15.52:0/3571601315 shutdown_connections 2023-05-10T01:45:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc068570 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 --2- 172.21.15.52:0/3571601315 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154080 0x7f1cdc0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 -- 172.21.15.52:0/3571601315 >> 172.21.15.52:0/3571601315 conn(0x7f1cdc067910 msgr2=0x7f1cdc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 -- 172.21.15.52:0/3571601315 shutdown_connections 2023-05-10T01:45:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.102+0000 7f1ce0824700 1 -- 172.21.15.52:0/3571601315 wait complete. 2023-05-10T01:45:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 Processor -- start 2023-05-10T01:45:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 -- start start 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cdc154080 0x7f1cdc156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154460 0x7f1cdc154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc151a50 con 0x7f1cdc068150 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc157ab0 con 0x7f1cdc154080 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1ce0824700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc157210 con 0x7f1cdc154460 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42058/0 (socket says 172.21.15.52:42058) 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.104+0000 7f1cda59c700 1 -- 172.21.15.52:0/2230590264 learned_addr learned my addr 172.21.15.52:0/2230590264 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cd9d9b700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cdc154080 0x7f1cdc156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cdad9d700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154460 0x7f1cdc154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 -- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154460 msgr2=0x7f1cdc154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154460 0x7f1cdc154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 -- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cdc154080 msgr2=0x7f1cdc156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cdc154080 0x7f1cdc156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 -- 172.21.15.52:0/2230590264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc009ae0 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cda59c700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f1cd400d860 tx=0x7f1cd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4011590 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd40116f0 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc1574f0 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4011a70 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.105+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc0ae5d0 con 0x7f1cdc068150 2023-05-10T01:45:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.106+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc0c91a0 con 0x7f1cdc068150 2023-05-10T01:45:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.106+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1cd4012420 con 0x7f1cdc068150 2023-05-10T01:45:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.107+0000 7f1cd27fc700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 0x7f1cc0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.107+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f1cd4079980 con 0x7f1cdc068150 2023-05-10T01:45:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.107+0000 7f1cd9d9b700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 0x7f1cc0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.107+0000 7f1cd9d9b700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 0x7f1cc0061220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1cdc0b0010 tx=0x7f1cc4007bb0).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.111+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cd404ad70 con 0x7f1cdc068150 2023-05-10T01:45:13.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.284+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1cdc0ae940 con 0x7f1cdc068150 2023-05-10T01:45:13.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.287+0000 7f1cd27fc700 1 -- 172.21.15.52:0/2230590264 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cd404e390 con 0x7f1cdc068150 2023-05-10T01:45:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 msgr2=0x7f1cc0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 0x7f1cc0061220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1cdc0b0010 tx=0x7f1cc4007bb0).stop 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 msgr2=0x7f1cdc14f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f1cd400d860 tx=0x7f1cd4008040).stop 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 shutdown_connections 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1cc005ed60 0x7f1cc0061220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1cdc154460 0x7f1cdc154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc068150 0x7f1cdc14f8f0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 --2- 172.21.15.52:0/2230590264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cdc154080 0x7f1cdc156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 >> 172.21.15.52:0/2230590264 conn(0x7f1cdc067910 msgr2=0x7f1cdc0c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:13.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 shutdown_connections 2023-05-10T01:45:13.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.289+0000 7f1ce0824700 1 -- 172.21.15.52:0/2230590264 wait complete. 2023-05-10T01:45:13.303 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:45:13.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:13.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:13.362 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:45:13.362 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T01:45:13.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.484+0000 7f53ff114700 1 Processor -- start 2023-05-10T01:45:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.484+0000 7f53ff114700 1 -- start start 2023-05-10T01:45:13.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53ff114700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53f8063e20 0x7f53f80bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53ff114700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f8062b00 con 0x7f53f8153d90 2023-05-10T01:45:13.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53ff114700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f8068330 con 0x7f53f8154170 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53ff114700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f8068610 con 0x7f53f8063e20 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53fceb0700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f53f8153d90 0x7f53f8069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51082/0 (socket says 172.21.15.52:51082) 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.485+0000 7f53fceb0700 1 -- 172.21.15.52:0/1157258810 learned_addr learned my addr 172.21.15.52:0/1157258810 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090621699 0 0) 0x7f53f8062b00 con 0x7f53f8153d90 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fd6b1700 1 --2- 172.21.15.52:0/1157258810 >> v2:172.21.15.172:3300/0 conn(0x7f53f8063e20 0x7f53f80bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53dc0033f0 con 0x7f53f8153d90 2023-05-10T01:45:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 125899663 0 0) 0x7f53dc0033f0 con 0x7f53f8153d90 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 >> v2:172.21.15.172:3300/0 conn(0x7f53f8063e20 msgr2=0x7f53f80bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 --2- 172.21.15.52:0/1157258810 >> v2:172.21.15.172:3300/0 conn(0x7f53f8063e20 0x7f53f80bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 >> v1:172.21.15.172:6789/0 conn(0x7f53f8154170 legacy=0x7f53f8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80624b0 con 0x7f53f8153d90 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f53ec001470 con 0x7f53f8153d90 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 >> v1:172.21.15.52:6789/0 conn(0x7f53f8153d90 legacy=0x7f53f8069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 0x7f53dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53dc004690 0x7f53dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc005050 0x7f53dc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8068610 con 0x7f53dc0038e0 2023-05-10T01:45:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc00bf30 con 0x7f53dc004690 2023-05-10T01:45:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc00c0f0 con 0x7f53dc005050 2023-05-10T01:45:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 0x7f53dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53f7fff700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53dc004690 0x7f53dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fd6b1700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc005050 0x7f53dc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 -- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc005050 msgr2=0x7f53dc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc005050 0x7f53dc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 -- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53dc004690 msgr2=0x7f53dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53dc004690 0x7f53dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 -- 172.21.15.52:0/1157258810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0033f0 con 0x7f53dc0038e0 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fd6b1700 1 -- 172.21.15.52:0/1157258810 reap_dead start 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.486+0000 7f53fceb0700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 0x7f53dc003d00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f53ec00c190 tx=0x7f53ec001e50).ready entity=mon.0 client_cookie=3545cbf39d8b48d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec007a20 con 0x7f53dc0038e0 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec00cac0 con 0x7f53dc0038e0 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53f77fe700 1 -- 172.21.15.52:0/1157258810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00ce40 con 0x7f53dc0038e0 2023-05-10T01:45:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 -- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 msgr2=0x7f53dc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 0x7f53dc003d00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f53ec00c190 tx=0x7f53ec001e50).stop 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 -- 172.21.15.52:0/1157258810 shutdown_connections 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 --2- 172.21.15.52:0/1157258810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53dc0038e0 0x7f53dc003d00 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 -- 172.21.15.52:0/1157258810 >> 172.21.15.52:0/1157258810 conn(0x7f53f80c8a90 msgr2=0x7f53f80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 -- 172.21.15.52:0/1157258810 shutdown_connections 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.487+0000 7f53ff114700 1 -- 172.21.15.52:0/1157258810 wait complete. 2023-05-10T01:45:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.488+0000 7f53ff114700 1 Processor -- start 2023-05-10T01:45:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.488+0000 7f53ff114700 1 -- start start 2023-05-10T01:45:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 0x7f53f80c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 0x7f53f8144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8150e00 con 0x7f53f8150920 2023-05-10T01:45:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81510e0 con 0x7f53f8144030 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53ff114700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81513c0 con 0x7f53dc0038e0 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42080/0 (socket says 172.21.15.52:42080) 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53f7fff700 1 -- 172.21.15.52:0/3658997504 learned_addr learned my addr 172.21.15.52:0/3658997504 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53fceb0700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 0x7f53f80c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.489+0000 7f53fd6b1700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 0x7f53f8144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 -- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 msgr2=0x7f53f80c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 0x7f53f80c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 -- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 msgr2=0x7f53f8144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 0x7f53f8144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 -- 172.21.15.52:0/3658997504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f81516a0 con 0x7f53f8150920 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53fceb0700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 0x7f53f80c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53fd6b1700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 0x7f53f8144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f7fff700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f53e40028c0 tx=0x7f53e4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400f6c0 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400f820 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f8151980 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400fba0 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.490+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80c2ac0 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.491+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8065d90 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.491+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f53e401b030 con 0x7f53f8150920 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.492+0000 7f53f4ff9700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 0x7f53e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.492+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f53e4079710 con 0x7f53f8150920 2023-05-10T01:45:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.492+0000 7f53fceb0700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 0x7f53e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.492+0000 7f53fceb0700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 0x7f53e0061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53ec001ed0 tx=0x7f53ec015000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.496+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f53e404ad20 con 0x7f53f8150920 2023-05-10T01:45:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.709+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53f80c2c50 con 0x7f53f8150920 2023-05-10T01:45:13.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.709+0000 7f53f4ff9700 1 -- 172.21.15.52:0/3658997504 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f53e404e340 con 0x7f53f8150920 2023-05-10T01:45:13.712 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:13.712 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7112,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/181885391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":181885391},{"type":"v1","addr":"172.21.15.52:6835","nonce":181885391}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3950662036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3950662036},{"type":"v1","addr":"172.21.15.172:6837","nonce":3950662036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1999904451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1999904451},{"type":"v1","addr":"172.21.15.52:6834","nonce":1999904451}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/787978989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":787978989},{"type":"v1","addr":"172.21.15.172:6836","nonce":787978989}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-05-10T01:45:13.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 msgr2=0x7f53e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 0x7f53e0061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53ec001ed0 tx=0x7f53ec015000).stop 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 msgr2=0x7f53f8146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f53e40028c0 tx=0x7f53e4007bb0).stop 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 shutdown_connections 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f53e005ed90 0x7f53e0061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f8144030 0x7f53f8144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53dc0038e0 0x7f53f80c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 --2- 172.21.15.52:0/3658997504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53f8150920 0x7f53f8146960 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 >> 172.21.15.52:0/3658997504 conn(0x7f53f80c8a90 msgr2=0x7f53f8063710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.711+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 shutdown_connections 2023-05-10T01:45:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.712+0000 7f53ff114700 1 -- 172.21.15.52:0/3658997504 wait complete. 2023-05-10T01:45:13.715 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 72 2023-05-10T01:45:13.725 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T01:45:13.726 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T01:45:13.726 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:45:13.726 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:45:13.726 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T01:45:13.727 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T01:45:13.727 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:45:13.727 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:45:13.727 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T01:45:13.728 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T01:45:13.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:45:13.728 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:45:13.728 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T01:45:13.729 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T01:45:13.729 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:45:13.729 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:45:13.734 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:45:13.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T01:45:13.735 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:45:13.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T01:45:13.739 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:45:13.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T01:45:13.740 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:45:13.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T01:45:13.777 INFO:tasks.ceph.mds.a:Started 2023-05-10T01:45:13.778 DEBUG:teuthology.parallel:result is None 2023-05-10T01:45:13.779 INFO:tasks.ceph.mds.c:Started 2023-05-10T01:45:13.779 DEBUG:teuthology.parallel:result is None 2023-05-10T01:45:13.782 INFO:tasks.ceph.mds.b:Started 2023-05-10T01:45:13.782 DEBUG:teuthology.parallel:result is None 2023-05-10T01:45:13.783 INFO:tasks.ceph.mds.d:Started 2023-05-10T01:45:13.783 DEBUG:teuthology.parallel:result is None 2023-05-10T01:45:13.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T01:45:13.851 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:45:13.851 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-05-10T01:45:13.863 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-05-10T01:45:13.863 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-05-10T01:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.911+0000 7f9148961700 1 Processor -- start 2023-05-10T01:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.911+0000 7f9148961700 1 -- start start 2023-05-10T01:45:13.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9148961700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9148961700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91440c34f0 0x7f91440c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9148961700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440c3060 con 0x7f91440652f0 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9148961700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440c2450 con 0x7f91440c34f0 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9148961700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440c2730 con 0x7f9144064f10 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91440c34f0 0x7f91440c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91440c34f0 0x7f91440c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42114/0 (socket says 172.21.15.52:42114) 2023-05-10T01:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 -- 172.21.15.52:0/407205707 learned_addr learned my addr 172.21.15.52:0/407205707 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9142d9d700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 -- 172.21.15.52:0/407205707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 msgr2=0x7f91440c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 -- 172.21.15.52:0/407205707 >> v1:172.21.15.172:6789/0 conn(0x7f91440652f0 legacy=0x7f91440a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 -- 172.21.15.52:0/407205707 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440c2a10 con 0x7f91440c34f0 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f9142d9d700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.912+0000 7f914359e700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f91440c3940 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f9134006fd0 tx=0x7f91340090f0).ready entity=mon.0 client_cookie=88e9aeaca7f11b58 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9141d9b700 1 -- 172.21.15.52:0/407205707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400b690 con 0x7f91440c34f0 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9141d9b700 1 -- 172.21.15.52:0/407205707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400b7f0 con 0x7f91440c34f0 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9141d9b700 1 -- 172.21.15.52:0/407205707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400bb70 con 0x7f91440c34f0 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 -- 172.21.15.52:0/407205707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 msgr2=0x7f91440c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f91440c3940 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f9134006fd0 tx=0x7f91340090f0).stop 2023-05-10T01:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 -- 172.21.15.52:0/407205707 shutdown_connections 2023-05-10T01:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 --2- 172.21.15.52:0/407205707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f91440c3940 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 -- 172.21.15.52:0/407205707 >> 172.21.15.52:0/407205707 conn(0x7f91440c82a0 msgr2=0x7f91440c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 -- 172.21.15.52:0/407205707 shutdown_connections 2023-05-10T01:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.913+0000 7f9148961700 1 -- 172.21.15.52:0/407205707 wait complete. 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.914+0000 7f9148961700 1 Processor -- start 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.914+0000 7f9148961700 1 -- start start 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91440652f0 0x7f914414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440a7620 con 0x7f91440c34f0 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144069430 con 0x7f91440652f0 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9148961700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144069db0 con 0x7f9144064f10 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f914359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f914359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42120/0 (socket says 172.21.15.52:42120) 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f914359e700 1 -- 172.21.15.52:0/1988957820 learned_addr learned my addr 172.21.15.52:0/1988957820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f9142d9d700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.915+0000 7f914259c700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91440652f0 0x7f914414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 -- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 msgr2=0x7f91440698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 -- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91440652f0 msgr2=0x7f914414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91440652f0 0x7f914414a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 -- 172.21.15.52:0/1988957820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009370 con 0x7f91440c34f0 2023-05-10T01:45:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f914359e700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f91440c5380 tx=0x7f9134017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134006d90 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913401c420 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914414a610 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400bb70 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.916+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9144068820 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.917+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144047150 con 0x7f91440c34f0 2023-05-10T01:45:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.917+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9134024030 con 0x7f91440c34f0 2023-05-10T01:45:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.918+0000 7f912affd700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 0x7f9124061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.918+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6163+0+0 (secure 0 0 0) 0x7f913407ae90 con 0x7f91440c34f0 2023-05-10T01:45:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.918+0000 7f9142d9d700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 0x7f9124061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.918+0000 7f9142d9d700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 0x7f9124061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f913c00d6e0 tx=0x7f913c007850).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:13.922+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f913404fe30 con 0x7f91440c34f0 2023-05-10T01:45:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.111+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9144069570 con 0x7f91440c34f0 2023-05-10T01:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.967+0000 7f912affd700 1 -- 172.21.15.52:0/1988957820 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9134022030 con 0x7f91440c34f0 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 msgr2=0x7f9124061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 0x7f9124061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f913c00d6e0 tx=0x7f913c007850).stop 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 msgr2=0x7f914413ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f91440c5380 tx=0x7f9134017000).stop 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 shutdown_connections 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f912405ed90 0x7f9124061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:14.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.969+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91440c34f0 0x7f914413ec20 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.970+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9144064f10 0x7f91440698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.970+0000 7f9148961700 1 --2- 172.21.15.52:0/1988957820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91440652f0 0x7f914414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.970+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 >> 172.21.15.52:0/1988957820 conn(0x7f91440c82a0 msgr2=0x7f9144150800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.970+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 shutdown_connections 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:14.970+0000 7f9148961700 1 -- 172.21.15.52:0/1988957820 wait complete. 2023-05-10T01:45:14.973 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-05-10T01:45:14.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T01:45:15.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 Processor -- start 2023-05-10T01:45:15.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 -- start start 2023-05-10T01:45:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f712c13b540 0x7f712c0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0bdc20 con 0x7f712c13b920 2023-05-10T01:45:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0c4e30 con 0x7f712c063e20 2023-05-10T01:45:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.108+0000 7f7132a6c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0c53f0 con 0x7f712c13b540 2023-05-10T01:45:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f7130808700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f712c13b540 0x7f712c0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f712c13b920 0x7f712c063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51144/0 (socket says 172.21.15.52:51144) 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712bfff700 1 -- 172.21.15.52:0/241965179 learned_addr learned my addr 172.21.15.52:0/241965179 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f7130808700 1 -- 172.21.15.52:0/241965179 >> v1:172.21.15.172:6789/0 conn(0x7f712c063e20 legacy=0x7f712c0be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f7130808700 1 -- 172.21.15.52:0/241965179 >> v1:172.21.15.52:6789/0 conn(0x7f712c13b920 legacy=0x7f712c063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712b7fe700 1 -- 172.21.15.52:0/241965179 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689182101 0 0) 0x7f712c0bdc20 con 0x7f712c13b920 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f7130808700 1 -- 172.21.15.52:0/241965179 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0c5110 con 0x7f712c13b540 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f7130808700 1 --2- 172.21.15.52:0/241965179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b540 0x7f712c0c31e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f7124009e60 tx=0x7f7124009780).ready entity=mon.0 client_cookie=8ab2da6a1d79ba74 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712b7fe700 1 -- 172.21.15.52:0/241965179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400e070 con 0x7f712c13b540 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712b7fe700 1 -- 172.21.15.52:0/241965179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400bbf0 con 0x7f712c13b540 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.109+0000 7f712b7fe700 1 -- 172.21.15.52:0/241965179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124012410 con 0x7f712c13b540 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 -- 172.21.15.52:0/241965179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b540 msgr2=0x7f712c0c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 --2- 172.21.15.52:0/241965179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b540 0x7f712c0c31e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f7124009e60 tx=0x7f7124009780).stop 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 -- 172.21.15.52:0/241965179 shutdown_connections 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 --2- 172.21.15.52:0/241965179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b540 0x7f712c0c31e0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 -- 172.21.15.52:0/241965179 >> 172.21.15.52:0/241965179 conn(0x7f712c0c8a90 msgr2=0x7f712c0c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:15.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 -- 172.21.15.52:0/241965179 shutdown_connections 2023-05-10T01:45:15.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.110+0000 7f7132a6c700 1 -- 172.21.15.52:0/241965179 wait complete. 2023-05-10T01:45:15.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.111+0000 7f7132a6c700 1 Processor -- start 2023-05-10T01:45:15.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.111+0000 7f7132a6c700 1 -- start start 2023-05-10T01:45:15.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 0x7f712c167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 0x7f712c0c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c069960 con 0x7f712c13b920 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c2140 con 0x7f712c063e20 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7132a6c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c1530 con 0x7f712c13b540 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42134/0 (socket says 172.21.15.52:42134) 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 -- 172.21.15.52:0/3183044643 learned_addr learned my addr 172.21.15.52:0/3183044643 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7130808700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 0x7f712c167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f712bfff700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 0x7f712c0c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 -- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 msgr2=0x7f712c0c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 0x7f712c0c0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 -- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 msgr2=0x7f712c167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 0x7f712c167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 -- 172.21.15.52:0/3183044643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009a20 con 0x7f712c13b920 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7130808700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 0x7f712c167f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:15.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f712bfff700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 0x7f712c0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7131009700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f711c00c4c0 tx=0x7f711c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.112+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c002ea0 con 0x7f712c13b920 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.113+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00f470 con 0x7f712c13b920 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.113+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c0c1810 con 0x7f712c13b920 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.113+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00f810 con 0x7f712c13b920 2023-05-10T01:45:15.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.113+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c0c1dd0 con 0x7f712c13b920 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.114+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c06c340 con 0x7f712c13b920 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.114+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f711c010070 con 0x7f712c13b920 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.114+0000 7f7128ff9700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 0x7f710c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.114+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f711c078c50 con 0x7f712c13b920 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.114+0000 7f7130808700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 0x7f710c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.115+0000 7f7130808700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 0x7f710c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f712c0c09f0 tx=0x7f7124009780).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.118+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f711c0478f0 con 0x7f712c13b920 2023-05-10T01:45:15.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.359+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f712c0c4b40 con 0x7f712c13b920 2023-05-10T01:45:15.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.359+0000 7f7128ff9700 1 -- 172.21.15.52:0/3183044643 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f711c04a420 con 0x7f712c13b920 2023-05-10T01:45:15.362 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:15.362 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:15.362 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-05-10T01:45:15.362 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk5NR6AxAAKiAcaOKooL8dg/QtAAdkVA==", 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.363 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkZkLODhAACeTdT+UssJ2tuX8j7JXtRA==", 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.364 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkaXpQChAAv1LmthkArXbm3xEDYHnK1A==", 2023-05-10T01:45:15.365 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:45:15.366 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:45:15.366 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.366 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkMhp/FRAAt0mYCVT6IuWnJjBn9Pc/vQ==", 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:45:15.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCs7lpkpM9PNhAAItyy/d0UgLEf/Zrsb5w+Xw==", 2023-05-10T01:45:15.368 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-05-10T01:45:15.369 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCv7lpkCYlIORAAyR1X5/b+KAVCv8uI3Afp6A==", 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.370 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCy7lpkewltOxAA6jeI5tumQyJP1EIH3vGRcQ==", 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.371 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC27lpkoKSKABAArT5z2/pThr5hBfWqTwhduQ==", 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC77lpkYPW5IhAAoKHlZAa1mNmoYO9YUoYzgA==", 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQC+7lpkH9GbJhAAD2FGJlaauqTRMRAuBYS6/w==", 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.374 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDB7lpk8kIsJRAAjAn7rRmbLC8n9fy4HHpRWQ==", 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.375 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDE7lpkKXaNJhAAzT1KsQPbY+e78GZrB683yA==", 2023-05-10T01:45:15.376 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-05-10T01:45:15.377 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk9T9FGRAALb+5/LEZkR5FyXMFdpL6dQ==", 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.378 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk7XrYIRAACze4DzDY3ewAR9xlGS6VQg==", 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.379 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkEDfMHhAAUNNUAokfGZ9mRFi0N9NIdw==", 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:45:15.380 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpkShQ2JxAA60BHSzuXrUMZjgcaB+4jAg==", 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-05-10T01:45:15.382 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkcPBGJBAAvWo6kWV7Cjplx5kUfirQmA==", 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.383 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-05-10T01:45:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCr7lpk3yNxABAACGi/I2X+i4T7JNNgilo0yQ==", 2023-05-10T01:45:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.384 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQCq7lpkEAWLOBAAluBVpZ5q0XBUv4FVlgtKFQ==", 2023-05-10T01:45:15.385 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-05-10T01:45:15.386 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 msgr2=0x7f710c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 0x7f710c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f712c0c09f0 tx=0x7f7124009780).stop 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 msgr2=0x7f712c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f711c00c4c0 tx=0x7f711c007de0).stop 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 shutdown_connections 2023-05-10T01:45:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f710c05ed90 0x7f710c061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f712c13b920 0x7f712c153dd0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c063e20 0x7f712c167f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 --2- 172.21.15.52:0/3183044643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c13b540 0x7f712c0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 >> 172.21.15.52:0/3183044643 conn(0x7f712c0c8a90 msgr2=0x7f712c137e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 shutdown_connections 2023-05-10T01:45:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.361+0000 7f7132a6c700 1 -- 172.21.15.52:0/3183044643 wait complete. 2023-05-10T01:45:15.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:15.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.504+0000 7f1d68f4b700 1 Processor -- start 2023-05-10T01:45:15.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.504+0000 7f1d68f4b700 1 -- start start 2023-05-10T01:45:15.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d68f4b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d64150b40 0x7f1d64150f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d68f4b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640a61c0 con 0x7f1d64068f00 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d68f4b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d64069400 con 0x7f1d640bc8e0 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d68f4b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640696e0 con 0x7f1d64150b40 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d61d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d64068f00 0x7f1d640a5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51156/0 (socket says 172.21.15.52:51156) 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d61d9b700 1 -- 172.21.15.52:0/2502381198 learned_addr learned my addr 172.21.15.52:0/2502381198 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d6259c700 1 --2- 172.21.15.52:0/2502381198 >> v2:172.21.15.172:3300/0 conn(0x7f1d64150b40 0x7f1d64150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544156066 0 0) 0x7f1d640a61c0 con 0x7f1d64068f00 2023-05-10T01:45:15.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.505+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d440033f0 con 0x7f1d64068f00 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782137066 0 0) 0x7f1d64069400 con 0x7f1d640bc8e0 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d640a61c0 con 0x7f1d640bc8e0 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201502460 0 0) 0x7f1d440033f0 con 0x7f1d64068f00 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 >> v2:172.21.15.172:3300/0 conn(0x7f1d64150b40 msgr2=0x7f1d64150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 --2- 172.21.15.52:0/2502381198 >> v2:172.21.15.172:3300/0 conn(0x7f1d64150b40 0x7f1d64150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 >> v1:172.21.15.172:6789/0 conn(0x7f1d640bc8e0 legacy=0x7f1d64065310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640699c0 con 0x7f1d64068f00 2023-05-10T01:45:15.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f1d4c001470 con 0x7f1d64068f00 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 >> v1:172.21.15.52:6789/0 conn(0x7f1d64068f00 legacy=0x7f1d640a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d44003ac0 0x7f1d44003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d44004690 0x7f1d44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d4400daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640696e0 con 0x7f1d44005000 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4400e170 con 0x7f1d44004690 2023-05-10T01:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4400e330 con 0x7f1d44003ac0 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d4400daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d61d9b700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d44004690 0x7f1d44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d6259c700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d44003ac0 0x7f1d44003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 -- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d44003ac0 msgr2=0x7f1d44003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d44003ac0 0x7f1d44003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 -- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d44004690 msgr2=0x7f1d44004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d44004690 0x7f1d44004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 -- 172.21.15.52:0/2502381198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440033f0 con 0x7f1d44005000 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 -- 172.21.15.52:0/2502381198 reap_dead start 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.506+0000 7f1d62d9d700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d4400daf0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f1d54001f90 tx=0x7f1d54007f30).ready entity=mon.0 client_cookie=9e526cd8f188efab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54006a20 con 0x7f1d44005000 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54006b80 con 0x7f1d44005000 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d6159a700 1 -- 172.21.15.52:0/2502381198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400c8b0 con 0x7f1d44005000 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 msgr2=0x7f1d4400daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d4400daf0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f1d54001f90 tx=0x7f1d54007f30).stop 2023-05-10T01:45:15.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2502381198 shutdown_connections 2023-05-10T01:45:15.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2502381198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d4400daf0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2502381198 >> 172.21.15.52:0/2502381198 conn(0x7f1d640c7340 msgr2=0x7f1d640c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:15.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2502381198 shutdown_connections 2023-05-10T01:45:15.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.507+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2502381198 wait complete. 2023-05-10T01:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.508+0000 7f1d68f4b700 1 Processor -- start 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.508+0000 7f1d68f4b700 1 -- start start 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 0x7f1d641648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64161190 0x7f1d640a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6414ea20 con 0x7f1d44005000 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6414ed00 con 0x7f1d6414e4a0 2023-05-10T01:45:15.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d68f4b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6414efe0 con 0x7f1d64161190 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42154/0 (socket says 172.21.15.52:42154) 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 -- 172.21.15.52:0/2368174694 learned_addr learned my addr 172.21.15.52:0/2368174694 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d62d9d700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64161190 0x7f1d640a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d61d9b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 0x7f1d641648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 -- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64161190 msgr2=0x7f1d640a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64161190 0x7f1d640a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 -- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 msgr2=0x7f1d641648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 0x7f1d641648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 -- 172.21.15.52:0/2368174694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6414f2c0 con 0x7f1d44005000 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d61d9b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 0x7f1d641648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.509+0000 7f1d6259c700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f1d5c0119c0 tx=0x7f1d5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011e50 con 0x7f1d44005000 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00f940 con 0x7f1d44005000 2023-05-10T01:45:15.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6414f5a0 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00fcc0 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d641615f0 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.510+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6406c340 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.511+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1d5c024070 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.511+0000 7f1d5a7fc700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 0x7f1d48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.512+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f1d5c07a280 con 0x7f1d44005000 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.512+0000 7f1d61d9b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 0x7f1d48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.512+0000 7f1d61d9b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 0x7f1d48061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1d64167390 tx=0x7f1d4c009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.516+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d5c04ba50 con 0x7f1d44005000 2023-05-10T01:45:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.687+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d640c3e10 con 0x7f1d44005000 2023-05-10T01:45:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.688+0000 7f1d5a7fc700 1 -- 172.21.15.52:0/2368174694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+14268 (secure 0 0 0) 0x7f1d5c04f070 con 0x7f1d44005000 2023-05-10T01:45:15.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:15.691 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":169,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:14.961159+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 msgr2=0x7f1d48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 0x7f1d48061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1d64167390 tx=0x7f1d4c009040).stop 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 msgr2=0x7f1d6414fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f1d5c0119c0 tx=0x7f1d5c009060).stop 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 shutdown_connections 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1d4805ed90 0x7f1d48061250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64161190 0x7f1d640a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d44005000 0x7f1d6414fac0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 --2- 172.21.15.52:0/2368174694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d6414e4a0 0x7f1d641648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 >> 172.21.15.52:0/2368174694 conn(0x7f1d640c7340 msgr2=0x7f1d640c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 shutdown_connections 2023-05-10T01:45:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.690+0000 7f1d68f4b700 1 -- 172.21.15.52:0/2368174694 wait complete. 2023-05-10T01:45:15.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-05-10T01:45:15.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:45:15.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.823+0000 7f43c9bdd700 1 Processor -- start 2023-05-10T01:45:15.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.823+0000 7f43c9bdd700 1 -- start start 2023-05-10T01:45:15.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c9bdd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43c40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c9bdd700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40c94c0 con 0x7f43c4154080 2023-05-10T01:45:15.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c9bdd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40cb7d0 con 0x7f43c4154460 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c9bdd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c88b0 con 0x7f43c4068860 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f43c4154080 0x7f43c40a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51176/0 (socket says 172.21.15.52:51176) 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c37fe700 1 -- 172.21.15.52:0/3400038921 learned_addr learned my addr 172.21.15.52:0/3400038921 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917129461 0 0) 0x7f43c40c94c0 con 0x7f43c4154080 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b00033f0 con 0x7f43c4154080 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.824+0000 7f43c3fff700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43c40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1699513393 0 0) 0x7f43b00033f0 con 0x7f43c4154080 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 msgr2=0x7f43c40aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43c40aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 >> v1:172.21.15.172:6789/0 conn(0x7f43c4154460 legacy=0x7f43c4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40c8b90 con 0x7f43c4154080 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f43b4001470 con 0x7f43c4154080 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 >> v1:172.21.15.52:6789/0 conn(0x7f43c4154080 legacy=0x7f43c40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0003910 0x7f43b0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b0004b80 0x7f43b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c88b0 con 0x7f43b0004b80 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b000b910 con 0x7f43b0003910 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b000bad0 con 0x7f43c4068860 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b0004b80 0x7f43b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c37fe700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0003910 0x7f43b0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c2ffd700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 -- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 msgr2=0x7f43b0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c4068860 0x7f43b0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 -- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0003910 msgr2=0x7f43b0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0003910 0x7f43b0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 -- 172.21.15.52:0/3400038921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00033f0 con 0x7f43b0004b80 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c3fff700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b0004b80 0x7f43b0005000 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f43bc00e1c0 tx=0x7f43bc00b040).ready entity=mon.0 client_cookie=aa25b7b37beab01b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc009ac0 con 0x7f43b0004b80 2023-05-10T01:45:15.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00f040 con 0x7f43b0004b80 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.825+0000 7f43c27fc700 1 -- 172.21.15.52:0/3400038921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00eca0 con 0x7f43b0004b80 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 -- 172.21.15.52:0/3400038921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b0004b80 msgr2=0x7f43b0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/3400038921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b0004b80 0x7f43b0005000 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f43bc00e1c0 tx=0x7f43bc00b040).stop 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c3fff700 1 -- 172.21.15.52:0/3400038921 reap_dead start 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 -- 172.21.15.52:0/3400038921 shutdown_connections 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 -- 172.21.15.52:0/3400038921 >> 172.21.15.52:0/3400038921 conn(0x7f43c4067910 msgr2=0x7f43c40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:15.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 -- 172.21.15.52:0/3400038921 shutdown_connections 2023-05-10T01:45:15.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.826+0000 7f43c9bdd700 1 -- 172.21.15.52:0/3400038921 wait complete. 2023-05-10T01:45:15.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.827+0000 7f43c9bdd700 1 Processor -- start 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.827+0000 7f43c9bdd700 1 -- start start 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 0x7f43c414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c40ae8f0 0x7f43c40c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4168d00 con 0x7f43c4155ad0 2023-05-10T01:45:15.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40aed70 con 0x7f43b0004b80 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c9bdd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41680f0 con 0x7f43c40ae8f0 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42172/0 (socket says 172.21.15.52:42172) 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 -- 172.21.15.52:0/190311874 learned_addr learned my addr 172.21.15.52:0/190311874 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c3fff700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c40ae8f0 0x7f43c40c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c37fe700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 0x7f43c414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 -- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c40ae8f0 msgr2=0x7f43c40c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c40ae8f0 0x7f43c40c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 -- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 msgr2=0x7f43c414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 0x7f43c414e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 -- 172.21.15.52:0/190311874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c41683d0 con 0x7f43c4155ad0 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c37fe700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 0x7f43c414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.828+0000 7f43c2ffd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f43b8002690 tx=0x7f43b8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.829+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8011590 con 0x7f43c4155ad0 2023-05-10T01:45:15.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.829+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80116f0 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.829+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c41686b0 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.829+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8011a70 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.829+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c414eec0 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.830+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4168b50 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.830+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f43b801a030 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.830+0000 7f43ab7fe700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 0x7f43a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.830+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f43b8079060 con 0x7f43c4155ad0 2023-05-10T01:45:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.830+0000 7f43c37fe700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 0x7f43a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.831+0000 7f43c37fe700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 0x7f43a4061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43b4000e10 tx=0x7f43b4009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:15.835+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43b80498f0 con 0x7f43c4155ad0 2023-05-10T01:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.008+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f43c4168eb0 con 0x7f43c4155ad0 2023-05-10T01:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.008+0000 7f43ab7fe700 1 -- 172.21.15.52:0/190311874 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v169) v1 ==== 110+0+10 (secure 0 0 0) 0x7f43c4168eb0 con 0x7f43c4155ad0 2023-05-10T01:45:16.011 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 msgr2=0x7f43a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 0x7f43a4061250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43b4000e10 tx=0x7f43b4009040).stop 2023-05-10T01:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 msgr2=0x7f43c40ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f43b8002690 tx=0x7f43b8007bb0).stop 2023-05-10T01:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 shutdown_connections 2023-05-10T01:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f43a405ed90 0x7f43a4061250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43c40ae8f0 0x7f43c40c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b0004b80 0x7f43c414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 --2- 172.21.15.52:0/190311874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43c4155ad0 0x7f43c40ae400 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 >> 172.21.15.52:0/190311874 conn(0x7f43c4067910 msgr2=0x7f43c40b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 shutdown_connections 2023-05-10T01:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.010+0000 7f43c9bdd700 1 -- 172.21.15.52:0/190311874 wait complete. 2023-05-10T01:45:16.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:45:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.141+0000 7fd4a0e30700 1 Processor -- start 2023-05-10T01:45:16.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.141+0000 7fd4a0e30700 1 -- start start 2023-05-10T01:45:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd4a0e30700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd49c154080 0x7fd49c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd4a0e30700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd4a0e30700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0c94c0 con 0x7fd49c0aa140 2023-05-10T01:45:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd4a0e30700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0aa5b0 con 0x7fd49c154080 2023-05-10T01:45:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd4a0e30700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0cb7d0 con 0x7fd49c154460 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd49a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd49c154080 0x7fd49c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd49a59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd49c154080 0x7fd49c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42180/0 (socket says 172.21.15.52:42180) 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.142+0000 7fd49a59c700 1 -- 172.21.15.52:0/530281612 learned_addr learned my addr 172.21.15.52:0/530281612 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd499d9b700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49a59c700 1 -- 172.21.15.52:0/530281612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 msgr2=0x7fd49c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49a59c700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49a59c700 1 -- 172.21.15.52:0/530281612 >> v1:172.21.15.172:6789/0 conn(0x7fd49c0aa140 legacy=0x7fd49c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49a59c700 1 -- 172.21.15.52:0/530281612 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0c88b0 con 0x7fd49c154080 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49a59c700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c154080 0x7fd49c0aac90 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fd494006fd0 tx=0x7fd4940090f0).ready entity=mon.0 client_cookie=d41e7964e8f13044 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49959a700 1 -- 172.21.15.52:0/530281612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400b580 con 0x7fd49c154080 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49959a700 1 -- 172.21.15.52:0/530281612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400b6e0 con 0x7fd49c154080 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd49959a700 1 -- 172.21.15.52:0/530281612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400ba60 con 0x7fd49c154080 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd4a0e30700 1 -- 172.21.15.52:0/530281612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c154080 msgr2=0x7fd49c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.143+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c154080 0x7fd49c0aac90 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fd494006fd0 tx=0x7fd4940090f0).stop 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 -- 172.21.15.52:0/530281612 shutdown_connections 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c154080 0x7fd49c0aac90 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/530281612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 -- 172.21.15.52:0/530281612 >> 172.21.15.52:0/530281612 conn(0x7fd49c067910 msgr2=0x7fd49c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 -- 172.21.15.52:0/530281612 shutdown_connections 2023-05-10T01:45:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.144+0000 7fd4a0e30700 1 -- 172.21.15.52:0/530281612 wait complete. 2023-05-10T01:45:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 Processor -- start 2023-05-10T01:45:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 -- start start 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 0x7fd49c155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c154e90 con 0x7fd49c0aa140 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c156550 con 0x7fd49c154080 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.145+0000 7fd4a0e30700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c156830 con 0x7fd49c154460 2023-05-10T01:45:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42186/0 (socket says 172.21.15.52:42186) 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 -- 172.21.15.52:0/1146232888 learned_addr learned my addr 172.21.15.52:0/1146232888 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49ad9d700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd499d9b700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 0x7fd49c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 -- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 msgr2=0x7fd49c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c14a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 -- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 msgr2=0x7fd49c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 0x7fd49c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 -- 172.21.15.52:0/1146232888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009370 con 0x7fd49c0aa140 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd499d9b700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 0x7fd49c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49ad9d700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd49a59c700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fd494009130 tx=0x7fd494017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400b850 con 0x7fd49c0aa140 2023-05-10T01:45:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400b9b0 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c156b10 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49401c670 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.146+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c154b20 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.147+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c066720 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.148+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd49402c070 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.148+0000 7fd4927fc700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 0x7fd480061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.148+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7fd49407b490 con 0x7fd49c0aa140 2023-05-10T01:45:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.148+0000 7fd499d9b700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 0x7fd480061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.149+0000 7fd499d9b700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 0x7fd480061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd49c0c4730 tx=0x7fd484008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.152+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd49404cc60 con 0x7fd49c0aa140 2023-05-10T01:45:16.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.327+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd49c06c340 con 0x7fd49c0aa140 2023-05-10T01:45:16.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.328+0000 7fd4927fc700 1 -- 172.21.15.52:0/1146232888 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v169) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd49402a020 con 0x7fd49c0aa140 2023-05-10T01:45:16.330 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:45:16.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 msgr2=0x7fd480061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 0x7fd480061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd49c0c4730 tx=0x7fd484008040).stop 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 msgr2=0x7fd49c0c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fd494009130 tx=0x7fd494017000).stop 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 shutdown_connections 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd48005ed90 0x7fd480061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd49c154460 0x7fd49c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0aa140 0x7fd49c0c4e40 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 --2- 172.21.15.52:0/1146232888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd49c154080 0x7fd49c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 >> 172.21.15.52:0/1146232888 conn(0x7fd49c067910 msgr2=0x7fd49c14ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.329+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 shutdown_connections 2023-05-10T01:45:16.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.330+0000 7fd4a0e30700 1 -- 172.21.15.52:0/1146232888 wait complete. 2023-05-10T01:45:16.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T01:45:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.456+0000 7fc507a23700 1 Processor -- start 2023-05-10T01:45:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.457+0000 7fc507a23700 1 -- start start 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.457+0000 7fc507a23700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc500069da0 0x7fc50015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.457+0000 7fc507a23700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000c0650 con 0x7fc500154540 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.457+0000 7fc507a23700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000c1af0 con 0x7fc500154160 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.457+0000 7fc507a23700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5000bfd20 con 0x7fc500069da0 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc504fbe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc500154540 0x7fc500069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51212/0 (socket says 172.21.15.52:51212) 2023-05-10T01:45:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc504fbe700 1 -- 172.21.15.52:0/3884890953 learned_addr learned my addr 172.21.15.52:0/3884890953 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc505fc0700 1 --2- 172.21.15.52:0/3884890953 >> v2:172.21.15.172:3300/0 conn(0x7fc500069da0 0x7fc50015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656998555 0 0) 0x7fc5000c0650 con 0x7fc500154540 2023-05-10T01:45:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ec0033f0 con 0x7fc500154540 2023-05-10T01:45:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798392299 0 0) 0x7fc4ec0033f0 con 0x7fc500154540 2023-05-10T01:45:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 >> v2:172.21.15.172:3300/0 conn(0x7fc500069da0 msgr2=0x7fc50015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 --2- 172.21.15.52:0/3884890953 >> v2:172.21.15.172:3300/0 conn(0x7fc500069da0 0x7fc50015f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 >> v1:172.21.15.172:6789/0 conn(0x7fc500154160 legacy=0x7fc5000c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000c0000 con 0x7fc500154540 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fc4f4001470 con 0x7fc500154540 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 >> v1:172.21.15.52:6789/0 conn(0x7fc500154540 legacy=0x7fc500069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4ec0038e0 0x7fc4ec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 0x7fc4ec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec005050 0x7fc4ec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000bfd20 con 0x7fc4ec004690 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec00bfe0 con 0x7fc4ec005050 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec00c1a0 con 0x7fc4ec0038e0 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 0x7fc4ec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.458+0000 7fc5057bf700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4ec0038e0 0x7fc4ec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc505fc0700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec005050 0x7fc4ec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 -- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4ec0038e0 msgr2=0x7fc4ec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4ec0038e0 0x7fc4ec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 -- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec005050 msgr2=0x7fc4ec00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec005050 0x7fc4ec00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc505fc0700 1 -- 172.21.15.52:0/3884890953 reap_dead start 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 -- 172.21.15.52:0/3884890953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0033f0 con 0x7fc4ec004690 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 0x7fc4ec004b10 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fc500154920 tx=0x7fc4f4001e50).ready entity=mon.0 client_cookie=7856285bdf908246 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4007a20 con 0x7fc4ec004690 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f400c9e0 con 0x7fc4ec004690 2023-05-10T01:45:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc4fffff700 1 -- 172.21.15.52:0/3884890953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400cd80 con 0x7fc4ec004690 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc507a23700 1 -- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 msgr2=0x7fc4ec004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc507a23700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 0x7fc4ec004b10 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fc500154920 tx=0x7fc4f4001e50).stop 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc507a23700 1 -- 172.21.15.52:0/3884890953 shutdown_connections 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.459+0000 7fc507a23700 1 --2- 172.21.15.52:0/3884890953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ec004690 0x7fc4ec004b10 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.460+0000 7fc507a23700 1 -- 172.21.15.52:0/3884890953 >> 172.21.15.52:0/3884890953 conn(0x7fc5000cb6f0 msgr2=0x7fc5000c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.460+0000 7fc507a23700 1 -- 172.21.15.52:0/3884890953 shutdown_connections 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.460+0000 7fc507a23700 1 -- 172.21.15.52:0/3884890953 wait complete. 2023-05-10T01:45:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.461+0000 7fc507a23700 1 Processor -- start 2023-05-10T01:45:16.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.461+0000 7fc507a23700 1 -- start start 2023-05-10T01:45:16.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec004690 0x7fc5000af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5001528d0 0x7fc500152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b03f0 con 0x7fc50014eb00 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50014ef80 con 0x7fc4ec004690 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000af7e0 con 0x7fc5001528d0 2023-05-10T01:45:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42206/0 (socket says 172.21.15.52:42206) 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 -- 172.21.15.52:0/3555503162 learned_addr learned my addr 172.21.15.52:0/3555503162 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc5057bf700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec004690 0x7fc5000af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc505fc0700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5001528d0 0x7fc500152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 -- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5001528d0 msgr2=0x7fc500152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5001528d0 0x7fc500152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 -- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec004690 msgr2=0x7fc5000af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec004690 0x7fc5000af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 -- 172.21.15.52:0/3555503162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000afac0 con 0x7fc50014eb00 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc504fbe700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fc4f400c720 tx=0x7fc4f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4007a20 con 0x7fc50014eb00 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4001430 con 0x7fc50014eb00 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5000b03f0 con 0x7fc50014eb00 2023-05-10T01:45:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004af0 con 0x7fc50014eb00 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.462+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5000b0080 con 0x7fc50014eb00 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.463+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5000666b0 con 0x7fc50014eb00 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.464+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc4f4027070 con 0x7fc50014eb00 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.465+0000 7fc4fd7fa700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 0x7fc4e0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.465+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7fc4f407a7a0 con 0x7fc50014eb00 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.465+0000 7fc5057bf700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 0x7fc4e0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.465+0000 7fc5057bf700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 0x7fc4e0061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc4f8000f80 tx=0x7fc4f8007f30).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.468+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4f404bff0 con 0x7fc50014eb00 2023-05-10T01:45:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.645+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc50006c340 con 0x7fc50014eb00 2023-05-10T01:45:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.646+0000 7fc4fd7fa700 1 -- 172.21.15.52:0/3555503162 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v169) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc4f4025070 con 0x7fc50014eb00 2023-05-10T01:45:16.648 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:16.648 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:45:16.648 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "device_health_metrics" 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-05-10T01:45:16.649 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:16.650 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:45:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.647+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 msgr2=0x7fc4e0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.647+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 0x7fc4e0061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc4f8000f80 tx=0x7fc4f8007f30).stop 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.647+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 msgr2=0x7fc5001523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.647+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fc4f400c720 tx=0x7fc4f4015000).stop 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 shutdown_connections 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fc4e005ed90 0x7fc4e0061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5001528d0 0x7fc500152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4ec004690 0x7fc5000af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 --2- 172.21.15.52:0/3555503162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc50014eb00 0x7fc5001523e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 >> 172.21.15.52:0/3555503162 conn(0x7fc5000cb6f0 msgr2=0x7fc5000ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 shutdown_connections 2023-05-10T01:45:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.648+0000 7fc507a23700 1 -- 172.21.15.52:0/3555503162 wait complete. 2023-05-10T01:45:16.661 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T01:45:16.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-05-10T01:45:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.780+0000 7f3bfeab0700 1 Processor -- start 2023-05-10T01:45:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.780+0000 7f3bfeab0700 1 -- start start 2023-05-10T01:45:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfeab0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3bf8150ba0 0x7f3bf8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfeab0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 0x7f3bf8068440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfeab0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf8064e80 con 0x7f3bf80a6770 2023-05-10T01:45:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfeab0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf8068930 con 0x7f3bf8150ba0 2023-05-10T01:45:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfeab0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8065a00 con 0x7f3bf8150f80 2023-05-10T01:45:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfd04d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3bf80a6770 0x7f3bf8154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51230/0 (socket says 172.21.15.52:51230) 2023-05-10T01:45:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.781+0000 7f3bfd04d700 1 -- 172.21.15.52:0/2921576980 learned_addr learned my addr 172.21.15.52:0/2921576980 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 --2- 172.21.15.52:0/2921576980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 0x7f3bf8068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bfc84c700 1 --2- 172.21.15.52:0/2921576980 >> v2:172.21.15.172:3300/0 conn(0x7f3bf8150ba0 0x7f3bf8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053716739 0 0) 0x7f3bf8064e80 con 0x7f3bf80a6770 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80033f0 con 0x7f3bf80a6770 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 -- 172.21.15.52:0/2921576980 >> v2:172.21.15.172:3300/0 conn(0x7f3bf8150ba0 msgr2=0x7f3bf8067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 --2- 172.21.15.52:0/2921576980 >> v2:172.21.15.172:3300/0 conn(0x7f3bf8150ba0 0x7f3bf8067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285133176 0 0) 0x7f3bd80033f0 con 0x7f3bf80a6770 2023-05-10T01:45:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 -- 172.21.15.52:0/2921576980 >> v1:172.21.15.52:6789/0 conn(0x7f3bf80a6770 legacy=0x7f3bf8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 -- 172.21.15.52:0/2921576980 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80635a0 con 0x7f3bf8150f80 2023-05-10T01:45:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf7fff700 1 --2- 172.21.15.52:0/2921576980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 0x7f3bf8068440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f3be8009e60 tx=0x7f3be8009780).ready entity=mon.2 client_cookie=70a0a384421dcd93 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800e070 con 0x7f3bf8150f80 2023-05-10T01:45:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800b7a0 con 0x7f3bf8150f80 2023-05-10T01:45:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.782+0000 7f3bf77fe700 1 -- 172.21.15.52:0/2921576980 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0001470 con 0x7f3bf8150f80 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 -- 172.21.15.52:0/2921576980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 msgr2=0x7f3bf8068440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/2921576980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 0x7f3bf8068440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f3be8009e60 tx=0x7f3be8009780).stop 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 -- 172.21.15.52:0/2921576980 shutdown_connections 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/2921576980 >> v2:172.21.15.172:3300/0 conn(0x7f3bf8150ba0 0x7f3bf8067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/2921576980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf8150f80 0x7f3bf8068440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 -- 172.21.15.52:0/2921576980 >> 172.21.15.52:0/2921576980 conn(0x7f3bf80c8410 msgr2=0x7f3bf80c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 -- 172.21.15.52:0/2921576980 shutdown_connections 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.783+0000 7f3bfeab0700 1 -- 172.21.15.52:0/2921576980 wait complete. 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.784+0000 7f3bfeab0700 1 Processor -- start 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.784+0000 7f3bfeab0700 1 -- start start 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf80a6770 0x7f3bf81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8150ba0 0x7f3bf80c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80c0f20 con 0x7f3bf8150f80 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80a9140 con 0x7f3bf8150ba0 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfeab0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80c0770 con 0x7f3bf80a6770 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42220/0 (socket says 172.21.15.52:42220) 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 -- 172.21.15.52:0/1625344946 learned_addr learned my addr 172.21.15.52:0/1625344946 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfc84c700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf80a6770 0x7f3bf81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bf7fff700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8150ba0 0x7f3bf80c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 -- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf80a6770 msgr2=0x7f3bf81536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf80a6770 0x7f3bf81536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 -- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8150ba0 msgr2=0x7f3bf80c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8150ba0 0x7f3bf80c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 -- 172.21.15.52:0/1625344946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009a20 con 0x7f3bf8150f80 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.785+0000 7f3bfd04d700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f3be000c840 tx=0x7f3be0001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.786+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007170 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.786+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00072d0 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.786+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf80a8530 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.786+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00048c0 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.786+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf80a8af0 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.787+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80a92d0 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.787+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3be0004cf0 con 0x7f3bf8150f80 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.788+0000 7f3bf4ff9700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 0x7f3bdc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.788+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5561+0+0 (secure 0 0 0) 0x7f3be00794b0 con 0x7f3bf8150f80 2023-05-10T01:45:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.788+0000 7f3bfc84c700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 0x7f3bdc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.788+0000 7f3bfc84c700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 0x7f3bdc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3bf0009c30 tx=0x7f3bf0009060).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.792+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3be004ac80 con 0x7f3bf8150f80 2023-05-10T01:45:16.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:16.967+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3bf806c340 con 0x7f3bf8150f80 2023-05-10T01:45:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.797+0000 7f3bf4ff9700 1 -- 172.21.15.52:0/1625344946 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v170) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3be004e2a0 con 0x7f3bf8150f80 2023-05-10T01:45:17.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.801+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 msgr2=0x7f3bdc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.801+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 0x7f3bdc061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3bf0009c30 tx=0x7f3bf0009060).stop 2023-05-10T01:45:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.801+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 msgr2=0x7f3bf80ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.801+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f3be000c840 tx=0x7f3be0001aa0).stop 2023-05-10T01:45:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 shutdown_connections 2023-05-10T01:45:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3bdc05ed90 0x7f3bdc061250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf8150f80 0x7f3bf80ab0b0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3bf80a6770 0x7f3bf81536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 --2- 172.21.15.52:0/1625344946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8150ba0 0x7f3bf80c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.803+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 >> 172.21.15.52:0/1625344946 conn(0x7f3bf80c8410 msgr2=0x7f3bf80c28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:17.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.805+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 shutdown_connections 2023-05-10T01:45:17.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.806+0000 7f3bfeab0700 1 -- 172.21.15.52:0/1625344946 wait complete. 2023-05-10T01:45:17.810 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-05-10T01:45:17.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T01:45:17.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.952+0000 7f3e55027700 1 Processor -- start 2023-05-10T01:45:17.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.952+0000 7f3e55027700 1 -- start start 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e55027700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e55027700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e55027700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500c94c0 con 0x7f3e50154080 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e55027700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500cb7d0 con 0x7f3e50068150 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e55027700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50068ab0 con 0x7f3e50154460 2023-05-10T01:45:17.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4ed9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3e50154080 0x7f3e500a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:53778/0 (socket says 172.21.15.52:53778) 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:33630/0 (socket says 172.21.15.52:33630) 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:40552/0 (socket says 172.21.15.52:40552) 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1363392057 learned_addr learned my addr 172.21.15.52:0/1363392057 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1363392057 >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 msgr2=0x7f3e500685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:17.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 --2- 172.21.15.52:0/1363392057 >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1363392057 >> v1:172.21.15.172:6789/0 conn(0x7f3e50154080 legacy=0x7f3e500a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1363392057 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500c88b0 con 0x7f3e50154460 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.953+0000 7f3e4f59e700 1 --2- 172.21.15.52:0/1363392057 >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e4e59c700 1 --2- 172.21.15.52:0/1363392057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3e44006fd0 tx=0x7f3e440090f0).ready entity=mon.2 client_cookie=a923b4e5a9e67586 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e4dd9b700 1 -- 172.21.15.52:0/1363392057 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b580 con 0x7f3e50154460 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e4dd9b700 1 -- 172.21.15.52:0/1363392057 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400b6e0 con 0x7f3e50154460 2023-05-10T01:45:17.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e4dd9b700 1 -- 172.21.15.52:0/1363392057 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ba60 con 0x7f3e50154460 2023-05-10T01:45:17.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 -- 172.21.15.52:0/1363392057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 msgr2=0x7f3e500aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 --2- 172.21.15.52:0/1363392057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3e44006fd0 tx=0x7f3e440090f0).stop 2023-05-10T01:45:17.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 -- 172.21.15.52:0/1363392057 shutdown_connections 2023-05-10T01:45:17.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 --2- 172.21.15.52:0/1363392057 >> v2:172.21.15.172:3300/0 conn(0x7f3e50068150 0x7f3e500685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 --2- 172.21.15.52:0/1363392057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e500aac90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 -- 172.21.15.52:0/1363392057 >> 172.21.15.52:0/1363392057 conn(0x7f3e50067910 msgr2=0x7f3e500cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 -- 172.21.15.52:0/1363392057 shutdown_connections 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.954+0000 7f3e55027700 1 -- 172.21.15.52:0/1363392057 wait complete. 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.955+0000 7f3e55027700 1 Processor -- start 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 -- start start 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e50068150 0x7f3e500c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e50152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50150b50 con 0x7f3e50154080 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c5410 con 0x7f3e50068150 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e55027700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b0480 con 0x7f3e50154460 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e4e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e4e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42232/0 (socket says 172.21.15.52:42232) 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.956+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1559236749 learned_addr learned my addr 172.21.15.52:0/1559236749 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:17.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4ed9d700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e50068150 0x7f3e500c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4f59e700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e50152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 msgr2=0x7f3e50152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e50152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e50068150 msgr2=0x7f3e500c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e50068150 0x7f3e500c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 -- 172.21.15.52:0/1559236749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400092a0 con 0x7f3e50154080 2023-05-10T01:45:17.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4f59e700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e50152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e4e59c700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f3e50068bf0 tx=0x7f3e44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b850 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400b9b0 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44009370 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4401c650 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.957+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e500afbd0 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.958+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e50066720 con 0x7f3e50154080 2023-05-10T01:45:17.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.958+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3e44022020 con 0x7f3e50154080 2023-05-10T01:45:17.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.959+0000 7f3e36ffd700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 0x7f3e30061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:17.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.959+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5931+0+0 (secure 0 0 0) 0x7f3e4407b480 con 0x7f3e50154080 2023-05-10T01:45:17.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.959+0000 7f3e4ed9d700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 0x7f3e30061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:17.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.959+0000 7f3e4ed9d700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 0x7f3e30061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3e48000f80 tx=0x7f3e48001530).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:17.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:17.963+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e4404cb90 con 0x7f3e50154080 2023-05-10T01:45:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.136+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e5006c340 con 0x7f3e50154080 2023-05-10T01:45:18.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.803+0000 7f3e36ffd700 1 -- 172.21.15.52:0/1559236749 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v171) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e440501b0 con 0x7f3e50154080 2023-05-10T01:45:18.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.810+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 msgr2=0x7f3e30061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:18.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.810+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 0x7f3e30061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3e48000f80 tx=0x7f3e48001530).stop 2023-05-10T01:45:18.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.810+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 msgr2=0x7f3e500c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:18.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.810+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f3e50068bf0 tx=0x7f3e44017000).stop 2023-05-10T01:45:18.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 shutdown_connections 2023-05-10T01:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e3005ed90 0x7f3e30061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e50154460 0x7f3e50152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e50068150 0x7f3e500c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 --2- 172.21.15.52:0/1559236749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50154080 0x7f3e500c4f20 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.814+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 >> 172.21.15.52:0/1559236749 conn(0x7f3e50067910 msgr2=0x7f3e500cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:18.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.816+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 shutdown_connections 2023-05-10T01:45:18.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.818+0000 7f3e55027700 1 -- 172.21.15.52:0/1559236749 wait complete. 2023-05-10T01:45:18.826 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-05-10T01:45:18.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T01:45:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.961+0000 7f23213d8700 1 Processor -- start 2023-05-10T01:45:18.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.961+0000 7f23213d8700 1 -- start start 2023-05-10T01:45:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f23213d8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f231c154460 0x7f231c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f23213d8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c0685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f23213d8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0c94c0 con 0x7f231c154080 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f23213d8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0cb7d0 con 0x7f231c154460 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f23213d8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c068a90 con 0x7f231c068150 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f231a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f231c154460 0x7f231c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f231a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f231c154460 0x7f231c0aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42242/0 (socket says 172.21.15.52:42242) 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f231a7fc700 1 -- 172.21.15.52:0/3198970820 learned_addr learned my addr 172.21.15.52:0/3198970820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.962+0000 7f231b7fe700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c0685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231a7fc700 1 -- 172.21.15.52:0/3198970820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 msgr2=0x7f231c0685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231a7fc700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c0685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231a7fc700 1 -- 172.21.15.52:0/3198970820 >> v1:172.21.15.172:6789/0 conn(0x7f231c154080 legacy=0x7f231c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231a7fc700 1 -- 172.21.15.52:0/3198970820 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0c88b0 con 0x7f231c154460 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231b7fe700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f231a7fc700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154460 0x7f231c0aac90 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2304006fd0 tx=0x7f23040090f0).ready entity=mon.0 client_cookie=45f70f65a64cb234 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f2319ffb700 1 -- 172.21.15.52:0/3198970820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400b600 con 0x7f231c154460 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f2319ffb700 1 -- 172.21.15.52:0/3198970820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230400b760 con 0x7f231c154460 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f2319ffb700 1 -- 172.21.15.52:0/3198970820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400bae0 con 0x7f231c154460 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 -- 172.21.15.52:0/3198970820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154460 msgr2=0x7f231c0aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154460 0x7f231c0aac90 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2304006fd0 tx=0x7f23040090f0).stop 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 -- 172.21.15.52:0/3198970820 shutdown_connections 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c0685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 --2- 172.21.15.52:0/3198970820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154460 0x7f231c0aac90 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 -- 172.21.15.52:0/3198970820 >> 172.21.15.52:0/3198970820 conn(0x7f231c067910 msgr2=0x7f231c0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 -- 172.21.15.52:0/3198970820 shutdown_connections 2023-05-10T01:45:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.963+0000 7f23213d8700 1 -- 172.21.15.52:0/3198970820 wait complete. 2023-05-10T01:45:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 Processor -- start 2023-05-10T01:45:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 -- start start 2023-05-10T01:45:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f231c154460 0x7f231c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c151290 con 0x7f231c154080 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c0af040 con 0x7f231c154460 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.965+0000 7f23213d8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c0af4d0 con 0x7f231c068150 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42246/0 (socket says 172.21.15.52:42246) 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 -- 172.21.15.52:0/575541035 learned_addr learned my addr 172.21.15.52:0/575541035 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 -- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 msgr2=0x7f231c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231affd700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231b7fe700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f231c154460 0x7f231c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 -- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f231c154460 msgr2=0x7f231c0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f231c154460 0x7f231c0a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 -- 172.21.15.52:0/575541035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009370 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f231a7fc700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f231c06bb20 tx=0x7f2304017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400bae0 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304000c90 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c0ae710 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230401b660 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.966+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c0aecd0 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.967+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c0af320 con 0x7f231c154080 2023-05-10T01:45:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.968+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f230400f070 con 0x7f231c154080 2023-05-10T01:45:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.968+0000 7f2312ffd700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.968+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6313+0+0 (secure 0 0 0) 0x7f230407b1b0 con 0x7f231c154080 2023-05-10T01:45:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.968+0000 7f231affd700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.969+0000 7f231affd700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 0x7f2300061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2314007fd0 tx=0x7f2314009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:18.972+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f230404c710 con 0x7f231c154080 2023-05-10T01:45:19.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.190+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f231c066720 con 0x7f231c154080 2023-05-10T01:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.195+0000 7f2312ffd700 1 -- 172.21.15.52:0/575541035 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f230401f020 con 0x7f231c154080 2023-05-10T01:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.198+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 msgr2=0x7f2300061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.198+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 0x7f2300061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2314007fd0 tx=0x7f2314009040).stop 2023-05-10T01:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.198+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 msgr2=0x7f231c150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.198+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f231c06bb20 tx=0x7f2304017000).stop 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 shutdown_connections 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f230005ed90 0x7f2300061250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f231c154460 0x7f231c0a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f231c068150 0x7f231c1556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 --2- 172.21.15.52:0/575541035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f231c154080 0x7f231c150ab0 secure :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0x7f231c06bb20 tx=0x7f2304017000).stop 2023-05-10T01:45:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.199+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 >> 172.21.15.52:0/575541035 conn(0x7f231c067910 msgr2=0x7f231c0b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:19.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.203+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 shutdown_connections 2023-05-10T01:45:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.214+0000 7f23213d8700 1 -- 172.21.15.52:0/575541035 wait complete. 2023-05-10T01:45:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 21 and data pool 22 2023-05-10T01:45:19.233 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:19.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.347+0000 7ff4b3c17700 1 Processor -- start 2023-05-10T01:45:19.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.348+0000 7ff4b3c17700 1 -- start start 2023-05-10T01:45:19.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.348+0000 7ff4b3c17700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4ac154160 0x7ff4ac0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.348+0000 7ff4b3c17700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 0x7ff4ac0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.348+0000 7ff4b3c17700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b3c17700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c0650 con 0x7ff4ac154160 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b3c17700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac06a010 con 0x7ff4ac154540 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b3c17700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0bfd20 con 0x7ff4ac069690 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4ac154160 0x7ff4ac0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4ac154160 0x7ff4ac0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42268/0 (socket says 172.21.15.52:42268) 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 -- 172.21.15.52:0/897526474 learned_addr learned my addr 172.21.15.52:0/897526474 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 -- 172.21.15.52:0/897526474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 msgr2=0x7ff4ac069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:19.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b21b4700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b11b2700 1 --2- 172.21.15.52:0/897526474 >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 0x7ff4ac0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 -- 172.21.15.52:0/897526474 >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 msgr2=0x7ff4ac0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/897526474 >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 0x7ff4ac0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 -- 172.21.15.52:0/897526474 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0c0000 con 0x7ff4ac154160 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b21b4700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b11b2700 1 --2- 172.21.15.52:0/897526474 >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 0x7ff4ac0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:19.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac0c5c60 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7ff4ac0844d0 tx=0x7ff4a40090f0).ready entity=mon.0 client_cookie=ba46b364863f14d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b09b1700 1 -- 172.21.15.52:0/897526474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400b600 con 0x7ff4ac154160 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b09b1700 1 -- 172.21.15.52:0/897526474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400b760 con 0x7ff4ac154160 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.349+0000 7ff4b09b1700 1 -- 172.21.15.52:0/897526474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400bb00 con 0x7ff4ac154160 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 -- 172.21.15.52:0/897526474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 msgr2=0x7ff4ac0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac0c5c60 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7ff4ac0844d0 tx=0x7ff4a40090f0).stop 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 -- 172.21.15.52:0/897526474 shutdown_connections 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/897526474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac0c5c60 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/897526474 >> v2:172.21.15.172:3300/0 conn(0x7ff4ac154540 0x7ff4ac0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 -- 172.21.15.52:0/897526474 >> 172.21.15.52:0/897526474 conn(0x7ff4ac0cb6f0 msgr2=0x7ff4ac0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:19.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 -- 172.21.15.52:0/897526474 shutdown_connections 2023-05-10T01:45:19.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.350+0000 7ff4b3c17700 1 -- 172.21.15.52:0/897526474 wait complete. 2023-05-10T01:45:19.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.351+0000 7ff4b3c17700 1 Processor -- start 2023-05-10T01:45:19.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.351+0000 7ff4b3c17700 1 -- start start 2023-05-10T01:45:19.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac14cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ac154540 0x7ff4ac0abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0add50 con 0x7ff4ac154160 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac157e20 con 0x7ff4ac154540 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac158100 con 0x7ff4ac069690 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42276/0 (socket says 172.21.15.52:42276) 2023-05-10T01:45:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 -- 172.21.15.52:0/2740414316 learned_addr learned my addr 172.21.15.52:0/2740414316 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b21b4700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ac154540 0x7ff4ac0abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac14cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 -- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 msgr2=0x7ff4ac14cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac14cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 -- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ac154540 msgr2=0x7ff4ac0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ac154540 0x7ff4ac0abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 -- 172.21.15.52:0/2740414316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009370 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac14cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b11b2700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7ff4a000c880 tx=0x7ff4a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0010580 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a00106e0 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac1583e0 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.352+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0010a60 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.353+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac1586c0 con 0x7ff4ac154160 2023-05-10T01:45:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.354+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0666b0 con 0x7ff4ac154160 2023-05-10T01:45:19.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.354+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff4a001b460 con 0x7ff4ac154160 2023-05-10T01:45:19.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.354+0000 7ff4a9ffb700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 0x7ff48c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.354+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6413+0+0 (secure 0 0 0) 0x7ff4a0079e20 con 0x7ff4ac154160 2023-05-10T01:45:19.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.355+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 0x7ff48c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.355+0000 7ff4b19b3700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 0x7ff48c061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff4ac0ca640 tx=0x7ff4a4017000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.358+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4a004b130 con 0x7ff4ac154160 2023-05-10T01:45:19.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.531+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4ac06c340 con 0x7ff4ac154160 2023-05-10T01:45:19.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.532+0000 7ff4a9ffb700 1 -- 172.21.15.52:0/2740414316 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17501 (secure 0 0 0) 0x7ff4a004e750 con 0x7ff4ac154160 2023-05-10T01:45:19.535 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:19.535 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":172,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:19.190887+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 msgr2=0x7ff48c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 0x7ff48c061250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff4ac0ca640 tx=0x7ff4a4017000).stop 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 msgr2=0x7ff4ac13f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7ff4a000c880 tx=0x7ff4a0008040).stop 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 shutdown_connections 2023-05-10T01:45:19.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff48c05ed90 0x7ff48c061250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ac154540 0x7ff4ac0abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4ac069690 0x7ff4ac14cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 --2- 172.21.15.52:0/2740414316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4ac154160 0x7ff4ac13f240 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 >> 172.21.15.52:0/2740414316 conn(0x7ff4ac0cb6f0 msgr2=0x7ff4ac14da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 shutdown_connections 2023-05-10T01:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.535+0000 7ff4b3c17700 1 -- 172.21.15.52:0/2740414316 wait complete. 2023-05-10T01:45:19.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:19.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.664+0000 7f9f78c1b700 1 Processor -- start 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.664+0000 7f9f78c1b700 1 -- start start 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f78c1b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 0x7f9f74154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f78c1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f740ad250 0x7f9f7414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f78c1b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f74158960 con 0x7f9f740c7750 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f78c1b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f74155330 con 0x7f9f740ad250 2023-05-10T01:45:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f78c1b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f74157d50 con 0x7f9f740c7370 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f740ad250 0x7f9f7414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f72ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9f740c7750 0x7f9f740acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51302/0 (socket says 172.21.15.52:51302) 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f72ffd700 1 -- 172.21.15.52:0/942029876 learned_addr learned my addr 172.21.15.52:0/942029876 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f737fe700 1 --2- 172.21.15.52:0/942029876 >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 0x7f9f74154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 -- 172.21.15.52:0/942029876 >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 msgr2=0x7f9f74154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 --2- 172.21.15.52:0/942029876 >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 0x7f9f74154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 -- 172.21.15.52:0/942029876 >> v1:172.21.15.52:6789/0 conn(0x7f9f740c7750 legacy=0x7f9f740acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f727fc700 1 -- 172.21.15.52:0/942029876 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526894185 0 0) 0x7f9f74158960 con 0x7f9f740c7750 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 -- 172.21.15.52:0/942029876 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740ad6b0 con 0x7f9f740ad250 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f737fe700 1 --2- 172.21.15.52:0/942029876 >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 0x7f9f74154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f73fff700 1 --2- 172.21.15.52:0/942029876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f7414dd60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f9f74083b90 tx=0x7f9f6c009780).ready entity=mon.0 client_cookie=3418a80e2d2076c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.665+0000 7f9f727fc700 1 -- 172.21.15.52:0/942029876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00e070 con 0x7f9f740ad250 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f727fc700 1 -- 172.21.15.52:0/942029876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c00bc30 con 0x7f9f740ad250 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f727fc700 1 -- 172.21.15.52:0/942029876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c012410 con 0x7f9f740ad250 2023-05-10T01:45:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 -- 172.21.15.52:0/942029876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 msgr2=0x7f9f7414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/942029876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f7414dd60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f9f74083b90 tx=0x7f9f6c009780).stop 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 -- 172.21.15.52:0/942029876 shutdown_connections 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/942029876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f7414dd60 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/942029876 >> v2:172.21.15.172:3300/0 conn(0x7f9f740c7370 0x7f9f74154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 -- 172.21.15.52:0/942029876 >> 172.21.15.52:0/942029876 conn(0x7f9f74068320 msgr2=0x7f9f74068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 -- 172.21.15.52:0/942029876 shutdown_connections 2023-05-10T01:45:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.666+0000 7f9f78c1b700 1 -- 172.21.15.52:0/942029876 wait complete. 2023-05-10T01:45:19.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.667+0000 7f9f78c1b700 1 Processor -- start 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.667+0000 7f9f78c1b700 1 -- start start 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f740c7370 0x7f9f740c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f740c7750 0x7f9f740c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740c4a40 con 0x7f9f740ad250 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740c34b0 con 0x7f9f740c7750 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f78c1b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740c28a0 con 0x7f9f740c7370 2023-05-10T01:45:19.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42288/0 (socket says 172.21.15.52:42288) 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 -- 172.21.15.52:0/893941559 learned_addr learned my addr 172.21.15.52:0/893941559 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 -- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f740c7370 msgr2=0x7f9f740c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f740c7370 0x7f9f740c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 -- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f740c7750 msgr2=0x7f9f740c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f740c7750 0x7f9f740c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.668+0000 7f9f737fe700 1 -- 172.21.15.52:0/893941559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009a20 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f737fe700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f9f5c00c880 tx=0x7f9f5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c010580 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0106e0 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f740c2b80 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c010a60 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.669+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f740c3140 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.670+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f74047150 con 0x7f9f740ad250 2023-05-10T01:45:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.670+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9f5c01b460 con 0x7f9f740ad250 2023-05-10T01:45:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.670+0000 7f9f6b7fe700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 0x7f9f58061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.670+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f9f5c079e30 con 0x7f9f740ad250 2023-05-10T01:45:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.671+0000 7f9f72ffd700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 0x7f9f58061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.671+0000 7f9f72ffd700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 0x7f9f58061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f740c9ae0 tx=0x7f9f64007a50).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.675+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f5c04b250 con 0x7f9f740ad250 2023-05-10T01:45:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.848+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f740bfb80 con 0x7f9f740ad250 2023-05-10T01:45:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.849+0000 7f9f6b7fe700 1 -- 172.21.15.52:0/893941559 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+17501 (secure 0 0 0) 0x7f9f5c04e870 con 0x7f9f740ad250 2023-05-10T01:45:19.851 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":172,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:19.190887+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 msgr2=0x7f9f58061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 0x7f9f58061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f740c9ae0 tx=0x7f9f64007a50).stop 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 msgr2=0x7f9f74144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f9f5c00c880 tx=0x7f9f5c008040).stop 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 shutdown_connections 2023-05-10T01:45:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f9f5805ed90 0x7f9f58061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f740c7750 0x7f9f740c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f740ad250 0x7f9f74144570 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 --2- 172.21.15.52:0/893941559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9f740c7370 0x7f9f740c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 >> 172.21.15.52:0/893941559 conn(0x7f9f74068320 msgr2=0x7f9f74150600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 shutdown_connections 2023-05-10T01:45:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.851+0000 7f9f78c1b700 1 -- 172.21.15.52:0/893941559 wait complete. 2023-05-10T01:45:19.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T01:45:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.983+0000 7fced4595700 1 Processor -- start 2023-05-10T01:45:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.983+0000 7fced4595700 1 -- start start 2023-05-10T01:45:20.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced4595700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcecc069170 0x7fcecc0a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced4595700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc14e930 con 0x7fcecc0a4a30 2023-05-10T01:45:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced4595700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06a380 con 0x7fcecc1550e0 2023-05-10T01:45:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced4595700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc137420 con 0x7fcecc069170 2023-05-10T01:45:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced2331700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcecc0a4a30 0x7fcecc1549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51310/0 (socket says 172.21.15.52:51310) 2023-05-10T01:45:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced2331700 1 -- 172.21.15.52:0/3118628167 learned_addr learned my addr 172.21.15.52:0/3118628167 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced2b32700 1 --2- 172.21.15.52:0/3118628167 >> v2:172.21.15.172:3300/0 conn(0x7fcecc069170 0x7fcecc0a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463831191 0 0) 0x7fcecc14e930 con 0x7fcecc0a4a30 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb80033f0 con 0x7fcecc0a4a30 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883597994 0 0) 0x7fceb80033f0 con 0x7fcecc0a4a30 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 >> v2:172.21.15.172:3300/0 conn(0x7fcecc069170 msgr2=0x7fcecc0a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 --2- 172.21.15.52:0/3118628167 >> v2:172.21.15.172:3300/0 conn(0x7fcecc069170 0x7fcecc0a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 >> v1:172.21.15.172:6789/0 conn(0x7fcecc1550e0 legacy=0x7fcecc068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc069770 con 0x7fcecc0a4a30 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fcec40017f0 con 0x7fcecc0a4a30 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 >> v1:172.21.15.52:6789/0 conn(0x7fcecc0a4a30 legacy=0x7fcecc1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb80038e0 0x7fceb8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 0x7fceb8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb8005000 0x7fceb800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc137420 con 0x7fceb8004690 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800be00 con 0x7fceb80038e0 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800bfc0 con 0x7fceb8005000 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced1b30700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 0x7fceb8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.984+0000 7fced2331700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb80038e0 0x7fceb8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced2b32700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb8005000 0x7fceb800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 -- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb8005000 msgr2=0x7fceb800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fceb8005000 0x7fceb800b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 -- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb80038e0 msgr2=0x7fceb8003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb80038e0 0x7fceb8003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 -- 172.21.15.52:0/3118628167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80033f0 con 0x7fceb8004690 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced2b32700 1 -- 172.21.15.52:0/3118628167 reap_dead start 2023-05-10T01:45:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced1b30700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 0x7fceb8004b10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fcec0001820 tx=0x7fcec0007b90).ready entity=mon.0 client_cookie=89d435e96ef06aeb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0007ea0 con 0x7fceb8004690 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0012400 con 0x7fceb8004690 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced132f700 1 -- 172.21.15.52:0/3118628167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00127a0 con 0x7fceb8004690 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced4595700 1 -- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 msgr2=0x7fceb8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced4595700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 0x7fceb8004b10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fcec0001820 tx=0x7fcec0007b90).stop 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced4595700 1 -- 172.21.15.52:0/3118628167 shutdown_connections 2023-05-10T01:45:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced4595700 1 --2- 172.21.15.52:0/3118628167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb8004690 0x7fceb8004b10 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.985+0000 7fced4595700 1 -- 172.21.15.52:0/3118628167 >> 172.21.15.52:0/3118628167 conn(0x7fcecc0c4610 msgr2=0x7fcecc066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.986+0000 7fced4595700 1 -- 172.21.15.52:0/3118628167 shutdown_connections 2023-05-10T01:45:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.986+0000 7fced4595700 1 -- 172.21.15.52:0/3118628167 wait complete. 2023-05-10T01:45:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 Processor -- start 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 -- start start 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 0x7fcecc136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcecc0a7e80 0x7fcecc0a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc137b60 con 0x7fcecc159e00 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15a770 con 0x7fceb8004690 2023-05-10T01:45:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced4595700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0a8940 con 0x7fcecc0a7e80 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced2b32700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced2b32700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42310/0 (socket says 172.21.15.52:42310) 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.987+0000 7fced2b32700 1 -- 172.21.15.52:0/1429633387 learned_addr learned my addr 172.21.15.52:0/1429633387 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced1b30700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcecc0a7e80 0x7fcecc0a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2331700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 0x7fcecc136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 -- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcecc0a7e80 msgr2=0x7fcecc0a8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:20.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcecc0a7e80 0x7fcecc0a8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 -- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 msgr2=0x7fcecc136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 0x7fcecc136ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 -- 172.21.15.52:0/1429633387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0a8c20 con 0x7fcecc159e00 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2331700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 0x7fcecc136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced2b32700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fcecc0c7040 tx=0x7fcebc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc009410 con 0x7fcecc159e00 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc0125b0 con 0x7fcecc159e00 2023-05-10T01:45:20.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0a8f00 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc012970 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.988+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc0c35f0 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.989+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc137950 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.989+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcebc012040 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.990+0000 7fceca7fc700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 0x7fceac061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.990+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fcebc079c00 con 0x7fcecc159e00 2023-05-10T01:45:20.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.990+0000 7fced2331700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 0x7fceac061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:20.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.990+0000 7fced2331700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 0x7fceac061280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcec4001920 tx=0x7fcec4009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:20.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:19.994+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcebc04b080 con 0x7fcecc159e00 2023-05-10T01:45:20.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:20.214+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcecc06c340 con 0x7fcecc159e00 2023-05-10T01:45:21.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.203+0000 7fceca7fc700 1 -- 172.21.15.52:0/1429633387 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcebc000e60 con 0x7fcecc159e00 2023-05-10T01:45:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 msgr2=0x7fceac061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 0x7fceac061280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcec4001920 tx=0x7fcec4009040).stop 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 msgr2=0x7fcecc15a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7fcecc0c7040 tx=0x7fcebc008040).stop 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 shutdown_connections 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fceac05edc0 0x7fceac061280 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcecc159e00 0x7fcecc15a280 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fceb8004690 0x7fcecc136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 --2- 172.21.15.52:0/1429633387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcecc0a7e80 0x7fcecc0a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 >> 172.21.15.52:0/1429633387 conn(0x7fcecc0c4610 msgr2=0x7fcecc0c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:21.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 shutdown_connections 2023-05-10T01:45:21.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.206+0000 7fced4595700 1 -- 172.21.15.52:0/1429633387 wait complete. 2023-05-10T01:45:21.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T01:45:21.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.346+0000 7f3c96f46700 1 Processor -- start 2023-05-10T01:45:21.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.346+0000 7f3c96f46700 1 -- start start 2023-05-10T01:45:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c96f46700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 0x7f3c900aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c96f46700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c90068150 0x7f3c900685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c96f46700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900c94c0 con 0x7f3c90154080 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c96f46700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c900cb7d0 con 0x7f3c90068150 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c96f46700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c90068a90 con 0x7f3c90154460 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c90068150 0x7f3c900685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c90068150 0x7f3c900685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42316/0 (socket says 172.21.15.52:42316) 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 -- 172.21.15.52:0/2892693825 learned_addr learned my addr 172.21.15.52:0/2892693825 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:21.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2892693825 >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 0x7f3c900aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 -- 172.21.15.52:0/2892693825 >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 msgr2=0x7f3c900aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 --2- 172.21.15.52:0/2892693825 >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 0x7f3c900aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 -- 172.21.15.52:0/2892693825 >> v1:172.21.15.172:6789/0 conn(0x7f3c90154080 legacy=0x7f3c900a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c954e3700 1 -- 172.21.15.52:0/2892693825 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c900c88b0 con 0x7f3c90068150 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.347+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2892693825 >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 0x7f3c900aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c954e3700 1 --2- 172.21.15.52:0/2892693825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c900685a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f3c90084310 tx=0x7f3c780090f0).ready entity=mon.0 client_cookie=24467bd98dc0c1e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c8f7fe700 1 -- 172.21.15.52:0/2892693825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800b600 con 0x7f3c90068150 2023-05-10T01:45:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c8f7fe700 1 -- 172.21.15.52:0/2892693825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b760 con 0x7f3c90068150 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c8f7fe700 1 -- 172.21.15.52:0/2892693825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800bae0 con 0x7f3c90068150 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 -- 172.21.15.52:0/2892693825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 msgr2=0x7f3c900685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2892693825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c900685a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f3c90084310 tx=0x7f3c780090f0).stop 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 -- 172.21.15.52:0/2892693825 shutdown_connections 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2892693825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c900685a0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2892693825 >> v2:172.21.15.172:3300/0 conn(0x7f3c90154460 0x7f3c900aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 -- 172.21.15.52:0/2892693825 >> 172.21.15.52:0/2892693825 conn(0x7f3c90067910 msgr2=0x7f3c900cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 -- 172.21.15.52:0/2892693825 shutdown_connections 2023-05-10T01:45:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.348+0000 7f3c96f46700 1 -- 172.21.15.52:0/2892693825 wait complete. 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.349+0000 7f3c96f46700 1 Processor -- start 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 -- start start 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 0x7f3c900b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 0x7f3c90157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90157540 con 0x7f3c90068150 2023-05-10T01:45:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90164d90 con 0x7f3c90154080 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c96f46700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90155660 con 0x7f3c90154460 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c94ce2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c94ce2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42320/0 (socket says 172.21.15.52:42320) 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.350+0000 7f3c94ce2700 1 -- 172.21.15.52:0/2351752772 learned_addr learned my addr 172.21.15.52:0/2351752772 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 0x7f3c900b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 -- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 msgr2=0x7f3c90157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c954e3700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 0x7f3c90157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 0x7f3c90157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 -- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 msgr2=0x7f3c900b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 0x7f3c900b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 -- 172.21.15.52:0/2351752772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009370 con 0x7f3c90068150 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 0x7f3c900b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c954e3700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 0x7f3c90157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c94ce2700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f3c8800c4c0 tx=0x7f3c88007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88007020 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88001e90 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c90155940 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c880073b0 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.351+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c90155f00 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.352+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c90066720 con 0x7f3c90068150 2023-05-10T01:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.352+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3c88010070 con 0x7f3c90068150 2023-05-10T01:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.353+0000 7f3c8cff9700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 0x7f3c74061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.353+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f3c88079cc0 con 0x7f3c90068150 2023-05-10T01:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.353+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 0x7f3c74061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.353+0000 7f3c8ffff700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 0x7f3c74061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3c800094d0 tx=0x7f3c8000b040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.357+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c8804a930 con 0x7f3c90068150 2023-05-10T01:45:21.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:21.574+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c900c8b90 con 0x7f3c90068150 2023-05-10T01:45:22.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.211+0000 7f3c8cff9700 1 -- 172.21.15.52:0/2351752772 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c8804df50 con 0x7f3c90068150 2023-05-10T01:45:22.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 msgr2=0x7f3c74061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 0x7f3c74061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3c800094d0 tx=0x7f3c8000b040).stop 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 msgr2=0x7f3c901648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f3c8800c4c0 tx=0x7f3c88007e00).stop 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 shutdown_connections 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3c7405ed90 0x7f3c74061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c90154460 0x7f3c90157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c90068150 0x7f3c901648a0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 --2- 172.21.15.52:0/2351752772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90154080 0x7f3c900b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 >> 172.21.15.52:0/2351752772 conn(0x7f3c90067910 msgr2=0x7f3c900c1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 shutdown_connections 2023-05-10T01:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.213+0000 7f3c96f46700 1 -- 172.21.15.52:0/2351752772 wait complete. 2023-05-10T01:45:22.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.346+0000 7f333b1bb700 1 Processor -- start 2023-05-10T01:45:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.346+0000 7f333b1bb700 1 -- start start 2023-05-10T01:45:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f333b1bb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3334154320 0x7f33340c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f333b1bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334069580 0x7f3334069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f333b1bb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33340bfb40 con 0x7f3334153f40 2023-05-10T01:45:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f333b1bb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340c0100 con 0x7f3334154320 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f333b1bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3334069ef0 con 0x7f3334069580 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3334154320 0x7f33340c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3338f57700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3334153f40 0x7f333406a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51344/0 (socket says 172.21.15.52:51344) 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3338f57700 1 -- 172.21.15.52:0/1631039561 learned_addr learned my addr 172.21.15.52:0/1631039561 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 -- 172.21.15.52:0/1631039561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334069580 msgr2=0x7f3334069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 --2- 172.21.15.52:0/1631039561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334069580 0x7f3334069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 -- 172.21.15.52:0/1631039561 >> v1:172.21.15.52:6789/0 conn(0x7f3334153f40 legacy=0x7f333406a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f33337fe700 1 -- 172.21.15.52:0/1631039561 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966752499 0 0) 0x7f33340bfb40 con 0x7f3334153f40 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 -- 172.21.15.52:0/1631039561 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340c6100 con 0x7f3334154320 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f3333fff700 1 --2- 172.21.15.52:0/1631039561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334154320 0x7f33340c5b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f3324009e60 tx=0x7f3324009780).ready entity=mon.0 client_cookie=ff559f8f1f6a6607 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f33337fe700 1 -- 172.21.15.52:0/1631039561 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400e070 con 0x7f3334154320 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f33337fe700 1 -- 172.21.15.52:0/1631039561 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400bc30 con 0x7f3334154320 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.347+0000 7f33337fe700 1 -- 172.21.15.52:0/1631039561 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324012410 con 0x7f3334154320 2023-05-10T01:45:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 -- 172.21.15.52:0/1631039561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334154320 msgr2=0x7f33340c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1631039561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334154320 0x7f33340c5b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f3324009e60 tx=0x7f3324009780).stop 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 -- 172.21.15.52:0/1631039561 shutdown_connections 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1631039561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334069580 0x7f3334069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1631039561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334154320 0x7f33340c5b20 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 -- 172.21.15.52:0/1631039561 >> 172.21.15.52:0/1631039561 conn(0x7f33340cb6b0 msgr2=0x7f33340c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 -- 172.21.15.52:0/1631039561 shutdown_connections 2023-05-10T01:45:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.348+0000 7f333b1bb700 1 -- 172.21.15.52:0/1631039561 wait complete. 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.349+0000 7f333b1bb700 1 Processor -- start 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.349+0000 7f333b1bb700 1 -- start start 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 0x7f3334165650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334154320 0x7f3334164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340adb90 con 0x7f3334153f40 2023-05-10T01:45:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340ae430 con 0x7f3334069580 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f333b1bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3334165430 con 0x7f3334154320 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42334/0 (socket says 172.21.15.52:42334) 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 -- 172.21.15.52:0/1434885700 learned_addr learned my addr 172.21.15.52:0/1434885700 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3338f57700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 0x7f3334165650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3339758700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334154320 0x7f3334164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 -- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334154320 msgr2=0x7f3334164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334154320 0x7f3334164f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 -- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 msgr2=0x7f3334165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 0x7f3334165650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3333fff700 1 -- 172.21.15.52:0/1434885700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009a20 con 0x7f3334153f40 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.350+0000 7f3338f57700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 0x7f3334165650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f3333fff700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f3324012490 tx=0x7f3324009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332401c660 con 0x7f3334153f40 2023-05-10T01:45:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332401c7c0 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3334156630 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332401cb80 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.351+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33340ae0c0 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.352+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33340ae5c0 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.352+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f332401d420 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.352+0000 7f3330ff9700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 0x7f3318061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.352+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f332407bef0 con 0x7f3334153f40 2023-05-10T01:45:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.353+0000 7f3338f57700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 0x7f3318061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.353+0000 7f3338f57700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 0x7f3318061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f331c0011e0 tx=0x7f331c009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.357+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f332404d310 con 0x7f3334153f40 2023-05-10T01:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.570+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f333406c340 con 0x7f3334153f40 2023-05-10T01:45:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.570+0000 7f3330ff9700 1 -- 172.21.15.52:0/1434885700 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f3324050930 con 0x7f3334153f40 2023-05-10T01:45:22.573 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:22.573 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:22.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 msgr2=0x7f3318061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 0x7f3318061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f331c0011e0 tx=0x7f331c009040).stop 2023-05-10T01:45:22.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 msgr2=0x7f3334155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f3324012490 tx=0x7f3324009780).stop 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 shutdown_connections 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f331805ed90 0x7f3318061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3334154320 0x7f3334164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3334069580 0x7f3334165650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 --2- 172.21.15.52:0/1434885700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3334153f40 0x7f3334155fc0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 >> 172.21.15.52:0/1434885700 conn(0x7f33340cb6b0 msgr2=0x7f33340aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 shutdown_connections 2023-05-10T01:45:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.572+0000 7f333b1bb700 1 -- 172.21.15.52:0/1434885700 wait complete. 2023-05-10T01:45:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:22.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:22.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.701+0000 7f90cec72700 1 Processor -- start 2023-05-10T01:45:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.701+0000 7f90cec72700 1 -- start start 2023-05-10T01:45:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cec72700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f90c8150da0 0x7f90c8064270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cec72700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f90c81506a0 0x7f90c80c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cec72700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c8065440 con 0x7f90c8151180 2023-05-10T01:45:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cec72700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80bd370 con 0x7f90c8150da0 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cec72700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80c1360 con 0x7f90c81506a0 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cca0e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f90c8150da0 0x7f90c8064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90c7fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f90c8151180 0x7f90c814ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51360/0 (socket says 172.21.15.52:51360) 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90c7fff700 1 -- 172.21.15.52:0/3762547760 learned_addr learned my addr 172.21.15.52:0/3762547760 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.702+0000 7f90cd20f700 1 --2- 172.21.15.52:0/3762547760 >> v2:172.21.15.172:3300/0 conn(0x7f90c81506a0 0x7f90c80c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cca0e700 1 -- 172.21.15.52:0/3762547760 >> v2:172.21.15.172:3300/0 conn(0x7f90c81506a0 msgr2=0x7f90c80c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cca0e700 1 --2- 172.21.15.52:0/3762547760 >> v2:172.21.15.172:3300/0 conn(0x7f90c81506a0 0x7f90c80c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cca0e700 1 -- 172.21.15.52:0/3762547760 >> v1:172.21.15.52:6789/0 conn(0x7f90c8151180 legacy=0x7f90c814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90c77fe700 1 -- 172.21.15.52:0/3762547760 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998442445 0 0) 0x7f90c8065440 con 0x7f90c8151180 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cca0e700 1 -- 172.21.15.52:0/3762547760 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c81519d0 con 0x7f90c8150da0 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cca0e700 1 --2- 172.21.15.52:0/3762547760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8150da0 0x7f90c8064270 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f90c8064060 tx=0x7f90c0009780).ready entity=mon.0 client_cookie=6bc05e4915dc52df server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90c77fe700 1 -- 172.21.15.52:0/3762547760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c000e070 con 0x7f90c8150da0 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90c77fe700 1 -- 172.21.15.52:0/3762547760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000bb60 con 0x7f90c8150da0 2023-05-10T01:45:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90c77fe700 1 -- 172.21.15.52:0/3762547760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0012410 con 0x7f90c8150da0 2023-05-10T01:45:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cec72700 1 -- 172.21.15.52:0/3762547760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8150da0 msgr2=0x7f90c8064270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.703+0000 7f90cec72700 1 --2- 172.21.15.52:0/3762547760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8150da0 0x7f90c8064270 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f90c8064060 tx=0x7f90c0009780).stop 2023-05-10T01:45:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 -- 172.21.15.52:0/3762547760 shutdown_connections 2023-05-10T01:45:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 --2- 172.21.15.52:0/3762547760 >> v2:172.21.15.172:3300/0 conn(0x7f90c81506a0 0x7f90c80c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 --2- 172.21.15.52:0/3762547760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8150da0 0x7f90c8064270 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 -- 172.21.15.52:0/3762547760 >> 172.21.15.52:0/3762547760 conn(0x7f90c80c7340 msgr2=0x7f90c80c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 -- 172.21.15.52:0/3762547760 shutdown_connections 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.704+0000 7f90cec72700 1 -- 172.21.15.52:0/3762547760 wait complete. 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.705+0000 7f90cec72700 1 Processor -- start 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.705+0000 7f90cec72700 1 -- start start 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90c81506a0 0x7f90c80a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90c8150da0 0x7f90c80ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80a93c0 con 0x7f90c8151180 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80bde50 con 0x7f90c81506a0 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80be130 con 0x7f90c8150da0 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42352/0 (socket says 172.21.15.52:42352) 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 -- 172.21.15.52:0/3106505318 learned_addr learned my addr 172.21.15.52:0/3106505318 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cca0e700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90c81506a0 0x7f90c80a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 -- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90c8150da0 msgr2=0x7f90c80ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90c8150da0 0x7f90c80ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 -- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90c81506a0 msgr2=0x7f90c80a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90c81506a0 0x7f90c80a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 -- 172.21.15.52:0/3106505318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009a20 con 0x7f90c8151180 2023-05-10T01:45:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cd20f700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f90b000e8d0 tx=0x7f90b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000ee70 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0009530 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80be410 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000ca60 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.706+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80be9d0 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.707+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c806c340 con 0x7f90c8151180 2023-05-10T01:45:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.708+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f90b0022070 con 0x7f90c8151180 2023-05-10T01:45:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.708+0000 7f90c4ff9700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 0x7f90ac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.708+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f90b0079f80 con 0x7f90c8151180 2023-05-10T01:45:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.708+0000 7f90cca0e700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 0x7f90ac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:22.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.709+0000 7f90cca0e700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 0x7f90ac061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f90c8064060 tx=0x7f90c0009780).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:22.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.712+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90b004b400 con 0x7f90c8151180 2023-05-10T01:45:22.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.885+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90c8068770 con 0x7f90c8151180 2023-05-10T01:45:22.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.886+0000 7f90c4ff9700 1 -- 172.21.15.52:0/3106505318 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17488 (secure 0 0 0) 0x7f90b004ea20 con 0x7f90c8151180 2023-05-10T01:45:22.889 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:22.889 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":173,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:20.192967+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:22.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 msgr2=0x7f90ac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 0x7f90ac061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f90c8064060 tx=0x7f90c0009780).stop 2023-05-10T01:45:22.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 msgr2=0x7f90c80abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:22.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f90b000e8d0 tx=0x7f90b0009060).stop 2023-05-10T01:45:22.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 shutdown_connections 2023-05-10T01:45:22.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f90ac05ed90 0x7f90ac061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c8151180 0x7f90c80abae0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90c81506a0 0x7f90c80a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:22.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 --2- 172.21.15.52:0/3106505318 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90c8150da0 0x7f90c80ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:22.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 >> 172.21.15.52:0/3106505318 conn(0x7f90c80c7340 msgr2=0x7f90c8068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:22.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 shutdown_connections 2023-05-10T01:45:22.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:22.888+0000 7f90cec72700 1 -- 172.21.15.52:0/3106505318 wait complete. 2023-05-10T01:45:22.903 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T01:45:22.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:23.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.018+0000 7f3eb6614700 1 Processor -- start 2023-05-10T01:45:23.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.018+0000 7f3eb6614700 1 -- start start 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb6614700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb6614700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eb0069da0 0x7f3eb00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb6614700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00c0650 con 0x7f3eb0154540 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb6614700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb00c1af0 con 0x7f3eb0069da0 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb6614700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00bfd20 con 0x7f3eb0154160 2023-05-10T01:45:23.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb4bb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eb0069da0 0x7f3eb00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb4bb1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eb0069da0 0x7f3eb00c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42358/0 (socket says 172.21.15.52:42358) 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.019+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3068088464 learned_addr learned my addr 172.21.15.52:0/3068088464 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eaffff700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3068088464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 msgr2=0x7f3eb00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb4bb1700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3068088464 >> v1:172.21.15.172:6789/0 conn(0x7f3eb0154540 legacy=0x7f3eb0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3068088464 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00c0000 con 0x7f3eb0069da0 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eaffff700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb4bb1700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0069da0 0x7f3eb00c6150 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3ea8009f20 tx=0x7f3ea8009840).ready entity=mon.0 client_cookie=bcffb2d9fa721012 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eaeffd700 1 -- 172.21.15.52:0/3068088464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800e070 con 0x7f3eb0069da0 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eaeffd700 1 -- 172.21.15.52:0/3068088464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea800ba40 con 0x7f3eb0069da0 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eaeffd700 1 -- 172.21.15.52:0/3068088464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800bdc0 con 0x7f3eb0069da0 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 -- 172.21.15.52:0/3068088464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0069da0 msgr2=0x7f3eb00c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0069da0 0x7f3eb00c6150 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3ea8009f20 tx=0x7f3ea8009840).stop 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 -- 172.21.15.52:0/3068088464 shutdown_connections 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3068088464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0069da0 0x7f3eb00c6150 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 -- 172.21.15.52:0/3068088464 >> 172.21.15.52:0/3068088464 conn(0x7f3eb00cb6f0 msgr2=0x7f3eb00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.020+0000 7f3eb6614700 1 -- 172.21.15.52:0/3068088464 shutdown_connections 2023-05-10T01:45:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.021+0000 7f3eb6614700 1 -- 172.21.15.52:0/3068088464 wait complete. 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 Processor -- start 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 -- start start 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eb0069da0 0x7f3eb014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb0154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01564b0 con 0x7f3eb0154540 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0155330 con 0x7f3eb0069da0 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.022+0000 7f3eb6614700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0155610 con 0x7f3eb0154160 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42366/0 (socket says 172.21.15.52:42366) 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3227933969 learned_addr learned my addr 172.21.15.52:0/3227933969 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:23.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eaffff700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eb0069da0 0x7f3eb014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 msgr2=0x7f3eb0154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eaf7fe700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb0154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eb0069da0 msgr2=0x7f3eb014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eb0069da0 0x7f3eb014a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 -- 172.21.15.52:0/3227933969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8009ae0 con 0x7f3eb0154540 2023-05-10T01:45:23.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb4bb1700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f3ea8010000 tx=0x7f3ea8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80092e0 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea801e470 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb01558f0 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea801e7f0 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.023+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00c4d00 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.024+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb00666b0 con 0x7f3eb0154540 2023-05-10T01:45:23.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.025+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ea8025030 con 0x7f3eb0154540 2023-05-10T01:45:23.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.025+0000 7f3e97fff700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 0x7f3e90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.025+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f3ea807b4b0 con 0x7f3eb0154540 2023-05-10T01:45:23.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.025+0000 7f3eaffff700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 0x7f3e90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.026+0000 7f3eaffff700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 0x7f3e90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3ea00088c0 tx=0x7f3ea0008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.029+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ea804c9e0 con 0x7f3eb0154540 2023-05-10T01:45:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.195+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3eb006c340 con 0x7f3e9005ed90 2023-05-10T01:45:23.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.206+0000 7f3e97fff700 1 -- 172.21.15.52:0/3227933969 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358733 (secure 0 0 0) 0x7f3eb006c340 con 0x7f3e9005ed90 2023-05-10T01:45:23.212 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:23.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 msgr2=0x7f3e90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 0x7f3e90061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3ea00088c0 tx=0x7f3ea0008040).stop 2023-05-10T01:45:23.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 msgr2=0x7f3eb00c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f3ea8010000 tx=0x7f3ea8009840).stop 2023-05-10T01:45:23.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 shutdown_connections 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e9005ed90 0x7f3e90061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eb0154540 0x7f3eb00c9480 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eb0069da0 0x7f3eb014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 --2- 172.21.15.52:0/3227933969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eb0154160 0x7f3eb0154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 >> 172.21.15.52:0/3227933969 conn(0x7f3eb00cb6f0 msgr2=0x7f3eb014d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 shutdown_connections 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.210+0000 7f3eb6614700 1 -- 172.21.15.52:0/3227933969 wait complete. 2023-05-10T01:45:23.215 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:23.224 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:45:21.949302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":192472,"kb_used_data":16600,"kb_used_omap":0,"kb_used_meta":175808,"kb_avail":754782248,"statfs":{"total":773094113280,"available":772897021952,"internally_reserved":0,"allocated":16998400,"data_stored":8789894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180027392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27877,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.224551"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813640+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818402+0000","last_change":"2023-05-10T01:45:18.818402+0000","last_active":"2023-05-10T01:45:18.818402+0000","last_peered":"2023-05-10T01:45:18.818402+0000","last_clean":"2023-05-10T01:45:18.818402+0000","last_became_active":"2023-05-10T01:45:18.818138+0000","last_became_peered":"2023-05-10T01:45:18.818138+0000","last_unstale":"2023-05-10T01:45:18.818402+0000","last_undegraded":"2023-05-10T01:45:18.818402+0000","last_fullsized":"2023-05-10T01:45:18.818402+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810742+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814168+0000","last_change":"2023-05-10T01:45:18.814168+0000","last_active":"2023-05-10T01:45:18.814168+0000","last_peered":"2023-05-10T01:45:18.814168+0000","last_clean":"2023-05-10T01:45:18.814168+0000","last_became_active":"2023-05-10T01:45:18.813893+0000","last_became_peered":"2023-05-10T01:45:18.813893+0000","last_unstale":"2023-05-10T01:45:18.814168+0000","last_undegraded":"2023-05-10T01:45:18.814168+0000","last_fullsized":"2023-05-10T01:45:18.814168+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810084+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821662+0000","last_change":"2023-05-10T01:45:18.821662+0000","last_active":"2023-05-10T01:45:18.821662+0000","last_peered":"2023-05-10T01:45:18.821662+0000","last_clean":"2023-05-10T01:45:18.821662+0000","last_became_active":"2023-05-10T01:45:18.821367+0000","last_became_peered":"2023-05-10T01:45:18.821367+0000","last_unstale":"2023-05-10T01:45:18.821662+0000","last_undegraded":"2023-05-10T01:45:18.821662+0000","last_fullsized":"2023-05-10T01:45:18.821662+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814319+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830114+0000","last_change":"2023-05-10T01:45:18.830114+0000","last_active":"2023-05-10T01:45:18.830114+0000","last_peered":"2023-05-10T01:45:18.830114+0000","last_clean":"2023-05-10T01:45:18.830114+0000","last_became_active":"2023-05-10T01:45:18.829808+0000","last_became_peered":"2023-05-10T01:45:18.829808+0000","last_unstale":"2023-05-10T01:45:18.830114+0000","last_undegraded":"2023-05-10T01:45:18.830114+0000","last_fullsized":"2023-05-10T01:45:18.830114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807219+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820192+0000","last_change":"2023-05-10T01:45:18.820192+0000","last_active":"2023-05-10T01:45:18.820192+0000","last_peered":"2023-05-10T01:45:18.820192+0000","last_clean":"2023-05-10T01:45:18.820192+0000","last_became_active":"2023-05-10T01:45:18.819911+0000","last_became_peered":"2023-05-10T01:45:18.819911+0000","last_unstale":"2023-05-10T01:45:18.820192+0000","last_undegraded":"2023-05-10T01:45:18.820192+0000","last_fullsized":"2023-05-10T01:45:18.820192+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814732+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827571+0000","last_change":"2023-05-10T01:45:18.827571+0000","last_active":"2023-05-10T01:45:18.827571+0000","last_peered":"2023-05-10T01:45:18.827571+0000","last_clean":"2023-05-10T01:45:18.827571+0000","last_became_active":"2023-05-10T01:45:18.827216+0000","last_became_peered":"2023-05-10T01:45:18.827216+0000","last_unstale":"2023-05-10T01:45:18.827571+0000","last_undegraded":"2023-05-10T01:45:18.827571+0000","last_fullsized":"2023-05-10T01:45:18.827571+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807614+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823558+0000","last_change":"2023-05-10T01:45:18.823558+0000","last_active":"2023-05-10T01:45:18.823558+0000","last_peered":"2023-05-10T01:45:18.823558+0000","last_clean":"2023-05-10T01:45:18.823558+0000","last_became_active":"2023-05-10T01:45:18.823058+0000","last_became_peered":"2023-05-10T01:45:18.823058+0000","last_unstale":"2023-05-10T01:45:18.823558+0000","last_undegraded":"2023-05-10T01:45:18.823558+0000","last_fullsized":"2023-05-10T01:45:18.823558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811615+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817323+0000","last_change":"2023-05-10T01:45:18.817323+0000","last_active":"2023-05-10T01:45:18.817323+0000","last_peered":"2023-05-10T01:45:18.817323+0000","last_clean":"2023-05-10T01:45:18.817323+0000","last_became_active":"2023-05-10T01:45:18.817030+0000","last_became_peered":"2023-05-10T01:45:18.817030+0000","last_unstale":"2023-05-10T01:45:18.817323+0000","last_undegraded":"2023-05-10T01:45:18.817323+0000","last_fullsized":"2023-05-10T01:45:18.817323+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.816664+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819801+0000","last_change":"2023-05-10T01:45:18.819801+0000","last_active":"2023-05-10T01:45:18.819801+0000","last_peered":"2023-05-10T01:45:18.819801+0000","last_clean":"2023-05-10T01:45:18.819801+0000","last_became_active":"2023-05-10T01:45:18.819525+0000","last_became_peered":"2023-05-10T01:45:18.819525+0000","last_unstale":"2023-05-10T01:45:18.819801+0000","last_undegraded":"2023-05-10T01:45:18.819801+0000","last_fullsized":"2023-05-10T01:45:18.819801+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811410+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826355+0000","last_change":"2023-05-10T01:45:18.826355+0000","last_active":"2023-05-10T01:45:18.826355+0000","last_peered":"2023-05-10T01:45:18.826355+0000","last_clean":"2023-05-10T01:45:18.826355+0000","last_became_active":"2023-05-10T01:45:18.825988+0000","last_became_peered":"2023-05-10T01:45:18.825988+0000","last_unstale":"2023-05-10T01:45:18.826355+0000","last_undegraded":"2023-05-10T01:45:18.826355+0000","last_fullsized":"2023-05-10T01:45:18.826355+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807606+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823529+0000","last_change":"2023-05-10T01:45:18.823529+0000","last_active":"2023-05-10T01:45:18.823529+0000","last_peered":"2023-05-10T01:45:18.823529+0000","last_clean":"2023-05-10T01:45:18.823529+0000","last_became_active":"2023-05-10T01:45:18.823231+0000","last_became_peered":"2023-05-10T01:45:18.823231+0000","last_unstale":"2023-05-10T01:45:18.823529+0000","last_undegraded":"2023-05-10T01:45:18.823529+0000","last_fullsized":"2023-05-10T01:45:18.823529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808049+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824587+0000","last_change":"2023-05-10T01:45:18.824587+0000","last_active":"2023-05-10T01:45:18.824587+0000","last_peered":"2023-05-10T01:45:18.824587+0000","last_clean":"2023-05-10T01:45:18.824587+0000","last_became_active":"2023-05-10T01:45:18.824256+0000","last_became_peered":"2023-05-10T01:45:18.824256+0000","last_unstale":"2023-05-10T01:45:18.824587+0000","last_undegraded":"2023-05-10T01:45:18.824587+0000","last_fullsized":"2023-05-10T01:45:18.824587+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808274+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818724+0000","last_change":"2023-05-10T01:45:18.818724+0000","last_active":"2023-05-10T01:45:18.818724+0000","last_peered":"2023-05-10T01:45:18.818724+0000","last_clean":"2023-05-10T01:45:18.818724+0000","last_became_active":"2023-05-10T01:45:18.818428+0000","last_became_peered":"2023-05-10T01:45:18.818428+0000","last_unstale":"2023-05-10T01:45:18.818724+0000","last_undegraded":"2023-05-10T01:45:18.818724+0000","last_fullsized":"2023-05-10T01:45:18.818724+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812172+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817675+0000","last_change":"2023-05-10T01:45:18.817675+0000","last_active":"2023-05-10T01:45:18.817675+0000","last_peered":"2023-05-10T01:45:18.817675+0000","last_clean":"2023-05-10T01:45:18.817675+0000","last_became_active":"2023-05-10T01:45:18.817193+0000","last_became_peered":"2023-05-10T01:45:18.817193+0000","last_unstale":"2023-05-10T01:45:18.817675+0000","last_undegraded":"2023-05-10T01:45:18.817675+0000","last_fullsized":"2023-05-10T01:45:18.817675+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814714+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821898+0000","last_change":"2023-05-10T01:45:18.821898+0000","last_active":"2023-05-10T01:45:18.821898+0000","last_peered":"2023-05-10T01:45:18.821898+0000","last_clean":"2023-05-10T01:45:18.821898+0000","last_became_active":"2023-05-10T01:45:18.821629+0000","last_became_peered":"2023-05-10T01:45:18.821629+0000","last_unstale":"2023-05-10T01:45:18.821898+0000","last_undegraded":"2023-05-10T01:45:18.821898+0000","last_fullsized":"2023-05-10T01:45:18.821898+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821558+0000","last_change":"2023-05-10T01:45:18.821558+0000","last_active":"2023-05-10T01:45:18.821558+0000","last_peered":"2023-05-10T01:45:18.821558+0000","last_clean":"2023-05-10T01:45:18.821558+0000","last_became_active":"2023-05-10T01:45:18.821237+0000","last_became_peered":"2023-05-10T01:45:18.821237+0000","last_unstale":"2023-05-10T01:45:18.821558+0000","last_undegraded":"2023-05-10T01:45:18.821558+0000","last_fullsized":"2023-05-10T01:45:18.821558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806738+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820366+0000","last_change":"2023-05-10T01:45:18.820366+0000","last_active":"2023-05-10T01:45:18.820366+0000","last_peered":"2023-05-10T01:45:18.820366+0000","last_clean":"2023-05-10T01:45:18.820366+0000","last_became_active":"2023-05-10T01:45:18.819939+0000","last_became_peered":"2023-05-10T01:45:18.819939+0000","last_unstale":"2023-05-10T01:45:18.820366+0000","last_undegraded":"2023-05-10T01:45:18.820366+0000","last_fullsized":"2023-05-10T01:45:18.820366+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807942+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820855+0000","last_became_peered":"2023-05-10T01:45:18.820855+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809881+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821215+0000","last_change":"2023-05-10T01:45:18.821215+0000","last_active":"2023-05-10T01:45:18.821215+0000","last_peered":"2023-05-10T01:45:18.821215+0000","last_clean":"2023-05-10T01:45:18.821215+0000","last_became_active":"2023-05-10T01:45:18.820901+0000","last_became_peered":"2023-05-10T01:45:18.820901+0000","last_unstale":"2023-05-10T01:45:18.821215+0000","last_undegraded":"2023-05-10T01:45:18.821215+0000","last_fullsized":"2023-05-10T01:45:18.821215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813156+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819565+0000","last_change":"2023-05-10T01:45:18.819565+0000","last_active":"2023-05-10T01:45:18.819565+0000","last_peered":"2023-05-10T01:45:18.819565+0000","last_clean":"2023-05-10T01:45:18.819565+0000","last_became_active":"2023-05-10T01:45:18.819253+0000","last_became_peered":"2023-05-10T01:45:18.819253+0000","last_unstale":"2023-05-10T01:45:18.819565+0000","last_undegraded":"2023-05-10T01:45:18.819565+0000","last_fullsized":"2023-05-10T01:45:18.819565+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812836+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820818+0000","last_became_peered":"2023-05-10T01:45:18.820818+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805101+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817483+0000","last_change":"2023-05-10T01:45:18.817483+0000","last_active":"2023-05-10T01:45:18.817483+0000","last_peered":"2023-05-10T01:45:18.817483+0000","last_clean":"2023-05-10T01:45:18.817483+0000","last_became_active":"2023-05-10T01:45:18.816820+0000","last_became_peered":"2023-05-10T01:45:18.816820+0000","last_unstale":"2023-05-10T01:45:18.817483+0000","last_undegraded":"2023-05-10T01:45:18.817483+0000","last_fullsized":"2023-05-10T01:45:18.817483+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808335+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817187+0000","last_change":"2023-05-10T01:45:18.817187+0000","last_active":"2023-05-10T01:45:18.817187+0000","last_peered":"2023-05-10T01:45:18.817187+0000","last_clean":"2023-05-10T01:45:18.817187+0000","last_became_active":"2023-05-10T01:45:18.816332+0000","last_became_peered":"2023-05-10T01:45:18.816332+0000","last_unstale":"2023-05-10T01:45:18.817187+0000","last_undegraded":"2023-05-10T01:45:18.817187+0000","last_fullsized":"2023-05-10T01:45:18.817187+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807453+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826802+0000","last_change":"2023-05-10T01:45:18.826802+0000","last_active":"2023-05-10T01:45:18.826802+0000","last_peered":"2023-05-10T01:45:18.826802+0000","last_clean":"2023-05-10T01:45:18.826802+0000","last_became_active":"2023-05-10T01:45:18.825995+0000","last_became_peered":"2023-05-10T01:45:18.825995+0000","last_unstale":"2023-05-10T01:45:18.826802+0000","last_undegraded":"2023-05-10T01:45:18.826802+0000","last_fullsized":"2023-05-10T01:45:18.826802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808946+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821375+0000","last_change":"2023-05-10T01:45:18.821375+0000","last_active":"2023-05-10T01:45:18.821375+0000","last_peered":"2023-05-10T01:45:18.821375+0000","last_clean":"2023-05-10T01:45:18.821375+0000","last_became_active":"2023-05-10T01:45:18.821091+0000","last_became_peered":"2023-05-10T01:45:18.821091+0000","last_unstale":"2023-05-10T01:45:18.821375+0000","last_undegraded":"2023-05-10T01:45:18.821375+0000","last_fullsized":"2023-05-10T01:45:18.821375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807395+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823164+0000","last_change":"2023-05-10T01:45:18.823164+0000","last_active":"2023-05-10T01:45:18.823164+0000","last_peered":"2023-05-10T01:45:18.823164+0000","last_clean":"2023-05-10T01:45:18.823164+0000","last_became_active":"2023-05-10T01:45:18.820928+0000","last_became_peered":"2023-05-10T01:45:18.820928+0000","last_unstale":"2023-05-10T01:45:18.823164+0000","last_undegraded":"2023-05-10T01:45:18.823164+0000","last_fullsized":"2023-05-10T01:45:18.823164+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.815355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.829455+0000","last_change":"2023-05-10T01:45:18.829455+0000","last_active":"2023-05-10T01:45:18.829455+0000","last_peered":"2023-05-10T01:45:18.829455+0000","last_clean":"2023-05-10T01:45:18.829455+0000","last_became_active":"2023-05-10T01:45:18.829196+0000","last_became_peered":"2023-05-10T01:45:18.829196+0000","last_unstale":"2023-05-10T01:45:18.829455+0000","last_undegraded":"2023-05-10T01:45:18.829455+0000","last_fullsized":"2023-05-10T01:45:18.829455+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813899+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828648+0000","last_change":"2023-05-10T01:45:18.828648+0000","last_active":"2023-05-10T01:45:18.828648+0000","last_peered":"2023-05-10T01:45:18.828648+0000","last_clean":"2023-05-10T01:45:18.828648+0000","last_became_active":"2023-05-10T01:45:18.828290+0000","last_became_peered":"2023-05-10T01:45:18.828290+0000","last_unstale":"2023-05-10T01:45:18.828648+0000","last_undegraded":"2023-05-10T01:45:18.828648+0000","last_fullsized":"2023-05-10T01:45:18.828648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805834+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830978+0000","last_change":"2023-05-10T01:45:18.830978+0000","last_active":"2023-05-10T01:45:18.830978+0000","last_peered":"2023-05-10T01:45:18.830978+0000","last_clean":"2023-05-10T01:45:18.830978+0000","last_became_active":"2023-05-10T01:45:18.830722+0000","last_became_peered":"2023-05-10T01:45:18.830722+0000","last_unstale":"2023-05-10T01:45:18.830978+0000","last_undegraded":"2023-05-10T01:45:18.830978+0000","last_fullsized":"2023-05-10T01:45:18.830978+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807066+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819989+0000","last_change":"2023-05-10T01:45:18.819989+0000","last_active":"2023-05-10T01:45:18.819989+0000","last_peered":"2023-05-10T01:45:18.819989+0000","last_clean":"2023-05-10T01:45:18.819989+0000","last_became_active":"2023-05-10T01:45:18.819433+0000","last_became_peered":"2023-05-10T01:45:18.819433+0000","last_unstale":"2023-05-10T01:45:18.819989+0000","last_undegraded":"2023-05-10T01:45:18.819989+0000","last_fullsized":"2023-05-10T01:45:18.819989+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810625+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828193+0000","last_change":"2023-05-10T01:45:18.828193+0000","last_active":"2023-05-10T01:45:18.828193+0000","last_peered":"2023-05-10T01:45:18.828193+0000","last_clean":"2023-05-10T01:45:18.828193+0000","last_became_active":"2023-05-10T01:45:18.827891+0000","last_became_peered":"2023-05-10T01:45:18.827891+0000","last_unstale":"2023-05-10T01:45:18.828193+0000","last_undegraded":"2023-05-10T01:45:18.828193+0000","last_fullsized":"2023-05-10T01:45:18.828193+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806107+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823841+0000","last_change":"2023-05-10T01:45:18.823841+0000","last_active":"2023-05-10T01:45:18.823841+0000","last_peered":"2023-05-10T01:45:18.823841+0000","last_clean":"2023-05-10T01:45:18.823841+0000","last_became_active":"2023-05-10T01:45:18.823575+0000","last_became_peered":"2023-05-10T01:45:18.823575+0000","last_unstale":"2023-05-10T01:45:18.823841+0000","last_undegraded":"2023-05-10T01:45:18.823841+0000","last_fullsized":"2023-05-10T01:45:18.823841+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811940+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814752+0000","last_change":"2023-05-10T01:45:18.814752+0000","last_active":"2023-05-10T01:45:18.814752+0000","last_peered":"2023-05-10T01:45:18.814752+0000","last_clean":"2023-05-10T01:45:18.814752+0000","last_became_active":"2023-05-10T01:45:18.814470+0000","last_became_peered":"2023-05-10T01:45:18.814470+0000","last_unstale":"2023-05-10T01:45:18.814752+0000","last_undegraded":"2023-05-10T01:45:18.814752+0000","last_fullsized":"2023-05-10T01:45:18.814752+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810271+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828344+0000","last_change":"2023-05-10T01:45:18.828344+0000","last_active":"2023-05-10T01:45:18.828344+0000","last_peered":"2023-05-10T01:45:18.828344+0000","last_clean":"2023-05-10T01:45:18.828344+0000","last_became_active":"2023-05-10T01:45:18.828023+0000","last_became_peered":"2023-05-10T01:45:18.828023+0000","last_unstale":"2023-05-10T01:45:18.828344+0000","last_undegraded":"2023-05-10T01:45:18.828344+0000","last_fullsized":"2023-05-10T01:45:18.828344+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804826+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828387+0000","last_change":"2023-05-10T01:45:18.828387+0000","last_active":"2023-05-10T01:45:18.828387+0000","last_peered":"2023-05-10T01:45:18.828387+0000","last_clean":"2023-05-10T01:45:18.828387+0000","last_became_active":"2023-05-10T01:45:18.828060+0000","last_became_peered":"2023-05-10T01:45:18.828060+0000","last_unstale":"2023-05-10T01:45:18.828387+0000","last_undegraded":"2023-05-10T01:45:18.828387+0000","last_fullsized":"2023-05-10T01:45:18.828387+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807374+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826254+0000","last_change":"2023-05-10T01:45:18.826254+0000","last_active":"2023-05-10T01:45:18.826254+0000","last_peered":"2023-05-10T01:45:18.826254+0000","last_clean":"2023-05-10T01:45:18.826254+0000","last_became_active":"2023-05-10T01:45:18.825958+0000","last_became_peered":"2023-05-10T01:45:18.825958+0000","last_unstale":"2023-05-10T01:45:18.826254+0000","last_undegraded":"2023-05-10T01:45:18.826254+0000","last_fullsized":"2023-05-10T01:45:18.826254+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823399+0000","last_change":"2023-05-10T01:45:18.823399+0000","last_active":"2023-05-10T01:45:18.823399+0000","last_peered":"2023-05-10T01:45:18.823399+0000","last_clean":"2023-05-10T01:45:18.823399+0000","last_became_active":"2023-05-10T01:45:18.823098+0000","last_became_peered":"2023-05-10T01:45:18.823098+0000","last_unstale":"2023-05-10T01:45:18.823399+0000","last_undegraded":"2023-05-10T01:45:18.823399+0000","last_fullsized":"2023-05-10T01:45:18.823399+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817703+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828746+0000","last_change":"2023-05-10T01:45:18.828746+0000","last_active":"2023-05-10T01:45:18.828746+0000","last_peered":"2023-05-10T01:45:18.828746+0000","last_clean":"2023-05-10T01:45:18.828746+0000","last_became_active":"2023-05-10T01:45:18.828489+0000","last_became_peered":"2023-05-10T01:45:18.828489+0000","last_unstale":"2023-05-10T01:45:18.828746+0000","last_undegraded":"2023-05-10T01:45:18.828746+0000","last_fullsized":"2023-05-10T01:45:18.828746+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809532+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821338+0000","last_change":"2023-05-10T01:45:18.821338+0000","last_active":"2023-05-10T01:45:18.821338+0000","last_peered":"2023-05-10T01:45:18.821338+0000","last_clean":"2023-05-10T01:45:18.821338+0000","last_became_active":"2023-05-10T01:45:18.821075+0000","last_became_peered":"2023-05-10T01:45:18.821075+0000","last_unstale":"2023-05-10T01:45:18.821338+0000","last_undegraded":"2023-05-10T01:45:18.821338+0000","last_fullsized":"2023-05-10T01:45:18.821338+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809877+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817485+0000","last_change":"2023-05-10T01:45:18.817485+0000","last_active":"2023-05-10T01:45:18.817485+0000","last_peered":"2023-05-10T01:45:18.817485+0000","last_clean":"2023-05-10T01:45:18.817485+0000","last_became_active":"2023-05-10T01:45:18.817189+0000","last_became_peered":"2023-05-10T01:45:18.817189+0000","last_unstale":"2023-05-10T01:45:18.817485+0000","last_undegraded":"2023-05-10T01:45:18.817485+0000","last_fullsized":"2023-05-10T01:45:18.817485+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827114+0000","last_change":"2023-05-10T01:45:18.827114+0000","last_active":"2023-05-10T01:45:18.827114+0000","last_peered":"2023-05-10T01:45:18.827114+0000","last_clean":"2023-05-10T01:45:18.827114+0000","last_became_active":"2023-05-10T01:45:18.826814+0000","last_became_peered":"2023-05-10T01:45:18.826814+0000","last_unstale":"2023-05-10T01:45:18.827114+0000","last_undegraded":"2023-05-10T01:45:18.827114+0000","last_fullsized":"2023-05-10T01:45:18.827114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822470+0000","last_change":"2023-05-10T01:45:18.822470+0000","last_active":"2023-05-10T01:45:18.822470+0000","last_peered":"2023-05-10T01:45:18.822470+0000","last_clean":"2023-05-10T01:45:18.822470+0000","last_became_active":"2023-05-10T01:45:18.822174+0000","last_became_peered":"2023-05-10T01:45:18.822174+0000","last_unstale":"2023-05-10T01:45:18.822470+0000","last_undegraded":"2023-05-10T01:45:18.822470+0000","last_fullsized":"2023-05-10T01:45:18.822470+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810166+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830987+0000","last_change":"2023-05-10T01:45:18.830987+0000","last_active":"2023-05-10T01:45:18.830987+0000","last_peered":"2023-05-10T01:45:18.830987+0000","last_clean":"2023-05-10T01:45:18.830987+0000","last_became_active":"2023-05-10T01:45:18.830748+0000","last_became_peered":"2023-05-10T01:45:18.830748+0000","last_unstale":"2023-05-10T01:45:18.830987+0000","last_undegraded":"2023-05-10T01:45:18.830987+0000","last_fullsized":"2023-05-10T01:45:18.830987+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811397+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827522+0000","last_change":"2023-05-10T01:45:18.827522+0000","last_active":"2023-05-10T01:45:18.827522+0000","last_peered":"2023-05-10T01:45:18.827522+0000","last_clean":"2023-05-10T01:45:18.827522+0000","last_became_active":"2023-05-10T01:45:18.827210+0000","last_became_peered":"2023-05-10T01:45:18.827210+0000","last_unstale":"2023-05-10T01:45:18.827522+0000","last_undegraded":"2023-05-10T01:45:18.827522+0000","last_fullsized":"2023-05-10T01:45:18.827522+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807193+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822866+0000","last_change":"2023-05-10T01:45:18.822866+0000","last_active":"2023-05-10T01:45:18.822866+0000","last_peered":"2023-05-10T01:45:18.822866+0000","last_clean":"2023-05-10T01:45:18.822866+0000","last_became_active":"2023-05-10T01:45:18.822558+0000","last_became_peered":"2023-05-10T01:45:18.822558+0000","last_unstale":"2023-05-10T01:45:18.822866+0000","last_undegraded":"2023-05-10T01:45:18.822866+0000","last_fullsized":"2023-05-10T01:45:18.822866+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810573+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819802+0000","last_change":"2023-05-10T01:45:18.819802+0000","last_active":"2023-05-10T01:45:18.819802+0000","last_peered":"2023-05-10T01:45:18.819802+0000","last_clean":"2023-05-10T01:45:18.819802+0000","last_became_active":"2023-05-10T01:45:18.819051+0000","last_became_peered":"2023-05-10T01:45:18.819051+0000","last_unstale":"2023-05-10T01:45:18.819802+0000","last_undegraded":"2023-05-10T01:45:18.819802+0000","last_fullsized":"2023-05-10T01:45:18.819802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809902+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823375+0000","last_change":"2023-05-10T01:45:18.823375+0000","last_active":"2023-05-10T01:45:18.823375+0000","last_peered":"2023-05-10T01:45:18.823375+0000","last_clean":"2023-05-10T01:45:18.823375+0000","last_became_active":"2023-05-10T01:45:18.822638+0000","last_became_peered":"2023-05-10T01:45:18.822638+0000","last_unstale":"2023-05-10T01:45:18.823375+0000","last_undegraded":"2023-05-10T01:45:18.823375+0000","last_fullsized":"2023-05-10T01:45:18.823375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812577+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819534+0000","last_change":"2023-05-10T01:45:18.819534+0000","last_active":"2023-05-10T01:45:18.819534+0000","last_peered":"2023-05-10T01:45:18.819534+0000","last_clean":"2023-05-10T01:45:18.819534+0000","last_became_active":"2023-05-10T01:45:18.818481+0000","last_became_peered":"2023-05-10T01:45:18.818481+0000","last_unstale":"2023-05-10T01:45:18.819534+0000","last_undegraded":"2023-05-10T01:45:18.819534+0000","last_fullsized":"2023-05-10T01:45:18.819534+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805778+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827299+0000","last_change":"2023-05-10T01:45:18.827299+0000","last_active":"2023-05-10T01:45:18.827299+0000","last_peered":"2023-05-10T01:45:18.827299+0000","last_clean":"2023-05-10T01:45:18.827299+0000","last_became_active":"2023-05-10T01:45:18.827012+0000","last_became_peered":"2023-05-10T01:45:18.827012+0000","last_unstale":"2023-05-10T01:45:18.827299+0000","last_undegraded":"2023-05-10T01:45:18.827299+0000","last_fullsized":"2023-05-10T01:45:18.827299+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810934+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823876+0000","last_change":"2023-05-10T01:45:18.823876+0000","last_active":"2023-05-10T01:45:18.823876+0000","last_peered":"2023-05-10T01:45:18.823876+0000","last_clean":"2023-05-10T01:45:18.823876+0000","last_became_active":"2023-05-10T01:45:18.823602+0000","last_became_peered":"2023-05-10T01:45:18.823602+0000","last_unstale":"2023-05-10T01:45:18.823876+0000","last_undegraded":"2023-05-10T01:45:18.823876+0000","last_fullsized":"2023-05-10T01:45:18.823876+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814943+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819295+0000","last_change":"2023-05-10T01:45:18.819295+0000","last_active":"2023-05-10T01:45:18.819295+0000","last_peered":"2023-05-10T01:45:18.819295+0000","last_clean":"2023-05-10T01:45:18.819295+0000","last_became_active":"2023-05-10T01:45:18.819022+0000","last_became_peered":"2023-05-10T01:45:18.819022+0000","last_unstale":"2023-05-10T01:45:18.819295+0000","last_undegraded":"2023-05-10T01:45:18.819295+0000","last_fullsized":"2023-05-10T01:45:18.819295+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805472+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820590+0000","last_change":"2023-05-10T01:45:18.820590+0000","last_active":"2023-05-10T01:45:18.820590+0000","last_peered":"2023-05-10T01:45:18.820590+0000","last_clean":"2023-05-10T01:45:18.820590+0000","last_became_active":"2023-05-10T01:45:18.818788+0000","last_became_peered":"2023-05-10T01:45:18.818788+0000","last_unstale":"2023-05-10T01:45:18.820590+0000","last_undegraded":"2023-05-10T01:45:18.820590+0000","last_fullsized":"2023-05-10T01:45:18.820590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816454+0000","last_change":"2023-05-10T01:45:18.816454+0000","last_active":"2023-05-10T01:45:18.816454+0000","last_peered":"2023-05-10T01:45:18.816454+0000","last_clean":"2023-05-10T01:45:18.816454+0000","last_became_active":"2023-05-10T01:45:18.816162+0000","last_became_peered":"2023-05-10T01:45:18.816162+0000","last_unstale":"2023-05-10T01:45:18.816454+0000","last_undegraded":"2023-05-10T01:45:18.816454+0000","last_fullsized":"2023-05-10T01:45:18.816454+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817272+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825786+0000","last_change":"2023-05-10T01:45:18.825786+0000","last_active":"2023-05-10T01:45:18.825786+0000","last_peered":"2023-05-10T01:45:18.825786+0000","last_clean":"2023-05-10T01:45:18.825786+0000","last_became_active":"2023-05-10T01:45:18.825527+0000","last_became_peered":"2023-05-10T01:45:18.825527+0000","last_unstale":"2023-05-10T01:45:18.825786+0000","last_undegraded":"2023-05-10T01:45:18.825786+0000","last_fullsized":"2023-05-10T01:45:18.825786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808691+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824463+0000","last_change":"2023-05-10T01:45:18.824463+0000","last_active":"2023-05-10T01:45:18.824463+0000","last_peered":"2023-05-10T01:45:18.824463+0000","last_clean":"2023-05-10T01:45:18.824463+0000","last_became_active":"2023-05-10T01:45:18.824185+0000","last_became_peered":"2023-05-10T01:45:18.824185+0000","last_unstale":"2023-05-10T01:45:18.824463+0000","last_undegraded":"2023-05-10T01:45:18.824463+0000","last_fullsized":"2023-05-10T01:45:18.824463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805624+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825086+0000","last_change":"2023-05-10T01:45:18.825086+0000","last_active":"2023-05-10T01:45:18.825086+0000","last_peered":"2023-05-10T01:45:18.825086+0000","last_clean":"2023-05-10T01:45:18.825086+0000","last_became_active":"2023-05-10T01:45:18.823740+0000","last_became_peered":"2023-05-10T01:45:18.823740+0000","last_unstale":"2023-05-10T01:45:18.825086+0000","last_undegraded":"2023-05-10T01:45:18.825086+0000","last_fullsized":"2023-05-10T01:45:18.825086+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806775+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816038+0000","last_change":"2023-05-10T01:45:18.816038+0000","last_active":"2023-05-10T01:45:18.816038+0000","last_peered":"2023-05-10T01:45:18.816038+0000","last_clean":"2023-05-10T01:45:18.816038+0000","last_became_active":"2023-05-10T01:45:18.815608+0000","last_became_peered":"2023-05-10T01:45:18.815608+0000","last_unstale":"2023-05-10T01:45:18.816038+0000","last_undegraded":"2023-05-10T01:45:18.816038+0000","last_fullsized":"2023-05-10T01:45:18.816038+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798030+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:17.798030+0000","last_peered":"2023-05-10T01:45:17.798030+0000","last_clean":"2023-05-10T01:45:17.798030+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:17.798030+0000","last_undegraded":"2023-05-10T01:45:17.798030+0000","last_fullsized":"2023-05-10T01:45:17.798030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809441+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820670+0000","last_change":"2023-05-10T01:45:18.820670+0000","last_active":"2023-05-10T01:45:18.820670+0000","last_peered":"2023-05-10T01:45:18.820670+0000","last_clean":"2023-05-10T01:45:18.820670+0000","last_became_active":"2023-05-10T01:45:18.820163+0000","last_became_peered":"2023-05-10T01:45:18.820163+0000","last_unstale":"2023-05-10T01:45:18.820670+0000","last_undegraded":"2023-05-10T01:45:18.820670+0000","last_fullsized":"2023-05-10T01:45:18.820670+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805587+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:17.805587+0000","last_peered":"2023-05-10T01:45:17.805587+0000","last_clean":"2023-05-10T01:45:17.805587+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:17.805587+0000","last_undegraded":"2023-05-10T01:45:17.805587+0000","last_fullsized":"2023-05-10T01:45:17.805587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812134+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824998+0000","last_change":"2023-05-10T01:45:18.824998+0000","last_active":"2023-05-10T01:45:18.824998+0000","last_peered":"2023-05-10T01:45:18.824998+0000","last_clean":"2023-05-10T01:45:18.824998+0000","last_became_active":"2023-05-10T01:45:18.824704+0000","last_became_peered":"2023-05-10T01:45:18.824704+0000","last_unstale":"2023-05-10T01:45:18.824998+0000","last_undegraded":"2023-05-10T01:45:18.824998+0000","last_fullsized":"2023-05-10T01:45:18.824998+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.808796+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:17.808796+0000","last_peered":"2023-05-10T01:45:17.808796+0000","last_clean":"2023-05-10T01:45:17.808796+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:17.808796+0000","last_undegraded":"2023-05-10T01:45:17.808796+0000","last_fullsized":"2023-05-10T01:45:17.808796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804968+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819070+0000","last_change":"2023-05-10T01:45:18.819070+0000","last_active":"2023-05-10T01:45:18.819070+0000","last_peered":"2023-05-10T01:45:18.819070+0000","last_clean":"2023-05-10T01:45:18.819070+0000","last_became_active":"2023-05-10T01:45:18.818756+0000","last_became_peered":"2023-05-10T01:45:18.818756+0000","last_unstale":"2023-05-10T01:45:18.819070+0000","last_undegraded":"2023-05-10T01:45:18.819070+0000","last_fullsized":"2023-05-10T01:45:18.819070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805649+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:17.805649+0000","last_peered":"2023-05-10T01:45:17.805649+0000","last_clean":"2023-05-10T01:45:17.805649+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:17.805649+0000","last_undegraded":"2023-05-10T01:45:17.805649+0000","last_fullsized":"2023-05-10T01:45:17.805649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810620+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:17.810620+0000","last_peered":"2023-05-10T01:45:17.810620+0000","last_clean":"2023-05-10T01:45:17.810620+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:17.810620+0000","last_undegraded":"2023-05-10T01:45:17.810620+0000","last_fullsized":"2023-05-10T01:45:17.810620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806766+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820200+0000","last_change":"2023-05-10T01:45:18.820200+0000","last_active":"2023-05-10T01:45:18.820200+0000","last_peered":"2023-05-10T01:45:18.820200+0000","last_clean":"2023-05-10T01:45:18.820200+0000","last_became_active":"2023-05-10T01:45:18.819546+0000","last_became_peered":"2023-05-10T01:45:18.819546+0000","last_unstale":"2023-05-10T01:45:18.820200+0000","last_undegraded":"2023-05-10T01:45:18.820200+0000","last_fullsized":"2023-05-10T01:45:18.820200+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810678+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:17.810678+0000","last_peered":"2023-05-10T01:45:17.810678+0000","last_clean":"2023-05-10T01:45:17.810678+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:17.810678+0000","last_undegraded":"2023-05-10T01:45:17.810678+0000","last_fullsized":"2023-05-10T01:45:17.810678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811712+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826710+0000","last_change":"2023-05-10T01:45:18.826710+0000","last_active":"2023-05-10T01:45:18.826710+0000","last_peered":"2023-05-10T01:45:18.826710+0000","last_clean":"2023-05-10T01:45:18.826710+0000","last_became_active":"2023-05-10T01:45:18.826416+0000","last_became_peered":"2023-05-10T01:45:18.826416+0000","last_unstale":"2023-05-10T01:45:18.826710+0000","last_undegraded":"2023-05-10T01:45:18.826710+0000","last_fullsized":"2023-05-10T01:45:18.826710+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810515+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:17.810515+0000","last_peered":"2023-05-10T01:45:17.810515+0000","last_clean":"2023-05-10T01:45:17.810515+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:17.810515+0000","last_undegraded":"2023-05-10T01:45:17.810515+0000","last_fullsized":"2023-05-10T01:45:17.810515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805892+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825979+0000","last_change":"2023-05-10T01:45:18.825979+0000","last_active":"2023-05-10T01:45:18.825979+0000","last_peered":"2023-05-10T01:45:18.825979+0000","last_clean":"2023-05-10T01:45:18.825979+0000","last_became_active":"2023-05-10T01:45:18.825702+0000","last_became_peered":"2023-05-10T01:45:18.825702+0000","last_unstale":"2023-05-10T01:45:18.825979+0000","last_undegraded":"2023-05-10T01:45:18.825979+0000","last_fullsized":"2023-05-10T01:45:18.825979+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798039+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:17.798039+0000","last_peered":"2023-05-10T01:45:17.798039+0000","last_clean":"2023-05-10T01:45:17.798039+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:17.798039+0000","last_undegraded":"2023-05-10T01:45:17.798039+0000","last_fullsized":"2023-05-10T01:45:17.798039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812157+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820578+0000","last_change":"2023-05-10T01:45:18.820578+0000","last_active":"2023-05-10T01:45:18.820578+0000","last_peered":"2023-05-10T01:45:18.820578+0000","last_clean":"2023-05-10T01:45:18.820578+0000","last_became_active":"2023-05-10T01:45:18.820022+0000","last_became_peered":"2023-05-10T01:45:18.820022+0000","last_unstale":"2023-05-10T01:45:18.820578+0000","last_undegraded":"2023-05-10T01:45:18.820578+0000","last_fullsized":"2023-05-10T01:45:18.820578+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.803642+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:17.803642+0000","last_peered":"2023-05-10T01:45:17.803642+0000","last_clean":"2023-05-10T01:45:17.803642+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:17.803642+0000","last_undegraded":"2023-05-10T01:45:17.803642+0000","last_fullsized":"2023-05-10T01:45:17.803642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20768,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351072,"statfs":{"total":96636764160,"available":96615497728,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.375}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20384,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18304,"kb_avail":94351456,"statfs":{"total":96636764160,"available":96615890944,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18743296},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.77300000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.627}]},{"osd":1,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":1.208,"15min":1.208},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":1.284},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.72599999999999998,"15min":1.3360000000000001},"last":0.501},{"interface":"front","average":{"1min":0.5,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":1.3620000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.3120000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.995,"15min":1.2729999999999999},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575266,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24096,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94347744,"statfs":{"total":96636764160,"available":96612089856,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":1.1200000000000001,"15min":1.357},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.90900000000000003,"5min":1.171,"15min":1.226},"last":0.75}]},{"osd":5,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.872,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.008,"15min":1.008},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":1.1830000000000001,"15min":1.403},"last":0.72699999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575266,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24684,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":22592,"kb_avail":94347156,"statfs":{"total":96636764160,"available":96611487744,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23134208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.37}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.871}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.878},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575266,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25760,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94346080,"statfs":{"total":96636764160,"available":96610385920,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.314}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575266,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":30528,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31260672},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.45800000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.69799999999999995}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20588,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351252,"statfs":{"total":96636764160,"available":96615682048,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.497}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.442}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23584,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":21504,"kb_avail":94348256,"statfs":{"total":96636764160,"available":96612614144,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22020096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.80400000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.79500000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.75,"15min":0.88600000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.624,"15min":0.628},"min":{"1min":0.441,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.66600000000000004,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.65600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.75700000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.55200000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.63}]},{"osd":6,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.60999999999999999,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":0.76000000000000001,"15min":0.89200000000000002},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:23.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.378+0000 7f64eab07700 1 Processor -- start 2023-05-10T01:45:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.378+0000 7f64eab07700 1 -- start start 2023-05-10T01:45:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64eab07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 0x7f64e40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64eab07700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40c0650 con 0x7f64e4069da0 2023-05-10T01:45:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64eab07700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40bfd20 con 0x7f64e4154540 2023-05-10T01:45:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64eab07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c0000 con 0x7f64e4154160 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64e90a4700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f64e4069da0 0x7f64e40c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51386/0 (socket says 172.21.15.52:51386) 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.379+0000 7f64e90a4700 1 -- 172.21.15.52:0/3898140393 learned_addr learned my addr 172.21.15.52:0/3898140393 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 0x7f64e40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061970255 0 0) 0x7f64e40c0650 con 0x7f64e4069da0 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c40033f0 con 0x7f64e4069da0 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691947222 0 0) 0x7f64c40033f0 con 0x7f64e4069da0 2023-05-10T01:45:23.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 msgr2=0x7f64e40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 0x7f64e40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 >> v1:172.21.15.172:6789/0 conn(0x7f64e4154540 legacy=0x7f64e4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40c02e0 con 0x7f64e4069da0 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f64cc001470 con 0x7f64e4069da0 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 >> v1:172.21.15.52:6789/0 conn(0x7f64e4069da0 legacy=0x7f64e40c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64c4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64c4004690 0x7f64c4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 0x7f64c40050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c0000 con 0x7f64c4003910 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c400b9c0 con 0x7f64c4004690 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c400bb80 con 0x7f64e4154160 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64c4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 -- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 msgr2=0x7f64c40050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e4154160 0x7f64c40050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 -- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64c4004690 msgr2=0x7f64c4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64c4004690 0x7f64c4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 -- 172.21.15.52:0/3898140393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40033f0 con 0x7f64c4003910 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.380+0000 7f64e88a3700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64c4003d30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f64dc00e210 tx=0x7f64dc00b040).ready entity=mon.0 client_cookie=e97a9b7abb046289 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc009ac0 con 0x7f64c4003910 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc00f040 con 0x7f64c4003910 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64e37fe700 1 -- 172.21.15.52:0/3898140393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00ecd0 con 0x7f64c4003910 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 -- 172.21.15.52:0/3898140393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 msgr2=0x7f64c4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 --2- 172.21.15.52:0/3898140393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64c4003d30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f64dc00e210 tx=0x7f64dc00b040).stop 2023-05-10T01:45:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64e90a4700 1 -- 172.21.15.52:0/3898140393 reap_dead start 2023-05-10T01:45:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 -- 172.21.15.52:0/3898140393 shutdown_connections 2023-05-10T01:45:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 -- 172.21.15.52:0/3898140393 >> 172.21.15.52:0/3898140393 conn(0x7f64e40cb6f0 msgr2=0x7f64e40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 -- 172.21.15.52:0/3898140393 shutdown_connections 2023-05-10T01:45:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.381+0000 7f64eab07700 1 -- 172.21.15.52:0/3898140393 wait complete. 2023-05-10T01:45:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.382+0000 7f64eab07700 1 Processor -- start 2023-05-10T01:45:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.382+0000 7f64eab07700 1 -- start start 2023-05-10T01:45:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 0x7f64e40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 0x7f64e40c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c2ee0 con 0x7f64c4003910 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c31c0 con 0x7f64e414dc80 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64eab07700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c34a0 con 0x7f64e40c2220 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64e88a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64e88a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42380/0 (socket says 172.21.15.52:42380) 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64e88a3700 1 -- 172.21.15.52:0/2893567749 learned_addr learned my addr 172.21.15.52:0/2893567749 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.383+0000 7f64e3fff700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 0x7f64e40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e90a4700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 0x7f64e40c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 -- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 msgr2=0x7f64e40c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 0x7f64e40c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 -- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 msgr2=0x7f64e40c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 0x7f64e40c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 -- 172.21.15.52:0/2893567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40c3780 con 0x7f64c4003910 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e3fff700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 0x7f64e40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e90a4700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 0x7f64e40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e88a3700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f64c400b990 tx=0x7f64dc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc013d70 con 0x7f64c4003910 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc027420 con 0x7f64c4003910 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40c3a60 con 0x7f64c4003910 2023-05-10T01:45:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc027610 con 0x7f64c4003910 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.384+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e414fa40 con 0x7f64c4003910 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.385+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e40666b0 con 0x7f64c4003910 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.385+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f64dc02e070 con 0x7f64c4003910 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.386+0000 7f64e0ff9700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 0x7f64c8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.386+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f64dc07bc00 con 0x7f64c4003910 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.386+0000 7f64e3fff700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 0x7f64c8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.386+0000 7f64e3fff700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 0x7f64c8061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f64d4000f60 tx=0x7f64d4009040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.390+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64dc081020 con 0x7f64c4003910 2023-05-10T01:45:23.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.562+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64e40c3330 con 0x7f64c805ed90 2023-05-10T01:45:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.572+0000 7f64e0ff9700 1 -- 172.21.15.52:0/2893567749 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358733 (secure 0 0 0) 0x7f64e40c3330 con 0x7f64c805ed90 2023-05-10T01:45:23.578 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 msgr2=0x7f64c8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 0x7f64c8061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f64d4000f60 tx=0x7f64d4009040).stop 2023-05-10T01:45:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 msgr2=0x7f64e414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f64c400b990 tx=0x7f64dc01a000).stop 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 shutdown_connections 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f64c805ed90 0x7f64c8061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64e40c2220 0x7f64e40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64c4003910 0x7f64e414d790 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 --2- 172.21.15.52:0/2893567749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e414dc80 0x7f64e40c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 >> 172.21.15.52:0/2893567749 conn(0x7f64e40cb6f0 msgr2=0x7f64e40ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 shutdown_connections 2023-05-10T01:45:23.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.575+0000 7f64eab07700 1 -- 172.21.15.52:0/2893567749 wait complete. 2023-05-10T01:45:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:23.589 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:45:21.949302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":192472,"kb_used_data":16600,"kb_used_omap":0,"kb_used_meta":175808,"kb_avail":754782248,"statfs":{"total":773094113280,"available":772897021952,"internally_reserved":0,"allocated":16998400,"data_stored":8789894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180027392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27877,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.224551"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813640+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818402+0000","last_change":"2023-05-10T01:45:18.818402+0000","last_active":"2023-05-10T01:45:18.818402+0000","last_peered":"2023-05-10T01:45:18.818402+0000","last_clean":"2023-05-10T01:45:18.818402+0000","last_became_active":"2023-05-10T01:45:18.818138+0000","last_became_peered":"2023-05-10T01:45:18.818138+0000","last_unstale":"2023-05-10T01:45:18.818402+0000","last_undegraded":"2023-05-10T01:45:18.818402+0000","last_fullsized":"2023-05-10T01:45:18.818402+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810742+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814168+0000","last_change":"2023-05-10T01:45:18.814168+0000","last_active":"2023-05-10T01:45:18.814168+0000","last_peered":"2023-05-10T01:45:18.814168+0000","last_clean":"2023-05-10T01:45:18.814168+0000","last_became_active":"2023-05-10T01:45:18.813893+0000","last_became_peered":"2023-05-10T01:45:18.813893+0000","last_unstale":"2023-05-10T01:45:18.814168+0000","last_undegraded":"2023-05-10T01:45:18.814168+0000","last_fullsized":"2023-05-10T01:45:18.814168+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810084+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821662+0000","last_change":"2023-05-10T01:45:18.821662+0000","last_active":"2023-05-10T01:45:18.821662+0000","last_peered":"2023-05-10T01:45:18.821662+0000","last_clean":"2023-05-10T01:45:18.821662+0000","last_became_active":"2023-05-10T01:45:18.821367+0000","last_became_peered":"2023-05-10T01:45:18.821367+0000","last_unstale":"2023-05-10T01:45:18.821662+0000","last_undegraded":"2023-05-10T01:45:18.821662+0000","last_fullsized":"2023-05-10T01:45:18.821662+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814319+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830114+0000","last_change":"2023-05-10T01:45:18.830114+0000","last_active":"2023-05-10T01:45:18.830114+0000","last_peered":"2023-05-10T01:45:18.830114+0000","last_clean":"2023-05-10T01:45:18.830114+0000","last_became_active":"2023-05-10T01:45:18.829808+0000","last_became_peered":"2023-05-10T01:45:18.829808+0000","last_unstale":"2023-05-10T01:45:18.830114+0000","last_undegraded":"2023-05-10T01:45:18.830114+0000","last_fullsized":"2023-05-10T01:45:18.830114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807219+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820192+0000","last_change":"2023-05-10T01:45:18.820192+0000","last_active":"2023-05-10T01:45:18.820192+0000","last_peered":"2023-05-10T01:45:18.820192+0000","last_clean":"2023-05-10T01:45:18.820192+0000","last_became_active":"2023-05-10T01:45:18.819911+0000","last_became_peered":"2023-05-10T01:45:18.819911+0000","last_unstale":"2023-05-10T01:45:18.820192+0000","last_undegraded":"2023-05-10T01:45:18.820192+0000","last_fullsized":"2023-05-10T01:45:18.820192+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814732+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827571+0000","last_change":"2023-05-10T01:45:18.827571+0000","last_active":"2023-05-10T01:45:18.827571+0000","last_peered":"2023-05-10T01:45:18.827571+0000","last_clean":"2023-05-10T01:45:18.827571+0000","last_became_active":"2023-05-10T01:45:18.827216+0000","last_became_peered":"2023-05-10T01:45:18.827216+0000","last_unstale":"2023-05-10T01:45:18.827571+0000","last_undegraded":"2023-05-10T01:45:18.827571+0000","last_fullsized":"2023-05-10T01:45:18.827571+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807614+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823558+0000","last_change":"2023-05-10T01:45:18.823558+0000","last_active":"2023-05-10T01:45:18.823558+0000","last_peered":"2023-05-10T01:45:18.823558+0000","last_clean":"2023-05-10T01:45:18.823558+0000","last_became_active":"2023-05-10T01:45:18.823058+0000","last_became_peered":"2023-05-10T01:45:18.823058+0000","last_unstale":"2023-05-10T01:45:18.823558+0000","last_undegraded":"2023-05-10T01:45:18.823558+0000","last_fullsized":"2023-05-10T01:45:18.823558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811615+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817323+0000","last_change":"2023-05-10T01:45:18.817323+0000","last_active":"2023-05-10T01:45:18.817323+0000","last_peered":"2023-05-10T01:45:18.817323+0000","last_clean":"2023-05-10T01:45:18.817323+0000","last_became_active":"2023-05-10T01:45:18.817030+0000","last_became_peered":"2023-05-10T01:45:18.817030+0000","last_unstale":"2023-05-10T01:45:18.817323+0000","last_undegraded":"2023-05-10T01:45:18.817323+0000","last_fullsized":"2023-05-10T01:45:18.817323+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.816664+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819801+0000","last_change":"2023-05-10T01:45:18.819801+0000","last_active":"2023-05-10T01:45:18.819801+0000","last_peered":"2023-05-10T01:45:18.819801+0000","last_clean":"2023-05-10T01:45:18.819801+0000","last_became_active":"2023-05-10T01:45:18.819525+0000","last_became_peered":"2023-05-10T01:45:18.819525+0000","last_unstale":"2023-05-10T01:45:18.819801+0000","last_undegraded":"2023-05-10T01:45:18.819801+0000","last_fullsized":"2023-05-10T01:45:18.819801+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811410+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826355+0000","last_change":"2023-05-10T01:45:18.826355+0000","last_active":"2023-05-10T01:45:18.826355+0000","last_peered":"2023-05-10T01:45:18.826355+0000","last_clean":"2023-05-10T01:45:18.826355+0000","last_became_active":"2023-05-10T01:45:18.825988+0000","last_became_peered":"2023-05-10T01:45:18.825988+0000","last_unstale":"2023-05-10T01:45:18.826355+0000","last_undegraded":"2023-05-10T01:45:18.826355+0000","last_fullsized":"2023-05-10T01:45:18.826355+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807606+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823529+0000","last_change":"2023-05-10T01:45:18.823529+0000","last_active":"2023-05-10T01:45:18.823529+0000","last_peered":"2023-05-10T01:45:18.823529+0000","last_clean":"2023-05-10T01:45:18.823529+0000","last_became_active":"2023-05-10T01:45:18.823231+0000","last_became_peered":"2023-05-10T01:45:18.823231+0000","last_unstale":"2023-05-10T01:45:18.823529+0000","last_undegraded":"2023-05-10T01:45:18.823529+0000","last_fullsized":"2023-05-10T01:45:18.823529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808049+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824587+0000","last_change":"2023-05-10T01:45:18.824587+0000","last_active":"2023-05-10T01:45:18.824587+0000","last_peered":"2023-05-10T01:45:18.824587+0000","last_clean":"2023-05-10T01:45:18.824587+0000","last_became_active":"2023-05-10T01:45:18.824256+0000","last_became_peered":"2023-05-10T01:45:18.824256+0000","last_unstale":"2023-05-10T01:45:18.824587+0000","last_undegraded":"2023-05-10T01:45:18.824587+0000","last_fullsized":"2023-05-10T01:45:18.824587+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808274+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818724+0000","last_change":"2023-05-10T01:45:18.818724+0000","last_active":"2023-05-10T01:45:18.818724+0000","last_peered":"2023-05-10T01:45:18.818724+0000","last_clean":"2023-05-10T01:45:18.818724+0000","last_became_active":"2023-05-10T01:45:18.818428+0000","last_became_peered":"2023-05-10T01:45:18.818428+0000","last_unstale":"2023-05-10T01:45:18.818724+0000","last_undegraded":"2023-05-10T01:45:18.818724+0000","last_fullsized":"2023-05-10T01:45:18.818724+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812172+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817675+0000","last_change":"2023-05-10T01:45:18.817675+0000","last_active":"2023-05-10T01:45:18.817675+0000","last_peered":"2023-05-10T01:45:18.817675+0000","last_clean":"2023-05-10T01:45:18.817675+0000","last_became_active":"2023-05-10T01:45:18.817193+0000","last_became_peered":"2023-05-10T01:45:18.817193+0000","last_unstale":"2023-05-10T01:45:18.817675+0000","last_undegraded":"2023-05-10T01:45:18.817675+0000","last_fullsized":"2023-05-10T01:45:18.817675+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814714+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821898+0000","last_change":"2023-05-10T01:45:18.821898+0000","last_active":"2023-05-10T01:45:18.821898+0000","last_peered":"2023-05-10T01:45:18.821898+0000","last_clean":"2023-05-10T01:45:18.821898+0000","last_became_active":"2023-05-10T01:45:18.821629+0000","last_became_peered":"2023-05-10T01:45:18.821629+0000","last_unstale":"2023-05-10T01:45:18.821898+0000","last_undegraded":"2023-05-10T01:45:18.821898+0000","last_fullsized":"2023-05-10T01:45:18.821898+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821558+0000","last_change":"2023-05-10T01:45:18.821558+0000","last_active":"2023-05-10T01:45:18.821558+0000","last_peered":"2023-05-10T01:45:18.821558+0000","last_clean":"2023-05-10T01:45:18.821558+0000","last_became_active":"2023-05-10T01:45:18.821237+0000","last_became_peered":"2023-05-10T01:45:18.821237+0000","last_unstale":"2023-05-10T01:45:18.821558+0000","last_undegraded":"2023-05-10T01:45:18.821558+0000","last_fullsized":"2023-05-10T01:45:18.821558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806738+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820366+0000","last_change":"2023-05-10T01:45:18.820366+0000","last_active":"2023-05-10T01:45:18.820366+0000","last_peered":"2023-05-10T01:45:18.820366+0000","last_clean":"2023-05-10T01:45:18.820366+0000","last_became_active":"2023-05-10T01:45:18.819939+0000","last_became_peered":"2023-05-10T01:45:18.819939+0000","last_unstale":"2023-05-10T01:45:18.820366+0000","last_undegraded":"2023-05-10T01:45:18.820366+0000","last_fullsized":"2023-05-10T01:45:18.820366+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807942+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820855+0000","last_became_peered":"2023-05-10T01:45:18.820855+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809881+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821215+0000","last_change":"2023-05-10T01:45:18.821215+0000","last_active":"2023-05-10T01:45:18.821215+0000","last_peered":"2023-05-10T01:45:18.821215+0000","last_clean":"2023-05-10T01:45:18.821215+0000","last_became_active":"2023-05-10T01:45:18.820901+0000","last_became_peered":"2023-05-10T01:45:18.820901+0000","last_unstale":"2023-05-10T01:45:18.821215+0000","last_undegraded":"2023-05-10T01:45:18.821215+0000","last_fullsized":"2023-05-10T01:45:18.821215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813156+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819565+0000","last_change":"2023-05-10T01:45:18.819565+0000","last_active":"2023-05-10T01:45:18.819565+0000","last_peered":"2023-05-10T01:45:18.819565+0000","last_clean":"2023-05-10T01:45:18.819565+0000","last_became_active":"2023-05-10T01:45:18.819253+0000","last_became_peered":"2023-05-10T01:45:18.819253+0000","last_unstale":"2023-05-10T01:45:18.819565+0000","last_undegraded":"2023-05-10T01:45:18.819565+0000","last_fullsized":"2023-05-10T01:45:18.819565+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812836+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820818+0000","last_became_peered":"2023-05-10T01:45:18.820818+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805101+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817483+0000","last_change":"2023-05-10T01:45:18.817483+0000","last_active":"2023-05-10T01:45:18.817483+0000","last_peered":"2023-05-10T01:45:18.817483+0000","last_clean":"2023-05-10T01:45:18.817483+0000","last_became_active":"2023-05-10T01:45:18.816820+0000","last_became_peered":"2023-05-10T01:45:18.816820+0000","last_unstale":"2023-05-10T01:45:18.817483+0000","last_undegraded":"2023-05-10T01:45:18.817483+0000","last_fullsized":"2023-05-10T01:45:18.817483+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808335+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817187+0000","last_change":"2023-05-10T01:45:18.817187+0000","last_active":"2023-05-10T01:45:18.817187+0000","last_peered":"2023-05-10T01:45:18.817187+0000","last_clean":"2023-05-10T01:45:18.817187+0000","last_became_active":"2023-05-10T01:45:18.816332+0000","last_became_peered":"2023-05-10T01:45:18.816332+0000","last_unstale":"2023-05-10T01:45:18.817187+0000","last_undegraded":"2023-05-10T01:45:18.817187+0000","last_fullsized":"2023-05-10T01:45:18.817187+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807453+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826802+0000","last_change":"2023-05-10T01:45:18.826802+0000","last_active":"2023-05-10T01:45:18.826802+0000","last_peered":"2023-05-10T01:45:18.826802+0000","last_clean":"2023-05-10T01:45:18.826802+0000","last_became_active":"2023-05-10T01:45:18.825995+0000","last_became_peered":"2023-05-10T01:45:18.825995+0000","last_unstale":"2023-05-10T01:45:18.826802+0000","last_undegraded":"2023-05-10T01:45:18.826802+0000","last_fullsized":"2023-05-10T01:45:18.826802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808946+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821375+0000","last_change":"2023-05-10T01:45:18.821375+0000","last_active":"2023-05-10T01:45:18.821375+0000","last_peered":"2023-05-10T01:45:18.821375+0000","last_clean":"2023-05-10T01:45:18.821375+0000","last_became_active":"2023-05-10T01:45:18.821091+0000","last_became_peered":"2023-05-10T01:45:18.821091+0000","last_unstale":"2023-05-10T01:45:18.821375+0000","last_undegraded":"2023-05-10T01:45:18.821375+0000","last_fullsized":"2023-05-10T01:45:18.821375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807395+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823164+0000","last_change":"2023-05-10T01:45:18.823164+0000","last_active":"2023-05-10T01:45:18.823164+0000","last_peered":"2023-05-10T01:45:18.823164+0000","last_clean":"2023-05-10T01:45:18.823164+0000","last_became_active":"2023-05-10T01:45:18.820928+0000","last_became_peered":"2023-05-10T01:45:18.820928+0000","last_unstale":"2023-05-10T01:45:18.823164+0000","last_undegraded":"2023-05-10T01:45:18.823164+0000","last_fullsized":"2023-05-10T01:45:18.823164+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.815355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.829455+0000","last_change":"2023-05-10T01:45:18.829455+0000","last_active":"2023-05-10T01:45:18.829455+0000","last_peered":"2023-05-10T01:45:18.829455+0000","last_clean":"2023-05-10T01:45:18.829455+0000","last_became_active":"2023-05-10T01:45:18.829196+0000","last_became_peered":"2023-05-10T01:45:18.829196+0000","last_unstale":"2023-05-10T01:45:18.829455+0000","last_undegraded":"2023-05-10T01:45:18.829455+0000","last_fullsized":"2023-05-10T01:45:18.829455+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813899+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828648+0000","last_change":"2023-05-10T01:45:18.828648+0000","last_active":"2023-05-10T01:45:18.828648+0000","last_peered":"2023-05-10T01:45:18.828648+0000","last_clean":"2023-05-10T01:45:18.828648+0000","last_became_active":"2023-05-10T01:45:18.828290+0000","last_became_peered":"2023-05-10T01:45:18.828290+0000","last_unstale":"2023-05-10T01:45:18.828648+0000","last_undegraded":"2023-05-10T01:45:18.828648+0000","last_fullsized":"2023-05-10T01:45:18.828648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805834+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830978+0000","last_change":"2023-05-10T01:45:18.830978+0000","last_active":"2023-05-10T01:45:18.830978+0000","last_peered":"2023-05-10T01:45:18.830978+0000","last_clean":"2023-05-10T01:45:18.830978+0000","last_became_active":"2023-05-10T01:45:18.830722+0000","last_became_peered":"2023-05-10T01:45:18.830722+0000","last_unstale":"2023-05-10T01:45:18.830978+0000","last_undegraded":"2023-05-10T01:45:18.830978+0000","last_fullsized":"2023-05-10T01:45:18.830978+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807066+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819989+0000","last_change":"2023-05-10T01:45:18.819989+0000","last_active":"2023-05-10T01:45:18.819989+0000","last_peered":"2023-05-10T01:45:18.819989+0000","last_clean":"2023-05-10T01:45:18.819989+0000","last_became_active":"2023-05-10T01:45:18.819433+0000","last_became_peered":"2023-05-10T01:45:18.819433+0000","last_unstale":"2023-05-10T01:45:18.819989+0000","last_undegraded":"2023-05-10T01:45:18.819989+0000","last_fullsized":"2023-05-10T01:45:18.819989+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810625+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828193+0000","last_change":"2023-05-10T01:45:18.828193+0000","last_active":"2023-05-10T01:45:18.828193+0000","last_peered":"2023-05-10T01:45:18.828193+0000","last_clean":"2023-05-10T01:45:18.828193+0000","last_became_active":"2023-05-10T01:45:18.827891+0000","last_became_peered":"2023-05-10T01:45:18.827891+0000","last_unstale":"2023-05-10T01:45:18.828193+0000","last_undegraded":"2023-05-10T01:45:18.828193+0000","last_fullsized":"2023-05-10T01:45:18.828193+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806107+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823841+0000","last_change":"2023-05-10T01:45:18.823841+0000","last_active":"2023-05-10T01:45:18.823841+0000","last_peered":"2023-05-10T01:45:18.823841+0000","last_clean":"2023-05-10T01:45:18.823841+0000","last_became_active":"2023-05-10T01:45:18.823575+0000","last_became_peered":"2023-05-10T01:45:18.823575+0000","last_unstale":"2023-05-10T01:45:18.823841+0000","last_undegraded":"2023-05-10T01:45:18.823841+0000","last_fullsized":"2023-05-10T01:45:18.823841+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811940+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814752+0000","last_change":"2023-05-10T01:45:18.814752+0000","last_active":"2023-05-10T01:45:18.814752+0000","last_peered":"2023-05-10T01:45:18.814752+0000","last_clean":"2023-05-10T01:45:18.814752+0000","last_became_active":"2023-05-10T01:45:18.814470+0000","last_became_peered":"2023-05-10T01:45:18.814470+0000","last_unstale":"2023-05-10T01:45:18.814752+0000","last_undegraded":"2023-05-10T01:45:18.814752+0000","last_fullsized":"2023-05-10T01:45:18.814752+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810271+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828344+0000","last_change":"2023-05-10T01:45:18.828344+0000","last_active":"2023-05-10T01:45:18.828344+0000","last_peered":"2023-05-10T01:45:18.828344+0000","last_clean":"2023-05-10T01:45:18.828344+0000","last_became_active":"2023-05-10T01:45:18.828023+0000","last_became_peered":"2023-05-10T01:45:18.828023+0000","last_unstale":"2023-05-10T01:45:18.828344+0000","last_undegraded":"2023-05-10T01:45:18.828344+0000","last_fullsized":"2023-05-10T01:45:18.828344+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804826+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828387+0000","last_change":"2023-05-10T01:45:18.828387+0000","last_active":"2023-05-10T01:45:18.828387+0000","last_peered":"2023-05-10T01:45:18.828387+0000","last_clean":"2023-05-10T01:45:18.828387+0000","last_became_active":"2023-05-10T01:45:18.828060+0000","last_became_peered":"2023-05-10T01:45:18.828060+0000","last_unstale":"2023-05-10T01:45:18.828387+0000","last_undegraded":"2023-05-10T01:45:18.828387+0000","last_fullsized":"2023-05-10T01:45:18.828387+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807374+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826254+0000","last_change":"2023-05-10T01:45:18.826254+0000","last_active":"2023-05-10T01:45:18.826254+0000","last_peered":"2023-05-10T01:45:18.826254+0000","last_clean":"2023-05-10T01:45:18.826254+0000","last_became_active":"2023-05-10T01:45:18.825958+0000","last_became_peered":"2023-05-10T01:45:18.825958+0000","last_unstale":"2023-05-10T01:45:18.826254+0000","last_undegraded":"2023-05-10T01:45:18.826254+0000","last_fullsized":"2023-05-10T01:45:18.826254+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823399+0000","last_change":"2023-05-10T01:45:18.823399+0000","last_active":"2023-05-10T01:45:18.823399+0000","last_peered":"2023-05-10T01:45:18.823399+0000","last_clean":"2023-05-10T01:45:18.823399+0000","last_became_active":"2023-05-10T01:45:18.823098+0000","last_became_peered":"2023-05-10T01:45:18.823098+0000","last_unstale":"2023-05-10T01:45:18.823399+0000","last_undegraded":"2023-05-10T01:45:18.823399+0000","last_fullsized":"2023-05-10T01:45:18.823399+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817703+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828746+0000","last_change":"2023-05-10T01:45:18.828746+0000","last_active":"2023-05-10T01:45:18.828746+0000","last_peered":"2023-05-10T01:45:18.828746+0000","last_clean":"2023-05-10T01:45:18.828746+0000","last_became_active":"2023-05-10T01:45:18.828489+0000","last_became_peered":"2023-05-10T01:45:18.828489+0000","last_unstale":"2023-05-10T01:45:18.828746+0000","last_undegraded":"2023-05-10T01:45:18.828746+0000","last_fullsized":"2023-05-10T01:45:18.828746+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809532+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821338+0000","last_change":"2023-05-10T01:45:18.821338+0000","last_active":"2023-05-10T01:45:18.821338+0000","last_peered":"2023-05-10T01:45:18.821338+0000","last_clean":"2023-05-10T01:45:18.821338+0000","last_became_active":"2023-05-10T01:45:18.821075+0000","last_became_peered":"2023-05-10T01:45:18.821075+0000","last_unstale":"2023-05-10T01:45:18.821338+0000","last_undegraded":"2023-05-10T01:45:18.821338+0000","last_fullsized":"2023-05-10T01:45:18.821338+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809877+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817485+0000","last_change":"2023-05-10T01:45:18.817485+0000","last_active":"2023-05-10T01:45:18.817485+0000","last_peered":"2023-05-10T01:45:18.817485+0000","last_clean":"2023-05-10T01:45:18.817485+0000","last_became_active":"2023-05-10T01:45:18.817189+0000","last_became_peered":"2023-05-10T01:45:18.817189+0000","last_unstale":"2023-05-10T01:45:18.817485+0000","last_undegraded":"2023-05-10T01:45:18.817485+0000","last_fullsized":"2023-05-10T01:45:18.817485+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827114+0000","last_change":"2023-05-10T01:45:18.827114+0000","last_active":"2023-05-10T01:45:18.827114+0000","last_peered":"2023-05-10T01:45:18.827114+0000","last_clean":"2023-05-10T01:45:18.827114+0000","last_became_active":"2023-05-10T01:45:18.826814+0000","last_became_peered":"2023-05-10T01:45:18.826814+0000","last_unstale":"2023-05-10T01:45:18.827114+0000","last_undegraded":"2023-05-10T01:45:18.827114+0000","last_fullsized":"2023-05-10T01:45:18.827114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822470+0000","last_change":"2023-05-10T01:45:18.822470+0000","last_active":"2023-05-10T01:45:18.822470+0000","last_peered":"2023-05-10T01:45:18.822470+0000","last_clean":"2023-05-10T01:45:18.822470+0000","last_became_active":"2023-05-10T01:45:18.822174+0000","last_became_peered":"2023-05-10T01:45:18.822174+0000","last_unstale":"2023-05-10T01:45:18.822470+0000","last_undegraded":"2023-05-10T01:45:18.822470+0000","last_fullsized":"2023-05-10T01:45:18.822470+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810166+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830987+0000","last_change":"2023-05-10T01:45:18.830987+0000","last_active":"2023-05-10T01:45:18.830987+0000","last_peered":"2023-05-10T01:45:18.830987+0000","last_clean":"2023-05-10T01:45:18.830987+0000","last_became_active":"2023-05-10T01:45:18.830748+0000","last_became_peered":"2023-05-10T01:45:18.830748+0000","last_unstale":"2023-05-10T01:45:18.830987+0000","last_undegraded":"2023-05-10T01:45:18.830987+0000","last_fullsized":"2023-05-10T01:45:18.830987+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811397+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827522+0000","last_change":"2023-05-10T01:45:18.827522+0000","last_active":"2023-05-10T01:45:18.827522+0000","last_peered":"2023-05-10T01:45:18.827522+0000","last_clean":"2023-05-10T01:45:18.827522+0000","last_became_active":"2023-05-10T01:45:18.827210+0000","last_became_peered":"2023-05-10T01:45:18.827210+0000","last_unstale":"2023-05-10T01:45:18.827522+0000","last_undegraded":"2023-05-10T01:45:18.827522+0000","last_fullsized":"2023-05-10T01:45:18.827522+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807193+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822866+0000","last_change":"2023-05-10T01:45:18.822866+0000","last_active":"2023-05-10T01:45:18.822866+0000","last_peered":"2023-05-10T01:45:18.822866+0000","last_clean":"2023-05-10T01:45:18.822866+0000","last_became_active":"2023-05-10T01:45:18.822558+0000","last_became_peered":"2023-05-10T01:45:18.822558+0000","last_unstale":"2023-05-10T01:45:18.822866+0000","last_undegraded":"2023-05-10T01:45:18.822866+0000","last_fullsized":"2023-05-10T01:45:18.822866+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810573+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819802+0000","last_change":"2023-05-10T01:45:18.819802+0000","last_active":"2023-05-10T01:45:18.819802+0000","last_peered":"2023-05-10T01:45:18.819802+0000","last_clean":"2023-05-10T01:45:18.819802+0000","last_became_active":"2023-05-10T01:45:18.819051+0000","last_became_peered":"2023-05-10T01:45:18.819051+0000","last_unstale":"2023-05-10T01:45:18.819802+0000","last_undegraded":"2023-05-10T01:45:18.819802+0000","last_fullsized":"2023-05-10T01:45:18.819802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809902+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823375+0000","last_change":"2023-05-10T01:45:18.823375+0000","last_active":"2023-05-10T01:45:18.823375+0000","last_peered":"2023-05-10T01:45:18.823375+0000","last_clean":"2023-05-10T01:45:18.823375+0000","last_became_active":"2023-05-10T01:45:18.822638+0000","last_became_peered":"2023-05-10T01:45:18.822638+0000","last_unstale":"2023-05-10T01:45:18.823375+0000","last_undegraded":"2023-05-10T01:45:18.823375+0000","last_fullsized":"2023-05-10T01:45:18.823375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812577+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819534+0000","last_change":"2023-05-10T01:45:18.819534+0000","last_active":"2023-05-10T01:45:18.819534+0000","last_peered":"2023-05-10T01:45:18.819534+0000","last_clean":"2023-05-10T01:45:18.819534+0000","last_became_active":"2023-05-10T01:45:18.818481+0000","last_became_peered":"2023-05-10T01:45:18.818481+0000","last_unstale":"2023-05-10T01:45:18.819534+0000","last_undegraded":"2023-05-10T01:45:18.819534+0000","last_fullsized":"2023-05-10T01:45:18.819534+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805778+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827299+0000","last_change":"2023-05-10T01:45:18.827299+0000","last_active":"2023-05-10T01:45:18.827299+0000","last_peered":"2023-05-10T01:45:18.827299+0000","last_clean":"2023-05-10T01:45:18.827299+0000","last_became_active":"2023-05-10T01:45:18.827012+0000","last_became_peered":"2023-05-10T01:45:18.827012+0000","last_unstale":"2023-05-10T01:45:18.827299+0000","last_undegraded":"2023-05-10T01:45:18.827299+0000","last_fullsized":"2023-05-10T01:45:18.827299+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810934+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823876+0000","last_change":"2023-05-10T01:45:18.823876+0000","last_active":"2023-05-10T01:45:18.823876+0000","last_peered":"2023-05-10T01:45:18.823876+0000","last_clean":"2023-05-10T01:45:18.823876+0000","last_became_active":"2023-05-10T01:45:18.823602+0000","last_became_peered":"2023-05-10T01:45:18.823602+0000","last_unstale":"2023-05-10T01:45:18.823876+0000","last_undegraded":"2023-05-10T01:45:18.823876+0000","last_fullsized":"2023-05-10T01:45:18.823876+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814943+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819295+0000","last_change":"2023-05-10T01:45:18.819295+0000","last_active":"2023-05-10T01:45:18.819295+0000","last_peered":"2023-05-10T01:45:18.819295+0000","last_clean":"2023-05-10T01:45:18.819295+0000","last_became_active":"2023-05-10T01:45:18.819022+0000","last_became_peered":"2023-05-10T01:45:18.819022+0000","last_unstale":"2023-05-10T01:45:18.819295+0000","last_undegraded":"2023-05-10T01:45:18.819295+0000","last_fullsized":"2023-05-10T01:45:18.819295+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805472+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820590+0000","last_change":"2023-05-10T01:45:18.820590+0000","last_active":"2023-05-10T01:45:18.820590+0000","last_peered":"2023-05-10T01:45:18.820590+0000","last_clean":"2023-05-10T01:45:18.820590+0000","last_became_active":"2023-05-10T01:45:18.818788+0000","last_became_peered":"2023-05-10T01:45:18.818788+0000","last_unstale":"2023-05-10T01:45:18.820590+0000","last_undegraded":"2023-05-10T01:45:18.820590+0000","last_fullsized":"2023-05-10T01:45:18.820590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816454+0000","last_change":"2023-05-10T01:45:18.816454+0000","last_active":"2023-05-10T01:45:18.816454+0000","last_peered":"2023-05-10T01:45:18.816454+0000","last_clean":"2023-05-10T01:45:18.816454+0000","last_became_active":"2023-05-10T01:45:18.816162+0000","last_became_peered":"2023-05-10T01:45:18.816162+0000","last_unstale":"2023-05-10T01:45:18.816454+0000","last_undegraded":"2023-05-10T01:45:18.816454+0000","last_fullsized":"2023-05-10T01:45:18.816454+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817272+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825786+0000","last_change":"2023-05-10T01:45:18.825786+0000","last_active":"2023-05-10T01:45:18.825786+0000","last_peered":"2023-05-10T01:45:18.825786+0000","last_clean":"2023-05-10T01:45:18.825786+0000","last_became_active":"2023-05-10T01:45:18.825527+0000","last_became_peered":"2023-05-10T01:45:18.825527+0000","last_unstale":"2023-05-10T01:45:18.825786+0000","last_undegraded":"2023-05-10T01:45:18.825786+0000","last_fullsized":"2023-05-10T01:45:18.825786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808691+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824463+0000","last_change":"2023-05-10T01:45:18.824463+0000","last_active":"2023-05-10T01:45:18.824463+0000","last_peered":"2023-05-10T01:45:18.824463+0000","last_clean":"2023-05-10T01:45:18.824463+0000","last_became_active":"2023-05-10T01:45:18.824185+0000","last_became_peered":"2023-05-10T01:45:18.824185+0000","last_unstale":"2023-05-10T01:45:18.824463+0000","last_undegraded":"2023-05-10T01:45:18.824463+0000","last_fullsized":"2023-05-10T01:45:18.824463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805624+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825086+0000","last_change":"2023-05-10T01:45:18.825086+0000","last_active":"2023-05-10T01:45:18.825086+0000","last_peered":"2023-05-10T01:45:18.825086+0000","last_clean":"2023-05-10T01:45:18.825086+0000","last_became_active":"2023-05-10T01:45:18.823740+0000","last_became_peered":"2023-05-10T01:45:18.823740+0000","last_unstale":"2023-05-10T01:45:18.825086+0000","last_undegraded":"2023-05-10T01:45:18.825086+0000","last_fullsized":"2023-05-10T01:45:18.825086+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806775+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816038+0000","last_change":"2023-05-10T01:45:18.816038+0000","last_active":"2023-05-10T01:45:18.816038+0000","last_peered":"2023-05-10T01:45:18.816038+0000","last_clean":"2023-05-10T01:45:18.816038+0000","last_became_active":"2023-05-10T01:45:18.815608+0000","last_became_peered":"2023-05-10T01:45:18.815608+0000","last_unstale":"2023-05-10T01:45:18.816038+0000","last_undegraded":"2023-05-10T01:45:18.816038+0000","last_fullsized":"2023-05-10T01:45:18.816038+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798030+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:17.798030+0000","last_peered":"2023-05-10T01:45:17.798030+0000","last_clean":"2023-05-10T01:45:17.798030+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:17.798030+0000","last_undegraded":"2023-05-10T01:45:17.798030+0000","last_fullsized":"2023-05-10T01:45:17.798030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809441+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820670+0000","last_change":"2023-05-10T01:45:18.820670+0000","last_active":"2023-05-10T01:45:18.820670+0000","last_peered":"2023-05-10T01:45:18.820670+0000","last_clean":"2023-05-10T01:45:18.820670+0000","last_became_active":"2023-05-10T01:45:18.820163+0000","last_became_peered":"2023-05-10T01:45:18.820163+0000","last_unstale":"2023-05-10T01:45:18.820670+0000","last_undegraded":"2023-05-10T01:45:18.820670+0000","last_fullsized":"2023-05-10T01:45:18.820670+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805587+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:17.805587+0000","last_peered":"2023-05-10T01:45:17.805587+0000","last_clean":"2023-05-10T01:45:17.805587+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:17.805587+0000","last_undegraded":"2023-05-10T01:45:17.805587+0000","last_fullsized":"2023-05-10T01:45:17.805587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812134+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824998+0000","last_change":"2023-05-10T01:45:18.824998+0000","last_active":"2023-05-10T01:45:18.824998+0000","last_peered":"2023-05-10T01:45:18.824998+0000","last_clean":"2023-05-10T01:45:18.824998+0000","last_became_active":"2023-05-10T01:45:18.824704+0000","last_became_peered":"2023-05-10T01:45:18.824704+0000","last_unstale":"2023-05-10T01:45:18.824998+0000","last_undegraded":"2023-05-10T01:45:18.824998+0000","last_fullsized":"2023-05-10T01:45:18.824998+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.808796+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:17.808796+0000","last_peered":"2023-05-10T01:45:17.808796+0000","last_clean":"2023-05-10T01:45:17.808796+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:17.808796+0000","last_undegraded":"2023-05-10T01:45:17.808796+0000","last_fullsized":"2023-05-10T01:45:17.808796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804968+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819070+0000","last_change":"2023-05-10T01:45:18.819070+0000","last_active":"2023-05-10T01:45:18.819070+0000","last_peered":"2023-05-10T01:45:18.819070+0000","last_clean":"2023-05-10T01:45:18.819070+0000","last_became_active":"2023-05-10T01:45:18.818756+0000","last_became_peered":"2023-05-10T01:45:18.818756+0000","last_unstale":"2023-05-10T01:45:18.819070+0000","last_undegraded":"2023-05-10T01:45:18.819070+0000","last_fullsized":"2023-05-10T01:45:18.819070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805649+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:17.805649+0000","last_peered":"2023-05-10T01:45:17.805649+0000","last_clean":"2023-05-10T01:45:17.805649+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:17.805649+0000","last_undegraded":"2023-05-10T01:45:17.805649+0000","last_fullsized":"2023-05-10T01:45:17.805649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810620+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:17.810620+0000","last_peered":"2023-05-10T01:45:17.810620+0000","last_clean":"2023-05-10T01:45:17.810620+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:17.810620+0000","last_undegraded":"2023-05-10T01:45:17.810620+0000","last_fullsized":"2023-05-10T01:45:17.810620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806766+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820200+0000","last_change":"2023-05-10T01:45:18.820200+0000","last_active":"2023-05-10T01:45:18.820200+0000","last_peered":"2023-05-10T01:45:18.820200+0000","last_clean":"2023-05-10T01:45:18.820200+0000","last_became_active":"2023-05-10T01:45:18.819546+0000","last_became_peered":"2023-05-10T01:45:18.819546+0000","last_unstale":"2023-05-10T01:45:18.820200+0000","last_undegraded":"2023-05-10T01:45:18.820200+0000","last_fullsized":"2023-05-10T01:45:18.820200+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810678+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:17.810678+0000","last_peered":"2023-05-10T01:45:17.810678+0000","last_clean":"2023-05-10T01:45:17.810678+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:17.810678+0000","last_undegraded":"2023-05-10T01:45:17.810678+0000","last_fullsized":"2023-05-10T01:45:17.810678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811712+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826710+0000","last_change":"2023-05-10T01:45:18.826710+0000","last_active":"2023-05-10T01:45:18.826710+0000","last_peered":"2023-05-10T01:45:18.826710+0000","last_clean":"2023-05-10T01:45:18.826710+0000","last_became_active":"2023-05-10T01:45:18.826416+0000","last_became_peered":"2023-05-10T01:45:18.826416+0000","last_unstale":"2023-05-10T01:45:18.826710+0000","last_undegraded":"2023-05-10T01:45:18.826710+0000","last_fullsized":"2023-05-10T01:45:18.826710+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810515+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:17.810515+0000","last_peered":"2023-05-10T01:45:17.810515+0000","last_clean":"2023-05-10T01:45:17.810515+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:17.810515+0000","last_undegraded":"2023-05-10T01:45:17.810515+0000","last_fullsized":"2023-05-10T01:45:17.810515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805892+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825979+0000","last_change":"2023-05-10T01:45:18.825979+0000","last_active":"2023-05-10T01:45:18.825979+0000","last_peered":"2023-05-10T01:45:18.825979+0000","last_clean":"2023-05-10T01:45:18.825979+0000","last_became_active":"2023-05-10T01:45:18.825702+0000","last_became_peered":"2023-05-10T01:45:18.825702+0000","last_unstale":"2023-05-10T01:45:18.825979+0000","last_undegraded":"2023-05-10T01:45:18.825979+0000","last_fullsized":"2023-05-10T01:45:18.825979+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798039+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:17.798039+0000","last_peered":"2023-05-10T01:45:17.798039+0000","last_clean":"2023-05-10T01:45:17.798039+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:17.798039+0000","last_undegraded":"2023-05-10T01:45:17.798039+0000","last_fullsized":"2023-05-10T01:45:17.798039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812157+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820578+0000","last_change":"2023-05-10T01:45:18.820578+0000","last_active":"2023-05-10T01:45:18.820578+0000","last_peered":"2023-05-10T01:45:18.820578+0000","last_clean":"2023-05-10T01:45:18.820578+0000","last_became_active":"2023-05-10T01:45:18.820022+0000","last_became_peered":"2023-05-10T01:45:18.820022+0000","last_unstale":"2023-05-10T01:45:18.820578+0000","last_undegraded":"2023-05-10T01:45:18.820578+0000","last_fullsized":"2023-05-10T01:45:18.820578+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.803642+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:17.803642+0000","last_peered":"2023-05-10T01:45:17.803642+0000","last_clean":"2023-05-10T01:45:17.803642+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:17.803642+0000","last_undegraded":"2023-05-10T01:45:17.803642+0000","last_fullsized":"2023-05-10T01:45:17.803642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20768,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351072,"statfs":{"total":96636764160,"available":96615497728,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.375}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20384,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18304,"kb_avail":94351456,"statfs":{"total":96636764160,"available":96615890944,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18743296},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.77300000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.627}]},{"osd":1,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":1.208,"15min":1.208},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":1.284},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.72599999999999998,"15min":1.3360000000000001},"last":0.501},{"interface":"front","average":{"1min":0.5,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":1.3620000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.3120000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.995,"15min":1.2729999999999999},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575266,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24096,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94347744,"statfs":{"total":96636764160,"available":96612089856,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":1.1200000000000001,"15min":1.357},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.90900000000000003,"5min":1.171,"15min":1.226},"last":0.75}]},{"osd":5,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.872,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.008,"15min":1.008},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":1.1830000000000001,"15min":1.403},"last":0.72699999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575266,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24684,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":22592,"kb_avail":94347156,"statfs":{"total":96636764160,"available":96611487744,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23134208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.37}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.871}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.878},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575266,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25760,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94346080,"statfs":{"total":96636764160,"available":96610385920,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.314}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575266,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":30528,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31260672},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.45800000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.69799999999999995}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20588,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351252,"statfs":{"total":96636764160,"available":96615682048,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.497}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.442}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23584,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":21504,"kb_avail":94348256,"statfs":{"total":96636764160,"available":96612614144,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22020096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.80400000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.79500000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.75,"15min":0.88600000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.624,"15min":0.628},"min":{"1min":0.441,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.66600000000000004,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.65600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.75700000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.55200000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.63}]},{"osd":6,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.60999999999999999,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":0.76000000000000001,"15min":0.89200000000000002},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:23.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.744+0000 7f13a1533700 1 Processor -- start 2023-05-10T01:45:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.744+0000 7f13a1533700 1 -- start start 2023-05-10T01:45:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f13a1533700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f139c154160 0x7f139c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f13a1533700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c069da0 0x7f139c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f13a1533700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0c0650 con 0x7f139c154540 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f13a1533700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0c1af0 con 0x7f139c154160 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f13a1533700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0bfd20 con 0x7f139c069da0 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f139affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f139c154160 0x7f139c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f139affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f139c154160 0x7f139c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42388/0 (socket says 172.21.15.52:42388) 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.745+0000 7f139affd700 1 -- 172.21.15.52:0/1487151948 learned_addr learned my addr 172.21.15.52:0/1487151948 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139b7fe700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c069da0 0x7f139c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139affd700 1 -- 172.21.15.52:0/1487151948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c069da0 msgr2=0x7f139c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139affd700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c069da0 0x7f139c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139affd700 1 -- 172.21.15.52:0/1487151948 >> v1:172.21.15.172:6789/0 conn(0x7f139c154540 legacy=0x7f139c069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139affd700 1 -- 172.21.15.52:0/1487151948 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0c0000 con 0x7f139c154160 2023-05-10T01:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f139affd700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c154160 0x7f139c0c5c60 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f1394006fd0 tx=0x7f13940090f0).ready entity=mon.0 client_cookie=689d695d4a6cbf6f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f1399ffb700 1 -- 172.21.15.52:0/1487151948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400b600 con 0x7f139c154160 2023-05-10T01:45:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f1399ffb700 1 -- 172.21.15.52:0/1487151948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400b760 con 0x7f139c154160 2023-05-10T01:45:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f1399ffb700 1 -- 172.21.15.52:0/1487151948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400bb00 con 0x7f139c154160 2023-05-10T01:45:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f13a1533700 1 -- 172.21.15.52:0/1487151948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c154160 msgr2=0x7f139c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.746+0000 7f13a1533700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c154160 0x7f139c0c5c60 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f1394006fd0 tx=0x7f13940090f0).stop 2023-05-10T01:45:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 -- 172.21.15.52:0/1487151948 shutdown_connections 2023-05-10T01:45:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c069da0 0x7f139c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 --2- 172.21.15.52:0/1487151948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c154160 0x7f139c0c5c60 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 -- 172.21.15.52:0/1487151948 >> 172.21.15.52:0/1487151948 conn(0x7f139c0cb6f0 msgr2=0x7f139c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 -- 172.21.15.52:0/1487151948 shutdown_connections 2023-05-10T01:45:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.747+0000 7f13a1533700 1 -- 172.21.15.52:0/1487151948 wait complete. 2023-05-10T01:45:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.748+0000 7f13a1533700 1 Processor -- start 2023-05-10T01:45:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.748+0000 7f13a1533700 1 -- start start 2023-05-10T01:45:23.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f139c154160 0x7f139c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 0x7f139c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c31c0 con 0x7f139c069da0 2023-05-10T01:45:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c44c0 con 0x7f139c154160 2023-05-10T01:45:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c38b0 con 0x7f139c154540 2023-05-10T01:45:23.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42394/0 (socket says 172.21.15.52:42394) 2023-05-10T01:45:23.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 -- 172.21.15.52:0/2765699886 learned_addr learned my addr 172.21.15.52:0/2765699886 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:23.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139a7fc700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f139c154160 0x7f139c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139b7fe700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 0x7f139c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 -- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 msgr2=0x7f139c147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 0x7f139c147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 -- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f139c154160 msgr2=0x7f139c145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f139c154160 0x7f139c145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 -- 172.21.15.52:0/2765699886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009370 con 0x7f139c069da0 2023-05-10T01:45:23.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139b7fe700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 0x7f139c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:23.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f139affd700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f139c083050 tx=0x7f1394017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400bec0 con 0x7f139c069da0 2023-05-10T01:45:23.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394006930 con 0x7f139c069da0 2023-05-10T01:45:23.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0c3b90 con 0x7f139c069da0 2023-05-10T01:45:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400bae0 con 0x7f139c069da0 2023-05-10T01:45:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.749+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c0c4150 con 0x7f139c069da0 2023-05-10T01:45:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.750+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c0666b0 con 0x7f139c069da0 2023-05-10T01:45:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.751+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f139400f070 con 0x7f139c069da0 2023-05-10T01:45:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.751+0000 7f1392ffd700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 0x7f1380061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:23.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.751+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f139407b850 con 0x7f139c069da0 2023-05-10T01:45:23.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.751+0000 7f139a7fc700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 0x7f1380061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:23.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.752+0000 7f139a7fc700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 0x7f1380061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f139c154920 tx=0x7f1384007d40).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:23.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.755+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f139404cd80 con 0x7f139c069da0 2023-05-10T01:45:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.926+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f139c06c340 con 0x7f138005ed60 2023-05-10T01:45:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.936+0000 7f1392ffd700 1 -- 172.21.15.52:0/2765699886 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358733 (secure 0 0 0) 0x7f139c06c340 con 0x7f138005ed60 2023-05-10T01:45:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 msgr2=0x7f1380061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 0x7f1380061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f139c154920 tx=0x7f1384007d40).stop 2023-05-10T01:45:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 msgr2=0x7f139c0c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f139c083050 tx=0x7f1394017000).stop 2023-05-10T01:45:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 shutdown_connections 2023-05-10T01:45:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f138005ed60 0x7f1380061220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f139c154540 0x7f139c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c069da0 0x7f139c0c4950 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 --2- 172.21.15.52:0/2765699886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f139c154160 0x7f139c145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 >> 172.21.15.52:0/2765699886 conn(0x7f139c0cb6f0 msgr2=0x7f139c0abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 shutdown_connections 2023-05-10T01:45:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:23.940+0000 7f13a1533700 1 -- 172.21.15.52:0/2765699886 wait complete. 2023-05-10T01:45:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:23.955 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:45:21.949302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":192472,"kb_used_data":16600,"kb_used_omap":0,"kb_used_meta":175808,"kb_avail":754782248,"statfs":{"total":773094113280,"available":772897021952,"internally_reserved":0,"allocated":16998400,"data_stored":8789894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":180027392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27877,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.224551"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813640+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818402+0000","last_change":"2023-05-10T01:45:18.818402+0000","last_active":"2023-05-10T01:45:18.818402+0000","last_peered":"2023-05-10T01:45:18.818402+0000","last_clean":"2023-05-10T01:45:18.818402+0000","last_became_active":"2023-05-10T01:45:18.818138+0000","last_became_peered":"2023-05-10T01:45:18.818138+0000","last_unstale":"2023-05-10T01:45:18.818402+0000","last_undegraded":"2023-05-10T01:45:18.818402+0000","last_fullsized":"2023-05-10T01:45:18.818402+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810742+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814168+0000","last_change":"2023-05-10T01:45:18.814168+0000","last_active":"2023-05-10T01:45:18.814168+0000","last_peered":"2023-05-10T01:45:18.814168+0000","last_clean":"2023-05-10T01:45:18.814168+0000","last_became_active":"2023-05-10T01:45:18.813893+0000","last_became_peered":"2023-05-10T01:45:18.813893+0000","last_unstale":"2023-05-10T01:45:18.814168+0000","last_undegraded":"2023-05-10T01:45:18.814168+0000","last_fullsized":"2023-05-10T01:45:18.814168+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810084+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821662+0000","last_change":"2023-05-10T01:45:18.821662+0000","last_active":"2023-05-10T01:45:18.821662+0000","last_peered":"2023-05-10T01:45:18.821662+0000","last_clean":"2023-05-10T01:45:18.821662+0000","last_became_active":"2023-05-10T01:45:18.821367+0000","last_became_peered":"2023-05-10T01:45:18.821367+0000","last_unstale":"2023-05-10T01:45:18.821662+0000","last_undegraded":"2023-05-10T01:45:18.821662+0000","last_fullsized":"2023-05-10T01:45:18.821662+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814319+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830114+0000","last_change":"2023-05-10T01:45:18.830114+0000","last_active":"2023-05-10T01:45:18.830114+0000","last_peered":"2023-05-10T01:45:18.830114+0000","last_clean":"2023-05-10T01:45:18.830114+0000","last_became_active":"2023-05-10T01:45:18.829808+0000","last_became_peered":"2023-05-10T01:45:18.829808+0000","last_unstale":"2023-05-10T01:45:18.830114+0000","last_undegraded":"2023-05-10T01:45:18.830114+0000","last_fullsized":"2023-05-10T01:45:18.830114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807219+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820192+0000","last_change":"2023-05-10T01:45:18.820192+0000","last_active":"2023-05-10T01:45:18.820192+0000","last_peered":"2023-05-10T01:45:18.820192+0000","last_clean":"2023-05-10T01:45:18.820192+0000","last_became_active":"2023-05-10T01:45:18.819911+0000","last_became_peered":"2023-05-10T01:45:18.819911+0000","last_unstale":"2023-05-10T01:45:18.820192+0000","last_undegraded":"2023-05-10T01:45:18.820192+0000","last_fullsized":"2023-05-10T01:45:18.820192+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814732+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827571+0000","last_change":"2023-05-10T01:45:18.827571+0000","last_active":"2023-05-10T01:45:18.827571+0000","last_peered":"2023-05-10T01:45:18.827571+0000","last_clean":"2023-05-10T01:45:18.827571+0000","last_became_active":"2023-05-10T01:45:18.827216+0000","last_became_peered":"2023-05-10T01:45:18.827216+0000","last_unstale":"2023-05-10T01:45:18.827571+0000","last_undegraded":"2023-05-10T01:45:18.827571+0000","last_fullsized":"2023-05-10T01:45:18.827571+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807614+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823558+0000","last_change":"2023-05-10T01:45:18.823558+0000","last_active":"2023-05-10T01:45:18.823558+0000","last_peered":"2023-05-10T01:45:18.823558+0000","last_clean":"2023-05-10T01:45:18.823558+0000","last_became_active":"2023-05-10T01:45:18.823058+0000","last_became_peered":"2023-05-10T01:45:18.823058+0000","last_unstale":"2023-05-10T01:45:18.823558+0000","last_undegraded":"2023-05-10T01:45:18.823558+0000","last_fullsized":"2023-05-10T01:45:18.823558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811615+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817323+0000","last_change":"2023-05-10T01:45:18.817323+0000","last_active":"2023-05-10T01:45:18.817323+0000","last_peered":"2023-05-10T01:45:18.817323+0000","last_clean":"2023-05-10T01:45:18.817323+0000","last_became_active":"2023-05-10T01:45:18.817030+0000","last_became_peered":"2023-05-10T01:45:18.817030+0000","last_unstale":"2023-05-10T01:45:18.817323+0000","last_undegraded":"2023-05-10T01:45:18.817323+0000","last_fullsized":"2023-05-10T01:45:18.817323+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.816664+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819801+0000","last_change":"2023-05-10T01:45:18.819801+0000","last_active":"2023-05-10T01:45:18.819801+0000","last_peered":"2023-05-10T01:45:18.819801+0000","last_clean":"2023-05-10T01:45:18.819801+0000","last_became_active":"2023-05-10T01:45:18.819525+0000","last_became_peered":"2023-05-10T01:45:18.819525+0000","last_unstale":"2023-05-10T01:45:18.819801+0000","last_undegraded":"2023-05-10T01:45:18.819801+0000","last_fullsized":"2023-05-10T01:45:18.819801+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811410+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826355+0000","last_change":"2023-05-10T01:45:18.826355+0000","last_active":"2023-05-10T01:45:18.826355+0000","last_peered":"2023-05-10T01:45:18.826355+0000","last_clean":"2023-05-10T01:45:18.826355+0000","last_became_active":"2023-05-10T01:45:18.825988+0000","last_became_peered":"2023-05-10T01:45:18.825988+0000","last_unstale":"2023-05-10T01:45:18.826355+0000","last_undegraded":"2023-05-10T01:45:18.826355+0000","last_fullsized":"2023-05-10T01:45:18.826355+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807606+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823529+0000","last_change":"2023-05-10T01:45:18.823529+0000","last_active":"2023-05-10T01:45:18.823529+0000","last_peered":"2023-05-10T01:45:18.823529+0000","last_clean":"2023-05-10T01:45:18.823529+0000","last_became_active":"2023-05-10T01:45:18.823231+0000","last_became_peered":"2023-05-10T01:45:18.823231+0000","last_unstale":"2023-05-10T01:45:18.823529+0000","last_undegraded":"2023-05-10T01:45:18.823529+0000","last_fullsized":"2023-05-10T01:45:18.823529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808049+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824587+0000","last_change":"2023-05-10T01:45:18.824587+0000","last_active":"2023-05-10T01:45:18.824587+0000","last_peered":"2023-05-10T01:45:18.824587+0000","last_clean":"2023-05-10T01:45:18.824587+0000","last_became_active":"2023-05-10T01:45:18.824256+0000","last_became_peered":"2023-05-10T01:45:18.824256+0000","last_unstale":"2023-05-10T01:45:18.824587+0000","last_undegraded":"2023-05-10T01:45:18.824587+0000","last_fullsized":"2023-05-10T01:45:18.824587+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808274+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.818724+0000","last_change":"2023-05-10T01:45:18.818724+0000","last_active":"2023-05-10T01:45:18.818724+0000","last_peered":"2023-05-10T01:45:18.818724+0000","last_clean":"2023-05-10T01:45:18.818724+0000","last_became_active":"2023-05-10T01:45:18.818428+0000","last_became_peered":"2023-05-10T01:45:18.818428+0000","last_unstale":"2023-05-10T01:45:18.818724+0000","last_undegraded":"2023-05-10T01:45:18.818724+0000","last_fullsized":"2023-05-10T01:45:18.818724+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812172+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817675+0000","last_change":"2023-05-10T01:45:18.817675+0000","last_active":"2023-05-10T01:45:18.817675+0000","last_peered":"2023-05-10T01:45:18.817675+0000","last_clean":"2023-05-10T01:45:18.817675+0000","last_became_active":"2023-05-10T01:45:18.817193+0000","last_became_peered":"2023-05-10T01:45:18.817193+0000","last_unstale":"2023-05-10T01:45:18.817675+0000","last_undegraded":"2023-05-10T01:45:18.817675+0000","last_fullsized":"2023-05-10T01:45:18.817675+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814714+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821898+0000","last_change":"2023-05-10T01:45:18.821898+0000","last_active":"2023-05-10T01:45:18.821898+0000","last_peered":"2023-05-10T01:45:18.821898+0000","last_clean":"2023-05-10T01:45:18.821898+0000","last_became_active":"2023-05-10T01:45:18.821629+0000","last_became_peered":"2023-05-10T01:45:18.821629+0000","last_unstale":"2023-05-10T01:45:18.821898+0000","last_undegraded":"2023-05-10T01:45:18.821898+0000","last_fullsized":"2023-05-10T01:45:18.821898+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821558+0000","last_change":"2023-05-10T01:45:18.821558+0000","last_active":"2023-05-10T01:45:18.821558+0000","last_peered":"2023-05-10T01:45:18.821558+0000","last_clean":"2023-05-10T01:45:18.821558+0000","last_became_active":"2023-05-10T01:45:18.821237+0000","last_became_peered":"2023-05-10T01:45:18.821237+0000","last_unstale":"2023-05-10T01:45:18.821558+0000","last_undegraded":"2023-05-10T01:45:18.821558+0000","last_fullsized":"2023-05-10T01:45:18.821558+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806738+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820366+0000","last_change":"2023-05-10T01:45:18.820366+0000","last_active":"2023-05-10T01:45:18.820366+0000","last_peered":"2023-05-10T01:45:18.820366+0000","last_clean":"2023-05-10T01:45:18.820366+0000","last_became_active":"2023-05-10T01:45:18.819939+0000","last_became_peered":"2023-05-10T01:45:18.819939+0000","last_unstale":"2023-05-10T01:45:18.820366+0000","last_undegraded":"2023-05-10T01:45:18.820366+0000","last_fullsized":"2023-05-10T01:45:18.820366+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807942+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820855+0000","last_became_peered":"2023-05-10T01:45:18.820855+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809881+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821215+0000","last_change":"2023-05-10T01:45:18.821215+0000","last_active":"2023-05-10T01:45:18.821215+0000","last_peered":"2023-05-10T01:45:18.821215+0000","last_clean":"2023-05-10T01:45:18.821215+0000","last_became_active":"2023-05-10T01:45:18.820901+0000","last_became_peered":"2023-05-10T01:45:18.820901+0000","last_unstale":"2023-05-10T01:45:18.821215+0000","last_undegraded":"2023-05-10T01:45:18.821215+0000","last_fullsized":"2023-05-10T01:45:18.821215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813156+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819565+0000","last_change":"2023-05-10T01:45:18.819565+0000","last_active":"2023-05-10T01:45:18.819565+0000","last_peered":"2023-05-10T01:45:18.819565+0000","last_clean":"2023-05-10T01:45:18.819565+0000","last_became_active":"2023-05-10T01:45:18.819253+0000","last_became_peered":"2023-05-10T01:45:18.819253+0000","last_unstale":"2023-05-10T01:45:18.819565+0000","last_undegraded":"2023-05-10T01:45:18.819565+0000","last_fullsized":"2023-05-10T01:45:18.819565+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812836+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821115+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:18.821115+0000","last_peered":"2023-05-10T01:45:18.821115+0000","last_clean":"2023-05-10T01:45:18.821115+0000","last_became_active":"2023-05-10T01:45:18.820818+0000","last_became_peered":"2023-05-10T01:45:18.820818+0000","last_unstale":"2023-05-10T01:45:18.821115+0000","last_undegraded":"2023-05-10T01:45:18.821115+0000","last_fullsized":"2023-05-10T01:45:18.821115+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805101+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817483+0000","last_change":"2023-05-10T01:45:18.817483+0000","last_active":"2023-05-10T01:45:18.817483+0000","last_peered":"2023-05-10T01:45:18.817483+0000","last_clean":"2023-05-10T01:45:18.817483+0000","last_became_active":"2023-05-10T01:45:18.816820+0000","last_became_peered":"2023-05-10T01:45:18.816820+0000","last_unstale":"2023-05-10T01:45:18.817483+0000","last_undegraded":"2023-05-10T01:45:18.817483+0000","last_fullsized":"2023-05-10T01:45:18.817483+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808335+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817187+0000","last_change":"2023-05-10T01:45:18.817187+0000","last_active":"2023-05-10T01:45:18.817187+0000","last_peered":"2023-05-10T01:45:18.817187+0000","last_clean":"2023-05-10T01:45:18.817187+0000","last_became_active":"2023-05-10T01:45:18.816332+0000","last_became_peered":"2023-05-10T01:45:18.816332+0000","last_unstale":"2023-05-10T01:45:18.817187+0000","last_undegraded":"2023-05-10T01:45:18.817187+0000","last_fullsized":"2023-05-10T01:45:18.817187+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807453+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826802+0000","last_change":"2023-05-10T01:45:18.826802+0000","last_active":"2023-05-10T01:45:18.826802+0000","last_peered":"2023-05-10T01:45:18.826802+0000","last_clean":"2023-05-10T01:45:18.826802+0000","last_became_active":"2023-05-10T01:45:18.825995+0000","last_became_peered":"2023-05-10T01:45:18.825995+0000","last_unstale":"2023-05-10T01:45:18.826802+0000","last_undegraded":"2023-05-10T01:45:18.826802+0000","last_fullsized":"2023-05-10T01:45:18.826802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808946+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821375+0000","last_change":"2023-05-10T01:45:18.821375+0000","last_active":"2023-05-10T01:45:18.821375+0000","last_peered":"2023-05-10T01:45:18.821375+0000","last_clean":"2023-05-10T01:45:18.821375+0000","last_became_active":"2023-05-10T01:45:18.821091+0000","last_became_peered":"2023-05-10T01:45:18.821091+0000","last_unstale":"2023-05-10T01:45:18.821375+0000","last_undegraded":"2023-05-10T01:45:18.821375+0000","last_fullsized":"2023-05-10T01:45:18.821375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807395+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823164+0000","last_change":"2023-05-10T01:45:18.823164+0000","last_active":"2023-05-10T01:45:18.823164+0000","last_peered":"2023-05-10T01:45:18.823164+0000","last_clean":"2023-05-10T01:45:18.823164+0000","last_became_active":"2023-05-10T01:45:18.820928+0000","last_became_peered":"2023-05-10T01:45:18.820928+0000","last_unstale":"2023-05-10T01:45:18.823164+0000","last_undegraded":"2023-05-10T01:45:18.823164+0000","last_fullsized":"2023-05-10T01:45:18.823164+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.815355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.829455+0000","last_change":"2023-05-10T01:45:18.829455+0000","last_active":"2023-05-10T01:45:18.829455+0000","last_peered":"2023-05-10T01:45:18.829455+0000","last_clean":"2023-05-10T01:45:18.829455+0000","last_became_active":"2023-05-10T01:45:18.829196+0000","last_became_peered":"2023-05-10T01:45:18.829196+0000","last_unstale":"2023-05-10T01:45:18.829455+0000","last_undegraded":"2023-05-10T01:45:18.829455+0000","last_fullsized":"2023-05-10T01:45:18.829455+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.813899+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828648+0000","last_change":"2023-05-10T01:45:18.828648+0000","last_active":"2023-05-10T01:45:18.828648+0000","last_peered":"2023-05-10T01:45:18.828648+0000","last_clean":"2023-05-10T01:45:18.828648+0000","last_became_active":"2023-05-10T01:45:18.828290+0000","last_became_peered":"2023-05-10T01:45:18.828290+0000","last_unstale":"2023-05-10T01:45:18.828648+0000","last_undegraded":"2023-05-10T01:45:18.828648+0000","last_fullsized":"2023-05-10T01:45:18.828648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805834+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830978+0000","last_change":"2023-05-10T01:45:18.830978+0000","last_active":"2023-05-10T01:45:18.830978+0000","last_peered":"2023-05-10T01:45:18.830978+0000","last_clean":"2023-05-10T01:45:18.830978+0000","last_became_active":"2023-05-10T01:45:18.830722+0000","last_became_peered":"2023-05-10T01:45:18.830722+0000","last_unstale":"2023-05-10T01:45:18.830978+0000","last_undegraded":"2023-05-10T01:45:18.830978+0000","last_fullsized":"2023-05-10T01:45:18.830978+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807066+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819989+0000","last_change":"2023-05-10T01:45:18.819989+0000","last_active":"2023-05-10T01:45:18.819989+0000","last_peered":"2023-05-10T01:45:18.819989+0000","last_clean":"2023-05-10T01:45:18.819989+0000","last_became_active":"2023-05-10T01:45:18.819433+0000","last_became_peered":"2023-05-10T01:45:18.819433+0000","last_unstale":"2023-05-10T01:45:18.819989+0000","last_undegraded":"2023-05-10T01:45:18.819989+0000","last_fullsized":"2023-05-10T01:45:18.819989+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810625+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828193+0000","last_change":"2023-05-10T01:45:18.828193+0000","last_active":"2023-05-10T01:45:18.828193+0000","last_peered":"2023-05-10T01:45:18.828193+0000","last_clean":"2023-05-10T01:45:18.828193+0000","last_became_active":"2023-05-10T01:45:18.827891+0000","last_became_peered":"2023-05-10T01:45:18.827891+0000","last_unstale":"2023-05-10T01:45:18.828193+0000","last_undegraded":"2023-05-10T01:45:18.828193+0000","last_fullsized":"2023-05-10T01:45:18.828193+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806107+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823841+0000","last_change":"2023-05-10T01:45:18.823841+0000","last_active":"2023-05-10T01:45:18.823841+0000","last_peered":"2023-05-10T01:45:18.823841+0000","last_clean":"2023-05-10T01:45:18.823841+0000","last_became_active":"2023-05-10T01:45:18.823575+0000","last_became_peered":"2023-05-10T01:45:18.823575+0000","last_unstale":"2023-05-10T01:45:18.823841+0000","last_undegraded":"2023-05-10T01:45:18.823841+0000","last_fullsized":"2023-05-10T01:45:18.823841+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811940+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.814752+0000","last_change":"2023-05-10T01:45:18.814752+0000","last_active":"2023-05-10T01:45:18.814752+0000","last_peered":"2023-05-10T01:45:18.814752+0000","last_clean":"2023-05-10T01:45:18.814752+0000","last_became_active":"2023-05-10T01:45:18.814470+0000","last_became_peered":"2023-05-10T01:45:18.814470+0000","last_unstale":"2023-05-10T01:45:18.814752+0000","last_undegraded":"2023-05-10T01:45:18.814752+0000","last_fullsized":"2023-05-10T01:45:18.814752+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810271+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828344+0000","last_change":"2023-05-10T01:45:18.828344+0000","last_active":"2023-05-10T01:45:18.828344+0000","last_peered":"2023-05-10T01:45:18.828344+0000","last_clean":"2023-05-10T01:45:18.828344+0000","last_became_active":"2023-05-10T01:45:18.828023+0000","last_became_peered":"2023-05-10T01:45:18.828023+0000","last_unstale":"2023-05-10T01:45:18.828344+0000","last_undegraded":"2023-05-10T01:45:18.828344+0000","last_fullsized":"2023-05-10T01:45:18.828344+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804826+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828387+0000","last_change":"2023-05-10T01:45:18.828387+0000","last_active":"2023-05-10T01:45:18.828387+0000","last_peered":"2023-05-10T01:45:18.828387+0000","last_clean":"2023-05-10T01:45:18.828387+0000","last_became_active":"2023-05-10T01:45:18.828060+0000","last_became_peered":"2023-05-10T01:45:18.828060+0000","last_unstale":"2023-05-10T01:45:18.828387+0000","last_undegraded":"2023-05-10T01:45:18.828387+0000","last_fullsized":"2023-05-10T01:45:18.828387+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807374+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826254+0000","last_change":"2023-05-10T01:45:18.826254+0000","last_active":"2023-05-10T01:45:18.826254+0000","last_peered":"2023-05-10T01:45:18.826254+0000","last_clean":"2023-05-10T01:45:18.826254+0000","last_became_active":"2023-05-10T01:45:18.825958+0000","last_became_peered":"2023-05-10T01:45:18.825958+0000","last_unstale":"2023-05-10T01:45:18.826254+0000","last_undegraded":"2023-05-10T01:45:18.826254+0000","last_fullsized":"2023-05-10T01:45:18.826254+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806893+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823399+0000","last_change":"2023-05-10T01:45:18.823399+0000","last_active":"2023-05-10T01:45:18.823399+0000","last_peered":"2023-05-10T01:45:18.823399+0000","last_clean":"2023-05-10T01:45:18.823399+0000","last_became_active":"2023-05-10T01:45:18.823098+0000","last_became_peered":"2023-05-10T01:45:18.823098+0000","last_unstale":"2023-05-10T01:45:18.823399+0000","last_undegraded":"2023-05-10T01:45:18.823399+0000","last_fullsized":"2023-05-10T01:45:18.823399+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817703+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.828746+0000","last_change":"2023-05-10T01:45:18.828746+0000","last_active":"2023-05-10T01:45:18.828746+0000","last_peered":"2023-05-10T01:45:18.828746+0000","last_clean":"2023-05-10T01:45:18.828746+0000","last_became_active":"2023-05-10T01:45:18.828489+0000","last_became_peered":"2023-05-10T01:45:18.828489+0000","last_unstale":"2023-05-10T01:45:18.828746+0000","last_undegraded":"2023-05-10T01:45:18.828746+0000","last_fullsized":"2023-05-10T01:45:18.828746+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809532+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.821338+0000","last_change":"2023-05-10T01:45:18.821338+0000","last_active":"2023-05-10T01:45:18.821338+0000","last_peered":"2023-05-10T01:45:18.821338+0000","last_clean":"2023-05-10T01:45:18.821338+0000","last_became_active":"2023-05-10T01:45:18.821075+0000","last_became_peered":"2023-05-10T01:45:18.821075+0000","last_unstale":"2023-05-10T01:45:18.821338+0000","last_undegraded":"2023-05-10T01:45:18.821338+0000","last_fullsized":"2023-05-10T01:45:18.821338+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809877+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.817485+0000","last_change":"2023-05-10T01:45:18.817485+0000","last_active":"2023-05-10T01:45:18.817485+0000","last_peered":"2023-05-10T01:45:18.817485+0000","last_clean":"2023-05-10T01:45:18.817485+0000","last_became_active":"2023-05-10T01:45:18.817189+0000","last_became_peered":"2023-05-10T01:45:18.817189+0000","last_unstale":"2023-05-10T01:45:18.817485+0000","last_undegraded":"2023-05-10T01:45:18.817485+0000","last_fullsized":"2023-05-10T01:45:18.817485+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827114+0000","last_change":"2023-05-10T01:45:18.827114+0000","last_active":"2023-05-10T01:45:18.827114+0000","last_peered":"2023-05-10T01:45:18.827114+0000","last_clean":"2023-05-10T01:45:18.827114+0000","last_became_active":"2023-05-10T01:45:18.826814+0000","last_became_peered":"2023-05-10T01:45:18.826814+0000","last_unstale":"2023-05-10T01:45:18.827114+0000","last_undegraded":"2023-05-10T01:45:18.827114+0000","last_fullsized":"2023-05-10T01:45:18.827114+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808409+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822470+0000","last_change":"2023-05-10T01:45:18.822470+0000","last_active":"2023-05-10T01:45:18.822470+0000","last_peered":"2023-05-10T01:45:18.822470+0000","last_clean":"2023-05-10T01:45:18.822470+0000","last_became_active":"2023-05-10T01:45:18.822174+0000","last_became_peered":"2023-05-10T01:45:18.822174+0000","last_unstale":"2023-05-10T01:45:18.822470+0000","last_undegraded":"2023-05-10T01:45:18.822470+0000","last_fullsized":"2023-05-10T01:45:18.822470+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810166+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.830987+0000","last_change":"2023-05-10T01:45:18.830987+0000","last_active":"2023-05-10T01:45:18.830987+0000","last_peered":"2023-05-10T01:45:18.830987+0000","last_clean":"2023-05-10T01:45:18.830987+0000","last_became_active":"2023-05-10T01:45:18.830748+0000","last_became_peered":"2023-05-10T01:45:18.830748+0000","last_unstale":"2023-05-10T01:45:18.830987+0000","last_undegraded":"2023-05-10T01:45:18.830987+0000","last_fullsized":"2023-05-10T01:45:18.830987+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811397+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827522+0000","last_change":"2023-05-10T01:45:18.827522+0000","last_active":"2023-05-10T01:45:18.827522+0000","last_peered":"2023-05-10T01:45:18.827522+0000","last_clean":"2023-05-10T01:45:18.827522+0000","last_became_active":"2023-05-10T01:45:18.827210+0000","last_became_peered":"2023-05-10T01:45:18.827210+0000","last_unstale":"2023-05-10T01:45:18.827522+0000","last_undegraded":"2023-05-10T01:45:18.827522+0000","last_fullsized":"2023-05-10T01:45:18.827522+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.807193+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.822866+0000","last_change":"2023-05-10T01:45:18.822866+0000","last_active":"2023-05-10T01:45:18.822866+0000","last_peered":"2023-05-10T01:45:18.822866+0000","last_clean":"2023-05-10T01:45:18.822866+0000","last_became_active":"2023-05-10T01:45:18.822558+0000","last_became_peered":"2023-05-10T01:45:18.822558+0000","last_unstale":"2023-05-10T01:45:18.822866+0000","last_undegraded":"2023-05-10T01:45:18.822866+0000","last_fullsized":"2023-05-10T01:45:18.822866+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810573+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819802+0000","last_change":"2023-05-10T01:45:18.819802+0000","last_active":"2023-05-10T01:45:18.819802+0000","last_peered":"2023-05-10T01:45:18.819802+0000","last_clean":"2023-05-10T01:45:18.819802+0000","last_became_active":"2023-05-10T01:45:18.819051+0000","last_became_peered":"2023-05-10T01:45:18.819051+0000","last_unstale":"2023-05-10T01:45:18.819802+0000","last_undegraded":"2023-05-10T01:45:18.819802+0000","last_fullsized":"2023-05-10T01:45:18.819802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809902+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823375+0000","last_change":"2023-05-10T01:45:18.823375+0000","last_active":"2023-05-10T01:45:18.823375+0000","last_peered":"2023-05-10T01:45:18.823375+0000","last_clean":"2023-05-10T01:45:18.823375+0000","last_became_active":"2023-05-10T01:45:18.822638+0000","last_became_peered":"2023-05-10T01:45:18.822638+0000","last_unstale":"2023-05-10T01:45:18.823375+0000","last_undegraded":"2023-05-10T01:45:18.823375+0000","last_fullsized":"2023-05-10T01:45:18.823375+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812577+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819534+0000","last_change":"2023-05-10T01:45:18.819534+0000","last_active":"2023-05-10T01:45:18.819534+0000","last_peered":"2023-05-10T01:45:18.819534+0000","last_clean":"2023-05-10T01:45:18.819534+0000","last_became_active":"2023-05-10T01:45:18.818481+0000","last_became_peered":"2023-05-10T01:45:18.818481+0000","last_unstale":"2023-05-10T01:45:18.819534+0000","last_undegraded":"2023-05-10T01:45:18.819534+0000","last_fullsized":"2023-05-10T01:45:18.819534+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805778+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.827299+0000","last_change":"2023-05-10T01:45:18.827299+0000","last_active":"2023-05-10T01:45:18.827299+0000","last_peered":"2023-05-10T01:45:18.827299+0000","last_clean":"2023-05-10T01:45:18.827299+0000","last_became_active":"2023-05-10T01:45:18.827012+0000","last_became_peered":"2023-05-10T01:45:18.827012+0000","last_unstale":"2023-05-10T01:45:18.827299+0000","last_undegraded":"2023-05-10T01:45:18.827299+0000","last_fullsized":"2023-05-10T01:45:18.827299+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.810934+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.823876+0000","last_change":"2023-05-10T01:45:18.823876+0000","last_active":"2023-05-10T01:45:18.823876+0000","last_peered":"2023-05-10T01:45:18.823876+0000","last_clean":"2023-05-10T01:45:18.823876+0000","last_became_active":"2023-05-10T01:45:18.823602+0000","last_became_peered":"2023-05-10T01:45:18.823602+0000","last_unstale":"2023-05-10T01:45:18.823876+0000","last_undegraded":"2023-05-10T01:45:18.823876+0000","last_fullsized":"2023-05-10T01:45:18.823876+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.814943+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819295+0000","last_change":"2023-05-10T01:45:18.819295+0000","last_active":"2023-05-10T01:45:18.819295+0000","last_peered":"2023-05-10T01:45:18.819295+0000","last_clean":"2023-05-10T01:45:18.819295+0000","last_became_active":"2023-05-10T01:45:18.819022+0000","last_became_peered":"2023-05-10T01:45:18.819022+0000","last_unstale":"2023-05-10T01:45:18.819295+0000","last_undegraded":"2023-05-10T01:45:18.819295+0000","last_fullsized":"2023-05-10T01:45:18.819295+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805472+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820590+0000","last_change":"2023-05-10T01:45:18.820590+0000","last_active":"2023-05-10T01:45:18.820590+0000","last_peered":"2023-05-10T01:45:18.820590+0000","last_clean":"2023-05-10T01:45:18.820590+0000","last_became_active":"2023-05-10T01:45:18.818788+0000","last_became_peered":"2023-05-10T01:45:18.818788+0000","last_unstale":"2023-05-10T01:45:18.820590+0000","last_undegraded":"2023-05-10T01:45:18.820590+0000","last_fullsized":"2023-05-10T01:45:18.820590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805355+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816454+0000","last_change":"2023-05-10T01:45:18.816454+0000","last_active":"2023-05-10T01:45:18.816454+0000","last_peered":"2023-05-10T01:45:18.816454+0000","last_clean":"2023-05-10T01:45:18.816454+0000","last_became_active":"2023-05-10T01:45:18.816162+0000","last_became_peered":"2023-05-10T01:45:18.816162+0000","last_unstale":"2023-05-10T01:45:18.816454+0000","last_undegraded":"2023-05-10T01:45:18.816454+0000","last_fullsized":"2023-05-10T01:45:18.816454+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.817272+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825786+0000","last_change":"2023-05-10T01:45:18.825786+0000","last_active":"2023-05-10T01:45:18.825786+0000","last_peered":"2023-05-10T01:45:18.825786+0000","last_clean":"2023-05-10T01:45:18.825786+0000","last_became_active":"2023-05-10T01:45:18.825527+0000","last_became_peered":"2023-05-10T01:45:18.825527+0000","last_unstale":"2023-05-10T01:45:18.825786+0000","last_undegraded":"2023-05-10T01:45:18.825786+0000","last_fullsized":"2023-05-10T01:45:18.825786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.808691+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824463+0000","last_change":"2023-05-10T01:45:18.824463+0000","last_active":"2023-05-10T01:45:18.824463+0000","last_peered":"2023-05-10T01:45:18.824463+0000","last_clean":"2023-05-10T01:45:18.824463+0000","last_became_active":"2023-05-10T01:45:18.824185+0000","last_became_peered":"2023-05-10T01:45:18.824185+0000","last_unstale":"2023-05-10T01:45:18.824463+0000","last_undegraded":"2023-05-10T01:45:18.824463+0000","last_fullsized":"2023-05-10T01:45:18.824463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805624+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825086+0000","last_change":"2023-05-10T01:45:18.825086+0000","last_active":"2023-05-10T01:45:18.825086+0000","last_peered":"2023-05-10T01:45:18.825086+0000","last_clean":"2023-05-10T01:45:18.825086+0000","last_became_active":"2023-05-10T01:45:18.823740+0000","last_became_peered":"2023-05-10T01:45:18.823740+0000","last_unstale":"2023-05-10T01:45:18.825086+0000","last_undegraded":"2023-05-10T01:45:18.825086+0000","last_fullsized":"2023-05-10T01:45:18.825086+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806775+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.816038+0000","last_change":"2023-05-10T01:45:18.816038+0000","last_active":"2023-05-10T01:45:18.816038+0000","last_peered":"2023-05-10T01:45:18.816038+0000","last_clean":"2023-05-10T01:45:18.816038+0000","last_became_active":"2023-05-10T01:45:18.815608+0000","last_became_peered":"2023-05-10T01:45:18.815608+0000","last_unstale":"2023-05-10T01:45:18.816038+0000","last_undegraded":"2023-05-10T01:45:18.816038+0000","last_fullsized":"2023-05-10T01:45:18.816038+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798030+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:17.798030+0000","last_peered":"2023-05-10T01:45:17.798030+0000","last_clean":"2023-05-10T01:45:17.798030+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:17.798030+0000","last_undegraded":"2023-05-10T01:45:17.798030+0000","last_fullsized":"2023-05-10T01:45:17.798030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.809441+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820670+0000","last_change":"2023-05-10T01:45:18.820670+0000","last_active":"2023-05-10T01:45:18.820670+0000","last_peered":"2023-05-10T01:45:18.820670+0000","last_clean":"2023-05-10T01:45:18.820670+0000","last_became_active":"2023-05-10T01:45:18.820163+0000","last_became_peered":"2023-05-10T01:45:18.820163+0000","last_unstale":"2023-05-10T01:45:18.820670+0000","last_undegraded":"2023-05-10T01:45:18.820670+0000","last_fullsized":"2023-05-10T01:45:18.820670+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805587+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:17.805587+0000","last_peered":"2023-05-10T01:45:17.805587+0000","last_clean":"2023-05-10T01:45:17.805587+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:17.805587+0000","last_undegraded":"2023-05-10T01:45:17.805587+0000","last_fullsized":"2023-05-10T01:45:17.805587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812134+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.824998+0000","last_change":"2023-05-10T01:45:18.824998+0000","last_active":"2023-05-10T01:45:18.824998+0000","last_peered":"2023-05-10T01:45:18.824998+0000","last_clean":"2023-05-10T01:45:18.824998+0000","last_became_active":"2023-05-10T01:45:18.824704+0000","last_became_peered":"2023-05-10T01:45:18.824704+0000","last_unstale":"2023-05-10T01:45:18.824998+0000","last_undegraded":"2023-05-10T01:45:18.824998+0000","last_fullsized":"2023-05-10T01:45:18.824998+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.808796+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:17.808796+0000","last_peered":"2023-05-10T01:45:17.808796+0000","last_clean":"2023-05-10T01:45:17.808796+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:17.808796+0000","last_undegraded":"2023-05-10T01:45:17.808796+0000","last_fullsized":"2023-05-10T01:45:17.808796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.804968+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.819070+0000","last_change":"2023-05-10T01:45:18.819070+0000","last_active":"2023-05-10T01:45:18.819070+0000","last_peered":"2023-05-10T01:45:18.819070+0000","last_clean":"2023-05-10T01:45:18.819070+0000","last_became_active":"2023-05-10T01:45:18.818756+0000","last_became_peered":"2023-05-10T01:45:18.818756+0000","last_unstale":"2023-05-10T01:45:18.819070+0000","last_undegraded":"2023-05-10T01:45:18.819070+0000","last_fullsized":"2023-05-10T01:45:18.819070+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.805649+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:17.805649+0000","last_peered":"2023-05-10T01:45:17.805649+0000","last_clean":"2023-05-10T01:45:17.805649+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:17.805649+0000","last_undegraded":"2023-05-10T01:45:17.805649+0000","last_fullsized":"2023-05-10T01:45:17.805649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":137,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810620+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:17.810620+0000","last_peered":"2023-05-10T01:45:17.810620+0000","last_clean":"2023-05-10T01:45:17.810620+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:17.810620+0000","last_undegraded":"2023-05-10T01:45:17.810620+0000","last_fullsized":"2023-05-10T01:45:17.810620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.806766+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820200+0000","last_change":"2023-05-10T01:45:18.820200+0000","last_active":"2023-05-10T01:45:18.820200+0000","last_peered":"2023-05-10T01:45:18.820200+0000","last_clean":"2023-05-10T01:45:18.820200+0000","last_became_active":"2023-05-10T01:45:18.819546+0000","last_became_peered":"2023-05-10T01:45:18.819546+0000","last_unstale":"2023-05-10T01:45:18.820200+0000","last_undegraded":"2023-05-10T01:45:18.820200+0000","last_fullsized":"2023-05-10T01:45:18.820200+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810678+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:17.810678+0000","last_peered":"2023-05-10T01:45:17.810678+0000","last_clean":"2023-05-10T01:45:17.810678+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:17.810678+0000","last_undegraded":"2023-05-10T01:45:17.810678+0000","last_fullsized":"2023-05-10T01:45:17.810678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.811712+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.826710+0000","last_change":"2023-05-10T01:45:18.826710+0000","last_active":"2023-05-10T01:45:18.826710+0000","last_peered":"2023-05-10T01:45:18.826710+0000","last_clean":"2023-05-10T01:45:18.826710+0000","last_became_active":"2023-05-10T01:45:18.826416+0000","last_became_peered":"2023-05-10T01:45:18.826416+0000","last_unstale":"2023-05-10T01:45:18.826710+0000","last_undegraded":"2023-05-10T01:45:18.826710+0000","last_fullsized":"2023-05-10T01:45:18.826710+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.810515+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:17.810515+0000","last_peered":"2023-05-10T01:45:17.810515+0000","last_clean":"2023-05-10T01:45:17.810515+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:17.810515+0000","last_undegraded":"2023-05-10T01:45:17.810515+0000","last_fullsized":"2023-05-10T01:45:17.810515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.805892+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.825979+0000","last_change":"2023-05-10T01:45:18.825979+0000","last_active":"2023-05-10T01:45:18.825979+0000","last_peered":"2023-05-10T01:45:18.825979+0000","last_clean":"2023-05-10T01:45:18.825979+0000","last_became_active":"2023-05-10T01:45:18.825702+0000","last_became_peered":"2023-05-10T01:45:18.825702+0000","last_unstale":"2023-05-10T01:45:18.825979+0000","last_undegraded":"2023-05-10T01:45:18.825979+0000","last_fullsized":"2023-05-10T01:45:18.825979+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.798039+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:17.798039+0000","last_peered":"2023-05-10T01:45:17.798039+0000","last_clean":"2023-05-10T01:45:17.798039+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:17.798039+0000","last_undegraded":"2023-05-10T01:45:17.798039+0000","last_fullsized":"2023-05-10T01:45:17.798039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-05-10T01:45:18.796315+0000","last_change":"2023-05-10T01:45:18.812157+0000","last_active":"2023-05-10T01:45:18.796315+0000","last_peered":"2023-05-10T01:45:18.796315+0000","last_clean":"2023-05-10T01:45:18.796315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T01:45:18.796315+0000","last_undegraded":"2023-05-10T01:45:18.796315+0000","last_fullsized":"2023-05-10T01:45:18.796315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-05-10T01:45:18.820578+0000","last_change":"2023-05-10T01:45:18.820578+0000","last_active":"2023-05-10T01:45:18.820578+0000","last_peered":"2023-05-10T01:45:18.820578+0000","last_clean":"2023-05-10T01:45:18.820578+0000","last_became_active":"2023-05-10T01:45:18.820022+0000","last_became_peered":"2023-05-10T01:45:18.820022+0000","last_unstale":"2023-05-10T01:45:18.820578+0000","last_undegraded":"2023-05-10T01:45:18.820578+0000","last_fullsized":"2023-05-10T01:45:18.820578+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-05-10T01:45:17.803642+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:17.803642+0000","last_peered":"2023-05-10T01:45:17.803642+0000","last_clean":"2023-05-10T01:45:17.803642+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:17.803642+0000","last_undegraded":"2023-05-10T01:45:17.803642+0000","last_fullsized":"2023-05-10T01:45:17.803642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575267,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20768,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94351072,"statfs":{"total":96636764160,"available":96615497728,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.375}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20384,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":18304,"kb_avail":94351456,"statfs":{"total":96636764160,"available":96615890944,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18743296},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.77300000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.627}]},{"osd":1,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":1.208,"15min":1.208},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":1.284},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.72599999999999998,"15min":1.3360000000000001},"last":0.501},{"interface":"front","average":{"1min":0.5,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":1.3620000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.3120000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.995,"15min":1.2729999999999999},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575266,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24096,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94347744,"statfs":{"total":96636764160,"available":96612089856,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":1.1200000000000001,"15min":1.357},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.90900000000000003,"5min":1.171,"15min":1.226},"last":0.75}]},{"osd":5,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.872,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.008,"15min":1.008},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":1.1830000000000001,"15min":1.403},"last":0.72699999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575266,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24684,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":22592,"kb_avail":94347156,"statfs":{"total":96636764160,"available":96611487744,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23134208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.37}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33300000000000002}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.871}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.878},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575266,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25760,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94346080,"statfs":{"total":96636764160,"available":96610385920,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32700000000000001}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.314}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575266,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":30528,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31260672},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.45800000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.69799999999999995}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575266,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20588,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351252,"statfs":{"total":96636764160,"available":96615682048,"internally_reserved":0,"allocated":2134016,"data_stored":1103965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.497}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.442}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575268,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23584,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":21504,"kb_avail":94348256,"statfs":{"total":96636764160,"available":96612614144,"internally_reserved":0,"allocated":2121728,"data_stored":1096994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22020096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.80400000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.79500000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.75,"15min":0.88600000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.624,"15min":0.628},"min":{"1min":0.441,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.66600000000000004,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.65600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.75700000000000001}]},{"osd":4,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.55200000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.63}]},{"osd":6,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.60999999999999999,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":0.76000000000000001,"15min":0.89200000000000002},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:23.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-05-10T01:45:23.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.813640+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:23.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-05-10T01:45:23.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810742+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-05-10T01:45:23.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810084+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-05-10T01:45:23.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.814319+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-05-10T01:45:23.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807219+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:23.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-05-10T01:45:23.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.814732+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-05-10T01:45:23.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807614+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-05-10T01:45:23.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.811615+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-05-10T01:45:23.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.816664+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:23.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-05-10T01:45:23.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.811410+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:23.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-05-10T01:45:23.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807606+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-05-10T01:45:23.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808049+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-05-10T01:45:23.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808274+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-05-10T01:45:23.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.812172+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-05-10T01:45:23.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.814714+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:23.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-05-10T01:45:23.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807893+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-05-10T01:45:23.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.806738+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:45:23.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-05-10T01:45:23.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807942+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:23.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-05-10T01:45:23.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.809881+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:23.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-05-10T01:45:23.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.813156+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:23.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-05-10T01:45:23.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.812836+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:23.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-05-10T01:45:23.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805101+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:23.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-05-10T01:45:23.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808335+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-05-10T01:45:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807453+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-05-10T01:45:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808946+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-05-10T01:45:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807395+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-05-10T01:45:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.815355+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-05-10T01:45:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.813899+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-05-10T01:45:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805834+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-05-10T01:45:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807066+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-05-10T01:45:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810625+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-05-10T01:45:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.806107+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-05-10T01:45:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.811940+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-05-10T01:45:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810271+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-05-10T01:45:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.804826+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-05-10T01:45:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807374+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-05-10T01:45:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.806893+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-10T01:45:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-05-10T01:45:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.817703+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-05-10T01:45:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.809532+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-05-10T01:45:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.809877+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-05-10T01:45:23.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807409+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:23.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-05-10T01:45:23.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808409+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:23.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-05-10T01:45:23.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810166+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-05-10T01:45:23.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.811397+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:23.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-05-10T01:45:23.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.807193+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:24.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-05-10T01:45:24.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810573+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:24.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-05-10T01:45:24.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.809902+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-10T01:45:24.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-05-10T01:45:24.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.812577+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:24.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-05-10T01:45:24.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805778+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:24.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-05-10T01:45:24.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.810934+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:24.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-05-10T01:45:24.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.814943+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-10T01:45:24.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-05-10T01:45:24.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805472+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:24.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-05-10T01:45:24.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805355+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:24.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-05-10T01:45:24.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.817272+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-10T01:45:24.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-05-10T01:45:24.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.808691+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:24.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-05-10T01:45:24.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805624+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:24.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-05-10T01:45:24.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.806775+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:24.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-05-10T01:45:24.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.809441+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:24.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-05-10T01:45:24.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.812134+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-10T01:45:24.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-05-10T01:45:24.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.804968+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:24.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-05-10T01:45:24.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.806766+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-10T01:45:24.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-05-10T01:45:24.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.811712+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:24.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-05-10T01:45:24.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.805892+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-10T01:45:24.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-05-10T01:45:24.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-05-10T01:45:18.796315+0000', 'last_change': '2023-05-10T01:45:18.812157+0000', 'last_active': '2023-05-10T01:45:18.796315+0000', 'last_peered': '2023-05-10T01:45:18.796315+0000', 'last_clean': '2023-05-10T01:45:18.796315+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-10T01:45:18.796315+0000', 'last_undegraded': '2023-05-10T01:45:18.796315+0000', 'last_fullsized': '2023-05-10T01:45:18.796315+0000', 'mapping_epoch': 171, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 171, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'last_clean_scrub_stamp': '2023-05-10T01:45:18.796315+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-10T01:45:24.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-10T01:45:24.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.128+0000 7f946d8b7700 1 Processor -- start 2023-05-10T01:45:24.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.128+0000 7f946d8b7700 1 -- start start 2023-05-10T01:45:24.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f946d8b7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9468154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f946d8b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680bfba0 con 0x7f94680c52e0 2023-05-10T01:45:24.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f946d8b7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680c0160 con 0x7f9468069e70 2023-05-10T01:45:24.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f946d8b7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680aa0a0 con 0x7f94681541a0 2023-05-10T01:45:24.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f94667fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f94680c52e0 0x7f9468069760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51422/0 (socket says 172.21.15.52:51422) 2023-05-10T01:45:24.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f94667fc700 1 -- 172.21.15.52:0/2836147819 learned_addr learned my addr 172.21.15.52:0/2836147819 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:24.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.129+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9468154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294548082 0 0) 0x7f94680bfba0 con 0x7f94680c52e0 2023-05-10T01:45:24.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94480033f0 con 0x7f94680c52e0 2023-05-10T01:45:24.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365765724 0 0) 0x7f94680c0160 con 0x7f9468069e70 2023-05-10T01:45:24.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94680bfba0 con 0x7f9468069e70 2023-05-10T01:45:24.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569612730 0 0) 0x7f94480033f0 con 0x7f94680c52e0 2023-05-10T01:45:24.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 msgr2=0x7f9468154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:24.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9468154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 >> v1:172.21.15.172:6789/0 conn(0x7f9468069e70 legacy=0x7f946815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680aa380 con 0x7f94680c52e0 2023-05-10T01:45:24.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f9450001470 con 0x7f94680c52e0 2023-05-10T01:45:24.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9468154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 >> v1:172.21.15.52:6789/0 conn(0x7f94680c52e0 legacy=0x7f9468069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9448003aa0 0x7f9448003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f9448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9448005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680aa0a0 con 0x7f9448004690 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944800b8e0 con 0x7f9448003aa0 2023-05-10T01:45:24.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944800ba70 con 0x7f94681541a0 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f9448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9448003aa0 0x7f9448003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94677fe700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9448005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 -- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 msgr2=0x7f9448005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9448005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 -- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9448003aa0 msgr2=0x7f9448003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9448003aa0 0x7f9448003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 -- 172.21.15.52:0/2836147819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600092a0 con 0x7f9448004690 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94677fe700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94681541a0 0x7f9448005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.130+0000 7f94667fc700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f9448004b10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f945000c160 tx=0x7f9450001e10).ready entity=mon.0 client_cookie=d20553b76f648176 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945000c9d0 con 0x7f9448004690 2023-05-10T01:45:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945000cb30 con 0x7f9448004690 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f9465ffb700 1 -- 172.21.15.52:0/2836147819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500070d0 con 0x7f9448004690 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 -- 172.21.15.52:0/2836147819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 msgr2=0x7f9448004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2836147819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f9448004b10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f945000c160 tx=0x7f9450001e10).stop 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f94677fe700 1 -- 172.21.15.52:0/2836147819 reap_dead start 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 -- 172.21.15.52:0/2836147819 shutdown_connections 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 -- 172.21.15.52:0/2836147819 >> 172.21.15.52:0/2836147819 conn(0x7f94680cb710 msgr2=0x7f94680c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 -- 172.21.15.52:0/2836147819 shutdown_connections 2023-05-10T01:45:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.131+0000 7f946d8b7700 1 -- 172.21.15.52:0/2836147819 wait complete. 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.132+0000 7f946d8b7700 1 Processor -- start 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.132+0000 7f946d8b7700 1 -- start start 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 0x7f94681506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 0x7f9468143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c2430 con 0x7f9448004690 2023-05-10T01:45:24.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c29f0 con 0x7f9468150ba0 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f946d8b7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9468153200 con 0x7f9468152d70 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f9466ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f9466ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42416/0 (socket says 172.21.15.52:42416) 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f9466ffd700 1 -- 172.21.15.52:0/2746628431 learned_addr learned my addr 172.21.15.52:0/2746628431 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f94667fc700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 0x7f94681506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f94677fe700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 0x7f9468143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.133+0000 7f9466ffd700 1 -- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 msgr2=0x7f94681506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 0x7f94681506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f9466ffd700 1 -- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 msgr2=0x7f9468143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 0x7f9468143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f9466ffd700 1 -- 172.21.15.52:0/2746628431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94681534c0 con 0x7f9448004690 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f94667fc700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 0x7f94681506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f94677fe700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 0x7f9468143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f9466ffd700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f9460011d40 tx=0x7f9460009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946000fac0 con 0x7f9448004690 2023-05-10T01:45:24.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946000fc20 con 0x7f9448004690 2023-05-10T01:45:24.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680c2680 con 0x7f9448004690 2023-05-10T01:45:24.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460014440 con 0x7f9448004690 2023-05-10T01:45:24.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.134+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9468143d40 con 0x7f9448004690 2023-05-10T01:45:24.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.135+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94680666b0 con 0x7f9448004690 2023-05-10T01:45:24.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.135+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9460024070 con 0x7f9448004690 2023-05-10T01:45:24.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.135+0000 7f945effd700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 0x7f944c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.136+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f946007a890 con 0x7f9448004690 2023-05-10T01:45:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.136+0000 7f94667fc700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 0x7f944c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.136+0000 7f94667fc700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 0x7f944c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9468069150 tx=0x7f9450015000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.140+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f946004bd10 con 0x7f9448004690 2023-05-10T01:45:24.294 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:45:24.292+0000 7f63b64f7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:45:24.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.378+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f946806c340 con 0x7f9448004690 2023-05-10T01:45:24.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.378+0000 7f945effd700 1 -- 172.21.15.52:0/2746628431 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+955 (secure 0 0 0) 0x7f946004f330 con 0x7f9448004690 2023-05-10T01:45:24.381 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:24.381 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2148,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":173,"num_osds":8,"num_up_osds":8,"osd_up_since":1683680984,"num_in_osds":8,"osd_in_since":1683680978,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":22,"data_bytes":2306,"bytes_used":198803456,"bytes_avail":772895309824,"bytes_total":773094113280},"fsmap":{"epoch":78,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9084}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-05-10T01:44:53.804945+0000","services":{}},"progress_events":{}} 2023-05-10T01:45:24.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 msgr2=0x7f944c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 0x7f944c061250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9468069150 tx=0x7f9450015000).stop 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 msgr2=0x7f94681401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f9460011d40 tx=0x7f9460009060).stop 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 shutdown_connections 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f944c05ed90 0x7f944c061250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9468150ba0 0x7f9468143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9448004690 0x7f94681401e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 --2- 172.21.15.52:0/2746628431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9468152d70 0x7f94681506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 >> 172.21.15.52:0/2746628431 conn(0x7f94680cb710 msgr2=0x7f94680ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:24.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 shutdown_connections 2023-05-10T01:45:24.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.380+0000 7f946d8b7700 1 -- 172.21.15.52:0/2746628431 wait complete. 2023-05-10T01:45:24.394 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-10T01:45:24.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.516+0000 7f10856b4700 1 Processor -- start 2023-05-10T01:45:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.516+0000 7f10856b4700 1 -- start start 2023-05-10T01:45:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f10856b4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10800c7370 0x7f1080154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f10856b4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800c7750 0x7f10800acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f10856b4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1080158960 con 0x7f10800ad030 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f10856b4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1080155330 con 0x7f10800c7370 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f10856b4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1080157d50 con 0x7f10800c7750 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10800c7370 0x7f1080154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10800c7370 0x7f1080154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42422/0 (socket says 172.21.15.52:42422) 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 -- 172.21.15.52:0/3885038138 learned_addr learned my addr 172.21.15.52:0/3885038138 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107f7fe700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800c7750 0x7f10800acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 -- 172.21.15.52:0/3885038138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800c7750 msgr2=0x7f10800acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800c7750 0x7f10800acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 -- 172.21.15.52:0/3885038138 >> v1:172.21.15.172:6789/0 conn(0x7f10800ad030 legacy=0x7f108014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 -- 172.21.15.52:0/3885038138 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080158030 con 0x7f10800c7370 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.517+0000 7f107ffff700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7370 0x7f1080154e40 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f1068006fd0 tx=0x7f10680090f0).ready entity=mon.0 client_cookie=5317fa864a229a36 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f107effd700 1 -- 172.21.15.52:0/3885038138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800b600 con 0x7f10800c7370 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f107effd700 1 -- 172.21.15.52:0/3885038138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800b760 con 0x7f10800c7370 2023-05-10T01:45:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f107effd700 1 -- 172.21.15.52:0/3885038138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800bae0 con 0x7f10800c7370 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 -- 172.21.15.52:0/3885038138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7370 msgr2=0x7f1080154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7370 0x7f1080154e40 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f1068006fd0 tx=0x7f10680090f0).stop 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 -- 172.21.15.52:0/3885038138 shutdown_connections 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7370 0x7f1080154e40 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 --2- 172.21.15.52:0/3885038138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800c7750 0x7f10800acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 -- 172.21.15.52:0/3885038138 >> 172.21.15.52:0/3885038138 conn(0x7f1080068320 msgr2=0x7f1080068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 -- 172.21.15.52:0/3885038138 shutdown_connections 2023-05-10T01:45:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.518+0000 7f10856b4700 1 -- 172.21.15.52:0/3885038138 wait complete. 2023-05-10T01:45:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.519+0000 7f10856b4700 1 Processor -- start 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.519+0000 7f10856b4700 1 -- start start 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 0x7f10800c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10800c7370 0x7f10800c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1080164470 con 0x7f10800c7750 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c32e0 con 0x7f10800c7370 2023-05-10T01:45:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f10856b4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1080164680 con 0x7f10800ad030 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f1084eb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f1084eb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42432/0 (socket says 172.21.15.52:42432) 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f1084eb3700 1 -- 172.21.15.52:0/4206146052 learned_addr learned my addr 172.21.15.52:0/4206146052 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f107f7fe700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10800c7370 0x7f10800c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.520+0000 7f107ffff700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 0x7f10800c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 -- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 msgr2=0x7f10800c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 0x7f10800c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 -- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10800c7370 msgr2=0x7f10800c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10800c7370 0x7f10800c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 -- 172.21.15.52:0/4206146052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068009370 con 0x7f10800c7750 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f107ffff700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 0x7f10800c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1084eb3700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f107800c810 tx=0x7f1078002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078010510 con 0x7f10800c7750 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10780106b0 con 0x7f10800c7750 2023-05-10T01:45:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078010a70 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1080164920 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.521+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1080164ee0 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.522+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1080047150 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.522+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1078019030 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.522+0000 7f1077fff700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 0x7f1064061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.523+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f1078079420 con 0x7f10800c7750 2023-05-10T01:45:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.523+0000 7f107ffff700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 0x7f1064061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.523+0000 7f107ffff700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 0x7f1064061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1068009130 tx=0x7f1068017000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.527+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10780488f0 con 0x7f10800c7750 2023-05-10T01:45:24.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.693+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10800bfb80 con 0x7f106405ed90 2023-05-10T01:45:24.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.703+0000 7f1077fff700 1 -- 172.21.15.52:0/4206146052 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361735 (secure 0 0 0) 0x7f10800bfb80 con 0x7f106405ed90 2023-05-10T01:45:24.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:24.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 msgr2=0x7f1064061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 0x7f1064061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1068009130 tx=0x7f1068017000).stop 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 msgr2=0x7f10800c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f107800c810 tx=0x7f1078002560).stop 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 shutdown_connections 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f106405ed90 0x7f1064061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10800c7750 0x7f10800c88d0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f10800ad030 0x7f10800c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 --2- 172.21.15.52:0/4206146052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10800c7370 0x7f10800c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 >> 172.21.15.52:0/4206146052 conn(0x7f1080068320 msgr2=0x7f1080150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 shutdown_connections 2023-05-10T01:45:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:24.706+0000 7f10856b4700 1 -- 172.21.15.52:0/4206146052 wait complete. 2023-05-10T01:45:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:24.720 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-05-10T01:45:23.949868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":194144,"kb_used_data":16928,"kb_used_omap":0,"kb_used_meta":177152,"kb_avail":754780576,"statfs":{"total":773094113280,"available":772895309824,"internally_reserved":0,"allocated":17334272,"data_stored":8952068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181403648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27877,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.224551"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222966+0000","last_change":"2023-05-10T01:45:19.220084+0000","last_active":"2023-05-10T01:45:19.222966+0000","last_peered":"2023-05-10T01:45:19.222966+0000","last_clean":"2023-05-10T01:45:19.222966+0000","last_became_active":"2023-05-10T01:45:19.219808+0000","last_became_peered":"2023-05-10T01:45:19.219808+0000","last_unstale":"2023-05-10T01:45:19.222966+0000","last_undegraded":"2023-05-10T01:45:19.222966+0000","last_fullsized":"2023-05-10T01:45:19.222966+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223143+0000","last_change":"2023-05-10T01:45:18.818402+0000","last_active":"2023-05-10T01:45:19.223143+0000","last_peered":"2023-05-10T01:45:19.223143+0000","last_clean":"2023-05-10T01:45:19.223143+0000","last_became_active":"2023-05-10T01:45:18.818138+0000","last_became_peered":"2023-05-10T01:45:18.818138+0000","last_unstale":"2023-05-10T01:45:19.223143+0000","last_undegraded":"2023-05-10T01:45:19.223143+0000","last_fullsized":"2023-05-10T01:45:19.223143+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222790+0000","last_change":"2023-05-10T01:45:19.220886+0000","last_active":"2023-05-10T01:45:19.222790+0000","last_peered":"2023-05-10T01:45:19.222790+0000","last_clean":"2023-05-10T01:45:19.222790+0000","last_became_active":"2023-05-10T01:45:19.220574+0000","last_became_peered":"2023-05-10T01:45:19.220574+0000","last_unstale":"2023-05-10T01:45:19.222790+0000","last_undegraded":"2023-05-10T01:45:19.222790+0000","last_fullsized":"2023-05-10T01:45:19.222790+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197529+0000","last_change":"2023-05-10T01:45:18.814168+0000","last_active":"2023-05-10T01:45:19.197529+0000","last_peered":"2023-05-10T01:45:19.197529+0000","last_clean":"2023-05-10T01:45:19.197529+0000","last_became_active":"2023-05-10T01:45:18.813893+0000","last_became_peered":"2023-05-10T01:45:18.813893+0000","last_unstale":"2023-05-10T01:45:19.197529+0000","last_undegraded":"2023-05-10T01:45:19.197529+0000","last_fullsized":"2023-05-10T01:45:19.197529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217312+0000","last_change":"2023-05-10T01:45:19.215949+0000","last_active":"2023-05-10T01:45:19.217312+0000","last_peered":"2023-05-10T01:45:19.217312+0000","last_clean":"2023-05-10T01:45:19.217312+0000","last_became_active":"2023-05-10T01:45:19.215683+0000","last_became_peered":"2023-05-10T01:45:19.215683+0000","last_unstale":"2023-05-10T01:45:19.217312+0000","last_undegraded":"2023-05-10T01:45:19.217312+0000","last_fullsized":"2023-05-10T01:45:19.217312+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203265+0000","last_change":"2023-05-10T01:45:18.821662+0000","last_active":"2023-05-10T01:45:19.203265+0000","last_peered":"2023-05-10T01:45:19.203265+0000","last_clean":"2023-05-10T01:45:19.203265+0000","last_became_active":"2023-05-10T01:45:18.821367+0000","last_became_peered":"2023-05-10T01:45:18.821367+0000","last_unstale":"2023-05-10T01:45:19.203265+0000","last_undegraded":"2023-05-10T01:45:19.203265+0000","last_fullsized":"2023-05-10T01:45:19.203265+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219566+0000","last_change":"2023-05-10T01:45:19.216473+0000","last_active":"2023-05-10T01:45:19.219566+0000","last_peered":"2023-05-10T01:45:19.219566+0000","last_clean":"2023-05-10T01:45:19.219566+0000","last_became_active":"2023-05-10T01:45:19.216143+0000","last_became_peered":"2023-05-10T01:45:19.216143+0000","last_unstale":"2023-05-10T01:45:19.219566+0000","last_undegraded":"2023-05-10T01:45:19.219566+0000","last_fullsized":"2023-05-10T01:45:19.219566+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219791+0000","last_change":"2023-05-10T01:45:18.830114+0000","last_active":"2023-05-10T01:45:19.219791+0000","last_peered":"2023-05-10T01:45:19.219791+0000","last_clean":"2023-05-10T01:45:19.219791+0000","last_became_active":"2023-05-10T01:45:18.829808+0000","last_became_peered":"2023-05-10T01:45:18.829808+0000","last_unstale":"2023-05-10T01:45:19.219791+0000","last_undegraded":"2023-05-10T01:45:19.219791+0000","last_fullsized":"2023-05-10T01:45:19.219791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219269+0000","last_change":"2023-05-10T01:45:19.215773+0000","last_active":"2023-05-10T01:45:19.219269+0000","last_peered":"2023-05-10T01:45:19.219269+0000","last_clean":"2023-05-10T01:45:19.219269+0000","last_became_active":"2023-05-10T01:45:19.215351+0000","last_became_peered":"2023-05-10T01:45:19.215351+0000","last_unstale":"2023-05-10T01:45:19.219269+0000","last_undegraded":"2023-05-10T01:45:19.219269+0000","last_fullsized":"2023-05-10T01:45:19.219269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222094+0000","last_change":"2023-05-10T01:45:18.820192+0000","last_active":"2023-05-10T01:45:19.222094+0000","last_peered":"2023-05-10T01:45:19.222094+0000","last_clean":"2023-05-10T01:45:19.222094+0000","last_became_active":"2023-05-10T01:45:18.819911+0000","last_became_peered":"2023-05-10T01:45:18.819911+0000","last_unstale":"2023-05-10T01:45:19.222094+0000","last_undegraded":"2023-05-10T01:45:19.222094+0000","last_fullsized":"2023-05-10T01:45:19.222094+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218692+0000","last_change":"2023-05-10T01:45:19.213120+0000","last_active":"2023-05-10T01:45:19.218692+0000","last_peered":"2023-05-10T01:45:19.218692+0000","last_clean":"2023-05-10T01:45:19.218692+0000","last_became_active":"2023-05-10T01:45:19.211868+0000","last_became_peered":"2023-05-10T01:45:19.211868+0000","last_unstale":"2023-05-10T01:45:19.218692+0000","last_undegraded":"2023-05-10T01:45:19.218692+0000","last_fullsized":"2023-05-10T01:45:19.218692+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221189+0000","last_change":"2023-05-10T01:45:18.827571+0000","last_active":"2023-05-10T01:45:19.221189+0000","last_peered":"2023-05-10T01:45:19.221189+0000","last_clean":"2023-05-10T01:45:19.221189+0000","last_became_active":"2023-05-10T01:45:18.827216+0000","last_became_peered":"2023-05-10T01:45:18.827216+0000","last_unstale":"2023-05-10T01:45:19.221189+0000","last_undegraded":"2023-05-10T01:45:19.221189+0000","last_fullsized":"2023-05-10T01:45:19.221189+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217523+0000","last_change":"2023-05-10T01:45:19.209679+0000","last_active":"2023-05-10T01:45:19.217523+0000","last_peered":"2023-05-10T01:45:19.217523+0000","last_clean":"2023-05-10T01:45:19.217523+0000","last_became_active":"2023-05-10T01:45:19.209416+0000","last_became_peered":"2023-05-10T01:45:19.209416+0000","last_unstale":"2023-05-10T01:45:19.217523+0000","last_undegraded":"2023-05-10T01:45:19.217523+0000","last_fullsized":"2023-05-10T01:45:19.217523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203912+0000","last_change":"2023-05-10T01:45:18.823558+0000","last_active":"2023-05-10T01:45:19.203912+0000","last_peered":"2023-05-10T01:45:19.203912+0000","last_clean":"2023-05-10T01:45:19.203912+0000","last_became_active":"2023-05-10T01:45:18.823058+0000","last_became_peered":"2023-05-10T01:45:18.823058+0000","last_unstale":"2023-05-10T01:45:19.203912+0000","last_undegraded":"2023-05-10T01:45:19.203912+0000","last_fullsized":"2023-05-10T01:45:19.203912+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219379+0000","last_change":"2023-05-10T01:45:19.211768+0000","last_active":"2023-05-10T01:45:19.219379+0000","last_peered":"2023-05-10T01:45:19.219379+0000","last_clean":"2023-05-10T01:45:19.219379+0000","last_became_active":"2023-05-10T01:45:19.211116+0000","last_became_peered":"2023-05-10T01:45:19.211116+0000","last_unstale":"2023-05-10T01:45:19.219379+0000","last_undegraded":"2023-05-10T01:45:19.219379+0000","last_fullsized":"2023-05-10T01:45:19.219379+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202123+0000","last_change":"2023-05-10T01:45:18.817323+0000","last_active":"2023-05-10T01:45:19.202123+0000","last_peered":"2023-05-10T01:45:19.202123+0000","last_clean":"2023-05-10T01:45:19.202123+0000","last_became_active":"2023-05-10T01:45:18.817030+0000","last_became_peered":"2023-05-10T01:45:18.817030+0000","last_unstale":"2023-05-10T01:45:19.202123+0000","last_undegraded":"2023-05-10T01:45:19.202123+0000","last_fullsized":"2023-05-10T01:45:19.202123+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.227886+0000","last_change":"2023-05-10T01:45:19.222891+0000","last_active":"2023-05-10T01:45:19.227886+0000","last_peered":"2023-05-10T01:45:19.227886+0000","last_clean":"2023-05-10T01:45:19.227886+0000","last_became_active":"2023-05-10T01:45:19.222537+0000","last_became_peered":"2023-05-10T01:45:19.222537+0000","last_unstale":"2023-05-10T01:45:19.227886+0000","last_undegraded":"2023-05-10T01:45:19.227886+0000","last_fullsized":"2023-05-10T01:45:19.227886+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197006+0000","last_change":"2023-05-10T01:45:18.819801+0000","last_active":"2023-05-10T01:45:19.197006+0000","last_peered":"2023-05-10T01:45:19.197006+0000","last_clean":"2023-05-10T01:45:19.197006+0000","last_became_active":"2023-05-10T01:45:18.819525+0000","last_became_peered":"2023-05-10T01:45:18.819525+0000","last_unstale":"2023-05-10T01:45:19.197006+0000","last_undegraded":"2023-05-10T01:45:19.197006+0000","last_fullsized":"2023-05-10T01:45:19.197006+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.213979+0000","last_change":"2023-05-10T01:45:19.208110+0000","last_active":"2023-05-10T01:45:19.213979+0000","last_peered":"2023-05-10T01:45:19.213979+0000","last_clean":"2023-05-10T01:45:19.213979+0000","last_became_active":"2023-05-10T01:45:19.207841+0000","last_became_peered":"2023-05-10T01:45:19.207841+0000","last_unstale":"2023-05-10T01:45:19.213979+0000","last_undegraded":"2023-05-10T01:45:19.213979+0000","last_fullsized":"2023-05-10T01:45:19.213979+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206168+0000","last_change":"2023-05-10T01:45:18.826355+0000","last_active":"2023-05-10T01:45:19.206168+0000","last_peered":"2023-05-10T01:45:19.206168+0000","last_clean":"2023-05-10T01:45:19.206168+0000","last_became_active":"2023-05-10T01:45:18.825988+0000","last_became_peered":"2023-05-10T01:45:18.825988+0000","last_unstale":"2023-05-10T01:45:19.206168+0000","last_undegraded":"2023-05-10T01:45:19.206168+0000","last_fullsized":"2023-05-10T01:45:19.206168+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217837+0000","last_change":"2023-05-10T01:45:19.211686+0000","last_active":"2023-05-10T01:45:19.217837+0000","last_peered":"2023-05-10T01:45:19.217837+0000","last_clean":"2023-05-10T01:45:19.217837+0000","last_became_active":"2023-05-10T01:45:19.211410+0000","last_became_peered":"2023-05-10T01:45:19.211410+0000","last_unstale":"2023-05-10T01:45:19.217837+0000","last_undegraded":"2023-05-10T01:45:19.217837+0000","last_fullsized":"2023-05-10T01:45:19.217837+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204992+0000","last_change":"2023-05-10T01:45:18.823529+0000","last_active":"2023-05-10T01:45:19.204992+0000","last_peered":"2023-05-10T01:45:19.204992+0000","last_clean":"2023-05-10T01:45:19.204992+0000","last_became_active":"2023-05-10T01:45:18.823231+0000","last_became_peered":"2023-05-10T01:45:18.823231+0000","last_unstale":"2023-05-10T01:45:19.204992+0000","last_undegraded":"2023-05-10T01:45:19.204992+0000","last_fullsized":"2023-05-10T01:45:19.204992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211042+0000","last_change":"2023-05-10T01:45:19.205139+0000","last_active":"2023-05-10T01:45:19.211042+0000","last_peered":"2023-05-10T01:45:19.211042+0000","last_clean":"2023-05-10T01:45:19.211042+0000","last_became_active":"2023-05-10T01:45:19.204841+0000","last_became_peered":"2023-05-10T01:45:19.204841+0000","last_unstale":"2023-05-10T01:45:19.211042+0000","last_undegraded":"2023-05-10T01:45:19.211042+0000","last_fullsized":"2023-05-10T01:45:19.211042+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.227763+0000","last_change":"2023-05-10T01:45:18.824587+0000","last_active":"2023-05-10T01:45:19.227763+0000","last_peered":"2023-05-10T01:45:19.227763+0000","last_clean":"2023-05-10T01:45:19.227763+0000","last_became_active":"2023-05-10T01:45:18.824256+0000","last_became_peered":"2023-05-10T01:45:18.824256+0000","last_unstale":"2023-05-10T01:45:19.227763+0000","last_undegraded":"2023-05-10T01:45:19.227763+0000","last_fullsized":"2023-05-10T01:45:19.227763+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.208878+0000","last_change":"2023-05-10T01:45:19.201518+0000","last_active":"2023-05-10T01:45:19.208878+0000","last_peered":"2023-05-10T01:45:19.208878+0000","last_clean":"2023-05-10T01:45:19.208878+0000","last_became_active":"2023-05-10T01:45:19.201224+0000","last_became_peered":"2023-05-10T01:45:19.201224+0000","last_unstale":"2023-05-10T01:45:19.208878+0000","last_undegraded":"2023-05-10T01:45:19.208878+0000","last_fullsized":"2023-05-10T01:45:19.208878+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222261+0000","last_change":"2023-05-10T01:45:18.818724+0000","last_active":"2023-05-10T01:45:19.222261+0000","last_peered":"2023-05-10T01:45:19.222261+0000","last_clean":"2023-05-10T01:45:19.222261+0000","last_became_active":"2023-05-10T01:45:18.818428+0000","last_became_peered":"2023-05-10T01:45:18.818428+0000","last_unstale":"2023-05-10T01:45:19.222261+0000","last_undegraded":"2023-05-10T01:45:19.222261+0000","last_fullsized":"2023-05-10T01:45:19.222261+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223124+0000","last_change":"2023-05-10T01:45:19.221514+0000","last_active":"2023-05-10T01:45:19.223124+0000","last_peered":"2023-05-10T01:45:19.223124+0000","last_clean":"2023-05-10T01:45:19.223124+0000","last_became_active":"2023-05-10T01:45:19.221234+0000","last_became_peered":"2023-05-10T01:45:19.221234+0000","last_unstale":"2023-05-10T01:45:19.223124+0000","last_undegraded":"2023-05-10T01:45:19.223124+0000","last_fullsized":"2023-05-10T01:45:19.223124+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197134+0000","last_change":"2023-05-10T01:45:18.817675+0000","last_active":"2023-05-10T01:45:19.197134+0000","last_peered":"2023-05-10T01:45:19.197134+0000","last_clean":"2023-05-10T01:45:19.197134+0000","last_became_active":"2023-05-10T01:45:18.817193+0000","last_became_peered":"2023-05-10T01:45:18.817193+0000","last_unstale":"2023-05-10T01:45:19.197134+0000","last_undegraded":"2023-05-10T01:45:19.197134+0000","last_fullsized":"2023-05-10T01:45:19.197134+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222730+0000","last_change":"2023-05-10T01:45:19.219213+0000","last_active":"2023-05-10T01:45:19.222730+0000","last_peered":"2023-05-10T01:45:19.222730+0000","last_clean":"2023-05-10T01:45:19.222730+0000","last_became_active":"2023-05-10T01:45:19.218969+0000","last_became_peered":"2023-05-10T01:45:19.218969+0000","last_unstale":"2023-05-10T01:45:19.222730+0000","last_undegraded":"2023-05-10T01:45:19.222730+0000","last_fullsized":"2023-05-10T01:45:19.222730+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204644+0000","last_change":"2023-05-10T01:45:18.821898+0000","last_active":"2023-05-10T01:45:19.204644+0000","last_peered":"2023-05-10T01:45:19.204644+0000","last_clean":"2023-05-10T01:45:19.204644+0000","last_became_active":"2023-05-10T01:45:18.821629+0000","last_became_peered":"2023-05-10T01:45:18.821629+0000","last_unstale":"2023-05-10T01:45:19.204644+0000","last_undegraded":"2023-05-10T01:45:19.204644+0000","last_fullsized":"2023-05-10T01:45:19.204644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219401+0000","last_change":"2023-05-10T01:45:19.212026+0000","last_active":"2023-05-10T01:45:19.219401+0000","last_peered":"2023-05-10T01:45:19.219401+0000","last_clean":"2023-05-10T01:45:19.219401+0000","last_became_active":"2023-05-10T01:45:19.211508+0000","last_became_peered":"2023-05-10T01:45:19.211508+0000","last_unstale":"2023-05-10T01:45:19.219401+0000","last_undegraded":"2023-05-10T01:45:19.219401+0000","last_fullsized":"2023-05-10T01:45:19.219401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218780+0000","last_change":"2023-05-10T01:45:18.821558+0000","last_active":"2023-05-10T01:45:19.218780+0000","last_peered":"2023-05-10T01:45:19.218780+0000","last_clean":"2023-05-10T01:45:19.218780+0000","last_became_active":"2023-05-10T01:45:18.821237+0000","last_became_peered":"2023-05-10T01:45:18.821237+0000","last_unstale":"2023-05-10T01:45:19.218780+0000","last_undegraded":"2023-05-10T01:45:19.218780+0000","last_fullsized":"2023-05-10T01:45:19.218780+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216784+0000","last_change":"2023-05-10T01:45:19.215501+0000","last_active":"2023-05-10T01:45:19.216784+0000","last_peered":"2023-05-10T01:45:19.216784+0000","last_clean":"2023-05-10T01:45:19.216784+0000","last_became_active":"2023-05-10T01:45:19.215281+0000","last_became_peered":"2023-05-10T01:45:19.215281+0000","last_unstale":"2023-05-10T01:45:19.216784+0000","last_undegraded":"2023-05-10T01:45:19.216784+0000","last_fullsized":"2023-05-10T01:45:19.216784+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207242+0000","last_change":"2023-05-10T01:45:18.820366+0000","last_active":"2023-05-10T01:45:19.207242+0000","last_peered":"2023-05-10T01:45:19.207242+0000","last_clean":"2023-05-10T01:45:19.207242+0000","last_became_active":"2023-05-10T01:45:18.819939+0000","last_became_peered":"2023-05-10T01:45:18.819939+0000","last_unstale":"2023-05-10T01:45:19.207242+0000","last_undegraded":"2023-05-10T01:45:19.207242+0000","last_fullsized":"2023-05-10T01:45:19.207242+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223250+0000","last_change":"2023-05-10T01:45:19.218190+0000","last_active":"2023-05-10T01:45:19.223250+0000","last_peered":"2023-05-10T01:45:19.223250+0000","last_clean":"2023-05-10T01:45:19.223250+0000","last_became_active":"2023-05-10T01:45:19.217717+0000","last_became_peered":"2023-05-10T01:45:19.217717+0000","last_unstale":"2023-05-10T01:45:19.223250+0000","last_undegraded":"2023-05-10T01:45:19.223250+0000","last_fullsized":"2023-05-10T01:45:19.223250+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210096+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:19.210096+0000","last_peered":"2023-05-10T01:45:19.210096+0000","last_clean":"2023-05-10T01:45:19.210096+0000","last_became_active":"2023-05-10T01:45:18.820855+0000","last_became_peered":"2023-05-10T01:45:18.820855+0000","last_unstale":"2023-05-10T01:45:19.210096+0000","last_undegraded":"2023-05-10T01:45:19.210096+0000","last_fullsized":"2023-05-10T01:45:19.210096+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219247+0000","last_change":"2023-05-10T01:45:19.213757+0000","last_active":"2023-05-10T01:45:19.219247+0000","last_peered":"2023-05-10T01:45:19.219247+0000","last_clean":"2023-05-10T01:45:19.219247+0000","last_became_active":"2023-05-10T01:45:19.213128+0000","last_became_peered":"2023-05-10T01:45:19.213128+0000","last_unstale":"2023-05-10T01:45:19.219247+0000","last_undegraded":"2023-05-10T01:45:19.219247+0000","last_fullsized":"2023-05-10T01:45:19.219247+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214804+0000","last_change":"2023-05-10T01:45:18.821215+0000","last_active":"2023-05-10T01:45:19.214804+0000","last_peered":"2023-05-10T01:45:19.214804+0000","last_clean":"2023-05-10T01:45:19.214804+0000","last_became_active":"2023-05-10T01:45:18.820901+0000","last_became_peered":"2023-05-10T01:45:18.820901+0000","last_unstale":"2023-05-10T01:45:19.214804+0000","last_undegraded":"2023-05-10T01:45:19.214804+0000","last_fullsized":"2023-05-10T01:45:19.214804+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220713+0000","last_change":"2023-05-10T01:45:19.213586+0000","last_active":"2023-05-10T01:45:19.220713+0000","last_peered":"2023-05-10T01:45:19.220713+0000","last_clean":"2023-05-10T01:45:19.220713+0000","last_became_active":"2023-05-10T01:45:19.213362+0000","last_became_peered":"2023-05-10T01:45:19.213362+0000","last_unstale":"2023-05-10T01:45:19.220713+0000","last_undegraded":"2023-05-10T01:45:19.220713+0000","last_fullsized":"2023-05-10T01:45:19.220713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199637+0000","last_change":"2023-05-10T01:45:18.819565+0000","last_active":"2023-05-10T01:45:19.199637+0000","last_peered":"2023-05-10T01:45:19.199637+0000","last_clean":"2023-05-10T01:45:19.199637+0000","last_became_active":"2023-05-10T01:45:18.819253+0000","last_became_peered":"2023-05-10T01:45:18.819253+0000","last_unstale":"2023-05-10T01:45:19.199637+0000","last_undegraded":"2023-05-10T01:45:19.199637+0000","last_fullsized":"2023-05-10T01:45:19.199637+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221501+0000","last_change":"2023-05-10T01:45:19.214645+0000","last_active":"2023-05-10T01:45:19.221501+0000","last_peered":"2023-05-10T01:45:19.221501+0000","last_clean":"2023-05-10T01:45:19.221501+0000","last_became_active":"2023-05-10T01:45:19.214350+0000","last_became_peered":"2023-05-10T01:45:19.214350+0000","last_unstale":"2023-05-10T01:45:19.221501+0000","last_undegraded":"2023-05-10T01:45:19.221501+0000","last_fullsized":"2023-05-10T01:45:19.221501+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214861+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:19.214861+0000","last_peered":"2023-05-10T01:45:19.214861+0000","last_clean":"2023-05-10T01:45:19.214861+0000","last_became_active":"2023-05-10T01:45:18.820818+0000","last_became_peered":"2023-05-10T01:45:18.820818+0000","last_unstale":"2023-05-10T01:45:19.214861+0000","last_undegraded":"2023-05-10T01:45:19.214861+0000","last_fullsized":"2023-05-10T01:45:19.214861+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214666+0000","last_change":"2023-05-10T01:45:19.209850+0000","last_active":"2023-05-10T01:45:19.214666+0000","last_peered":"2023-05-10T01:45:19.214666+0000","last_clean":"2023-05-10T01:45:19.214666+0000","last_became_active":"2023-05-10T01:45:19.209557+0000","last_became_peered":"2023-05-10T01:45:19.209557+0000","last_unstale":"2023-05-10T01:45:19.214666+0000","last_undegraded":"2023-05-10T01:45:19.214666+0000","last_fullsized":"2023-05-10T01:45:19.214666+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197254+0000","last_change":"2023-05-10T01:45:18.817483+0000","last_active":"2023-05-10T01:45:19.197254+0000","last_peered":"2023-05-10T01:45:19.197254+0000","last_clean":"2023-05-10T01:45:19.197254+0000","last_became_active":"2023-05-10T01:45:18.816820+0000","last_became_peered":"2023-05-10T01:45:18.816820+0000","last_unstale":"2023-05-10T01:45:19.197254+0000","last_undegraded":"2023-05-10T01:45:19.197254+0000","last_fullsized":"2023-05-10T01:45:19.197254+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219904+0000","last_change":"2023-05-10T01:45:19.217049+0000","last_active":"2023-05-10T01:45:19.219904+0000","last_peered":"2023-05-10T01:45:19.219904+0000","last_clean":"2023-05-10T01:45:19.219904+0000","last_became_active":"2023-05-10T01:45:19.216745+0000","last_became_peered":"2023-05-10T01:45:19.216745+0000","last_unstale":"2023-05-10T01:45:19.219904+0000","last_undegraded":"2023-05-10T01:45:19.219904+0000","last_fullsized":"2023-05-10T01:45:19.219904+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197383+0000","last_change":"2023-05-10T01:45:18.817187+0000","last_active":"2023-05-10T01:45:19.197383+0000","last_peered":"2023-05-10T01:45:19.197383+0000","last_clean":"2023-05-10T01:45:19.197383+0000","last_became_active":"2023-05-10T01:45:18.816332+0000","last_became_peered":"2023-05-10T01:45:18.816332+0000","last_unstale":"2023-05-10T01:45:19.197383+0000","last_undegraded":"2023-05-10T01:45:19.197383+0000","last_fullsized":"2023-05-10T01:45:19.197383+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211302+0000","last_change":"2023-05-10T01:45:19.205377+0000","last_active":"2023-05-10T01:45:19.211302+0000","last_peered":"2023-05-10T01:45:19.211302+0000","last_clean":"2023-05-10T01:45:19.211302+0000","last_became_active":"2023-05-10T01:45:19.204962+0000","last_became_peered":"2023-05-10T01:45:19.204962+0000","last_unstale":"2023-05-10T01:45:19.211302+0000","last_undegraded":"2023-05-10T01:45:19.211302+0000","last_fullsized":"2023-05-10T01:45:19.211302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204968+0000","last_change":"2023-05-10T01:45:18.826802+0000","last_active":"2023-05-10T01:45:19.204968+0000","last_peered":"2023-05-10T01:45:19.204968+0000","last_clean":"2023-05-10T01:45:19.204968+0000","last_became_active":"2023-05-10T01:45:18.825995+0000","last_became_peered":"2023-05-10T01:45:18.825995+0000","last_unstale":"2023-05-10T01:45:19.204968+0000","last_undegraded":"2023-05-10T01:45:19.204968+0000","last_fullsized":"2023-05-10T01:45:19.204968+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218620+0000","last_change":"2023-05-10T01:45:19.210619+0000","last_active":"2023-05-10T01:45:19.218620+0000","last_peered":"2023-05-10T01:45:19.218620+0000","last_clean":"2023-05-10T01:45:19.218620+0000","last_became_active":"2023-05-10T01:45:19.210425+0000","last_became_peered":"2023-05-10T01:45:19.210425+0000","last_unstale":"2023-05-10T01:45:19.218620+0000","last_undegraded":"2023-05-10T01:45:19.218620+0000","last_fullsized":"2023-05-10T01:45:19.218620+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200154+0000","last_change":"2023-05-10T01:45:18.821375+0000","last_active":"2023-05-10T01:45:19.200154+0000","last_peered":"2023-05-10T01:45:19.200154+0000","last_clean":"2023-05-10T01:45:19.200154+0000","last_became_active":"2023-05-10T01:45:18.821091+0000","last_became_peered":"2023-05-10T01:45:18.821091+0000","last_unstale":"2023-05-10T01:45:19.200154+0000","last_undegraded":"2023-05-10T01:45:19.200154+0000","last_fullsized":"2023-05-10T01:45:19.200154+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.213662+0000","last_change":"2023-05-10T01:45:19.207123+0000","last_active":"2023-05-10T01:45:19.213662+0000","last_peered":"2023-05-10T01:45:19.213662+0000","last_clean":"2023-05-10T01:45:19.213662+0000","last_became_active":"2023-05-10T01:45:19.206869+0000","last_became_peered":"2023-05-10T01:45:19.206869+0000","last_unstale":"2023-05-10T01:45:19.213662+0000","last_undegraded":"2023-05-10T01:45:19.213662+0000","last_fullsized":"2023-05-10T01:45:19.213662+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-05-10T01:45:21.080884+0000","last_change":"2023-05-10T01:45:18.823164+0000","last_active":"2023-05-10T01:45:21.080884+0000","last_peered":"2023-05-10T01:45:21.080884+0000","last_clean":"2023-05-10T01:45:21.080884+0000","last_became_active":"2023-05-10T01:45:18.820928+0000","last_became_peered":"2023-05-10T01:45:18.820928+0000","last_unstale":"2023-05-10T01:45:21.080884+0000","last_undegraded":"2023-05-10T01:45:21.080884+0000","last_fullsized":"2023-05-10T01:45:21.080884+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219583+0000","last_change":"2023-05-10T01:45:19.212852+0000","last_active":"2023-05-10T01:45:19.219583+0000","last_peered":"2023-05-10T01:45:19.219583+0000","last_clean":"2023-05-10T01:45:19.219583+0000","last_became_active":"2023-05-10T01:45:19.212534+0000","last_became_peered":"2023-05-10T01:45:19.212534+0000","last_unstale":"2023-05-10T01:45:19.219583+0000","last_undegraded":"2023-05-10T01:45:19.219583+0000","last_fullsized":"2023-05-10T01:45:19.219583+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200090+0000","last_change":"2023-05-10T01:45:18.829455+0000","last_active":"2023-05-10T01:45:19.200090+0000","last_peered":"2023-05-10T01:45:19.200090+0000","last_clean":"2023-05-10T01:45:19.200090+0000","last_became_active":"2023-05-10T01:45:18.829196+0000","last_became_peered":"2023-05-10T01:45:18.829196+0000","last_unstale":"2023-05-10T01:45:19.200090+0000","last_undegraded":"2023-05-10T01:45:19.200090+0000","last_fullsized":"2023-05-10T01:45:19.200090+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219546+0000","last_change":"2023-05-10T01:45:19.215879+0000","last_active":"2023-05-10T01:45:19.219546+0000","last_peered":"2023-05-10T01:45:19.219546+0000","last_clean":"2023-05-10T01:45:19.219546+0000","last_became_active":"2023-05-10T01:45:19.213119+0000","last_became_peered":"2023-05-10T01:45:19.213119+0000","last_unstale":"2023-05-10T01:45:19.219546+0000","last_undegraded":"2023-05-10T01:45:19.219546+0000","last_fullsized":"2023-05-10T01:45:19.219546+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206573+0000","last_change":"2023-05-10T01:45:18.828648+0000","last_active":"2023-05-10T01:45:19.206573+0000","last_peered":"2023-05-10T01:45:19.206573+0000","last_clean":"2023-05-10T01:45:19.206573+0000","last_became_active":"2023-05-10T01:45:18.828290+0000","last_became_peered":"2023-05-10T01:45:18.828290+0000","last_unstale":"2023-05-10T01:45:19.206573+0000","last_undegraded":"2023-05-10T01:45:19.206573+0000","last_fullsized":"2023-05-10T01:45:19.206573+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219252+0000","last_change":"2023-05-10T01:45:19.215582+0000","last_active":"2023-05-10T01:45:19.219252+0000","last_peered":"2023-05-10T01:45:19.219252+0000","last_clean":"2023-05-10T01:45:19.219252+0000","last_became_active":"2023-05-10T01:45:19.215016+0000","last_became_peered":"2023-05-10T01:45:19.215016+0000","last_unstale":"2023-05-10T01:45:19.219252+0000","last_undegraded":"2023-05-10T01:45:19.219252+0000","last_fullsized":"2023-05-10T01:45:19.219252+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203836+0000","last_change":"2023-05-10T01:45:18.830978+0000","last_active":"2023-05-10T01:45:19.203836+0000","last_peered":"2023-05-10T01:45:19.203836+0000","last_clean":"2023-05-10T01:45:19.203836+0000","last_became_active":"2023-05-10T01:45:18.830722+0000","last_became_peered":"2023-05-10T01:45:18.830722+0000","last_unstale":"2023-05-10T01:45:19.203836+0000","last_undegraded":"2023-05-10T01:45:19.203836+0000","last_fullsized":"2023-05-10T01:45:19.203836+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209875+0000","last_change":"2023-05-10T01:45:19.201436+0000","last_active":"2023-05-10T01:45:19.209875+0000","last_peered":"2023-05-10T01:45:19.209875+0000","last_clean":"2023-05-10T01:45:19.209875+0000","last_became_active":"2023-05-10T01:45:19.201146+0000","last_became_peered":"2023-05-10T01:45:19.201146+0000","last_unstale":"2023-05-10T01:45:19.209875+0000","last_undegraded":"2023-05-10T01:45:19.209875+0000","last_fullsized":"2023-05-10T01:45:19.209875+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198088+0000","last_change":"2023-05-10T01:45:18.819989+0000","last_active":"2023-05-10T01:45:19.198088+0000","last_peered":"2023-05-10T01:45:19.198088+0000","last_clean":"2023-05-10T01:45:19.198088+0000","last_became_active":"2023-05-10T01:45:18.819433+0000","last_became_peered":"2023-05-10T01:45:18.819433+0000","last_unstale":"2023-05-10T01:45:19.198088+0000","last_undegraded":"2023-05-10T01:45:19.198088+0000","last_fullsized":"2023-05-10T01:45:19.198088+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221466+0000","last_change":"2023-05-10T01:45:19.215872+0000","last_active":"2023-05-10T01:45:19.221466+0000","last_peered":"2023-05-10T01:45:19.221466+0000","last_clean":"2023-05-10T01:45:19.221466+0000","last_became_active":"2023-05-10T01:45:19.215616+0000","last_became_peered":"2023-05-10T01:45:19.215616+0000","last_unstale":"2023-05-10T01:45:19.221466+0000","last_undegraded":"2023-05-10T01:45:19.221466+0000","last_fullsized":"2023-05-10T01:45:19.221466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.195301+0000","last_change":"2023-05-10T01:45:18.828193+0000","last_active":"2023-05-10T01:45:19.195301+0000","last_peered":"2023-05-10T01:45:19.195301+0000","last_clean":"2023-05-10T01:45:19.195301+0000","last_became_active":"2023-05-10T01:45:18.827891+0000","last_became_peered":"2023-05-10T01:45:18.827891+0000","last_unstale":"2023-05-10T01:45:19.195301+0000","last_undegraded":"2023-05-10T01:45:19.195301+0000","last_fullsized":"2023-05-10T01:45:19.195301+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217626+0000","last_change":"2023-05-10T01:45:19.213728+0000","last_active":"2023-05-10T01:45:19.217626+0000","last_peered":"2023-05-10T01:45:19.217626+0000","last_clean":"2023-05-10T01:45:19.217626+0000","last_became_active":"2023-05-10T01:45:19.213470+0000","last_became_peered":"2023-05-10T01:45:19.213470+0000","last_unstale":"2023-05-10T01:45:19.217626+0000","last_undegraded":"2023-05-10T01:45:19.217626+0000","last_fullsized":"2023-05-10T01:45:19.217626+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199322+0000","last_change":"2023-05-10T01:45:18.823841+0000","last_active":"2023-05-10T01:45:19.199322+0000","last_peered":"2023-05-10T01:45:19.199322+0000","last_clean":"2023-05-10T01:45:19.199322+0000","last_became_active":"2023-05-10T01:45:18.823575+0000","last_became_peered":"2023-05-10T01:45:18.823575+0000","last_unstale":"2023-05-10T01:45:19.199322+0000","last_undegraded":"2023-05-10T01:45:19.199322+0000","last_fullsized":"2023-05-10T01:45:19.199322+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223096+0000","last_change":"2023-05-10T01:45:19.221420+0000","last_active":"2023-05-10T01:45:19.223096+0000","last_peered":"2023-05-10T01:45:19.223096+0000","last_clean":"2023-05-10T01:45:19.223096+0000","last_became_active":"2023-05-10T01:45:19.220673+0000","last_became_peered":"2023-05-10T01:45:19.220673+0000","last_unstale":"2023-05-10T01:45:19.223096+0000","last_undegraded":"2023-05-10T01:45:19.223096+0000","last_fullsized":"2023-05-10T01:45:19.223096+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210954+0000","last_change":"2023-05-10T01:45:18.814752+0000","last_active":"2023-05-10T01:45:19.210954+0000","last_peered":"2023-05-10T01:45:19.210954+0000","last_clean":"2023-05-10T01:45:19.210954+0000","last_became_active":"2023-05-10T01:45:18.814470+0000","last_became_peered":"2023-05-10T01:45:18.814470+0000","last_unstale":"2023-05-10T01:45:19.210954+0000","last_undegraded":"2023-05-10T01:45:19.210954+0000","last_fullsized":"2023-05-10T01:45:19.210954+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223196+0000","last_change":"2023-05-10T01:45:19.221772+0000","last_active":"2023-05-10T01:45:19.223196+0000","last_peered":"2023-05-10T01:45:19.223196+0000","last_clean":"2023-05-10T01:45:19.223196+0000","last_became_active":"2023-05-10T01:45:19.221517+0000","last_became_peered":"2023-05-10T01:45:19.221517+0000","last_unstale":"2023-05-10T01:45:19.223196+0000","last_undegraded":"2023-05-10T01:45:19.223196+0000","last_fullsized":"2023-05-10T01:45:19.223196+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221986+0000","last_change":"2023-05-10T01:45:18.828344+0000","last_active":"2023-05-10T01:45:19.221986+0000","last_peered":"2023-05-10T01:45:19.221986+0000","last_clean":"2023-05-10T01:45:19.221986+0000","last_became_active":"2023-05-10T01:45:18.828023+0000","last_became_peered":"2023-05-10T01:45:18.828023+0000","last_unstale":"2023-05-10T01:45:19.221986+0000","last_undegraded":"2023-05-10T01:45:19.221986+0000","last_fullsized":"2023-05-10T01:45:19.221986+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219228+0000","last_change":"2023-05-10T01:45:19.216428+0000","last_active":"2023-05-10T01:45:19.219228+0000","last_peered":"2023-05-10T01:45:19.219228+0000","last_clean":"2023-05-10T01:45:19.219228+0000","last_became_active":"2023-05-10T01:45:19.216153+0000","last_became_peered":"2023-05-10T01:45:19.216153+0000","last_unstale":"2023-05-10T01:45:19.219228+0000","last_undegraded":"2023-05-10T01:45:19.219228+0000","last_fullsized":"2023-05-10T01:45:19.219228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214367+0000","last_change":"2023-05-10T01:45:18.828387+0000","last_active":"2023-05-10T01:45:19.214367+0000","last_peered":"2023-05-10T01:45:19.214367+0000","last_clean":"2023-05-10T01:45:19.214367+0000","last_became_active":"2023-05-10T01:45:18.828060+0000","last_became_peered":"2023-05-10T01:45:18.828060+0000","last_unstale":"2023-05-10T01:45:19.214367+0000","last_undegraded":"2023-05-10T01:45:19.214367+0000","last_fullsized":"2023-05-10T01:45:19.214367+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222867+0000","last_change":"2023-05-10T01:45:19.217675+0000","last_active":"2023-05-10T01:45:19.222867+0000","last_peered":"2023-05-10T01:45:19.222867+0000","last_clean":"2023-05-10T01:45:19.222867+0000","last_became_active":"2023-05-10T01:45:19.217415+0000","last_became_peered":"2023-05-10T01:45:19.217415+0000","last_unstale":"2023-05-10T01:45:19.222867+0000","last_undegraded":"2023-05-10T01:45:19.222867+0000","last_fullsized":"2023-05-10T01:45:19.222867+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202275+0000","last_change":"2023-05-10T01:45:18.826254+0000","last_active":"2023-05-10T01:45:19.202275+0000","last_peered":"2023-05-10T01:45:19.202275+0000","last_clean":"2023-05-10T01:45:19.202275+0000","last_became_active":"2023-05-10T01:45:18.825958+0000","last_became_peered":"2023-05-10T01:45:18.825958+0000","last_unstale":"2023-05-10T01:45:19.202275+0000","last_undegraded":"2023-05-10T01:45:19.202275+0000","last_fullsized":"2023-05-10T01:45:19.202275+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219436+0000","last_change":"2023-05-10T01:45:19.217164+0000","last_active":"2023-05-10T01:45:19.219436+0000","last_peered":"2023-05-10T01:45:19.219436+0000","last_clean":"2023-05-10T01:45:19.219436+0000","last_became_active":"2023-05-10T01:45:19.216892+0000","last_became_peered":"2023-05-10T01:45:19.216892+0000","last_unstale":"2023-05-10T01:45:19.219436+0000","last_undegraded":"2023-05-10T01:45:19.219436+0000","last_fullsized":"2023-05-10T01:45:19.219436+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198621+0000","last_change":"2023-05-10T01:45:18.823399+0000","last_active":"2023-05-10T01:45:19.198621+0000","last_peered":"2023-05-10T01:45:19.198621+0000","last_clean":"2023-05-10T01:45:19.198621+0000","last_became_active":"2023-05-10T01:45:18.823098+0000","last_became_peered":"2023-05-10T01:45:18.823098+0000","last_unstale":"2023-05-10T01:45:19.198621+0000","last_undegraded":"2023-05-10T01:45:19.198621+0000","last_fullsized":"2023-05-10T01:45:19.198621+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220855+0000","last_change":"2023-05-10T01:45:19.215733+0000","last_active":"2023-05-10T01:45:19.220855+0000","last_peered":"2023-05-10T01:45:19.220855+0000","last_clean":"2023-05-10T01:45:19.220855+0000","last_became_active":"2023-05-10T01:45:19.215445+0000","last_became_peered":"2023-05-10T01:45:19.215445+0000","last_unstale":"2023-05-10T01:45:19.220855+0000","last_undegraded":"2023-05-10T01:45:19.220855+0000","last_fullsized":"2023-05-10T01:45:19.220855+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197994+0000","last_change":"2023-05-10T01:45:18.828746+0000","last_active":"2023-05-10T01:45:19.197994+0000","last_peered":"2023-05-10T01:45:19.197994+0000","last_clean":"2023-05-10T01:45:19.197994+0000","last_became_active":"2023-05-10T01:45:18.828489+0000","last_became_peered":"2023-05-10T01:45:18.828489+0000","last_unstale":"2023-05-10T01:45:19.197994+0000","last_undegraded":"2023-05-10T01:45:19.197994+0000","last_fullsized":"2023-05-10T01:45:19.197994+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217910+0000","last_change":"2023-05-10T01:45:19.217138+0000","last_active":"2023-05-10T01:45:19.217910+0000","last_peered":"2023-05-10T01:45:19.217910+0000","last_clean":"2023-05-10T01:45:19.217910+0000","last_became_active":"2023-05-10T01:45:19.215286+0000","last_became_peered":"2023-05-10T01:45:19.215286+0000","last_unstale":"2023-05-10T01:45:19.217910+0000","last_undegraded":"2023-05-10T01:45:19.217910+0000","last_fullsized":"2023-05-10T01:45:19.217910+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203107+0000","last_change":"2023-05-10T01:45:18.821338+0000","last_active":"2023-05-10T01:45:19.203107+0000","last_peered":"2023-05-10T01:45:19.203107+0000","last_clean":"2023-05-10T01:45:19.203107+0000","last_became_active":"2023-05-10T01:45:18.821075+0000","last_became_peered":"2023-05-10T01:45:18.821075+0000","last_unstale":"2023-05-10T01:45:19.203107+0000","last_undegraded":"2023-05-10T01:45:19.203107+0000","last_fullsized":"2023-05-10T01:45:19.203107+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221699+0000","last_change":"2023-05-10T01:45:19.220562+0000","last_active":"2023-05-10T01:45:19.221699+0000","last_peered":"2023-05-10T01:45:19.221699+0000","last_clean":"2023-05-10T01:45:19.221699+0000","last_became_active":"2023-05-10T01:45:19.220185+0000","last_became_peered":"2023-05-10T01:45:19.220185+0000","last_unstale":"2023-05-10T01:45:19.221699+0000","last_undegraded":"2023-05-10T01:45:19.221699+0000","last_fullsized":"2023-05-10T01:45:19.221699+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.194892+0000","last_change":"2023-05-10T01:45:18.817485+0000","last_active":"2023-05-10T01:45:19.194892+0000","last_peered":"2023-05-10T01:45:19.194892+0000","last_clean":"2023-05-10T01:45:19.194892+0000","last_became_active":"2023-05-10T01:45:18.817189+0000","last_became_peered":"2023-05-10T01:45:18.817189+0000","last_unstale":"2023-05-10T01:45:19.194892+0000","last_undegraded":"2023-05-10T01:45:19.194892+0000","last_fullsized":"2023-05-10T01:45:19.194892+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218655+0000","last_change":"2023-05-10T01:45:19.214992+0000","last_active":"2023-05-10T01:45:19.218655+0000","last_peered":"2023-05-10T01:45:19.218655+0000","last_clean":"2023-05-10T01:45:19.218655+0000","last_became_active":"2023-05-10T01:45:19.214708+0000","last_became_peered":"2023-05-10T01:45:19.214708+0000","last_unstale":"2023-05-10T01:45:19.218655+0000","last_undegraded":"2023-05-10T01:45:19.218655+0000","last_fullsized":"2023-05-10T01:45:19.218655+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214092+0000","last_change":"2023-05-10T01:45:18.827114+0000","last_active":"2023-05-10T01:45:19.214092+0000","last_peered":"2023-05-10T01:45:19.214092+0000","last_clean":"2023-05-10T01:45:19.214092+0000","last_became_active":"2023-05-10T01:45:18.826814+0000","last_became_peered":"2023-05-10T01:45:18.826814+0000","last_unstale":"2023-05-10T01:45:19.214092+0000","last_undegraded":"2023-05-10T01:45:19.214092+0000","last_fullsized":"2023-05-10T01:45:19.214092+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223229+0000","last_change":"2023-05-10T01:45:19.218013+0000","last_active":"2023-05-10T01:45:19.223229+0000","last_peered":"2023-05-10T01:45:19.223229+0000","last_clean":"2023-05-10T01:45:19.223229+0000","last_became_active":"2023-05-10T01:45:19.217054+0000","last_became_peered":"2023-05-10T01:45:19.217054+0000","last_unstale":"2023-05-10T01:45:19.223229+0000","last_undegraded":"2023-05-10T01:45:19.223229+0000","last_fullsized":"2023-05-10T01:45:19.223229+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217252+0000","last_change":"2023-05-10T01:45:18.822470+0000","last_active":"2023-05-10T01:45:19.217252+0000","last_peered":"2023-05-10T01:45:19.217252+0000","last_clean":"2023-05-10T01:45:19.217252+0000","last_became_active":"2023-05-10T01:45:18.822174+0000","last_became_peered":"2023-05-10T01:45:18.822174+0000","last_unstale":"2023-05-10T01:45:19.217252+0000","last_undegraded":"2023-05-10T01:45:19.217252+0000","last_fullsized":"2023-05-10T01:45:19.217252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219562+0000","last_change":"2023-05-10T01:45:19.212039+0000","last_active":"2023-05-10T01:45:19.219562+0000","last_peered":"2023-05-10T01:45:19.219562+0000","last_clean":"2023-05-10T01:45:19.219562+0000","last_became_active":"2023-05-10T01:45:19.211725+0000","last_became_peered":"2023-05-10T01:45:19.211725+0000","last_unstale":"2023-05-10T01:45:19.219562+0000","last_undegraded":"2023-05-10T01:45:19.219562+0000","last_fullsized":"2023-05-10T01:45:19.219562+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205208+0000","last_change":"2023-05-10T01:45:18.830987+0000","last_active":"2023-05-10T01:45:19.205208+0000","last_peered":"2023-05-10T01:45:19.205208+0000","last_clean":"2023-05-10T01:45:19.205208+0000","last_became_active":"2023-05-10T01:45:18.830748+0000","last_became_peered":"2023-05-10T01:45:18.830748+0000","last_unstale":"2023-05-10T01:45:19.205208+0000","last_undegraded":"2023-05-10T01:45:19.205208+0000","last_fullsized":"2023-05-10T01:45:19.205208+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219586+0000","last_change":"2023-05-10T01:45:19.216936+0000","last_active":"2023-05-10T01:45:19.219586+0000","last_peered":"2023-05-10T01:45:19.219586+0000","last_clean":"2023-05-10T01:45:19.219586+0000","last_became_active":"2023-05-10T01:45:19.215862+0000","last_became_peered":"2023-05-10T01:45:19.215862+0000","last_unstale":"2023-05-10T01:45:19.219586+0000","last_undegraded":"2023-05-10T01:45:19.219586+0000","last_fullsized":"2023-05-10T01:45:19.219586+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210635+0000","last_change":"2023-05-10T01:45:18.827522+0000","last_active":"2023-05-10T01:45:19.210635+0000","last_peered":"2023-05-10T01:45:19.210635+0000","last_clean":"2023-05-10T01:45:19.210635+0000","last_became_active":"2023-05-10T01:45:18.827210+0000","last_became_peered":"2023-05-10T01:45:18.827210+0000","last_unstale":"2023-05-10T01:45:19.210635+0000","last_undegraded":"2023-05-10T01:45:19.210635+0000","last_fullsized":"2023-05-10T01:45:19.210635+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222544+0000","last_change":"2023-05-10T01:45:19.216763+0000","last_active":"2023-05-10T01:45:19.222544+0000","last_peered":"2023-05-10T01:45:19.222544+0000","last_clean":"2023-05-10T01:45:19.222544+0000","last_became_active":"2023-05-10T01:45:19.216486+0000","last_became_peered":"2023-05-10T01:45:19.216486+0000","last_unstale":"2023-05-10T01:45:19.222544+0000","last_undegraded":"2023-05-10T01:45:19.222544+0000","last_fullsized":"2023-05-10T01:45:19.222544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209091+0000","last_change":"2023-05-10T01:45:18.822866+0000","last_active":"2023-05-10T01:45:19.209091+0000","last_peered":"2023-05-10T01:45:19.209091+0000","last_clean":"2023-05-10T01:45:19.209091+0000","last_became_active":"2023-05-10T01:45:18.822558+0000","last_became_peered":"2023-05-10T01:45:18.822558+0000","last_unstale":"2023-05-10T01:45:19.209091+0000","last_undegraded":"2023-05-10T01:45:19.209091+0000","last_fullsized":"2023-05-10T01:45:19.209091+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222442+0000","last_change":"2023-05-10T01:45:19.220842+0000","last_active":"2023-05-10T01:45:19.222442+0000","last_peered":"2023-05-10T01:45:19.222442+0000","last_clean":"2023-05-10T01:45:19.222442+0000","last_became_active":"2023-05-10T01:45:19.220523+0000","last_became_peered":"2023-05-10T01:45:19.220523+0000","last_unstale":"2023-05-10T01:45:19.222442+0000","last_undegraded":"2023-05-10T01:45:19.222442+0000","last_fullsized":"2023-05-10T01:45:19.222442+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197410+0000","last_change":"2023-05-10T01:45:18.819802+0000","last_active":"2023-05-10T01:45:19.197410+0000","last_peered":"2023-05-10T01:45:19.197410+0000","last_clean":"2023-05-10T01:45:19.197410+0000","last_became_active":"2023-05-10T01:45:18.819051+0000","last_became_peered":"2023-05-10T01:45:18.819051+0000","last_unstale":"2023-05-10T01:45:19.197410+0000","last_undegraded":"2023-05-10T01:45:19.197410+0000","last_fullsized":"2023-05-10T01:45:19.197410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221439+0000","last_change":"2023-05-10T01:45:19.212380+0000","last_active":"2023-05-10T01:45:19.221439+0000","last_peered":"2023-05-10T01:45:19.221439+0000","last_clean":"2023-05-10T01:45:19.221439+0000","last_became_active":"2023-05-10T01:45:19.212087+0000","last_became_peered":"2023-05-10T01:45:19.212087+0000","last_unstale":"2023-05-10T01:45:19.221439+0000","last_undegraded":"2023-05-10T01:45:19.221439+0000","last_fullsized":"2023-05-10T01:45:19.221439+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204013+0000","last_change":"2023-05-10T01:45:18.823375+0000","last_active":"2023-05-10T01:45:19.204013+0000","last_peered":"2023-05-10T01:45:19.204013+0000","last_clean":"2023-05-10T01:45:19.204013+0000","last_became_active":"2023-05-10T01:45:18.822638+0000","last_became_peered":"2023-05-10T01:45:18.822638+0000","last_unstale":"2023-05-10T01:45:19.204013+0000","last_undegraded":"2023-05-10T01:45:19.204013+0000","last_fullsized":"2023-05-10T01:45:19.204013+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223219+0000","last_change":"2023-05-10T01:45:19.221309+0000","last_active":"2023-05-10T01:45:19.223219+0000","last_peered":"2023-05-10T01:45:19.223219+0000","last_clean":"2023-05-10T01:45:19.223219+0000","last_became_active":"2023-05-10T01:45:19.221049+0000","last_became_peered":"2023-05-10T01:45:19.221049+0000","last_unstale":"2023-05-10T01:45:19.223219+0000","last_undegraded":"2023-05-10T01:45:19.223219+0000","last_fullsized":"2023-05-10T01:45:19.223219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198348+0000","last_change":"2023-05-10T01:45:18.819534+0000","last_active":"2023-05-10T01:45:19.198348+0000","last_peered":"2023-05-10T01:45:19.198348+0000","last_clean":"2023-05-10T01:45:19.198348+0000","last_became_active":"2023-05-10T01:45:18.818481+0000","last_became_peered":"2023-05-10T01:45:18.818481+0000","last_unstale":"2023-05-10T01:45:19.198348+0000","last_undegraded":"2023-05-10T01:45:19.198348+0000","last_fullsized":"2023-05-10T01:45:19.198348+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220160+0000","last_change":"2023-05-10T01:45:19.209740+0000","last_active":"2023-05-10T01:45:19.220160+0000","last_peered":"2023-05-10T01:45:19.220160+0000","last_clean":"2023-05-10T01:45:19.220160+0000","last_became_active":"2023-05-10T01:45:19.209468+0000","last_became_peered":"2023-05-10T01:45:19.209468+0000","last_unstale":"2023-05-10T01:45:19.220160+0000","last_undegraded":"2023-05-10T01:45:19.220160+0000","last_fullsized":"2023-05-10T01:45:19.220160+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220641+0000","last_change":"2023-05-10T01:45:18.827299+0000","last_active":"2023-05-10T01:45:19.220641+0000","last_peered":"2023-05-10T01:45:19.220641+0000","last_clean":"2023-05-10T01:45:19.220641+0000","last_became_active":"2023-05-10T01:45:18.827012+0000","last_became_peered":"2023-05-10T01:45:18.827012+0000","last_unstale":"2023-05-10T01:45:19.220641+0000","last_undegraded":"2023-05-10T01:45:19.220641+0000","last_fullsized":"2023-05-10T01:45:19.220641+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220944+0000","last_change":"2023-05-10T01:45:19.215429+0000","last_active":"2023-05-10T01:45:19.220944+0000","last_peered":"2023-05-10T01:45:19.220944+0000","last_clean":"2023-05-10T01:45:19.220944+0000","last_became_active":"2023-05-10T01:45:19.215142+0000","last_became_peered":"2023-05-10T01:45:19.215142+0000","last_unstale":"2023-05-10T01:45:19.220944+0000","last_undegraded":"2023-05-10T01:45:19.220944+0000","last_fullsized":"2023-05-10T01:45:19.220944+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203643+0000","last_change":"2023-05-10T01:45:18.823876+0000","last_active":"2023-05-10T01:45:19.203643+0000","last_peered":"2023-05-10T01:45:19.203643+0000","last_clean":"2023-05-10T01:45:19.203643+0000","last_became_active":"2023-05-10T01:45:18.823602+0000","last_became_peered":"2023-05-10T01:45:18.823602+0000","last_unstale":"2023-05-10T01:45:19.203643+0000","last_undegraded":"2023-05-10T01:45:19.203643+0000","last_fullsized":"2023-05-10T01:45:19.203643+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221685+0000","last_change":"2023-05-10T01:45:19.219685+0000","last_active":"2023-05-10T01:45:19.221685+0000","last_peered":"2023-05-10T01:45:19.221685+0000","last_clean":"2023-05-10T01:45:19.221685+0000","last_became_active":"2023-05-10T01:45:19.219356+0000","last_became_peered":"2023-05-10T01:45:19.219356+0000","last_unstale":"2023-05-10T01:45:19.221685+0000","last_undegraded":"2023-05-10T01:45:19.221685+0000","last_fullsized":"2023-05-10T01:45:19.221685+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205328+0000","last_change":"2023-05-10T01:45:18.819295+0000","last_active":"2023-05-10T01:45:19.205328+0000","last_peered":"2023-05-10T01:45:19.205328+0000","last_clean":"2023-05-10T01:45:19.205328+0000","last_became_active":"2023-05-10T01:45:18.819022+0000","last_became_peered":"2023-05-10T01:45:18.819022+0000","last_unstale":"2023-05-10T01:45:19.205328+0000","last_undegraded":"2023-05-10T01:45:19.205328+0000","last_fullsized":"2023-05-10T01:45:19.205328+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217946+0000","last_change":"2023-05-10T01:45:19.215575+0000","last_active":"2023-05-10T01:45:19.217946+0000","last_peered":"2023-05-10T01:45:19.217946+0000","last_clean":"2023-05-10T01:45:19.217946+0000","last_became_active":"2023-05-10T01:45:19.215194+0000","last_became_peered":"2023-05-10T01:45:19.215194+0000","last_unstale":"2023-05-10T01:45:19.217946+0000","last_undegraded":"2023-05-10T01:45:19.217946+0000","last_fullsized":"2023-05-10T01:45:19.217946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.196977+0000","last_change":"2023-05-10T01:45:18.820590+0000","last_active":"2023-05-10T01:45:19.196977+0000","last_peered":"2023-05-10T01:45:19.196977+0000","last_clean":"2023-05-10T01:45:19.196977+0000","last_became_active":"2023-05-10T01:45:18.818788+0000","last_became_peered":"2023-05-10T01:45:18.818788+0000","last_unstale":"2023-05-10T01:45:19.196977+0000","last_undegraded":"2023-05-10T01:45:19.196977+0000","last_fullsized":"2023-05-10T01:45:19.196977+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217751+0000","last_change":"2023-05-10T01:45:19.211133+0000","last_active":"2023-05-10T01:45:19.217751+0000","last_peered":"2023-05-10T01:45:19.217751+0000","last_clean":"2023-05-10T01:45:19.217751+0000","last_became_active":"2023-05-10T01:45:19.210585+0000","last_became_peered":"2023-05-10T01:45:19.210585+0000","last_unstale":"2023-05-10T01:45:19.217751+0000","last_undegraded":"2023-05-10T01:45:19.217751+0000","last_fullsized":"2023-05-10T01:45:19.217751+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203258+0000","last_change":"2023-05-10T01:45:18.816454+0000","last_active":"2023-05-10T01:45:19.203258+0000","last_peered":"2023-05-10T01:45:19.203258+0000","last_clean":"2023-05-10T01:45:19.203258+0000","last_became_active":"2023-05-10T01:45:18.816162+0000","last_became_peered":"2023-05-10T01:45:18.816162+0000","last_unstale":"2023-05-10T01:45:19.203258+0000","last_undegraded":"2023-05-10T01:45:19.203258+0000","last_fullsized":"2023-05-10T01:45:19.203258+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220835+0000","last_change":"2023-05-10T01:45:19.214722+0000","last_active":"2023-05-10T01:45:19.220835+0000","last_peered":"2023-05-10T01:45:19.220835+0000","last_clean":"2023-05-10T01:45:19.220835+0000","last_became_active":"2023-05-10T01:45:19.214448+0000","last_became_peered":"2023-05-10T01:45:19.214448+0000","last_unstale":"2023-05-10T01:45:19.220835+0000","last_undegraded":"2023-05-10T01:45:19.220835+0000","last_fullsized":"2023-05-10T01:45:19.220835+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199242+0000","last_change":"2023-05-10T01:45:18.825786+0000","last_active":"2023-05-10T01:45:19.199242+0000","last_peered":"2023-05-10T01:45:19.199242+0000","last_clean":"2023-05-10T01:45:19.199242+0000","last_became_active":"2023-05-10T01:45:18.825527+0000","last_became_peered":"2023-05-10T01:45:18.825527+0000","last_unstale":"2023-05-10T01:45:19.199242+0000","last_undegraded":"2023-05-10T01:45:19.199242+0000","last_fullsized":"2023-05-10T01:45:19.199242+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.215173+0000","last_change":"2023-05-10T01:45:19.213833+0000","last_active":"2023-05-10T01:45:19.215173+0000","last_peered":"2023-05-10T01:45:19.215173+0000","last_clean":"2023-05-10T01:45:19.215173+0000","last_became_active":"2023-05-10T01:45:19.213561+0000","last_became_peered":"2023-05-10T01:45:19.213561+0000","last_unstale":"2023-05-10T01:45:19.215173+0000","last_undegraded":"2023-05-10T01:45:19.215173+0000","last_fullsized":"2023-05-10T01:45:19.215173+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203206+0000","last_change":"2023-05-10T01:45:18.824463+0000","last_active":"2023-05-10T01:45:19.203206+0000","last_peered":"2023-05-10T01:45:19.203206+0000","last_clean":"2023-05-10T01:45:19.203206+0000","last_became_active":"2023-05-10T01:45:18.824185+0000","last_became_peered":"2023-05-10T01:45:18.824185+0000","last_unstale":"2023-05-10T01:45:19.203206+0000","last_undegraded":"2023-05-10T01:45:19.203206+0000","last_fullsized":"2023-05-10T01:45:19.203206+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206521+0000","last_change":"2023-05-10T01:45:19.204499+0000","last_active":"2023-05-10T01:45:19.206521+0000","last_peered":"2023-05-10T01:45:19.206521+0000","last_clean":"2023-05-10T01:45:19.206521+0000","last_became_active":"2023-05-10T01:45:19.204073+0000","last_became_peered":"2023-05-10T01:45:19.204073+0000","last_unstale":"2023-05-10T01:45:19.206521+0000","last_undegraded":"2023-05-10T01:45:19.206521+0000","last_fullsized":"2023-05-10T01:45:19.206521+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205057+0000","last_change":"2023-05-10T01:45:18.825086+0000","last_active":"2023-05-10T01:45:19.205057+0000","last_peered":"2023-05-10T01:45:19.205057+0000","last_clean":"2023-05-10T01:45:19.205057+0000","last_became_active":"2023-05-10T01:45:18.823740+0000","last_became_peered":"2023-05-10T01:45:18.823740+0000","last_unstale":"2023-05-10T01:45:19.205057+0000","last_undegraded":"2023-05-10T01:45:19.205057+0000","last_fullsized":"2023-05-10T01:45:19.205057+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217733+0000","last_change":"2023-05-10T01:45:19.210772+0000","last_active":"2023-05-10T01:45:19.217733+0000","last_peered":"2023-05-10T01:45:19.217733+0000","last_clean":"2023-05-10T01:45:19.217733+0000","last_became_active":"2023-05-10T01:45:19.210203+0000","last_became_peered":"2023-05-10T01:45:19.210203+0000","last_unstale":"2023-05-10T01:45:19.217733+0000","last_undegraded":"2023-05-10T01:45:19.217733+0000","last_fullsized":"2023-05-10T01:45:19.217733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.212162+0000","last_change":"2023-05-10T01:45:18.816038+0000","last_active":"2023-05-10T01:45:19.212162+0000","last_peered":"2023-05-10T01:45:19.212162+0000","last_clean":"2023-05-10T01:45:19.212162+0000","last_became_active":"2023-05-10T01:45:18.815608+0000","last_became_peered":"2023-05-10T01:45:18.815608+0000","last_unstale":"2023-05-10T01:45:19.212162+0000","last_undegraded":"2023-05-10T01:45:19.212162+0000","last_fullsized":"2023-05-10T01:45:19.212162+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203063+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:19.203063+0000","last_peered":"2023-05-10T01:45:19.203063+0000","last_clean":"2023-05-10T01:45:19.203063+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:19.203063+0000","last_undegraded":"2023-05-10T01:45:19.203063+0000","last_fullsized":"2023-05-10T01:45:19.203063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217118+0000","last_change":"2023-05-10T01:45:19.208138+0000","last_active":"2023-05-10T01:45:19.217118+0000","last_peered":"2023-05-10T01:45:19.217118+0000","last_clean":"2023-05-10T01:45:19.217118+0000","last_became_active":"2023-05-10T01:45:19.207851+0000","last_became_peered":"2023-05-10T01:45:19.207851+0000","last_unstale":"2023-05-10T01:45:19.217118+0000","last_undegraded":"2023-05-10T01:45:19.217118+0000","last_fullsized":"2023-05-10T01:45:19.217118+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210930+0000","last_change":"2023-05-10T01:45:18.820670+0000","last_active":"2023-05-10T01:45:19.210930+0000","last_peered":"2023-05-10T01:45:19.210930+0000","last_clean":"2023-05-10T01:45:19.210930+0000","last_became_active":"2023-05-10T01:45:18.820163+0000","last_became_peered":"2023-05-10T01:45:18.820163+0000","last_unstale":"2023-05-10T01:45:19.210930+0000","last_undegraded":"2023-05-10T01:45:19.210930+0000","last_fullsized":"2023-05-10T01:45:19.210930+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202806+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:19.202806+0000","last_peered":"2023-05-10T01:45:19.202806+0000","last_clean":"2023-05-10T01:45:19.202806+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:19.202806+0000","last_undegraded":"2023-05-10T01:45:19.202806+0000","last_fullsized":"2023-05-10T01:45:19.202806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218992+0000","last_change":"2023-05-10T01:45:19.210423+0000","last_active":"2023-05-10T01:45:19.218992+0000","last_peered":"2023-05-10T01:45:19.218992+0000","last_clean":"2023-05-10T01:45:19.218992+0000","last_became_active":"2023-05-10T01:45:19.210184+0000","last_became_peered":"2023-05-10T01:45:19.210184+0000","last_unstale":"2023-05-10T01:45:19.218992+0000","last_undegraded":"2023-05-10T01:45:19.218992+0000","last_fullsized":"2023-05-10T01:45:19.218992+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203758+0000","last_change":"2023-05-10T01:45:18.824998+0000","last_active":"2023-05-10T01:45:19.203758+0000","last_peered":"2023-05-10T01:45:19.203758+0000","last_clean":"2023-05-10T01:45:19.203758+0000","last_became_active":"2023-05-10T01:45:18.824704+0000","last_became_peered":"2023-05-10T01:45:18.824704+0000","last_unstale":"2023-05-10T01:45:19.203758+0000","last_undegraded":"2023-05-10T01:45:19.203758+0000","last_fullsized":"2023-05-10T01:45:19.203758+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200157+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:19.200157+0000","last_peered":"2023-05-10T01:45:19.200157+0000","last_clean":"2023-05-10T01:45:19.200157+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:19.200157+0000","last_undegraded":"2023-05-10T01:45:19.200157+0000","last_fullsized":"2023-05-10T01:45:19.200157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222813+0000","last_change":"2023-05-10T01:45:19.219736+0000","last_active":"2023-05-10T01:45:19.222813+0000","last_peered":"2023-05-10T01:45:19.222813+0000","last_clean":"2023-05-10T01:45:19.222813+0000","last_became_active":"2023-05-10T01:45:19.219448+0000","last_became_peered":"2023-05-10T01:45:19.219448+0000","last_unstale":"2023-05-10T01:45:19.222813+0000","last_undegraded":"2023-05-10T01:45:19.222813+0000","last_fullsized":"2023-05-10T01:45:19.222813+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218109+0000","last_change":"2023-05-10T01:45:18.819070+0000","last_active":"2023-05-10T01:45:19.218109+0000","last_peered":"2023-05-10T01:45:19.218109+0000","last_clean":"2023-05-10T01:45:19.218109+0000","last_became_active":"2023-05-10T01:45:18.818756+0000","last_became_peered":"2023-05-10T01:45:18.818756+0000","last_unstale":"2023-05-10T01:45:19.218109+0000","last_undegraded":"2023-05-10T01:45:19.218109+0000","last_fullsized":"2023-05-10T01:45:19.218109+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203298+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:19.203298+0000","last_peered":"2023-05-10T01:45:19.203298+0000","last_clean":"2023-05-10T01:45:19.203298+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:19.203298+0000","last_undegraded":"2023-05-10T01:45:19.203298+0000","last_fullsized":"2023-05-10T01:45:19.203298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205057+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:19.205057+0000","last_peered":"2023-05-10T01:45:19.205057+0000","last_clean":"2023-05-10T01:45:19.205057+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:19.205057+0000","last_undegraded":"2023-05-10T01:45:19.205057+0000","last_fullsized":"2023-05-10T01:45:19.205057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.208474+0000","last_change":"2023-05-10T01:45:19.205432+0000","last_active":"2023-05-10T01:45:19.208474+0000","last_peered":"2023-05-10T01:45:19.208474+0000","last_clean":"2023-05-10T01:45:19.208474+0000","last_became_active":"2023-05-10T01:45:19.204307+0000","last_became_peered":"2023-05-10T01:45:19.204307+0000","last_unstale":"2023-05-10T01:45:19.208474+0000","last_undegraded":"2023-05-10T01:45:19.208474+0000","last_fullsized":"2023-05-10T01:45:19.208474+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207346+0000","last_change":"2023-05-10T01:45:18.820200+0000","last_active":"2023-05-10T01:45:19.207346+0000","last_peered":"2023-05-10T01:45:19.207346+0000","last_clean":"2023-05-10T01:45:19.207346+0000","last_became_active":"2023-05-10T01:45:18.819546+0000","last_became_peered":"2023-05-10T01:45:18.819546+0000","last_unstale":"2023-05-10T01:45:19.207346+0000","last_undegraded":"2023-05-10T01:45:19.207346+0000","last_fullsized":"2023-05-10T01:45:19.207346+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205144+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:19.205144+0000","last_peered":"2023-05-10T01:45:19.205144+0000","last_clean":"2023-05-10T01:45:19.205144+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:19.205144+0000","last_undegraded":"2023-05-10T01:45:19.205144+0000","last_fullsized":"2023-05-10T01:45:19.205144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217523+0000","last_change":"2023-05-10T01:45:19.215966+0000","last_active":"2023-05-10T01:45:19.217523+0000","last_peered":"2023-05-10T01:45:19.217523+0000","last_clean":"2023-05-10T01:45:19.217523+0000","last_became_active":"2023-05-10T01:45:19.215718+0000","last_became_peered":"2023-05-10T01:45:19.215718+0000","last_unstale":"2023-05-10T01:45:19.217523+0000","last_undegraded":"2023-05-10T01:45:19.217523+0000","last_fullsized":"2023-05-10T01:45:19.217523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209808+0000","last_change":"2023-05-10T01:45:18.826710+0000","last_active":"2023-05-10T01:45:19.209808+0000","last_peered":"2023-05-10T01:45:19.209808+0000","last_clean":"2023-05-10T01:45:19.209808+0000","last_became_active":"2023-05-10T01:45:18.826416+0000","last_became_peered":"2023-05-10T01:45:18.826416+0000","last_unstale":"2023-05-10T01:45:19.209808+0000","last_undegraded":"2023-05-10T01:45:19.209808+0000","last_fullsized":"2023-05-10T01:45:19.209808+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207139+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:19.207139+0000","last_peered":"2023-05-10T01:45:19.207139+0000","last_clean":"2023-05-10T01:45:19.207139+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:19.207139+0000","last_undegraded":"2023-05-10T01:45:19.207139+0000","last_fullsized":"2023-05-10T01:45:19.207139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217511+0000","last_change":"2023-05-10T01:45:19.208997+0000","last_active":"2023-05-10T01:45:19.217511+0000","last_peered":"2023-05-10T01:45:19.217511+0000","last_clean":"2023-05-10T01:45:19.217511+0000","last_became_active":"2023-05-10T01:45:19.208729+0000","last_became_peered":"2023-05-10T01:45:19.208729+0000","last_unstale":"2023-05-10T01:45:19.217511+0000","last_undegraded":"2023-05-10T01:45:19.217511+0000","last_fullsized":"2023-05-10T01:45:19.217511+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203383+0000","last_change":"2023-05-10T01:45:18.825979+0000","last_active":"2023-05-10T01:45:19.203383+0000","last_peered":"2023-05-10T01:45:19.203383+0000","last_clean":"2023-05-10T01:45:19.203383+0000","last_became_active":"2023-05-10T01:45:18.825702+0000","last_became_peered":"2023-05-10T01:45:18.825702+0000","last_unstale":"2023-05-10T01:45:19.203383+0000","last_undegraded":"2023-05-10T01:45:19.203383+0000","last_fullsized":"2023-05-10T01:45:19.203383+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202955+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:19.202955+0000","last_peered":"2023-05-10T01:45:19.202955+0000","last_clean":"2023-05-10T01:45:19.202955+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:19.202955+0000","last_undegraded":"2023-05-10T01:45:19.202955+0000","last_fullsized":"2023-05-10T01:45:19.202955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216745+0000","last_change":"2023-05-10T01:45:19.214518+0000","last_active":"2023-05-10T01:45:19.216745+0000","last_peered":"2023-05-10T01:45:19.216745+0000","last_clean":"2023-05-10T01:45:19.216745+0000","last_became_active":"2023-05-10T01:45:19.214194+0000","last_became_peered":"2023-05-10T01:45:19.214194+0000","last_unstale":"2023-05-10T01:45:19.216745+0000","last_undegraded":"2023-05-10T01:45:19.216745+0000","last_fullsized":"2023-05-10T01:45:19.216745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216751+0000","last_change":"2023-05-10T01:45:18.820578+0000","last_active":"2023-05-10T01:45:19.216751+0000","last_peered":"2023-05-10T01:45:19.216751+0000","last_clean":"2023-05-10T01:45:19.216751+0000","last_became_active":"2023-05-10T01:45:18.820022+0000","last_became_peered":"2023-05-10T01:45:18.820022+0000","last_unstale":"2023-05-10T01:45:19.216751+0000","last_undegraded":"2023-05-10T01:45:19.216751+0000","last_fullsized":"2023-05-10T01:45:19.216751+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211739+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:19.211739+0000","last_peered":"2023-05-10T01:45:19.211739+0000","last_clean":"2023-05-10T01:45:19.211739+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:19.211739+0000","last_undegraded":"2023-05-10T01:45:19.211739+0000","last_fullsized":"2023-05-10T01:45:19.211739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575268,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21008,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18880,"kb_avail":94350832,"statfs":{"total":96636764160,"available":96615251968,"internally_reserved":0,"allocated":2170880,"data_stored":1119900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19333120},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.624},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.44}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575267,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20612,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351228,"statfs":{"total":96636764160,"available":96615657472,"internally_reserved":0,"allocated":2158592,"data_stored":1118432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.372},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.77300000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":1.208,"15min":1.208},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":1.284},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.72599999999999998,"15min":1.3360000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.435},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":1.3620000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.3120000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.995,"15min":1.2729999999999999},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575267,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24332,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347508,"statfs":{"total":96636764160,"available":96611848192,"internally_reserved":0,"allocated":2166784,"data_stored":1119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.621}]},{"osd":2,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":1.1200000000000001,"15min":1.357},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.90900000000000003,"5min":1.171,"15min":1.226},"last":0.77600000000000002}]},{"osd":5,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.872,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80900000000000005}]},{"osd":6,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.008,"15min":1.008},"last":0.878},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":1.1830000000000001,"15min":1.403},"last":0.94899999999999995}]},{"osd":7,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.82599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575267,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24788,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":94347052,"statfs":{"total":96636764160,"available":96611381248,"internally_reserved":0,"allocated":2174976,"data_stored":1119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.379},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575267,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26000,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":23872,"kb_avail":94345840,"statfs":{"total":96636764160,"available":96610140160,"internally_reserved":0,"allocated":2170880,"data_stored":1118614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24444928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.308},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.374}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834575267,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32840,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":94339000,"statfs":{"total":96636764160,"available":96603136000,"internally_reserved":0,"allocated":2162688,"data_stored":1118466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.252},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.36199999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.52900000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20748,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351092,"statfs":{"total":96636764160,"available":96615518208,"internally_reserved":0,"allocated":2166784,"data_stored":1119076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.497}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.442}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575269,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23816,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348024,"statfs":{"total":96636764160,"available":96612376576,"internally_reserved":0,"allocated":2162688,"data_stored":1119324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.80400000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.79500000000000004},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.82799999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.75,"15min":0.88600000000000001},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.624,"15min":0.628},"min":{"1min":0.441,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.66600000000000004,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.65600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.55200000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.60999999999999999,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":0.76000000000000001,"15min":0.89200000000000002},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:27.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.857+0000 7fca655f8700 1 Processor -- start 2023-05-10T01:45:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 -- start start 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca60069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca60063e20 0x7fca60062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca60062950 con 0x7fca600bf4e0 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca60154410 con 0x7fca60063e20 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.858+0000 7fca655f8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca60069fa0 con 0x7fca60154030 2023-05-10T01:45:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5e7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca600bf4e0 0x7fca60063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51452/0 (socket says 172.21.15.52:51452) 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5e7fc700 1 -- 172.21.15.52:0/471626434 learned_addr learned my addr 172.21.15.52:0/471626434 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5effd700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca60069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> v2:172.21.15.172:3300/0 conn(0x7fca60063e20 0x7fca60062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927216568 0 0) 0x7fca60062950 con 0x7fca600bf4e0 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca400033f0 con 0x7fca600bf4e0 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641914493 0 0) 0x7fca400033f0 con 0x7fca600bf4e0 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 msgr2=0x7fca60069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca60069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 >> v2:172.21.15.172:3300/0 conn(0x7fca60063e20 msgr2=0x7fca60062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 --2- 172.21.15.52:0/471626434 >> v2:172.21.15.172:3300/0 conn(0x7fca60063e20 0x7fca60062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60062340 con 0x7fca600bf4e0 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fca48001470 con 0x7fca600bf4e0 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> v2:172.21.15.172:3300/0 conn(0x7fca60063e20 0x7fca60062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 >> v1:172.21.15.52:6789/0 conn(0x7fca600bf4e0 legacy=0x7fca60063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca400038e0 0x7fca40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca40004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca40004b80 0x7fca40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca60069fa0 con 0x7fca40004b80 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400044c0 con 0x7fca400038e0 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4000b930 con 0x7fca60154030 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca40004b80 0x7fca40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5effd700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca400038e0 0x7fca40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.859+0000 7fca5e7fc700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca40004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 -- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 msgr2=0x7fca40004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca60154030 0x7fca40004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 -- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca400038e0 msgr2=0x7fca40003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca400038e0 0x7fca40003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 -- 172.21.15.52:0/471626434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400033f0 con 0x7fca40004b80 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca40004b80 0x7fca40005000 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fca50009c70 tx=0x7fca50009060).ready entity=mon.0 client_cookie=1e9b19a636f5fead server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:27.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500095c0 con 0x7fca40004b80 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000e6f0 con 0x7fca40004b80 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5dffb700 1 -- 172.21.15.52:0/471626434 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000ea70 con 0x7fca40004b80 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca655f8700 1 -- 172.21.15.52:0/471626434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca40004b80 msgr2=0x7fca40005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca655f8700 1 --2- 172.21.15.52:0/471626434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca40004b80 0x7fca40005000 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fca50009c70 tx=0x7fca50009060).stop 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca5f7fe700 1 -- 172.21.15.52:0/471626434 reap_dead start 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca655f8700 1 -- 172.21.15.52:0/471626434 shutdown_connections 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.860+0000 7fca655f8700 1 -- 172.21.15.52:0/471626434 >> 172.21.15.52:0/471626434 conn(0x7fca600c8a90 msgr2=0x7fca600c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:27.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.861+0000 7fca655f8700 1 -- 172.21.15.52:0/471626434 shutdown_connections 2023-05-10T01:45:27.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.861+0000 7fca655f8700 1 -- 172.21.15.52:0/471626434 wait complete. 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.862+0000 7fca655f8700 1 Processor -- start 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.862+0000 7fca655f8700 1 -- start start 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 0x7fca60167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca600a6e80 0x7fca600c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600c19c0 con 0x7fca600c7550 2023-05-10T01:45:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600a7300 con 0x7fca60167a20 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca600c2220 con 0x7fca600a6e80 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42452/0 (socket says 172.21.15.52:42452) 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 -- 172.21.15.52:0/3020991257 learned_addr learned my addr 172.21.15.52:0/3020991257 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5e7fc700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca600a6e80 0x7fca600c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5effd700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 0x7fca60167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 -- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca600a6e80 msgr2=0x7fca600c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca600a6e80 0x7fca600c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 -- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 msgr2=0x7fca60167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 0x7fca60167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 -- 172.21.15.52:0/3020991257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600a7520 con 0x7fca600c7550 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5effd700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 0x7fca60167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca5f7fe700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fca50014000 tx=0x7fca50019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500095c0 con 0x7fca600c7550 2023-05-10T01:45:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000e860 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca600c1bd0 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50024600 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.863+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca600c7e80 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.864+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca600c2390 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.865+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fca5002b030 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.865+0000 7fca56ffd700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 0x7fca44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.865+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fca5007b120 con 0x7fca600c7550 2023-05-10T01:45:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.865+0000 7fca5effd700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 0x7fca44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.866+0000 7fca5effd700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 0x7fca44061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fca58009fd0 tx=0x7fca5800b040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:27.869+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca5004c650 con 0x7fca600c7550 2023-05-10T01:45:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.039+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca600c2070 con 0x7fca4405ed90 2023-05-10T01:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.049+0000 7fca56ffd700 1 -- 172.21.15.52:0/3020991257 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361735 (secure 0 0 0) 0x7fca600c2070 con 0x7fca4405ed90 2023-05-10T01:45:28.055 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 msgr2=0x7fca44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 0x7fca44061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fca58009fd0 tx=0x7fca5800b040).stop 2023-05-10T01:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 msgr2=0x7fca600c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fca50014000 tx=0x7fca50019000).stop 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 shutdown_connections 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fca4405ed90 0x7fca44061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca600c7550 0x7fca600c7990 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca60167a20 0x7fca60167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 --2- 172.21.15.52:0/3020991257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca600a6e80 0x7fca600c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 >> 172.21.15.52:0/3020991257 conn(0x7fca600c8a90 msgr2=0x7fca600a7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 shutdown_connections 2023-05-10T01:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.052+0000 7fca655f8700 1 -- 172.21.15.52:0/3020991257 wait complete. 2023-05-10T01:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:28.066 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-10T01:45:27.951003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":194144,"kb_used_data":16928,"kb_used_omap":0,"kb_used_meta":177152,"kb_avail":754780576,"statfs":{"total":773094113280,"available":772895309824,"internally_reserved":0,"allocated":17334272,"data_stored":8952068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181403648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27877,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.225686"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222966+0000","last_change":"2023-05-10T01:45:19.220084+0000","last_active":"2023-05-10T01:45:19.222966+0000","last_peered":"2023-05-10T01:45:19.222966+0000","last_clean":"2023-05-10T01:45:19.222966+0000","last_became_active":"2023-05-10T01:45:19.219808+0000","last_became_peered":"2023-05-10T01:45:19.219808+0000","last_unstale":"2023-05-10T01:45:19.222966+0000","last_undegraded":"2023-05-10T01:45:19.222966+0000","last_fullsized":"2023-05-10T01:45:19.222966+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223143+0000","last_change":"2023-05-10T01:45:18.818402+0000","last_active":"2023-05-10T01:45:19.223143+0000","last_peered":"2023-05-10T01:45:19.223143+0000","last_clean":"2023-05-10T01:45:19.223143+0000","last_became_active":"2023-05-10T01:45:18.818138+0000","last_became_peered":"2023-05-10T01:45:18.818138+0000","last_unstale":"2023-05-10T01:45:19.223143+0000","last_undegraded":"2023-05-10T01:45:19.223143+0000","last_fullsized":"2023-05-10T01:45:19.223143+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222790+0000","last_change":"2023-05-10T01:45:19.220886+0000","last_active":"2023-05-10T01:45:19.222790+0000","last_peered":"2023-05-10T01:45:19.222790+0000","last_clean":"2023-05-10T01:45:19.222790+0000","last_became_active":"2023-05-10T01:45:19.220574+0000","last_became_peered":"2023-05-10T01:45:19.220574+0000","last_unstale":"2023-05-10T01:45:19.222790+0000","last_undegraded":"2023-05-10T01:45:19.222790+0000","last_fullsized":"2023-05-10T01:45:19.222790+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197529+0000","last_change":"2023-05-10T01:45:18.814168+0000","last_active":"2023-05-10T01:45:19.197529+0000","last_peered":"2023-05-10T01:45:19.197529+0000","last_clean":"2023-05-10T01:45:19.197529+0000","last_became_active":"2023-05-10T01:45:18.813893+0000","last_became_peered":"2023-05-10T01:45:18.813893+0000","last_unstale":"2023-05-10T01:45:19.197529+0000","last_undegraded":"2023-05-10T01:45:19.197529+0000","last_fullsized":"2023-05-10T01:45:19.197529+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217312+0000","last_change":"2023-05-10T01:45:19.215949+0000","last_active":"2023-05-10T01:45:19.217312+0000","last_peered":"2023-05-10T01:45:19.217312+0000","last_clean":"2023-05-10T01:45:19.217312+0000","last_became_active":"2023-05-10T01:45:19.215683+0000","last_became_peered":"2023-05-10T01:45:19.215683+0000","last_unstale":"2023-05-10T01:45:19.217312+0000","last_undegraded":"2023-05-10T01:45:19.217312+0000","last_fullsized":"2023-05-10T01:45:19.217312+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203265+0000","last_change":"2023-05-10T01:45:18.821662+0000","last_active":"2023-05-10T01:45:19.203265+0000","last_peered":"2023-05-10T01:45:19.203265+0000","last_clean":"2023-05-10T01:45:19.203265+0000","last_became_active":"2023-05-10T01:45:18.821367+0000","last_became_peered":"2023-05-10T01:45:18.821367+0000","last_unstale":"2023-05-10T01:45:19.203265+0000","last_undegraded":"2023-05-10T01:45:19.203265+0000","last_fullsized":"2023-05-10T01:45:19.203265+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219566+0000","last_change":"2023-05-10T01:45:19.216473+0000","last_active":"2023-05-10T01:45:19.219566+0000","last_peered":"2023-05-10T01:45:19.219566+0000","last_clean":"2023-05-10T01:45:19.219566+0000","last_became_active":"2023-05-10T01:45:19.216143+0000","last_became_peered":"2023-05-10T01:45:19.216143+0000","last_unstale":"2023-05-10T01:45:19.219566+0000","last_undegraded":"2023-05-10T01:45:19.219566+0000","last_fullsized":"2023-05-10T01:45:19.219566+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219791+0000","last_change":"2023-05-10T01:45:18.830114+0000","last_active":"2023-05-10T01:45:19.219791+0000","last_peered":"2023-05-10T01:45:19.219791+0000","last_clean":"2023-05-10T01:45:19.219791+0000","last_became_active":"2023-05-10T01:45:18.829808+0000","last_became_peered":"2023-05-10T01:45:18.829808+0000","last_unstale":"2023-05-10T01:45:19.219791+0000","last_undegraded":"2023-05-10T01:45:19.219791+0000","last_fullsized":"2023-05-10T01:45:19.219791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219269+0000","last_change":"2023-05-10T01:45:19.215773+0000","last_active":"2023-05-10T01:45:19.219269+0000","last_peered":"2023-05-10T01:45:19.219269+0000","last_clean":"2023-05-10T01:45:19.219269+0000","last_became_active":"2023-05-10T01:45:19.215351+0000","last_became_peered":"2023-05-10T01:45:19.215351+0000","last_unstale":"2023-05-10T01:45:19.219269+0000","last_undegraded":"2023-05-10T01:45:19.219269+0000","last_fullsized":"2023-05-10T01:45:19.219269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222094+0000","last_change":"2023-05-10T01:45:18.820192+0000","last_active":"2023-05-10T01:45:19.222094+0000","last_peered":"2023-05-10T01:45:19.222094+0000","last_clean":"2023-05-10T01:45:19.222094+0000","last_became_active":"2023-05-10T01:45:18.819911+0000","last_became_peered":"2023-05-10T01:45:18.819911+0000","last_unstale":"2023-05-10T01:45:19.222094+0000","last_undegraded":"2023-05-10T01:45:19.222094+0000","last_fullsized":"2023-05-10T01:45:19.222094+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218692+0000","last_change":"2023-05-10T01:45:19.213120+0000","last_active":"2023-05-10T01:45:19.218692+0000","last_peered":"2023-05-10T01:45:19.218692+0000","last_clean":"2023-05-10T01:45:19.218692+0000","last_became_active":"2023-05-10T01:45:19.211868+0000","last_became_peered":"2023-05-10T01:45:19.211868+0000","last_unstale":"2023-05-10T01:45:19.218692+0000","last_undegraded":"2023-05-10T01:45:19.218692+0000","last_fullsized":"2023-05-10T01:45:19.218692+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221189+0000","last_change":"2023-05-10T01:45:18.827571+0000","last_active":"2023-05-10T01:45:19.221189+0000","last_peered":"2023-05-10T01:45:19.221189+0000","last_clean":"2023-05-10T01:45:19.221189+0000","last_became_active":"2023-05-10T01:45:18.827216+0000","last_became_peered":"2023-05-10T01:45:18.827216+0000","last_unstale":"2023-05-10T01:45:19.221189+0000","last_undegraded":"2023-05-10T01:45:19.221189+0000","last_fullsized":"2023-05-10T01:45:19.221189+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217523+0000","last_change":"2023-05-10T01:45:19.209679+0000","last_active":"2023-05-10T01:45:19.217523+0000","last_peered":"2023-05-10T01:45:19.217523+0000","last_clean":"2023-05-10T01:45:19.217523+0000","last_became_active":"2023-05-10T01:45:19.209416+0000","last_became_peered":"2023-05-10T01:45:19.209416+0000","last_unstale":"2023-05-10T01:45:19.217523+0000","last_undegraded":"2023-05-10T01:45:19.217523+0000","last_fullsized":"2023-05-10T01:45:19.217523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203912+0000","last_change":"2023-05-10T01:45:18.823558+0000","last_active":"2023-05-10T01:45:19.203912+0000","last_peered":"2023-05-10T01:45:19.203912+0000","last_clean":"2023-05-10T01:45:19.203912+0000","last_became_active":"2023-05-10T01:45:18.823058+0000","last_became_peered":"2023-05-10T01:45:18.823058+0000","last_unstale":"2023-05-10T01:45:19.203912+0000","last_undegraded":"2023-05-10T01:45:19.203912+0000","last_fullsized":"2023-05-10T01:45:19.203912+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219379+0000","last_change":"2023-05-10T01:45:19.211768+0000","last_active":"2023-05-10T01:45:19.219379+0000","last_peered":"2023-05-10T01:45:19.219379+0000","last_clean":"2023-05-10T01:45:19.219379+0000","last_became_active":"2023-05-10T01:45:19.211116+0000","last_became_peered":"2023-05-10T01:45:19.211116+0000","last_unstale":"2023-05-10T01:45:19.219379+0000","last_undegraded":"2023-05-10T01:45:19.219379+0000","last_fullsized":"2023-05-10T01:45:19.219379+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202123+0000","last_change":"2023-05-10T01:45:18.817323+0000","last_active":"2023-05-10T01:45:19.202123+0000","last_peered":"2023-05-10T01:45:19.202123+0000","last_clean":"2023-05-10T01:45:19.202123+0000","last_became_active":"2023-05-10T01:45:18.817030+0000","last_became_peered":"2023-05-10T01:45:18.817030+0000","last_unstale":"2023-05-10T01:45:19.202123+0000","last_undegraded":"2023-05-10T01:45:19.202123+0000","last_fullsized":"2023-05-10T01:45:19.202123+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.227886+0000","last_change":"2023-05-10T01:45:19.222891+0000","last_active":"2023-05-10T01:45:19.227886+0000","last_peered":"2023-05-10T01:45:19.227886+0000","last_clean":"2023-05-10T01:45:19.227886+0000","last_became_active":"2023-05-10T01:45:19.222537+0000","last_became_peered":"2023-05-10T01:45:19.222537+0000","last_unstale":"2023-05-10T01:45:19.227886+0000","last_undegraded":"2023-05-10T01:45:19.227886+0000","last_fullsized":"2023-05-10T01:45:19.227886+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197006+0000","last_change":"2023-05-10T01:45:18.819801+0000","last_active":"2023-05-10T01:45:19.197006+0000","last_peered":"2023-05-10T01:45:19.197006+0000","last_clean":"2023-05-10T01:45:19.197006+0000","last_became_active":"2023-05-10T01:45:18.819525+0000","last_became_peered":"2023-05-10T01:45:18.819525+0000","last_unstale":"2023-05-10T01:45:19.197006+0000","last_undegraded":"2023-05-10T01:45:19.197006+0000","last_fullsized":"2023-05-10T01:45:19.197006+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.213979+0000","last_change":"2023-05-10T01:45:19.208110+0000","last_active":"2023-05-10T01:45:19.213979+0000","last_peered":"2023-05-10T01:45:19.213979+0000","last_clean":"2023-05-10T01:45:19.213979+0000","last_became_active":"2023-05-10T01:45:19.207841+0000","last_became_peered":"2023-05-10T01:45:19.207841+0000","last_unstale":"2023-05-10T01:45:19.213979+0000","last_undegraded":"2023-05-10T01:45:19.213979+0000","last_fullsized":"2023-05-10T01:45:19.213979+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206168+0000","last_change":"2023-05-10T01:45:18.826355+0000","last_active":"2023-05-10T01:45:19.206168+0000","last_peered":"2023-05-10T01:45:19.206168+0000","last_clean":"2023-05-10T01:45:19.206168+0000","last_became_active":"2023-05-10T01:45:18.825988+0000","last_became_peered":"2023-05-10T01:45:18.825988+0000","last_unstale":"2023-05-10T01:45:19.206168+0000","last_undegraded":"2023-05-10T01:45:19.206168+0000","last_fullsized":"2023-05-10T01:45:19.206168+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217837+0000","last_change":"2023-05-10T01:45:19.211686+0000","last_active":"2023-05-10T01:45:19.217837+0000","last_peered":"2023-05-10T01:45:19.217837+0000","last_clean":"2023-05-10T01:45:19.217837+0000","last_became_active":"2023-05-10T01:45:19.211410+0000","last_became_peered":"2023-05-10T01:45:19.211410+0000","last_unstale":"2023-05-10T01:45:19.217837+0000","last_undegraded":"2023-05-10T01:45:19.217837+0000","last_fullsized":"2023-05-10T01:45:19.217837+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204992+0000","last_change":"2023-05-10T01:45:18.823529+0000","last_active":"2023-05-10T01:45:19.204992+0000","last_peered":"2023-05-10T01:45:19.204992+0000","last_clean":"2023-05-10T01:45:19.204992+0000","last_became_active":"2023-05-10T01:45:18.823231+0000","last_became_peered":"2023-05-10T01:45:18.823231+0000","last_unstale":"2023-05-10T01:45:19.204992+0000","last_undegraded":"2023-05-10T01:45:19.204992+0000","last_fullsized":"2023-05-10T01:45:19.204992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211042+0000","last_change":"2023-05-10T01:45:19.205139+0000","last_active":"2023-05-10T01:45:19.211042+0000","last_peered":"2023-05-10T01:45:19.211042+0000","last_clean":"2023-05-10T01:45:19.211042+0000","last_became_active":"2023-05-10T01:45:19.204841+0000","last_became_peered":"2023-05-10T01:45:19.204841+0000","last_unstale":"2023-05-10T01:45:19.211042+0000","last_undegraded":"2023-05-10T01:45:19.211042+0000","last_fullsized":"2023-05-10T01:45:19.211042+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.227763+0000","last_change":"2023-05-10T01:45:18.824587+0000","last_active":"2023-05-10T01:45:19.227763+0000","last_peered":"2023-05-10T01:45:19.227763+0000","last_clean":"2023-05-10T01:45:19.227763+0000","last_became_active":"2023-05-10T01:45:18.824256+0000","last_became_peered":"2023-05-10T01:45:18.824256+0000","last_unstale":"2023-05-10T01:45:19.227763+0000","last_undegraded":"2023-05-10T01:45:19.227763+0000","last_fullsized":"2023-05-10T01:45:19.227763+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.208878+0000","last_change":"2023-05-10T01:45:19.201518+0000","last_active":"2023-05-10T01:45:19.208878+0000","last_peered":"2023-05-10T01:45:19.208878+0000","last_clean":"2023-05-10T01:45:19.208878+0000","last_became_active":"2023-05-10T01:45:19.201224+0000","last_became_peered":"2023-05-10T01:45:19.201224+0000","last_unstale":"2023-05-10T01:45:19.208878+0000","last_undegraded":"2023-05-10T01:45:19.208878+0000","last_fullsized":"2023-05-10T01:45:19.208878+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222261+0000","last_change":"2023-05-10T01:45:18.818724+0000","last_active":"2023-05-10T01:45:19.222261+0000","last_peered":"2023-05-10T01:45:19.222261+0000","last_clean":"2023-05-10T01:45:19.222261+0000","last_became_active":"2023-05-10T01:45:18.818428+0000","last_became_peered":"2023-05-10T01:45:18.818428+0000","last_unstale":"2023-05-10T01:45:19.222261+0000","last_undegraded":"2023-05-10T01:45:19.222261+0000","last_fullsized":"2023-05-10T01:45:19.222261+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223124+0000","last_change":"2023-05-10T01:45:19.221514+0000","last_active":"2023-05-10T01:45:19.223124+0000","last_peered":"2023-05-10T01:45:19.223124+0000","last_clean":"2023-05-10T01:45:19.223124+0000","last_became_active":"2023-05-10T01:45:19.221234+0000","last_became_peered":"2023-05-10T01:45:19.221234+0000","last_unstale":"2023-05-10T01:45:19.223124+0000","last_undegraded":"2023-05-10T01:45:19.223124+0000","last_fullsized":"2023-05-10T01:45:19.223124+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197134+0000","last_change":"2023-05-10T01:45:18.817675+0000","last_active":"2023-05-10T01:45:19.197134+0000","last_peered":"2023-05-10T01:45:19.197134+0000","last_clean":"2023-05-10T01:45:19.197134+0000","last_became_active":"2023-05-10T01:45:18.817193+0000","last_became_peered":"2023-05-10T01:45:18.817193+0000","last_unstale":"2023-05-10T01:45:19.197134+0000","last_undegraded":"2023-05-10T01:45:19.197134+0000","last_fullsized":"2023-05-10T01:45:19.197134+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222730+0000","last_change":"2023-05-10T01:45:19.219213+0000","last_active":"2023-05-10T01:45:19.222730+0000","last_peered":"2023-05-10T01:45:19.222730+0000","last_clean":"2023-05-10T01:45:19.222730+0000","last_became_active":"2023-05-10T01:45:19.218969+0000","last_became_peered":"2023-05-10T01:45:19.218969+0000","last_unstale":"2023-05-10T01:45:19.222730+0000","last_undegraded":"2023-05-10T01:45:19.222730+0000","last_fullsized":"2023-05-10T01:45:19.222730+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204644+0000","last_change":"2023-05-10T01:45:18.821898+0000","last_active":"2023-05-10T01:45:19.204644+0000","last_peered":"2023-05-10T01:45:19.204644+0000","last_clean":"2023-05-10T01:45:19.204644+0000","last_became_active":"2023-05-10T01:45:18.821629+0000","last_became_peered":"2023-05-10T01:45:18.821629+0000","last_unstale":"2023-05-10T01:45:19.204644+0000","last_undegraded":"2023-05-10T01:45:19.204644+0000","last_fullsized":"2023-05-10T01:45:19.204644+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219401+0000","last_change":"2023-05-10T01:45:19.212026+0000","last_active":"2023-05-10T01:45:19.219401+0000","last_peered":"2023-05-10T01:45:19.219401+0000","last_clean":"2023-05-10T01:45:19.219401+0000","last_became_active":"2023-05-10T01:45:19.211508+0000","last_became_peered":"2023-05-10T01:45:19.211508+0000","last_unstale":"2023-05-10T01:45:19.219401+0000","last_undegraded":"2023-05-10T01:45:19.219401+0000","last_fullsized":"2023-05-10T01:45:19.219401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218780+0000","last_change":"2023-05-10T01:45:18.821558+0000","last_active":"2023-05-10T01:45:19.218780+0000","last_peered":"2023-05-10T01:45:19.218780+0000","last_clean":"2023-05-10T01:45:19.218780+0000","last_became_active":"2023-05-10T01:45:18.821237+0000","last_became_peered":"2023-05-10T01:45:18.821237+0000","last_unstale":"2023-05-10T01:45:19.218780+0000","last_undegraded":"2023-05-10T01:45:19.218780+0000","last_fullsized":"2023-05-10T01:45:19.218780+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216784+0000","last_change":"2023-05-10T01:45:19.215501+0000","last_active":"2023-05-10T01:45:19.216784+0000","last_peered":"2023-05-10T01:45:19.216784+0000","last_clean":"2023-05-10T01:45:19.216784+0000","last_became_active":"2023-05-10T01:45:19.215281+0000","last_became_peered":"2023-05-10T01:45:19.215281+0000","last_unstale":"2023-05-10T01:45:19.216784+0000","last_undegraded":"2023-05-10T01:45:19.216784+0000","last_fullsized":"2023-05-10T01:45:19.216784+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207242+0000","last_change":"2023-05-10T01:45:18.820366+0000","last_active":"2023-05-10T01:45:19.207242+0000","last_peered":"2023-05-10T01:45:19.207242+0000","last_clean":"2023-05-10T01:45:19.207242+0000","last_became_active":"2023-05-10T01:45:18.819939+0000","last_became_peered":"2023-05-10T01:45:18.819939+0000","last_unstale":"2023-05-10T01:45:19.207242+0000","last_undegraded":"2023-05-10T01:45:19.207242+0000","last_fullsized":"2023-05-10T01:45:19.207242+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223250+0000","last_change":"2023-05-10T01:45:19.218190+0000","last_active":"2023-05-10T01:45:19.223250+0000","last_peered":"2023-05-10T01:45:19.223250+0000","last_clean":"2023-05-10T01:45:19.223250+0000","last_became_active":"2023-05-10T01:45:19.217717+0000","last_became_peered":"2023-05-10T01:45:19.217717+0000","last_unstale":"2023-05-10T01:45:19.223250+0000","last_undegraded":"2023-05-10T01:45:19.223250+0000","last_fullsized":"2023-05-10T01:45:19.223250+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210096+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:19.210096+0000","last_peered":"2023-05-10T01:45:19.210096+0000","last_clean":"2023-05-10T01:45:19.210096+0000","last_became_active":"2023-05-10T01:45:18.820855+0000","last_became_peered":"2023-05-10T01:45:18.820855+0000","last_unstale":"2023-05-10T01:45:19.210096+0000","last_undegraded":"2023-05-10T01:45:19.210096+0000","last_fullsized":"2023-05-10T01:45:19.210096+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219247+0000","last_change":"2023-05-10T01:45:19.213757+0000","last_active":"2023-05-10T01:45:19.219247+0000","last_peered":"2023-05-10T01:45:19.219247+0000","last_clean":"2023-05-10T01:45:19.219247+0000","last_became_active":"2023-05-10T01:45:19.213128+0000","last_became_peered":"2023-05-10T01:45:19.213128+0000","last_unstale":"2023-05-10T01:45:19.219247+0000","last_undegraded":"2023-05-10T01:45:19.219247+0000","last_fullsized":"2023-05-10T01:45:19.219247+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214804+0000","last_change":"2023-05-10T01:45:18.821215+0000","last_active":"2023-05-10T01:45:19.214804+0000","last_peered":"2023-05-10T01:45:19.214804+0000","last_clean":"2023-05-10T01:45:19.214804+0000","last_became_active":"2023-05-10T01:45:18.820901+0000","last_became_peered":"2023-05-10T01:45:18.820901+0000","last_unstale":"2023-05-10T01:45:19.214804+0000","last_undegraded":"2023-05-10T01:45:19.214804+0000","last_fullsized":"2023-05-10T01:45:19.214804+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220713+0000","last_change":"2023-05-10T01:45:19.213586+0000","last_active":"2023-05-10T01:45:19.220713+0000","last_peered":"2023-05-10T01:45:19.220713+0000","last_clean":"2023-05-10T01:45:19.220713+0000","last_became_active":"2023-05-10T01:45:19.213362+0000","last_became_peered":"2023-05-10T01:45:19.213362+0000","last_unstale":"2023-05-10T01:45:19.220713+0000","last_undegraded":"2023-05-10T01:45:19.220713+0000","last_fullsized":"2023-05-10T01:45:19.220713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199637+0000","last_change":"2023-05-10T01:45:18.819565+0000","last_active":"2023-05-10T01:45:19.199637+0000","last_peered":"2023-05-10T01:45:19.199637+0000","last_clean":"2023-05-10T01:45:19.199637+0000","last_became_active":"2023-05-10T01:45:18.819253+0000","last_became_peered":"2023-05-10T01:45:18.819253+0000","last_unstale":"2023-05-10T01:45:19.199637+0000","last_undegraded":"2023-05-10T01:45:19.199637+0000","last_fullsized":"2023-05-10T01:45:19.199637+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221501+0000","last_change":"2023-05-10T01:45:19.214645+0000","last_active":"2023-05-10T01:45:19.221501+0000","last_peered":"2023-05-10T01:45:19.221501+0000","last_clean":"2023-05-10T01:45:19.221501+0000","last_became_active":"2023-05-10T01:45:19.214350+0000","last_became_peered":"2023-05-10T01:45:19.214350+0000","last_unstale":"2023-05-10T01:45:19.221501+0000","last_undegraded":"2023-05-10T01:45:19.221501+0000","last_fullsized":"2023-05-10T01:45:19.221501+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214861+0000","last_change":"2023-05-10T01:45:18.821115+0000","last_active":"2023-05-10T01:45:19.214861+0000","last_peered":"2023-05-10T01:45:19.214861+0000","last_clean":"2023-05-10T01:45:19.214861+0000","last_became_active":"2023-05-10T01:45:18.820818+0000","last_became_peered":"2023-05-10T01:45:18.820818+0000","last_unstale":"2023-05-10T01:45:19.214861+0000","last_undegraded":"2023-05-10T01:45:19.214861+0000","last_fullsized":"2023-05-10T01:45:19.214861+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214666+0000","last_change":"2023-05-10T01:45:19.209850+0000","last_active":"2023-05-10T01:45:19.214666+0000","last_peered":"2023-05-10T01:45:19.214666+0000","last_clean":"2023-05-10T01:45:19.214666+0000","last_became_active":"2023-05-10T01:45:19.209557+0000","last_became_peered":"2023-05-10T01:45:19.209557+0000","last_unstale":"2023-05-10T01:45:19.214666+0000","last_undegraded":"2023-05-10T01:45:19.214666+0000","last_fullsized":"2023-05-10T01:45:19.214666+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197254+0000","last_change":"2023-05-10T01:45:18.817483+0000","last_active":"2023-05-10T01:45:19.197254+0000","last_peered":"2023-05-10T01:45:19.197254+0000","last_clean":"2023-05-10T01:45:19.197254+0000","last_became_active":"2023-05-10T01:45:18.816820+0000","last_became_peered":"2023-05-10T01:45:18.816820+0000","last_unstale":"2023-05-10T01:45:19.197254+0000","last_undegraded":"2023-05-10T01:45:19.197254+0000","last_fullsized":"2023-05-10T01:45:19.197254+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219904+0000","last_change":"2023-05-10T01:45:19.217049+0000","last_active":"2023-05-10T01:45:19.219904+0000","last_peered":"2023-05-10T01:45:19.219904+0000","last_clean":"2023-05-10T01:45:19.219904+0000","last_became_active":"2023-05-10T01:45:19.216745+0000","last_became_peered":"2023-05-10T01:45:19.216745+0000","last_unstale":"2023-05-10T01:45:19.219904+0000","last_undegraded":"2023-05-10T01:45:19.219904+0000","last_fullsized":"2023-05-10T01:45:19.219904+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197383+0000","last_change":"2023-05-10T01:45:18.817187+0000","last_active":"2023-05-10T01:45:19.197383+0000","last_peered":"2023-05-10T01:45:19.197383+0000","last_clean":"2023-05-10T01:45:19.197383+0000","last_became_active":"2023-05-10T01:45:18.816332+0000","last_became_peered":"2023-05-10T01:45:18.816332+0000","last_unstale":"2023-05-10T01:45:19.197383+0000","last_undegraded":"2023-05-10T01:45:19.197383+0000","last_fullsized":"2023-05-10T01:45:19.197383+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211302+0000","last_change":"2023-05-10T01:45:19.205377+0000","last_active":"2023-05-10T01:45:19.211302+0000","last_peered":"2023-05-10T01:45:19.211302+0000","last_clean":"2023-05-10T01:45:19.211302+0000","last_became_active":"2023-05-10T01:45:19.204962+0000","last_became_peered":"2023-05-10T01:45:19.204962+0000","last_unstale":"2023-05-10T01:45:19.211302+0000","last_undegraded":"2023-05-10T01:45:19.211302+0000","last_fullsized":"2023-05-10T01:45:19.211302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204968+0000","last_change":"2023-05-10T01:45:18.826802+0000","last_active":"2023-05-10T01:45:19.204968+0000","last_peered":"2023-05-10T01:45:19.204968+0000","last_clean":"2023-05-10T01:45:19.204968+0000","last_became_active":"2023-05-10T01:45:18.825995+0000","last_became_peered":"2023-05-10T01:45:18.825995+0000","last_unstale":"2023-05-10T01:45:19.204968+0000","last_undegraded":"2023-05-10T01:45:19.204968+0000","last_fullsized":"2023-05-10T01:45:19.204968+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218620+0000","last_change":"2023-05-10T01:45:19.210619+0000","last_active":"2023-05-10T01:45:19.218620+0000","last_peered":"2023-05-10T01:45:19.218620+0000","last_clean":"2023-05-10T01:45:19.218620+0000","last_became_active":"2023-05-10T01:45:19.210425+0000","last_became_peered":"2023-05-10T01:45:19.210425+0000","last_unstale":"2023-05-10T01:45:19.218620+0000","last_undegraded":"2023-05-10T01:45:19.218620+0000","last_fullsized":"2023-05-10T01:45:19.218620+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200154+0000","last_change":"2023-05-10T01:45:18.821375+0000","last_active":"2023-05-10T01:45:19.200154+0000","last_peered":"2023-05-10T01:45:19.200154+0000","last_clean":"2023-05-10T01:45:19.200154+0000","last_became_active":"2023-05-10T01:45:18.821091+0000","last_became_peered":"2023-05-10T01:45:18.821091+0000","last_unstale":"2023-05-10T01:45:19.200154+0000","last_undegraded":"2023-05-10T01:45:19.200154+0000","last_fullsized":"2023-05-10T01:45:19.200154+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.213662+0000","last_change":"2023-05-10T01:45:19.207123+0000","last_active":"2023-05-10T01:45:19.213662+0000","last_peered":"2023-05-10T01:45:19.213662+0000","last_clean":"2023-05-10T01:45:19.213662+0000","last_became_active":"2023-05-10T01:45:19.206869+0000","last_became_peered":"2023-05-10T01:45:19.206869+0000","last_unstale":"2023-05-10T01:45:19.213662+0000","last_undegraded":"2023-05-10T01:45:19.213662+0000","last_fullsized":"2023-05-10T01:45:19.213662+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-05-10T01:45:21.080884+0000","last_change":"2023-05-10T01:45:18.823164+0000","last_active":"2023-05-10T01:45:21.080884+0000","last_peered":"2023-05-10T01:45:21.080884+0000","last_clean":"2023-05-10T01:45:21.080884+0000","last_became_active":"2023-05-10T01:45:18.820928+0000","last_became_peered":"2023-05-10T01:45:18.820928+0000","last_unstale":"2023-05-10T01:45:21.080884+0000","last_undegraded":"2023-05-10T01:45:21.080884+0000","last_fullsized":"2023-05-10T01:45:21.080884+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219583+0000","last_change":"2023-05-10T01:45:19.212852+0000","last_active":"2023-05-10T01:45:19.219583+0000","last_peered":"2023-05-10T01:45:19.219583+0000","last_clean":"2023-05-10T01:45:19.219583+0000","last_became_active":"2023-05-10T01:45:19.212534+0000","last_became_peered":"2023-05-10T01:45:19.212534+0000","last_unstale":"2023-05-10T01:45:19.219583+0000","last_undegraded":"2023-05-10T01:45:19.219583+0000","last_fullsized":"2023-05-10T01:45:19.219583+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200090+0000","last_change":"2023-05-10T01:45:18.829455+0000","last_active":"2023-05-10T01:45:19.200090+0000","last_peered":"2023-05-10T01:45:19.200090+0000","last_clean":"2023-05-10T01:45:19.200090+0000","last_became_active":"2023-05-10T01:45:18.829196+0000","last_became_peered":"2023-05-10T01:45:18.829196+0000","last_unstale":"2023-05-10T01:45:19.200090+0000","last_undegraded":"2023-05-10T01:45:19.200090+0000","last_fullsized":"2023-05-10T01:45:19.200090+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219546+0000","last_change":"2023-05-10T01:45:19.215879+0000","last_active":"2023-05-10T01:45:19.219546+0000","last_peered":"2023-05-10T01:45:19.219546+0000","last_clean":"2023-05-10T01:45:19.219546+0000","last_became_active":"2023-05-10T01:45:19.213119+0000","last_became_peered":"2023-05-10T01:45:19.213119+0000","last_unstale":"2023-05-10T01:45:19.219546+0000","last_undegraded":"2023-05-10T01:45:19.219546+0000","last_fullsized":"2023-05-10T01:45:19.219546+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206573+0000","last_change":"2023-05-10T01:45:18.828648+0000","last_active":"2023-05-10T01:45:19.206573+0000","last_peered":"2023-05-10T01:45:19.206573+0000","last_clean":"2023-05-10T01:45:19.206573+0000","last_became_active":"2023-05-10T01:45:18.828290+0000","last_became_peered":"2023-05-10T01:45:18.828290+0000","last_unstale":"2023-05-10T01:45:19.206573+0000","last_undegraded":"2023-05-10T01:45:19.206573+0000","last_fullsized":"2023-05-10T01:45:19.206573+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219252+0000","last_change":"2023-05-10T01:45:19.215582+0000","last_active":"2023-05-10T01:45:19.219252+0000","last_peered":"2023-05-10T01:45:19.219252+0000","last_clean":"2023-05-10T01:45:19.219252+0000","last_became_active":"2023-05-10T01:45:19.215016+0000","last_became_peered":"2023-05-10T01:45:19.215016+0000","last_unstale":"2023-05-10T01:45:19.219252+0000","last_undegraded":"2023-05-10T01:45:19.219252+0000","last_fullsized":"2023-05-10T01:45:19.219252+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203836+0000","last_change":"2023-05-10T01:45:18.830978+0000","last_active":"2023-05-10T01:45:19.203836+0000","last_peered":"2023-05-10T01:45:19.203836+0000","last_clean":"2023-05-10T01:45:19.203836+0000","last_became_active":"2023-05-10T01:45:18.830722+0000","last_became_peered":"2023-05-10T01:45:18.830722+0000","last_unstale":"2023-05-10T01:45:19.203836+0000","last_undegraded":"2023-05-10T01:45:19.203836+0000","last_fullsized":"2023-05-10T01:45:19.203836+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209875+0000","last_change":"2023-05-10T01:45:19.201436+0000","last_active":"2023-05-10T01:45:19.209875+0000","last_peered":"2023-05-10T01:45:19.209875+0000","last_clean":"2023-05-10T01:45:19.209875+0000","last_became_active":"2023-05-10T01:45:19.201146+0000","last_became_peered":"2023-05-10T01:45:19.201146+0000","last_unstale":"2023-05-10T01:45:19.209875+0000","last_undegraded":"2023-05-10T01:45:19.209875+0000","last_fullsized":"2023-05-10T01:45:19.209875+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198088+0000","last_change":"2023-05-10T01:45:18.819989+0000","last_active":"2023-05-10T01:45:19.198088+0000","last_peered":"2023-05-10T01:45:19.198088+0000","last_clean":"2023-05-10T01:45:19.198088+0000","last_became_active":"2023-05-10T01:45:18.819433+0000","last_became_peered":"2023-05-10T01:45:18.819433+0000","last_unstale":"2023-05-10T01:45:19.198088+0000","last_undegraded":"2023-05-10T01:45:19.198088+0000","last_fullsized":"2023-05-10T01:45:19.198088+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221466+0000","last_change":"2023-05-10T01:45:19.215872+0000","last_active":"2023-05-10T01:45:19.221466+0000","last_peered":"2023-05-10T01:45:19.221466+0000","last_clean":"2023-05-10T01:45:19.221466+0000","last_became_active":"2023-05-10T01:45:19.215616+0000","last_became_peered":"2023-05-10T01:45:19.215616+0000","last_unstale":"2023-05-10T01:45:19.221466+0000","last_undegraded":"2023-05-10T01:45:19.221466+0000","last_fullsized":"2023-05-10T01:45:19.221466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.195301+0000","last_change":"2023-05-10T01:45:18.828193+0000","last_active":"2023-05-10T01:45:19.195301+0000","last_peered":"2023-05-10T01:45:19.195301+0000","last_clean":"2023-05-10T01:45:19.195301+0000","last_became_active":"2023-05-10T01:45:18.827891+0000","last_became_peered":"2023-05-10T01:45:18.827891+0000","last_unstale":"2023-05-10T01:45:19.195301+0000","last_undegraded":"2023-05-10T01:45:19.195301+0000","last_fullsized":"2023-05-10T01:45:19.195301+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217626+0000","last_change":"2023-05-10T01:45:19.213728+0000","last_active":"2023-05-10T01:45:19.217626+0000","last_peered":"2023-05-10T01:45:19.217626+0000","last_clean":"2023-05-10T01:45:19.217626+0000","last_became_active":"2023-05-10T01:45:19.213470+0000","last_became_peered":"2023-05-10T01:45:19.213470+0000","last_unstale":"2023-05-10T01:45:19.217626+0000","last_undegraded":"2023-05-10T01:45:19.217626+0000","last_fullsized":"2023-05-10T01:45:19.217626+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199322+0000","last_change":"2023-05-10T01:45:18.823841+0000","last_active":"2023-05-10T01:45:19.199322+0000","last_peered":"2023-05-10T01:45:19.199322+0000","last_clean":"2023-05-10T01:45:19.199322+0000","last_became_active":"2023-05-10T01:45:18.823575+0000","last_became_peered":"2023-05-10T01:45:18.823575+0000","last_unstale":"2023-05-10T01:45:19.199322+0000","last_undegraded":"2023-05-10T01:45:19.199322+0000","last_fullsized":"2023-05-10T01:45:19.199322+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223096+0000","last_change":"2023-05-10T01:45:19.221420+0000","last_active":"2023-05-10T01:45:19.223096+0000","last_peered":"2023-05-10T01:45:19.223096+0000","last_clean":"2023-05-10T01:45:19.223096+0000","last_became_active":"2023-05-10T01:45:19.220673+0000","last_became_peered":"2023-05-10T01:45:19.220673+0000","last_unstale":"2023-05-10T01:45:19.223096+0000","last_undegraded":"2023-05-10T01:45:19.223096+0000","last_fullsized":"2023-05-10T01:45:19.223096+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210954+0000","last_change":"2023-05-10T01:45:18.814752+0000","last_active":"2023-05-10T01:45:19.210954+0000","last_peered":"2023-05-10T01:45:19.210954+0000","last_clean":"2023-05-10T01:45:19.210954+0000","last_became_active":"2023-05-10T01:45:18.814470+0000","last_became_peered":"2023-05-10T01:45:18.814470+0000","last_unstale":"2023-05-10T01:45:19.210954+0000","last_undegraded":"2023-05-10T01:45:19.210954+0000","last_fullsized":"2023-05-10T01:45:19.210954+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223196+0000","last_change":"2023-05-10T01:45:19.221772+0000","last_active":"2023-05-10T01:45:19.223196+0000","last_peered":"2023-05-10T01:45:19.223196+0000","last_clean":"2023-05-10T01:45:19.223196+0000","last_became_active":"2023-05-10T01:45:19.221517+0000","last_became_peered":"2023-05-10T01:45:19.221517+0000","last_unstale":"2023-05-10T01:45:19.223196+0000","last_undegraded":"2023-05-10T01:45:19.223196+0000","last_fullsized":"2023-05-10T01:45:19.223196+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221986+0000","last_change":"2023-05-10T01:45:18.828344+0000","last_active":"2023-05-10T01:45:19.221986+0000","last_peered":"2023-05-10T01:45:19.221986+0000","last_clean":"2023-05-10T01:45:19.221986+0000","last_became_active":"2023-05-10T01:45:18.828023+0000","last_became_peered":"2023-05-10T01:45:18.828023+0000","last_unstale":"2023-05-10T01:45:19.221986+0000","last_undegraded":"2023-05-10T01:45:19.221986+0000","last_fullsized":"2023-05-10T01:45:19.221986+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219228+0000","last_change":"2023-05-10T01:45:19.216428+0000","last_active":"2023-05-10T01:45:19.219228+0000","last_peered":"2023-05-10T01:45:19.219228+0000","last_clean":"2023-05-10T01:45:19.219228+0000","last_became_active":"2023-05-10T01:45:19.216153+0000","last_became_peered":"2023-05-10T01:45:19.216153+0000","last_unstale":"2023-05-10T01:45:19.219228+0000","last_undegraded":"2023-05-10T01:45:19.219228+0000","last_fullsized":"2023-05-10T01:45:19.219228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214367+0000","last_change":"2023-05-10T01:45:18.828387+0000","last_active":"2023-05-10T01:45:19.214367+0000","last_peered":"2023-05-10T01:45:19.214367+0000","last_clean":"2023-05-10T01:45:19.214367+0000","last_became_active":"2023-05-10T01:45:18.828060+0000","last_became_peered":"2023-05-10T01:45:18.828060+0000","last_unstale":"2023-05-10T01:45:19.214367+0000","last_undegraded":"2023-05-10T01:45:19.214367+0000","last_fullsized":"2023-05-10T01:45:19.214367+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222867+0000","last_change":"2023-05-10T01:45:19.217675+0000","last_active":"2023-05-10T01:45:19.222867+0000","last_peered":"2023-05-10T01:45:19.222867+0000","last_clean":"2023-05-10T01:45:19.222867+0000","last_became_active":"2023-05-10T01:45:19.217415+0000","last_became_peered":"2023-05-10T01:45:19.217415+0000","last_unstale":"2023-05-10T01:45:19.222867+0000","last_undegraded":"2023-05-10T01:45:19.222867+0000","last_fullsized":"2023-05-10T01:45:19.222867+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202275+0000","last_change":"2023-05-10T01:45:18.826254+0000","last_active":"2023-05-10T01:45:19.202275+0000","last_peered":"2023-05-10T01:45:19.202275+0000","last_clean":"2023-05-10T01:45:19.202275+0000","last_became_active":"2023-05-10T01:45:18.825958+0000","last_became_peered":"2023-05-10T01:45:18.825958+0000","last_unstale":"2023-05-10T01:45:19.202275+0000","last_undegraded":"2023-05-10T01:45:19.202275+0000","last_fullsized":"2023-05-10T01:45:19.202275+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219436+0000","last_change":"2023-05-10T01:45:19.217164+0000","last_active":"2023-05-10T01:45:19.219436+0000","last_peered":"2023-05-10T01:45:19.219436+0000","last_clean":"2023-05-10T01:45:19.219436+0000","last_became_active":"2023-05-10T01:45:19.216892+0000","last_became_peered":"2023-05-10T01:45:19.216892+0000","last_unstale":"2023-05-10T01:45:19.219436+0000","last_undegraded":"2023-05-10T01:45:19.219436+0000","last_fullsized":"2023-05-10T01:45:19.219436+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198621+0000","last_change":"2023-05-10T01:45:18.823399+0000","last_active":"2023-05-10T01:45:19.198621+0000","last_peered":"2023-05-10T01:45:19.198621+0000","last_clean":"2023-05-10T01:45:19.198621+0000","last_became_active":"2023-05-10T01:45:18.823098+0000","last_became_peered":"2023-05-10T01:45:18.823098+0000","last_unstale":"2023-05-10T01:45:19.198621+0000","last_undegraded":"2023-05-10T01:45:19.198621+0000","last_fullsized":"2023-05-10T01:45:19.198621+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220855+0000","last_change":"2023-05-10T01:45:19.215733+0000","last_active":"2023-05-10T01:45:19.220855+0000","last_peered":"2023-05-10T01:45:19.220855+0000","last_clean":"2023-05-10T01:45:19.220855+0000","last_became_active":"2023-05-10T01:45:19.215445+0000","last_became_peered":"2023-05-10T01:45:19.215445+0000","last_unstale":"2023-05-10T01:45:19.220855+0000","last_undegraded":"2023-05-10T01:45:19.220855+0000","last_fullsized":"2023-05-10T01:45:19.220855+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197994+0000","last_change":"2023-05-10T01:45:18.828746+0000","last_active":"2023-05-10T01:45:19.197994+0000","last_peered":"2023-05-10T01:45:19.197994+0000","last_clean":"2023-05-10T01:45:19.197994+0000","last_became_active":"2023-05-10T01:45:18.828489+0000","last_became_peered":"2023-05-10T01:45:18.828489+0000","last_unstale":"2023-05-10T01:45:19.197994+0000","last_undegraded":"2023-05-10T01:45:19.197994+0000","last_fullsized":"2023-05-10T01:45:19.197994+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217910+0000","last_change":"2023-05-10T01:45:19.217138+0000","last_active":"2023-05-10T01:45:19.217910+0000","last_peered":"2023-05-10T01:45:19.217910+0000","last_clean":"2023-05-10T01:45:19.217910+0000","last_became_active":"2023-05-10T01:45:19.215286+0000","last_became_peered":"2023-05-10T01:45:19.215286+0000","last_unstale":"2023-05-10T01:45:19.217910+0000","last_undegraded":"2023-05-10T01:45:19.217910+0000","last_fullsized":"2023-05-10T01:45:19.217910+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203107+0000","last_change":"2023-05-10T01:45:18.821338+0000","last_active":"2023-05-10T01:45:19.203107+0000","last_peered":"2023-05-10T01:45:19.203107+0000","last_clean":"2023-05-10T01:45:19.203107+0000","last_became_active":"2023-05-10T01:45:18.821075+0000","last_became_peered":"2023-05-10T01:45:18.821075+0000","last_unstale":"2023-05-10T01:45:19.203107+0000","last_undegraded":"2023-05-10T01:45:19.203107+0000","last_fullsized":"2023-05-10T01:45:19.203107+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221699+0000","last_change":"2023-05-10T01:45:19.220562+0000","last_active":"2023-05-10T01:45:19.221699+0000","last_peered":"2023-05-10T01:45:19.221699+0000","last_clean":"2023-05-10T01:45:19.221699+0000","last_became_active":"2023-05-10T01:45:19.220185+0000","last_became_peered":"2023-05-10T01:45:19.220185+0000","last_unstale":"2023-05-10T01:45:19.221699+0000","last_undegraded":"2023-05-10T01:45:19.221699+0000","last_fullsized":"2023-05-10T01:45:19.221699+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.194892+0000","last_change":"2023-05-10T01:45:18.817485+0000","last_active":"2023-05-10T01:45:19.194892+0000","last_peered":"2023-05-10T01:45:19.194892+0000","last_clean":"2023-05-10T01:45:19.194892+0000","last_became_active":"2023-05-10T01:45:18.817189+0000","last_became_peered":"2023-05-10T01:45:18.817189+0000","last_unstale":"2023-05-10T01:45:19.194892+0000","last_undegraded":"2023-05-10T01:45:19.194892+0000","last_fullsized":"2023-05-10T01:45:19.194892+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218655+0000","last_change":"2023-05-10T01:45:19.214992+0000","last_active":"2023-05-10T01:45:19.218655+0000","last_peered":"2023-05-10T01:45:19.218655+0000","last_clean":"2023-05-10T01:45:19.218655+0000","last_became_active":"2023-05-10T01:45:19.214708+0000","last_became_peered":"2023-05-10T01:45:19.214708+0000","last_unstale":"2023-05-10T01:45:19.218655+0000","last_undegraded":"2023-05-10T01:45:19.218655+0000","last_fullsized":"2023-05-10T01:45:19.218655+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.214092+0000","last_change":"2023-05-10T01:45:18.827114+0000","last_active":"2023-05-10T01:45:19.214092+0000","last_peered":"2023-05-10T01:45:19.214092+0000","last_clean":"2023-05-10T01:45:19.214092+0000","last_became_active":"2023-05-10T01:45:18.826814+0000","last_became_peered":"2023-05-10T01:45:18.826814+0000","last_unstale":"2023-05-10T01:45:19.214092+0000","last_undegraded":"2023-05-10T01:45:19.214092+0000","last_fullsized":"2023-05-10T01:45:19.214092+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223229+0000","last_change":"2023-05-10T01:45:19.218013+0000","last_active":"2023-05-10T01:45:19.223229+0000","last_peered":"2023-05-10T01:45:19.223229+0000","last_clean":"2023-05-10T01:45:19.223229+0000","last_became_active":"2023-05-10T01:45:19.217054+0000","last_became_peered":"2023-05-10T01:45:19.217054+0000","last_unstale":"2023-05-10T01:45:19.223229+0000","last_undegraded":"2023-05-10T01:45:19.223229+0000","last_fullsized":"2023-05-10T01:45:19.223229+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217252+0000","last_change":"2023-05-10T01:45:18.822470+0000","last_active":"2023-05-10T01:45:19.217252+0000","last_peered":"2023-05-10T01:45:19.217252+0000","last_clean":"2023-05-10T01:45:19.217252+0000","last_became_active":"2023-05-10T01:45:18.822174+0000","last_became_peered":"2023-05-10T01:45:18.822174+0000","last_unstale":"2023-05-10T01:45:19.217252+0000","last_undegraded":"2023-05-10T01:45:19.217252+0000","last_fullsized":"2023-05-10T01:45:19.217252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219562+0000","last_change":"2023-05-10T01:45:19.212039+0000","last_active":"2023-05-10T01:45:19.219562+0000","last_peered":"2023-05-10T01:45:19.219562+0000","last_clean":"2023-05-10T01:45:19.219562+0000","last_became_active":"2023-05-10T01:45:19.211725+0000","last_became_peered":"2023-05-10T01:45:19.211725+0000","last_unstale":"2023-05-10T01:45:19.219562+0000","last_undegraded":"2023-05-10T01:45:19.219562+0000","last_fullsized":"2023-05-10T01:45:19.219562+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205208+0000","last_change":"2023-05-10T01:45:18.830987+0000","last_active":"2023-05-10T01:45:19.205208+0000","last_peered":"2023-05-10T01:45:19.205208+0000","last_clean":"2023-05-10T01:45:19.205208+0000","last_became_active":"2023-05-10T01:45:18.830748+0000","last_became_peered":"2023-05-10T01:45:18.830748+0000","last_unstale":"2023-05-10T01:45:19.205208+0000","last_undegraded":"2023-05-10T01:45:19.205208+0000","last_fullsized":"2023-05-10T01:45:19.205208+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.219586+0000","last_change":"2023-05-10T01:45:19.216936+0000","last_active":"2023-05-10T01:45:19.219586+0000","last_peered":"2023-05-10T01:45:19.219586+0000","last_clean":"2023-05-10T01:45:19.219586+0000","last_became_active":"2023-05-10T01:45:19.215862+0000","last_became_peered":"2023-05-10T01:45:19.215862+0000","last_unstale":"2023-05-10T01:45:19.219586+0000","last_undegraded":"2023-05-10T01:45:19.219586+0000","last_fullsized":"2023-05-10T01:45:19.219586+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210635+0000","last_change":"2023-05-10T01:45:18.827522+0000","last_active":"2023-05-10T01:45:19.210635+0000","last_peered":"2023-05-10T01:45:19.210635+0000","last_clean":"2023-05-10T01:45:19.210635+0000","last_became_active":"2023-05-10T01:45:18.827210+0000","last_became_peered":"2023-05-10T01:45:18.827210+0000","last_unstale":"2023-05-10T01:45:19.210635+0000","last_undegraded":"2023-05-10T01:45:19.210635+0000","last_fullsized":"2023-05-10T01:45:19.210635+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222544+0000","last_change":"2023-05-10T01:45:19.216763+0000","last_active":"2023-05-10T01:45:19.222544+0000","last_peered":"2023-05-10T01:45:19.222544+0000","last_clean":"2023-05-10T01:45:19.222544+0000","last_became_active":"2023-05-10T01:45:19.216486+0000","last_became_peered":"2023-05-10T01:45:19.216486+0000","last_unstale":"2023-05-10T01:45:19.222544+0000","last_undegraded":"2023-05-10T01:45:19.222544+0000","last_fullsized":"2023-05-10T01:45:19.222544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209091+0000","last_change":"2023-05-10T01:45:18.822866+0000","last_active":"2023-05-10T01:45:19.209091+0000","last_peered":"2023-05-10T01:45:19.209091+0000","last_clean":"2023-05-10T01:45:19.209091+0000","last_became_active":"2023-05-10T01:45:18.822558+0000","last_became_peered":"2023-05-10T01:45:18.822558+0000","last_unstale":"2023-05-10T01:45:19.209091+0000","last_undegraded":"2023-05-10T01:45:19.209091+0000","last_fullsized":"2023-05-10T01:45:19.209091+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222442+0000","last_change":"2023-05-10T01:45:19.220842+0000","last_active":"2023-05-10T01:45:19.222442+0000","last_peered":"2023-05-10T01:45:19.222442+0000","last_clean":"2023-05-10T01:45:19.222442+0000","last_became_active":"2023-05-10T01:45:19.220523+0000","last_became_peered":"2023-05-10T01:45:19.220523+0000","last_unstale":"2023-05-10T01:45:19.222442+0000","last_undegraded":"2023-05-10T01:45:19.222442+0000","last_fullsized":"2023-05-10T01:45:19.222442+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.197410+0000","last_change":"2023-05-10T01:45:18.819802+0000","last_active":"2023-05-10T01:45:19.197410+0000","last_peered":"2023-05-10T01:45:19.197410+0000","last_clean":"2023-05-10T01:45:19.197410+0000","last_became_active":"2023-05-10T01:45:18.819051+0000","last_became_peered":"2023-05-10T01:45:18.819051+0000","last_unstale":"2023-05-10T01:45:19.197410+0000","last_undegraded":"2023-05-10T01:45:19.197410+0000","last_fullsized":"2023-05-10T01:45:19.197410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221439+0000","last_change":"2023-05-10T01:45:19.212380+0000","last_active":"2023-05-10T01:45:19.221439+0000","last_peered":"2023-05-10T01:45:19.221439+0000","last_clean":"2023-05-10T01:45:19.221439+0000","last_became_active":"2023-05-10T01:45:19.212087+0000","last_became_peered":"2023-05-10T01:45:19.212087+0000","last_unstale":"2023-05-10T01:45:19.221439+0000","last_undegraded":"2023-05-10T01:45:19.221439+0000","last_fullsized":"2023-05-10T01:45:19.221439+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.204013+0000","last_change":"2023-05-10T01:45:18.823375+0000","last_active":"2023-05-10T01:45:19.204013+0000","last_peered":"2023-05-10T01:45:19.204013+0000","last_clean":"2023-05-10T01:45:19.204013+0000","last_became_active":"2023-05-10T01:45:18.822638+0000","last_became_peered":"2023-05-10T01:45:18.822638+0000","last_unstale":"2023-05-10T01:45:19.204013+0000","last_undegraded":"2023-05-10T01:45:19.204013+0000","last_fullsized":"2023-05-10T01:45:19.204013+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.223219+0000","last_change":"2023-05-10T01:45:19.221309+0000","last_active":"2023-05-10T01:45:19.223219+0000","last_peered":"2023-05-10T01:45:19.223219+0000","last_clean":"2023-05-10T01:45:19.223219+0000","last_became_active":"2023-05-10T01:45:19.221049+0000","last_became_peered":"2023-05-10T01:45:19.221049+0000","last_unstale":"2023-05-10T01:45:19.223219+0000","last_undegraded":"2023-05-10T01:45:19.223219+0000","last_fullsized":"2023-05-10T01:45:19.223219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.198348+0000","last_change":"2023-05-10T01:45:18.819534+0000","last_active":"2023-05-10T01:45:19.198348+0000","last_peered":"2023-05-10T01:45:19.198348+0000","last_clean":"2023-05-10T01:45:19.198348+0000","last_became_active":"2023-05-10T01:45:18.818481+0000","last_became_peered":"2023-05-10T01:45:18.818481+0000","last_unstale":"2023-05-10T01:45:19.198348+0000","last_undegraded":"2023-05-10T01:45:19.198348+0000","last_fullsized":"2023-05-10T01:45:19.198348+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220160+0000","last_change":"2023-05-10T01:45:19.209740+0000","last_active":"2023-05-10T01:45:19.220160+0000","last_peered":"2023-05-10T01:45:19.220160+0000","last_clean":"2023-05-10T01:45:19.220160+0000","last_became_active":"2023-05-10T01:45:19.209468+0000","last_became_peered":"2023-05-10T01:45:19.209468+0000","last_unstale":"2023-05-10T01:45:19.220160+0000","last_undegraded":"2023-05-10T01:45:19.220160+0000","last_fullsized":"2023-05-10T01:45:19.220160+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220641+0000","last_change":"2023-05-10T01:45:18.827299+0000","last_active":"2023-05-10T01:45:19.220641+0000","last_peered":"2023-05-10T01:45:19.220641+0000","last_clean":"2023-05-10T01:45:19.220641+0000","last_became_active":"2023-05-10T01:45:18.827012+0000","last_became_peered":"2023-05-10T01:45:18.827012+0000","last_unstale":"2023-05-10T01:45:19.220641+0000","last_undegraded":"2023-05-10T01:45:19.220641+0000","last_fullsized":"2023-05-10T01:45:19.220641+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220944+0000","last_change":"2023-05-10T01:45:19.215429+0000","last_active":"2023-05-10T01:45:19.220944+0000","last_peered":"2023-05-10T01:45:19.220944+0000","last_clean":"2023-05-10T01:45:19.220944+0000","last_became_active":"2023-05-10T01:45:19.215142+0000","last_became_peered":"2023-05-10T01:45:19.215142+0000","last_unstale":"2023-05-10T01:45:19.220944+0000","last_undegraded":"2023-05-10T01:45:19.220944+0000","last_fullsized":"2023-05-10T01:45:19.220944+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203643+0000","last_change":"2023-05-10T01:45:18.823876+0000","last_active":"2023-05-10T01:45:19.203643+0000","last_peered":"2023-05-10T01:45:19.203643+0000","last_clean":"2023-05-10T01:45:19.203643+0000","last_became_active":"2023-05-10T01:45:18.823602+0000","last_became_peered":"2023-05-10T01:45:18.823602+0000","last_unstale":"2023-05-10T01:45:19.203643+0000","last_undegraded":"2023-05-10T01:45:19.203643+0000","last_fullsized":"2023-05-10T01:45:19.203643+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.221685+0000","last_change":"2023-05-10T01:45:19.219685+0000","last_active":"2023-05-10T01:45:19.221685+0000","last_peered":"2023-05-10T01:45:19.221685+0000","last_clean":"2023-05-10T01:45:19.221685+0000","last_became_active":"2023-05-10T01:45:19.219356+0000","last_became_peered":"2023-05-10T01:45:19.219356+0000","last_unstale":"2023-05-10T01:45:19.221685+0000","last_undegraded":"2023-05-10T01:45:19.221685+0000","last_fullsized":"2023-05-10T01:45:19.221685+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205328+0000","last_change":"2023-05-10T01:45:18.819295+0000","last_active":"2023-05-10T01:45:19.205328+0000","last_peered":"2023-05-10T01:45:19.205328+0000","last_clean":"2023-05-10T01:45:19.205328+0000","last_became_active":"2023-05-10T01:45:18.819022+0000","last_became_peered":"2023-05-10T01:45:18.819022+0000","last_unstale":"2023-05-10T01:45:19.205328+0000","last_undegraded":"2023-05-10T01:45:19.205328+0000","last_fullsized":"2023-05-10T01:45:19.205328+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217946+0000","last_change":"2023-05-10T01:45:19.215575+0000","last_active":"2023-05-10T01:45:19.217946+0000","last_peered":"2023-05-10T01:45:19.217946+0000","last_clean":"2023-05-10T01:45:19.217946+0000","last_became_active":"2023-05-10T01:45:19.215194+0000","last_became_peered":"2023-05-10T01:45:19.215194+0000","last_unstale":"2023-05-10T01:45:19.217946+0000","last_undegraded":"2023-05-10T01:45:19.217946+0000","last_fullsized":"2023-05-10T01:45:19.217946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.196977+0000","last_change":"2023-05-10T01:45:18.820590+0000","last_active":"2023-05-10T01:45:19.196977+0000","last_peered":"2023-05-10T01:45:19.196977+0000","last_clean":"2023-05-10T01:45:19.196977+0000","last_became_active":"2023-05-10T01:45:18.818788+0000","last_became_peered":"2023-05-10T01:45:18.818788+0000","last_unstale":"2023-05-10T01:45:19.196977+0000","last_undegraded":"2023-05-10T01:45:19.196977+0000","last_fullsized":"2023-05-10T01:45:19.196977+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217751+0000","last_change":"2023-05-10T01:45:19.211133+0000","last_active":"2023-05-10T01:45:19.217751+0000","last_peered":"2023-05-10T01:45:19.217751+0000","last_clean":"2023-05-10T01:45:19.217751+0000","last_became_active":"2023-05-10T01:45:19.210585+0000","last_became_peered":"2023-05-10T01:45:19.210585+0000","last_unstale":"2023-05-10T01:45:19.217751+0000","last_undegraded":"2023-05-10T01:45:19.217751+0000","last_fullsized":"2023-05-10T01:45:19.217751+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203258+0000","last_change":"2023-05-10T01:45:18.816454+0000","last_active":"2023-05-10T01:45:19.203258+0000","last_peered":"2023-05-10T01:45:19.203258+0000","last_clean":"2023-05-10T01:45:19.203258+0000","last_became_active":"2023-05-10T01:45:18.816162+0000","last_became_peered":"2023-05-10T01:45:18.816162+0000","last_unstale":"2023-05-10T01:45:19.203258+0000","last_undegraded":"2023-05-10T01:45:19.203258+0000","last_fullsized":"2023-05-10T01:45:19.203258+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.220835+0000","last_change":"2023-05-10T01:45:19.214722+0000","last_active":"2023-05-10T01:45:19.220835+0000","last_peered":"2023-05-10T01:45:19.220835+0000","last_clean":"2023-05-10T01:45:19.220835+0000","last_became_active":"2023-05-10T01:45:19.214448+0000","last_became_peered":"2023-05-10T01:45:19.214448+0000","last_unstale":"2023-05-10T01:45:19.220835+0000","last_undegraded":"2023-05-10T01:45:19.220835+0000","last_fullsized":"2023-05-10T01:45:19.220835+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.199242+0000","last_change":"2023-05-10T01:45:18.825786+0000","last_active":"2023-05-10T01:45:19.199242+0000","last_peered":"2023-05-10T01:45:19.199242+0000","last_clean":"2023-05-10T01:45:19.199242+0000","last_became_active":"2023-05-10T01:45:18.825527+0000","last_became_peered":"2023-05-10T01:45:18.825527+0000","last_unstale":"2023-05-10T01:45:19.199242+0000","last_undegraded":"2023-05-10T01:45:19.199242+0000","last_fullsized":"2023-05-10T01:45:19.199242+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.215173+0000","last_change":"2023-05-10T01:45:19.213833+0000","last_active":"2023-05-10T01:45:19.215173+0000","last_peered":"2023-05-10T01:45:19.215173+0000","last_clean":"2023-05-10T01:45:19.215173+0000","last_became_active":"2023-05-10T01:45:19.213561+0000","last_became_peered":"2023-05-10T01:45:19.213561+0000","last_unstale":"2023-05-10T01:45:19.215173+0000","last_undegraded":"2023-05-10T01:45:19.215173+0000","last_fullsized":"2023-05-10T01:45:19.215173+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203206+0000","last_change":"2023-05-10T01:45:18.824463+0000","last_active":"2023-05-10T01:45:19.203206+0000","last_peered":"2023-05-10T01:45:19.203206+0000","last_clean":"2023-05-10T01:45:19.203206+0000","last_became_active":"2023-05-10T01:45:18.824185+0000","last_became_peered":"2023-05-10T01:45:18.824185+0000","last_unstale":"2023-05-10T01:45:19.203206+0000","last_undegraded":"2023-05-10T01:45:19.203206+0000","last_fullsized":"2023-05-10T01:45:19.203206+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.206521+0000","last_change":"2023-05-10T01:45:19.204499+0000","last_active":"2023-05-10T01:45:19.206521+0000","last_peered":"2023-05-10T01:45:19.206521+0000","last_clean":"2023-05-10T01:45:19.206521+0000","last_became_active":"2023-05-10T01:45:19.204073+0000","last_became_peered":"2023-05-10T01:45:19.204073+0000","last_unstale":"2023-05-10T01:45:19.206521+0000","last_undegraded":"2023-05-10T01:45:19.206521+0000","last_fullsized":"2023-05-10T01:45:19.206521+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205057+0000","last_change":"2023-05-10T01:45:18.825086+0000","last_active":"2023-05-10T01:45:19.205057+0000","last_peered":"2023-05-10T01:45:19.205057+0000","last_clean":"2023-05-10T01:45:19.205057+0000","last_became_active":"2023-05-10T01:45:18.823740+0000","last_became_peered":"2023-05-10T01:45:18.823740+0000","last_unstale":"2023-05-10T01:45:19.205057+0000","last_undegraded":"2023-05-10T01:45:19.205057+0000","last_fullsized":"2023-05-10T01:45:19.205057+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217733+0000","last_change":"2023-05-10T01:45:19.210772+0000","last_active":"2023-05-10T01:45:19.217733+0000","last_peered":"2023-05-10T01:45:19.217733+0000","last_clean":"2023-05-10T01:45:19.217733+0000","last_became_active":"2023-05-10T01:45:19.210203+0000","last_became_peered":"2023-05-10T01:45:19.210203+0000","last_unstale":"2023-05-10T01:45:19.217733+0000","last_undegraded":"2023-05-10T01:45:19.217733+0000","last_fullsized":"2023-05-10T01:45:19.217733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.212162+0000","last_change":"2023-05-10T01:45:18.816038+0000","last_active":"2023-05-10T01:45:19.212162+0000","last_peered":"2023-05-10T01:45:19.212162+0000","last_clean":"2023-05-10T01:45:19.212162+0000","last_became_active":"2023-05-10T01:45:18.815608+0000","last_became_peered":"2023-05-10T01:45:18.815608+0000","last_unstale":"2023-05-10T01:45:19.212162+0000","last_undegraded":"2023-05-10T01:45:19.212162+0000","last_fullsized":"2023-05-10T01:45:19.212162+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203063+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:19.203063+0000","last_peered":"2023-05-10T01:45:19.203063+0000","last_clean":"2023-05-10T01:45:19.203063+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:19.203063+0000","last_undegraded":"2023-05-10T01:45:19.203063+0000","last_fullsized":"2023-05-10T01:45:19.203063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217118+0000","last_change":"2023-05-10T01:45:19.208138+0000","last_active":"2023-05-10T01:45:19.217118+0000","last_peered":"2023-05-10T01:45:19.217118+0000","last_clean":"2023-05-10T01:45:19.217118+0000","last_became_active":"2023-05-10T01:45:19.207851+0000","last_became_peered":"2023-05-10T01:45:19.207851+0000","last_unstale":"2023-05-10T01:45:19.217118+0000","last_undegraded":"2023-05-10T01:45:19.217118+0000","last_fullsized":"2023-05-10T01:45:19.217118+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"172'3","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.210930+0000","last_change":"2023-05-10T01:45:18.820670+0000","last_active":"2023-05-10T01:45:19.210930+0000","last_peered":"2023-05-10T01:45:19.210930+0000","last_clean":"2023-05-10T01:45:19.210930+0000","last_became_active":"2023-05-10T01:45:18.820163+0000","last_became_peered":"2023-05-10T01:45:18.820163+0000","last_unstale":"2023-05-10T01:45:19.210930+0000","last_undegraded":"2023-05-10T01:45:19.210930+0000","last_fullsized":"2023-05-10T01:45:19.210930+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202806+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:19.202806+0000","last_peered":"2023-05-10T01:45:19.202806+0000","last_clean":"2023-05-10T01:45:19.202806+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:19.202806+0000","last_undegraded":"2023-05-10T01:45:19.202806+0000","last_fullsized":"2023-05-10T01:45:19.202806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218992+0000","last_change":"2023-05-10T01:45:19.210423+0000","last_active":"2023-05-10T01:45:19.218992+0000","last_peered":"2023-05-10T01:45:19.218992+0000","last_clean":"2023-05-10T01:45:19.218992+0000","last_became_active":"2023-05-10T01:45:19.210184+0000","last_became_peered":"2023-05-10T01:45:19.210184+0000","last_unstale":"2023-05-10T01:45:19.218992+0000","last_undegraded":"2023-05-10T01:45:19.218992+0000","last_fullsized":"2023-05-10T01:45:19.218992+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203758+0000","last_change":"2023-05-10T01:45:18.824998+0000","last_active":"2023-05-10T01:45:19.203758+0000","last_peered":"2023-05-10T01:45:19.203758+0000","last_clean":"2023-05-10T01:45:19.203758+0000","last_became_active":"2023-05-10T01:45:18.824704+0000","last_became_peered":"2023-05-10T01:45:18.824704+0000","last_unstale":"2023-05-10T01:45:19.203758+0000","last_undegraded":"2023-05-10T01:45:19.203758+0000","last_fullsized":"2023-05-10T01:45:19.203758+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.200157+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:19.200157+0000","last_peered":"2023-05-10T01:45:19.200157+0000","last_clean":"2023-05-10T01:45:19.200157+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:19.200157+0000","last_undegraded":"2023-05-10T01:45:19.200157+0000","last_fullsized":"2023-05-10T01:45:19.200157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.222813+0000","last_change":"2023-05-10T01:45:19.219736+0000","last_active":"2023-05-10T01:45:19.222813+0000","last_peered":"2023-05-10T01:45:19.222813+0000","last_clean":"2023-05-10T01:45:19.222813+0000","last_became_active":"2023-05-10T01:45:19.219448+0000","last_became_peered":"2023-05-10T01:45:19.219448+0000","last_unstale":"2023-05-10T01:45:19.222813+0000","last_undegraded":"2023-05-10T01:45:19.222813+0000","last_fullsized":"2023-05-10T01:45:19.222813+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.218109+0000","last_change":"2023-05-10T01:45:18.819070+0000","last_active":"2023-05-10T01:45:19.218109+0000","last_peered":"2023-05-10T01:45:19.218109+0000","last_clean":"2023-05-10T01:45:19.218109+0000","last_became_active":"2023-05-10T01:45:18.818756+0000","last_became_peered":"2023-05-10T01:45:18.818756+0000","last_unstale":"2023-05-10T01:45:19.218109+0000","last_undegraded":"2023-05-10T01:45:19.218109+0000","last_fullsized":"2023-05-10T01:45:19.218109+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203298+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:19.203298+0000","last_peered":"2023-05-10T01:45:19.203298+0000","last_clean":"2023-05-10T01:45:19.203298+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:19.203298+0000","last_undegraded":"2023-05-10T01:45:19.203298+0000","last_fullsized":"2023-05-10T01:45:19.203298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205057+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:19.205057+0000","last_peered":"2023-05-10T01:45:19.205057+0000","last_clean":"2023-05-10T01:45:19.205057+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:19.205057+0000","last_undegraded":"2023-05-10T01:45:19.205057+0000","last_fullsized":"2023-05-10T01:45:19.205057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.208474+0000","last_change":"2023-05-10T01:45:19.205432+0000","last_active":"2023-05-10T01:45:19.208474+0000","last_peered":"2023-05-10T01:45:19.208474+0000","last_clean":"2023-05-10T01:45:19.208474+0000","last_became_active":"2023-05-10T01:45:19.204307+0000","last_became_peered":"2023-05-10T01:45:19.204307+0000","last_unstale":"2023-05-10T01:45:19.208474+0000","last_undegraded":"2023-05-10T01:45:19.208474+0000","last_fullsized":"2023-05-10T01:45:19.208474+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207346+0000","last_change":"2023-05-10T01:45:18.820200+0000","last_active":"2023-05-10T01:45:19.207346+0000","last_peered":"2023-05-10T01:45:19.207346+0000","last_clean":"2023-05-10T01:45:19.207346+0000","last_became_active":"2023-05-10T01:45:18.819546+0000","last_became_peered":"2023-05-10T01:45:18.819546+0000","last_unstale":"2023-05-10T01:45:19.207346+0000","last_undegraded":"2023-05-10T01:45:19.207346+0000","last_fullsized":"2023-05-10T01:45:19.207346+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.205144+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:19.205144+0000","last_peered":"2023-05-10T01:45:19.205144+0000","last_clean":"2023-05-10T01:45:19.205144+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:19.205144+0000","last_undegraded":"2023-05-10T01:45:19.205144+0000","last_fullsized":"2023-05-10T01:45:19.205144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217523+0000","last_change":"2023-05-10T01:45:19.215966+0000","last_active":"2023-05-10T01:45:19.217523+0000","last_peered":"2023-05-10T01:45:19.217523+0000","last_clean":"2023-05-10T01:45:19.217523+0000","last_became_active":"2023-05-10T01:45:19.215718+0000","last_became_peered":"2023-05-10T01:45:19.215718+0000","last_unstale":"2023-05-10T01:45:19.217523+0000","last_undegraded":"2023-05-10T01:45:19.217523+0000","last_fullsized":"2023-05-10T01:45:19.217523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.209808+0000","last_change":"2023-05-10T01:45:18.826710+0000","last_active":"2023-05-10T01:45:19.209808+0000","last_peered":"2023-05-10T01:45:19.209808+0000","last_clean":"2023-05-10T01:45:19.209808+0000","last_became_active":"2023-05-10T01:45:18.826416+0000","last_became_peered":"2023-05-10T01:45:18.826416+0000","last_unstale":"2023-05-10T01:45:19.209808+0000","last_undegraded":"2023-05-10T01:45:19.209808+0000","last_fullsized":"2023-05-10T01:45:19.209808+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.207139+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:19.207139+0000","last_peered":"2023-05-10T01:45:19.207139+0000","last_clean":"2023-05-10T01:45:19.207139+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:19.207139+0000","last_undegraded":"2023-05-10T01:45:19.207139+0000","last_fullsized":"2023-05-10T01:45:19.207139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.217511+0000","last_change":"2023-05-10T01:45:19.208997+0000","last_active":"2023-05-10T01:45:19.217511+0000","last_peered":"2023-05-10T01:45:19.217511+0000","last_clean":"2023-05-10T01:45:19.217511+0000","last_became_active":"2023-05-10T01:45:19.208729+0000","last_became_peered":"2023-05-10T01:45:19.208729+0000","last_unstale":"2023-05-10T01:45:19.217511+0000","last_undegraded":"2023-05-10T01:45:19.217511+0000","last_fullsized":"2023-05-10T01:45:19.217511+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.203383+0000","last_change":"2023-05-10T01:45:18.825979+0000","last_active":"2023-05-10T01:45:19.203383+0000","last_peered":"2023-05-10T01:45:19.203383+0000","last_clean":"2023-05-10T01:45:19.203383+0000","last_became_active":"2023-05-10T01:45:18.825702+0000","last_became_peered":"2023-05-10T01:45:18.825702+0000","last_unstale":"2023-05-10T01:45:19.203383+0000","last_undegraded":"2023-05-10T01:45:19.203383+0000","last_fullsized":"2023-05-10T01:45:19.203383+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.202955+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:19.202955+0000","last_peered":"2023-05-10T01:45:19.202955+0000","last_clean":"2023-05-10T01:45:19.202955+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:19.202955+0000","last_undegraded":"2023-05-10T01:45:19.202955+0000","last_fullsized":"2023-05-10T01:45:19.202955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216745+0000","last_change":"2023-05-10T01:45:19.214518+0000","last_active":"2023-05-10T01:45:19.216745+0000","last_peered":"2023-05-10T01:45:19.216745+0000","last_clean":"2023-05-10T01:45:19.216745+0000","last_became_active":"2023-05-10T01:45:19.214194+0000","last_became_peered":"2023-05-10T01:45:19.214194+0000","last_unstale":"2023-05-10T01:45:19.216745+0000","last_undegraded":"2023-05-10T01:45:19.216745+0000","last_fullsized":"2023-05-10T01:45:19.216745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:18.796315+0000","last_clean_scrub_stamp":"2023-05-10T01:45:18.796315+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"172'4","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.216751+0000","last_change":"2023-05-10T01:45:18.820578+0000","last_active":"2023-05-10T01:45:19.216751+0000","last_peered":"2023-05-10T01:45:19.216751+0000","last_clean":"2023-05-10T01:45:19.216751+0000","last_became_active":"2023-05-10T01:45:18.820022+0000","last_became_peered":"2023-05-10T01:45:18.820022+0000","last_unstale":"2023-05-10T01:45:19.216751+0000","last_undegraded":"2023-05-10T01:45:19.216751+0000","last_fullsized":"2023-05-10T01:45:19.216751+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:17.793696+0000","last_clean_scrub_stamp":"2023-05-10T01:45:17.793696+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-05-10T01:45:19.211739+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:19.211739+0000","last_peered":"2023-05-10T01:45:19.211739+0000","last_clean":"2023-05-10T01:45:19.211739+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:19.211739+0000","last_undegraded":"2023-05-10T01:45:19.211739+0000","last_fullsized":"2023-05-10T01:45:19.211739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575268,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21008,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":18880,"kb_avail":94350832,"statfs":{"total":96636764160,"available":96615251968,"internally_reserved":0,"allocated":2170880,"data_stored":1119900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19333120},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.624},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.44}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575267,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20612,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351228,"statfs":{"total":96636764160,"available":96615657472,"internally_reserved":0,"allocated":2158592,"data_stored":1118432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.372},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.77300000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":1.208,"15min":1.208},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":1.284},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.86499999999999999,"15min":1.0129999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.72599999999999998,"15min":1.3360000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33400000000000002},"max":{"1min":0.69399999999999995,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.435},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":1.3620000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed May 10 01:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.3120000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.995,"15min":1.2729999999999999},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575267,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24332,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347508,"statfs":{"total":96636764160,"available":96611848192,"internally_reserved":0,"allocated":2166784,"data_stored":1119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.60899999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.621}]},{"osd":2,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.68400000000000005,"5min":0.752,"15min":0.752},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27300000000000002},"max":{"1min":0.63300000000000001,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.90900000000000003,"5min":1.1200000000000001,"15min":1.357},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67100000000000004},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.90900000000000003,"5min":1.171,"15min":1.226},"last":0.77600000000000002}]},{"osd":5,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.872,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80900000000000005}]},{"osd":6,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.008,"15min":1.008},"last":0.878},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93799999999999994,"5min":1.1830000000000001,"15min":1.403},"last":0.94899999999999995}]},{"osd":7,"last update":"Wed May 10 01:44:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.82599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575267,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24788,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":94347052,"statfs":{"total":96636764160,"available":96611381248,"internally_reserved":0,"allocated":2174976,"data_stored":1119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44400000000000001}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.379},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.504}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575267,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26000,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":23872,"kb_avail":94345840,"statfs":{"total":96636764160,"available":96610140160,"internally_reserved":0,"allocated":2170880,"data_stored":1118614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24444928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.308},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.374}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834575267,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32840,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":94339000,"statfs":{"total":96636764160,"available":96603136000,"internally_reserved":0,"allocated":2162688,"data_stored":1118466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.252},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.36199999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.28999999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.52900000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834575267,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20748,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351092,"statfs":{"total":96636764160,"available":96615518208,"internally_reserved":0,"allocated":2166784,"data_stored":1119076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.497}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.442}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575269,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23816,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":21696,"kb_avail":94348024,"statfs":{"total":96636764160,"available":96612376576,"internally_reserved":0,"allocated":2162688,"data_stored":1119324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22216704},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.621,"5min":0.78800000000000003,"15min":0.80400000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.79500000000000004},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.42499999999999999}]},{"osd":2,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.80400000000000005,"15min":0.82799999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.75,"15min":0.88600000000000001},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.624,"15min":0.628},"min":{"1min":0.441,"5min":0.437,"15min":0.42499999999999999},"max":{"1min":0.66600000000000004,"5min":0.81699999999999995,"15min":0.84699999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.65600000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45800000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.55200000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":0.58499999999999996,"5min":0.73699999999999999,"15min":0.81899999999999995},"last":0.59399999999999997}]},{"osd":6,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.25900000000000001},"max":{"1min":0.60899999999999999,"5min":0.72599999999999998,"15min":0.80800000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.28399999999999997},"max":{"1min":0.60999999999999999,"5min":0.80400000000000005,"15min":0.84299999999999997},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed May 10 01:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.29899999999999999},"max":{"1min":0.623,"5min":0.76000000000000001,"15min":0.89200000000000002},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:28.075 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T01:45:28.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T01:45:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.228+0000 7f24f9e27700 1 Processor -- start 2023-05-10T01:45:28.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.228+0000 7f24f9e27700 1 -- start start 2023-05-10T01:45:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f9e27700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f9e27700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f24f4068640 0x7f24f40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f9e27700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f40c9110 con 0x7f24f40c60c0 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f9e27700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40c6520 con 0x7f24f4068640 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f9e27700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40c8820 con 0x7f24f4153ff0 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f2ffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f24f4068640 0x7f24f40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:33860/0 (socket says 172.21.15.52:33860) 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f3fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f24f40c60c0 0x7f24f40c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:54010/0 (socket says 172.21.15.52:54010) 2023-05-10T01:45:28.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.229+0000 7f24f37fe700 1 -- 172.21.15.52:0/792828201 learned_addr learned my addr 172.21.15.52:0/792828201 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f2ffd700 1 -- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 msgr2=0x7f24f4068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f2ffd700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f2ffd700 1 -- 172.21.15.52:0/792828201 >> v1:172.21.15.172:6789/0 conn(0x7f24f40c60c0 legacy=0x7f24f40c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f27fc700 1 -- 172.21.15.52:0/792828201 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621372457 0 0) 0x7f24f40c9110 con 0x7f24f40c60c0 2023-05-10T01:45:28.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f2ffd700 1 -- 172.21.15.52:0/792828201 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40c8ac0 con 0x7f24f4068640 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f37fe700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f2ffd700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4068640 0x7f24f40c5bd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f24e8009760 tx=0x7f24e8009060).ready entity=mon.1 client_cookie=b086a42cecf13e45 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f27fc700 1 -- 172.21.15.52:0/792828201 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800f510 con 0x7f24f4068640 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f27fc700 1 -- 172.21.15.52:0/792828201 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e800f670 con 0x7f24f4068640 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f27fc700 1 -- 172.21.15.52:0/792828201 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800f9f0 con 0x7f24f4068640 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f9e27700 1 -- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4068640 msgr2=0x7f24f40c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.230+0000 7f24f9e27700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4068640 0x7f24f40c5bd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f24e8009760 tx=0x7f24e8009060).stop 2023-05-10T01:45:28.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 -- 172.21.15.52:0/792828201 shutdown_connections 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4153ff0 0x7f24f4068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 --2- 172.21.15.52:0/792828201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4068640 0x7f24f40c5bd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 -- 172.21.15.52:0/792828201 >> 172.21.15.52:0/792828201 conn(0x7f24f40678d0 msgr2=0x7f24f40cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 -- 172.21.15.52:0/792828201 shutdown_connections 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.231+0000 7f24f9e27700 1 -- 172.21.15.52:0/792828201 wait complete. 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.232+0000 7f24f9e27700 1 Processor -- start 2023-05-10T01:45:28.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.232+0000 7f24f9e27700 1 -- start start 2023-05-10T01:45:28.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4068640 0x7f24f41670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4153ff0 0x7f24f4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4165330 con 0x7f24f40c60c0 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4164720 con 0x7f24f4153ff0 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4164a00 con 0x7f24f4068640 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42462/0 (socket says 172.21.15.52:42462) 2023-05-10T01:45:28.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 -- 172.21.15.52:0/4188140768 learned_addr learned my addr 172.21.15.52:0/4188140768 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f3fff700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4153ff0 0x7f24f4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f37fe700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4068640 0x7f24f41670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 -- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4068640 msgr2=0x7f24f41670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4068640 0x7f24f41670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 -- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4153ff0 msgr2=0x7f24f4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4153ff0 0x7f24f4152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 -- 172.21.15.52:0/4188140768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009300 con 0x7f24f40c60c0 2023-05-10T01:45:28.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f2ffd700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f24f4060350 tx=0x7f24e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800fe80 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e800f7e0 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e801b660 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e80092a0 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.233+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f4164fc0 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.234+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f4066720 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.235+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f24e802c070 con 0x7f24f40c60c0 2023-05-10T01:45:28.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.235+0000 7f24db7fe700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 0x7f24d4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.235+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f24e807b5f0 con 0x7f24f40c60c0 2023-05-10T01:45:28.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.236+0000 7f24f37fe700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 0x7f24d4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.236+0000 7f24f37fe700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 0x7f24d4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f24e4006b40 tx=0x7f24e4009060).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.239+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24e804c960 con 0x7f24f40c60c0 2023-05-10T01:45:28.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.477+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f24f4165470 con 0x7f24f40c60c0 2023-05-10T01:45:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.481+0000 7f24db7fe700 1 -- 172.21.15.52:0/4188140768 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) v1 ==== 190+0+0 (secure 0 0 0) 0x7f24e804ff80 con 0x7f24f40c60c0 2023-05-10T01:45:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.482+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 msgr2=0x7f24d4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.482+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 0x7f24d4061250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f24e4006b40 tx=0x7f24e4009060).stop 2023-05-10T01:45:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.482+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 msgr2=0x7f24f41675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.482+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f24f4060350 tx=0x7f24e8017000).stop 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 shutdown_connections 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f24d405ed90 0x7f24d4061250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f4153ff0 0x7f24f4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24f4068640 0x7f24f41670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 --2- 172.21.15.52:0/4188140768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f40c60c0 0x7f24f41675d0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 >> 172.21.15.52:0/4188140768 conn(0x7f24f40678d0 msgr2=0x7f24f40ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 shutdown_connections 2023-05-10T01:45:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.483+0000 7f24f9e27700 1 -- 172.21.15.52:0/4188140768 wait complete. 2023-05-10T01:45:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-05-10T01:45:28.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.610+0000 7fe54eb47700 1 Processor -- start 2023-05-10T01:45:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.610+0000 7fe54eb47700 1 -- start start 2023-05-10T01:45:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548154160 0x7fe5480c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe548154540 0x7fe5480c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 0x7fe548069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480c0650 con 0x7fe548154540 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54806a010 con 0x7fe548069690 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe54eb47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480bfd20 con 0x7fe548154160 2023-05-10T01:45:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe547fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe548154540 0x7fe5480c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe547fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe548154540 0x7fe5480c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42470/0 (socket says 172.21.15.52:42470) 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.611+0000 7fe547fff700 1 -- 172.21.15.52:0/1549403212 learned_addr learned my addr 172.21.15.52:0/1549403212 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe54c8e3700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548154160 0x7fe5480c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe54d0e4700 1 --2- 172.21.15.52:0/1549403212 >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 0x7fe548069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 -- 172.21.15.52:0/1549403212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548154160 msgr2=0x7fe5480c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548154160 0x7fe5480c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 -- 172.21.15.52:0/1549403212 >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 msgr2=0x7fe548069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 --2- 172.21.15.52:0/1549403212 >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 0x7fe548069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 -- 172.21.15.52:0/1549403212 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480c0000 con 0x7fe548154540 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe54d0e4700 1 --2- 172.21.15.52:0/1549403212 >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 0x7fe548069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe547fff700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe5480c6150 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fe548083bd0 tx=0x7fe5300090f0).ready entity=mon.0 client_cookie=e602d75af1098f60 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe5477fe700 1 -- 172.21.15.52:0/1549403212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000b520 con 0x7fe548154540 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe5477fe700 1 -- 172.21.15.52:0/1549403212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000b680 con 0x7fe548154540 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe5477fe700 1 -- 172.21.15.52:0/1549403212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ba20 con 0x7fe548154540 2023-05-10T01:45:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe54eb47700 1 -- 172.21.15.52:0/1549403212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 msgr2=0x7fe5480c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.612+0000 7fe54eb47700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe5480c6150 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fe548083bd0 tx=0x7fe5300090f0).stop 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 -- 172.21.15.52:0/1549403212 shutdown_connections 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 --2- 172.21.15.52:0/1549403212 >> v2:172.21.15.172:3300/0 conn(0x7fe548069690 0x7fe548069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548154160 0x7fe5480c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 --2- 172.21.15.52:0/1549403212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe5480c6150 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 -- 172.21.15.52:0/1549403212 >> 172.21.15.52:0/1549403212 conn(0x7fe5480cb6f0 msgr2=0x7fe5480c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 -- 172.21.15.52:0/1549403212 shutdown_connections 2023-05-10T01:45:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.613+0000 7fe54eb47700 1 -- 172.21.15.52:0/1549403212 wait complete. 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.614+0000 7fe54eb47700 1 Processor -- start 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.614+0000 7fe54eb47700 1 -- start start 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 0x7fe5480c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 0x7fe5480adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c2b10 con 0x7fe548154540 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c2df0 con 0x7fe548154160 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c30d0 con 0x7fe548069690 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42478/0 (socket says 172.21.15.52:42478) 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 -- 172.21.15.52:0/3655164770 learned_addr learned my addr 172.21.15.52:0/3655164770 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe547fff700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 0x7fe5480adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54c8e3700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 0x7fe5480c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 -- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 msgr2=0x7fe5480c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 0x7fe5480c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 -- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 msgr2=0x7fe5480adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 0x7fe5480adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 -- 172.21.15.52:0/3655164770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009370 con 0x7fe548154540 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54c8e3700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 0x7fe5480c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe547fff700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 0x7fe5480adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54d0e4700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fe540009fc0 tx=0x7fe5400099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000dd40 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000f040 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000dea0 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480c33b0 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.615+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe548167630 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.616+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54806c340 con 0x7fe548154540 2023-05-10T01:45:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.617+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe540013890 con 0x7fe548154540 2023-05-10T01:45:28.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.617+0000 7fe544ff9700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 0x7fe52c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:28.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.617+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fe54007a480 con 0x7fe548154540 2023-05-10T01:45:28.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.617+0000 7fe54c8e3700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 0x7fe52c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:28.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.618+0000 7fe54c8e3700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 0x7fe52c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe538009c00 tx=0x7fe538008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:28.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.621+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe54004b8a0 con 0x7fe548154540 2023-05-10T01:45:28.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.836+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5480c02e0 con 0x7fe548154540 2023-05-10T01:45:28.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.836+0000 7fe544ff9700 1 -- 172.21.15.52:0/3655164770 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7fe54004eec0 con 0x7fe548154540 2023-05-10T01:45:28.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:28.839 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 msgr2=0x7fe52c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 0x7fe52c061250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe538009c00 tx=0x7fe538008040).stop 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 msgr2=0x7fe548166ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fe540009fc0 tx=0x7fe5400099b0).stop 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 shutdown_connections 2023-05-10T01:45:28.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe52c05ed90 0x7fe52c061250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe548154540 0x7fe548166ab0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe548069690 0x7fe5480c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 --2- 172.21.15.52:0/3655164770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe548154160 0x7fe5480adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 >> 172.21.15.52:0/3655164770 conn(0x7fe5480cb6f0 msgr2=0x7fe5480ab480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.838+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 shutdown_connections 2023-05-10T01:45:28.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:28.839+0000 7fe54eb47700 1 -- 172.21.15.52:0/3655164770 wait complete. 2023-05-10T01:45:28.843 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:29.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T01:45:19.191344+0000', 'modified': '2023-05-10T01:45:22.202760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9084}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9084': {'gid': 9084, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/2644351057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 2644351057}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2644351057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-05-10T01:45:29.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T01:45:29.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-10T01:45:29.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.375+0000 7f25fa13c700 1 Processor -- start 2023-05-10T01:45:29.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.375+0000 7f25fa13c700 1 -- start start 2023-05-10T01:45:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25fa13c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25f40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25fa13c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40c0650 con 0x7f25f4154540 2023-05-10T01:45:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25fa13c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40bfd20 con 0x7f25f4069da0 2023-05-10T01:45:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25fa13c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40c0000 con 0x7f25f4154160 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25f2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f25f4154540 0x7f25f4069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51498/0 (socket says 172.21.15.52:51498) 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.376+0000 7f25f2ffd700 1 -- 172.21.15.52:0/3584370244 learned_addr learned my addr 172.21.15.52:0/3584370244 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068590744 0 0) 0x7f25f40c0650 con 0x7f25f4154540 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e00033f0 con 0x7f25f4154540 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25f40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839700330 0 0) 0x7f25e00033f0 con 0x7f25f4154540 2023-05-10T01:45:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 msgr2=0x7f25f40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25f40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 >> v1:172.21.15.172:6789/0 conn(0x7f25f4069da0 legacy=0x7f25f40c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40c02e0 con 0x7f25f4154540 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f25e8001470 con 0x7f25f4154540 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 >> v1:172.21.15.52:6789/0 conn(0x7f25f4154540 legacy=0x7f25f4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e0003910 0x7f25e0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25e0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e0004b80 0x7f25e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40c0000 con 0x7f25e0003910 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e000b910 con 0x7f25e0004b80 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e000bad0 con 0x7f25f4154160 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e0003910 0x7f25e0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25e0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f3fff700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e0004b80 0x7f25e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 -- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 msgr2=0x7f25e0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25f4154160 0x7f25e0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 -- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e0004b80 msgr2=0x7f25e0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.377+0000 7f25f37fe700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e0004b80 0x7f25e0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f37fe700 1 -- 172.21.15.52:0/3584370244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00033f0 con 0x7f25e0003910 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f3fff700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e0004b80 0x7f25e0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f37fe700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e0003910 0x7f25e0003d30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f25e4009a60 tx=0x7f25e4009060).ready entity=mon.0 client_cookie=56d6a165eea33928 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4009ea0 con 0x7f25e0003910 2023-05-10T01:45:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4009430 con 0x7f25e0003910 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f27fc700 1 -- 172.21.15.52:0/3584370244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400e870 con 0x7f25e0003910 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 -- 172.21.15.52:0/3584370244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e0003910 msgr2=0x7f25e0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 --2- 172.21.15.52:0/3584370244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25e0003910 0x7f25e0003d30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f25e4009a60 tx=0x7f25e4009060).stop 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25f3fff700 1 -- 172.21.15.52:0/3584370244 reap_dead start 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 -- 172.21.15.52:0/3584370244 shutdown_connections 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 -- 172.21.15.52:0/3584370244 >> 172.21.15.52:0/3584370244 conn(0x7f25f40cb740 msgr2=0x7f25f40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 -- 172.21.15.52:0/3584370244 shutdown_connections 2023-05-10T01:45:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.378+0000 7f25fa13c700 1 -- 172.21.15.52:0/3584370244 wait complete. 2023-05-10T01:45:29.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.379+0000 7f25fa13c700 1 Processor -- start 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 -- start start 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25e0003910 0x7f25f4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f40aa150 0x7f25f40c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4158cc0 con 0x7f25f40c2700 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4153010 con 0x7f25f40aa150 2023-05-10T01:45:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25fa13c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40aa5d0 con 0x7f25e0003910 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42496/0 (socket says 172.21.15.52:42496) 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.380+0000 7f25f2ffd700 1 -- 172.21.15.52:0/83896360 learned_addr learned my addr 172.21.15.52:0/83896360 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f3fff700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f40aa150 0x7f25f40c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f37fe700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25e0003910 0x7f25f4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 -- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25e0003910 msgr2=0x7f25f4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25e0003910 0x7f25f4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 -- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f40aa150 msgr2=0x7f25f40c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f40aa150 0x7f25f40c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 -- 172.21.15.52:0/83896360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f41580b0 con 0x7f25f40c2700 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f25e8004760 tx=0x7f25e8001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25db7fe700 1 -- 172.21.15.52:0/83896360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800f5f0 con 0x7f25f40c2700 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25db7fe700 1 -- 172.21.15.52:0/83896360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800f750 con 0x7f25f40c2700 2023-05-10T01:45:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4158390 con 0x7f25f40c2700 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25db7fe700 1 -- 172.21.15.52:0/83896360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800fad0 con 0x7f25f40c2700 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.381+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4158950 con 0x7f25f40c2700 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.382+0000 7f25db7fe700 1 -- 172.21.15.52:0/83896360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f25e8015410 con 0x7f25f40c2700 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.383+0000 7f25db7fe700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 0x7f25d4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.383+0000 7f25db7fe700 1 -- 172.21.15.52:0/83896360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f25e8079f30 con 0x7f25f40c2700 2023-05-10T01:45:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.383+0000 7f25f37fe700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 0x7f25d4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.383+0000 7f25f37fe700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 0x7f25d4061280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f25e4006d50 tx=0x7f25e401a000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.385+0000 7f260baceb80 1 Processor -- start 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.385+0000 7f260baceb80 1 -- start start 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c58940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39bd95e0 con 0x562b39c58560 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39b508a0 con 0x562b39c14300 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b39b65900 con 0x562b39c5d480 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42500/0 (socket says 172.21.15.52:42500) 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 -- 172.21.15.52:0/1263579440 learned_addr learned my addr 172.21.15.52:0/1263579440 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c58940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f3fff700 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 -- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 msgr2=0x562b39c58940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c58940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 -- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 msgr2=0x562b39c0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c0e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 -- 172.21.15.52:0/1263579440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b39a08310 con 0x562b39c58560 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.386+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f25e400e4b0 tx=0x7f25e4022000).ready entity=mon.0 client_cookie=c19c645ffe957ad6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f25d8ff9700 1 -- 172.21.15.52:0/1263579440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e402c070 con 0x562b39c58560 2023-05-10T01:45:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f25d8ff9700 1 -- 172.21.15.52:0/1263579440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400edb0 con 0x562b39c58560 2023-05-10T01:45:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f25d8ff9700 1 -- 172.21.15.52:0/1263579440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4022070 con 0x562b39c58560 2023-05-10T01:45:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 -- 172.21.15.52:0/1263579440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 msgr2=0x562b39c3bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f25e400e4b0 tx=0x7f25e4022000).stop 2023-05-10T01:45:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 -- 172.21.15.52:0/1263579440 shutdown_connections 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3bc50 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 --2- 172.21.15.52:0/1263579440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c58940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 -- 172.21.15.52:0/1263579440 >> 172.21.15.52:0/1263579440 conn(0x562b399d0e40 msgr2=0x562b39c5c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 -- 172.21.15.52:0/1263579440 shutdown_connections 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.387+0000 7f260baceb80 1 -- 172.21.15.52:0/1263579440 wait complete. 2023-05-10T01:45:29.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.388+0000 7f260baceb80 1 -- start start 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.388+0000 7f260baceb80 1 Processor -- start 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c58560 0x562b39c0e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39b2ced0 con 0x562b39c5d480 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39c0f5b0 con 0x562b39c14300 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b39c0ec80 con 0x562b39c58560 2023-05-10T01:45:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 10 client.0 ll_register_callbacks cb 0x562b39bd3200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42510/0 (socket says 172.21.15.52:42510) 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 -- 172.21.15.52:0/1317274402 learned_addr learned my addr 172.21.15.52:0/1317274402 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c58560 0x562b39c0e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 -- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c58560 msgr2=0x562b39c0e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c58560 0x562b39c0e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 -- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 msgr2=0x562b39c3d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 -- 172.21.15.52:0/1317274402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e00033f0 con 0x562b39c5d480 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25f3fff700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f25ec0012e0 tx=0x7f25ec003040).ready entity=mon.0 client_cookie=3502141a62e418d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec011e40 con 0x562b39c5d480 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f25ec013540 con 0x562b39c5d480 2023-05-10T01:45:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.389+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b39c07460 con 0x562b39c5d480 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25ec013910 con 0x562b39c5d480 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 10 client.9249 fetch_fsmap learned FSMap version 78 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562b39b5e880 con 0x562b39c5d480 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b39c07460 con 0x562b39c5d480 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f25ec013a70 con 0x562b39c5d480 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 10 client.9249 fetch_fsmap finished waiting for FSMap version 78 2023-05-10T01:45:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 10 client.9249 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 20 client.9249 populate_metadata read hostname 'smithi052' 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c68fd0 0x562b39c6a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 4 client.9249 mds_command: new command op to 9084 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 --> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b399ccca0 con 0x562b39c68fd0 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c68fd0 0x562b39c6a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25cdffb700 10 client.9249 ms_handle_connect on v2:172.21.15.52:6833/2644351057 2023-05-10T01:45:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.390+0000 7f25f37fe700 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c68fd0 0x562b39c6a010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=406f051defb6dbb7 server_cookie=55876f1d8703955b in_seq=0 out_seq=0 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f25cdffb700 1 -- 172.21.15.52:0/1317274402 <== mds.0 v2:172.21.15.52:6833/2644351057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x562b399ccca0 con 0x562b39c68fd0 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f25cdffb700 10 client.9249 handle_command_reply: tid=0 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 client.9249 shutdown 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 msgr2=0x562b39c68410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f25ec0012e0 tx=0x7f25ec003040).stop 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 shutdown_connections 2023-05-10T01:45:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c68fd0 0x562b39c6a010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c5d480 0x562b39c68410 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 --2- 172.21.15.52:0/1317274402 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c58560 0x562b39c0e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 >> 172.21.15.52:0/1317274402 conn(0x562b399d0e40 msgr2=0x562b39c5c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f25cdffb700 0 client.9249 ms_handle_reset on v2:172.21.15.52:6833/2644351057 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 shutdown_connections 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 1 -- 172.21.15.52:0/1317274402 wait complete. 2023-05-10T01:45:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.391+0000 7f260baceb80 20 client.9249 trim_cache size 0 max 16384 2023-05-10T01:45:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 Processor -- start 2023-05-10T01:45:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 -- start start 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c59220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39c58240 con 0x562b39c58560 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39c53890 con 0x562b39c14300 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b39c14d90 con 0x562b39c5d480 2023-05-10T01:45:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.408+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42518/0 (socket says 172.21.15.52:42518) 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 -- 172.21.15.52:0/829844598 learned_addr learned my addr 172.21.15.52:0/829844598 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f37fe700 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c57d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 -- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 msgr2=0x562b39c59220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c59220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 -- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 msgr2=0x562b39c57d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c57d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 -- 172.21.15.52:0/829844598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b39b5a070 con 0x562b39c58560 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f25e804ed10 tx=0x7f25e8056040).ready entity=mon.0 client_cookie=eb8ea3b19502e991 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25d97fa700 1 -- 172.21.15.52:0/829844598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8059040 con 0x562b39c58560 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25d97fa700 1 -- 172.21.15.52:0/829844598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8054750 con 0x562b39c58560 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f25d97fa700 1 -- 172.21.15.52:0/829844598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800fe40 con 0x562b39c58560 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 -- 172.21.15.52:0/829844598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 msgr2=0x562b39c0d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f25e804ed10 tx=0x7f25e8056040).stop 2023-05-10T01:45:29.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 -- 172.21.15.52:0/829844598 shutdown_connections 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c59220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 --2- 172.21.15.52:0/829844598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c0d610 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.409+0000 7f260baceb80 1 -- 172.21.15.52:0/829844598 >> 172.21.15.52:0/829844598 conn(0x562b399d0e40 msgr2=0x562b39c3db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.410+0000 7f260baceb80 1 -- 172.21.15.52:0/829844598 shutdown_connections 2023-05-10T01:45:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.410+0000 7f260baceb80 1 -- 172.21.15.52:0/829844598 wait complete. 2023-05-10T01:45:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.410+0000 7f260baceb80 1 -- start start 2023-05-10T01:45:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.410+0000 7f260baceb80 1 Processor -- start 2023-05-10T01:45:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c5c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39c70a50 con 0x562b39c58560 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b39c3f810 con 0x562b39c14300 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b39cbefb0 con 0x562b39c5d480 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f260baceb80 10 client.0 ll_register_callbacks cb 0x562b39bd3200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42522/0 (socket says 172.21.15.52:42522) 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 -- 172.21.15.52:0/2240147419 learned_addr learned my addr 172.21.15.52:0/2240147419 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f3fff700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c5c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f37fe700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 -- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 msgr2=0x562b39c5c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c5c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 -- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 msgr2=0x562b39c3ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 -- 172.21.15.52:0/2240147419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4158950 con 0x562b39c58560 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25f2ffd700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f25e8004730 tx=0x7f25e8053000).ready entity=mon.0 client_cookie=62de8ce97671e5a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.411+0000 7f25cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8059070 con 0x562b39c58560 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f25e80781e0 con 0x562b39c58560 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25e400edb0 con 0x562b39c58560 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25e8065070 con 0x562b39c58560 2023-05-10T01:45:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 10 client.9255 fetch_fsmap learned FSMap version 78 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562b39b59dc0 con 0x562b39c58560 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400edb0 con 0x562b39c58560 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f25e8051070 con 0x562b39c58560 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 10 client.9255 fetch_fsmap finished waiting for FSMap version 78 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 10 client.9255 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 20 client.9255 populate_metadata read hostname 'smithi052' 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c5caa0 0x562b39cbd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 4 client.9255 mds_command: new command op to 9084 tid=0[{"prefix": "status"}] 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 --> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562b39a03ca0 con 0x562b39c5caa0 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25f37fe700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c5caa0 0x562b39cbd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25cdffb700 10 client.9255 ms_handle_connect on v2:172.21.15.52:6833/2644351057 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.412+0000 7f25f37fe700 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c5caa0 0x562b39cbd7f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7ff1900d188c57e3 server_cookie=be9b2a25ff6e71b0 in_seq=0 out_seq=0 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25cdffb700 1 -- 172.21.15.52:0/2240147419 <== mds.0 v2:172.21.15.52:6833/2644351057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x562b39a03ca0 con 0x562b39c5caa0 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25cdffb700 10 client.9255 handle_command_reply: tid=0 2023-05-10T01:45:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 client.9255 shutdown 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 msgr2=0x562b39c3f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f25e8004730 tx=0x7f25e8053000).stop 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 shutdown_connections 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:6833/2644351057,v1:172.21.15.52:6835/2644351057] conn(0x562b39c5caa0 0x562b39cbd7f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562b39c5d480 0x562b39c5c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b39c14300 0x562b39c3ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 --2- 172.21.15.52:0/2240147419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562b39c58560 0x562b39c3f320 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25cdffb700 0 client.9255 ms_handle_reset on v2:172.21.15.52:6833/2644351057 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 >> 172.21.15.52:0/2240147419 conn(0x562b399d0e40 msgr2=0x562b39c3dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 shutdown_connections 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 1 -- 172.21.15.52:0/2240147419 wait complete. 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f260baceb80 20 client.9255 trim_cache size 0 max 16384 2023-05-10T01:45:29.425 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "81a74aef-38e3-473f-8c9a-a859f40ac8ae", 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 9084, 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.220227737, 2023-05-10T01:45:29.426 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 78, 2023-05-10T01:45:29.427 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 173, 2023-05-10T01:45:29.427 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 173, 2023-05-10T01:45:29.427 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.56178914 2023-05-10T01:45:29.427 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:29.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 msgr2=0x7f25d4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 0x7f25d4061280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f25e4006d50 tx=0x7f25e401a000).stop 2023-05-10T01:45:29.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 msgr2=0x7f25f40a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f25e8004760 tx=0x7f25e8001e90).stop 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 shutdown_connections 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f25d405edc0 0x7f25d4061280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f40aa150 0x7f25f40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25e0003910 0x7f25f4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 --2- 172.21.15.52:0/83896360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25f40c2700 0x7f25f40a9c60 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 >> 172.21.15.52:0/83896360 conn(0x7f25f40cb740 msgr2=0x7f25f40ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 shutdown_connections 2023-05-10T01:45:29.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.413+0000 7f25fa13c700 1 -- 172.21.15.52:0/83896360 wait complete. 2023-05-10T01:45:29.430 DEBUG:teuthology.orchestra.run.smithi052:> ceph fs ls 2023-05-10T01:45:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.532+0000 7f46a2ff7700 1 Processor -- start 2023-05-10T01:45:29.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.532+0000 7f46a2ff7700 1 -- start start 2023-05-10T01:45:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.532+0000 7f46a2ff7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.532+0000 7f46a2ff7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 0x7f469c063ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.532+0000 7f46a2ff7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0aaf30 con 0x7f469c153db0 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f46a2ff7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c063fc0 con 0x7f469c0c5c40 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f46a2ff7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c1440 con 0x7f469c154190 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f46a1594700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 0x7f469c063ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:33934/0 (socket says 172.21.15.52:33934) 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 -- 172.21.15.52:0/3532507751 learned_addr learned my addr 172.21.15.52:0/3532507751 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f46a1594700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 0x7f469c063ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:40856/0 (socket says 172.21.15.52:40856) 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f46a0d93700 1 --1- 172.21.15.52:0/3532507751 >> v1:172.21.15.172:6789/0 conn(0x7f469c153db0 0x7f469c0c0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:54082/0 (socket says 172.21.15.52:54082) 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 -- 172.21.15.52:0/3532507751 >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 msgr2=0x7f469c063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 --2- 172.21.15.52:0/3532507751 >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 0x7f469c063ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 -- 172.21.15.52:0/3532507751 >> v1:172.21.15.172:6789/0 conn(0x7f469c153db0 legacy=0x7f469c0c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 -- 172.21.15.52:0/3532507751 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0c1720 con 0x7f469c154190 2023-05-10T01:45:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469b7fe700 1 -- 172.21.15.52:0/3532507751 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202223436 0 0) 0x7f469c0aaf30 con 0x7f469c153db0 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.533+0000 7f469bfff700 1 --2- 172.21.15.52:0/3532507751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f468c009f20 tx=0x7f468c009840).ready entity=mon.2 client_cookie=56734a8f7c7c5b41 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f469b7fe700 1 -- 172.21.15.52:0/3532507751 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00e070 con 0x7f469c154190 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f469b7fe700 1 -- 172.21.15.52:0/3532507751 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00b9d0 con 0x7f469c154190 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f469b7fe700 1 -- 172.21.15.52:0/3532507751 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00bd50 con 0x7f469c154190 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 -- 172.21.15.52:0/3532507751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 msgr2=0x7f469c0635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/3532507751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f468c009f20 tx=0x7f468c009840).stop 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 -- 172.21.15.52:0/3532507751 shutdown_connections 2023-05-10T01:45:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/3532507751 >> v2:172.21.15.172:3300/0 conn(0x7f469c0c5c40 0x7f469c063ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/3532507751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c154190 0x7f469c0635e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 -- 172.21.15.52:0/3532507751 >> 172.21.15.52:0/3532507751 conn(0x7f469c0cac90 msgr2=0x7f469c0cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 -- 172.21.15.52:0/3532507751 shutdown_connections 2023-05-10T01:45:29.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.534+0000 7f46a2ff7700 1 -- 172.21.15.52:0/3532507751 wait complete. 2023-05-10T01:45:29.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.535+0000 7f46a2ff7700 1 Processor -- start 2023-05-10T01:45:29.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.535+0000 7f46a2ff7700 1 -- start start 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c0c5c40 0x7f469c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f469c153db0 0x7f469c0c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b09d0 con 0x7f469c154190 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c149290 con 0x7f469c153db0 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a2ff7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c4690 con 0x7f469c0c5c40 2023-05-10T01:45:29.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a1594700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a1594700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42538/0 (socket says 172.21.15.52:42538) 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.536+0000 7f46a1594700 1 -- 172.21.15.52:0/2183405428 learned_addr learned my addr 172.21.15.52:0/2183405428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f469bfff700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f469c153db0 0x7f469c0c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a0d93700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c0c5c40 0x7f469c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 -- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c0c5c40 msgr2=0x7f469c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c0c5c40 0x7f469c148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 -- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f469c153db0 msgr2=0x7f469c0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f469c153db0 0x7f469c0c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 -- 172.21.15.52:0/2183405428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009ae0 con 0x7f469c154190 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a1594700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f468400e8d0 tx=0x7f4684009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400ee70 con 0x7f469c154190 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468400c850 con 0x7f469c154190 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0c37a0 con 0x7f469c154190 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400cbd0 con 0x7f469c154190 2023-05-10T01:45:29.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.537+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0c3d60 con 0x7f469c154190 2023-05-10T01:45:29.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.538+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0c4840 con 0x7f469c154190 2023-05-10T01:45:29.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.538+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4684022070 con 0x7f469c154190 2023-05-10T01:45:29.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.539+0000 7f4698ff9700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 0x7f4680061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:29.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.539+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f468407a060 con 0x7f469c154190 2023-05-10T01:45:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.539+0000 7f46a0d93700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 0x7f4680061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.539+0000 7f46a0d93700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 0x7f4680061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46940011e0 tx=0x7f4694007180).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:29.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.543+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f469c0c4840 con 0x7f469c154190 2023-05-10T01:45:29.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.758+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f469c0c4840 con 0x7f469c154190 2023-05-10T01:45:29.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.758+0000 7f4698ff9700 1 -- 172.21.15.52:0/2183405428 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f469c0c4840 con 0x7f469c154190 2023-05-10T01:45:29.761 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T01:45:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 msgr2=0x7f4680061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 0x7f4680061220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46940011e0 tx=0x7f4694007180).stop 2023-05-10T01:45:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 msgr2=0x7f469c14e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f468400e8d0 tx=0x7f4684009060).stop 2023-05-10T01:45:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 shutdown_connections 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f468005ed60 0x7f4680061220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f469c154190 0x7f469c14e8a0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f469c0c5c40 0x7f469c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 --2- 172.21.15.52:0/2183405428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f469c153db0 0x7f469c0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 >> 172.21.15.52:0/2183405428 conn(0x7f469c0cac90 msgr2=0x7f469c151620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 shutdown_connections 2023-05-10T01:45:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:29.760+0000 7f46a2ff7700 1 -- 172.21.15.52:0/2183405428 wait complete. 2023-05-10T01:45:29.772 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T01:45:29.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T01:45:29.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-05-10T01:45:29.773 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T01:45:29.774 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T01:45:29.774 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T01:45:29.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-10T01:45:29.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T01:45:29.775 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:45:29.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:29.775 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-05-10T01:45:29.790 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:45:29.791 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 40106sec preferred_lft 40106sec 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.792 INFO:teuthology.orchestra.run.smithi052.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.793 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4897:c7ff:fe93:7e4a/64 scope link 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 4e:c8:c4:27:19:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::4cc8:c4ff:fe27:1925/64 scope link 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether ea:39:4d:ef:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:45:29.794 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::e839:4dff:feef:4a59/64 scope link 2023-05-10T01:45:29.795 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-05-10T01:45:29.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:29.795 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T01:45:29.853 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-05-10T01:45:29.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:29.855 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-05-10T01:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-05-10T01:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T01:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-10T01:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-10T01:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T01:45:29.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:29.912 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-05-10T01:45:29.912 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-05-10T01:45:29.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-10T01:45:29.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-10T01:45:29.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-10T01:45:29.914 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-05-10T01:45:30.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:30.011 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:45:30.025 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:45:30.026 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:45:30.026 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T01:45:30.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:30.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-05-10T01:45:30.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:30.091 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-05-10T01:45:30.145 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-05-10T01:45:30.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:45:30.225 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:45:30.225 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:45:30.267 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-05-10T01:45:30.268 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-05-10T01:45:30.269 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-10T01:45:30.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:30.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T01:45:30.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-05-10T01:45:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.490+0000 7f0caff77700 1 Processor -- start 2023-05-10T01:45:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.490+0000 7f0caff77700 1 -- start start 2023-05-10T01:45:30.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0caff77700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ca8154160 0x7f0ca80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0caff77700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80c08a0 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0caff77700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80bfc90 con 0x7f0ca8154540 2023-05-10T01:45:30.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0caff77700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80ab1f0 con 0x7f0ca8154160 2023-05-10T01:45:30.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cae514700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ca80c5ca0 0x7f0ca80c0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51566/0 (socket says 172.21.15.52:51566) 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cae514700 1 -- 172.21.15.52:0/1043492583 learned_addr learned my addr 172.21.15.52:0/1043492583 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862986371 0 0) 0x7f0ca80c08a0 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cadd13700 1 --2- 172.21.15.52:0/1043492583 >> v2:172.21.15.172:3300/0 conn(0x7f0ca8154160 0x7f0ca80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c940033f0 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797296120 0 0) 0x7f0c940033f0 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 >> v2:172.21.15.172:3300/0 conn(0x7f0ca8154160 msgr2=0x7f0ca80aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 --2- 172.21.15.52:0/1043492583 >> v2:172.21.15.172:3300/0 conn(0x7f0ca8154160 0x7f0ca80aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 >> v1:172.21.15.172:6789/0 conn(0x7f0ca8154540 legacy=0x7f0ca80a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80bff70 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f0c98001470 con 0x7f0ca80c5ca0 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 >> v1:172.21.15.52:6789/0 conn(0x7f0ca80c5ca0 legacy=0x7f0ca80c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 0x7f0c94003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c94004690 0x7f0c94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c94005000 0x7f0c9400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80ab1f0 con 0x7f0c940038e0 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9400beb0 con 0x7f0c94005000 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9400c070 con 0x7f0c94004690 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.491+0000 7f0cadd13700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 0x7f0c94003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cae514700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c94005000 0x7f0c9400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cad512700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c94004690 0x7f0c94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 -- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c94004690 msgr2=0x7f0c94004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c94004690 0x7f0c94004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 -- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c94005000 msgr2=0x7f0c9400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c94005000 0x7f0c9400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cae514700 1 -- 172.21.15.52:0/1043492583 reap_dead start 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 -- 172.21.15.52:0/1043492583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940033f0 con 0x7f0c940038e0 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cad512700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c94004690 0x7f0c94004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cadd13700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 0x7f0c94003d00 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0ca000e210 tx=0x7f0ca000b040).ready entity=mon.0 client_cookie=dde44143f1641dc0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0009ac0 con 0x7f0c940038e0 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000f040 con 0x7f0c940038e0 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0cacd11700 1 -- 172.21.15.52:0/1043492583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000ecd0 con 0x7f0c940038e0 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0caff77700 1 -- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 msgr2=0x7f0c94003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.492+0000 7f0caff77700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 0x7f0c94003d00 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0ca000e210 tx=0x7f0ca000b040).stop 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.493+0000 7f0caff77700 1 -- 172.21.15.52:0/1043492583 shutdown_connections 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.493+0000 7f0caff77700 1 --2- 172.21.15.52:0/1043492583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c940038e0 0x7f0c94003d00 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.493+0000 7f0caff77700 1 -- 172.21.15.52:0/1043492583 >> 172.21.15.52:0/1043492583 conn(0x7f0ca80cb6c0 msgr2=0x7f0ca80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:30.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.493+0000 7f0caff77700 1 -- 172.21.15.52:0/1043492583 shutdown_connections 2023-05-10T01:45:30.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.493+0000 7f0caff77700 1 -- 172.21.15.52:0/1043492583 wait complete. 2023-05-10T01:45:30.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.494+0000 7f0caff77700 1 Processor -- start 2023-05-10T01:45:30.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.494+0000 7f0caff77700 1 -- start start 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.494+0000 7f0caff77700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c940038e0 0x7f0ca8153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.494+0000 7f0caff77700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0caff77700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 0x7f0ca8164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0caff77700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81579f0 con 0x7f0ca8153660 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0caff77700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8159cd0 con 0x7f0c940038e0 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0caff77700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8156de0 con 0x7f0ca80c2be0 2023-05-10T01:45:30.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42560/0 (socket says 172.21.15.52:42560) 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 -- 172.21.15.52:0/2306792387 learned_addr learned my addr 172.21.15.52:0/2306792387 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cadd13700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c940038e0 0x7f0ca8153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cae514700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 0x7f0ca8164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 -- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 msgr2=0x7f0ca8164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 0x7f0ca8164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 -- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c940038e0 msgr2=0x7f0ca8153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c940038e0 0x7f0ca8153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 -- 172.21.15.52:0/2306792387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca81570c0 con 0x7f0ca8153660 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cae514700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 0x7f0ca8164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0cad512700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f0c9c00e490 tx=0x7f0c9c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c014430 con 0x7f0ca8153660 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c014590 con 0x7f0ca8153660 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca81573a0 con 0x7f0ca8153660 2023-05-10T01:45:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.495+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c014910 con 0x7f0ca8153660 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.496+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8164b80 con 0x7f0ca8153660 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.496+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8157ba0 con 0x7f0ca8153660 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.497+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0c9c014cc0 con 0x7f0ca8153660 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.497+0000 7f0ca5ffb700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 0x7f0c88061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.497+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f0c9c079c80 con 0x7f0ca8153660 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.497+0000 7f0cadd13700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 0x7f0c88061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.498+0000 7f0cadd13700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 0x7f0c88061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0ca000afd0 tx=0x7f0ca001a000).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.501+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ca8157ba0 con 0x7f0ca8153660 2023-05-10T01:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.700+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca80666b0 con 0x7f0c8805ed90 2023-05-10T01:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.702+0000 7f0ca5ffb700 1 -- 172.21.15.52:0/2306792387 <== mgr.7295 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0ca80666b0 con 0x7f0c8805ed90 2023-05-10T01:45:30.705 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-05-10T01:45:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-05-10T01:45:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephfs" 2023-05-10T01:45:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-05-10T01:45:30.705 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-05-10T01:45:30.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 msgr2=0x7f0c88061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 0x7f0c88061250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0ca000afd0 tx=0x7f0ca001a000).stop 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 msgr2=0x7f0ca80c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f0c9c00e490 tx=0x7f0c9c009040).stop 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 shutdown_connections 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0c8805ed90 0x7f0c88061250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ca80c2be0 0x7f0ca8164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c940038e0 0x7f0ca8153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 --2- 172.21.15.52:0/2306792387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca8153660 0x7f0ca80c26f0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 >> 172.21.15.52:0/2306792387 conn(0x7f0ca80cb6c0 msgr2=0x7f0ca80abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 shutdown_connections 2023-05-10T01:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.704+0000 7f0caff77700 1 -- 172.21.15.52:0/2306792387 wait complete. 2023-05-10T01:45:30.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-05-10T01:45:30.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.834+0000 7fbc65f5e700 1 Processor -- start 2023-05-10T01:45:30.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.834+0000 7fbc65f5e700 1 -- start start 2023-05-10T01:45:30.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc65f5e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc600c5d20 0x7fbc600aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc65f5e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600ca5f0 con 0x7fbc60153a90 2023-05-10T01:45:30.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc65f5e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc60154610 con 0x7fbc600c6100 2023-05-10T01:45:30.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc65f5e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600c8820 con 0x7fbc600c5d20 2023-05-10T01:45:30.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc5ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc60153a90 0x7fbc60153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51586/0 (socket says 172.21.15.52:51586) 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.835+0000 7fbc5ffff700 1 -- 172.21.15.52:0/3629848799 learned_addr learned my addr 172.21.15.52:0/3629848799 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/3629848799 >> v2:172.21.15.172:3300/0 conn(0x7fbc600c5d20 0x7fbc600aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134055064 0 0) 0x7fbc600ca5f0 con 0x7fbc60153a90 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc4c0033f0 con 0x7fbc60153a90 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669228910 0 0) 0x7fbc4c0033f0 con 0x7fbc60153a90 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 >> v2:172.21.15.172:3300/0 conn(0x7fbc600c5d20 msgr2=0x7fbc600aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 --2- 172.21.15.52:0/3629848799 >> v2:172.21.15.172:3300/0 conn(0x7fbc600c5d20 0x7fbc600aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 >> v1:172.21.15.172:6789/0 conn(0x7fbc600c6100 legacy=0x7fbc60069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600c8b00 con 0x7fbc60153a90 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fbc580017f0 con 0x7fbc60153a90 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 >> v1:172.21.15.52:6789/0 conn(0x7fbc60153a90 legacy=0x7fbc60153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c0038e0 0x7fbc4c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 0x7fbc4c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc4c005000 0x7fbc4c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600c8820 con 0x7fbc4c004690 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c00be00 con 0x7fbc4c0038e0 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c00bfc0 con 0x7fbc4c005000 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5effd700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 0x7fbc4c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c0038e0 0x7fbc4c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.836+0000 7fbc5ffff700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc4c005000 0x7fbc4c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 -- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc4c005000 msgr2=0x7fbc4c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc4c005000 0x7fbc4c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 -- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c0038e0 msgr2=0x7fbc4c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c0038e0 0x7fbc4c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 -- 172.21.15.52:0/3629848799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0033f0 con 0x7fbc4c004690 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5ffff700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc4c005000 0x7fbc4c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c0038e0 0x7fbc4c003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5ffff700 1 -- 172.21.15.52:0/3629848799 reap_dead start 2023-05-10T01:45:30.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5effd700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 0x7fbc4c004b10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fbc54001820 tx=0x7fbc54007b90).ready entity=mon.0 client_cookie=2d33cfe9945f47a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54007ea0 con 0x7fbc4c004690 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54012400 con 0x7fbc4c004690 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc5e7fc700 1 -- 172.21.15.52:0/3629848799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540127c0 con 0x7fbc4c004690 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 -- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 msgr2=0x7fbc4c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 0x7fbc4c004b10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fbc54001820 tx=0x7fbc54007b90).stop 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 -- 172.21.15.52:0/3629848799 shutdown_connections 2023-05-10T01:45:30.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/3629848799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc4c004690 0x7fbc4c004b10 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 -- 172.21.15.52:0/3629848799 >> 172.21.15.52:0/3629848799 conn(0x7fbc600cb6f0 msgr2=0x7fbc600c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:30.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 -- 172.21.15.52:0/3629848799 shutdown_connections 2023-05-10T01:45:30.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.837+0000 7fbc65f5e700 1 -- 172.21.15.52:0/3629848799 wait complete. 2023-05-10T01:45:30.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 Processor -- start 2023-05-10T01:45:30.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 -- start start 2023-05-10T01:45:30.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 0x7fbc600b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc60150140 0x7fbc6014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60151250 con 0x7fbc6014d880 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b05e0 con 0x7fbc4c004690 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc65f5e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601505d0 con 0x7fbc60150140 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc5ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc5ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42582/0 (socket says 172.21.15.52:42582) 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.839+0000 7fbc5ffff700 1 -- 172.21.15.52:0/2095924424 learned_addr learned my addr 172.21.15.52:0/2095924424 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 0x7fbc600b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5effd700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc60150140 0x7fbc6014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 -- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc60150140 msgr2=0x7fbc6014d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc60150140 0x7fbc6014d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 -- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 msgr2=0x7fbc600b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 0x7fbc600b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 -- 172.21.15.52:0/2095924424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc601508b0 con 0x7fbc6014d880 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 0x7fbc600b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc5ffff700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fbc600837a0 tx=0x7fbc58001250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800e800 con 0x7fbc6014d880 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800e980 con 0x7fbc6014d880 2023-05-10T01:45:30.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800ed40 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60150b90 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.840+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600c0c30 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.841+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60066720 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.841+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 79) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbc58014650 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.842+0000 7fbc477fe700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 0x7fbc40061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.842+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fbc580793f0 con 0x7fbc6014d880 2023-05-10T01:45:30.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.842+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 0x7fbc40061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:30.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.843+0000 7fbc5f7fe700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 0x7fbc40061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbc600618d0 tx=0x7fbc50008040).ready entity=mgr.7295 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:30.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:30.846+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc5804a870 con 0x7fbc6014d880 2023-05-10T01:45:31.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.064+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbc6006c340 con 0x7fbc6014d880 2023-05-10T01:45:31.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.802+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fbc580771d0 con 0x7fbc6014d880 2023-05-10T01:45:31.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.804+0000 7fbc477fe700 1 -- 172.21.15.52:0/2095924424 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v80) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbc580725a0 con 0x7fbc6014d880 2023-05-10T01:45:31.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.806+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 msgr2=0x7fbc40061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.806+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 0x7fbc40061250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbc600618d0 tx=0x7fbc50008040).stop 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.806+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 msgr2=0x7fbc600c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.806+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fbc600837a0 tx=0x7fbc58001250).stop 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 shutdown_connections 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fbc4005ed90 0x7fbc40061250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6014d880 0x7fbc600c0740 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc4c004690 0x7fbc600b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 --2- 172.21.15.52:0/2095924424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc60150140 0x7fbc6014d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 >> 172.21.15.52:0/2095924424 conn(0x7fbc600cb6f0 msgr2=0x7fbc600bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:31.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 shutdown_connections 2023-05-10T01:45:31.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.807+0000 7fbc65f5e700 1 -- 172.21.15.52:0/2095924424 wait complete. 2023-05-10T01:45:31.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-05-10T01:45:31.948 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:31.946+0000 7fbbaf002680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.949+0000 7f3555eb0700 1 Processor -- start 2023-05-10T01:45:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.949+0000 7f3555eb0700 1 -- start start 2023-05-10T01:45:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f3555eb0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35501550e0 0x7f35500a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f3555eb0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355014e930 con 0x7f3550068a60 2023-05-10T01:45:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f3555eb0700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355006a380 con 0x7f35500a4a30 2023-05-10T01:45:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f3555eb0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3550137420 con 0x7f35501550e0 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f354ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3550068a60 0x7f3550068f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51632/0 (socket says 172.21.15.52:51632) 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.950+0000 7f354ffff700 1 -- 172.21.15.52:0/4066652248 learned_addr learned my addr 172.21.15.52:0/4066652248 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354effd700 1 --2- 172.21.15.52:0/4066652248 >> v2:172.21.15.172:3300/0 conn(0x7f35501550e0 0x7f35500a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354e7fc700 1 -- 172.21.15.52:0/4066652248 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630230508 0 0) 0x7f355014e930 con 0x7f3550068a60 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354e7fc700 1 -- 172.21.15.52:0/4066652248 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c0033f0 con 0x7f3550068a60 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354effd700 1 -- 172.21.15.52:0/4066652248 >> v1:172.21.15.172:6789/0 conn(0x7f35500a4a30 legacy=0x7f35501549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354effd700 1 -- 172.21.15.52:0/4066652248 >> v1:172.21.15.52:6789/0 conn(0x7f3550068a60 legacy=0x7f3550068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354effd700 1 -- 172.21.15.52:0/4066652248 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550069770 con 0x7f35501550e0 2023-05-10T01:45:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354effd700 1 --2- 172.21.15.52:0/4066652248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35501550e0 0x7f35500a4e10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3540009760 tx=0x7f3540009060).ready entity=mon.1 client_cookie=74004bafaed26e76 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354e7fc700 1 -- 172.21.15.52:0/4066652248 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000f510 con 0x7f35501550e0 2023-05-10T01:45:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354e7fc700 1 -- 172.21.15.52:0/4066652248 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000f670 con 0x7f35501550e0 2023-05-10T01:45:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.951+0000 7f354e7fc700 1 -- 172.21.15.52:0/4066652248 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000f9f0 con 0x7f35501550e0 2023-05-10T01:45:31.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 -- 172.21.15.52:0/4066652248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35501550e0 msgr2=0x7f35500a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 --2- 172.21.15.52:0/4066652248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35501550e0 0x7f35500a4e10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f3540009760 tx=0x7f3540009060).stop 2023-05-10T01:45:31.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 -- 172.21.15.52:0/4066652248 shutdown_connections 2023-05-10T01:45:31.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 --2- 172.21.15.52:0/4066652248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35501550e0 0x7f35500a4e10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 -- 172.21.15.52:0/4066652248 >> 172.21.15.52:0/4066652248 conn(0x7f35500c4610 msgr2=0x7f3550066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 -- 172.21.15.52:0/4066652248 shutdown_connections 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.952+0000 7f3555eb0700 1 -- 172.21.15.52:0/4066652248 wait complete. 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.953+0000 7f3555eb0700 1 Processor -- start 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.953+0000 7f3555eb0700 1 -- start start 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3550068a60 0x7f3550151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 0x7f35501508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550150da0 con 0x7f35501550e0 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35501529d0 con 0x7f35500a4a30 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f3555eb0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3550151dc0 con 0x7f3550068a60 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42622/0 (socket says 172.21.15.52:42622) 2023-05-10T01:45:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 -- 172.21.15.52:0/2325241349 learned_addr learned my addr 172.21.15.52:0/2325241349 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354effd700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 0x7f35501508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354f7fe700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3550068a60 0x7f3550151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 -- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3550068a60 msgr2=0x7f3550151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3550068a60 0x7f3550151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 -- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 msgr2=0x7f35501508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 0x7f35501508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 -- 172.21.15.52:0/2325241349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400092a0 con 0x7f35501550e0 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354effd700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 0x7f35501508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.954+0000 7f354ffff700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f3548005ad0 tx=0x7f3548001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:31.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548005d30 con 0x7f35501550e0 2023-05-10T01:45:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548005e90 con 0x7f35501550e0 2023-05-10T01:45:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35501520a0 con 0x7f35501550e0 2023-05-10T01:45:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548007320 con 0x7f35501550e0 2023-05-10T01:45:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550152660 con 0x7f35501550e0 2023-05-10T01:45:31.962 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:31.955+0000 7f00fb7ea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.956+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3550152b60 con 0x7f35501550e0 2023-05-10T01:45:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.956+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7f3548010030 con 0x7f35501550e0 2023-05-10T01:45:31.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.956+0000 7f35377fe700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 0x7f35300612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:31.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.956+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f3548079ab0 con 0x7f35501550e0 2023-05-10T01:45:31.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.957+0000 7f354f7fe700 1 -- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 msgr2=0x7f35300612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:31.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.957+0000 7f354f7fe700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 0x7f35300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:31.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:31.960+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f354804af80 con 0x7f35501550e0 2023-05-10T01:45:32.011 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:32.009+0000 7fbbaf002680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:32.024 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:32.022+0000 7f00fb7ea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:32.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.134+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f355006c340 con 0x7f35501550e0 2023-05-10T01:45:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.137+0000 7f35377fe700 1 -- 172.21.15.52:0/2325241349 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f354804e5a0 con 0x7f35501550e0 2023-05-10T01:45:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 msgr2=0x7f35300612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 0x7f35300612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 msgr2=0x7f3550164c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f3548005ad0 tx=0x7f3548001650).stop 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 shutdown_connections 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f353005ede0 0x7f35300612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35501550e0 0x7f3550164c80 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3550068a60 0x7f3550151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 --2- 172.21.15.52:0/2325241349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35500a4a30 0x7f35501508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 >> 172.21.15.52:0/2325241349 conn(0x7f35500c4610 msgr2=0x7f35500bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 shutdown_connections 2023-05-10T01:45:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.139+0000 7f3555eb0700 1 -- 172.21.15.52:0/2325241349 wait complete. 2023-05-10T01:45:32.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:32.154 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-05-10T01:45:32.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-05-10T01:45:32.281 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:32.279+0000 7fbbaf002680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:32.316 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:32.314+0000 7f00fb7ea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.334+0000 7fad60e14700 1 Processor -- start 2023-05-10T01:45:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.334+0000 7fad60e14700 1 -- start start 2023-05-10T01:45:32.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad60e14700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 0x7fad5c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:32.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad60e14700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0c26b0 con 0x7fad5c150d80 2023-05-10T01:45:32.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad60e14700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0bc1a0 con 0x7fad5c1509a0 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad60e14700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0bc480 con 0x7fad5c06a280 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad59d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad5c150d80 0x7fad5c069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51678/0 (socket says 172.21.15.52:51678) 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad59d9b700 1 -- 172.21.15.52:0/942317573 learned_addr learned my addr 172.21.15.52:0/942317573 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.335+0000 7fad5ad9d700 1 --2- 172.21.15.52:0/942317573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 0x7fad5c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40312045 0 0) 0x7fad5c0c26b0 con 0x7fad5c150d80 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c0033f0 con 0x7fad5c150d80 2023-05-10T01:45:32.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422502527 0 0) 0x7fad5c0bc1a0 con 0x7fad5c1509a0 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c0c26b0 con 0x7fad5c1509a0 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5ad9d700 1 -- 172.21.15.52:0/942317573 >> v1:172.21.15.172:6789/0 conn(0x7fad5c1509a0 legacy=0x7fad5c065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5ad9d700 1 -- 172.21.15.52:0/942317573 >> v1:172.21.15.52:6789/0 conn(0x7fad5c150d80 legacy=0x7fad5c069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5ad9d700 1 -- 172.21.15.52:0/942317573 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0bc760 con 0x7fad5c06a280 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5ad9d700 1 --2- 172.21.15.52:0/942317573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 0x7fad5c15bad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fad54009e90 tx=0x7fad54009780).ready entity=mon.2 client_cookie=e47160818d2be665 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400e070 con 0x7fad5c06a280 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400bab0 con 0x7fad5c06a280 2023-05-10T01:45:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.336+0000 7fad5959a700 1 -- 172.21.15.52:0/942317573 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400be30 con 0x7fad5c06a280 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 -- 172.21.15.52:0/942317573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 msgr2=0x7fad5c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 --2- 172.21.15.52:0/942317573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 0x7fad5c15bad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fad54009e90 tx=0x7fad54009780).stop 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 -- 172.21.15.52:0/942317573 shutdown_connections 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 --2- 172.21.15.52:0/942317573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c06a280 0x7fad5c15bad0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 -- 172.21.15.52:0/942317573 >> 172.21.15.52:0/942317573 conn(0x7fad5c0c4610 msgr2=0x7fad5c066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 -- 172.21.15.52:0/942317573 shutdown_connections 2023-05-10T01:45:32.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.337+0000 7fad60e14700 1 -- 172.21.15.52:0/942317573 wait complete. 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.338+0000 7fad60e14700 1 Processor -- start 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.338+0000 7fad60e14700 1 -- start start 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c06a280 0x7fad5c0c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c1509a0 0x7fad5c0beb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0c6160 con 0x7fad5c150d80 2023-05-10T01:45:32.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0bf610 con 0x7fad5c06a280 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0bf8f0 con 0x7fad5c1509a0 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42670/0 (socket says 172.21.15.52:42670) 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 -- 172.21.15.52:0/4156554846 learned_addr learned my addr 172.21.15.52:0/4156554846 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad59d9b700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c1509a0 0x7fad5c0beb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c06a280 0x7fad5c0c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:32.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c1509a0 msgr2=0x7fad5c0beb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c1509a0 0x7fad5c0beb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c06a280 msgr2=0x7fad5c0c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:32.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c06a280 0x7fad5c0c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:32.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009a20 con 0x7fad5c150d80 2023-05-10T01:45:32.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad5ad9d700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fad54009de0 tx=0x7fad54009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5401d5a0 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5401d700 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5401daa0 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c0bfbd0 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.339+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c0c0190 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.340+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c06c340 con 0x7fad5c150d80 2023-05-10T01:45:32.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.341+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 80) v1 ==== 75259+0+0 (secure 0 0 0) 0x7fad54028460 con 0x7fad5c150d80 2023-05-10T01:45:32.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.341+0000 7fad527fc700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:32.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.342+0000 7fad5a59c700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:32.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.342+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6413+0+0 (secure 0 0 0) 0x7fad5407c380 con 0x7fad5c150d80 2023-05-10T01:45:32.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.342+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:32.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.345+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad5404d720 con 0x7fad5c150d80 2023-05-10T01:45:32.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.543+0000 7fad5a59c700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:32.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.543+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:32.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.546+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad5c0c6dd0 con 0x7fad4005ede0 2023-05-10T01:45:32.890 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:32.888+0000 7fbbaf002680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:32.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.944+0000 7fad5a59c700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:32.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:32.944+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:45:32.961 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:32.959+0000 7fbbaf002680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:32.984 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:32.982+0000 7f00fb7ea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:33.052 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:33.050+0000 7f00fb7ea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:33.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.142+0000 7fbbaf002680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:33.246 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:33.244+0000 7f00fb7ea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:33.558 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.556+0000 7fbbaf002680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:33.660 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.658+0000 7fbbaf002680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:33.684 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:33.682+0000 7f00fb7ea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:33.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:33.745+0000 7fad5a59c700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:33.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:33.745+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-05-10T01:45:33.792 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:33.790+0000 7f00fb7ea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:33.813 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.811+0000 7fbbaf002680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:33.886 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.884+0000 7fbbaf002680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:33.953 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:33.950+0000 7fbbaf002680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:33.953 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:33.950+0000 7f00fb7ea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:34.030 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:34.028+0000 7f00fb7ea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:34.101 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:34.099+0000 7f00fb7ea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:34.206 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:34.204+0000 7fbbaf002680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:34.372 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:34.370+0000 7f00fb7ea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:34.389 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:34.387+0000 7fbbaf002680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:34.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:45:34.445 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:45:34.563 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:34.561+0000 7f00fb7ea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:35.040 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.038+0000 7fbbaf002680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:35.108 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.105+0000 7fbbaf002680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:35.181 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.179+0000 7fbbaf002680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:35.248 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.246+0000 7f00fb7ea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:35.320 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.318+0000 7f00fb7ea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:35.328 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.326+0000 7fbbaf002680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:35.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:35.346+0000 7fad5a59c700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:35.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:35.347+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-05-10T01:45:35.397 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.395+0000 7fbbaf002680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:35.398 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.396+0000 7f00fb7ea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:35.510 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.508+0000 7fbbaf002680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:35.551 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.549+0000 7f00fb7ea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:35.617 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.614+0000 7fbbaf002680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:35.625 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.623+0000 7f00fb7ea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:35.746 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.744+0000 7f00fb7ea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:35.863 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:35.861+0000 7f00fb7ea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:35.916 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.914+0000 7fbbaf002680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:35.986 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:35.983+0000 7fbbaf002680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:36.167 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:36.165+0000 7f00fb7ea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:36.241 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:36.239+0000 7f00fb7ea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:36.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:36.815+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 81) v1 ==== 75109+0+0 (secure 0 0 0) 0x7fad5407a0e0 con 0x7fad5c150d80 2023-05-10T01:45:36.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:36.815+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad400612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:36.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:36.815+0000 7fad527fc700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad400612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:36.878 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2cfe3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2cfe3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2cfe3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2cfe3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2cfe3700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2a7de700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.879 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2a7de700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.880 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2a7de700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.880 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2a7de700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:36.880 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:36.875+0000 7fbb2a7de700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:37.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.820+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 82) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fad5407a460 con 0x7fad5c150d80 2023-05-10T01:45:37.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.821+0000 7fad527fc700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad4002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:37.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.821+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad5c0c6dd0 con 0x7fad4005ede0 2023-05-10T01:45:37.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.821+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad4002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:37.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.822+0000 7fad5a59c700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad4002fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fad4c007e50 tx=0x7fad4c007b90).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:37.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.841+0000 7fad527fc700 1 -- 172.21.15.52:0/4156554846 <== mgr.8509 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad5c0c6dd0 con 0x7fad4005ede0 2023-05-10T01:45:37.845 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule set for path snap_test_dir1 2023-05-10T01:45:37.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 msgr2=0x7fad4002fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:37.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad4002fd40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fad4c007e50 tx=0x7fad4c007b90).stop 2023-05-10T01:45:37.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 msgr2=0x7fad5c0bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:37.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fad54009de0 tx=0x7fad54009780).stop 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 shutdown_connections 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fad4005ede0 0x7fad4002fd40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad5c150d80 0x7fad5c0bf010 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad5c06a280 0x7fad5c0c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 --2- 172.21.15.52:0/4156554846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5c1509a0 0x7fad5c0beb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 >> 172.21.15.52:0/4156554846 conn(0x7fad5c0c4610 msgr2=0x7fad5c0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:37.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 shutdown_connections 2023-05-10T01:45:37.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.843+0000 7fad60e14700 1 -- 172.21.15.52:0/4156554846 wait complete. 2023-05-10T01:45:37.861 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-05-10T01:45:37.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-05-10T01:45:37.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.988+0000 7fd4bcc26700 1 Processor -- start 2023-05-10T01:45:37.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.988+0000 7fd4bcc26700 1 -- start start 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4bcc26700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd4b8064e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4bcc26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b80bc8a0 con 0x7fd4b8067070 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4bcc26700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b8068810 con 0x7fd4b80bda00 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4bcc26700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81523d0 con 0x7fd4b8155b80 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4b5d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd4b8067070 0x7fd4b80bd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51846/0 (socket says 172.21.15.52:51846) 2023-05-10T01:45:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.989+0000 7fd4b5d9b700 1 -- 172.21.15.52:0/2165868021 learned_addr learned my addr 172.21.15.52:0/2165868021 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b659c700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd4b8064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778040422 0 0) 0x7fd4b80bc8a0 con 0x7fd4b8067070 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4980033f0 con 0x7fd4b8067070 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492012144 0 0) 0x7fd4b8068810 con 0x7fd4b80bda00 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b80bc8a0 con 0x7fd4b80bda00 2023-05-10T01:45:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472471637 0 0) 0x7fd4980033f0 con 0x7fd4b8067070 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 msgr2=0x7fd4b8064e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd4b8064e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 >> v1:172.21.15.172:6789/0 conn(0x7fd4b80bda00 legacy=0x7fd4b80a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8068a90 con 0x7fd4b8067070 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd4a0001470 con 0x7fd4b8067070 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 >> v1:172.21.15.52:6789/0 conn(0x7fd4b8067070 legacy=0x7fd4b80bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd498003aa0 0x7fd498003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd498004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd498004b80 0x7fd498005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81523d0 con 0x7fd498004b80 2023-05-10T01:45:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49800b910 con 0x7fd498003aa0 2023-05-10T01:45:37.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49800bad0 con 0x7fd4b8155b80 2023-05-10T01:45:37.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd498004b80 0x7fd498005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:37.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b659c700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd498003aa0 0x7fd498003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:37.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b5d9b700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd498004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:37.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.990+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 msgr2=0x7fd498004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:37.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b8155b80 0x7fd498004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd498003aa0 msgr2=0x7fd498003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd498003aa0 0x7fd498003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/2165868021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980033f0 con 0x7fd498004b80 2023-05-10T01:45:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd498004b80 0x7fd498005000 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fd4a8001fd0 tx=0x7fd4a8007f30).ready entity=mon.0 client_cookie=7d512dae43d948bb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8006a20 con 0x7fd498004b80 2023-05-10T01:45:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8006b80 con 0x7fd498004b80 2023-05-10T01:45:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b559a700 1 -- 172.21.15.52:0/2165868021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800c8b0 con 0x7fd498004b80 2023-05-10T01:45:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 -- 172.21.15.52:0/2165868021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd498004b80 msgr2=0x7fd498005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/2165868021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd498004b80 0x7fd498005000 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7fd4a8001fd0 tx=0x7fd4a8007f30).stop 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/2165868021 reap_dead start 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 -- 172.21.15.52:0/2165868021 shutdown_connections 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 -- 172.21.15.52:0/2165868021 >> 172.21.15.52:0/2165868021 conn(0x7fd4b80c8410 msgr2=0x7fd4b80c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 -- 172.21.15.52:0/2165868021 shutdown_connections 2023-05-10T01:45:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.991+0000 7fd4bcc26700 1 -- 172.21.15.52:0/2165868021 wait complete. 2023-05-10T01:45:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.992+0000 7fd4bcc26700 1 Processor -- start 2023-05-10T01:45:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 -- start start 2023-05-10T01:45:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd498004b80 0x7fd4b80ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8156f30 0x7fd4b81499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81582c0 con 0x7fd4b8149ec0 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80acd40 con 0x7fd4b8156f30 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4bcc26700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81576b0 con 0x7fd498004b80 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4b6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4b6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42844/0 (socket says 172.21.15.52:42844) 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.993+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/560814246 learned_addr learned my addr 172.21.15.52:0/560814246 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b5d9b700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8156f30 0x7fd4b81499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b659c700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd498004b80 0x7fd4b80ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd498004b80 msgr2=0x7fd4b80ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd498004b80 0x7fd4b80ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8156f30 msgr2=0x7fd4b81499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8156f30 0x7fd4b81499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 -- 172.21.15.52:0/560814246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8157990 con 0x7fd4b8149ec0 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4b6d9d700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fd4a8011000 tx=0x7fd4a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8003070 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8004040 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b8157c70 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800c8b0 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.994+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b81573b0 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.995+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b806c340 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.995+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 82) v1 ==== 75179+0+0 (secure 0 0 0) 0x7fd4a8025030 con 0x7fd4b8149ec0 2023-05-10T01:45:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.996+0000 7fd4ae7fc700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 0x7fd49c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.996+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fd4a807a6b0 con 0x7fd4b8149ec0 2023-05-10T01:45:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.996+0000 7fd4b659c700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 0x7fd49c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:37.996+0000 7fd4b659c700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 0x7fd49c061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd4b80c59e0 tx=0x7fd4b0009060).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.000+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4a804bbd0 con 0x7fd4b8149ec0 2023-05-10T01:45:38.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.197+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4b8158400 con 0x7fd49c05ed40 2023-05-10T01:45:38.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.203+0000 7fd4ae7fc700 1 -- 172.21.15.52:0/560814246 <== mgr.8509 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fd4b8158400 con 0x7fd49c05ed40 2023-05-10T01:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout:Retention added to path snap_test_dir1 2023-05-10T01:45:38.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 msgr2=0x7fd49c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 0x7fd49c061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd4b80c59e0 tx=0x7fd4b0009060).stop 2023-05-10T01:45:38.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 msgr2=0x7fd4b80622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7fd4a8011000 tx=0x7fd4a8016000).stop 2023-05-10T01:45:38.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 shutdown_connections 2023-05-10T01:45:38.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd49c05ed40 0x7fd49c061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4b8149ec0 0x7fd4b80622a0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd498004b80 0x7fd4b80ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 --2- 172.21.15.52:0/560814246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8156f30 0x7fd4b81499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.204+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 >> 172.21.15.52:0/560814246 conn(0x7fd4b80c8410 msgr2=0x7fd4b8064e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.205+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 shutdown_connections 2023-05-10T01:45:38.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.205+0000 7fd4bcc26700 1 -- 172.21.15.52:0/560814246 wait complete. 2023-05-10T01:45:38.219 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-05-10T01:45:38.223 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-05-10-01_46_00 in ~22s... 2023-05-10T01:45:38.224 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-05-10T01:45:38.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-05-10T01:45:38.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.342+0000 7efeb8607700 1 Processor -- start 2023-05-10T01:45:38.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.342+0000 7efeb8607700 1 -- start start 2023-05-10T01:45:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb8607700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efeb00c5d20 0x7efeb00aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb8607700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 0x7efeb0153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb8607700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00c8820 con 0x7efeb00c6100 2023-05-10T01:45:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb8607700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00ca5f0 con 0x7efeb00c5d20 2023-05-10T01:45:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb8607700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c8b00 con 0x7efeb0153a90 2023-05-10T01:45:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb63a3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efeb00c5d20 0x7efeb00aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb5ba2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efeb00c6100 0x7efeb0069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51864/0 (socket says 172.21.15.52:51864) 2023-05-10T01:45:38.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.343+0000 7efeb5ba2700 1 -- 172.21.15.52:0/1402005783 learned_addr learned my addr 172.21.15.52:0/1402005783 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb6ba4700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 0x7efeb0153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb63a3700 1 -- 172.21.15.52:0/1402005783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 msgr2=0x7efeb0153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb63a3700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 0x7efeb0153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb63a3700 1 -- 172.21.15.52:0/1402005783 >> v1:172.21.15.52:6789/0 conn(0x7efeb00c6100 legacy=0x7efeb0069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb53a1700 1 -- 172.21.15.52:0/1402005783 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410037434 0 0) 0x7efeb00c8820 con 0x7efeb00c6100 2023-05-10T01:45:38.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb63a3700 1 -- 172.21.15.52:0/1402005783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00c8de0 con 0x7efeb00c5d20 2023-05-10T01:45:38.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb6ba4700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 0x7efeb0153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb63a3700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb00aa200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7efea8009760 tx=0x7efea8009060).ready entity=mon.0 client_cookie=553a62b803660f35 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb53a1700 1 -- 172.21.15.52:0/1402005783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800b580 con 0x7efeb00c5d20 2023-05-10T01:45:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb53a1700 1 -- 172.21.15.52:0/1402005783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800b6e0 con 0x7efeb00c5d20 2023-05-10T01:45:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb53a1700 1 -- 172.21.15.52:0/1402005783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800ba60 con 0x7efeb00c5d20 2023-05-10T01:45:38.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb8607700 1 -- 172.21.15.52:0/1402005783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 msgr2=0x7efeb00aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.344+0000 7efeb8607700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb00aa200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7efea8009760 tx=0x7efea8009060).stop 2023-05-10T01:45:38.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 -- 172.21.15.52:0/1402005783 shutdown_connections 2023-05-10T01:45:38.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb0153a90 0x7efeb0153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 --2- 172.21.15.52:0/1402005783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb00aa200 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 -- 172.21.15.52:0/1402005783 >> 172.21.15.52:0/1402005783 conn(0x7efeb00cb6f0 msgr2=0x7efeb00c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 -- 172.21.15.52:0/1402005783 shutdown_connections 2023-05-10T01:45:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.345+0000 7efeb8607700 1 -- 172.21.15.52:0/1402005783 wait complete. 2023-05-10T01:45:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.346+0000 7efeb8607700 1 Processor -- start 2023-05-10T01:45:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.346+0000 7efeb8607700 1 -- start start 2023-05-10T01:45:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb00c6100 0x7efeb0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb0153a90 0x7efeb00c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb014c880 con 0x7efeb00c5d20 2023-05-10T01:45:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0152f40 con 0x7efeb0153a90 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01523c0 con 0x7efeb00c6100 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42854/0 (socket says 172.21.15.52:42854) 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 -- 172.21.15.52:0/1202903629 learned_addr learned my addr 172.21.15.52:0/1202903629 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb5ba2700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb00c6100 0x7efeb0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb6ba4700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb0153a90 0x7efeb00c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 -- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb00c6100 msgr2=0x7efeb0151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb00c6100 0x7efeb0151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 -- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb0153a90 msgr2=0x7efeb00c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb0153a90 0x7efeb00c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 -- 172.21.15.52:0/1202903629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80092a0 con 0x7efeb00c5d20 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb63a3700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7efea8009eb0 tx=0x7efea8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8000bc0 con 0x7efeb00c5d20 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800b850 con 0x7efeb00c5d20 2023-05-10T01:45:38.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb01526a0 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8000d20 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.347+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0152c60 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.348+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0066720 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.349+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 82) v1 ==== 75179+0+0 (secure 0 0 0) 0x7efea800f070 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.349+0000 7efeae7fc700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 0x7efe900611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.349+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7efea807ba50 con 0x7efeb00c5d20 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.349+0000 7efeb5ba2700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 0x7efe900611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.349+0000 7efeb5ba2700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 0x7efe900611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7efea40011e0 tx=0x7efea4009040).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.353+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efea804cec0 con 0x7efeb00c5d20 2023-05-10T01:45:38.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.550+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeb00c90c0 con 0x7efe9005ed10 2023-05-10T01:45:38.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.553+0000 7efeae7fc700 1 -- 172.21.15.52:0/1202903629 <== mgr.8509 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7efeb00c90c0 con 0x7efe9005ed10 2023-05-10T01:45:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:38.618 INFO:teuthology.orchestra.run.smithi052.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 msgr2=0x7efe900611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 0x7efe900611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7efea40011e0 tx=0x7efea4009040).stop 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 msgr2=0x7efeb014c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7efea8009eb0 tx=0x7efea8017000).stop 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 shutdown_connections 2023-05-10T01:45:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7efe9005ed10 0x7efe900611d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb0153a90 0x7efeb00c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeb00c5d20 0x7efeb014c390 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 --2- 172.21.15.52:0/1202903629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeb00c6100 0x7efeb0151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 >> 172.21.15.52:0/1202903629 conn(0x7efeb00cb6f0 msgr2=0x7efeb00ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 shutdown_connections 2023-05-10T01:45:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.554+0000 7efeb8607700 1 -- 172.21.15.52:0/1202903629 wait complete. 2023-05-10T01:45:38.621 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-05-10T01:45:38.621 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-05-10T01:45:38.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-05-10T01:45:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 Processor -- start 2023-05-10T01:45:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 -- start start 2023-05-10T01:45:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 0x7f2c780c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c780c61e0 0x7f2c78154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7806a130 con 0x7f2c78153f80 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c78069f50 con 0x7f2c780c61e0 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.740+0000 7f2c7c99f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7806a9d0 con 0x7f2c780c1150 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c780c61e0 0x7f2c78154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c76d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2c78153f80 0x7f2c780a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51878/0 (socket says 172.21.15.52:51878) 2023-05-10T01:45:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c76d9d700 1 -- 172.21.15.52:0/2481758093 learned_addr learned my addr 172.21.15.52:0/2481758093 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7659c700 1 --2- 172.21.15.52:0/2481758093 >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 0x7f2c780c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 -- 172.21.15.52:0/2481758093 >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 msgr2=0x7f2c780c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 --2- 172.21.15.52:0/2481758093 >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 0x7f2c780c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 -- 172.21.15.52:0/2481758093 >> v1:172.21.15.52:6789/0 conn(0x7f2c78153f80 legacy=0x7f2c780a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c75d9b700 1 -- 172.21.15.52:0/2481758093 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874014026 0 0) 0x7f2c7806a130 con 0x7f2c78153f80 2023-05-10T01:45:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 -- 172.21.15.52:0/2481758093 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7806a410 con 0x7f2c780c61e0 2023-05-10T01:45:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7659c700 1 --2- 172.21.15.52:0/2481758093 >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 0x7f2c780c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c7759e700 1 --2- 172.21.15.52:0/2481758093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c78154360 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f2c780c8230 tx=0x7f2c68009060).ready entity=mon.0 client_cookie=ef7ff3f334d5a50b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c75d9b700 1 -- 172.21.15.52:0/2481758093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800b580 con 0x7f2c780c61e0 2023-05-10T01:45:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c75d9b700 1 -- 172.21.15.52:0/2481758093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800b6e0 con 0x7f2c780c61e0 2023-05-10T01:45:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.741+0000 7f2c75d9b700 1 -- 172.21.15.52:0/2481758093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800ba60 con 0x7f2c780c61e0 2023-05-10T01:45:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 -- 172.21.15.52:0/2481758093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 msgr2=0x7f2c78154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/2481758093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c78154360 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f2c780c8230 tx=0x7f2c68009060).stop 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 -- 172.21.15.52:0/2481758093 shutdown_connections 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/2481758093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c78154360 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/2481758093 >> v2:172.21.15.172:3300/0 conn(0x7f2c780c1150 0x7f2c780c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 -- 172.21.15.52:0/2481758093 >> 172.21.15.52:0/2481758093 conn(0x7f2c780cb5f0 msgr2=0x7f2c780c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 -- 172.21.15.52:0/2481758093 shutdown_connections 2023-05-10T01:45:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.742+0000 7f2c7c99f700 1 -- 172.21.15.52:0/2481758093 wait complete. 2023-05-10T01:45:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.743+0000 7f2c7c99f700 1 Processor -- start 2023-05-10T01:45:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.743+0000 7f2c7c99f700 1 -- start start 2023-05-10T01:45:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c1150 0x7f2c780c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c78153f80 0x7f2c78068230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78165110 con 0x7f2c780c61e0 2023-05-10T01:45:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78164d10 con 0x7f2c780c1150 2023-05-10T01:45:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7c99f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780a9590 con 0x7f2c78153f80 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42870/0 (socket says 172.21.15.52:42870) 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 -- 172.21.15.52:0/294884739 learned_addr learned my addr 172.21.15.52:0/294884739 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c76d9d700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c1150 0x7f2c780c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7759e700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c78153f80 0x7f2c78068230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 -- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c78153f80 msgr2=0x7f2c78068230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c78153f80 0x7f2c78068230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 -- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c1150 msgr2=0x7f2c780c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c1150 0x7f2c780c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 -- 172.21.15.52:0/294884739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680092a0 con 0x7f2c780c61e0 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.744+0000 7f2c7659c700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f2c6000cfb0 tx=0x7f2c60007840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.745+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000ad80 con 0x7f2c780c61e0 2023-05-10T01:45:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.745+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60016400 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.745+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c780a9870 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.745+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60016780 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.745+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c780b0730 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.746+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c781653b0 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.746+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 82) v1 ==== 75179+0+0 (secure 0 0 0) 0x7f2c600203f0 con 0x7f2c780c61e0 2023-05-10T01:45:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.746+0000 7f2c6effd700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 0x7f2c5c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.747+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2c6007a740 con 0x7f2c780c61e0 2023-05-10T01:45:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.747+0000 7f2c76d9d700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 0x7f2c5c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.747+0000 7f2c76d9d700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 0x7f2c5c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2c700011e0 tx=0x7f2c70007bb0).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.751+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c6004bb50 con 0x7f2c780c61e0 2023-05-10T01:45:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.836+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 83) v1 ==== 75379+0+0 (secure 0 0 0) 0x7f2c60078510 con 0x7f2c780c61e0 2023-05-10T01:45:38.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.951+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c780a9410 con 0x7f2c5c05ed40 2023-05-10T01:45:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.956+0000 7f2c6effd700 1 -- 172.21.15.52:0/294884739 <== mgr.8509 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2c70007370 con 0x7f2c5c05ed40 2023-05-10T01:45:38.958 INFO:teuthology.orchestra.run.smithi052.stdout:Schedule removed for path snap_test_dir1 2023-05-10T01:45:38.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 msgr2=0x7f2c5c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 0x7f2c5c061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2c700011e0 tx=0x7f2c70007bb0).stop 2023-05-10T01:45:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 msgr2=0x7f2c780b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f2c6000cfb0 tx=0x7f2c60007840).stop 2023-05-10T01:45:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 shutdown_connections 2023-05-10T01:45:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2c5c05ed40 0x7f2c5c061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c78153f80 0x7f2c78068230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c780c1150 0x7f2c780c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 --2- 172.21.15.52:0/294884739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c780c61e0 0x7f2c780b0240 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 >> 172.21.15.52:0/294884739 conn(0x7f2c780cb5f0 msgr2=0x7f2c780acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 shutdown_connections 2023-05-10T01:45:38.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:38.958+0000 7f2c7c99f700 1 -- 172.21.15.52:0/294884739 wait complete. 2023-05-10T01:45:38.972 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-05-10T01:45:38.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:38.972 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-05-10T01:45:38.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:38.989 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-05-10T01:45:39.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-05-10T01:45:39.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.203+0000 7ff05019b700 1 Processor -- start 2023-05-10T01:45:39.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.203+0000 7ff05019b700 1 -- start start 2023-05-10T01:45:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff05019b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 0x7ff0481544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff05019b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0480cb410 0x7ff0480c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff05019b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0481550e0 con 0x7ff048155570 2023-05-10T01:45:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff05019b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480c6830 con 0x7ff0480cb410 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff05019b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480c6550 con 0x7ff048154110 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff04e738700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff048155570 0x7ff048068150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51896/0 (socket says 172.21.15.52:51896) 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.204+0000 7ff04e738700 1 -- 172.21.15.52:0/3500595039 learned_addr learned my addr 172.21.15.52:0/3500595039 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04df37700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 0x7ff0481544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 --2- 172.21.15.52:0/3500595039 >> v2:172.21.15.172:3300/0 conn(0x7ff0480cb410 0x7ff0480c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485067879 0 0) 0x7ff0481550e0 con 0x7ff048155570 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0300033f0 con 0x7ff048155570 2023-05-10T01:45:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 -- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 msgr2=0x7ff0481544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 0x7ff0481544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675820951 0 0) 0x7ff0300033f0 con 0x7ff048155570 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 -- 172.21.15.52:0/3500595039 >> v1:172.21.15.52:6789/0 conn(0x7ff048155570 legacy=0x7ff048068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 -- 172.21.15.52:0/3500595039 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048154a90 con 0x7ff0480cb410 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04df37700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 0x7ff0481544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04d736700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480c5c00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7ff038009760 tx=0x7ff038009060).ready entity=mon.1 client_cookie=9c8598671b9d7084 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400017f0 con 0x7ff0480cb410 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038011400 con 0x7ff0480cb410 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.205+0000 7ff04cf35700 1 -- 172.21.15.52:0/3500595039 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011780 con 0x7ff0480cb410 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 -- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 msgr2=0x7ff0480c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480c5c00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7ff038009760 tx=0x7ff038009060).stop 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 -- 172.21.15.52:0/3500595039 shutdown_connections 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048154110 0x7ff0481544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 --2- 172.21.15.52:0/3500595039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480c5c00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 -- 172.21.15.52:0/3500595039 >> 172.21.15.52:0/3500595039 conn(0x7ff0480678d0 msgr2=0x7ff0480cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:39.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 -- 172.21.15.52:0/3500595039 shutdown_connections 2023-05-10T01:45:39.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.206+0000 7ff05019b700 1 -- 172.21.15.52:0/3500595039 wait complete. 2023-05-10T01:45:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.207+0000 7ff05019b700 1 Processor -- start 2023-05-10T01:45:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.207+0000 7ff05019b700 1 -- start start 2023-05-10T01:45:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048155570 0x7ff0481522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480aa370 con 0x7ff048154110 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480afd20 con 0x7ff0480cb410 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480af240 con 0x7ff048155570 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42884/0 (socket says 172.21.15.52:42884) 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 -- 172.21.15.52:0/2257250010 learned_addr learned my addr 172.21.15.52:0/2257250010 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04df37700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04e738700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048155570 0x7ff0481522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 -- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048155570 msgr2=0x7ff0481522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048155570 0x7ff0481522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 -- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 msgr2=0x7ff0480aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 -- 172.21.15.52:0/2257250010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044009250 con 0x7ff048154110 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04df37700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff04d736700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7ff048083c40 tx=0x7ff038016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038010920 con 0x7ff048154110 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038010a80 con 0x7ff048154110 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038010e20 con 0x7ff048154110 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.208+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0380092a0 con 0x7ff048154110 2023-05-10T01:45:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.209+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480a4240 con 0x7ff048154110 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.210+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff048066720 con 0x7ff048154110 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.210+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 83) v1 ==== 75379+0+0 (secure 0 0 0) 0x7ff038023020 con 0x7ff048154110 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.210+0000 7ff035ffb700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 0x7ff0280612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.210+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7ff03807b7c0 con 0x7ff048154110 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.211+0000 7ff04df37700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 0x7ff0280612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.211+0000 7ff04df37700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 0x7ff0280612c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff044006d20 tx=0x7ff044008040).ready entity=mgr.8509 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:39.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.214+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff03804c9b0 con 0x7ff048154110 2023-05-10T01:45:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.435+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff0480afb80 con 0x7ff048154110 2023-05-10T01:45:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.839+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff03800f070 con 0x7ff048154110 2023-05-10T01:45:39.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.840+0000 7ff035ffb700 1 -- 172.21.15.52:0/2257250010 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v84) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff038042740 con 0x7ff048154110 2023-05-10T01:45:39.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 msgr2=0x7ff0280612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 0x7ff0280612c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff044006d20 tx=0x7ff044008040).stop 2023-05-10T01:45:39.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 msgr2=0x7ff0480a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:39.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7ff048083c40 tx=0x7ff038016000).stop 2023-05-10T01:45:39.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 shutdown_connections 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff02805ee00 0x7ff0280612c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff048155570 0x7ff0481522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0480cb410 0x7ff0480aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 --2- 172.21.15.52:0/2257250010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff048154110 0x7ff0480a3d50 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 >> 172.21.15.52:0/2257250010 conn(0x7ff0480678d0 msgr2=0x7ff0480c1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 shutdown_connections 2023-05-10T01:45:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:39.843+0000 7ff05019b700 1 -- 172.21.15.52:0/2257250010 wait complete. 2023-05-10T01:45:39.864 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T01:45:39.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:39.896 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T01:45:39.925 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T01:45:39.926 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-10T01:45:39.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-05-10T01:45:39.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-10T01:45:39.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:45:39.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:39.984 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T01:45:39.987 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:39.985+0000 7f027cccc680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:39.991 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:39.989+0000 7f1da3dc5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T01:45:39.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:40.053 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:40.051+0000 7f1da3dc5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:40.054 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:40.052+0000 7f027cccc680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T01:45:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.156+0000 7f1114e08700 1 Processor -- start 2023-05-10T01:45:40.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.156+0000 7f1114e08700 1 -- start start 2023-05-10T01:45:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.157+0000 7f1114e08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154160 0x7f11100c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.157+0000 7f1114e08700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1110069da0 0x7f11100c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.157+0000 7f1114e08700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100c0650 con 0x7f1110154540 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.157+0000 7f1114e08700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100c1af0 con 0x7f1110069da0 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.157+0000 7f1114e08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11100bfd20 con 0x7f1110154160 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1110069da0 0x7f11100c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110dd9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1110154540 0x7f1110069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51968/0 (socket says 172.21.15.52:51968) 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110dd9b700 1 -- 172.21.15.52:0/1840381343 learned_addr learned my addr 172.21.15.52:0/1840381343 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110e59c700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154160 0x7f11100c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 -- 172.21.15.52:0/1840381343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154160 msgr2=0x7f11100c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154160 0x7f11100c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 -- 172.21.15.52:0/1840381343 >> v1:172.21.15.52:6789/0 conn(0x7f1110154540 legacy=0x7f1110069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 -- 172.21.15.52:0/1840381343 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100c0000 con 0x7f1110069da0 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110d59a700 1 -- 172.21.15.52:0/1840381343 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270029561 0 0) 0x7f11100c0650 con 0x7f1110154540 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110ed9d700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f11100c6150 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f1108009e60 tx=0x7f1108009780).ready entity=mon.0 client_cookie=f74faf09c39e86b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110d59a700 1 -- 172.21.15.52:0/1840381343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800e070 con 0x7f1110069da0 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110d59a700 1 -- 172.21.15.52:0/1840381343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110800bb60 con 0x7f1110069da0 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.158+0000 7f110d59a700 1 -- 172.21.15.52:0/1840381343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108012410 con 0x7f1110069da0 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 -- 172.21.15.52:0/1840381343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 msgr2=0x7f11100c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f11100c6150 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f1108009e60 tx=0x7f1108009780).stop 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 -- 172.21.15.52:0/1840381343 shutdown_connections 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f11100c6150 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 --2- 172.21.15.52:0/1840381343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154160 0x7f11100c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 -- 172.21.15.52:0/1840381343 >> 172.21.15.52:0/1840381343 conn(0x7f11100cb6f0 msgr2=0x7f11100c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:40.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 -- 172.21.15.52:0/1840381343 shutdown_connections 2023-05-10T01:45:40.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.159+0000 7f1114e08700 1 -- 172.21.15.52:0/1840381343 wait complete. 2023-05-10T01:45:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.160+0000 7f1114e08700 1 Processor -- start 2023-05-10T01:45:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.160+0000 7f1114e08700 1 -- start start 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110154160 0x7f11101459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154540 0x7f1110145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11100c29e0 con 0x7f1110069da0 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110144e10 con 0x7f1110154160 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11100c1dd0 con 0x7f1110154540 2023-05-10T01:45:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42956/0 (socket says 172.21.15.52:42956) 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 -- 172.21.15.52:0/274947314 learned_addr learned my addr 172.21.15.52:0/274947314 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110ed9d700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154540 0x7f1110145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110dd9b700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110154160 0x7f11101459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154540 msgr2=0x7f1110145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154540 0x7f1110145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110154160 msgr2=0x7f11101459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110154160 0x7f11101459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 -- 172.21.15.52:0/274947314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009a20 con 0x7f1110069da0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f110e59c700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f110000e930 tx=0x7f1100009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100012600 con 0x7f1110069da0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100012760 con 0x7f1110069da0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100012ae0 con 0x7f1110069da0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.161+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11100c20b0 con 0x7f1110069da0 2023-05-10T01:45:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.162+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11100c2670 con 0x7f1110069da0 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.162+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11100666b0 con 0x7f1110069da0 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.163+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f1100022070 con 0x7f1110069da0 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.163+0000 7f10fe7fc700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 0x7f10ec0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.163+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f110007a130 con 0x7f1110069da0 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.163+0000 7f110dd9b700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 msgr2=0x7f10ec0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.163+0000 7f110dd9b700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 0x7f10ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.167+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f110004b430 con 0x7f1110069da0 2023-05-10T01:45:40.323 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:40.321+0000 7f1da3dc5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:40.349 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:40.347+0000 7f027cccc680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T01:45:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.364+0000 7f110dd9b700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 msgr2=0x7f10ec0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.364+0000 7f110dd9b700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 0x7f10ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.388+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f111006c340 con 0x7f1110069da0 2023-05-10T01:45:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.389+0000 7f10fe7fc700 1 -- 172.21.15.52:0/274947314 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f110004ea50 con 0x7f1110069da0 2023-05-10T01:45:40.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:40.392 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:40.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 msgr2=0x7f10ec0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:40.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 0x7f10ec0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:40.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 msgr2=0x7f1110144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f110000e930 tx=0x7f1100009060).stop 2023-05-10T01:45:40.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 shutdown_connections 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f10ec05ede0 0x7f10ec0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1110154540 0x7f1110145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1110069da0 0x7f1110144920 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 --2- 172.21.15.52:0/274947314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110154160 0x7f11101459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 >> 172.21.15.52:0/274947314 conn(0x7f11100cb6f0 msgr2=0x7f111014f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 shutdown_connections 2023-05-10T01:45:40.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.391+0000 7f1114e08700 1 -- 172.21.15.52:0/274947314 wait complete. 2023-05-10T01:45:40.396 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:40.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:40.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.561+0000 7f7746348700 1 Processor -- start 2023-05-10T01:45:40.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.561+0000 7f7746348700 1 -- start start 2023-05-10T01:45:40.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f7746348700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7740063e20 0x7f7740069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f7746348700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77400bf4e0 0x7f7740062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f7746348700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7740062950 con 0x7f7740154030 2023-05-10T01:45:40.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f7746348700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7740154410 con 0x7f7740063e20 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f7746348700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7740069fa0 con 0x7f77400bf4e0 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f773f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7740063e20 0x7f7740069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f773ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7740154030 0x7f7740063710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52016/0 (socket says 172.21.15.52:52016) 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.562+0000 7f773ffff700 1 -- 172.21.15.52:0/2550278115 learned_addr learned my addr 172.21.15.52:0/2550278115 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f77448e5700 1 --2- 172.21.15.52:0/2550278115 >> v2:172.21.15.172:3300/0 conn(0x7f77400bf4e0 0x7f7740062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773f7fe700 1 -- 172.21.15.52:0/2550278115 >> v2:172.21.15.172:3300/0 conn(0x7f77400bf4e0 msgr2=0x7f7740062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773f7fe700 1 --2- 172.21.15.52:0/2550278115 >> v2:172.21.15.172:3300/0 conn(0x7f77400bf4e0 0x7f7740062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773f7fe700 1 -- 172.21.15.52:0/2550278115 >> v1:172.21.15.52:6789/0 conn(0x7f7740154030 legacy=0x7f7740063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773effd700 1 -- 172.21.15.52:0/2550278115 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635063836 0 0) 0x7f7740062950 con 0x7f7740154030 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773f7fe700 1 -- 172.21.15.52:0/2550278115 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740062340 con 0x7f7740063e20 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773f7fe700 1 --2- 172.21.15.52:0/2550278115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7740063e20 0x7f7740069ab0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f77400c98b0 tx=0x7f7730009060).ready entity=mon.0 client_cookie=65dd820f4b96f611 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773effd700 1 -- 172.21.15.52:0/2550278115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000f510 con 0x7f7740063e20 2023-05-10T01:45:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773effd700 1 -- 172.21.15.52:0/2550278115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000f670 con 0x7f7740063e20 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.563+0000 7f773effd700 1 -- 172.21.15.52:0/2550278115 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000f9f0 con 0x7f7740063e20 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 -- 172.21.15.52:0/2550278115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7740063e20 msgr2=0x7f7740069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 --2- 172.21.15.52:0/2550278115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7740063e20 0x7f7740069ab0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f77400c98b0 tx=0x7f7730009060).stop 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 -- 172.21.15.52:0/2550278115 shutdown_connections 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 --2- 172.21.15.52:0/2550278115 >> v2:172.21.15.172:3300/0 conn(0x7f77400bf4e0 0x7f7740062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 --2- 172.21.15.52:0/2550278115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7740063e20 0x7f7740069ab0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 -- 172.21.15.52:0/2550278115 >> 172.21.15.52:0/2550278115 conn(0x7f77400c8a90 msgr2=0x7f77400c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:40.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 -- 172.21.15.52:0/2550278115 shutdown_connections 2023-05-10T01:45:40.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.564+0000 7f7746348700 1 -- 172.21.15.52:0/2550278115 wait complete. 2023-05-10T01:45:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.565+0000 7f7746348700 1 Processor -- start 2023-05-10T01:45:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.565+0000 7f7746348700 1 -- start start 2023-05-10T01:45:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 0x7f77400a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7740154030 0x7f77400ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774014f820 con 0x7f77400bf4e0 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400aa850 con 0x7f7740063e20 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f7746348700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400aeb50 con 0x7f7740154030 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43008/0 (socket says 172.21.15.52:43008) 2023-05-10T01:45:40.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 0x7f77400a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 -- 172.21.15.52:0/510854298 learned_addr learned my addr 172.21.15.52:0/510854298 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f77448e5700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7740154030 0x7f77400ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 -- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7740154030 msgr2=0x7f77400ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7740154030 0x7f77400ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 -- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 msgr2=0x7f77400a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 0x7f77400a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 -- 172.21.15.52:0/510854298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300092a0 con 0x7f77400bf4e0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773ffff700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 0x7f77400a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.566+0000 7f773f7fe700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f7740067b30 tx=0x7f7730017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.567+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000fe80 con 0x7f77400bf4e0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.567+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000f7e0 con 0x7f77400bf4e0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.567+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77400a9c40 con 0x7f77400bf4e0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.567+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773001a610 con 0x7f77400bf4e0 2023-05-10T01:45:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.567+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77400aa200 con 0x7f77400bf4e0 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.568+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774006c340 con 0x7f77400bf4e0 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.569+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f773002b070 con 0x7f77400bf4e0 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.569+0000 7f7727fff700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 0x7f77200612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.569+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f773007b0c0 con 0x7f77400bf4e0 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.569+0000 7f773ffff700 1 -- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 msgr2=0x7f77200612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:40.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.569+0000 7f773ffff700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 0x7f77200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:40.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.573+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f773004c4c0 con 0x7f77400bf4e0 2023-05-10T01:45:40.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.749+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7740069b10 con 0x7f77400bf4e0 2023-05-10T01:45:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.750+0000 7f7727fff700 1 -- 172.21.15.52:0/510854298 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17737 (secure 0 0 0) 0x7f7730029020 con 0x7f77400bf4e0 2023-05-10T01:45:40.753 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:40.753 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":174,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:35.997231+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2085813196":"2023-05-11T01:45:35.997195+0000","172.21.15.172:0/2688172415":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6833/125557":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6832/125557":"2023-05-11T01:45:35.997195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 msgr2=0x7f77200612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 0x7f77200612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 msgr2=0x7f774014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f7740067b30 tx=0x7f7730017000).stop 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 shutdown_connections 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f772005ede0 0x7f77200612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7740154030 0x7f77400ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7740063e20 0x7f77400a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 --2- 172.21.15.52:0/510854298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77400bf4e0 0x7f774014f330 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 >> 172.21.15.52:0/510854298 conn(0x7f77400c8a90 msgr2=0x7f77400c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.752+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 shutdown_connections 2023-05-10T01:45:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.753+0000 7f7746348700 1 -- 172.21.15.52:0/510854298 wait complete. 2023-05-10T01:45:40.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-05-10T01:09:44.499405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T01:09:46.826725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T01:45:17.005279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T01:45:18.174556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T01:45:40.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-05-10T01:45:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.890+0000 7f81c0c24700 1 Processor -- start 2023-05-10T01:45:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.890+0000 7f81c0c24700 1 -- start start 2023-05-10T01:45:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81c0c24700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81bc0c5d20 0x7f81bc0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81c0c24700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 0x7f81bc153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81c0c24700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81bc0c8820 con 0x7f81bc0c6100 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81c0c24700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc0ca5f0 con 0x7f81bc0c5d20 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81c0c24700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc0c8b00 con 0x7f81bc153a90 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81bc0c5d20 0x7f81bc0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81bc0c5d20 0x7f81bc0aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43016/0 (socket says 172.21.15.52:43016) 2023-05-10T01:45:40.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 -- 172.21.15.52:0/1363096487 learned_addr learned my addr 172.21.15.52:0/1363096487 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81bad9d700 1 --2- 172.21.15.52:0/1363096487 >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 0x7f81bc153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 -- 172.21.15.52:0/1363096487 >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 msgr2=0x7f81bc153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 --2- 172.21.15.52:0/1363096487 >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 0x7f81bc153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 -- 172.21.15.52:0/1363096487 >> v1:172.21.15.172:6789/0 conn(0x7f81bc0c6100 legacy=0x7f81bc069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 -- 172.21.15.52:0/1363096487 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0c8de0 con 0x7f81bc0c5d20 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81bad9d700 1 --2- 172.21.15.52:0/1363096487 >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 0x7f81bc153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:40.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.891+0000 7f81ba59c700 1 --2- 172.21.15.52:0/1363096487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc0aa200 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f81bc06bcc0 tx=0x7f81ac0090f0).ready entity=mon.0 client_cookie=bffec94b60aaa474 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81b959a700 1 -- 172.21.15.52:0/1363096487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00b600 con 0x7f81bc0c5d20 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81b959a700 1 -- 172.21.15.52:0/1363096487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00b760 con 0x7f81bc0c5d20 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81b959a700 1 -- 172.21.15.52:0/1363096487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00bae0 con 0x7f81bc0c5d20 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 -- 172.21.15.52:0/1363096487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 msgr2=0x7f81bc0aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 --2- 172.21.15.52:0/1363096487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc0aa200 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f81bc06bcc0 tx=0x7f81ac0090f0).stop 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 -- 172.21.15.52:0/1363096487 shutdown_connections 2023-05-10T01:45:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 --2- 172.21.15.52:0/1363096487 >> v2:172.21.15.172:3300/0 conn(0x7f81bc153a90 0x7f81bc153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 --2- 172.21.15.52:0/1363096487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc0aa200 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 -- 172.21.15.52:0/1363096487 >> 172.21.15.52:0/1363096487 conn(0x7f81bc0cb6f0 msgr2=0x7f81bc0c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 -- 172.21.15.52:0/1363096487 shutdown_connections 2023-05-10T01:45:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.892+0000 7f81c0c24700 1 -- 172.21.15.52:0/1363096487 wait complete. 2023-05-10T01:45:40.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.893+0000 7f81c0c24700 1 Processor -- start 2023-05-10T01:45:40.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.893+0000 7f81c0c24700 1 -- start start 2023-05-10T01:45:40.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81bc0c6100 0x7f81bc0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81bc153a90 0x7f81bc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0c3980 con 0x7f81bc0c5d20 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0c4590 con 0x7f81bc153a90 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81c0c24700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1555b0 con 0x7f81bc0c6100 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81ba59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81ba59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43020/0 (socket says 172.21.15.52:43020) 2023-05-10T01:45:40.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81ba59c700 1 -- 172.21.15.52:0/3621730531 learned_addr learned my addr 172.21.15.52:0/3621730531 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81bad9d700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81bc153a90 0x7f81bc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.894+0000 7f81b9d9b700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81bc0c6100 0x7f81bc0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81bc0c6100 msgr2=0x7f81bc0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81bc0c6100 0x7f81bc0c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81bc153a90 msgr2=0x7f81bc154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81bc153a90 0x7f81bc154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 -- 172.21.15.52:0/3621730531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac009370 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81ba59c700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f81ac009fd0 tx=0x7f81ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00b8d0 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00ba30 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc0c3c60 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac01b660 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.895+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc0c4220 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.896+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81bc066720 con 0x7f81bc0c5d20 2023-05-10T01:45:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.896+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f81ac02b070 con 0x7f81bc0c5d20 2023-05-10T01:45:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.897+0000 7f81aa7fc700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 0x7f81980612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.897+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f81ac07b700 con 0x7f81bc0c5d20 2023-05-10T01:45:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.897+0000 7f81b9d9b700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 msgr2=0x7f81980612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.897+0000 7f81b9d9b700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 0x7f81980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:40.901+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81ac04ca00 con 0x7f81bc0c5d20 2023-05-10T01:45:40.929 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:40.926+0000 7f1da3dc5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:41.000 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:40.998+0000 7f1da3dc5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:41.024 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:41.021+0000 7f027cccc680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T01:45:41.093 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:41.091+0000 7f027cccc680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T01:45:41.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.098+0000 7f81b9d9b700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 msgr2=0x7f81980612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:41.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.098+0000 7f81b9d9b700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 0x7f81980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.121+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f81bc06c340 con 0x7f81bc0c5d20 2023-05-10T01:45:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.121+0000 7f81aa7fc700 1 -- 172.21.15.52:0/3621730531 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v174) v1 ==== 110+0+10 (secure 0 0 0) 0x7f81ac01f0b0 con 0x7f81bc0c5d20 2023-05-10T01:45:41.124 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-05-10T01:45:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 msgr2=0x7f81980612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 0x7f81980612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 msgr2=0x7f81bc14f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f81ac009fd0 tx=0x7f81ac017000).stop 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 shutdown_connections 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f819805ede0 0x7f81980612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81bc153a90 0x7f81bc154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc0c5d20 0x7f81bc14f550 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 --2- 172.21.15.52:0/3621730531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81bc0c6100 0x7f81bc0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 >> 172.21.15.52:0/3621730531 conn(0x7f81bc0cb6f0 msgr2=0x7f81bc0ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 shutdown_connections 2023-05-10T01:45:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.123+0000 7f81c0c24700 1 -- 172.21.15.52:0/3621730531 wait complete. 2023-05-10T01:45:41.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T01:45:41.184 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.181+0000 7f1da3dc5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.258+0000 7f2850480700 1 Processor -- start 2023-05-10T01:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.258+0000 7f2850480700 1 -- start start 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f2850480700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2848154460 0x7f28480aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f2850480700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848068150 0x7f28480685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f2850480700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28480c94c0 con 0x7f2848154080 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f2850480700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28480cb7d0 con 0x7f2848154460 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f2850480700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2848068a90 con 0x7f2848068150 2023-05-10T01:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f284da1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2848154460 0x7f28480aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f284da1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2848154460 0x7f28480aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43032/0 (socket says 172.21.15.52:43032) 2023-05-10T01:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.259+0000 7f284da1b700 1 -- 172.21.15.52:0/2682920656 learned_addr learned my addr 172.21.15.52:0/2682920656 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284ea1d700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848068150 0x7f28480685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284da1b700 1 -- 172.21.15.52:0/2682920656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848068150 msgr2=0x7f28480685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284da1b700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848068150 0x7f28480685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284da1b700 1 -- 172.21.15.52:0/2682920656 >> v1:172.21.15.172:6789/0 conn(0x7f2848154080 legacy=0x7f28480a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284da1b700 1 -- 172.21.15.52:0/2682920656 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28480c88b0 con 0x7f2848154460 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284da1b700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848154460 0x7f28480aac90 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f2844006fd0 tx=0x7f28440090f0).ready entity=mon.0 client_cookie=fcf48af2c1ce58d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284d21a700 1 -- 172.21.15.52:0/2682920656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400b580 con 0x7f2848154460 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284d21a700 1 -- 172.21.15.52:0/2682920656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400b6e0 con 0x7f2848154460 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.260+0000 7f284d21a700 1 -- 172.21.15.52:0/2682920656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400ba60 con 0x7f2848154460 2023-05-10T01:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 -- 172.21.15.52:0/2682920656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848154460 msgr2=0x7f28480aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848154460 0x7f28480aac90 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f2844006fd0 tx=0x7f28440090f0).stop 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 -- 172.21.15.52:0/2682920656 shutdown_connections 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848068150 0x7f28480685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 --2- 172.21.15.52:0/2682920656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848154460 0x7f28480aac90 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 -- 172.21.15.52:0/2682920656 >> 172.21.15.52:0/2682920656 conn(0x7f2848067910 msgr2=0x7f28480cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 -- 172.21.15.52:0/2682920656 shutdown_connections 2023-05-10T01:45:41.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.261+0000 7f2850480700 1 -- 172.21.15.52:0/2682920656 wait complete. 2023-05-10T01:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.262+0000 7f2850480700 1 Processor -- start 2023-05-10T01:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.262+0000 7f2850480700 1 -- start start 2023-05-10T01:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2848154080 0x7f28480c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848154460 0x7f28481574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848164c80 con 0x7f2848068150 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848164f60 con 0x7f2848154080 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f2850480700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2848165240 con 0x7f2848154460 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43036/0 (socket says 172.21.15.52:43036) 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 -- 172.21.15.52:0/883373091 learned_addr learned my addr 172.21.15.52:0/883373091 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284da1b700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2848154080 0x7f28480c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284ea1d700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848154460 0x7f28481574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 -- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848154460 msgr2=0x7f28481574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848154460 0x7f28481574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 -- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2848154080 msgr2=0x7f28480c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2848154080 0x7f28480c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 -- 172.21.15.52:0/883373091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009370 con 0x7f2848068150 2023-05-10T01:45:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f284e21c700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f283800c440 tx=0x7f2838007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.263+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838012400 con 0x7f2848068150 2023-05-10T01:45:41.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.264+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838012580 con 0x7f2848068150 2023-05-10T01:45:41.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.264+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2848165520 con 0x7f2848068150 2023-05-10T01:45:41.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.264+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838012940 con 0x7f2848068150 2023-05-10T01:45:41.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.264+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28481579e0 con 0x7f2848068150 2023-05-10T01:45:41.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.265+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848155dd0 con 0x7f2848068150 2023-05-10T01:45:41.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.265+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2838019030 con 0x7f2848068150 2023-05-10T01:45:41.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.265+0000 7f28367fc700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 0x7f28280612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.266+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2838078fb0 con 0x7f2848068150 2023-05-10T01:45:41.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.266+0000 7f284da1b700 1 -- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 msgr2=0x7f28280612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:41.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.266+0000 7f284da1b700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 0x7f28280612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.270+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28380488f0 con 0x7f2848068150 2023-05-10T01:45:41.293 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:41.291+0000 7f027cccc680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T01:45:41.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.442+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2848066720 con 0x7f2848068150 2023-05-10T01:45:41.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.442+0000 7f28367fc700 1 -- 172.21.15.52:0/883373091 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v174) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2838017030 con 0x7f2848068150 2023-05-10T01:45:41.445 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-05-10T01:45:41.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 msgr2=0x7f28280612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:41.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 0x7f28280612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 msgr2=0x7f2848164670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f283800c440 tx=0x7f2838007dc0).stop 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 shutdown_connections 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f282805ede0 0x7f28280612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2848154460 0x7f28481574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2848068150 0x7f2848164670 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 --2- 172.21.15.52:0/883373091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2848154080 0x7f28480c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 >> 172.21.15.52:0/883373091 conn(0x7f2848067910 msgr2=0x7f284814f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 shutdown_connections 2023-05-10T01:45:41.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.444+0000 7f2850480700 1 -- 172.21.15.52:0/883373091 wait complete. 2023-05-10T01:45:41.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T01:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.580+0000 7ff89dfa2700 1 Processor -- start 2023-05-10T01:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.580+0000 7ff89dfa2700 1 -- start start 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff89814c6f0 0x7ff898066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff898152e80 0x7ff898064570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff898064a60 0x7ff8981559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff898067330 con 0x7ff898152e80 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff898068150 con 0x7ff89814c6f0 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89dfa2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff898153330 con 0x7ff898064a60 2023-05-10T01:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff898152e80 0x7ff898064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff898152e80 0x7ff898064570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43064/0 (socket says 172.21.15.52:43064) 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 -- 172.21.15.52:0/1589499222 learned_addr learned my addr 172.21.15.52:0/1589499222 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89d7a1700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff898064a60 0x7ff8981559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff89cfa0700 1 --2- 172.21.15.52:0/1589499222 >> v2:172.21.15.172:3300/0 conn(0x7ff89814c6f0 0x7ff898066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 -- 172.21.15.52:0/1589499222 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff898064a60 msgr2=0x7ff8981559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff898064a60 0x7ff8981559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 -- 172.21.15.52:0/1589499222 >> v2:172.21.15.172:3300/0 conn(0x7ff89814c6f0 msgr2=0x7ff898066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 --2- 172.21.15.52:0/1589499222 >> v2:172.21.15.172:3300/0 conn(0x7ff89814c6f0 0x7ff898066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 -- 172.21.15.52:0/1589499222 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898064ef0 con 0x7ff898152e80 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.581+0000 7ff897fff700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff898064570 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7ff89805fc40 tx=0x7ff8840090f0).ready entity=mon.0 client_cookie=1ceba8dd738887d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff8977fe700 1 -- 172.21.15.52:0/1589499222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400f510 con 0x7ff898152e80 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff8977fe700 1 -- 172.21.15.52:0/1589499222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88400f670 con 0x7ff898152e80 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff8977fe700 1 -- 172.21.15.52:0/1589499222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400f9f0 con 0x7ff898152e80 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1589499222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 msgr2=0x7ff898064570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff898064570 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7ff89805fc40 tx=0x7ff8840090f0).stop 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1589499222 shutdown_connections 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff898064a60 0x7ff8981559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1589499222 >> v2:172.21.15.172:3300/0 conn(0x7ff89814c6f0 0x7ff898066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1589499222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff898064570 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1589499222 >> 172.21.15.52:0/1589499222 conn(0x7ff8980c7a70 msgr2=0x7ff8980c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1589499222 shutdown_connections 2023-05-10T01:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.582+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1589499222 wait complete. 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.583+0000 7ff89dfa2700 1 Processor -- start 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 -- start start 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 0x7ff898162770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff89814c6f0 0x7ff898151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980a99b0 con 0x7ff898152e80 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff898162c60 con 0x7ff898064a60 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89dfa2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980a9110 con 0x7ff89814c6f0 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89d7a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89d7a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43070/0 (socket says 172.21.15.52:43070) 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89d7a1700 1 -- 172.21.15.52:0/1805958664 learned_addr learned my addr 172.21.15.52:0/1805958664 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff89cfa0700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 0x7ff898162770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.584+0000 7ff897fff700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff89814c6f0 0x7ff898151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 -- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff89814c6f0 msgr2=0x7ff898151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff89814c6f0 0x7ff898151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 -- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 msgr2=0x7ff898162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 0x7ff898162770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 -- 172.21.15.52:0/1805958664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884009370 con 0x7ff898152e80 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89cfa0700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 0x7ff898162770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:41.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89d7a1700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7ff890009e90 tx=0x7ff89000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000caa0 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000f040 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8980a93f0 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000ce10 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.585+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8981356c0 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.586+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898047150 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.587+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ff890013610 con 0x7ff898152e80 2023-05-10T01:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.587+0000 7ff894ff9700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 0x7ff8800612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.587+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7ff89007a8e0 con 0x7ff898152e80 2023-05-10T01:45:41.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.587+0000 7ff89cfa0700 1 -- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 msgr2=0x7ff8800612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:41.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.588+0000 7ff89cfa0700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 0x7ff8800612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:41.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.592+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff89004bad0 con 0x7ff898152e80 2023-05-10T01:45:41.597 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.595+0000 7f1da3dc5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:41.699 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.696+0000 7f1da3dc5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:41.741 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:41.739+0000 7f027cccc680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T01:45:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.766+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8980c42c0 con 0x7ff898152e80 2023-05-10T01:45:41.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.766+0000 7ff894ff9700 1 -- 172.21.15.52:0/1805958664 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff89004f0f0 con 0x7ff898152e80 2023-05-10T01:45:41.769 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:45:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 msgr2=0x7ff8800612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 0x7ff8800612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 msgr2=0x7ff8980c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7ff890009e90 tx=0x7ff89000b040).stop 2023-05-10T01:45:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 shutdown_connections 2023-05-10T01:45:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff88005ede0 0x7ff8800612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff898152e80 0x7ff8980c0550 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff898064a60 0x7ff898162770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 --2- 172.21.15.52:0/1805958664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff89814c6f0 0x7ff898151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 >> 172.21.15.52:0/1805958664 conn(0x7ff8980c7a70 msgr2=0x7ff8980c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 shutdown_connections 2023-05-10T01:45:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.768+0000 7ff89dfa2700 1 -- 172.21.15.52:0/1805958664 wait complete. 2023-05-10T01:45:41.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T01:45:41.852 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.849+0000 7f1da3dc5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:41.854 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:41.852+0000 7f027cccc680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:41.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.912+0000 7f868eb36700 1 Processor -- start 2023-05-10T01:45:41.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.912+0000 7f868eb36700 1 -- start start 2023-05-10T01:45:41.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868eb36700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f86880c5d20 0x7f86880aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868eb36700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880c6100 0x7f8688069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868eb36700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8688154610 con 0x7f8688153a90 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868eb36700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86880ca5f0 con 0x7f86880c5d20 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868eb36700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c8820 con 0x7f86880c6100 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f86880c5d20 0x7f86880aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868d0d3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8688153a90 0x7f8688153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52094/0 (socket says 172.21.15.52:52094) 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868d0d3700 1 -- 172.21.15.52:0/2884670844 learned_addr learned my addr 172.21.15.52:0/2884670844 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 --2- 172.21.15.52:0/2884670844 >> v2:172.21.15.52:3300/0 conn(0x7f86880c5d20 0x7f86880aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43074/0 (socket says 172.21.15.52:43074) 2023-05-10T01:45:41.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f8687fff700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880c6100 0x7f8688069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 -- 172.21.15.52:0/2884670844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880c6100 msgr2=0x7f8688069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880c6100 0x7f8688069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 -- 172.21.15.52:0/2884670844 >> v1:172.21.15.52:6789/0 conn(0x7f8688153a90 legacy=0x7f8688153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 -- 172.21.15.52:0/2884670844 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880c8b00 con 0x7f86880c5d20 2023-05-10T01:45:41.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f86877fe700 1 -- 172.21.15.52:0/2884670844 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644384694 0 0) 0x7f8688154610 con 0x7f8688153a90 2023-05-10T01:45:41.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.913+0000 7f868c8d2700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c5d20 0x7f86880aa200 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f867c009760 tx=0x7f867c009060).ready entity=mon.0 client_cookie=d10f46043f41f1bc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f86877fe700 1 -- 172.21.15.52:0/2884670844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00f510 con 0x7f86880c5d20 2023-05-10T01:45:41.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f86877fe700 1 -- 172.21.15.52:0/2884670844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00f670 con 0x7f86880c5d20 2023-05-10T01:45:41.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f86877fe700 1 -- 172.21.15.52:0/2884670844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00f9f0 con 0x7f86880c5d20 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 -- 172.21.15.52:0/2884670844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c5d20 msgr2=0x7f86880aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c5d20 0x7f86880aa200 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f867c009760 tx=0x7f867c009060).stop 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 -- 172.21.15.52:0/2884670844 shutdown_connections 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c5d20 0x7f86880aa200 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 --2- 172.21.15.52:0/2884670844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880c6100 0x7f8688069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 -- 172.21.15.52:0/2884670844 >> 172.21.15.52:0/2884670844 conn(0x7f86880cb6f0 msgr2=0x7f86880c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:41.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 -- 172.21.15.52:0/2884670844 shutdown_connections 2023-05-10T01:45:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.914+0000 7f868eb36700 1 -- 172.21.15.52:0/2884670844 wait complete. 2023-05-10T01:45:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.915+0000 7f868eb36700 1 Processor -- start 2023-05-10T01:45:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 -- start start 2023-05-10T01:45:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86880c5d20 0x7f8688150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 0x7f868814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880afad0 con 0x7f86880c6100 2023-05-10T01:45:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880af640 con 0x7f86880c5d20 2023-05-10T01:45:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868eb36700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868814f3b0 con 0x7f8688153a90 2023-05-10T01:45:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f8687fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f8687fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43082/0 (socket says 172.21.15.52:43082) 2023-05-10T01:45:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f8687fff700 1 -- 172.21.15.52:0/4030901470 learned_addr learned my addr 172.21.15.52:0/4030901470 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.916+0000 7f868c8d2700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86880c5d20 0x7f8688150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f868d0d3700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 0x7f868814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 -- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 msgr2=0x7f868814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 0x7f868814eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 -- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86880c5d20 msgr2=0x7f8688150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86880c5d20 0x7f8688150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 -- 172.21.15.52:0/4030901470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0092a0 con 0x7f86880c6100 2023-05-10T01:45:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f868d0d3700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 0x7f868814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8687fff700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f867400e960 tx=0x7f8674009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400c6a0 con 0x7f86880c6100 2023-05-10T01:45:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400c800 con 0x7f86880c6100 2023-05-10T01:45:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8688152be0 con 0x7f86880c6100 2023-05-10T01:45:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400cb80 con 0x7f86880c6100 2023-05-10T01:45:41.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.917+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880af2d0 con 0x7f86880c6100 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.918+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880af7f0 con 0x7f86880c6100 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.918+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f8674022070 con 0x7f86880c6100 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.919+0000 7f8684ff9700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 0x7f8670061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.919+0000 7f868c8d2700 1 -- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 msgr2=0x7f8670061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.919+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f867407a170 con 0x7f86880c6100 2023-05-10T01:45:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.919+0000 7f868c8d2700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 0x7f8670061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:41.933 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.924+0000 7f1da3dc5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:41.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:41.923+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86880af7f0 con 0x7f86880c6100 2023-05-10T01:45:41.992 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:41.990+0000 7f1da3dc5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:42.016 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:42.014+0000 7f027cccc680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:42.094 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:42.092+0000 7f027cccc680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T01:45:42.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.101+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86880af7f0 con 0x7f86880c6100 2023-05-10T01:45:42.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.101+0000 7f8684ff9700 1 -- 172.21.15.52:0/4030901470 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86880af7f0 con 0x7f86880c6100 2023-05-10T01:45:42.103 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-05-10T01:45:42.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 msgr2=0x7f8670061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:42.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 0x7f8670061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 msgr2=0x7f868814e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f867400e960 tx=0x7f8674009060).stop 2023-05-10T01:45:42.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 shutdown_connections 2023-05-10T01:45:42.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f867005edb0 0x7f8670061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8688153a90 0x7f868814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86880c5d20 0x7f8688150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 --2- 172.21.15.52:0/4030901470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86880c6100 0x7f868814e9d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 >> 172.21.15.52:0/4030901470 conn(0x7f86880cb6f0 msgr2=0x7f86880c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 shutdown_connections 2023-05-10T01:45:42.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.103+0000 7f868eb36700 1 -- 172.21.15.52:0/4030901470 wait complete. 2023-05-10T01:45:42.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:42.168 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:42.166+0000 7f027cccc680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T01:45:42.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 Processor -- start 2023-05-10T01:45:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 -- start start 2023-05-10T01:45:42.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b54154160 0x7f2b540c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154540 0x7f2b540c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540c0650 con 0x7f2b54069690 2023-05-10T01:45:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b540c1af0 con 0x7f2b54154160 2023-05-10T01:45:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.240+0000 7f2b59754700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540bfd20 con 0x7f2b54154540 2023-05-10T01:45:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b54154160 0x7f2b540c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b54154160 0x7f2b540c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43088/0 (socket says 172.21.15.52:43088) 2023-05-10T01:45:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 -- 172.21.15.52:0/2641272297 learned_addr learned my addr 172.21.15.52:0/2641272297 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b527fc700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154540 0x7f2b540c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 -- 172.21.15.52:0/2641272297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154540 msgr2=0x7f2b540c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154540 0x7f2b540c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 -- 172.21.15.52:0/2641272297 >> v1:172.21.15.172:6789/0 conn(0x7f2b54069690 legacy=0x7f2b54157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 -- 172.21.15.52:0/2641272297 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540c0000 con 0x7f2b54154160 2023-05-10T01:45:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b52ffd700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154160 0x7f2b540c5c60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f2b44006fd0 tx=0x7f2b440090f0).ready entity=mon.0 client_cookie=9ea89446209d5e2b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b51ffb700 1 -- 172.21.15.52:0/2641272297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400b580 con 0x7f2b54154160 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b51ffb700 1 -- 172.21.15.52:0/2641272297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400b6e0 con 0x7f2b54154160 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.241+0000 7f2b51ffb700 1 -- 172.21.15.52:0/2641272297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400ba60 con 0x7f2b54154160 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 -- 172.21.15.52:0/2641272297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154160 msgr2=0x7f2b540c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154160 0x7f2b540c5c60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f2b44006fd0 tx=0x7f2b440090f0).stop 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 -- 172.21.15.52:0/2641272297 shutdown_connections 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154160 0x7f2b540c5c60 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 --2- 172.21.15.52:0/2641272297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154540 0x7f2b540c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 -- 172.21.15.52:0/2641272297 >> 172.21.15.52:0/2641272297 conn(0x7f2b540cb740 msgr2=0x7f2b540c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 -- 172.21.15.52:0/2641272297 shutdown_connections 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.242+0000 7f2b59754700 1 -- 172.21.15.52:0/2641272297 wait complete. 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.243+0000 7f2b59754700 1 Processor -- start 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.243+0000 7f2b59754700 1 -- start start 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 0x7f2b54153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154160 0x7f2b54156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54158470 con 0x7f2b54154540 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540a9990 con 0x7f2b54069690 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b59754700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54157860 con 0x7f2b54154160 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43098/0 (socket says 172.21.15.52:43098) 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b52ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 0x7f2b54153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 -- 172.21.15.52:0/4106496903 learned_addr learned my addr 172.21.15.52:0/4106496903 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b527fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154160 0x7f2b54156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154160 msgr2=0x7f2b54156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154160 0x7f2b54156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 msgr2=0x7f2b54153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 0x7f2b54153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 -- 172.21.15.52:0/4106496903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009370 con 0x7f2b54154540 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b52ffd700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 0x7f2b54153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.244+0000 7f2b537fe700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f2b4c00c7c0 tx=0x7f2b4c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.245+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00e4a0 con 0x7f2b54154540 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.245+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00e600 con 0x7f2b54154540 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.245+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b54157b40 con 0x7f2b54154540 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.245+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00e980 con 0x7f2b54154540 2023-05-10T01:45:42.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.245+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b54158100 con 0x7f2b54154540 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.246+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b540666b0 con 0x7f2b54154540 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.246+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f2b4c010070 con 0x7f2b54154540 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.246+0000 7f2b3affd700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 0x7f2b340612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.246+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f2b4c079530 con 0x7f2b54154540 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.247+0000 7f2b52ffd700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 msgr2=0x7f2b340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:42.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.247+0000 7f2b52ffd700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 0x7f2b340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:42.261 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:42.244+0000 7f1da3dc5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:42.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.251+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b4c0478f0 con 0x7f2b54154540 2023-05-10T01:45:42.432 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:42.429+0000 7f1da3dc5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:42.448 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:42.445+0000 7f027cccc680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T01:45:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.448+0000 7f2b52ffd700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 msgr2=0x7f2b340612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:42.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.448+0000 7f2b52ffd700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 0x7f2b340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:42.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.469+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b5406c340 con 0x7f2b54154540 2023-05-10T01:45:42.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.470+0000 7f2b3affd700 1 -- 172.21.15.52:0/4106496903 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7f2b4c04a830 con 0x7f2b54154540 2023-05-10T01:45:42.472 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:42.472 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 msgr2=0x7f2b340612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 0x7f2b340612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 msgr2=0x7f2b541571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f2b4c00c7c0 tx=0x7f2b4c001510).stop 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 shutdown_connections 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f2b3405ede0 0x7f2b340612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b54154540 0x7f2b541571b0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b54069690 0x7f2b54153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 --2- 172.21.15.52:0/4106496903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b54154160 0x7f2b54156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 >> 172.21.15.52:0/4106496903 conn(0x7f2b540cb740 msgr2=0x7f2b540c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 shutdown_connections 2023-05-10T01:45:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.472+0000 7f2b59754700 1 -- 172.21.15.52:0/4106496903 wait complete. 2023-05-10T01:45:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:42.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.606+0000 7ffa36806700 1 Processor -- start 2023-05-10T01:45:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.606+0000 7ffa36806700 1 -- start start 2023-05-10T01:45:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa36806700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30154160 0x7ffa300c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa36806700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa30154540 0x7ffa300c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa36806700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300c0650 con 0x7ffa30069690 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa36806700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300c1af0 con 0x7ffa30154540 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa36806700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300bfd20 con 0x7ffa30154160 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa30154540 0x7ffa300c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa34da3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffa30069690 0x7ffa30157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52124/0 (socket says 172.21.15.52:52124) 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa34da3700 1 -- 172.21.15.52:0/1126207623 learned_addr learned my addr 172.21.15.52:0/1126207623 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2ffff700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30154160 0x7ffa300c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/1126207623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30154160 msgr2=0x7ffa300c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2f7fe700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30154160 0x7ffa300c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/1126207623 >> v1:172.21.15.52:6789/0 conn(0x7ffa30069690 legacy=0x7ffa30157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/1126207623 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300c0000 con 0x7ffa30154540 2023-05-10T01:45:42.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.607+0000 7ffa2effd700 1 -- 172.21.15.52:0/1126207623 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600303552 0 0) 0x7ffa300c0650 con 0x7ffa30069690 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa2f7fe700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154540 0x7ffa300c6150 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7ffa18009760 tx=0x7ffa18009060).ready entity=mon.0 client_cookie=207a71ec8bb1987a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa2effd700 1 -- 172.21.15.52:0/1126207623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180090d0 con 0x7ffa30154540 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa2effd700 1 -- 172.21.15.52:0/1126207623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800f510 con 0x7ffa30154540 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa2effd700 1 -- 172.21.15.52:0/1126207623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800f890 con 0x7ffa30154540 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 -- 172.21.15.52:0/1126207623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154540 msgr2=0x7ffa300c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154540 0x7ffa300c6150 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7ffa18009760 tx=0x7ffa18009060).stop 2023-05-10T01:45:42.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 -- 172.21.15.52:0/1126207623 shutdown_connections 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30154160 0x7ffa300c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 --2- 172.21.15.52:0/1126207623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154540 0x7ffa300c6150 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 -- 172.21.15.52:0/1126207623 >> 172.21.15.52:0/1126207623 conn(0x7ffa300cb6f0 msgr2=0x7ffa300c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 -- 172.21.15.52:0/1126207623 shutdown_connections 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.608+0000 7ffa36806700 1 -- 172.21.15.52:0/1126207623 wait complete. 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 Processor -- start 2023-05-10T01:45:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 -- start start 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30069690 0x7ffa301533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa30154540 0x7ffa30154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300b0480 con 0x7ffa30154160 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300aeb30 con 0x7ffa30154540 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.610+0000 7ffa36806700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30151120 con 0x7ffa30069690 2023-05-10T01:45:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43112/0 (socket says 172.21.15.52:43112) 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/648079608 learned_addr learned my addr 172.21.15.52:0/648079608 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2ffff700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30069690 0x7ffa301533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa34da3700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa30154540 0x7ffa30154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30069690 msgr2=0x7ffa301533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30069690 0x7ffa301533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa30154540 msgr2=0x7ffa30154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa30154540 0x7ffa30154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 -- 172.21.15.52:0/648079608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180092a0 con 0x7ffa30154160 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa2f7fe700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7ffa30083050 tx=0x7ffa18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800f890 con 0x7ffa30154160 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18009e30 con 0x7ffa30154160 2023-05-10T01:45:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa301507f0 con 0x7ffa30154160 2023-05-10T01:45:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800fe80 con 0x7ffa30154160 2023-05-10T01:45:42.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.611+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30150db0 con 0x7ffa30154160 2023-05-10T01:45:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa300666b0 con 0x7ffa30154160 2023-05-10T01:45:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7ffa1802b070 con 0x7ffa30154160 2023-05-10T01:45:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa27fff700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 0x7ffa140612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa2ffff700 1 -- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 msgr2=0x7ffa140612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7ffa1807b470 con 0x7ffa30154160 2023-05-10T01:45:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.613+0000 7ffa2ffff700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 0x7ffa140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.617+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa1804c710 con 0x7ffa30154160 2023-05-10T01:45:42.648 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:42.645+0000 7f027cccc680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T01:45:42.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.801+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa3006c340 con 0x7ffa30154160 2023-05-10T01:45:42.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.802+0000 7ffa27fff700 1 -- 172.21.15.52:0/648079608 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17737 (secure 0 0 0) 0x7ffa18029090 con 0x7ffa30154160 2023-05-10T01:45:42.807 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:42.808 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":174,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:35.997231+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2085813196":"2023-05-11T01:45:35.997195+0000","172.21.15.172:0/2688172415":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6833/125557":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6832/125557":"2023-05-11T01:45:35.997195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:42.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.803+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 msgr2=0x7ffa140612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:42.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.803+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 0x7ffa140612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.803+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 msgr2=0x7ffa300afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.803+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7ffa30083050 tx=0x7ffa18017000).stop 2023-05-10T01:45:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 shutdown_connections 2023-05-10T01:45:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ffa1405ede0 0x7ffa140612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:42.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa30154540 0x7ffa30154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa30069690 0x7ffa301533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 --2- 172.21.15.52:0/648079608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa30154160 0x7ffa300afaf0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 >> 172.21.15.52:0/648079608 conn(0x7ffa300cb6f0 msgr2=0x7ffa30155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 shutdown_connections 2023-05-10T01:45:42.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.804+0000 7ffa36806700 1 -- 172.21.15.52:0/648079608 wait complete. 2023-05-10T01:45:42.821 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:45:42.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:42.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.939+0000 7fdbad304700 1 Processor -- start 2023-05-10T01:45:42.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.939+0000 7fdbad304700 1 -- start start 2023-05-10T01:45:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbad304700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdba8150220 0x7fdba8066410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbad304700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdba80bc3c0 0x7fdba80c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbad304700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba8066e40 con 0x7fdba8150600 2023-05-10T01:45:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbad304700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80676e0 con 0x7fdba80bc3c0 2023-05-10T01:45:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbad304700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba8065bd0 con 0x7fdba8150220 2023-05-10T01:45:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdba80bc3c0 0x7fdba80c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdba77fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdba8150600 0x7fdba8065420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52168/0 (socket says 172.21.15.52:52168) 2023-05-10T01:45:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdba77fe700 1 -- 172.21.15.52:0/1544309274 learned_addr learned my addr 172.21.15.52:0/1544309274 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdba7fff700 1 --2- 172.21.15.52:0/1544309274 >> v2:172.21.15.172:3300/0 conn(0x7fdba8150220 0x7fdba8066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 -- 172.21.15.52:0/1544309274 >> v2:172.21.15.172:3300/0 conn(0x7fdba8150220 msgr2=0x7fdba8066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdba6ffd700 1 -- 172.21.15.52:0/1544309274 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828094648 0 0) 0x7fdba8066e40 con 0x7fdba8150600 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 --2- 172.21.15.52:0/1544309274 >> v2:172.21.15.172:3300/0 conn(0x7fdba8150220 0x7fdba8066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 -- 172.21.15.52:0/1544309274 >> v1:172.21.15.52:6789/0 conn(0x7fdba8150600 legacy=0x7fdba8065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 -- 172.21.15.52:0/1544309274 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8067090 con 0x7fdba80bc3c0 2023-05-10T01:45:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.940+0000 7fdbacb03700 1 --2- 172.21.15.52:0/1544309274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba80c1e80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fdba8064280 tx=0x7fdba0009780).ready entity=mon.0 client_cookie=8b915e783b5f1164 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdba6ffd700 1 -- 172.21.15.52:0/1544309274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000e070 con 0x7fdba80bc3c0 2023-05-10T01:45:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdba6ffd700 1 -- 172.21.15.52:0/1544309274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000bb60 con 0x7fdba80bc3c0 2023-05-10T01:45:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdba6ffd700 1 -- 172.21.15.52:0/1544309274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0012410 con 0x7fdba80bc3c0 2023-05-10T01:45:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 -- 172.21.15.52:0/1544309274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 msgr2=0x7fdba80c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 --2- 172.21.15.52:0/1544309274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba80c1e80 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fdba8064280 tx=0x7fdba0009780).stop 2023-05-10T01:45:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 -- 172.21.15.52:0/1544309274 shutdown_connections 2023-05-10T01:45:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 --2- 172.21.15.52:0/1544309274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba80c1e80 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 --2- 172.21.15.52:0/1544309274 >> v2:172.21.15.172:3300/0 conn(0x7fdba8150220 0x7fdba8066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 -- 172.21.15.52:0/1544309274 >> 172.21.15.52:0/1544309274 conn(0x7fdba8069930 msgr2=0x7fdba80c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 -- 172.21.15.52:0/1544309274 shutdown_connections 2023-05-10T01:45:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.941+0000 7fdbad304700 1 -- 172.21.15.52:0/1544309274 wait complete. 2023-05-10T01:45:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.942+0000 7fdbad304700 1 Processor -- start 2023-05-10T01:45:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 -- start start 2023-05-10T01:45:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 0x7fdba8164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8150600 0x7fdba814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8164d80 con 0x7fdba80bc3c0 2023-05-10T01:45:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba814d550 con 0x7fdba8150600 2023-05-10T01:45:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdbad304700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba814d830 con 0x7fdba8150220 2023-05-10T01:45:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.943+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43158/0 (socket says 172.21.15.52:43158) 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 -- 172.21.15.52:0/2229812174 learned_addr learned my addr 172.21.15.52:0/2229812174 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdbacb03700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8150600 0x7fdba814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba77fe700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 0x7fdba8164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 msgr2=0x7fdba8164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 0x7fdba8164890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8150600 msgr2=0x7fdba814b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8150600 0x7fdba814b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 -- 172.21.15.52:0/2229812174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0009a20 con 0x7fdba80bc3c0 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba77fe700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 0x7fdba8164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdba7fff700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fdb9000fad0 tx=0x7fdb90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:42.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000c070 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90009880 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba814db10 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90009c20 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.944+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba814e0d0 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.945+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba814e2f0 con 0x7fdba80bc3c0 2023-05-10T01:45:42.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.946+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fdb90021070 con 0x7fdba80bc3c0 2023-05-10T01:45:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.946+0000 7fdb9ffff700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 0x7fdb8c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.946+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fdb90079f20 con 0x7fdba80bc3c0 2023-05-10T01:45:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.946+0000 7fdba77fe700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 msgr2=0x7fdb8c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.946+0000 7fdba77fe700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 0x7fdb8c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:42.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:42.951+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb900a88f0 con 0x7fdba80bc3c0 2023-05-10T01:45:43.079 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.077+0000 7f1da3dc5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:43.147 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.145+0000 7f1da3dc5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:43.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.148+0000 7fdba77fe700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 msgr2=0x7fdb8c0612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:43.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.148+0000 7fdba77fe700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 0x7fdb8c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:43.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.171+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba805edd0 con 0x7fdba80bc3c0 2023-05-10T01:45:43.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.172+0000 7fdb9ffff700 1 -- 172.21.15.52:0/2229812174 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7fdb9001f030 con 0x7fdba80bc3c0 2023-05-10T01:45:43.175 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:43.175 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 msgr2=0x7fdb8c0612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 0x7fdb8c0612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 msgr2=0x7fdba814cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fdb9000fad0 tx=0x7fdb90008040).stop 2023-05-10T01:45:43.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 shutdown_connections 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fdb8c05ede0 0x7fdb8c0612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8150600 0x7fdba814b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba80bc3c0 0x7fdba814cec0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 --2- 172.21.15.52:0/2229812174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba8150220 0x7fdba8164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 >> 172.21.15.52:0/2229812174 conn(0x7fdba8069930 msgr2=0x7fdba80c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 shutdown_connections 2023-05-10T01:45:43.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.174+0000 7fdbad304700 1 -- 172.21.15.52:0/2229812174 wait complete. 2023-05-10T01:45:43.179 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:43.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:45:43.223 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.220+0000 7f1da3dc5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:43.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.312+0000 7fde42ef8700 1 Processor -- start 2023-05-10T01:45:43.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.312+0000 7fde42ef8700 1 -- start start 2023-05-10T01:45:43.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde42ef8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c0698a0 0x7fde3c069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde42ef8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde3c066e40 0x7fde3c0659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde42ef8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c065ea0 con 0x7fde3c13a160 2023-05-10T01:45:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde42ef8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c1558e0 con 0x7fde3c066e40 2023-05-10T01:45:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde42ef8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0672a0 con 0x7fde3c0698a0 2023-05-10T01:45:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde3c066e40 0x7fde3c0659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde3c066e40 0x7fde3c0659b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43168/0 (socket says 172.21.15.52:43168) 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 -- 172.21.15.52:0/371108250 learned_addr learned my addr 172.21.15.52:0/371108250 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde40c94700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c0698a0 0x7fde3c069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 -- 172.21.15.52:0/371108250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c0698a0 msgr2=0x7fde3c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c0698a0 0x7fde3c069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 -- 172.21.15.52:0/371108250 >> v1:172.21.15.172:6789/0 conn(0x7fde3c13a160 legacy=0x7fde3c13a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3b7fe700 1 -- 172.21.15.52:0/371108250 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525096705 0 0) 0x7fde3c065ea0 con 0x7fde3c13a160 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 -- 172.21.15.52:0/371108250 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0674b0 con 0x7fde3c066e40 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.313+0000 7fde3bfff700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0659b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fde28006fd0 tx=0x7fde280090f0).ready entity=mon.0 client_cookie=98ce4cecbd01ebcb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde3b7fe700 1 -- 172.21.15.52:0/371108250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800b580 con 0x7fde3c066e40 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde3b7fe700 1 -- 172.21.15.52:0/371108250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800b6e0 con 0x7fde3c066e40 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde3b7fe700 1 -- 172.21.15.52:0/371108250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800ba60 con 0x7fde3c066e40 2023-05-10T01:45:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 -- 172.21.15.52:0/371108250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 msgr2=0x7fde3c0659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0659b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fde28006fd0 tx=0x7fde280090f0).stop 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 -- 172.21.15.52:0/371108250 shutdown_connections 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c0698a0 0x7fde3c069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 --2- 172.21.15.52:0/371108250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0659b0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 -- 172.21.15.52:0/371108250 >> 172.21.15.52:0/371108250 conn(0x7fde3c063620 msgr2=0x7fde3c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 -- 172.21.15.52:0/371108250 shutdown_connections 2023-05-10T01:45:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.314+0000 7fde42ef8700 1 -- 172.21.15.52:0/371108250 wait complete. 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.315+0000 7fde42ef8700 1 Processor -- start 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.315+0000 7fde42ef8700 1 -- start start 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde3c0698a0 0x7fde3c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c13a160 0x7fde3c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0a7620 con 0x7fde3c066e40 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0a7ba0 con 0x7fde3c0698a0 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde42ef8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0ad8e0 con 0x7fde3c13a160 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde40c94700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde40c94700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43174/0 (socket says 172.21.15.52:43174) 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde40c94700 1 -- 172.21.15.52:0/145664193 learned_addr learned my addr 172.21.15.52:0/145664193 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde41495700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c13a160 0x7fde3c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.316+0000 7fde3bfff700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde3c0698a0 0x7fde3c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c13a160 msgr2=0x7fde3c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c13a160 0x7fde3c157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde3c0698a0 msgr2=0x7fde3c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde3c0698a0 0x7fde3c0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 -- 172.21.15.52:0/145664193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009370 con 0x7fde3c066e40 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde40c94700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fde3000e930 tx=0x7fde30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30012600 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c0abf30 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde30012760 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30012ae0 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.317+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c0a7830 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.318+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c06c340 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.318+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fde30022070 con 0x7fde3c066e40 2023-05-10T01:45:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.319+0000 7fde38ff9700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 0x7fde240612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.319+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7fde3007a2c0 con 0x7fde3c066e40 2023-05-10T01:45:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.319+0000 7fde3bfff700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 msgr2=0x7fde240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.319+0000 7fde3bfff700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 0x7fde240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.323+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde3004b4b0 con 0x7fde3c066e40 2023-05-10T01:45:43.351 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.348+0000 7f027cccc680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T01:45:43.369 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.367+0000 7f1da3dc5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:43.424 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.421+0000 7f027cccc680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T01:45:43.438 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.435+0000 7f1da3dc5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:43.503 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.500+0000 7f027cccc680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T01:45:43.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.520+0000 7fde3bfff700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 msgr2=0x7fde240612a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:43.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.520+0000 7fde3bfff700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 0x7fde240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:43.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.537+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde3c0bc900 con 0x7fde3c066e40 2023-05-10T01:45:43.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.537+0000 7fde38ff9700 1 -- 172.21.15.52:0/145664193 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4490 (secure 0 0 0) 0x7fde3004ead0 con 0x7fde3c066e40 2023-05-10T01:45:43.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:43.541 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T01:45:19.191344+0000","modified":"2023-05-10T01:45:22.202760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9084},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9084":{"gid":9084,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2644351057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2644351057},{"type":"v1","addr":"172.21.15.52:6835","nonce":2644351057}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-05-10T01:45:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 msgr2=0x7fde240612a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 0x7fde240612a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 msgr2=0x7fde3c0ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fde3000e930 tx=0x7fde30009060).stop 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 shutdown_connections 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fde2405ede0 0x7fde240612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde3c13a160 0x7fde3c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde3c066e40 0x7fde3c0ab3c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 --2- 172.21.15.52:0/145664193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde3c0698a0 0x7fde3c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.539+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 >> 172.21.15.52:0/145664193 conn(0x7fde3c063620 msgr2=0x7fde3c0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.540+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 shutdown_connections 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.540+0000 7fde42ef8700 1 -- 172.21.15.52:0/145664193 wait complete. 2023-05-10T01:45:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 78 2023-05-10T01:45:43.550 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.548+0000 7f1da3dc5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:43.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:43.656 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.654+0000 7f1da3dc5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:43.663 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.660+0000 7f027cccc680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T01:45:43.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.671+0000 7f5a9f1fd700 1 Processor -- start 2023-05-10T01:45:43.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.671+0000 7f5a9f1fd700 1 -- start start 2023-05-10T01:45:43.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9f1fd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a980acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9f1fd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a980ad030 0x7f5a9814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9f1fd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a98158960 con 0x7f5a980c7370 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9f1fd700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98157d50 con 0x7f5a980ad030 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9f1fd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98158030 con 0x7f5a98154e40 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a980ad030 0x7f5a9814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a980ad030 0x7f5a9814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43188/0 (socket says 172.21.15.52:43188) 2023-05-10T01:45:43.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 -- 172.21.15.52:0/3228094012 learned_addr learned my addr 172.21.15.52:0/3228094012 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9d9fa700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a980acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 -- 172.21.15.52:0/3228094012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 msgr2=0x7f5a980acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a980acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 -- 172.21.15.52:0/3228094012 >> v1:172.21.15.172:6789/0 conn(0x7f5a980c7370 legacy=0x7f5a980c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 -- 172.21.15.52:0/3228094012 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98158310 con 0x7f5a980ad030 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9e9fc700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a9814dd60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f5a90009f20 tx=0x7f5a90009840).ready entity=mon.0 client_cookie=a526e0872224b29e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.672+0000 7f5a9d1f9700 1 -- 172.21.15.52:0/3228094012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000e070 con 0x7f5a980ad030 2023-05-10T01:45:43.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9d1f9700 1 -- 172.21.15.52:0/3228094012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9000b9d0 con 0x7f5a980ad030 2023-05-10T01:45:43.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9d1f9700 1 -- 172.21.15.52:0/3228094012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000bd50 con 0x7f5a980ad030 2023-05-10T01:45:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/3228094012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 msgr2=0x7f5a9814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a9814dd60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f5a90009f20 tx=0x7f5a90009840).stop 2023-05-10T01:45:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/3228094012 shutdown_connections 2023-05-10T01:45:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a9814dd60 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/3228094012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a980acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/3228094012 >> 172.21.15.52:0/3228094012 conn(0x7f5a98068320 msgr2=0x7f5a98068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/3228094012 shutdown_connections 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.673+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/3228094012 wait complete. 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.674+0000 7f5a9f1fd700 1 Processor -- start 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.674+0000 7f5a9f1fd700 1 -- start start 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a980c7370 0x7f5a98167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a98167c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814ff20 con 0x7f5a980ad030 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980ca130 con 0x7f5a980c7370 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9f1fd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980aeeb0 con 0x7f5a98154e40 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43190/0 (socket says 172.21.15.52:43190) 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 -- 172.21.15.52:0/1467595518 learned_addr learned my addr 172.21.15.52:0/1467595518 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e9fc700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a98167c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9d9fa700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a980c7370 0x7f5a98167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 -- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 msgr2=0x7f5a98167c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a98167c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 -- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a980c7370 msgr2=0x7f5a98167740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a980c7370 0x7f5a98167740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.675+0000 7f5a9e1fb700 1 -- 172.21.15.52:0/1467595518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009ae0 con 0x7f5a980ad030 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a9e1fb700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f5a9400c4c0 tx=0x7f5a94007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400ce70 con 0x7f5a980ad030 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94001e90 con 0x7f5a980ad030 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a98168200 con 0x7f5a980ad030 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007270 con 0x7f5a980ad030 2023-05-10T01:45:43.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.676+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a980aeb40 con 0x7f5a980ad030 2023-05-10T01:45:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.677+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98047150 con 0x7f5a980ad030 2023-05-10T01:45:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.678+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f5a94010070 con 0x7f5a980ad030 2023-05-10T01:45:43.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.678+0000 7f5a867fc700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 0x7f5a78061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.678+0000 7f5a9d9fa700 1 -- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 msgr2=0x7f5a78061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.678+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f5a94079b20 con 0x7f5a980ad030 2023-05-10T01:45:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.678+0000 7f5a9d9fa700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 0x7f5a78061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:43.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.682+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a9404ae40 con 0x7f5a980ad030 2023-05-10T01:45:43.739 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.736+0000 7f027cccc680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T01:45:43.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.857+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a980bfb80 con 0x7f5a980ad030 2023-05-10T01:45:43.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.858+0000 7f5a867fc700 1 -- 172.21.15.52:0/1467595518 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17737 (secure 0 0 0) 0x7f5a9404e460 con 0x7f5a980ad030 2023-05-10T01:45:43.861 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:43.862 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":174,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:35.997231+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-05-10T01:45:17.005279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-05-10T01:45:18.174556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:0/2085813196":"2023-05-11T01:45:35.997195+0000","172.21.15.172:0/2688172415":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6833/125557":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6832/125557":"2023-05-11T01:45:35.997195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:43.862 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.859+0000 7f027cccc680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T01:45:43.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 msgr2=0x7f5a78061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:43.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 0x7f5a78061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 msgr2=0x7f5a980c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f5a9400c4c0 tx=0x7f5a94007e00).stop 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 shutdown_connections 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a7805edb0 0x7f5a78061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a98154e40 0x7f5a98167c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a980ad030 0x7f5a980c9c40 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 --2- 172.21.15.52:0/1467595518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a980c7370 0x7f5a98167740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:43.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 >> 172.21.15.52:0/1467595518 conn(0x7f5a98068320 msgr2=0x7f5a98150770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:43.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 shutdown_connections 2023-05-10T01:45:43.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.860+0000 7f5a9f1fd700 1 -- 172.21.15.52:0/1467595518 wait complete. 2023-05-10T01:45:43.876 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T01:45:43.948 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:43.946+0000 7f1da3dc5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:43.979 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:43.976+0000 7f027cccc680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T01:45:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 Processor -- start 2023-05-10T01:45:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 -- start start 2023-05-10T01:45:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b7c158000 0x7f0b7c154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0bdf50 con 0x7f0b7c154190 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c158570 con 0x7f0b7c0622a0 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.992+0000 7f0b825b2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0a8550 con 0x7f0b7c158000 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b7c158000 0x7f0b7c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0b7c154190 0x7f0b7c0a7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52214/0 (socket says 172.21.15.52:52214) 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7bfff700 1 -- 172.21.15.52:0/2538459171 learned_addr learned my addr 172.21.15.52:0/2538459171 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7b7fe700 1 -- 172.21.15.52:0/2538459171 >> v1:172.21.15.172:6789/0 conn(0x7f0b7c0622a0 legacy=0x7f0b7c0626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7b7fe700 1 -- 172.21.15.52:0/2538459171 >> v1:172.21.15.52:6789/0 conn(0x7f0b7c154190 legacy=0x7f0b7c0a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7affd700 1 -- 172.21.15.52:0/2538459171 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910042009 0 0) 0x7f0b7c0bdf50 con 0x7f0b7c154190 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7b7fe700 1 -- 172.21.15.52:0/2538459171 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c158850 con 0x7f0b7c158000 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7b7fe700 1 --2- 172.21.15.52:0/2538459171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c154570 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f0b6c009760 tx=0x7f0b6c009060).ready entity=mon.0 client_cookie=eddaa4ee239d3ce9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7affd700 1 -- 172.21.15.52:0/2538459171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00b580 con 0x7f0b7c158000 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7affd700 1 -- 172.21.15.52:0/2538459171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00b6e0 con 0x7f0b7c158000 2023-05-10T01:45:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.993+0000 7f0b7affd700 1 -- 172.21.15.52:0/2538459171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00ba60 con 0x7f0b7c158000 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 -- 172.21.15.52:0/2538459171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 msgr2=0x7f0b7c154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2538459171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c154570 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f0b6c009760 tx=0x7f0b6c009060).stop 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 -- 172.21.15.52:0/2538459171 shutdown_connections 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2538459171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c154570 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 -- 172.21.15.52:0/2538459171 >> 172.21.15.52:0/2538459171 conn(0x7f0b7c0c8c10 msgr2=0x7f0b7c0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 -- 172.21.15.52:0/2538459171 shutdown_connections 2023-05-10T01:45:44.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.994+0000 7f0b825b2700 1 -- 172.21.15.52:0/2538459171 wait complete. 2023-05-10T01:45:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.995+0000 7f0b825b2700 1 Processor -- start 2023-05-10T01:45:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.995+0000 7f0b825b2700 1 -- start start 2023-05-10T01:45:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0622a0 0x7f0b7c14d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b7c154190 0x7f0b7c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0a8b50 con 0x7f0b7c158000 2023-05-10T01:45:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c150310 con 0x7f0b7c0622a0 2023-05-10T01:45:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b825b2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c1505f0 con 0x7f0b7c154190 2023-05-10T01:45:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43206/0 (socket says 172.21.15.52:43206) 2023-05-10T01:45:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 -- 172.21.15.52:0/2729841064 learned_addr learned my addr 172.21.15.52:0/2729841064 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b7bfff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0622a0 0x7f0b7c14d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b7b7fe700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b7c154190 0x7f0b7c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b7c154190 msgr2=0x7f0b7c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b7c154190 0x7f0b7c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0622a0 msgr2=0x7f0b7c14d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0622a0 0x7f0b7c14d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.996+0000 7f0b80b4f700 1 -- 172.21.15.52:0/2729841064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0092a0 con 0x7f0b7c158000 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b80b4f700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f0b74002230 tx=0x7f0b740015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400e4a0 con 0x7f0b7c158000 2023-05-10T01:45:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400e600 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c1508d0 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400e980 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.997+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c14dec0 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.998+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c06c340 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.998+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 84) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f0b74019030 con 0x7f0b7c158000 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.999+0000 7f0b73fff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:44.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.999+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6585+0+0 (secure 0 0 0) 0x7f0b74079440 con 0x7f0b7c158000 2023-05-10T01:45:44.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.999+0000 7f0b7bfff700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 msgr2=0x7f0b60061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:44.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:43.999+0000 7f0b7bfff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-05-10T01:45:44.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.003+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b740488f0 con 0x7f0b7c158000 2023-05-10T01:45:44.017 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.015+0000 7f1da3dc5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:44.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.200+0000 7f0b7bfff700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 msgr2=0x7f0b60061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:44.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.200+0000 7f0b7bfff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-05-10T01:45:44.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.225+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0b7c158b30 con 0x7f0b7c158000 2023-05-10T01:45:44.287 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:44.284+0000 7f027cccc680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T01:45:44.361 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-05-10T01:45:44.358+0000 7f027cccc680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T01:45:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.601+0000 7f0b7bfff700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 msgr2=0x7f0b60061270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.172:6832/125557 2023-05-10T01:45:44.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.601+0000 7f0b7bfff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-05-10T01:45:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.860+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 85) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f0b74010070 con 0x7f0b7c158000 2023-05-10T01:45:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.861+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 msgr2=0x7f0b60061270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T01:45:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:44.861+0000 7f0b73fff700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.917+0000 7f1d23daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.917+0000 7f1d23daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.917+0000 7f1d23daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.917+0000 7f1d23daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.917+0000 7f1d23daa700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.920 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.918+0000 7f1d26db0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.921 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.918+0000 7f1d26db0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.921 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.918+0000 7f1d26db0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.921 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.918+0000 7f1d26db0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.921 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-05-10T01:45:44.918+0000 7f1d26db0700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-10T01:45:44.924 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:44.925 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:44.925 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:45:44.928 INFO:tasks.ceph.mds.a.smithi052.stderr: -2546> 2023-05-10T01:45:24.292+0000 7f63b64f7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T01:45:44.932 INFO:tasks.ceph.mds.a.smithi052.stderr: -5> 2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:44.932 INFO:tasks.ceph.mds.a.smithi052.stderr: -3> 2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-05-10T01:45:44.932 INFO:tasks.ceph.mds.a.smithi052.stderr: -1> 2023-05-10T01:45:44.922+0000 7f63b2cf0700 -1 MDSIOContextBase: failed with -108, restarting... 2023-05-10T01:45:44.952 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-05-10T01:45:45.033 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-05-10T01:45:45.030+0000 7f5a6f450700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T01:45:45.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.033+0000 7f0b73fff700 1 -- 172.21.15.52:0/2729841064 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b7406f6b0 con 0x7f0b7c158000 2023-05-10T01:45:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 msgr2=0x7f0b7c0a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f0b74002230 tx=0x7f0b740015e0).stop 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 shutdown_connections 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0b6005edb0 0x7f0b60061270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b7c158000 0x7f0b7c0a6860 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0622a0 0x7f0b7c14d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 --2- 172.21.15.52:0/2729841064 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0b7c154190 0x7f0b7c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 >> 172.21.15.52:0/2729841064 conn(0x7f0b7c0c8c10 msgr2=0x7f0b7c152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:45.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 shutdown_connections 2023-05-10T01:45:45.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.035+0000 7f0b825b2700 1 -- 172.21.15.52:0/2729841064 wait complete. 2023-05-10T01:45:45.040 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T01:45:45.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T01:45:45.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.171+0000 7f8907fff700 1 Processor -- start 2023-05-10T01:45:45.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.171+0000 7f8907fff700 1 -- start start 2023-05-10T01:45:45.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8907fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89080c1150 0x7f89080c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8907fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89080c61e0 0x7f8908154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8907fff700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89080c6650 con 0x7f8908153f80 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8907fff700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8908069f50 con 0x7f89080c61e0 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8907fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890806a9d0 con 0x7f89080c1150 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8906ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8908153f80 0x7f89080a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52246/0 (socket says 172.21.15.52:52246) 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8906ffd700 1 -- 172.21.15.52:0/1524565697 learned_addr learned my addr 172.21.15.52:0/1524565697 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89077fe700 1 --2- 172.21.15.52:0/1524565697 >> v2:172.21.15.52:3300/0 conn(0x7f89080c61e0 0x7f8908154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89067fc700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89080c1150 0x7f89080c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89077fe700 1 -- 172.21.15.52:0/1524565697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89080c1150 msgr2=0x7f89080c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89077fe700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89080c1150 0x7f89080c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89077fe700 1 -- 172.21.15.52:0/1524565697 >> v1:172.21.15.52:6789/0 conn(0x7f8908153f80 legacy=0x7f89080a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f89077fe700 1 -- 172.21.15.52:0/1524565697 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890806a130 con 0x7f89080c61e0 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.172+0000 7f8905ffb700 1 -- 172.21.15.52:0/1524565697 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095342549 0 0) 0x7f89080c6650 con 0x7f8908153f80 2023-05-10T01:45:45.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f89077fe700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c61e0 0x7f8908154360 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f88f8009760 tx=0x7f88f8009060).ready entity=mon.0 client_cookie=40d98f4813368bee server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8905ffb700 1 -- 172.21.15.52:0/1524565697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800f510 con 0x7f89080c61e0 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8905ffb700 1 -- 172.21.15.52:0/1524565697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f800f670 con 0x7f89080c61e0 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8905ffb700 1 -- 172.21.15.52:0/1524565697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800f9f0 con 0x7f89080c61e0 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 -- 172.21.15.52:0/1524565697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c61e0 msgr2=0x7f8908154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c61e0 0x7f8908154360 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f88f8009760 tx=0x7f88f8009060).stop 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 -- 172.21.15.52:0/1524565697 shutdown_connections 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c61e0 0x7f8908154360 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 --2- 172.21.15.52:0/1524565697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89080c1150 0x7f89080c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 -- 172.21.15.52:0/1524565697 >> 172.21.15.52:0/1524565697 conn(0x7f89080cb5f0 msgr2=0x7f89080c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:45.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 -- 172.21.15.52:0/1524565697 shutdown_connections 2023-05-10T01:45:45.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.173+0000 7f8907fff700 1 -- 172.21.15.52:0/1524565697 wait complete. 2023-05-10T01:45:45.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.174+0000 7f8907fff700 1 Processor -- start 2023-05-10T01:45:45.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 -- start start 2023-05-10T01:45:45.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89080c61e0 0x7f89080c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8908153f80 0x7f89080c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89080aea30 con 0x7f89080c1150 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89080ade20 con 0x7f89080c61e0 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8907fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89080ae100 con 0x7f8908153f80 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8906ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8906ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43236/0 (socket says 172.21.15.52:43236) 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.175+0000 7f8906ffd700 1 -- 172.21.15.52:0/1956687873 learned_addr learned my addr 172.21.15.52:0/1956687873 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f89077fe700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8908153f80 0x7f89080c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f89067fc700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89080c61e0 0x7f89080c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 -- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8908153f80 msgr2=0x7f89080c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8908153f80 0x7f89080c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 -- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89080c61e0 msgr2=0x7f89080c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89080c61e0 0x7f89080c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 -- 172.21.15.52:0/1956687873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80092a0 con 0x7f89080c1150 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8906ffd700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f890000c960 tx=0x7f8900001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900005d30 con 0x7f89080c1150 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900005e90 con 0x7f89080c1150 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900007320 con 0x7f89080c1150 2023-05-10T01:45:45.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89080ae3e0 con 0x7f89080c1150 2023-05-10T01:45:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.176+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89080adad0 con 0x7f89080c1150 2023-05-10T01:45:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.177+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8908083110 con 0x7f89080c1150 2023-05-10T01:45:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.177+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 85) v1 ==== 75092+0+0 (secure 0 0 0) 0x7f8900010030 con 0x7f89080c1150 2023-05-10T01:45:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.178+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6886+0+0 (secure 0 0 0) 0x7f8900079bc0 con 0x7f89080c1150 2023-05-10T01:45:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.182+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f890004af00 con 0x7f89080c1150 2023-05-10T01:45:45.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.397+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8908047150 con 0x7f89080c1150 2023-05-10T01:45:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.867+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 86) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f8900077860 con 0x7f89080c1150 2023-05-10T01:45:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.867+0000 7f88feffd700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 0x7f88ec0679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:45.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.870+0000 7f89067fc700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 0x7f88ec0679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:45.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:45.871+0000 7f89067fc700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 0x7f88ec0679b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8908153a30 tx=0x7f88f0009060).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:46.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.035+0000 7f88feffd700 1 -- 172.21.15.52:0/1956687873 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f890006dca0 con 0x7f89080c1150 2023-05-10T01:45:46.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 msgr2=0x7f88ec0679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 0x7f88ec0679b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8908153a30 tx=0x7f88f0009060).stop 2023-05-10T01:45:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 msgr2=0x7f890814da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f890000c960 tx=0x7f8900001630).stop 2023-05-10T01:45:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 shutdown_connections 2023-05-10T01:45:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f88ec0301b0 0x7f88ec0679b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8908153f80 0x7f89080c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89080c1150 0x7f890814da80 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 --2- 172.21.15.52:0/1956687873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89080c61e0 0x7f89080c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 >> 172.21.15.52:0/1956687873 conn(0x7f89080cb5f0 msgr2=0x7f89080acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 shutdown_connections 2023-05-10T01:45:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.037+0000 7f8907fff700 1 -- 172.21.15.52:0/1956687873 wait complete. 2023-05-10T01:45:46.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T01:45:46.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.179+0000 7f5aaebd3700 1 Processor -- start 2023-05-10T01:45:46.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.179+0000 7f5aaebd3700 1 -- start start 2023-05-10T01:45:46.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.180+0000 7f5aaebd3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5aa8154080 0x7f5aa80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.180+0000 7f5aaebd3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 0x7f5aa80a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.180+0000 7f5aaebd3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa80c94c0 con 0x7f5aa80aa140 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.180+0000 7f5aaebd3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80aa5b0 con 0x7f5aa8154080 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.180+0000 7f5aaebd3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80cb7d0 con 0x7f5aa8154460 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aa7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 0x7f5aa80a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5aa8154080 0x7f5aa80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5aa8154080 0x7f5aa80aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:41584/0 (socket says 172.21.15.52:41584) 2023-05-10T01:45:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 -- 172.21.15.52:0/2681404715 learned_addr learned my addr 172.21.15.52:0/2681404715 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 -- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 msgr2=0x7f5aa80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 0x7f5aa80a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 -- 172.21.15.52:0/2681404715 >> v1:172.21.15.172:6789/0 conn(0x7f5aa80aa140 legacy=0x7f5aa8068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aa77fe700 1 -- 172.21.15.52:0/2681404715 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866687533 0 0) 0x7f5aa80c94c0 con 0x7f5aa80aa140 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 -- 172.21.15.52:0/2681404715 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80c88b0 con 0x7f5aa8154080 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aa7fff700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 0x7f5aa80a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.181+0000 7f5aac96f700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa8154080 0x7f5aa80aac90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f5aa0006fd0 tx=0x7f5aa00090f0).ready entity=mon.1 client_cookie=cef192096f933d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aa77fe700 1 -- 172.21.15.52:0/2681404715 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000b580 con 0x7f5aa8154080 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aa77fe700 1 -- 172.21.15.52:0/2681404715 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000b6e0 con 0x7f5aa8154080 2023-05-10T01:45:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aa77fe700 1 -- 172.21.15.52:0/2681404715 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000ba60 con 0x7f5aa8154080 2023-05-10T01:45:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 -- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa8154080 msgr2=0x7f5aa80aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa8154080 0x7f5aa80aac90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f5aa0006fd0 tx=0x7f5aa00090f0).stop 2023-05-10T01:45:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 -- 172.21.15.52:0/2681404715 shutdown_connections 2023-05-10T01:45:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa8154080 0x7f5aa80aac90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/2681404715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154460 0x7f5aa80a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 -- 172.21.15.52:0/2681404715 >> 172.21.15.52:0/2681404715 conn(0x7f5aa8067910 msgr2=0x7f5aa80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 -- 172.21.15.52:0/2681404715 shutdown_connections 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.182+0000 7f5aaebd3700 1 -- 172.21.15.52:0/2681404715 wait complete. 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.183+0000 7f5aaebd3700 1 Processor -- start 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.183+0000 7f5aaebd3700 1 -- start start 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa80aa140 0x7f5aa80ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154080 0x7f5aa80c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80ae360 con 0x7f5aa8154460 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81562c0 con 0x7f5aa80aa140 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aaebd3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c2220 con 0x7f5aa8154080 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aad170700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aad170700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43270/0 (socket says 172.21.15.52:43270) 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aad170700 1 -- 172.21.15.52:0/1428386488 learned_addr learned my addr 172.21.15.52:0/1428386488 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aa7fff700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154080 0x7f5aa80c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.184+0000 7f5aac96f700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa80aa140 0x7f5aa80ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 -- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154080 msgr2=0x7f5aa80c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154080 0x7f5aa80c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 -- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa80aa140 msgr2=0x7f5aa80ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa80aa140 0x7f5aa80ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 -- 172.21.15.52:0/1428386488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98009a20 con 0x7f5aa8154460 2023-05-10T01:45:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aad170700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f5a9000c440 tx=0x7f5a90007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012400 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90012580 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa0009370 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012940 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.185+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa8155c70 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.186+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa8066720 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.186+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 86) v1 ==== 75162+0+0 (secure 0 0 0) 0x7f5a90019030 con 0x7f5aa8154460 2023-05-10T01:45:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.186+0000 7f5aa4ff9700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 0x7f5a8c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.187+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6886+0+0 (secure 0 0 0) 0x7f5a90079010 con 0x7f5aa8154460 2023-05-10T01:45:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.187+0000 7f5aac96f700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 0x7f5a8c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.187+0000 7f5aac96f700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 0x7f5a8c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5aa0009130 tx=0x7f5aa0017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.191+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a9004a350 con 0x7f5aa8154460 2023-05-10T01:45:46.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:46.365+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5aa80c8b90 con 0x7f5aa8154460 2023-05-10T01:45:47.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.039+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5a90010070 con 0x7f5aa8154460 2023-05-10T01:45:47.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.045+0000 7f5aa4ff9700 1 -- 172.21.15.52:0/1428386488 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v177) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5a90070c10 con 0x7f5aa8154460 2023-05-10T01:45:47.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 msgr2=0x7f5a8c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 0x7f5a8c0611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5aa0009130 tx=0x7f5aa0017000).stop 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 msgr2=0x7f5aa814c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f5a9000c440 tx=0x7f5a90007b90).stop 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 shutdown_connections 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f5a8c05ecf0 0x7f5a8c0611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa8154460 0x7f5aa814c870 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5aa80aa140 0x7f5aa80ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 --2- 172.21.15.52:0/1428386488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aa8154080 0x7f5aa80c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 >> 172.21.15.52:0/1428386488 conn(0x7f5aa8067910 msgr2=0x7f5aa80c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:47.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.049+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 shutdown_connections 2023-05-10T01:45:47.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.050+0000 7f5aaebd3700 1 -- 172.21.15.52:0/1428386488 wait complete. 2023-05-10T01:45:47.054 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-05-10T01:45:47.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T01:45:47.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.198+0000 7f0af03a8700 1 Processor -- start 2023-05-10T01:45:47.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.198+0000 7f0af03a8700 1 -- start start 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.199+0000 7f0af03a8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ae8153cf0 0x7f0ae8063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.199+0000 7f0af03a8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ae81540d0 0x7f0ae80bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.199+0000 7f0af03a8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae80a7c80 con 0x7f0ae80622a0 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.199+0000 7f0af03a8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae8067f50 con 0x7f0ae81540d0 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.199+0000 7f0af03a8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80a7ef0 con 0x7f0ae8153cf0 2023-05-10T01:45:47.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ae81540d0 0x7f0ae80bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ae81540d0 0x7f0ae80bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43276/0 (socket says 172.21.15.52:43276) 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 -- 172.21.15.52:0/43178453 learned_addr learned my addr 172.21.15.52:0/43178453 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aee144700 1 --2- 172.21.15.52:0/43178453 >> v2:172.21.15.172:3300/0 conn(0x7f0ae8153cf0 0x7f0ae8063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 -- 172.21.15.52:0/43178453 >> v2:172.21.15.172:3300/0 conn(0x7f0ae8153cf0 msgr2=0x7f0ae8063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 --2- 172.21.15.52:0/43178453 >> v2:172.21.15.172:3300/0 conn(0x7f0ae8153cf0 0x7f0ae8063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 -- 172.21.15.52:0/43178453 >> v1:172.21.15.172:6789/0 conn(0x7f0ae80622a0 legacy=0x7f0ae8157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 -- 172.21.15.52:0/43178453 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80a81d0 con 0x7f0ae81540d0 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed943700 1 --2- 172.21.15.52:0/43178453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae81540d0 0x7f0ae80bf230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f0ae805ec80 tx=0x7f0adc0090f0).ready entity=mon.0 client_cookie=dbf9dd0372561fa4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed142700 1 -- 172.21.15.52:0/43178453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00b520 con 0x7f0ae81540d0 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed142700 1 -- 172.21.15.52:0/43178453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00b680 con 0x7f0ae81540d0 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.200+0000 7f0aed142700 1 -- 172.21.15.52:0/43178453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00ba00 con 0x7f0ae81540d0 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 -- 172.21.15.52:0/43178453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae81540d0 msgr2=0x7f0ae80bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 --2- 172.21.15.52:0/43178453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae81540d0 0x7f0ae80bf230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f0ae805ec80 tx=0x7f0adc0090f0).stop 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 -- 172.21.15.52:0/43178453 shutdown_connections 2023-05-10T01:45:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 --2- 172.21.15.52:0/43178453 >> v2:172.21.15.172:3300/0 conn(0x7f0ae8153cf0 0x7f0ae8063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 --2- 172.21.15.52:0/43178453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae81540d0 0x7f0ae80bf230 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 -- 172.21.15.52:0/43178453 >> 172.21.15.52:0/43178453 conn(0x7f0ae805e810 msgr2=0x7f0ae80c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:47.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 -- 172.21.15.52:0/43178453 shutdown_connections 2023-05-10T01:45:47.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.201+0000 7f0af03a8700 1 -- 172.21.15.52:0/43178453 wait complete. 2023-05-10T01:45:47.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.202+0000 7f0af03a8700 1 Processor -- start 2023-05-10T01:45:47.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.202+0000 7f0af03a8700 1 -- start start 2023-05-10T01:45:47.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80622a0 0x7f0ae814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ae81540d0 0x7f0ae80c0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80ae910 con 0x7f0ae8153cf0 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80aba30 con 0x7f0ae80622a0 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80c11d0 con 0x7f0ae81540d0 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43282/0 (socket says 172.21.15.52:43282) 2023-05-10T01:45:47.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 -- 172.21.15.52:0/815479975 learned_addr learned my addr 172.21.15.52:0/815479975 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aee144700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80622a0 0x7f0ae814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aee945700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ae81540d0 0x7f0ae80c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 -- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ae81540d0 msgr2=0x7f0ae80c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ae81540d0 0x7f0ae80c0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 -- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80622a0 msgr2=0x7f0ae814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80622a0 0x7f0ae814ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 -- 172.21.15.52:0/815479975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009370 con 0x7f0ae8153cf0 2023-05-10T01:45:47.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0aed943700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f0adc006fd0 tx=0x7f0adc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc000bc0 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00b7f0 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae80c05c0 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc000d20 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.203+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80c0b80 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.204+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae806c340 con 0x7f0ae8153cf0 2023-05-10T01:45:47.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.205+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0adc02b070 con 0x7f0ae8153cf0 2023-05-10T01:45:47.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.205+0000 7f0ae67fc700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 0x7f0ac8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:47.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.205+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6448+0+0 (secure 0 0 0) 0x7f0adc07b3a0 con 0x7f0ae8153cf0 2023-05-10T01:45:47.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.205+0000 7f0aee144700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 0x7f0ac8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:47.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.206+0000 7f0aee144700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 0x7f0ac8061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0ae0009fd0 tx=0x7f0ae000b040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:47.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.209+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0adc04c800 con 0x7f0ae8153cf0 2023-05-10T01:45:47.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:47.383+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ae8064550 con 0x7f0ae8153cf0 2023-05-10T01:45:48.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.047+0000 7f0ae67fc700 1 -- 172.21.15.52:0/815479975 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v178) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0adc029020 con 0x7f0ae8153cf0 2023-05-10T01:45:48.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 msgr2=0x7f0ac8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 0x7f0ac8061250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0ae0009fd0 tx=0x7f0ae000b040).stop 2023-05-10T01:45:48.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 msgr2=0x7f0ae80bfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f0adc006fd0 tx=0x7f0adc017000).stop 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 shutdown_connections 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f0ac805ed90 0x7f0ac8061250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ae81540d0 0x7f0ae80c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ae80622a0 0x7f0ae814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 --2- 172.21.15.52:0/815479975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ae8153cf0 0x7f0ae80bfb20 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 >> 172.21.15.52:0/815479975 conn(0x7f0ae805e810 msgr2=0x7f0ae80c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 shutdown_connections 2023-05-10T01:45:48.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.051+0000 7f0af03a8700 1 -- 172.21.15.52:0/815479975 wait complete. 2023-05-10T01:45:48.058 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-05-10T01:45:48.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-05-10T01:45:48.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.198+0000 7fa407106700 1 Processor -- start 2023-05-10T01:45:48.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.198+0000 7fa407106700 1 -- start start 2023-05-10T01:45:48.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa407106700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 0x7fa4000a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa407106700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4001549d0 0x7fa400154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa407106700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40014e930 con 0x7fa400068a60 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa407106700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa400137420 con 0x7fa4001549d0 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa407106700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40006a380 con 0x7fa4000a4a30 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4001549d0 0x7fa400154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4001549d0 0x7fa400154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43290/0 (socket says 172.21.15.52:43290) 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 -- 172.21.15.52:0/1663963438 learned_addr learned my addr 172.21.15.52:0/1663963438 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa404ea2700 1 --2- 172.21.15.52:0/1663963438 >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 0x7fa4000a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 -- 172.21.15.52:0/1663963438 >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 msgr2=0x7fa4000a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 --2- 172.21.15.52:0/1663963438 >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 0x7fa4000a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 -- 172.21.15.52:0/1663963438 >> v1:172.21.15.172:6789/0 conn(0x7fa400068a60 legacy=0x7fa400068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 -- 172.21.15.52:0/1663963438 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400069770 con 0x7fa4001549d0 2023-05-10T01:45:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa404ea2700 1 --2- 172.21.15.52:0/1663963438 >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 0x7fa4000a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.199+0000 7fa3fffff700 1 --2- 172.21.15.52:0/1663963438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4001549d0 0x7fa400154e50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fa400063620 tx=0x7fa3ec0090f0).ready entity=mon.0 client_cookie=72f479b354f3c68c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa3ff7fe700 1 -- 172.21.15.52:0/1663963438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00b600 con 0x7fa4001549d0 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa3ff7fe700 1 -- 172.21.15.52:0/1663963438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00b760 con 0x7fa4001549d0 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa3ff7fe700 1 -- 172.21.15.52:0/1663963438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00bae0 con 0x7fa4001549d0 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 -- 172.21.15.52:0/1663963438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4001549d0 msgr2=0x7fa400154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 --2- 172.21.15.52:0/1663963438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4001549d0 0x7fa400154e50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fa400063620 tx=0x7fa3ec0090f0).stop 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 -- 172.21.15.52:0/1663963438 shutdown_connections 2023-05-10T01:45:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 --2- 172.21.15.52:0/1663963438 >> v2:172.21.15.172:3300/0 conn(0x7fa4000a4a30 0x7fa4000a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 --2- 172.21.15.52:0/1663963438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4001549d0 0x7fa400154e50 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 -- 172.21.15.52:0/1663963438 >> 172.21.15.52:0/1663963438 conn(0x7fa4000c4610 msgr2=0x7fa400066e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 -- 172.21.15.52:0/1663963438 shutdown_connections 2023-05-10T01:45:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.200+0000 7fa407106700 1 -- 172.21.15.52:0/1663963438 wait complete. 2023-05-10T01:45:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.201+0000 7fa407106700 1 Processor -- start 2023-05-10T01:45:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 -- start start 2023-05-10T01:45:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 0x7fa4000abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4001549d0 0x7fa4000bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000aba20 con 0x7fa4000a4a30 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000ac3a0 con 0x7fa400068a60 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa407106700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000aae10 con 0x7fa4001549d0 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43296/0 (socket says 172.21.15.52:43296) 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa3fffff700 1 -- 172.21.15.52:0/241099461 learned_addr learned my addr 172.21.15.52:0/241099461 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa404ea2700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 0x7fa4000abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.202+0000 7fa4056a3700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4001549d0 0x7fa4000bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 -- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4001549d0 msgr2=0x7fa4000bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4001549d0 0x7fa4000bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 -- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 msgr2=0x7fa4000abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 0x7fa4000abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 -- 172.21.15.52:0/241099461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009370 con 0x7fa4000a4a30 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa404ea2700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 0x7fa4000abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fffff700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fa40005ec40 tx=0x7fa3ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00b8d0 con 0x7fa4000a4a30 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00ba50 con 0x7fa4000a4a30 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4000ab0f0 con 0x7fa4000a4a30 2023-05-10T01:45:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec01b660 con 0x7fa4000a4a30 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.203+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4000ab6b0 con 0x7fa4000a4a30 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.204+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4000abb90 con 0x7fa4000a4a30 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.204+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa3ec02a070 con 0x7fa4000a4a30 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.205+0000 7fa3fcff9700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 0x7fa3e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.205+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fa3ec07b1c0 con 0x7fa4000a4a30 2023-05-10T01:45:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.205+0000 7fa404ea2700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 0x7fa3e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.205+0000 7fa404ea2700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 0x7fa3e8061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa3f4006fd0 tx=0x7fa3f4008040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.209+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3ec04c7b0 con 0x7fa4000a4a30 2023-05-10T01:45:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.382+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa400136fc0 con 0x7fa4000a4a30 2023-05-10T01:45:48.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.386+0000 7fa3fcff9700 1 -- 172.21.15.52:0/241099461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v36) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa3ec0280b0 con 0x7fa4000a4a30 2023-05-10T01:45:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 msgr2=0x7fa3e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 0x7fa3e8061250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa3f4006fd0 tx=0x7fa3f4008040).stop 2023-05-10T01:45:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 msgr2=0x7fa400136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fa40005ec40 tx=0x7fa3ec017000).stop 2023-05-10T01:45:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 shutdown_connections 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa3e805ed90 0x7fa3e8061250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4001549d0 0x7fa4000bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa400068a60 0x7fa4000abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 --2- 172.21.15.52:0/241099461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4000a4a30 0x7fa400136a10 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 >> 172.21.15.52:0/241099461 conn(0x7fa4000c4610 msgr2=0x7fa40013cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 shutdown_connections 2023-05-10T01:45:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.388+0000 7fa407106700 1 -- 172.21.15.52:0/241099461 wait complete. 2023-05-10T01:45:48.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-10T01:45:48.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.517+0000 7fabfee24700 1 Processor -- start 2023-05-10T01:45:48.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.517+0000 7fabfee24700 1 -- start start 2023-05-10T01:45:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfee24700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabf80a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfee24700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabf80c5cf0 0x7fabf80c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfee24700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80c6660 con 0x7fabf80c0140 2023-05-10T01:45:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfee24700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf8069f50 con 0x7fabf80c5cf0 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfee24700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf806a9d0 con 0x7fabf8153f80 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfe623700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fabf80c0140 0x7fabf80c05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52320/0 (socket says 172.21.15.52:52320) 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfe623700 1 -- 172.21.15.52:0/321688281 learned_addr learned my addr 172.21.15.52:0/321688281 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfde22700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabf80a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfd621700 1 --2- 172.21.15.52:0/321688281 >> v2:172.21.15.172:3300/0 conn(0x7fabf80c5cf0 0x7fabf80c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251026791 0 0) 0x7fabf80c6660 con 0x7fabf80c0140 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe40033f0 con 0x7fabf80c0140 2023-05-10T01:45:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.518+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199210201 0 0) 0x7fabe40033f0 con 0x7fabf80c0140 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 msgr2=0x7fabf80a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabf80a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 >> v2:172.21.15.172:3300/0 conn(0x7fabf80c5cf0 msgr2=0x7fabf80c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 --2- 172.21.15.52:0/321688281 >> v2:172.21.15.172:3300/0 conn(0x7fabf80c5cf0 0x7fabf80c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf806a130 con 0x7fabf80c0140 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fabe80017f0 con 0x7fabf80c0140 2023-05-10T01:45:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 >> v1:172.21.15.52:6789/0 conn(0x7fabf80c0140 legacy=0x7fabf80c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabe40038e0 0x7fabe4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe4004690 0x7fabe4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabe4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8069f50 con 0x7fabe40038e0 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40044b0 con 0x7fabe4004690 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe400b910 con 0x7fabf8153f80 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabe40038e0 0x7fabe4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfe623700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabe4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfd621700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe4004690 0x7fabe4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 -- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 msgr2=0x7fabe4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf8153f80 0x7fabe4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 -- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe4004690 msgr2=0x7fabe4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe4004690 0x7fabe4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 -- 172.21.15.52:0/321688281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40033f0 con 0x7fabe40038e0 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfde22700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabe40038e0 0x7fabe4003d00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fabf0009a60 tx=0x7fabf0009060).ready entity=mon.0 client_cookie=7894b1e072031053 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0009ea0 con 0x7fabe40038e0 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0009430 con 0x7fabe40038e0 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.519+0000 7fabfce20700 1 -- 172.21.15.52:0/321688281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000e870 con 0x7fabe40038e0 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 -- 172.21.15.52:0/321688281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabe40038e0 msgr2=0x7fabe4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 --2- 172.21.15.52:0/321688281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabe40038e0 0x7fabe4003d00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fabf0009a60 tx=0x7fabf0009060).stop 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfe623700 1 -- 172.21.15.52:0/321688281 reap_dead start 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 -- 172.21.15.52:0/321688281 shutdown_connections 2023-05-10T01:45:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 -- 172.21.15.52:0/321688281 >> 172.21.15.52:0/321688281 conn(0x7fabf80cb5f0 msgr2=0x7fabf80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 -- 172.21.15.52:0/321688281 shutdown_connections 2023-05-10T01:45:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.520+0000 7fabfee24700 1 -- 172.21.15.52:0/321688281 wait complete. 2023-05-10T01:45:48.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.521+0000 7fabfee24700 1 Processor -- start 2023-05-10T01:45:48.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.521+0000 7fabfee24700 1 -- start start 2023-05-10T01:45:48.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe40038e0 0x7fabf8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf80c9930 0x7fabf80c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8154850 con 0x7fabf8150b20 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8165480 con 0x7fabe40038e0 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfee24700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf815a650 con 0x7fabf80c9930 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43316/0 (socket says 172.21.15.52:43316) 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 -- 172.21.15.52:0/834302129 learned_addr learned my addr 172.21.15.52:0/834302129 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfe623700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf80c9930 0x7fabf80c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfde22700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe40038e0 0x7fabf8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 -- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf80c9930 msgr2=0x7fabf80c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf80c9930 0x7fabf80c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 -- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe40038e0 msgr2=0x7fabf8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe40038e0 0x7fabf8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 -- 172.21.15.52:0/834302129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80ca280 con 0x7fabf8150b20 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabfd621700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fabec0119f0 tx=0x7fabec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.522+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00f730 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.523+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec00f890 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.523+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf8164870 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.523+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00fc10 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.523+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf8164e30 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.524+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf8167a80 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.524+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fabec024070 con 0x7fabf8150b20 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.524+0000 7fabf5ffb700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 0x7fabd8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.525+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fabec07a160 con 0x7fabf8150b20 2023-05-10T01:45:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.525+0000 7fabfde22700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 0x7fabd8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.525+0000 7fabfde22700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 0x7fabd8061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fabf0006d50 tx=0x7fabf001a000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.529+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fabf8167a80 con 0x7fabf8150b20 2023-05-10T01:45:48.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.703+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fabf8167a80 con 0x7fabf8150b20 2023-05-10T01:45:48.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.706+0000 7fabf5ffb700 1 -- 172.21.15.52:0/834302129 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabf8167a80 con 0x7fabf8150b20 2023-05-10T01:45:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 msgr2=0x7fabd8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 0x7fabd8061250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fabf0006d50 tx=0x7fabf001a000).stop 2023-05-10T01:45:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 msgr2=0x7fabf80afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fabec0119f0 tx=0x7fabec009060).stop 2023-05-10T01:45:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 shutdown_connections 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fabd805ed90 0x7fabd8061250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabf80c9930 0x7fabf80c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabe40038e0 0x7fabf8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 --2- 172.21.15.52:0/834302129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabf8150b20 0x7fabf80afb40 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 >> 172.21.15.52:0/834302129 conn(0x7fabf80cb5f0 msgr2=0x7fabf8069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 shutdown_connections 2023-05-10T01:45:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.709+0000 7fabfee24700 1 -- 172.21.15.52:0/834302129 wait complete. 2023-05-10T01:45:48.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-05-10T01:45:48.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.837+0000 7fd235e34700 1 Processor -- start 2023-05-10T01:45:48.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.837+0000 7fd235e34700 1 -- start start 2023-05-10T01:45:48.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.838+0000 7fd235e34700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.838+0000 7fd235e34700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 0x7fd2300c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.838+0000 7fd235e34700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300c0650 con 0x7fd230069690 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.838+0000 7fd235e34700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300c1af0 con 0x7fd230154540 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.838+0000 7fd235e34700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300bfd20 con 0x7fd230154160 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22effd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 0x7fd2300c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22ffff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd230069690 0x7fd230157e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:54880/0 (socket says 172.21.15.52:54880) 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22effd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 0x7fd2300c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:41648/0 (socket says 172.21.15.52:41648) 2023-05-10T01:45:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:34726/0 (socket says 172.21.15.52:34726) 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22ffff700 1 -- 172.21.15.52:0/508995231 learned_addr learned my addr 172.21.15.52:0/508995231 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 -- 172.21.15.52:0/508995231 >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 msgr2=0x7fd2300c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 --2- 172.21.15.52:0/508995231 >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 0x7fd2300c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 -- 172.21.15.52:0/508995231 >> v1:172.21.15.172:6789/0 conn(0x7fd230069690 legacy=0x7fd230157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 -- 172.21.15.52:0/508995231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300c0000 con 0x7fd230154160 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22f7fe700 1 --2- 172.21.15.52:0/508995231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fd220009760 tx=0x7fd220009060).ready entity=mon.2 client_cookie=ab15cd2b1c4d0c1c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22e7fc700 1 -- 172.21.15.52:0/508995231 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200090d0 con 0x7fd230154160 2023-05-10T01:45:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22e7fc700 1 -- 172.21.15.52:0/508995231 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000f510 con 0x7fd230154160 2023-05-10T01:45:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.839+0000 7fd22e7fc700 1 -- 172.21.15.52:0/508995231 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000f890 con 0x7fd230154160 2023-05-10T01:45:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 -- 172.21.15.52:0/508995231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 msgr2=0x7fd2300c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 --2- 172.21.15.52:0/508995231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fd220009760 tx=0x7fd220009060).stop 2023-05-10T01:45:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 -- 172.21.15.52:0/508995231 shutdown_connections 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 --2- 172.21.15.52:0/508995231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230154160 0x7fd2300c5c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 --2- 172.21.15.52:0/508995231 >> v2:172.21.15.172:3300/0 conn(0x7fd230154540 0x7fd2300c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 -- 172.21.15.52:0/508995231 >> 172.21.15.52:0/508995231 conn(0x7fd2300cb6f0 msgr2=0x7fd2300c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 -- 172.21.15.52:0/508995231 shutdown_connections 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.840+0000 7fd235e34700 1 -- 172.21.15.52:0/508995231 wait complete. 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.841+0000 7fd235e34700 1 Processor -- start 2023-05-10T01:45:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.841+0000 7fd235e34700 1 -- start start 2023-05-10T01:45:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230069690 0x7fd2300c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd230154160 0x7fd23014d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301646f0 con 0x7fd230154540 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23014fb20 con 0x7fd230154160 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd235e34700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23014df50 con 0x7fd230069690 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43330/0 (socket says 172.21.15.52:43330) 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 -- 172.21.15.52:0/4207859228 learned_addr learned my addr 172.21.15.52:0/4207859228 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22f7fe700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230069690 0x7fd2300c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22effd700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd230154160 0x7fd23014d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 -- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230069690 msgr2=0x7fd2300c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230069690 0x7fd2300c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 -- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd230154160 msgr2=0x7fd23014d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd230154160 0x7fd23014d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 -- 172.21.15.52:0/4207859228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200092a0 con 0x7fd230154540 2023-05-10T01:45:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.842+0000 7fd22ffff700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fd22800c7c0 tx=0x7fd2280015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.843+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228005d30 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.843+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228005e90 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.843+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2300c2980 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.843+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280072e0 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.843+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23014fd70 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.844+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2300666b0 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.844+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd22801a060 con 0x7fd230154540 2023-05-10T01:45:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.844+0000 7fd2177fe700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:48.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.844+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fd228079390 con 0x7fd230154540 2023-05-10T01:45:48.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.845+0000 7fd22f7fe700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:48.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.845+0000 7fd22f7fe700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd220009fd0 tx=0x7fd220017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:48.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:48.848+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd22804a980 con 0x7fd230154540 2023-05-10T01:45:49.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:49.094+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fd23006c340 con 0x7fd230154540 2023-05-10T01:45:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.049+0000 7fd2177fe700 1 -- 172.21.15.52:0/4207859228 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1266) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd228018020 con 0x7fd230154540 2023-05-10T01:45:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 msgr2=0x7fd210061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd220009fd0 tx=0x7fd220017000).stop 2023-05-10T01:45:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 msgr2=0x7fd23014da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fd22800c7c0 tx=0x7fd2280015e0).stop 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 shutdown_connections 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd230154540 0x7fd23014da60 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230069690 0x7fd2300c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 --2- 172.21.15.52:0/4207859228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd230154160 0x7fd23014d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 >> 172.21.15.52:0/4207859228 conn(0x7fd2300cb6f0 msgr2=0x7fd230153150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 shutdown_connections 2023-05-10T01:45:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.052+0000 7fd235e34700 1 -- 172.21.15.52:0/4207859228 wait complete. 2023-05-10T01:45:50.070 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-05-10T01:45:50.070 INFO:tasks.cephfs_test_runner: 2023-05-10T01:45:50.071 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-05-10T01:45:50.071 INFO:tasks.cephfs_test_runner:Ran 9 tests in 2126.618s 2023-05-10T01:45:50.071 INFO:tasks.cephfs_test_runner: 2023-05-10T01:45:50.071 INFO:tasks.cephfs_test_runner:OK 2023-05-10T01:45:50.072 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-05-10T01:45:50.081 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-05-10T01:45:50.102 INFO:tasks.kclient:Unmounting kernel clients... 2023-05-10T01:45:50.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.102 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:45:50.119 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T01:45:50.119 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T01:45:50.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T01:45:50.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T01:45:50.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-05-10T01:45:50.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.333 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-05-10T01:45:50.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-05-10T01:45:50.417 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2023-05-10T01:45:50.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:45:50.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.419 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:45:50.436 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-05-10T01:45:50.436 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-10T01:45:50.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-10T01:45:50.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-10T01:45:50.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.593 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-05-10T01:45:50.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.707 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-05-10T01:45:50.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T01:45:50.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-05-10T01:45:50.791 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-05-10T01:45:50.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:45:50.793 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-05-10T01:45:50.802 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-05-10T01:45:50.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.923+0000 7f6638fe9700 1 Processor -- start 2023-05-10T01:45:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.923+0000 7f6638fe9700 1 -- start start 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6638fe9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6638fe9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634065440 con 0x7f6634151180 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6638fe9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66341519d0 con 0x7f6634150da0 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6638fe9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340bd370 con 0x7f6634064270 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6632d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6634151180 0x7f66340c3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52354/0 (socket says 172.21.15.52:52354) 2023-05-10T01:45:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6632d9d700 1 -- 172.21.15.52:0/3933887405 learned_addr learned my addr 172.21.15.52:0/3933887405 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.924+0000 7f6631d9b700 1 --2- 172.21.15.52:0/3933887405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45703426 0 0) 0x7f6634065440 con 0x7f6634151180 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66180033f0 con 0x7f6634151180 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957975667 0 0) 0x7f66341519d0 con 0x7f6634150da0 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634065440 con 0x7f6634150da0 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f6631d9b700 1 -- 172.21.15.52:0/3933887405 >> v1:172.21.15.172:6789/0 conn(0x7f6634150da0 legacy=0x7f663414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f6631d9b700 1 -- 172.21.15.52:0/3933887405 >> v1:172.21.15.52:6789/0 conn(0x7f6634151180 legacy=0x7f66340c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 405773494 0 0) 0x7f66180033f0 con 0x7f6634151180 2023-05-10T01:45:50.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f6631d9b700 1 -- 172.21.15.52:0/3933887405 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634064830 con 0x7f6634064270 2023-05-10T01:45:50.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f6631d9b700 1 --2- 172.21.15.52:0/3933887405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341506a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f6628009790 tx=0x7f6628009060).ready entity=mon.2 client_cookie=777ec57369b0f0b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:50.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624001470 con 0x7f6634064270 2023-05-10T01:45:50.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6628011400 con 0x7f6634064270 2023-05-10T01:45:50.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.925+0000 7f663159a700 1 -- 172.21.15.52:0/3933887405 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628011780 con 0x7f6634064270 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 -- 172.21.15.52:0/3933887405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 msgr2=0x7f66341506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3933887405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341506a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f6628009790 tx=0x7f6628009060).stop 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 -- 172.21.15.52:0/3933887405 shutdown_connections 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3933887405 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341506a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 -- 172.21.15.52:0/3933887405 >> 172.21.15.52:0/3933887405 conn(0x7f66340c7340 msgr2=0x7f66340c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 -- 172.21.15.52:0/3933887405 shutdown_connections 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.926+0000 7f6638fe9700 1 -- 172.21.15.52:0/3933887405 wait complete. 2023-05-10T01:45:50.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.927+0000 7f6638fe9700 1 Processor -- start 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.927+0000 7f6638fe9700 1 -- start start 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634151180 0x7f663414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341579f0 con 0x7f6634150da0 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634157150 con 0x7f6634151180 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6634157430 con 0x7f6634064270 2023-05-10T01:45:50.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43344/0 (socket says 172.21.15.52:43344) 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 -- 172.21.15.52:0/3913466019 learned_addr learned my addr 172.21.15.52:0/3913466019 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6632d9d700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634151180 0x7f663414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f663259c700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 -- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 msgr2=0x7f66341661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 -- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634151180 msgr2=0x7f663414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634151180 0x7f663414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 -- 172.21.15.52:0/3913466019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280092a0 con 0x7f6634150da0 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6631d9b700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f6628009d80 tx=0x7f6628016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280107f0 con 0x7f6634150da0 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6628010950 con 0x7f6634150da0 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6634157710 con 0x7f6634150da0 2023-05-10T01:45:50.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628010cf0 con 0x7f6634150da0 2023-05-10T01:45:50.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.928+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634156e30 con 0x7f6634150da0 2023-05-10T01:45:50.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.929+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634155210 con 0x7f6634150da0 2023-05-10T01:45:50.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.930+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6628024030 con 0x7f6634150da0 2023-05-10T01:45:50.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.930+0000 7f66227fc700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 0x7f6610061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:50.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.930+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f662807a620 con 0x7f6634150da0 2023-05-10T01:45:50.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.930+0000 7f663259c700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 0x7f6610061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:50.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.931+0000 7f663259c700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 0x7f6610061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f662c003fc0 tx=0x7f662c007f50).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:50.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:50.934+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6634155210 con 0x7f6634150da0 2023-05-10T01:45:51.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.109+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6634155210 con 0x7f6634150da0 2023-05-10T01:45:51.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.109+0000 7f66227fc700 1 -- 172.21.15.52:0/3913466019 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+14962 (secure 0 0 0) 0x7f6634155210 con 0x7f6634150da0 2023-05-10T01:45:51.113 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:51.113 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":178,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:48.045167+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/2644351057":"2023-05-11T01:45:44.227000+0000","172.21.15.172:0/3064772861":"2023-05-11T01:45:44.030660+0000","172.21.15.52:6833/2644351057":"2023-05-11T01:45:44.227000+0000","172.21.15.172:0/2808296808":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2986238820":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2454848793":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2085813196":"2023-05-11T01:45:35.997195+0000","172.21.15.172:0/3109593958":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2688172415":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6833/125557":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6832/125557":"2023-05-11T01:45:35.997195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:51.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 msgr2=0x7f6610061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 0x7f6610061250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f662c003fc0 tx=0x7f662c007f50).stop 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 msgr2=0x7f6634156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f6628009d80 tx=0x7f6628016000).stop 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 shutdown_connections 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f661005ed90 0x7f6610061250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634151180 0x7f663414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6634064270 0x7f66341661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 --2- 172.21.15.52:0/3913466019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6634150da0 0x7f6634156940 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 >> 172.21.15.52:0/3913466019 conn(0x7f66340c7340 msgr2=0x7f6634151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 shutdown_connections 2023-05-10T01:45:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.111+0000 7f6638fe9700 1 -- 172.21.15.52:0/3913466019 wait complete. 2023-05-10T01:45:51.126 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-10T01:45:51.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:51.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.240+0000 7f424d3a1700 1 Processor -- start 2023-05-10T01:45:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.240+0000 7f424d3a1700 1 -- start start 2023-05-10T01:45:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424d3a1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4248154e40 0x7f42480acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424d3a1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4248158960 con 0x7f42480ad030 2023-05-10T01:45:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424d3a1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42481552f0 con 0x7f42480c7370 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424d3a1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4248157d50 con 0x7f4248154e40 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f42477fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4248154e40 0x7f42480acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424cba0700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f42480ad030 0x7f424814dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52368/0 (socket says 172.21.15.52:52368) 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f424cba0700 1 -- 172.21.15.52:0/672388433 learned_addr learned my addr 172.21.15.52:0/672388433 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f42477fe700 1 -- 172.21.15.52:0/672388433 >> v1:172.21.15.172:6789/0 conn(0x7f42480c7370 legacy=0x7f42480c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f42477fe700 1 -- 172.21.15.52:0/672388433 >> v1:172.21.15.52:6789/0 conn(0x7f42480ad030 legacy=0x7f424814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f42477fe700 1 -- 172.21.15.52:0/672388433 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248158030 con 0x7f4248154e40 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.241+0000 7f42477fe700 1 --2- 172.21.15.52:0/672388433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4248154e40 0x7f42480acb40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f4238009760 tx=0x7f4238009060).ready entity=mon.0 client_cookie=bbdecab25022bcff server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f4246ffd700 1 -- 172.21.15.52:0/672388433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800b580 con 0x7f4248154e40 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f4246ffd700 1 -- 172.21.15.52:0/672388433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800b6e0 con 0x7f4248154e40 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f4246ffd700 1 -- 172.21.15.52:0/672388433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800ba60 con 0x7f4248154e40 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 -- 172.21.15.52:0/672388433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4248154e40 msgr2=0x7f42480acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 --2- 172.21.15.52:0/672388433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4248154e40 0x7f42480acb40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f4238009760 tx=0x7f4238009060).stop 2023-05-10T01:45:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 -- 172.21.15.52:0/672388433 shutdown_connections 2023-05-10T01:45:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 --2- 172.21.15.52:0/672388433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4248154e40 0x7f42480acb40 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 -- 172.21.15.52:0/672388433 >> 172.21.15.52:0/672388433 conn(0x7f4248068320 msgr2=0x7f4248068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 -- 172.21.15.52:0/672388433 shutdown_connections 2023-05-10T01:45:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.242+0000 7f424d3a1700 1 -- 172.21.15.52:0/672388433 wait complete. 2023-05-10T01:45:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.243+0000 7f424d3a1700 1 Processor -- start 2023-05-10T01:45:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.243+0000 7f424d3a1700 1 -- start start 2023-05-10T01:45:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 0x7f4248167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 0x7f4248153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c8a90 con 0x7f42480c7370 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248168950 con 0x7f42480ad030 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f424d3a1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42481680b0 con 0x7f4248154e40 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f42477fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f42477fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43358/0 (socket says 172.21.15.52:43358) 2023-05-10T01:45:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.244+0000 7f42477fe700 1 -- 172.21.15.52:0/3820699620 learned_addr learned my addr 172.21.15.52:0/3820699620 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f424cba0700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 0x7f4248153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f4247fff700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 0x7f4248167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 -- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 msgr2=0x7f4248153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 0x7f4248153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 -- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 msgr2=0x7f4248167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 0x7f4248167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 -- 172.21.15.52:0/3820699620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380092a0 con 0x7f42480c7370 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f4247fff700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 0x7f4248167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f424cba0700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 0x7f4248153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f42477fe700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f4238009eb0 tx=0x7f4238017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238000d10 con 0x7f42480c7370 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800ba60 con 0x7f42480c7370 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4248168390 con 0x7f42480c7370 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423801b620 con 0x7f42480c7370 2023-05-10T01:45:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.245+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480cac90 con 0x7f42480c7370 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.246+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248047150 con 0x7f42480c7370 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.246+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4238021030 con 0x7f42480c7370 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.247+0000 7f423ffff700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 0x7f422c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.247+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f423807b850 con 0x7f42480c7370 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.247+0000 7f4247fff700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 0x7f422c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.247+0000 7f4247fff700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 0x7f422c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4230001710 tx=0x7f4230009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.251+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f423804ce40 con 0x7f42480c7370 2023-05-10T01:45:51.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.418+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42480666b0 con 0x7f422c05ed90 2023-05-10T01:45:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.422+0000 7f423ffff700 1 -- 172.21.15.52:0/3820699620 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71040 (secure 0 0 0) 0x7f42480666b0 con 0x7f422c05ed90 2023-05-10T01:45:51.426 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.423+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 msgr2=0x7f422c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.423+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 0x7f422c061250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4230001710 tx=0x7f4230009040).stop 2023-05-10T01:45:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.423+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 msgr2=0x7f42480ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.423+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f4238009eb0 tx=0x7f4238017000).stop 2023-05-10T01:45:51.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 shutdown_connections 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f422c05ed90 0x7f422c061250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4248154e40 0x7f4248153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42480ad030 0x7f4248167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 --2- 172.21.15.52:0/3820699620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42480c7370 0x7f42480ca7a0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 >> 172.21.15.52:0/3820699620 conn(0x7f4248068320 msgr2=0x7f424814f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 shutdown_connections 2023-05-10T01:45:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.424+0000 7f424d3a1700 1 -- 172.21.15.52:0/3820699620 wait complete. 2023-05-10T01:45:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:51.438 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-10T01:45:50.870030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":194748,"kb_used_data":17212,"kb_used_omap":0,"kb_used_meta":177472,"kb_avail":754779972,"statfs":{"total":773094113280,"available":772894691328,"internally_reserved":0,"allocated":17625088,"data_stored":9121571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181731328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12244,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.169526"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.612897+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:36.612897+0000","last_peered":"2023-05-10T01:45:36.612897+0000","last_clean":"2023-05-10T01:45:36.612897+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:36.612897+0000","last_undegraded":"2023-05-10T01:45:36.612897+0000","last_fullsized":"2023-05-10T01:45:36.612897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.039864+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:44.039864+0000","last_peered":"2023-05-10T01:45:44.039864+0000","last_clean":"2023-05-10T01:45:44.039864+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:44.039864+0000","last_undegraded":"2023-05-10T01:45:44.039864+0000","last_fullsized":"2023-05-10T01:45:44.039864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.611612+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:36.611612+0000","last_peered":"2023-05-10T01:45:36.611612+0000","last_clean":"2023-05-10T01:45:36.611612+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:36.611612+0000","last_undegraded":"2023-05-10T01:45:36.611612+0000","last_fullsized":"2023-05-10T01:45:36.611612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.040131+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:44.040131+0000","last_peered":"2023-05-10T01:45:44.040131+0000","last_clean":"2023-05-10T01:45:44.040131+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:44.040131+0000","last_undegraded":"2023-05-10T01:45:44.040131+0000","last_fullsized":"2023-05-10T01:45:44.040131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036027+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:44.036027+0000","last_peered":"2023-05-10T01:45:44.036027+0000","last_clean":"2023-05-10T01:45:44.036027+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:44.036027+0000","last_undegraded":"2023-05-10T01:45:44.036027+0000","last_fullsized":"2023-05-10T01:45:44.036027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036117+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:44.036117+0000","last_peered":"2023-05-10T01:45:44.036117+0000","last_clean":"2023-05-10T01:45:44.036117+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:44.036117+0000","last_undegraded":"2023-05-10T01:45:44.036117+0000","last_fullsized":"2023-05-10T01:45:44.036117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036252+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:44.036252+0000","last_peered":"2023-05-10T01:45:44.036252+0000","last_clean":"2023-05-10T01:45:44.036252+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:44.036252+0000","last_undegraded":"2023-05-10T01:45:44.036252+0000","last_fullsized":"2023-05-10T01:45:44.036252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.613035+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:36.613035+0000","last_peered":"2023-05-10T01:45:36.613035+0000","last_clean":"2023-05-10T01:45:36.613035+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:36.613035+0000","last_undegraded":"2023-05-10T01:45:36.613035+0000","last_fullsized":"2023-05-10T01:45:36.613035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.389321+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:44.389321+0000","last_peered":"2023-05-10T01:45:44.389321+0000","last_clean":"2023-05-10T01:45:44.389321+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:44.389321+0000","last_undegraded":"2023-05-10T01:45:44.389321+0000","last_fullsized":"2023-05-10T01:45:44.389321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21184,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350656,"statfs":{"total":96636764160,"available":96615071744,"internally_reserved":0,"allocated":2220032,"data_stored":1151143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.496}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.442}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575270,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20652,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351188,"statfs":{"total":96636764160,"available":96615616512,"internally_reserved":0,"allocated":2199552,"data_stored":1139939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":1.208,"15min":1.208},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.84599999999999997,"15min":1.284},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.84799999999999998,"15min":1.0129999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.3360000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.371},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.3620000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.87,"15min":1.3120000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.747,"5min":0.995,"15min":1.2729999999999999},"last":0.41199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24368,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347472,"statfs":{"total":96636764160,"available":96611811328,"internally_reserved":0,"allocated":2203648,"data_stored":1140462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.49199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.56399999999999995,"5min":0.752,"15min":0.752},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.435,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.80300000000000005,"5min":1.1200000000000001,"15min":1.357},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79700000000000004,"5min":1.171,"15min":1.226},"last":0.628}]},{"osd":5,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.503}]},{"osd":6,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.403},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.83999999999999997,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.86099999999999999,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575270,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24880,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346960,"statfs":{"total":96636764160,"available":96611287040,"internally_reserved":0,"allocated":2203648,"data_stored":1134165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80000000000000004}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575270,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26036,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":23872,"kb_avail":94345804,"statfs":{"total":96636764160,"available":96610103296,"internally_reserved":0,"allocated":2207744,"data_stored":1140020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24444928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.36799999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":2179072,"data_stored":1125516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575270,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20848,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350992,"statfs":{"total":96636764160,"available":96615415808,"internally_reserved":0,"allocated":2203648,"data_stored":1140482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.309}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.38},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.32100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23924,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94347916,"statfs":{"total":96636764160,"available":96612265984,"internally_reserved":0,"allocated":2207744,"data_stored":1149844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.88600000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.625},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.65900000000000003}]},{"osd":4,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.79000000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.28399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.53600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.89200000000000002},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:51.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:51.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.553+0000 7f35c85e5700 1 Processor -- start 2023-05-10T01:45:51.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.554+0000 7f35c85e5700 1 -- start start 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.554+0000 7f35c85e5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35c0154160 0x7f35c00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.554+0000 7f35c85e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35c0154540 0x7f35c00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.554+0000 7f35c85e5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.554+0000 7f35c85e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00c0650 con 0x7f35c0154540 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c85e5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c006a010 con 0x7f35c0154160 2023-05-10T01:45:51.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c85e5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00bfd20 con 0x7f35c0069690 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35c0154540 0x7f35c00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35c0154540 0x7f35c00c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43366/0 (socket says 172.21.15.52:43366) 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 -- 172.21.15.52:0/2976146992 learned_addr learned my addr 172.21.15.52:0/2976146992 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c6381700 1 --2- 172.21.15.52:0/2976146992 >> v2:172.21.15.172:3300/0 conn(0x7f35c0154160 0x7f35c00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c6b82700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 -- 172.21.15.52:0/2976146992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 msgr2=0x7f35c0069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:51.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c0069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 -- 172.21.15.52:0/2976146992 >> v2:172.21.15.172:3300/0 conn(0x7f35c0154160 msgr2=0x7f35c00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 --2- 172.21.15.52:0/2976146992 >> v2:172.21.15.172:3300/0 conn(0x7f35c0154160 0x7f35c00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 -- 172.21.15.52:0/2976146992 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00c0000 con 0x7f35c0154540 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c5b80700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154540 0x7f35c00c6150 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f35c0083020 tx=0x7f35b40090f0).ready entity=mon.0 client_cookie=10b9be6ce2232551 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c537f700 1 -- 172.21.15.52:0/2976146992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400b600 con 0x7f35c0154540 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c537f700 1 -- 172.21.15.52:0/2976146992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b760 con 0x7f35c0154540 2023-05-10T01:45:51.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.555+0000 7f35c537f700 1 -- 172.21.15.52:0/2976146992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400bb00 con 0x7f35c0154540 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 -- 172.21.15.52:0/2976146992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154540 msgr2=0x7f35c00c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154540 0x7f35c00c6150 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f35c0083020 tx=0x7f35b40090f0).stop 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 -- 172.21.15.52:0/2976146992 shutdown_connections 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c0069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 --2- 172.21.15.52:0/2976146992 >> v2:172.21.15.172:3300/0 conn(0x7f35c0154160 0x7f35c00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 --2- 172.21.15.52:0/2976146992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154540 0x7f35c00c6150 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 -- 172.21.15.52:0/2976146992 >> 172.21.15.52:0/2976146992 conn(0x7f35c00cb6f0 msgr2=0x7f35c00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 -- 172.21.15.52:0/2976146992 shutdown_connections 2023-05-10T01:45:51.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.556+0000 7f35c85e5700 1 -- 172.21.15.52:0/2976146992 wait complete. 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.557+0000 7f35c85e5700 1 Processor -- start 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.557+0000 7f35c85e5700 1 -- start start 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c0154540 0x7f35c015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0164720 con 0x7f35c0154160 2023-05-10T01:45:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c2710 con 0x7f35c0154540 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c29f0 con 0x7f35c0069690 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43372/0 (socket says 172.21.15.52:43372) 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 -- 172.21.15.52:0/1027099413 learned_addr learned my addr 172.21.15.52:0/1027099413 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c6381700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c6b82700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c0154540 0x7f35c015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 -- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 msgr2=0x7f35c013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c013f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 -- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c0154540 msgr2=0x7f35c015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c0154540 0x7f35c015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 -- 172.21.15.52:0/1027099413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009370 con 0x7f35c0154160 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c5b80700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f35b4011000 tx=0x7f35b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4006d90 con 0x7f35c0154160 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400bec0 con 0x7f35c0154160 2023-05-10T01:45:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00c2cd0 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400b8d0 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.558+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c013fd70 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.559+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0164cf0 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.560+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f35b402c070 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.560+0000 7f35be7fc700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 0x7f35a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.560+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f35b407b2e0 con 0x7f35c0154160 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.560+0000 7f35c6381700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 0x7f35a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.561+0000 7f35c6381700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 0x7f35a0061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f35b8009fd0 tx=0x7f35b8009880).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.564+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35b404c8d0 con 0x7f35c0154160 2023-05-10T01:45:51.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.735+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35c00666b0 con 0x7f35a005ed90 2023-05-10T01:45:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.739+0000 7f35be7fc700 1 -- 172.21.15.52:0/1027099413 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71040 (secure 0 0 0) 0x7f35c00666b0 con 0x7f35a005ed90 2023-05-10T01:45:51.742 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 msgr2=0x7f35a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 0x7f35a0061250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f35b8009fd0 tx=0x7f35b8009880).stop 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 msgr2=0x7f35c00c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f35b4011000 tx=0x7f35b4017000).stop 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 shutdown_connections 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f35a005ed90 0x7f35a0061250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c0154540 0x7f35c015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c0069690 0x7f35c013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 --2- 172.21.15.52:0/1027099413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35c0154160 0x7f35c00c1d30 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 >> 172.21.15.52:0/1027099413 conn(0x7f35c00cb6f0 msgr2=0x7f35c014e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 shutdown_connections 2023-05-10T01:45:51.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.740+0000 7f35c85e5700 1 -- 172.21.15.52:0/1027099413 wait complete. 2023-05-10T01:45:51.746 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:51.754 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-10T01:45:50.870030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":194748,"kb_used_data":17212,"kb_used_omap":0,"kb_used_meta":177472,"kb_avail":754779972,"statfs":{"total":773094113280,"available":772894691328,"internally_reserved":0,"allocated":17625088,"data_stored":9121571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181731328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12244,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.169526"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.612897+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:36.612897+0000","last_peered":"2023-05-10T01:45:36.612897+0000","last_clean":"2023-05-10T01:45:36.612897+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:36.612897+0000","last_undegraded":"2023-05-10T01:45:36.612897+0000","last_fullsized":"2023-05-10T01:45:36.612897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.039864+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:44.039864+0000","last_peered":"2023-05-10T01:45:44.039864+0000","last_clean":"2023-05-10T01:45:44.039864+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:44.039864+0000","last_undegraded":"2023-05-10T01:45:44.039864+0000","last_fullsized":"2023-05-10T01:45:44.039864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.611612+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:36.611612+0000","last_peered":"2023-05-10T01:45:36.611612+0000","last_clean":"2023-05-10T01:45:36.611612+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:36.611612+0000","last_undegraded":"2023-05-10T01:45:36.611612+0000","last_fullsized":"2023-05-10T01:45:36.611612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.040131+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:44.040131+0000","last_peered":"2023-05-10T01:45:44.040131+0000","last_clean":"2023-05-10T01:45:44.040131+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:44.040131+0000","last_undegraded":"2023-05-10T01:45:44.040131+0000","last_fullsized":"2023-05-10T01:45:44.040131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036027+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:44.036027+0000","last_peered":"2023-05-10T01:45:44.036027+0000","last_clean":"2023-05-10T01:45:44.036027+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:44.036027+0000","last_undegraded":"2023-05-10T01:45:44.036027+0000","last_fullsized":"2023-05-10T01:45:44.036027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036117+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:44.036117+0000","last_peered":"2023-05-10T01:45:44.036117+0000","last_clean":"2023-05-10T01:45:44.036117+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:44.036117+0000","last_undegraded":"2023-05-10T01:45:44.036117+0000","last_fullsized":"2023-05-10T01:45:44.036117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036252+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:44.036252+0000","last_peered":"2023-05-10T01:45:44.036252+0000","last_clean":"2023-05-10T01:45:44.036252+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:44.036252+0000","last_undegraded":"2023-05-10T01:45:44.036252+0000","last_fullsized":"2023-05-10T01:45:44.036252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.613035+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:36.613035+0000","last_peered":"2023-05-10T01:45:36.613035+0000","last_clean":"2023-05-10T01:45:36.613035+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:36.613035+0000","last_undegraded":"2023-05-10T01:45:36.613035+0000","last_fullsized":"2023-05-10T01:45:36.613035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.389321+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:44.389321+0000","last_peered":"2023-05-10T01:45:44.389321+0000","last_clean":"2023-05-10T01:45:44.389321+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:44.389321+0000","last_undegraded":"2023-05-10T01:45:44.389321+0000","last_fullsized":"2023-05-10T01:45:44.389321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21184,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350656,"statfs":{"total":96636764160,"available":96615071744,"internally_reserved":0,"allocated":2220032,"data_stored":1151143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.496}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.442}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575270,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20652,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351188,"statfs":{"total":96636764160,"available":96615616512,"internally_reserved":0,"allocated":2199552,"data_stored":1139939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":1.208,"15min":1.208},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.84599999999999997,"15min":1.284},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.84799999999999998,"15min":1.0129999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.3360000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.371},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.3620000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.87,"15min":1.3120000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.747,"5min":0.995,"15min":1.2729999999999999},"last":0.41199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24368,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347472,"statfs":{"total":96636764160,"available":96611811328,"internally_reserved":0,"allocated":2203648,"data_stored":1140462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.49199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.56399999999999995,"5min":0.752,"15min":0.752},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.435,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.80300000000000005,"5min":1.1200000000000001,"15min":1.357},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79700000000000004,"5min":1.171,"15min":1.226},"last":0.628}]},{"osd":5,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.503}]},{"osd":6,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.403},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.83999999999999997,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.86099999999999999,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575270,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24880,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346960,"statfs":{"total":96636764160,"available":96611287040,"internally_reserved":0,"allocated":2203648,"data_stored":1134165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80000000000000004}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575270,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26036,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":23872,"kb_avail":94345804,"statfs":{"total":96636764160,"available":96610103296,"internally_reserved":0,"allocated":2207744,"data_stored":1140020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24444928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.36799999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":2179072,"data_stored":1125516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575270,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20848,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350992,"statfs":{"total":96636764160,"available":96615415808,"internally_reserved":0,"allocated":2203648,"data_stored":1140482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.309}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.38},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.32100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23924,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94347916,"statfs":{"total":96636764160,"available":96612265984,"internally_reserved":0,"allocated":2207744,"data_stored":1149844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.88600000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.625},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.65900000000000003}]},{"osd":4,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.79000000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.28399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.53600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.89200000000000002},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:51.757 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-10T01:45:51.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:51.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.870+0000 7fb1808e5700 1 Processor -- start 2023-05-10T01:45:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.870+0000 7fb1808e5700 1 -- start start 2023-05-10T01:45:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb1808e5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb1808e5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb1808e5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c067550 con 0x7fb17c068c60 2023-05-10T01:45:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb1808e5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c065970 con 0x7fb17c064ff0 2023-05-10T01:45:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb1808e5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0bc9a0 con 0x7fb17c153ea0 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb17ad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:34782/0 (socket says 172.21.15.52:34782) 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb17ad9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:41706/0 (socket says 172.21.15.52:41706) 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb179d9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb17c068c60 0x7fb17c066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:54932/0 (socket says 172.21.15.52:54932) 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.871+0000 7fb17a59c700 1 -- 172.21.15.52:0/316235796 learned_addr learned my addr 172.21.15.52:0/316235796 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:51.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17a59c700 1 -- 172.21.15.52:0/316235796 >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 msgr2=0x7fb17c065480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17a59c700 1 --2- 172.21.15.52:0/316235796 >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17a59c700 1 -- 172.21.15.52:0/316235796 >> v1:172.21.15.172:6789/0 conn(0x7fb17c068c60 legacy=0x7fb17c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17a59c700 1 -- 172.21.15.52:0/316235796 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0bcc80 con 0x7fb17c153ea0 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17ad9d700 1 --2- 172.21.15.52:0/316235796 >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17a59c700 1 --2- 172.21.15.52:0/316235796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb174009f20 tx=0x7fb174009840).ready entity=mon.2 client_cookie=c2284a6ebdbf6716 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17959a700 1 -- 172.21.15.52:0/316235796 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400e070 con 0x7fb17c153ea0 2023-05-10T01:45:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17959a700 1 -- 172.21.15.52:0/316235796 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400b9d0 con 0x7fb17c153ea0 2023-05-10T01:45:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.872+0000 7fb17959a700 1 -- 172.21.15.52:0/316235796 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400bd50 con 0x7fb17c153ea0 2023-05-10T01:45:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 -- 172.21.15.52:0/316235796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 msgr2=0x7fb17c154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 --2- 172.21.15.52:0/316235796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb174009f20 tx=0x7fb174009840).stop 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 -- 172.21.15.52:0/316235796 shutdown_connections 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 --2- 172.21.15.52:0/316235796 >> v2:172.21.15.172:3300/0 conn(0x7fb17c064ff0 0x7fb17c065480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 --2- 172.21.15.52:0/316235796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c153ea0 0x7fb17c154280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 -- 172.21.15.52:0/316235796 >> 172.21.15.52:0/316235796 conn(0x7fb17c0c4420 msgr2=0x7fb17c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 -- 172.21.15.52:0/316235796 shutdown_connections 2023-05-10T01:45:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.873+0000 7fb1808e5700 1 -- 172.21.15.52:0/316235796 wait complete. 2023-05-10T01:45:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 Processor -- start 2023-05-10T01:45:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 -- start start 2023-05-10T01:45:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb17c153ea0 0x7fb17c0a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c0a8c40 0x7fb17c150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.874+0000 7fb1808e5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0a7db0 con 0x7fb17c064ff0 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1808e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0a82c0 con 0x7fb17c153ea0 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1808e5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c150db0 con 0x7fb17c0a8c40 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43384/0 (socket says 172.21.15.52:43384) 2023-05-10T01:45:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 -- 172.21.15.52:0/3177812432 learned_addr learned my addr 172.21.15.52:0/3177812432 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb179d9b700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb17c153ea0 0x7fb17c0a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17ad9d700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c0a8c40 0x7fb17c150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 -- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c0a8c40 msgr2=0x7fb17c150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c0a8c40 0x7fb17c150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 -- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb17c153ea0 msgr2=0x7fb17c0a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb17c153ea0 0x7fb17c0a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 -- 172.21.15.52:0/3177812432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c0092a0 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb17a59c700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fb174007080 tx=0x7fb174009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400bd50 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740092e0 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb174009ae0 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17401e680 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.875+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0a7f90 con 0x7fb17c064ff0 2023-05-10T01:45:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.876+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c0a85a0 con 0x7fb17c064ff0 2023-05-10T01:45:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.877+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb174025030 con 0x7fb17c064ff0 2023-05-10T01:45:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.878+0000 7fb1727fc700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 0x7fb160061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.878+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fb17407bb40 con 0x7fb17c064ff0 2023-05-10T01:45:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.878+0000 7fb179d9b700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 0x7fb160061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.878+0000 7fb179d9b700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 0x7fb160061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb17c0c38a0 tx=0x7fb164007d30).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:51.881+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb17404d260 con 0x7fb17c064ff0 2023-05-10T01:45:52.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.049+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb17c0bcf60 con 0x7fb16005ed90 2023-05-10T01:45:52.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.052+0000 7fb1727fc700 1 -- 172.21.15.52:0/3177812432 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71040 (secure 0 0 0) 0x7fb17c0bcf60 con 0x7fb16005ed90 2023-05-10T01:45:52.056 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:52.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 msgr2=0x7fb160061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 0x7fb160061250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb17c0c38a0 tx=0x7fb164007d30).stop 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 msgr2=0x7fb17c1508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fb174007080 tx=0x7fb174009840).stop 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 shutdown_connections 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fb16005ed90 0x7fb160061250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb17c0a8c40 0x7fb17c150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17c064ff0 0x7fb17c1508c0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 --2- 172.21.15.52:0/3177812432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb17c153ea0 0x7fb17c0a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 >> 172.21.15.52:0/3177812432 conn(0x7fb17c0c4420 msgr2=0x7fb17c153470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:52.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 shutdown_connections 2023-05-10T01:45:52.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.054+0000 7fb1808e5700 1 -- 172.21.15.52:0/3177812432 wait complete. 2023-05-10T01:45:52.059 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:52.068 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-05-10T01:45:50.870030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":194748,"kb_used_data":17212,"kb_used_omap":0,"kb_used_meta":177472,"kb_avail":754779972,"statfs":{"total":773094113280,"available":772894691328,"internally_reserved":0,"allocated":17625088,"data_stored":9121571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181731328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12244,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.169526"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.612897+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:36.612897+0000","last_peered":"2023-05-10T01:45:36.612897+0000","last_clean":"2023-05-10T01:45:36.612897+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:36.612897+0000","last_undegraded":"2023-05-10T01:45:36.612897+0000","last_fullsized":"2023-05-10T01:45:36.612897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.039864+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:44.039864+0000","last_peered":"2023-05-10T01:45:44.039864+0000","last_clean":"2023-05-10T01:45:44.039864+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:44.039864+0000","last_undegraded":"2023-05-10T01:45:44.039864+0000","last_fullsized":"2023-05-10T01:45:44.039864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.611612+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:36.611612+0000","last_peered":"2023-05-10T01:45:36.611612+0000","last_clean":"2023-05-10T01:45:36.611612+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:36.611612+0000","last_undegraded":"2023-05-10T01:45:36.611612+0000","last_fullsized":"2023-05-10T01:45:36.611612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.040131+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:44.040131+0000","last_peered":"2023-05-10T01:45:44.040131+0000","last_clean":"2023-05-10T01:45:44.040131+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:44.040131+0000","last_undegraded":"2023-05-10T01:45:44.040131+0000","last_fullsized":"2023-05-10T01:45:44.040131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036027+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:44.036027+0000","last_peered":"2023-05-10T01:45:44.036027+0000","last_clean":"2023-05-10T01:45:44.036027+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:44.036027+0000","last_undegraded":"2023-05-10T01:45:44.036027+0000","last_fullsized":"2023-05-10T01:45:44.036027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036117+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:44.036117+0000","last_peered":"2023-05-10T01:45:44.036117+0000","last_clean":"2023-05-10T01:45:44.036117+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:44.036117+0000","last_undegraded":"2023-05-10T01:45:44.036117+0000","last_fullsized":"2023-05-10T01:45:44.036117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.036252+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:44.036252+0000","last_peered":"2023-05-10T01:45:44.036252+0000","last_clean":"2023-05-10T01:45:44.036252+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:44.036252+0000","last_undegraded":"2023-05-10T01:45:44.036252+0000","last_fullsized":"2023-05-10T01:45:44.036252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-05-10T01:45:36.613035+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:36.613035+0000","last_peered":"2023-05-10T01:45:36.613035+0000","last_clean":"2023-05-10T01:45:36.613035+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:36.613035+0000","last_undegraded":"2023-05-10T01:45:36.613035+0000","last_fullsized":"2023-05-10T01:45:36.613035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-05-10T01:45:44.389321+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:44.389321+0000","last_peered":"2023-05-10T01:45:44.389321+0000","last_clean":"2023-05-10T01:45:44.389321+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:44.389321+0000","last_undegraded":"2023-05-10T01:45:44.389321+0000","last_fullsized":"2023-05-10T01:45:44.389321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21184,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":19008,"kb_avail":94350656,"statfs":{"total":96636764160,"available":96615071744,"internally_reserved":0,"allocated":2220032,"data_stored":1151143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19464192},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.496}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.442}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575270,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20652,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":18496,"kb_avail":94351188,"statfs":{"total":96636764160,"available":96615616512,"internally_reserved":0,"allocated":2199552,"data_stored":1139939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18939904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":1.208,"15min":1.208},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.84599999999999997,"15min":1.284},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.84799999999999998,"15min":1.0129999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.3360000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.371},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.3620000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.87,"15min":1.3120000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.747,"5min":0.995,"15min":1.2729999999999999},"last":0.41199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24368,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347472,"statfs":{"total":96636764160,"available":96611811328,"internally_reserved":0,"allocated":2203648,"data_stored":1140462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.49199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.56399999999999995,"5min":0.752,"15min":0.752},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.435,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.80300000000000005,"5min":1.1200000000000001,"15min":1.357},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79700000000000004,"5min":1.171,"15min":1.226},"last":0.628}]},{"osd":5,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.503}]},{"osd":6,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.403},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.83999999999999997,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.86099999999999999,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575270,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24880,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346960,"statfs":{"total":96636764160,"available":96611287040,"internally_reserved":0,"allocated":2203648,"data_stored":1134165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.879},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.80000000000000004}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575270,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26036,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":23872,"kb_avail":94345804,"statfs":{"total":96636764160,"available":96610103296,"internally_reserved":0,"allocated":2207744,"data_stored":1140020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24444928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.747},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.26100000000000001},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":0.53600000000000003,"5min":0.69099999999999995,"15min":0.76400000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.433,"15min":0.44},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55400000000000005,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.36799999999999999}]},{"osd":4,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89200000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92400000000000004,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.53800000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":1.0620000000000001,"15min":1.133},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed May 10 01:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69099999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575270,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":2179072,"data_stored":1125516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.36299999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575270,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20848,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":18688,"kb_avail":94350992,"statfs":{"total":96636764160,"available":96615415808,"internally_reserved":0,"allocated":2203648,"data_stored":1140482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19136512},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.45400000000000001}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.309}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.372},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.38},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.32100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23924,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94347916,"statfs":{"total":96636764160,"available":96612265984,"internally_reserved":0,"allocated":2207744,"data_stored":1149844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.88600000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.625},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.65900000000000003}]},{"osd":4,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.79000000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.28399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.53600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.89200000000000002},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:52.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T01:45:52.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.184+0000 7f278c5b7700 1 Processor -- start 2023-05-10T01:45:52.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.184+0000 7f278c5b7700 1 -- start start 2023-05-10T01:45:52.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278c5b7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 0x7f2784069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278c5b7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278c5b7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784062950 con 0x7f27840bf4e0 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278c5b7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784154410 con 0x7f2784154030 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278c5b7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784069fa0 con 0x7f2784063e20 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278ab54700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278a353700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 0x7f2784069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.185+0000 7f278ab54700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:34796/0 (socket says 172.21.15.52:34796) 2023-05-10T01:45:52.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 -- 172.21.15.52:0/2151117010 learned_addr learned my addr 172.21.15.52:0/2151117010 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 -- 172.21.15.52:0/2151117010 >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 msgr2=0x7f2784069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 --2- 172.21.15.52:0/2151117010 >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 0x7f2784069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 -- 172.21.15.52:0/2151117010 >> v1:172.21.15.172:6789/0 conn(0x7f27840bf4e0 legacy=0x7f2784063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 -- 172.21.15.52:0/2151117010 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784062340 con 0x7f2784063e20 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278a353700 1 --2- 172.21.15.52:0/2151117010 >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 0x7f2784069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f278ab54700 1 --2- 172.21.15.52:0/2151117010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f2774006fd0 tx=0x7f27740090f0).ready entity=mon.2 client_cookie=d06c725bbde1473a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f2789351700 1 -- 172.21.15.52:0/2151117010 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400b580 con 0x7f2784063e20 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f2789351700 1 -- 172.21.15.52:0/2151117010 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400b6e0 con 0x7f2784063e20 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.186+0000 7f2789351700 1 -- 172.21.15.52:0/2151117010 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400ba60 con 0x7f2784063e20 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 -- 172.21.15.52:0/2151117010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 msgr2=0x7f2784062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 --2- 172.21.15.52:0/2151117010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f2774006fd0 tx=0x7f27740090f0).stop 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 -- 172.21.15.52:0/2151117010 shutdown_connections 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 --2- 172.21.15.52:0/2151117010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2784063e20 0x7f2784062de0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 --2- 172.21.15.52:0/2151117010 >> v2:172.21.15.172:3300/0 conn(0x7f2784154030 0x7f2784069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 -- 172.21.15.52:0/2151117010 >> 172.21.15.52:0/2151117010 conn(0x7f27840c8a90 msgr2=0x7f27840c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 -- 172.21.15.52:0/2151117010 shutdown_connections 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.187+0000 7f278c5b7700 1 -- 172.21.15.52:0/2151117010 wait complete. 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.188+0000 7f278c5b7700 1 Processor -- start 2023-05-10T01:45:52.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.188+0000 7f278c5b7700 1 -- start start 2023-05-10T01:45:52.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27840bf4e0 0x7f27840c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2784154030 0x7f2784152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841511d0 con 0x7f2784063e20 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841505c0 con 0x7f2784154030 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278c5b7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27841508a0 con 0x7f27840bf4e0 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43394/0 (socket says 172.21.15.52:43394) 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 -- 172.21.15.52:0/233233837 learned_addr learned my addr 172.21.15.52:0/233233837 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f2789b52700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27840bf4e0 0x7f27840c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278ab54700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2784154030 0x7f2784152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 -- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27840bf4e0 msgr2=0x7f27840c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27840bf4e0 0x7f27840c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 -- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2784154030 msgr2=0x7f2784152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2784154030 0x7f2784152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 -- 172.21.15.52:0/233233837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009a20 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f278a353700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f277c00c170 tx=0x7f277c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.189+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c00ccb0 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.190+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c00f040 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.190+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2774009370 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.190+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c013400 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.190+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784150e60 con 0x7f2784063e20 2023-05-10T01:45:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.191+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27841514b0 con 0x7f2784063e20 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.191+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f277c0137b0 con 0x7f2784063e20 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.191+0000 7f27827fc700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 0x7f2764061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.191+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f277c07a580 con 0x7f2784063e20 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.192+0000 7f2789b52700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 0x7f2764061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.192+0000 7f2789b52700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 0x7f2764061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2784063a60 tx=0x7f2778007d40).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:52.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.195+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f277c04bb70 con 0x7f2784063e20 2023-05-10T01:45:52.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.369+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f278406c340 con 0x7f2784063e20 2023-05-10T01:45:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.370+0000 7f27827fc700 1 -- 172.21.15.52:0/233233837 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+14962 (secure 0 0 0) 0x7f277c04f190 con 0x7f2784063e20 2023-05-10T01:45:52.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:52.374 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":178,"fsid":"81a74aef-38e3-473f-8c9a-a859f40ac8ae","created":"2023-05-10T01:09:35.593834+0000","modified":"2023-05-10T01:45:48.045167+0000","last_up_change":"2023-05-10T01:09:44.449432+0000","last_in_change":"2023-05-10T01:09:38.064744+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-05-10T01:09:44.499405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T01:09:46.826725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"29044984-cd85-43ea-b2d5-3bc38d56181d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":116680},{"type":"v1","addr":"172.21.15.52:6818","nonce":116680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":116680},{"type":"v1","addr":"172.21.15.52:6822","nonce":116680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":116680},{"type":"v1","addr":"172.21.15.52:6829","nonce":116680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":116680},{"type":"v1","addr":"172.21.15.52:6825","nonce":116680}]},"public_addr":"172.21.15.52:6818/116680","cluster_addr":"172.21.15.52:6822/116680","heartbeat_back_addr":"172.21.15.52:6829/116680","heartbeat_front_addr":"172.21.15.52:6825/116680","state":["exists","up"]},{"osd":1,"uuid":"da7e871c-9b19-43d4-803b-7e2b05bbefab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":116664},{"type":"v1","addr":"172.21.15.52:6819","nonce":116664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":116664},{"type":"v1","addr":"172.21.15.52:6823","nonce":116664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":116664},{"type":"v1","addr":"172.21.15.52:6831","nonce":116664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":116664},{"type":"v1","addr":"172.21.15.52:6828","nonce":116664}]},"public_addr":"172.21.15.52:6819/116664","cluster_addr":"172.21.15.52:6823/116664","heartbeat_back_addr":"172.21.15.52:6831/116664","heartbeat_front_addr":"172.21.15.52:6828/116664","state":["exists","up"]},{"osd":2,"uuid":"82ebe07f-9862-4742-b9e5-df5284613972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":116667},{"type":"v1","addr":"172.21.15.52:6801","nonce":116667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":116667},{"type":"v1","addr":"172.21.15.52:6803","nonce":116667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":116667},{"type":"v1","addr":"172.21.15.52:6807","nonce":116667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":116667},{"type":"v1","addr":"172.21.15.52:6805","nonce":116667}]},"public_addr":"172.21.15.52:6801/116667","cluster_addr":"172.21.15.52:6803/116667","heartbeat_back_addr":"172.21.15.52:6807/116667","heartbeat_front_addr":"172.21.15.52:6805/116667","state":["exists","up"]},{"osd":3,"uuid":"fc11f055-b948-4c26-8de8-cbe0f444b59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":116668},{"type":"v1","addr":"172.21.15.52:6809","nonce":116668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":116668},{"type":"v1","addr":"172.21.15.52:6811","nonce":116668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":116668},{"type":"v1","addr":"172.21.15.52:6815","nonce":116668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":116668},{"type":"v1","addr":"172.21.15.52:6813","nonce":116668}]},"public_addr":"172.21.15.52:6809/116668","cluster_addr":"172.21.15.52:6811/116668","heartbeat_back_addr":"172.21.15.52:6815/116668","heartbeat_front_addr":"172.21.15.52:6813/116668","state":["exists","up"]},{"osd":4,"uuid":"221cf996-65ca-441f-8c0e-1aaad320a4de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":116794},{"type":"v1","addr":"172.21.15.172:6820","nonce":116794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":116794},{"type":"v1","addr":"172.21.15.172:6824","nonce":116794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":116794},{"type":"v1","addr":"172.21.15.172:6831","nonce":116794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":116794},{"type":"v1","addr":"172.21.15.172:6828","nonce":116794}]},"public_addr":"172.21.15.172:6820/116794","cluster_addr":"172.21.15.172:6824/116794","heartbeat_back_addr":"172.21.15.172:6831/116794","heartbeat_front_addr":"172.21.15.172:6828/116794","state":["exists","up"]},{"osd":5,"uuid":"4228c974-0e49-42f0-82d2-1090c5a3373c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":116763},{"type":"v1","addr":"172.21.15.172:6801","nonce":116763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":116763},{"type":"v1","addr":"172.21.15.172:6803","nonce":116763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":116763},{"type":"v1","addr":"172.21.15.172:6807","nonce":116763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":116763},{"type":"v1","addr":"172.21.15.172:6805","nonce":116763}]},"public_addr":"172.21.15.172:6801/116763","cluster_addr":"172.21.15.172:6803/116763","heartbeat_back_addr":"172.21.15.172:6807/116763","heartbeat_front_addr":"172.21.15.172:6805/116763","state":["exists","up"]},{"osd":6,"uuid":"22167a6f-e927-4e37-b448-c2a85cbf45cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":116764},{"type":"v1","addr":"172.21.15.172:6809","nonce":116764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":116764},{"type":"v1","addr":"172.21.15.172:6811","nonce":116764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":116764},{"type":"v1","addr":"172.21.15.172:6815","nonce":116764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":116764},{"type":"v1","addr":"172.21.15.172:6813","nonce":116764}]},"public_addr":"172.21.15.172:6809/116764","cluster_addr":"172.21.15.172:6811/116764","heartbeat_back_addr":"172.21.15.172:6815/116764","heartbeat_front_addr":"172.21.15.172:6813/116764","state":["exists","up"]},{"osd":7,"uuid":"9d81c33f-18a1-4ed1-8f6b-8c06e06f510c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":116795},{"type":"v1","addr":"172.21.15.172:6817","nonce":116795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6819","nonce":116795},{"type":"v1","addr":"172.21.15.172:6821","nonce":116795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6827","nonce":116795},{"type":"v1","addr":"172.21.15.172:6829","nonce":116795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":116795},{"type":"v1","addr":"172.21.15.172:6825","nonce":116795}]},"public_addr":"172.21.15.172:6817/116795","cluster_addr":"172.21.15.172:6821/116795","heartbeat_back_addr":"172.21.15.172:6829/116795","heartbeat_front_addr":"172.21.15.172:6825/116795","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.233740+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.208055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.205312+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.222209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.242292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.223934+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.255801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T01:09:43.306310+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/2644351057":"2023-05-11T01:45:44.227000+0000","172.21.15.172:0/3064772861":"2023-05-11T01:45:44.030660+0000","172.21.15.52:6833/2644351057":"2023-05-11T01:45:44.227000+0000","172.21.15.172:0/2808296808":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2986238820":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2454848793":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2085813196":"2023-05-11T01:45:35.997195+0000","172.21.15.172:0/3109593958":"2023-05-11T01:45:44.030660+0000","172.21.15.172:0/2688172415":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6833/125557":"2023-05-11T01:45:35.997195+0000","172.21.15.172:6832/125557":"2023-05-11T01:45:35.997195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":17,"length":1},{"begin":27,"length":1},{"begin":37,"length":1},{"begin":47,"length":1},{"begin":57,"length":1},{"begin":67,"length":1},{"begin":77,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":207,"length":13}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":18,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T01:45:52.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 msgr2=0x7f2764061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 0x7f2764061250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2784063a60 tx=0x7f2778007d40).stop 2023-05-10T01:45:52.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 msgr2=0x7f2784151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:52.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f277c00c170 tx=0x7f277c00b040).stop 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 shutdown_connections 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f276405ed90 0x7f2764061250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2784154030 0x7f2784152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2784063e20 0x7f2784151660 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 --2- 172.21.15.52:0/233233837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27840bf4e0 0x7f27840c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 >> 172.21.15.52:0/233233837 conn(0x7f27840c8a90 msgr2=0x7f278414f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 shutdown_connections 2023-05-10T01:45:52.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:52.372+0000 7f278c5b7700 1 -- 172.21.15.52:0/233233837 wait complete. 2023-05-10T01:45:53.388 INFO:tasks.ceph:Scrubbing osd.0 2023-05-10T01:45:53.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.520+0000 7f3eb0880700 1 Processor -- start 2023-05-10T01:45:53.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.520+0000 7f3eb0880700 1 -- start start 2023-05-10T01:45:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eb0880700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eb0880700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eac068150 0x7f3eac068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eb0880700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0c94c0 con 0x7f3eac154460 2023-05-10T01:45:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eb0880700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0cb7d0 con 0x7f3eac068150 2023-05-10T01:45:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eb0880700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac068a60 con 0x7f3eac154080 2023-05-10T01:45:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eaad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3eac068150 0x7f3eac068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3ea9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3eac154460 0x7f3eac0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52420/0 (socket says 172.21.15.52:52420) 2023-05-10T01:45:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3ea9d9b700 1 -- 172.21.15.52:0/61276125 learned_addr learned my addr 172.21.15.52:0/61276125 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.521+0000 7f3eaa59c700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eaad9d700 1 -- 172.21.15.52:0/61276125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 msgr2=0x7f3eac0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eaad9d700 1 -- 172.21.15.52:0/61276125 >> v1:172.21.15.52:6789/0 conn(0x7f3eac154460 legacy=0x7f3eac0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eaad9d700 1 -- 172.21.15.52:0/61276125 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0c88b0 con 0x7f3eac068150 2023-05-10T01:45:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3ea959a700 1 -- 172.21.15.52:0/61276125 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321584633 0 0) 0x7f3eac0c94c0 con 0x7f3eac154460 2023-05-10T01:45:53.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac068570 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f3e9c009e60 tx=0x7f3e9c009780).ready entity=mon.0 client_cookie=891b82e135ef5038 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3ea959a700 1 -- 172.21.15.52:0/61276125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00e070 con 0x7f3eac068150 2023-05-10T01:45:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3ea959a700 1 -- 172.21.15.52:0/61276125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00bc30 con 0x7f3eac068150 2023-05-10T01:45:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3ea959a700 1 -- 172.21.15.52:0/61276125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c012410 con 0x7f3eac068150 2023-05-10T01:45:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 -- 172.21.15.52:0/61276125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 msgr2=0x7f3eac068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac068570 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f3e9c009e60 tx=0x7f3e9c009780).stop 2023-05-10T01:45:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 -- 172.21.15.52:0/61276125 shutdown_connections 2023-05-10T01:45:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac068570 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 --2- 172.21.15.52:0/61276125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 -- 172.21.15.52:0/61276125 >> 172.21.15.52:0/61276125 conn(0x7f3eac067910 msgr2=0x7f3eac0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:53.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 -- 172.21.15.52:0/61276125 shutdown_connections 2023-05-10T01:45:53.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.522+0000 7f3eb0880700 1 -- 172.21.15.52:0/61276125 wait complete. 2023-05-10T01:45:53.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 Processor -- start 2023-05-10T01:45:53.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 -- start start 2023-05-10T01:45:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac0c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eac154460 0x7f3eac1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac150920 con 0x7f3eac068150 2023-05-10T01:45:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0c4020 con 0x7f3eac154460 2023-05-10T01:45:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eb0880700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0c4300 con 0x7f3eac154080 2023-05-10T01:45:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eaa59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac0c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eaa59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac0c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43410/0 (socket says 172.21.15.52:43410) 2023-05-10T01:45:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.524+0000 7f3eaa59c700 1 -- 172.21.15.52:0/2234816709 learned_addr learned my addr 172.21.15.52:0/2234816709 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3ea9d9b700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eac154460 0x7f3eac1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 -- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 msgr2=0x7f3eac150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 -- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eac154460 msgr2=0x7f3eac1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eac154460 0x7f3eac1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c009a20 con 0x7f3eac068150 2023-05-10T01:45:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3ea9d9b700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3eac154080 0x7f3eac150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3eac154460 0x7f3eac1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eaa59c700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac0c1cc0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f3ea400d890 tx=0x7f3ea4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40125f0 con 0x7f3eac068150 2023-05-10T01:45:53.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4012750 con 0x7f3eac068150 2023-05-10T01:45:53.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac1538a0 con 0x7f3eac068150 2023-05-10T01:45:53.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012ad0 con 0x7f3eac068150 2023-05-10T01:45:53.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.525+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac157220 con 0x7f3eac068150 2023-05-10T01:45:53.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.526+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3eac066720 con 0x7f3eac068150 2023-05-10T01:45:53.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.526+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3ea4013480 con 0x7f3eac068150 2023-05-10T01:45:53.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3e9a7fc700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e8805ed90 0x7f3e88061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f3ea407a7c0 con 0x7f3eac068150 2023-05-10T01:45:53.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3e9a7fc700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f3e88065900 0x7f3e88067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e88068350 con 0x7f3e88065900 2023-05-10T01:45:53.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea407abc0 con 0x7f3eac068150 2023-05-10T01:45:53.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3ea9d9b700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e8805ed90 0x7f3e88061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f3e88065900 0x7f3e88067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3eaad9d700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f3e88065900 0x7f3e88067d70 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.527+0000 7f3ea9d9b700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e8805ed90 0x7f3e88061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3eac168910 tx=0x7f3ea0009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.528+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== osd.0 v2:172.21.15.52:6816/116680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3e88068350 con 0x7f3e88065900 2023-05-10T01:45:53.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 --> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3eac06c340 con 0x7f3e88065900 2023-05-10T01:45:53.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3e9a7fc700 1 -- 172.21.15.52:0/2234816709 <== osd.0 v2:172.21.15.52:6816/116680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3eac06c340 con 0x7f3e88065900 2023-05-10T01:45:53.549 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:53.549 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:53.549 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:53.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f3e88065900 msgr2=0x7f3e88067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:6816/116680,v1:172.21.15.52:6818/116680] conn(0x7f3e88065900 0x7f3e88067d70 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e8805ed90 msgr2=0x7f3e88061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f3e8805ed90 0x7f3e88061250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3eac168910 tx=0x7f3ea0009040).stop 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 msgr2=0x7f3eac0c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 --2- 172.21.15.52:0/2234816709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3eac068150 0x7f3eac0c1cc0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f3ea400d890 tx=0x7f3ea4008040).stop 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eaad9d700 1 -- 172.21.15.52:0/2234816709 reap_dead start 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 shutdown_connections 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 >> 172.21.15.52:0/2234816709 conn(0x7f3eac067910 msgr2=0x7f3eac0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 shutdown_connections 2023-05-10T01:45:53.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.542+0000 7f3eb0880700 1 -- 172.21.15.52:0/2234816709 wait complete. 2023-05-10T01:45:53.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-05-10T01:45:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.671+0000 7faa6b73c700 1 Processor -- start 2023-05-10T01:45:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.671+0000 7faa6b73c700 1 -- start start 2023-05-10T01:45:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa6b73c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 0x7faa64069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa6b73c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa64069b80 0x7faa640c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa6b73c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c0650 con 0x7faa64154160 2023-05-10T01:45:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa6b73c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64069fb0 con 0x7faa64069b80 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa6b73c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640bfd20 con 0x7faa64154540 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa64069b80 0x7faa640c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa64069b80 0x7faa640c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43422/0 (socket says 172.21.15.52:43422) 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 -- 172.21.15.52:0/3883715961 learned_addr learned my addr 172.21.15.52:0/3883715961 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 -- 172.21.15.52:0/3883715961 >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 msgr2=0x7faa64069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa68cd7700 1 --2- 172.21.15.52:0/3883715961 >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 0x7faa64069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 --2- 172.21.15.52:0/3883715961 >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 0x7faa64069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 -- 172.21.15.52:0/3883715961 >> v1:172.21.15.172:6789/0 conn(0x7faa64154160 legacy=0x7faa640c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 -- 172.21.15.52:0/3883715961 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640c0000 con 0x7faa64069b80 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa68cd7700 1 --2- 172.21.15.52:0/3883715961 >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 0x7faa64069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa69cd9700 1 --2- 172.21.15.52:0/3883715961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa640c0ae0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7faa640844d0 tx=0x7faa5c009840).ready entity=mon.0 client_cookie=6f72ff3b0fdab29e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa53fff700 1 -- 172.21.15.52:0/3883715961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00e070 con 0x7faa64069b80 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa53fff700 1 -- 172.21.15.52:0/3883715961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00ba10 con 0x7faa64069b80 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.672+0000 7faa53fff700 1 -- 172.21.15.52:0/3883715961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00bd90 con 0x7faa64069b80 2023-05-10T01:45:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 -- 172.21.15.52:0/3883715961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 msgr2=0x7faa640c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 --2- 172.21.15.52:0/3883715961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa640c0ae0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7faa640844d0 tx=0x7faa5c009840).stop 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 -- 172.21.15.52:0/3883715961 shutdown_connections 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 --2- 172.21.15.52:0/3883715961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa640c0ae0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 --2- 172.21.15.52:0/3883715961 >> v2:172.21.15.172:3300/0 conn(0x7faa64154540 0x7faa64069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 -- 172.21.15.52:0/3883715961 >> 172.21.15.52:0/3883715961 conn(0x7faa640cb6f0 msgr2=0x7faa640c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 -- 172.21.15.52:0/3883715961 shutdown_connections 2023-05-10T01:45:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.673+0000 7faa6b73c700 1 -- 172.21.15.52:0/3883715961 wait complete. 2023-05-10T01:45:53.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.674+0000 7faa6b73c700 1 Processor -- start 2023-05-10T01:45:53.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.674+0000 7faa6b73c700 1 -- start start 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 0x7faa640af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64154540 0x7faa6414d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640affe0 con 0x7faa64069b80 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640b02c0 con 0x7faa64154540 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa6b73c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c1dd0 con 0x7faa64154160 2023-05-10T01:45:53.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43426/0 (socket says 172.21.15.52:43426) 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 -- 172.21.15.52:0/90862377 learned_addr learned my addr 172.21.15.52:0/90862377 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa69cd9700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64154540 0x7faa6414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa68cd7700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 0x7faa640af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 -- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 msgr2=0x7faa640af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 0x7faa640af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 -- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64154540 msgr2=0x7faa6414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64154540 0x7faa6414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa694d8700 1 -- 172.21.15.52:0/90862377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c009ae0 con 0x7faa64069b80 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.675+0000 7faa68cd7700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 0x7faa640af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa694d8700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7faa6000c440 tx=0x7faa60007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000cea0 con 0x7faa64069b80 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000f470 con 0x7faa64069b80 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa640c20b0 con 0x7faa64069b80 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000f810 con 0x7faa64069b80 2023-05-10T01:45:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.676+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa640afca0 con 0x7faa64069b80 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.677+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa640666b0 con 0x7faa64069b80 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.677+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faa60019030 con 0x7faa64069b80 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.677+0000 7faa517fa700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 0x7faa44061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.677+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7faa60078da0 con 0x7faa64069b80 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.678+0000 7faa68cd7700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 0x7faa44061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.678+0000 7faa68cd7700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 0x7faa44061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7faa54006fd0 tx=0x7faa54008040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.682+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa600488f0 con 0x7faa64069b80 2023-05-10T01:45:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.854+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7faa6406c340 con 0x7faa4405ed90 2023-05-10T01:45:53.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.855+0000 7faa517fa700 1 -- 172.21.15.52:0/90862377 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa6406c340 con 0x7faa4405ed90 2023-05-10T01:45:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 msgr2=0x7faa44061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 0x7faa44061250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7faa54006fd0 tx=0x7faa54008040).stop 2023-05-10T01:45:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 msgr2=0x7faa641586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7faa6000c440 tx=0x7faa60007de0).stop 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 shutdown_connections 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7faa4405ed90 0x7faa44061250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64154540 0x7faa6414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa64069b80 0x7faa641586c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 --2- 172.21.15.52:0/90862377 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa64154160 0x7faa640af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 >> 172.21.15.52:0/90862377 conn(0x7faa640cb6f0 msgr2=0x7faa640aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:53.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 shutdown_connections 2023-05-10T01:45:53.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.857+0000 7faa6b73c700 1 -- 172.21.15.52:0/90862377 wait complete. 2023-05-10T01:45:53.862 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2023-05-10T01:45:53.871 INFO:tasks.ceph:Scrubbing osd.1 2023-05-10T01:45:53.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:53.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.988+0000 7fa8091a5700 1 Processor -- start 2023-05-10T01:45:53.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.988+0000 7fa8091a5700 1 -- start start 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa8091a5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8040c5d20 0x7fa8040aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa8091a5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa804153a90 0x7fa804153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa8091a5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040c8820 con 0x7fa8040c6100 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa8091a5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040ca5f0 con 0x7fa804153a90 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa8091a5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040c8b00 con 0x7fa8040c5d20 2023-05-10T01:45:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa80359e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa804153a90 0x7fa804153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa80259c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa8040c6100 0x7fa804069fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52450/0 (socket says 172.21.15.52:52450) 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.989+0000 7fa80259c700 1 -- 172.21.15.52:0/767515126 learned_addr learned my addr 172.21.15.52:0/767515126 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa802d9d700 1 --2- 172.21.15.52:0/767515126 >> v2:172.21.15.172:3300/0 conn(0x7fa8040c5d20 0x7fa8040aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa80359e700 1 -- 172.21.15.52:0/767515126 >> v2:172.21.15.172:3300/0 conn(0x7fa8040c5d20 msgr2=0x7fa8040aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa80359e700 1 --2- 172.21.15.52:0/767515126 >> v2:172.21.15.172:3300/0 conn(0x7fa8040c5d20 0x7fa8040aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa80359e700 1 -- 172.21.15.52:0/767515126 >> v1:172.21.15.52:6789/0 conn(0x7fa8040c6100 legacy=0x7fa804069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa801d9b700 1 -- 172.21.15.52:0/767515126 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989763302 0 0) 0x7fa8040c8820 con 0x7fa8040c6100 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa80359e700 1 -- 172.21.15.52:0/767515126 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040c8de0 con 0x7fa804153a90 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa80359e700 1 --2- 172.21.15.52:0/767515126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa804153a90 0x7fa804153f00 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fa80406c000 tx=0x7fa7f4009060).ready entity=mon.0 client_cookie=af7b8e7ef3a4eee7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa801d9b700 1 -- 172.21.15.52:0/767515126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400b580 con 0x7fa804153a90 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa801d9b700 1 -- 172.21.15.52:0/767515126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400b6e0 con 0x7fa804153a90 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa801d9b700 1 -- 172.21.15.52:0/767515126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400ba60 con 0x7fa804153a90 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 -- 172.21.15.52:0/767515126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa804153a90 msgr2=0x7fa804153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 --2- 172.21.15.52:0/767515126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa804153a90 0x7fa804153f00 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fa80406c000 tx=0x7fa7f4009060).stop 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 -- 172.21.15.52:0/767515126 shutdown_connections 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 --2- 172.21.15.52:0/767515126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa804153a90 0x7fa804153f00 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 --2- 172.21.15.52:0/767515126 >> v2:172.21.15.172:3300/0 conn(0x7fa8040c5d20 0x7fa8040aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 -- 172.21.15.52:0/767515126 >> 172.21.15.52:0/767515126 conn(0x7fa8040cb6f0 msgr2=0x7fa8040c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.990+0000 7fa8091a5700 1 -- 172.21.15.52:0/767515126 shutdown_connections 2023-05-10T01:45:53.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.991+0000 7fa8091a5700 1 -- 172.21.15.52:0/767515126 wait complete. 2023-05-10T01:45:54.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 Processor -- start 2023-05-10T01:45:54.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 -- start start 2023-05-10T01:45:54.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8040c5d20 0x7fa8040c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 0x7fa8040ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa804153a90 0x7fa8040ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c40f0 con 0x7fa8040c6100 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c34e0 con 0x7fa804153a90 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.992+0000 7fa8091a5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c37c0 con 0x7fa8040c5d20 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 0x7fa8040ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 0x7fa8040ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43438/0 (socket says 172.21.15.52:43438) 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 -- 172.21.15.52:0/1057242737 learned_addr learned my addr 172.21.15.52:0/1057242737 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa802d9d700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8040c5d20 0x7fa8040c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80359e700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa804153a90 0x7fa8040ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 -- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8040c5d20 msgr2=0x7fa8040c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8040c5d20 0x7fa8040c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 -- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa804153a90 msgr2=0x7fa8040ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa804153a90 0x7fa8040ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40092a0 con 0x7fa8040c6100 2023-05-10T01:45:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa80259c700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 0x7fa8040ae2d0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fa7ec00c4e0 tx=0x7fa7ec007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00ce90 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0072e0 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040c3aa0 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007660 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.993+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8040c3180 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.994+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa804066720 con 0x7fa8040c6100 2023-05-10T01:45:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa7ec01a060 con 0x7fa8040c6100 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa7e805ed90 0x7fa7e8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fa7ec079a50 con 0x7fa8040c6100 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fa7e8065790 0x7fa7e8067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7e80681e0 con 0x7fa7e8065790 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7ec079e50 con 0x7fa8040c6100 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa80359e700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fa7e8065790 0x7fa7e8067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.995+0000 7fa802d9d700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa7e805ed90 0x7fa7e8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.996+0000 7fa80359e700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fa7e8065790 0x7fa7e8067c00 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.996+0000 7fa802d9d700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa7e805ed90 0x7fa7e8061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa7fc009fd0 tx=0x7fa7fc009880).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:53.996+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== osd.1 v2:172.21.15.52:6817/116664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa7e80681e0 con 0x7fa7e8065790 2023-05-10T01:45:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.009+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 --> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa80406c340 con 0x7fa7e8065790 2023-05-10T01:45:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa7faffd700 1 -- 172.21.15.52:0/1057242737 <== osd.1 v2:172.21.15.52:6817/116664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa80406c340 con 0x7fa7e8065790 2023-05-10T01:45:54.013 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:54.013 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:54.013 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fa7e8065790 msgr2=0x7fa7e8067c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:6817/116664,v1:172.21.15.52:6819/116664] conn(0x7fa7e8065790 0x7fa7e8067c00 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa7e805ed90 msgr2=0x7fa7e8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa7e805ed90 0x7fa7e8061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa7fc009fd0 tx=0x7fa7fc009880).stop 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 msgr2=0x7fa8040ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 --2- 172.21.15.52:0/1057242737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8040c6100 0x7fa8040ae2d0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7fa7ec00c4e0 tx=0x7fa7ec007c70).stop 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa80359e700 1 -- 172.21.15.52:0/1057242737 reap_dead start 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 shutdown_connections 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 >> 172.21.15.52:0/1057242737 conn(0x7fa8040cb6f0 msgr2=0x7fa8041516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 shutdown_connections 2023-05-10T01:45:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.010+0000 7fa8091a5700 1 -- 172.21.15.52:0/1057242737 wait complete. 2023-05-10T01:45:54.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-05-10T01:45:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.138+0000 7ff2b076c700 1 Processor -- start 2023-05-10T01:45:54.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 -- start start 2023-05-10T01:45:54.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a8154540 0x7ff2a80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2a80c5ca0 0x7ff2a80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80c6640 con 0x7ff2a8154160 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80ab1f0 con 0x7ff2a8154540 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.139+0000 7ff2b076c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80c08a0 con 0x7ff2a80c5ca0 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a8154540 0x7ff2a80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2a8154540 0x7ff2a80aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43450/0 (socket says 172.21.15.52:43450) 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 -- 172.21.15.52:0/2354282667 learned_addr learned my addr 172.21.15.52:0/2354282667 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2aed09700 1 --2- 172.21.15.52:0/2354282667 >> v2:172.21.15.172:3300/0 conn(0x7ff2a80c5ca0 0x7ff2a80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 -- 172.21.15.52:0/2354282667 >> v2:172.21.15.172:3300/0 conn(0x7ff2a80c5ca0 msgr2=0x7ff2a80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 --2- 172.21.15.52:0/2354282667 >> v2:172.21.15.172:3300/0 conn(0x7ff2a80c5ca0 0x7ff2a80c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 -- 172.21.15.52:0/2354282667 >> v1:172.21.15.172:6789/0 conn(0x7ff2a8154160 legacy=0x7ff2a80a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 -- 172.21.15.52:0/2354282667 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a80bfc90 con 0x7ff2a8154540 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2add07700 1 --2- 172.21.15.52:0/2354282667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80aad00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7ff2a80c0810 tx=0x7ff29c0090f0).ready entity=mon.0 client_cookie=43a15c1c9ec881b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2ad506700 1 -- 172.21.15.52:0/2354282667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00b5a0 con 0x7ff2a8154540 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2ad506700 1 -- 172.21.15.52:0/2354282667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00b700 con 0x7ff2a8154540 2023-05-10T01:45:54.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.140+0000 7ff2ad506700 1 -- 172.21.15.52:0/2354282667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00ba80 con 0x7ff2a8154540 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 -- 172.21.15.52:0/2354282667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 msgr2=0x7ff2a80aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 --2- 172.21.15.52:0/2354282667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80aad00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7ff2a80c0810 tx=0x7ff29c0090f0).stop 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 -- 172.21.15.52:0/2354282667 shutdown_connections 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 --2- 172.21.15.52:0/2354282667 >> v2:172.21.15.172:3300/0 conn(0x7ff2a80c5ca0 0x7ff2a80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 --2- 172.21.15.52:0/2354282667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80aad00 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 -- 172.21.15.52:0/2354282667 >> 172.21.15.52:0/2354282667 conn(0x7ff2a80cb6c0 msgr2=0x7ff2a80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 -- 172.21.15.52:0/2354282667 shutdown_connections 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.141+0000 7ff2b076c700 1 -- 172.21.15.52:0/2354282667 wait complete. 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.142+0000 7ff2b076c700 1 Processor -- start 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.142+0000 7ff2b076c700 1 -- start start 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a80c5ca0 0x7ff2a80b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a8154160 0x7ff2a8149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8158f80 con 0x7ff2a8154540 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b0d70 con 0x7ff2a80c5ca0 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2b076c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8157ee0 con 0x7ff2a8154160 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43456/0 (socket says 172.21.15.52:43456) 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 -- 172.21.15.52:0/3490748578 learned_addr learned my addr 172.21.15.52:0/3490748578 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2ae508700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a80c5ca0 0x7ff2a80b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2add07700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a8154160 0x7ff2a8149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 -- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a8154160 msgr2=0x7ff2a8149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a8154160 0x7ff2a8149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 -- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a80c5ca0 msgr2=0x7ff2a80b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a80c5ca0 0x7ff2a80b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 -- 172.21.15.52:0/3490748578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009370 con 0x7ff2a8154540 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2aed09700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7ff298009fa0 tx=0x7ff298009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.143+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800ebc0 con 0x7ff2a8154540 2023-05-10T01:45:54.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.144+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29800ed20 con 0x7ff2a8154540 2023-05-10T01:45:54.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.144+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a81581c0 con 0x7ff2a8154540 2023-05-10T01:45:54.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.144+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298014610 con 0x7ff2a8154540 2023-05-10T01:45:54.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.144+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a8158780 con 0x7ff2a8154540 2023-05-10T01:45:54.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.145+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a80666b0 con 0x7ff2a8154540 2023-05-10T01:45:54.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.145+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff29801b030 con 0x7ff2a8154540 2023-05-10T01:45:54.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.145+0000 7ff2a67fc700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 0x7ff288061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.145+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7ff298079df0 con 0x7ff2a8154540 2023-05-10T01:45:54.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.146+0000 7ff2ae508700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 0x7ff288061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.146+0000 7ff2ae508700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 0x7ff288061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff2a00038b0 tx=0x7ff2a0007d20).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.149+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff29804b380 con 0x7ff2a8154540 2023-05-10T01:45:54.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.323+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2a80afe60 con 0x7ff28805ed60 2023-05-10T01:45:54.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.324+0000 7ff2a67fc700 1 -- 172.21.15.52:0/3490748578 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2a80afe60 con 0x7ff28805ed60 2023-05-10T01:45:54.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.325+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 msgr2=0x7ff288061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.325+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 0x7ff288061220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff2a00038b0 tx=0x7ff2a0007d20).stop 2023-05-10T01:45:54.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 msgr2=0x7ff2a80adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7ff298009fa0 tx=0x7ff298009900).stop 2023-05-10T01:45:54.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 shutdown_connections 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff28805ed60 0x7ff288061220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a8154540 0x7ff2a80adc40 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a80c5ca0 0x7ff2a80b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 --2- 172.21.15.52:0/3490748578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a8154160 0x7ff2a8149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 >> 172.21.15.52:0/3490748578 conn(0x7ff2a80cb6c0 msgr2=0x7ff2a80ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 shutdown_connections 2023-05-10T01:45:54.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.326+0000 7ff2b076c700 1 -- 172.21.15.52:0/3490748578 wait complete. 2023-05-10T01:45:54.331 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2023-05-10T01:45:54.341 INFO:tasks.ceph:Scrubbing osd.2 2023-05-10T01:45:54.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.458+0000 7fe38efbe700 1 Processor -- start 2023-05-10T01:45:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.459+0000 7fe38efbe700 1 -- start start 2023-05-10T01:45:54.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.459+0000 7fe38efbe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe3880c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38efbe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3880c61e0 0x7fe388154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38efbe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3880c6650 con 0x7fe388153f80 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38efbe700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe388069f50 con 0x7fe3880c61e0 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38efbe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38806a9d0 con 0x7fe3880c1150 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38dfbc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe388153f80 0x7fe3880a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52476/0 (socket says 172.21.15.52:52476) 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38dfbc700 1 -- 172.21.15.52:0/2721017846 learned_addr learned my addr 172.21.15.52:0/2721017846 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2721017846 >> v2:172.21.15.172:3300/0 conn(0x7fe3880c61e0 0x7fe388154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38d7bb700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe3880c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331067033 0 0) 0x7fe3880c6650 con 0x7fe388153f80 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3740033f0 con 0x7fe388153f80 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 msgr2=0x7fe3880c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe3880c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457512582 0 0) 0x7fe3740033f0 con 0x7fe388153f80 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2721017846 >> v1:172.21.15.52:6789/0 conn(0x7fe388153f80 legacy=0x7fe3880a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2721017846 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38806a130 con 0x7fe3880c61e0 2023-05-10T01:45:54.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe388154360 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fe378009760 tx=0x7fe378009060).ready entity=mon.1 client_cookie=58fdc40294a9521a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.460+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3800017f0 con 0x7fe3880c61e0 2023-05-10T01:45:54.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378011400 con 0x7fe3880c61e0 2023-05-10T01:45:54.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38cfba700 1 -- 172.21.15.52:0/2721017846 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378011780 con 0x7fe3880c61e0 2023-05-10T01:45:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 -- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 msgr2=0x7fe388154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe388154360 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fe378009760 tx=0x7fe378009060).stop 2023-05-10T01:45:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 -- 172.21.15.52:0/2721017846 shutdown_connections 2023-05-10T01:45:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe388154360 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2721017846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe3880c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 -- 172.21.15.52:0/2721017846 >> 172.21.15.52:0/2721017846 conn(0x7fe3880cb5f0 msgr2=0x7fe3880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 -- 172.21.15.52:0/2721017846 shutdown_connections 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.461+0000 7fe38efbe700 1 -- 172.21.15.52:0/2721017846 wait complete. 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.462+0000 7fe38efbe700 1 Processor -- start 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.462+0000 7fe38efbe700 1 -- start start 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe38814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe3880b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 0x7fe388163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880b0180 con 0x7fe388153f80 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880afb70 con 0x7fe3880c61e0 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38efbe700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe388164a70 con 0x7fe3880c1150 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 0x7fe388163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 0x7fe388163f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43468/0 (socket says 172.21.15.52:43468) 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2486789153 learned_addr learned my addr 172.21.15.52:0/2486789153 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38dfbc700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe38814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38d7bb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe3880b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 msgr2=0x7fe38814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3880c1150 0x7fe38814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 msgr2=0x7fe3880b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe3880b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780092a0 con 0x7fe388153f80 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38d7bb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3880c61e0 0x7fe3880b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.463+0000 7fe38e7bd700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 0x7fe388163f20 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fe378009d50 tx=0x7fe378016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.464+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378023e10 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.464+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378010710 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.464+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe388164d50 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.464+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378010a90 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.464+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38814eac0 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.465+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe388083110 con 0x7fe388153f80 2023-05-10T01:45:54.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.465+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe378033070 con 0x7fe388153f80 2023-05-10T01:45:54.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.465+0000 7fe385ffb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe36805ed90 0x7fe368061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fe3780838a0 con 0x7fe388153f80 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe385ffb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7fe368065900 0x7fe368067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe368068350 con 0x7fe368065900 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe378088220 con 0x7fe388153f80 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe38dfbc700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe36805ed90 0x7fe368061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe38d7bb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7fe368065900 0x7fe368067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe38dfbc700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe36805ed90 0x7fe368061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe380001560 tx=0x7fe380001e20).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.466+0000 7fe38d7bb700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7fe368065900 0x7fe368067d70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.467+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== osd.2 v2:172.21.15.52:6800/116667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe368068350 con 0x7fe368065900 2023-05-10T01:45:54.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.480+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 --> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe388066760 con 0x7fe368065900 2023-05-10T01:45:54.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.480+0000 7fe385ffb700 1 -- 172.21.15.52:0/2486789153 <== osd.2 v2:172.21.15.52:6800/116667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe37c009b70 con 0x7fe368065900 2023-05-10T01:45:54.483 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:54.484 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7fe368065900 msgr2=0x7fe368067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:6800/116667,v1:172.21.15.52:6801/116667] conn(0x7fe368065900 0x7fe368067d70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe36805ed90 msgr2=0x7fe368061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fe36805ed90 0x7fe368061250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe380001560 tx=0x7fe380001e20).stop 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 msgr2=0x7fe388163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 --2- 172.21.15.52:0/2486789153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe388153f80 0x7fe388163f20 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fe378009d50 tx=0x7fe378016000).stop 2023-05-10T01:45:54.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38e7bd700 1 -- 172.21.15.52:0/2486789153 reap_dead start 2023-05-10T01:45:54.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 shutdown_connections 2023-05-10T01:45:54.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 >> 172.21.15.52:0/2486789153 conn(0x7fe3880cb5f0 msgr2=0x7fe3880acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 shutdown_connections 2023-05-10T01:45:54.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.481+0000 7fe38efbe700 1 -- 172.21.15.52:0/2486789153 wait complete. 2023-05-10T01:45:54.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-05-10T01:45:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.609+0000 7f4dc62e3700 1 Processor -- start 2023-05-10T01:45:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.609+0000 7f4dc62e3700 1 -- start start 2023-05-10T01:45:54.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.609+0000 7f4dc62e3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4dc0154160 0x7f4dc00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dc62e3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00c0650 con 0x7f4dc0154540 2023-05-10T01:45:54.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dc62e3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00bfd20 con 0x7f4dc0069da0 2023-05-10T01:45:54.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dc62e3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc00c0000 con 0x7f4dc0154160 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbf7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4dc0154540 0x7f4dc0069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52494/0 (socket says 172.21.15.52:52494) 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/1011023070 learned_addr learned my addr 172.21.15.52:0/1011023070 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbffff700 1 --2- 172.21.15.52:0/1011023070 >> v2:172.21.15.172:3300/0 conn(0x7f4dc0154160 0x7f4dc00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896905459 0 0) 0x7f4dc00c0650 con 0x7f4dc0154540 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da00033f0 con 0x7f4dc0154540 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1038496674 0 0) 0x7f4da00033f0 con 0x7f4dc0154540 2023-05-10T01:45:54.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 >> v2:172.21.15.172:3300/0 conn(0x7f4dc0154160 msgr2=0x7f4dc00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 --2- 172.21.15.52:0/1011023070 >> v2:172.21.15.172:3300/0 conn(0x7f4dc0154160 0x7f4dc00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 >> v1:172.21.15.172:6789/0 conn(0x7f4dc0069da0 legacy=0x7f4dc00c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00c02e0 con 0x7f4dc0154540 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7f4db0001470 con 0x7f4dc0154540 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 >> v1:172.21.15.52:6789/0 conn(0x7f4dc0154540 legacy=0x7f4dc0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da00038e0 0x7f4da0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 0x7f4da0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da0005050 0x7f4da000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00c0000 con 0x7f4da0004690 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000bfe0 con 0x7f4da00038e0 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000c1a0 con 0x7f4da0005050 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.610+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 0x7f4da0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbffff700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da00038e0 0x7f4da0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dc4880700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da0005050 0x7f4da000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da0005050 msgr2=0x7f4da000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da0005050 0x7f4da000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da00038e0 msgr2=0x7f4da0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da00038e0 0x7f4da0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/1011023070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00033f0 con 0x7f4da0004690 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dc4880700 1 -- 172.21.15.52:0/1011023070 reap_dead start 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 0x7f4da0004b10 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f4dc0154920 tx=0x7f4db0001e50).ready entity=mon.0 client_cookie=fdc07882d75173b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0007a20 con 0x7f4da0004690 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000ca60 con 0x7f4da0004690 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dbeffd700 1 -- 172.21.15.52:0/1011023070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000ce00 con 0x7f4da0004690 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dc62e3700 1 -- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 msgr2=0x7f4da0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.611+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 0x7f4da0004b10 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f4dc0154920 tx=0x7f4db0001e50).stop 2023-05-10T01:45:54.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.612+0000 7f4dc62e3700 1 -- 172.21.15.52:0/1011023070 shutdown_connections 2023-05-10T01:45:54.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.612+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/1011023070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da0004690 0x7f4da0004b10 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.612+0000 7f4dc62e3700 1 -- 172.21.15.52:0/1011023070 >> 172.21.15.52:0/1011023070 conn(0x7f4dc00cb6f0 msgr2=0x7f4dc00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.612+0000 7f4dc62e3700 1 -- 172.21.15.52:0/1011023070 shutdown_connections 2023-05-10T01:45:54.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.612+0000 7f4dc62e3700 1 -- 172.21.15.52:0/1011023070 wait complete. 2023-05-10T01:45:54.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.613+0000 7f4dc62e3700 1 Processor -- start 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.613+0000 7f4dc62e3700 1 -- start start 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.613+0000 7f4dc62e3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da0004690 0x7f4dc0158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc014d250 0x7f4dc00c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0157270 con 0x7f4dc0155560 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc01550d0 con 0x7f4da0004690 2023-05-10T01:45:54.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0156f90 con 0x7f4dc014d250 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43490/0 (socket says 172.21.15.52:43490) 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/4242326292 learned_addr learned my addr 172.21.15.52:0/4242326292 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbffff700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da0004690 0x7f4dc0158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc4880700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc014d250 0x7f4dc00c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc014d250 msgr2=0x7f4dc00c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc014d250 0x7f4dc00c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da0004690 msgr2=0x7f4dc0158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da0004690 0x7f4dc0158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 -- 172.21.15.52:0/4242326292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0154a80 con 0x7f4dc0155560 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dbf7fe700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f4db000d010 tx=0x7f4db0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0001470 con 0x7f4dc0155560 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db00074f0 con 0x7f4dc0155560 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc0154d60 con 0x7f4dc0155560 2023-05-10T01:45:54.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0004900 con 0x7f4dc0155560 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.614+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc01559e0 con 0x7f4dc0155560 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.615+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00666b0 con 0x7f4dc0155560 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.616+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4db0010070 con 0x7f4dc0155560 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.616+0000 7f4db7fff700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 0x7f4da4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.616+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f4db007a6f0 con 0x7f4dc0155560 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.616+0000 7f4dbffff700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 0x7f4da4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.617+0000 7f4dbffff700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 0x7f4da4061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4da8006d80 tx=0x7f4da8009060).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.620+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4db004bce0 con 0x7f4dc0155560 2023-05-10T01:45:54.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.794+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc006c340 con 0x7f4da405ed60 2023-05-10T01:45:54.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.794+0000 7f4db7fff700 1 -- 172.21.15.52:0/4242326292 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4dc006c340 con 0x7f4da405ed60 2023-05-10T01:45:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 msgr2=0x7f4da4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 0x7f4da4061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4da8006d80 tx=0x7f4da8009060).stop 2023-05-10T01:45:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 msgr2=0x7f4dc0156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f4db000d010 tx=0x7f4db0015000).stop 2023-05-10T01:45:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 shutdown_connections 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f4da405ed60 0x7f4da4061220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc014d250 0x7f4dc00c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da0004690 0x7f4dc0158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 --2- 172.21.15.52:0/4242326292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc0155560 0x7f4dc0156760 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 >> 172.21.15.52:0/4242326292 conn(0x7f4dc00cb6f0 msgr2=0x7f4dc00aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 shutdown_connections 2023-05-10T01:45:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.796+0000 7f4dc62e3700 1 -- 172.21.15.52:0/4242326292 wait complete. 2023-05-10T01:45:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2023-05-10T01:45:54.811 INFO:tasks.ceph:Scrubbing osd.3 2023-05-10T01:45:54.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.928+0000 7fcc390c7700 1 Processor -- start 2023-05-10T01:45:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.928+0000 7fcc390c7700 1 -- start start 2023-05-10T01:45:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc390c7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 0x7fcc340aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc390c7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 0x7fcc34068570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc390c7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc340c94c0 con 0x7fcc34154460 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc390c7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc340cb7d0 con 0x7fcc34068150 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc390c7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34068a60 con 0x7fcc34154080 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc3359e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 0x7fcc34068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 0x7fcc340aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc3259c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcc34154460 0x7fcc340a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:55052/0 (socket says 172.21.15.52:55052) 2023-05-10T01:45:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc3259c700 1 -- 172.21.15.52:0/1508079188 learned_addr learned my addr 172.21.15.52:0/1508079188 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:54.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 -- 172.21.15.52:0/1508079188 >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 msgr2=0x7fcc34068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:54.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 --2- 172.21.15.52:0/1508079188 >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 0x7fcc34068570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 -- 172.21.15.52:0/1508079188 >> v1:172.21.15.172:6789/0 conn(0x7fcc34154460 legacy=0x7fcc340a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 -- 172.21.15.52:0/1508079188 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340c88b0 con 0x7fcc34154080 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc3359e700 1 --2- 172.21.15.52:0/1508079188 >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 0x7fcc34068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.929+0000 7fcc32d9d700 1 --2- 172.21.15.52:0/1508079188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 0x7fcc340aac90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fcc24009760 tx=0x7fcc24009060).ready entity=mon.2 client_cookie=dd51c4eb516ae215 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc31d9b700 1 -- 172.21.15.52:0/1508079188 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400f510 con 0x7fcc34154080 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc31d9b700 1 -- 172.21.15.52:0/1508079188 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2400f670 con 0x7fcc34154080 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc31d9b700 1 -- 172.21.15.52:0/1508079188 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400f9f0 con 0x7fcc34154080 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 -- 172.21.15.52:0/1508079188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 msgr2=0x7fcc340aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 --2- 172.21.15.52:0/1508079188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 0x7fcc340aac90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fcc24009760 tx=0x7fcc24009060).stop 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 -- 172.21.15.52:0/1508079188 shutdown_connections 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 --2- 172.21.15.52:0/1508079188 >> v2:172.21.15.172:3300/0 conn(0x7fcc34068150 0x7fcc34068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 --2- 172.21.15.52:0/1508079188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34154080 0x7fcc340aac90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 -- 172.21.15.52:0/1508079188 >> 172.21.15.52:0/1508079188 conn(0x7fcc34067910 msgr2=0x7fcc340cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 -- 172.21.15.52:0/1508079188 shutdown_connections 2023-05-10T01:45:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.930+0000 7fcc390c7700 1 -- 172.21.15.52:0/1508079188 wait complete. 2023-05-10T01:45:54.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.931+0000 7fcc390c7700 1 Processor -- start 2023-05-10T01:45:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.931+0000 7fcc390c7700 1 -- start start 2023-05-10T01:45:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34068150 0x7fcc3414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc34154080 0x7fcc34152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 0x7fcc34152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34151f50 con 0x7fcc34154460 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3414f9a0 con 0x7fcc34154080 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc390c7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34153450 con 0x7fcc34068150 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 0x7fcc34152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 0x7fcc34152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43506/0 (socket says 172.21.15.52:43506) 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc3359e700 1 -- 172.21.15.52:0/2551878153 learned_addr learned my addr 172.21.15.52:0/2551878153 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc3259c700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc34154080 0x7fcc34152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.932+0000 7fcc32d9d700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34068150 0x7fcc3414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 -- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34068150 msgr2=0x7fcc3414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc34068150 0x7fcc3414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 -- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc34154080 msgr2=0x7fcc34152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc34154080 0x7fcc34152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c009a20 con 0x7fcc34154460 2023-05-10T01:45:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc3359e700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 0x7fcc34152f60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fcc2c009fc0 tx=0x7fcc2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00cd30 con 0x7fcc34154460 2023-05-10T01:45:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c00f040 con 0x7fcc34154460 2023-05-10T01:45:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc240092a0 con 0x7fcc34154460 2023-05-10T01:45:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c013610 con 0x7fcc34154460 2023-05-10T01:45:54.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.933+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc340af390 con 0x7fcc34154460 2023-05-10T01:45:54.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.934+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc34066720 con 0x7fcc34154460 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.934+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcc2c0139c0 con 0x7fcc34154460 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc1affd700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcc1405ed90 0x7fcc14061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fcc2c07b0d0 con 0x7fcc34154460 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc1affd700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7fcc14065900 0x7fcc14067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc14068350 con 0x7fcc14065900 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc2c07b4d0 con 0x7fcc34154460 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc32d9d700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcc1405ed90 0x7fcc14061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc3259c700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7fcc14065900 0x7fcc14067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:54.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc3259c700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7fcc14065900 0x7fcc14067d70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.935+0000 7fcc32d9d700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcc1405ed90 0x7fcc14061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcc24009fd0 tx=0x7fcc24017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:54.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.936+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== osd.3 v2:172.21.15.52:6808/116668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fcc14068350 con 0x7fcc14065900 2023-05-10T01:45:54.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.949+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 --> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc340af520 con 0x7fcc14065900 2023-05-10T01:45:54.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.949+0000 7fcc1affd700 1 -- 172.21.15.52:0/2551878153 <== osd.3 v2:172.21.15.52:6808/116668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcc340af520 con 0x7fcc14065900 2023-05-10T01:45:54.953 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:54.953 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:54.953 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.949+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7fcc14065900 msgr2=0x7fcc14067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.949+0000 7fcc390c7700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:6808/116668,v1:172.21.15.52:6809/116668] conn(0x7fcc14065900 0x7fcc14067d70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcc1405ed90 msgr2=0x7fcc14061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fcc1405ed90 0x7fcc14061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcc24009fd0 tx=0x7fcc24017000).stop 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 msgr2=0x7fcc34152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:54.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 --2- 172.21.15.52:0/2551878153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc34154460 0x7fcc34152f60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fcc2c009fc0 tx=0x7fcc2c00b040).stop 2023-05-10T01:45:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc3359e700 1 -- 172.21.15.52:0/2551878153 reap_dead start 2023-05-10T01:45:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 shutdown_connections 2023-05-10T01:45:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 >> 172.21.15.52:0/2551878153 conn(0x7fcc34067910 msgr2=0x7fcc340ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 shutdown_connections 2023-05-10T01:45:54.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:54.950+0000 7fcc390c7700 1 -- 172.21.15.52:0/2551878153 wait complete. 2023-05-10T01:45:54.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-05-10T01:45:55.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.079+0000 7fd3c81b3700 1 Processor -- start 2023-05-10T01:45:55.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.080+0000 7fd3c81b3700 1 -- start start 2023-05-10T01:45:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.080+0000 7fd3c81b3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3c0069da0 0x7fd3c015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.080+0000 7fd3c81b3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00c0650 con 0x7fd3c0154540 2023-05-10T01:45:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.080+0000 7fd3c81b3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00c1af0 con 0x7fd3c0154160 2023-05-10T01:45:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.080+0000 7fd3c81b3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00bfd20 con 0x7fd3c0069da0 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c6750700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3c0069da0 0x7fd3c015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c574e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd3c0154540 0x7fd3c0069690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52530/0 (socket says 172.21.15.52:52530) 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c574e700 1 -- 172.21.15.52:0/2240352672 learned_addr learned my addr 172.21.15.52:0/2240352672 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c6750700 1 -- 172.21.15.52:0/2240352672 >> v1:172.21.15.172:6789/0 conn(0x7fd3c0154160 legacy=0x7fd3c00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c6750700 1 -- 172.21.15.52:0/2240352672 >> v1:172.21.15.52:6789/0 conn(0x7fd3c0154540 legacy=0x7fd3c0069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c4f4d700 1 -- 172.21.15.52:0/2240352672 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778376519 0 0) 0x7fd3c00c0650 con 0x7fd3c0154540 2023-05-10T01:45:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c6750700 1 -- 172.21.15.52:0/2240352672 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00c0000 con 0x7fd3c0069da0 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c6750700 1 --2- 172.21.15.52:0/2240352672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0069da0 0x7fd3c015f1f0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7fd3b0009760 tx=0x7fd3b0009060).ready entity=mon.0 client_cookie=6676b38b5c31b886 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c4f4d700 1 -- 172.21.15.52:0/2240352672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0009120 con 0x7fd3c0069da0 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c4f4d700 1 -- 172.21.15.52:0/2240352672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000b580 con 0x7fd3c0069da0 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.081+0000 7fd3c4f4d700 1 -- 172.21.15.52:0/2240352672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000b900 con 0x7fd3c0069da0 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 -- 172.21.15.52:0/2240352672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0069da0 msgr2=0x7fd3c015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/2240352672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0069da0 0x7fd3c015f1f0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7fd3b0009760 tx=0x7fd3b0009060).stop 2023-05-10T01:45:55.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 -- 172.21.15.52:0/2240352672 shutdown_connections 2023-05-10T01:45:55.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/2240352672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0069da0 0x7fd3c015f1f0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 -- 172.21.15.52:0/2240352672 >> 172.21.15.52:0/2240352672 conn(0x7fd3c00cb6f0 msgr2=0x7fd3c00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 -- 172.21.15.52:0/2240352672 shutdown_connections 2023-05-10T01:45:55.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.082+0000 7fd3c81b3700 1 -- 172.21.15.52:0/2240352672 wait complete. 2023-05-10T01:45:55.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.083+0000 7fd3c81b3700 1 Processor -- start 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.083+0000 7fd3c81b3700 1 -- start start 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 0x7fd3c01683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 0x7fd3c014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0152180 con 0x7fd3c0154160 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00aea00 con 0x7fd3c0154540 2023-05-10T01:45:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01688a0 con 0x7fd3c0069da0 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43520/0 (socket says 172.21.15.52:43520) 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 -- 172.21.15.52:0/1208473467 learned_addr learned my addr 172.21.15.52:0/1208473467 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c6750700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 0x7fd3c014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c5f4f700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 0x7fd3c01683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 -- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 msgr2=0x7fd3c01683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 0x7fd3c01683b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 -- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 msgr2=0x7fd3c014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 0x7fd3c014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 -- 172.21.15.52:0/1208473467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00092a0 con 0x7fd3c0154160 2023-05-10T01:45:55.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c6750700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 0x7fd3c014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:55.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c5f4f700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 0x7fd3c01683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:55.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c574e700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fd3b400c460 tx=0x7fd3b4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40072e0 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4007440 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c01524a0 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.084+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40057a0 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.085+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c0152a60 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.086+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c00666b0 con 0x7fd3c0154160 2023-05-10T01:45:55.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.086+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd3b4010070 con 0x7fd3c0154160 2023-05-10T01:45:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.086+0000 7fd3bdffb700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 0x7fd3a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.086+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fd3b4079120 con 0x7fd3c0154160 2023-05-10T01:45:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.086+0000 7fd3c5f4f700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 0x7fd3a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.087+0000 7fd3c5f4f700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 0x7fd3a0061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd3b8007fd0 tx=0x7fd3b8009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.090+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3b404a710 con 0x7fd3c0154160 2023-05-10T01:45:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.263+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c00aeb70 con 0x7fd3a005ed90 2023-05-10T01:45:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.263+0000 7fd3bdffb700 1 -- 172.21.15.52:0/1208473467 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3c00aeb70 con 0x7fd3a005ed90 2023-05-10T01:45:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 msgr2=0x7fd3a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 0x7fd3a0061250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd3b8007fd0 tx=0x7fd3b8009040).stop 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 msgr2=0x7fd3c0144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fd3b400c460 tx=0x7fd3b4007e10).stop 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 shutdown_connections 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd3a005ed90 0x7fd3a0061250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c0154540 0x7fd3c014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c0069da0 0x7fd3c01683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 --2- 172.21.15.52:0/1208473467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c0154160 0x7fd3c0144080 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.265+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 >> 172.21.15.52:0/1208473467 conn(0x7fd3c00cb6f0 msgr2=0x7fd3c00ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.266+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 shutdown_connections 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.266+0000 7fd3c81b3700 1 -- 172.21.15.52:0/1208473467 wait complete. 2023-05-10T01:45:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2023-05-10T01:45:55.280 INFO:tasks.ceph:Scrubbing osd.4 2023-05-10T01:45:55.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.397+0000 7fa27e488700 1 Processor -- start 2023-05-10T01:45:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.397+0000 7fa27e488700 1 -- start start 2023-05-10T01:45:55.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa278153cf0 0x7fa278063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2781540d0 0x7fa2780bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2780622a0 0x7fa2780626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa278067f50 con 0x7fa2781540d0 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780a7c80 con 0x7fa278153cf0 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27e488700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa278062bd0 con 0x7fa2780622a0 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2781540d0 0x7fa2780bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2781540d0 0x7fa2780bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43528/0 (socket says 172.21.15.52:43528) 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 -- 172.21.15.52:0/3166947592 learned_addr learned my addr 172.21.15.52:0/3166947592 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa27ca25700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2780622a0 0x7fa2780626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa277fff700 1 --2- 172.21.15.52:0/3166947592 >> v2:172.21.15.172:3300/0 conn(0x7fa278153cf0 0x7fa278063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 -- 172.21.15.52:0/3166947592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2780622a0 msgr2=0x7fa2780626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2780622a0 0x7fa2780626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 -- 172.21.15.52:0/3166947592 >> v2:172.21.15.172:3300/0 conn(0x7fa278153cf0 msgr2=0x7fa278063fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 --2- 172.21.15.52:0/3166947592 >> v2:172.21.15.172:3300/0 conn(0x7fa278153cf0 0x7fa278063fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 -- 172.21.15.52:0/3166947592 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780a7ef0 con 0x7fa2781540d0 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa2777fe700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2781540d0 0x7fa2780bf230 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fa27805ec80 tx=0x7fa2680090f0).ready entity=mon.0 client_cookie=3c9563c5f53deaad server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.398+0000 7fa276ffd700 1 -- 172.21.15.52:0/3166947592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800b600 con 0x7fa2781540d0 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa276ffd700 1 -- 172.21.15.52:0/3166947592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800b760 con 0x7fa2781540d0 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa276ffd700 1 -- 172.21.15.52:0/3166947592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800bae0 con 0x7fa2781540d0 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 -- 172.21.15.52:0/3166947592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2781540d0 msgr2=0x7fa2780bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2781540d0 0x7fa2780bf230 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fa27805ec80 tx=0x7fa2680090f0).stop 2023-05-10T01:45:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 -- 172.21.15.52:0/3166947592 shutdown_connections 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2780622a0 0x7fa2780626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 --2- 172.21.15.52:0/3166947592 >> v2:172.21.15.172:3300/0 conn(0x7fa278153cf0 0x7fa278063fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 --2- 172.21.15.52:0/3166947592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2781540d0 0x7fa2780bf230 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 -- 172.21.15.52:0/3166947592 >> 172.21.15.52:0/3166947592 conn(0x7fa27805e810 msgr2=0x7fa2780c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 -- 172.21.15.52:0/3166947592 shutdown_connections 2023-05-10T01:45:55.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.399+0000 7fa27e488700 1 -- 172.21.15.52:0/3166947592 wait complete. 2023-05-10T01:45:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.400+0000 7fa27e488700 1 Processor -- start 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.400+0000 7fa27e488700 1 -- start start 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 0x7fa27814c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa278153cf0 0x7fa2780c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2781540d0 0x7fa2780c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780c4d00 con 0x7fa2780622a0 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a8540 con 0x7fa278153cf0 2023-05-10T01:45:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa27e488700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a87e0 con 0x7fa2781540d0 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 0x7fa27814c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 0x7fa27814c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43532/0 (socket says 172.21.15.52:43532) 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 -- 172.21.15.52:0/44366837 learned_addr learned my addr 172.21.15.52:0/44366837 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 -- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2781540d0 msgr2=0x7fa2780c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa2781540d0 0x7fa2780c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 -- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa278153cf0 msgr2=0x7fa2780c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa278153cf0 0x7fa2780c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.401+0000 7fa277fff700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268009370 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa277fff700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 0x7fa27814c750 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fa26000d890 tx=0x7fa260008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2600125f0 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260012750 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780a8ac0 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260012ad0 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780a8e50 con 0x7fa2780622a0 2023-05-10T01:45:55.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.402+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa27806c340 con 0x7fa2780622a0 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.403+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa260013480 con 0x7fa2780622a0 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.403+0000 7fa26ffff700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa25c05ed90 0x7fa25c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.403+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fa2600799c0 con 0x7fa2780622a0 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa26ffff700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7fa25c065900 0x7fa25c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa25c068350 con 0x7fa25c065900 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa26007e220 con 0x7fa2780622a0 2023-05-10T01:45:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa2777fe700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa25c05ed90 0x7fa25c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa27ca25700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7fa25c065900 0x7fa25c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa2777fe700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa25c05ed90 0x7fa25c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa268009fd0 tx=0x7fa268017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.404+0000 7fa27ca25700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7fa25c065900 0x7fa25c067d70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.405+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== osd.4 v2:172.21.15.172:6818/116794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa25c068350 con 0x7fa25c065900 2023-05-10T01:45:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.418+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 --> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2780a81d0 con 0x7fa25c065900 2023-05-10T01:45:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa26ffff700 1 -- 172.21.15.52:0/44366837 <== osd.4 v2:172.21.15.172:6818/116794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa2780a81d0 con 0x7fa25c065900 2023-05-10T01:45:55.422 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:55.422 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:55.422 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7fa25c065900 msgr2=0x7fa25c067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6818/116794,v1:172.21.15.172:6820/116794] conn(0x7fa25c065900 0x7fa25c067d70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa25c05ed90 msgr2=0x7fa25c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fa25c05ed90 0x7fa25c061250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa268009fd0 tx=0x7fa268017000).stop 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 msgr2=0x7fa27814c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 --2- 172.21.15.52:0/44366837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2780622a0 0x7fa27814c750 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fa26000d890 tx=0x7fa260008040).stop 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27ca25700 1 -- 172.21.15.52:0/44366837 reap_dead start 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 shutdown_connections 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 >> 172.21.15.52:0/44366837 conn(0x7fa27805e810 msgr2=0x7fa2780c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 shutdown_connections 2023-05-10T01:45:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.419+0000 7fa27e488700 1 -- 172.21.15.52:0/44366837 wait complete. 2023-05-10T01:45:55.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-05-10T01:45:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.547+0000 7ff5ec97a700 1 Processor -- start 2023-05-10T01:45:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.547+0000 7ff5ec97a700 1 -- start start 2023-05-10T01:45:55.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.548+0000 7ff5ec97a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 0x7ff5e8069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.548+0000 7ff5ec97a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8062b00 con 0x7ff5e8063e20 2023-05-10T01:45:55.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.548+0000 7ff5ec97a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8068330 con 0x7ff5e8154170 2023-05-10T01:45:55.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.548+0000 7ff5ec97a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8068610 con 0x7ff5e8153d90 2023-05-10T01:45:55.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e6d9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff5e8063e20 0x7ff5e80bd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52562/0 (socket says 172.21.15.52:52562) 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e6d9d700 1 -- 172.21.15.52:0/369472103 learned_addr learned my addr 172.21.15.52:0/369472103 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e659c700 1 --2- 172.21.15.52:0/369472103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 0x7ff5e8069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728040364 0 0) 0x7ff5e8062b00 con 0x7ff5e8063e20 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5cc0033f0 con 0x7ff5e8063e20 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309032262 0 0) 0x7ff5e8068330 con 0x7ff5e8154170 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8062b00 con 0x7ff5e8154170 2023-05-10T01:45:55.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e659c700 1 -- 172.21.15.52:0/369472103 >> v1:172.21.15.172:6789/0 conn(0x7ff5e8154170 legacy=0x7ff5e8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e659c700 1 -- 172.21.15.52:0/369472103 >> v1:172.21.15.52:6789/0 conn(0x7ff5e8063e20 legacy=0x7ff5e80bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e659c700 1 -- 172.21.15.52:0/369472103 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80624b0 con 0x7ff5e8153d90 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e659c700 1 --2- 172.21.15.52:0/369472103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 0x7ff5e8069a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff5e0009790 tx=0x7ff5e0009060).ready entity=mon.2 client_cookie=ed01f75804274caf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000f510 con 0x7ff5e8153d90 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e000f670 con 0x7ff5e8153d90 2023-05-10T01:45:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.549+0000 7ff5e559a700 1 -- 172.21.15.52:0/369472103 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000f9f0 con 0x7ff5e8153d90 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 -- 172.21.15.52:0/369472103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 msgr2=0x7ff5e8069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/369472103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 0x7ff5e8069a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff5e0009790 tx=0x7ff5e0009060).stop 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 -- 172.21.15.52:0/369472103 shutdown_connections 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/369472103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8153d90 0x7ff5e8069a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 -- 172.21.15.52:0/369472103 >> 172.21.15.52:0/369472103 conn(0x7ff5e80c8a90 msgr2=0x7ff5e80c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 -- 172.21.15.52:0/369472103 shutdown_connections 2023-05-10T01:45:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.550+0000 7ff5ec97a700 1 -- 172.21.15.52:0/369472103 wait complete. 2023-05-10T01:45:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.551+0000 7ff5ec97a700 1 Processor -- start 2023-05-10T01:45:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.551+0000 7ff5ec97a700 1 -- start start 2023-05-10T01:45:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8063e20 0x7ff5e80a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e8153d90 0x7ff5e81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e81679e0 con 0x7ff5e8154170 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8167cc0 con 0x7ff5e8153d90 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5ec97a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8167fa0 con 0x7ff5e8063e20 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43550/0 (socket says 172.21.15.52:43550) 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 -- 172.21.15.52:0/204680266 learned_addr learned my addr 172.21.15.52:0/204680266 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e659c700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8063e20 0x7ff5e80a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e5d9b700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e8153d90 0x7ff5e81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 -- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8063e20 msgr2=0x7ff5e80a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8063e20 0x7ff5e80a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 -- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e8153d90 msgr2=0x7ff5e81508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e8153d90 0x7ff5e81508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 -- 172.21.15.52:0/204680266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00092a0 con 0x7ff5e8154170 2023-05-10T01:45:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.552+0000 7ff5e6d9d700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7ff5d8001560 tx=0x7ff5d8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.553+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8005d30 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.553+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8005e90 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.553+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e8168280 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.553+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8007300 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.553+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e80a4e40 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.554+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e806c340 con 0x7ff5e8154170 2023-05-10T01:45:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.554+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff5d8010070 con 0x7ff5e8154170 2023-05-10T01:45:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.554+0000 7ff5d67fc700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 0x7ff5c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.554+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7ff5d80792b0 con 0x7ff5e8154170 2023-05-10T01:45:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.555+0000 7ff5e659c700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 0x7ff5c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.555+0000 7ff5e659c700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 0x7ff5c4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff5e0009fd0 tx=0x7ff5e0017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.558+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5d804a8a0 con 0x7ff5e8154170 2023-05-10T01:45:55.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.731+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5e80bf590 con 0x7ff5c405ed90 2023-05-10T01:45:55.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.732+0000 7ff5d67fc700 1 -- 172.21.15.52:0/204680266 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff5e80bf590 con 0x7ff5c405ed90 2023-05-10T01:45:55.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 msgr2=0x7ff5c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 0x7ff5c4061250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff5e0009fd0 tx=0x7ff5e0017000).stop 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 msgr2=0x7ff5e80c0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7ff5d8001560 tx=0x7ff5d8001650).stop 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 shutdown_connections 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff5c405ed90 0x7ff5c4061250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e8154170 0x7ff5e80c0e50 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e8063e20 0x7ff5e80a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 --2- 172.21.15.52:0/204680266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e8153d90 0x7ff5e81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 >> 172.21.15.52:0/204680266 conn(0x7ff5e80c8a90 msgr2=0x7ff5e80c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 shutdown_connections 2023-05-10T01:45:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.734+0000 7ff5ec97a700 1 -- 172.21.15.52:0/204680266 wait complete. 2023-05-10T01:45:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2023-05-10T01:45:55.749 INFO:tasks.ceph:Scrubbing osd.5 2023-05-10T01:45:55.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.867+0000 7f09fd3ac700 1 Processor -- start 2023-05-10T01:45:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.867+0000 7f09fd3ac700 1 -- start start 2023-05-10T01:45:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09fd3ac700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09f80629b0 0x7f09f81540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09fd3ac700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80bf940 con 0x7f09f8153cf0 2023-05-10T01:45:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09fd3ac700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80a7c80 con 0x7f09f8063fa0 2023-05-10T01:45:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09fd3ac700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f8067f50 con 0x7f09f80629b0 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09f80629b0 0x7f09f81540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f6ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f09f8153cf0 0x7f09f80bf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52572/0 (socket says 172.21.15.52:52572) 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f6ffd700 1 -- 172.21.15.52:0/1265698005 learned_addr learned my addr 172.21.15.52:0/1265698005 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 --2- 172.21.15.52:0/1265698005 >> v2:172.21.15.52:3300/0 conn(0x7f09f80629b0 0x7f09f81540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43560/0 (socket says 172.21.15.52:43560) 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 -- 172.21.15.52:0/1265698005 >> v1:172.21.15.172:6789/0 conn(0x7f09f8063fa0 legacy=0x7f09f80622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 -- 172.21.15.52:0/1265698005 >> v1:172.21.15.52:6789/0 conn(0x7f09f8153cf0 legacy=0x7f09f80bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 -- 172.21.15.52:0/1265698005 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f80a7ef0 con 0x7f09f80629b0 2023-05-10T01:45:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f5ffb700 1 -- 172.21.15.52:0/1265698005 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656182480 0 0) 0x7f09f80bf940 con 0x7f09f8153cf0 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.868+0000 7f09f77fe700 1 --2- 172.21.15.52:0/1265698005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f80629b0 0x7f09f81540d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f09e8009750 tx=0x7f09e8006f90).ready entity=mon.0 client_cookie=8b02b69f123e8118 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09f5ffb700 1 -- 172.21.15.52:0/1265698005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80058d0 con 0x7f09f80629b0 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09f5ffb700 1 -- 172.21.15.52:0/1265698005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8005a30 con 0x7f09f80629b0 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09f5ffb700 1 -- 172.21.15.52:0/1265698005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8005db0 con 0x7f09f80629b0 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 -- 172.21.15.52:0/1265698005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f80629b0 msgr2=0x7f09f81540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 --2- 172.21.15.52:0/1265698005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f80629b0 0x7f09f81540d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f09e8009750 tx=0x7f09e8006f90).stop 2023-05-10T01:45:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 -- 172.21.15.52:0/1265698005 shutdown_connections 2023-05-10T01:45:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 --2- 172.21.15.52:0/1265698005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f80629b0 0x7f09f81540d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 -- 172.21.15.52:0/1265698005 >> 172.21.15.52:0/1265698005 conn(0x7f09f805e810 msgr2=0x7f09f80c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 -- 172.21.15.52:0/1265698005 shutdown_connections 2023-05-10T01:45:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.869+0000 7f09fd3ac700 1 -- 172.21.15.52:0/1265698005 wait complete. 2023-05-10T01:45:55.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.870+0000 7f09fd3ac700 1 Processor -- start 2023-05-10T01:45:55.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.870+0000 7f09fd3ac700 1 -- start start 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f09f80629b0 0x7f09f80a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f8063fa0 0x7f09f814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 0x7f09f80c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80c1d20 con 0x7f09f8153cf0 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80a8ba0 con 0x7f09f8063fa0 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09fd3ac700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80a8e80 con 0x7f09f80629b0 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 0x7f09f80c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 0x7f09f80c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43566/0 (socket says 172.21.15.52:43566) 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 -- 172.21.15.52:0/3568053401 learned_addr learned my addr 172.21.15.52:0/3568053401 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 -- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f09f80629b0 msgr2=0x7f09f80a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f09f80629b0 0x7f09f80a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f77fe700 1 -- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f8063fa0 msgr2=0x7f09f814d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.871+0000 7f09f67fc700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f8063fa0 0x7f09f814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09f77fe700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f8063fa0 0x7f09f814d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09f77fe700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009290 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09f77fe700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 0x7f09f80c1830 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f09e8000ea0 tx=0x7f09e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800b8e0 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800ba40 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f80a9160 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800be00 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.872+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f80abf80 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.873+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09f80abde0 con 0x7f09f8153cf0 2023-05-10T01:45:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.873+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f09e8023030 con 0x7f09f8153cf0 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.873+0000 7f09eeffd700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f09dc05ed90 0x7f09dc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f09e807a750 con 0x7f09f8153cf0 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09eeffd700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7f09dc065900 0x7f09dc067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09dc068350 con 0x7f09dc065900 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09e807cdc0 con 0x7f09f8153cf0 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09f6ffd700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f09dc05ed90 0x7f09dc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09f67fc700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7f09dc065900 0x7f09dc067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09f6ffd700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f09dc05ed90 0x7f09dc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f09f0007fd0 tx=0x7f09f0007db0).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.874+0000 7f09f67fc700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7f09dc065900 0x7f09dc067d70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.875+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== osd.5 v2:172.21.15.172:6800/116763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f09dc068350 con 0x7f09dc065900 2023-05-10T01:45:55.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.888+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 --> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09f806c340 con 0x7f09dc065900 2023-05-10T01:45:55.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09eeffd700 1 -- 172.21.15.52:0/3568053401 <== osd.5 v2:172.21.15.172:6800/116763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f09f806c340 con 0x7f09dc065900 2023-05-10T01:45:55.892 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:55.892 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:55.892 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:55.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7f09dc065900 msgr2=0x7f09dc067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6800/116763,v1:172.21.15.172:6801/116763] conn(0x7f09dc065900 0x7f09dc067d70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f09dc05ed90 msgr2=0x7f09dc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f09dc05ed90 0x7f09dc061250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f09f0007fd0 tx=0x7f09f0007db0).stop 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 msgr2=0x7f09f80c1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09fd3ac700 1 --2- 172.21.15.52:0/3568053401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09f8153cf0 0x7f09f80c1830 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f09e8000ea0 tx=0x7f09e8016000).stop 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.889+0000 7f09f77fe700 1 -- 172.21.15.52:0/3568053401 reap_dead start 2023-05-10T01:45:55.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.890+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 shutdown_connections 2023-05-10T01:45:55.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.890+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 >> 172.21.15.52:0/3568053401 conn(0x7f09f805e810 msgr2=0x7f09f80c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:55.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.890+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 shutdown_connections 2023-05-10T01:45:55.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:55.890+0000 7f09fd3ac700 1 -- 172.21.15.52:0/3568053401 wait complete. 2023-05-10T01:45:55.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-05-10T01:45:56.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.017+0000 7f12847bf700 1 Processor -- start 2023-05-10T01:45:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.017+0000 7f12847bf700 1 -- start start 2023-05-10T01:45:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.018+0000 7f12847bf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 0x7f127c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.018+0000 7f12847bf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0683c0 con 0x7f127c066e40 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.018+0000 7f12847bf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0be050 con 0x7f127c158150 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.018+0000 7f12847bf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c137460 con 0x7f127c14e1f0 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281d5a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f127c066e40 0x7f127c157a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52590/0 (socket says 172.21.15.52:52590) 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281d5a700 1 -- 172.21.15.52:0/1417890477 learned_addr learned my addr 172.21.15.52:0/1417890477 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f128255b700 1 --2- 172.21.15.52:0/1417890477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 0x7f127c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740360457 0 0) 0x7f127c0683c0 con 0x7f127c066e40 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12680033f0 con 0x7f127c066e40 2023-05-10T01:45:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089991817 0 0) 0x7f127c0be050 con 0x7f127c158150 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f127c0683c0 con 0x7f127c158150 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f128255b700 1 -- 172.21.15.52:0/1417890477 >> v1:172.21.15.172:6789/0 conn(0x7f127c158150 legacy=0x7f127c15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f128255b700 1 -- 172.21.15.52:0/1417890477 >> v1:172.21.15.52:6789/0 conn(0x7f127c066e40 legacy=0x7f127c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f128255b700 1 -- 172.21.15.52:0/1417890477 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0677b0 con 0x7f127c14e1f0 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f128255b700 1 --2- 172.21.15.52:0/1417890477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 0x7f127c14e5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1274009790 tx=0x7f1274009060).ready entity=mon.2 client_cookie=95269516db74422f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400f510 con 0x7f127c14e1f0 2023-05-10T01:45:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400f670 con 0x7f127c14e1f0 2023-05-10T01:45:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.019+0000 7f1281559700 1 -- 172.21.15.52:0/1417890477 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400f9f0 con 0x7f127c14e1f0 2023-05-10T01:45:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 -- 172.21.15.52:0/1417890477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 msgr2=0x7f127c14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 --2- 172.21.15.52:0/1417890477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 0x7f127c14e5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1274009790 tx=0x7f1274009060).stop 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 -- 172.21.15.52:0/1417890477 shutdown_connections 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 --2- 172.21.15.52:0/1417890477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c14e1f0 0x7f127c14e5d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 -- 172.21.15.52:0/1417890477 >> 172.21.15.52:0/1417890477 conn(0x7f127c0c7bb0 msgr2=0x7f127c0c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 -- 172.21.15.52:0/1417890477 shutdown_connections 2023-05-10T01:45:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.020+0000 7f12847bf700 1 -- 172.21.15.52:0/1417890477 wait complete. 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.021+0000 7f12847bf700 1 Processor -- start 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.021+0000 7f12847bf700 1 -- start start 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f127c14e1f0 0x7f127c0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158150 0x7f127c065760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0be8f0 con 0x7f127c066e40 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1365f0 con 0x7f127c14e1f0 2023-05-10T01:45:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f12847bf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c0cb0 con 0x7f127c158150 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43580/0 (socket says 172.21.15.52:43580) 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 -- 172.21.15.52:0/2528065895 learned_addr learned my addr 172.21.15.52:0/2528065895 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f1281d5a700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f127c14e1f0 0x7f127c0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f1282d5c700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158150 0x7f127c065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 -- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158150 msgr2=0x7f127c065760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158150 0x7f127c065760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 -- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f127c14e1f0 msgr2=0x7f127c0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f127c14e1f0 0x7f127c0c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 -- 172.21.15.52:0/2528065895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740092a0 con 0x7f127c066e40 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.022+0000 7f128255b700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f1274009d80 tx=0x7f1274017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.023+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400f7e0 con 0x7f127c066e40 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.023+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400f940 con 0x7f127c066e40 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.023+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0be2a0 con 0x7f127c066e40 2023-05-10T01:45:56.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.023+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127401b620 con 0x7f127c066e40 2023-05-10T01:45:56.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.023+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0c09c0 con 0x7f127c066e40 2023-05-10T01:45:56.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.024+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c06c340 con 0x7f127c066e40 2023-05-10T01:45:56.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.024+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f127400f070 con 0x7f127c066e40 2023-05-10T01:45:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.024+0000 7f127a7fc700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 0x7f125c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.024+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f127407b1d0 con 0x7f127c066e40 2023-05-10T01:45:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.025+0000 7f1281d5a700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 0x7f125c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.025+0000 7f1281d5a700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 0x7f125c061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f127c066630 tx=0x7f1270009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.029+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f127404c870 con 0x7f127c066e40 2023-05-10T01:45:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.205+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c0bea30 con 0x7f125c05ed60 2023-05-10T01:45:56.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.205+0000 7f127a7fc700 1 -- 172.21.15.52:0/2528065895 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1270007110 con 0x7f125c05ed60 2023-05-10T01:45:56.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 msgr2=0x7f125c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 0x7f125c061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f127c066630 tx=0x7f1270009040).stop 2023-05-10T01:45:56.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 msgr2=0x7f127c136100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f1274009d80 tx=0x7f1274017000).stop 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 shutdown_connections 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f125c05ed60 0x7f125c061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158150 0x7f127c065760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f127c066e40 0x7f127c136100 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 --2- 172.21.15.52:0/2528065895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f127c14e1f0 0x7f127c0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 >> 172.21.15.52:0/2528065895 conn(0x7f127c0c7bb0 msgr2=0x7f127c0c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 shutdown_connections 2023-05-10T01:45:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.207+0000 7f12847bf700 1 -- 172.21.15.52:0/2528065895 wait complete. 2023-05-10T01:45:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2023-05-10T01:45:56.221 INFO:tasks.ceph:Scrubbing osd.6 2023-05-10T01:45:56.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.338+0000 7f292c8fb700 1 Processor -- start 2023-05-10T01:45:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.338+0000 7f292c8fb700 1 -- start start 2023-05-10T01:45:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292c8fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292c8fb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2928068150 0x7f29280685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292c8fb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280c94c0 con 0x7f2928154080 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292c8fb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280cb7d0 con 0x7f2928068150 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292c8fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2928068ab0 con 0x7f2928154460 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f2926d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2928068150 0x7f29280685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f2926d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2928068150 0x7f29280685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.52:41914/0 (socket says 172.21.15.52:41914) 2023-05-10T01:45:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f2926d9d700 1 -- 172.21.15.52:0/2108652962 learned_addr learned my addr 172.21.15.52:0/2108652962 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.52:34992/0 (socket says 172.21.15.52:34992) 2023-05-10T01:45:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.339+0000 7f292659c700 1 --1- 172.21.15.52:0/2108652962 >> v1:172.21.15.172:6789/0 conn(0x7f2928154080 0x7f29280a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:55140/0 (socket says 172.21.15.52:55140) 2023-05-10T01:45:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2926d9d700 1 -- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 msgr2=0x7f29280aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2926d9d700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2926d9d700 1 -- 172.21.15.52:0/2108652962 >> v1:172.21.15.172:6789/0 conn(0x7f2928154080 legacy=0x7f29280a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f292559a700 1 -- 172.21.15.52:0/2108652962 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089464477 0 0) 0x7f29280c94c0 con 0x7f2928154080 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2926d9d700 1 -- 172.21.15.52:0/2108652962 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280c88b0 con 0x7f2928068150 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2925d9b700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f2926d9d700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f29280685c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2918009f20 tx=0x7f2918009840).ready entity=mon.1 client_cookie=fdcc56756d52f4ef server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f292559a700 1 -- 172.21.15.52:0/2108652962 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800e070 con 0x7f2928068150 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f292559a700 1 -- 172.21.15.52:0/2108652962 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291800b9d0 con 0x7f2928068150 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.340+0000 7f292559a700 1 -- 172.21.15.52:0/2108652962 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800bd50 con 0x7f2928068150 2023-05-10T01:45:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 -- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 msgr2=0x7f29280685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f29280685c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2918009f20 tx=0x7f2918009840).stop 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 -- 172.21.15.52:0/2108652962 shutdown_connections 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f29280685c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2108652962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f29280aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 -- 172.21.15.52:0/2108652962 >> 172.21.15.52:0/2108652962 conn(0x7f2928067910 msgr2=0x7f29280cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 -- 172.21.15.52:0/2108652962 shutdown_connections 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.341+0000 7f292c8fb700 1 -- 172.21.15.52:0/2108652962 wait complete. 2023-05-10T01:45:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.342+0000 7f292c8fb700 1 Processor -- start 2023-05-10T01:45:56.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.342+0000 7f292c8fb700 1 -- start start 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f2928167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 0x7f292814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f2928155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928168640 con 0x7f2928154080 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29281559d0 con 0x7f2928068150 2023-05-10T01:45:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292c8fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29280c4230 con 0x7f2928154460 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 0x7f292814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f292659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f2928167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 0x7f292814f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43594/0 (socket says 172.21.15.52:43594) 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 -- 172.21.15.52:0/2562952879 learned_addr learned my addr 172.21.15.52:0/2562952879 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2926d9d700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f2928155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 -- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 msgr2=0x7f2928155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2928154460 0x7f2928155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 -- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 msgr2=0x7f2928167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2928068150 0x7f2928167710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100092a0 con 0x7f2928154080 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f2925d9b700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 0x7f292814f800 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f291000e9e0 tx=0x7f2910009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000c670 con 0x7f2928154080 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.343+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000c7d0 con 0x7f2928154080 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.344+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000cb50 con 0x7f2928154080 2023-05-10T01:45:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.344+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2918009ae0 con 0x7f2928154080 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.344+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2928168080 con 0x7f2928154080 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.344+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2928066720 con 0x7f2928154080 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2910022070 con 0x7f2928154080 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f290c05ed90 0x7f290c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f291007a420 con 0x7f2928154080 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f290c065900 0x7f290c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f290c068350 con 0x7f290c065900 2023-05-10T01:45:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7f291007a820 con 0x7f2928154080 2023-05-10T01:45:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.345+0000 7f292659c700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f290c05ed90 0x7f290c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.346+0000 7f2926d9d700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f290c065900 0x7f290c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.346+0000 7f292659c700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f290c05ed90 0x7f290c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f29200011e0 tx=0x7f2920007bd0).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.346+0000 7f2926d9d700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f290c065900 0x7f290c067d70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.347+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== osd.6 v2:172.21.15.172:6808/116764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f290c068350 con 0x7f290c065900 2023-05-10T01:45:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.360+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 --> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f292806c340 con 0x7f290c065900 2023-05-10T01:45:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f291e7fc700 1 -- 172.21.15.52:0/2562952879 <== osd.6 v2:172.21.15.172:6808/116764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f292806c340 con 0x7f290c065900 2023-05-10T01:45:56.364 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:56.364 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:56.364 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f290c065900 msgr2=0x7f290c067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6808/116764,v1:172.21.15.172:6809/116764] conn(0x7f290c065900 0x7f290c067d70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f290c05ed90 msgr2=0x7f290c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f290c05ed90 0x7f290c061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f29200011e0 tx=0x7f2920007bd0).stop 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 msgr2=0x7f292814f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 --2- 172.21.15.52:0/2562952879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2928154080 0x7f292814f800 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f291000e9e0 tx=0x7f2910009060).stop 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f2926d9d700 1 -- 172.21.15.52:0/2562952879 reap_dead start 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 shutdown_connections 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 >> 172.21.15.52:0/2562952879 conn(0x7f2928067910 msgr2=0x7f29280afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 shutdown_connections 2023-05-10T01:45:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.361+0000 7f292c8fb700 1 -- 172.21.15.52:0/2562952879 wait complete. 2023-05-10T01:45:56.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-05-10T01:45:56.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.489+0000 7fd8568c2700 1 Processor -- start 2023-05-10T01:45:56.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.490+0000 7fd8568c2700 1 -- start start 2023-05-10T01:45:56.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.490+0000 7fd8568c2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd850153d90 0x7fd850069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.490+0000 7fd8568c2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd850062b00 con 0x7fd850063e20 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.490+0000 7fd8568c2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd850068330 con 0x7fd850154170 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.490+0000 7fd8568c2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850068610 con 0x7fd850153d90 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd854e5f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd850063e20 0x7fd8500bd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52620/0 (socket says 172.21.15.52:52620) 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd854e5f700 1 -- 172.21.15.52:0/1021873164 learned_addr learned my addr 172.21.15.52:0/1021873164 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84ffff700 1 --2- 172.21.15.52:0/1021873164 >> v2:172.21.15.172:3300/0 conn(0x7fd850153d90 0x7fd850069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715411176 0 0) 0x7fd850062b00 con 0x7fd850063e20 2023-05-10T01:45:56.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd83c0033f0 con 0x7fd850063e20 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84ffff700 1 -- 172.21.15.52:0/1021873164 >> v1:172.21.15.172:6789/0 conn(0x7fd850154170 legacy=0x7fd850063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683610112 0 0) 0x7fd850068330 con 0x7fd850154170 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84ffff700 1 -- 172.21.15.52:0/1021873164 >> v1:172.21.15.52:6789/0 conn(0x7fd850063e20 legacy=0x7fd8500bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84ffff700 1 -- 172.21.15.52:0/1021873164 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500624b0 con 0x7fd850153d90 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84ffff700 1 --2- 172.21.15.52:0/1021873164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850069a00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fd840009760 tx=0x7fd840009060).ready entity=mon.1 client_cookie=ac1f46f9425eacb8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480017f0 con 0x7fd850153d90 2023-05-10T01:45:56.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840012410 con 0x7fd850153d90 2023-05-10T01:45:56.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.491+0000 7fd84effd700 1 -- 172.21.15.52:0/1021873164 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840012790 con 0x7fd850153d90 2023-05-10T01:45:56.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 -- 172.21.15.52:0/1021873164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 msgr2=0x7fd850069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 --2- 172.21.15.52:0/1021873164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850069a00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fd840009760 tx=0x7fd840009060).stop 2023-05-10T01:45:56.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 -- 172.21.15.52:0/1021873164 shutdown_connections 2023-05-10T01:45:56.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 --2- 172.21.15.52:0/1021873164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850069a00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 -- 172.21.15.52:0/1021873164 >> 172.21.15.52:0/1021873164 conn(0x7fd8500c8a90 msgr2=0x7fd8500c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 -- 172.21.15.52:0/1021873164 shutdown_connections 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.492+0000 7fd8568c2700 1 -- 172.21.15.52:0/1021873164 wait complete. 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.493+0000 7fd8568c2700 1 Processor -- start 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.493+0000 7fd8568c2700 1 -- start start 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd850063e20 0x7fd8501589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501531a0 con 0x7fd850154170 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850159510 con 0x7fd850153d90 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd8568c2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501597f0 con 0x7fd850063e20 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43612/0 (socket says 172.21.15.52:43612) 2023-05-10T01:45:56.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 -- 172.21.15.52:0/3754238479 learned_addr learned my addr 172.21.15.52:0/3754238479 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd84ffff700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd850063e20 0x7fd8501589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd84f7fe700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 -- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd850063e20 msgr2=0x7fd8501589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd850063e20 0x7fd8501589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 -- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 msgr2=0x7fd850158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.494+0000 7fd854e5f700 1 -- 172.21.15.52:0/3754238479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400092a0 con 0x7fd850154170 2023-05-10T01:45:56.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd854e5f700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7fd8480012e0 tx=0x7fd848007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800ce10 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848004c40 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850159ad0 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800a930 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.495+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85015a090 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.496+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85015a280 con 0x7fd850154170 2023-05-10T01:45:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.496+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd84801b060 con 0x7fd850154170 2023-05-10T01:45:56.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.496+0000 7fd837fff700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 0x7fd830061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.497+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fd848079a80 con 0x7fd850154170 2023-05-10T01:45:56.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.497+0000 7fd84ffff700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 0x7fd830061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.497+0000 7fd84ffff700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 0x7fd830061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd840009760 tx=0x7fd840015000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.501+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd84804b010 con 0x7fd850154170 2023-05-10T01:45:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.678+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd85006c340 con 0x7fd83005ed90 2023-05-10T01:45:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.678+0000 7fd837fff700 1 -- 172.21.15.52:0/3754238479 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd85006c340 con 0x7fd83005ed90 2023-05-10T01:45:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 msgr2=0x7fd830061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 0x7fd830061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd840009760 tx=0x7fd840015000).stop 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 msgr2=0x7fd8500c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7fd8480012e0 tx=0x7fd848007cf0).stop 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 shutdown_connections 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd83005ed90 0x7fd830061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd850154170 0x7fd8500c1960 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd850063e20 0x7fd8501589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 --2- 172.21.15.52:0/3754238479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd850153d90 0x7fd850158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 >> 172.21.15.52:0/3754238479 conn(0x7fd8500c8a90 msgr2=0x7fd8500c4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 shutdown_connections 2023-05-10T01:45:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.680+0000 7fd8568c2700 1 -- 172.21.15.52:0/3754238479 wait complete. 2023-05-10T01:45:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2023-05-10T01:45:56.695 INFO:tasks.ceph:Scrubbing osd.7 2023-05-10T01:45:56.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-05-10T01:45:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.812+0000 7f1e70490700 1 Processor -- start 2023-05-10T01:45:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.812+0000 7f1e70490700 1 -- start start 2023-05-10T01:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e70490700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e68154460 0x7f1e680aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e70490700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680c94c0 con 0x7f1e68068150 2023-05-10T01:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e70490700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680cb7d0 con 0x7f1e68154080 2023-05-10T01:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e70490700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680c88b0 con 0x7f1e68154460 2023-05-10T01:45:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e6da2b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e68154460 0x7f1e680aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e6ea2d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e68068150 0x7f1e680c9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52634/0 (socket says 172.21.15.52:52634) 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e6ea2d700 1 -- 172.21.15.52:0/3731814126 learned_addr learned my addr 172.21.15.52:0/3731814126 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e6da2b700 1 -- 172.21.15.52:0/3731814126 >> v1:172.21.15.172:6789/0 conn(0x7f1e68154080 legacy=0x7f1e680a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.813+0000 7f1e6da2b700 1 -- 172.21.15.52:0/3731814126 >> v1:172.21.15.52:6789/0 conn(0x7f1e68068150 legacy=0x7f1e680c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e6da2b700 1 -- 172.21.15.52:0/3731814126 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680c8b90 con 0x7f1e68154460 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e6da2b700 1 --2- 172.21.15.52:0/3731814126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154460 0x7f1e680aac90 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f1e5c009760 tx=0x7f1e5c009060).ready entity=mon.0 client_cookie=8a0afd6686db0c45 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e6d22a700 1 -- 172.21.15.52:0/3731814126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00b580 con 0x7f1e68154460 2023-05-10T01:45:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e6d22a700 1 -- 172.21.15.52:0/3731814126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c00b6e0 con 0x7f1e68154460 2023-05-10T01:45:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e6d22a700 1 -- 172.21.15.52:0/3731814126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00ba60 con 0x7f1e68154460 2023-05-10T01:45:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 -- 172.21.15.52:0/3731814126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154460 msgr2=0x7f1e680aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 --2- 172.21.15.52:0/3731814126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154460 0x7f1e680aac90 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f1e5c009760 tx=0x7f1e5c009060).stop 2023-05-10T01:45:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 -- 172.21.15.52:0/3731814126 shutdown_connections 2023-05-10T01:45:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 --2- 172.21.15.52:0/3731814126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154460 0x7f1e680aac90 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 -- 172.21.15.52:0/3731814126 >> 172.21.15.52:0/3731814126 conn(0x7f1e68067910 msgr2=0x7f1e680cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 -- 172.21.15.52:0/3731814126 shutdown_connections 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.814+0000 7f1e70490700 1 -- 172.21.15.52:0/3731814126 wait complete. 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.815+0000 7f1e70490700 1 Processor -- start 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 -- start start 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e68068150 0x7f1e680b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 0x7f1e680c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68154460 0x7f1e6814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68156320 con 0x7f1e68154080 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680aa270 con 0x7f1e68154460 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e70490700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680c21b0 con 0x7f1e68068150 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e6da2b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 0x7f1e680c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e6da2b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 0x7f1e680c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43624/0 (socket says 172.21.15.52:43624) 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.816+0000 7f1e6da2b700 1 -- 172.21.15.52:0/2845228016 learned_addr learned my addr 172.21.15.52:0/2845228016 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6ea2d700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68154460 0x7f1e6814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6e22c700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e68068150 0x7f1e680b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 -- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e68068150 msgr2=0x7f1e680b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e68068150 0x7f1e680b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 -- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68154460 msgr2=0x7f1e6814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68154460 0x7f1e6814bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0092a0 con 0x7f1e68154080 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e6da2b700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 0x7f1e680c1cc0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f1e5c009eb0 tx=0x7f1e5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00ba60 con 0x7f1e68154080 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c01b440 con 0x7f1e68154080 2023-05-10T01:45:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e680aa510 con 0x7f1e68154080 2023-05-10T01:45:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c01b7c0 con 0x7f1e68154080 2023-05-10T01:45:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.817+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e68155fb0 con 0x7f1e68154080 2023-05-10T01:45:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.818+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e68066720 con 0x7f1e68154080 2023-05-10T01:45:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.818+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1e5c02a070 con 0x7f1e68154080 2023-05-10T01:45:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e667fc700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e4805ed90 0x7f1e48061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f1e5c07b2c0 con 0x7f1e68154080 2023-05-10T01:45:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e6e22c700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e4805ed90 0x7f1e48061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e667fc700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f1e48065900 0x7f1e48067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e48068350 con 0x7f1e48065900 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=178) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e5c07d930 con 0x7f1e68154080 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e6ea2d700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f1e48065900 0x7f1e48067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e6e22c700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e4805ed90 0x7f1e48061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1e60003750 tx=0x7f1e60009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.819+0000 7f1e6ea2d700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f1e48065900 0x7f1e48067d70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.820+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== osd.7 v2:172.21.15.172:6816/116795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1e48068350 con 0x7f1e48065900 2023-05-10T01:45:56.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.833+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 --> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1e68156460 con 0x7f1e48065900 2023-05-10T01:45:56.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e667fc700 1 -- 172.21.15.52:0/2845228016 <== osd.7 v2:172.21.15.172:6816/116795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1e58001f00 con 0x7f1e48065900 2023-05-10T01:45:56.837 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-05-10T01:45:56.837 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-10T01:45:56.837 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-05-10T01:45:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f1e48065900 msgr2=0x7f1e48067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6816/116795,v1:172.21.15.172:6817/116795] conn(0x7f1e48065900 0x7f1e48067d70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e4805ed90 msgr2=0x7f1e48061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f1e4805ed90 0x7f1e48061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1e60003750 tx=0x7f1e60009040).stop 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 msgr2=0x7f1e680c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 --2- 172.21.15.52:0/2845228016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68154080 0x7f1e680c1cc0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f1e5c009eb0 tx=0x7f1e5c017000).stop 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e6ea2d700 1 -- 172.21.15.52:0/2845228016 reap_dead start 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 shutdown_connections 2023-05-10T01:45:56.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 >> 172.21.15.52:0/2845228016 conn(0x7f1e68067910 msgr2=0x7f1e680ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 shutdown_connections 2023-05-10T01:45:56.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.834+0000 7f1e70490700 1 -- 172.21.15.52:0/2845228016 wait complete. 2023-05-10T01:45:56.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-05-10T01:45:56.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.965+0000 7f6bc9950700 1 Processor -- start 2023-05-10T01:45:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 -- start start 2023-05-10T01:45:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6bc4154540 0x7f6bc4069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4069b80 0x7f6bc40c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40c0650 con 0x7f6bc4154160 2023-05-10T01:45:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc4069ff0 con 0x7f6bc4154540 2023-05-10T01:45:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.966+0000 7f6bc9950700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40bfd20 con 0x7f6bc4069b80 2023-05-10T01:45:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6bc4154540 0x7f6bc4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc37fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4069b80 0x7f6bc40c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc2ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6bc4154160 0x7f6bc40c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.52:55186/0 (socket says 172.21.15.52:55186) 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc2ffd700 1 -- 172.21.15.52:0/3923875906 learned_addr learned my addr 172.21.15.52:0/3923875906 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 -- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4069b80 msgr2=0x7f6bc40c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 --2- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4069b80 0x7f6bc40c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 -- 172.21.15.52:0/3923875906 >> v1:172.21.15.172:6789/0 conn(0x7f6bc4154160 legacy=0x7f6bc40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 -- 172.21.15.52:0/3923875906 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40c0000 con 0x7f6bc4154540 2023-05-10T01:45:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc1ffb700 1 -- 172.21.15.52:0/3923875906 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854575796 0 0) 0x7f6bc40c0650 con 0x7f6bc4154160 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc27fc700 1 --2- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154540 0x7f6bc4069690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f6bac009760 tx=0x7f6bac009060).ready entity=mon.1 client_cookie=458a3fc158977eb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc1ffb700 1 -- 172.21.15.52:0/3923875906 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0090d0 con 0x7f6bc4154540 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.967+0000 7f6bc1ffb700 1 -- 172.21.15.52:0/3923875906 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00f510 con 0x7f6bc4154540 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc1ffb700 1 -- 172.21.15.52:0/3923875906 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00f890 con 0x7f6bc4154540 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 -- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154540 msgr2=0x7f6bc4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 --2- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154540 0x7f6bc4069690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f6bac009760 tx=0x7f6bac009060).stop 2023-05-10T01:45:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 -- 172.21.15.52:0/3923875906 shutdown_connections 2023-05-10T01:45:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 --2- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4069b80 0x7f6bc40c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 --2- 172.21.15.52:0/3923875906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154540 0x7f6bc4069690 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 -- 172.21.15.52:0/3923875906 >> 172.21.15.52:0/3923875906 conn(0x7f6bc40cb6f0 msgr2=0x7f6bc40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 -- 172.21.15.52:0/3923875906 shutdown_connections 2023-05-10T01:45:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.968+0000 7f6bc9950700 1 -- 172.21.15.52:0/3923875906 wait complete. 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.969+0000 7f6bc9950700 1 Processor -- start 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.969+0000 7f6bc9950700 1 -- start start 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154160 0x7f6bc4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4154540 0x7f6bc4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40c1d30 con 0x7f6bc4069b80 2023-05-10T01:45:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40c22f0 con 0x7f6bc4154160 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc9950700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4156a00 con 0x7f6bc4154540 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43638/0 (socket says 172.21.15.52:43638) 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 -- 172.21.15.52:0/299800419 learned_addr learned my addr 172.21.15.52:0/299800419 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc37fe700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4154540 0x7f6bc4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc27fc700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154160 0x7f6bc4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 -- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4154540 msgr2=0x7f6bc4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4154540 0x7f6bc4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 -- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154160 msgr2=0x7f6bc4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154160 0x7f6bc4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 -- 172.21.15.52:0/299800419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0092a0 con 0x7f6bc4069b80 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.970+0000 7f6bc2ffd700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f6bbc00c990 tx=0x7f6bbc001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc005d30 con 0x7f6bc4069b80 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc005e90 con 0x7f6bc4069b80 2023-05-10T01:45:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc4156ce0 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc007320 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc4168090 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.971+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc40666b0 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.972+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6bbc010030 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.972+0000 7f6bbaffd700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 0x7f6ba8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.973+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f6bbc079a30 con 0x7f6bc4069b80 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.973+0000 7f6bc27fc700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 0x7f6ba8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.973+0000 7f6bc27fc700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 0x7f6ba8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6bc4154920 tx=0x7f6bac017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:56.977+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bbc04afc0 con 0x7f6bc4069b80 2023-05-10T01:45:57.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.149+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bc406c340 con 0x7f6ba805ed90 2023-05-10T01:45:57.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.150+0000 7f6bbaffd700 1 -- 172.21.15.52:0/299800419 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6bc406c340 con 0x7f6ba805ed90 2023-05-10T01:45:57.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 msgr2=0x7f6ba8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 0x7f6ba8061250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6bc4154920 tx=0x7f6bac017000).stop 2023-05-10T01:45:57.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 msgr2=0x7f6bc414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f6bbc00c990 tx=0x7f6bbc001630).stop 2023-05-10T01:45:57.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 shutdown_connections 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f6ba805ed90 0x7f6ba8061250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6bc4154540 0x7f6bc4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4069b80 0x7f6bc414cf50 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 --2- 172.21.15.52:0/299800419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4154160 0x7f6bc4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 >> 172.21.15.52:0/299800419 conn(0x7f6bc40cb6f0 msgr2=0x7f6bc40ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:57.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 shutdown_connections 2023-05-10T01:45:57.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.152+0000 7f6bc9950700 1 -- 172.21.15.52:0/299800419 wait complete. 2023-05-10T01:45:57.157 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2023-05-10T01:45:57.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:45:57.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.280+0000 7f35786bb700 1 Processor -- start 2023-05-10T01:45:57.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.280+0000 7f35786bb700 1 -- start start 2023-05-10T01:45:57.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f35786bb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3570154160 0x7f35700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f35786bb700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700c0650 con 0x7f3570069da0 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f35786bb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700bfd20 con 0x7f3570154540 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f35786bb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35700c0000 con 0x7f3570154160 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f3576c58700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3570069da0 0x7f35700c0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52664/0 (socket says 172.21.15.52:52664) 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f3576c58700 1 -- 172.21.15.52:0/1876470169 learned_addr learned my addr 172.21.15.52:0/1876470169 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:45:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f3576457700 1 --2- 172.21.15.52:0/1876470169 >> v2:172.21.15.172:3300/0 conn(0x7f3570154160 0x7f35700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f3575455700 1 -- 172.21.15.52:0/1876470169 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554193312 0 0) 0x7f35700c0650 con 0x7f3570069da0 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.281+0000 7f3575455700 1 -- 172.21.15.52:0/1876470169 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c0033f0 con 0x7f3570069da0 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3576457700 1 -- 172.21.15.52:0/1876470169 >> v1:172.21.15.172:6789/0 conn(0x7f3570154540 legacy=0x7f3570069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3576457700 1 -- 172.21.15.52:0/1876470169 >> v1:172.21.15.52:6789/0 conn(0x7f3570069da0 legacy=0x7f35700c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3576457700 1 -- 172.21.15.52:0/1876470169 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700c02e0 con 0x7f3570154160 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3576457700 1 --2- 172.21.15.52:0/1876470169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570154160 0x7f35700c5c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f3568009760 tx=0x7f3568009060).ready entity=mon.1 client_cookie=14a70b65f31ed452 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3575455700 1 -- 172.21.15.52:0/1876470169 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35680090d0 con 0x7f3570154160 2023-05-10T01:45:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3575455700 1 -- 172.21.15.52:0/1876470169 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800f510 con 0x7f3570154160 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f3575455700 1 -- 172.21.15.52:0/1876470169 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800f890 con 0x7f3570154160 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f35786bb700 1 -- 172.21.15.52:0/1876470169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570154160 msgr2=0x7f35700c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.282+0000 7f35786bb700 1 --2- 172.21.15.52:0/1876470169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570154160 0x7f35700c5c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f3568009760 tx=0x7f3568009060).stop 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.283+0000 7f35786bb700 1 -- 172.21.15.52:0/1876470169 shutdown_connections 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.283+0000 7f35786bb700 1 --2- 172.21.15.52:0/1876470169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570154160 0x7f35700c5c60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.283+0000 7f35786bb700 1 -- 172.21.15.52:0/1876470169 >> 172.21.15.52:0/1876470169 conn(0x7f35700cb6f0 msgr2=0x7f35700c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:57.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.283+0000 7f35786bb700 1 -- 172.21.15.52:0/1876470169 shutdown_connections 2023-05-10T01:45:57.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.283+0000 7f35786bb700 1 -- 172.21.15.52:0/1876470169 wait complete. 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 Processor -- start 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 -- start start 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 0x7f357014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3570154160 0x7f357014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35701502d0 con 0x7f3570154540 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357014f9e0 con 0x7f3570069da0 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.284+0000 7f35786bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357014fc80 con 0x7f3570154160 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43654/0 (socket says 172.21.15.52:43654) 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 -- 172.21.15.52:0/2893468357 learned_addr learned my addr 172.21.15.52:0/2893468357 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576457700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 0x7f357014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3575c56700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3570154160 0x7f357014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 -- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3570154160 msgr2=0x7f357014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3570154160 0x7f357014b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 -- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 msgr2=0x7f357014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 0x7f357014ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 -- 172.21.15.52:0/2893468357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35680092a0 con 0x7f3570154540 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576457700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 0x7f357014ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f3576c58700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f3560005ad0 tx=0x7f3560001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:57.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560005d30 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560005e90 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357014ff60 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560007320 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.285+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35701522f0 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.286+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35700666b0 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.286+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3560010030 con 0x7f3570154540 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.287+0000 7f356e7fc700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:45:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.287+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f3560079a30 con 0x7f3570154540 2023-05-10T01:45:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.287+0000 7f3576457700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:45:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.287+0000 7f3576457700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 0x7f3550061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3568000e50 tx=0x7f3568017000).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:45:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.291+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f356004b020 con 0x7f3570154540 2023-05-10T01:45:57.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.460+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f357006c340 con 0x7f355005ed90 2023-05-10T01:45:57.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.463+0000 7f356e7fc700 1 -- 172.21.15.52:0/2893468357 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70949 (secure 0 0 0) 0x7f357006c340 con 0x7f355005ed90 2023-05-10T01:45:57.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:45:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 msgr2=0x7f3550061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 0x7f3550061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3568000e50 tx=0x7f3568017000).stop 2023-05-10T01:45:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 msgr2=0x7f3570151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:45:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f3560005ad0 tx=0x7f3560001650).stop 2023-05-10T01:45:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 shutdown_connections 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f355005ed90 0x7f3550061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3570154540 0x7f3570151780 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3570069da0 0x7f357014ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 --2- 172.21.15.52:0/2893468357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3570154160 0x7f357014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 >> 172.21.15.52:0/2893468357 conn(0x7f35700cb6f0 msgr2=0x7f35700ac030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 shutdown_connections 2023-05-10T01:45:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:45:57.465+0000 7f35786bb700 1 -- 172.21.15.52:0/2893468357 wait complete. 2023-05-10T01:45:57.470 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:45:57.480 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-05-10T01:45:56.871383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":195776,"kb_used_data":17408,"kb_used_omap":0,"kb_used_meta":178304,"kb_avail":754778944,"statfs":{"total":773094113280,"available":772893638656,"internally_reserved":0,"allocated":17825792,"data_stored":9231640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":182583296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12244,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.169526"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.144983+0000","last_change":"2023-05-10T01:09:49.090415+0000","last_active":"2023-05-10T01:45:47.144983+0000","last_peered":"2023-05-10T01:45:47.144983+0000","last_clean":"2023-05-10T01:45:47.144983+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:47.144983+0000","last_undegraded":"2023-05-10T01:45:47.144983+0000","last_fullsized":"2023-05-10T01:45:47.144983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.144636+0000","last_change":"2023-05-10T01:09:48.493327+0000","last_active":"2023-05-10T01:45:47.144636+0000","last_peered":"2023-05-10T01:45:47.144636+0000","last_clean":"2023-05-10T01:45:47.144636+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:45:47.144636+0000","last_undegraded":"2023-05-10T01:45:47.144636+0000","last_fullsized":"2023-05-10T01:45:47.144636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.048675+0000","last_change":"2023-05-10T01:09:48.486524+0000","last_active":"2023-05-10T01:45:47.048675+0000","last_peered":"2023-05-10T01:45:47.048675+0000","last_clean":"2023-05-10T01:45:47.048675+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:47.048675+0000","last_undegraded":"2023-05-10T01:45:47.048675+0000","last_fullsized":"2023-05-10T01:45:47.048675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.146173+0000","last_change":"2023-05-10T01:09:48.490562+0000","last_active":"2023-05-10T01:45:47.146173+0000","last_peered":"2023-05-10T01:45:47.146173+0000","last_clean":"2023-05-10T01:45:47.146173+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:45:47.146173+0000","last_undegraded":"2023-05-10T01:45:47.146173+0000","last_fullsized":"2023-05-10T01:45:47.146173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.122344+0000","last_change":"2023-05-10T01:09:47.362417+0000","last_active":"2023-05-10T01:45:47.122344+0000","last_peered":"2023-05-10T01:45:47.122344+0000","last_clean":"2023-05-10T01:45:47.122344+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:47.122344+0000","last_undegraded":"2023-05-10T01:45:47.122344+0000","last_fullsized":"2023-05-10T01:45:47.122344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:45.457484+0000","last_clean_scrub_stamp":"2023-05-10T01:09:45.457484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.123309+0000","last_change":"2023-05-10T01:09:48.487966+0000","last_active":"2023-05-10T01:45:47.123309+0000","last_peered":"2023-05-10T01:45:47.123309+0000","last_clean":"2023-05-10T01:45:47.123309+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:47.123309+0000","last_undegraded":"2023-05-10T01:45:47.123309+0000","last_fullsized":"2023-05-10T01:45:47.123309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.123122+0000","last_change":"2023-05-10T01:09:49.090457+0000","last_active":"2023-05-10T01:45:47.123122+0000","last_peered":"2023-05-10T01:45:47.123122+0000","last_clean":"2023-05-10T01:45:47.123122+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:47.123122+0000","last_undegraded":"2023-05-10T01:45:47.123122+0000","last_fullsized":"2023-05-10T01:45:47.123122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.148409+0000","last_change":"2023-05-10T01:09:48.493947+0000","last_active":"2023-05-10T01:45:47.148409+0000","last_peered":"2023-05-10T01:45:47.148409+0000","last_clean":"2023-05-10T01:45:47.148409+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:47.148409+0000","last_undegraded":"2023-05-10T01:45:47.148409+0000","last_fullsized":"2023-05-10T01:45:47.148409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-05-10T01:45:47.049443+0000","last_change":"2023-05-10T01:09:48.493837+0000","last_active":"2023-05-10T01:45:47.049443+0000","last_peered":"2023-05-10T01:45:47.049443+0000","last_clean":"2023-05-10T01:45:47.049443+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:47.049443+0000","last_undegraded":"2023-05-10T01:45:47.049443+0000","last_fullsized":"2023-05-10T01:45:47.049443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:09:47.470489+0000","last_clean_scrub_stamp":"2023-05-10T01:09:47.470489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575273,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21256,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":19072,"kb_avail":94350584,"statfs":{"total":96636764160,"available":96614998016,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19529728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.627},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.77800000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78600000000000003,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.498}]},{"osd":1,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69599999999999995,"5min":1.127,"15min":1.127},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73899999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.377}]},{"osd":2,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.45500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":1.024,"15min":1.024},"last":0.47799999999999998}]},{"osd":3,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.502}]},{"osd":4,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":1.155,"15min":1.155},"last":0.434},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.433,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.167,"15min":1.167},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":1.597,"15min":1.597},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":1.292,"15min":1.292},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76400000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":1.248,"15min":1.248},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20808,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351032,"statfs":{"total":96636764160,"available":96615456768,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":1.208,"15min":1.208},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.84599999999999997,"15min":1.284},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.84799999999999998,"15min":1.0129999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.3360000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.3620000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.87,"15min":1.3120000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.747,"5min":0.995,"15min":1.2729999999999999},"last":0.78400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24520,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":22336,"kb_avail":94347320,"statfs":{"total":96636764160,"available":96611655680,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22872064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.49199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.251},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.56399999999999995,"5min":0.752,"15min":0.752},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.435,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.33900000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.80300000000000005,"5min":1.1200000000000001,"15min":1.357},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79700000000000004,"5min":1.171,"15min":1.226},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.403},"last":0.58799999999999997}]},{"osd":7,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.83999999999999997,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.86099999999999999,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575272,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24968,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":22784,"kb_avail":94346872,"statfs":{"total":96636764160,"available":96611196928,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23330816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.28899999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.28199999999999997,"5min":0.25900000000000001,"15min":0.24299999999999999},"max":{"1min":0.61499999999999999,"5min":0.75,"15min":0.75},"last":0.28000000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.56499999999999995,"5min":0.624,"15min":0.70599999999999996},"last":0.309},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.372}]},{"osd":3,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.378,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52300000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.63700000000000001,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.439},"max":{"1min":0.879,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.47299999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.53000000000000003}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.48399999999999999,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.57299999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93899999999999995,"5min":1.141,"15min":1.141},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26120,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":23936,"kb_avail":94345720,"statfs":{"total":96636764160,"available":96610017280,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24510464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.503,"5min":0.68100000000000005,"15min":0.747},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26100000000000001},"max":{"1min":0.56100000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.41599999999999998,"15min":0.42999999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.309},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.39600000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64300000000000002,"15min":0.66600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.62}]},{"osd":5,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77800000000000002,"5min":0.98299999999999998,"15min":1.0800000000000001},"last":0.626}]},{"osd":6,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.67500000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82199999999999995,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90600000000000003,"5min":1.0620000000000001,"15min":1.133},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67400000000000004,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575272,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":30848,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31588352},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.307},{"interface":"front","average":{"1min":0.435,"5min":0.432,"15min":0.434},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.379}]},{"osd":1,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.44900000000000001},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.373,"5min":0.222,"15min":0.222},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.71799999999999997,"15min":0.72199999999999998},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93400000000000005,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90900000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.48199999999999998,"5min":0.44,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":1.05},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83999999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.98299999999999998,"15min":1.008},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":1.0329999999999999,"15min":1.048},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed May 10 01:45:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.82299999999999995,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":21000,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94350840,"statfs":{"total":96636764160,"available":96615260160,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.436,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.872,"15min":1.431},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.439,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.51200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.51},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":1.996,"15min":1.996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.85799999999999998,"15min":1.462},"last":0.624}]},{"osd":3,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.2370000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48399999999999999,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.497}]},{"osd":6,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51700000000000002,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 10 01:44:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":1.266},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575274,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24072,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":21888,"kb_avail":94347768,"statfs":{"total":96636764160,"available":96612114432,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22413312},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"last":0.375}]},{"osd":1,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.443}]},{"osd":2,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.88600000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.79000000000000004},"last":0.5}]},{"osd":6,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.28399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.53600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.89200000000000002},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:45:57.484 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.485 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.485 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.485 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.485 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-05-10T01:09:45.457484+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=45, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.485 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.486 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.486 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.486 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-05-10T01:09:47.470489+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=9, tm_sec=47, tm_wday=2, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=10, tm_hour=1, tm_min=45, tm_sec=52, tm_wday=2, tm_yday=130, tm_isdst=0) 2023-05-10T01:45:57.486 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-10T01:46:04.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:04.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:17.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T01:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.615+0000 7f8ed6be9700 1 Processor -- start 2023-05-10T01:46:17.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.615+0000 7f8ed6be9700 1 -- start start 2023-05-10T01:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed6be9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ed0158150 0x7f8ed015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed6be9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00683c0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed6be9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00be050 con 0x7f8ed014e5d0 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed6be9700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed0137460 con 0x7f8ed0158150 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed5186700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ed0158150 0x7f8ed015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed4985700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8ed014e1f0 0x7f8ed0066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52676/0 (socket says 172.21.15.52:52676) 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed4985700 1 -- 172.21.15.52:0/2599436492 learned_addr learned my addr 172.21.15.52:0/2599436492 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed5186700 1 -- 172.21.15.52:0/2599436492 >> v1:172.21.15.172:6789/0 conn(0x7f8ed014e5d0 legacy=0x7f8ed0157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed5186700 1 -- 172.21.15.52:0/2599436492 >> v1:172.21.15.52:6789/0 conn(0x7f8ed014e1f0 legacy=0x7f8ed0066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ecf7fe700 1 -- 172.21.15.52:0/2599436492 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030472073 0 0) 0x7f8ed00683c0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed5186700 1 -- 172.21.15.52:0/2599436492 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0067550 con 0x7f8ed0158150 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.616+0000 7f8ed5186700 1 --2- 172.21.15.52:0/2599436492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed0158150 0x7f8ed015edf0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f8ec0009e60 tx=0x7f8ec0009780).ready entity=mon.0 client_cookie=68271c3d1ec313b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ecf7fe700 1 -- 172.21.15.52:0/2599436492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e070 con 0x7f8ed0158150 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ecf7fe700 1 -- 172.21.15.52:0/2599436492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000bbf0 con 0x7f8ed0158150 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ecf7fe700 1 -- 172.21.15.52:0/2599436492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0012410 con 0x7f8ed0158150 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 -- 172.21.15.52:0/2599436492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed0158150 msgr2=0x7f8ed015edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/2599436492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed0158150 0x7f8ed015edf0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f8ec0009e60 tx=0x7f8ec0009780).stop 2023-05-10T01:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 -- 172.21.15.52:0/2599436492 shutdown_connections 2023-05-10T01:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/2599436492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed0158150 0x7f8ed015edf0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 -- 172.21.15.52:0/2599436492 >> 172.21.15.52:0/2599436492 conn(0x7f8ed00c7bb0 msgr2=0x7f8ed00c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 -- 172.21.15.52:0/2599436492 shutdown_connections 2023-05-10T01:46:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.617+0000 7f8ed6be9700 1 -- 172.21.15.52:0/2599436492 wait complete. 2023-05-10T01:46:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.618+0000 7f8ed6be9700 1 Processor -- start 2023-05-10T01:46:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.618+0000 7f8ed6be9700 1 -- start start 2023-05-10T01:46:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed014e5d0 0x7f8ed00c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ed0158150 0x7f8ed00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00c6400 con 0x7f8ed014e1f0 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a8540 con 0x7f8ed014e5d0 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed6be9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a7930 con 0x7f8ed0158150 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed4985700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed4985700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43666/0 (socket says 172.21.15.52:43666) 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed4985700 1 -- 172.21.15.52:0/1300700455 learned_addr learned my addr 172.21.15.52:0/1300700455 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.619+0000 7f8ed5186700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ed0158150 0x7f8ed00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ecffff700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed014e5d0 0x7f8ed00c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 -- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ed0158150 msgr2=0x7f8ed00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ed0158150 0x7f8ed00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 -- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed014e5d0 msgr2=0x7f8ed00c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed014e5d0 0x7f8ed00c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 -- 172.21.15.52:0/1300700455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009a20 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed4985700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f8ec800c4e0 tx=0x7f8ec8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80072e0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8007440 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80057a0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed00a7c10 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.620+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed00a81d0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.621+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed006c340 con 0x7f8ed014e1f0 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.621+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8ec8010070 con 0x7f8ed014e1f0 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.622+0000 7f8eccff9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 0x7f8eb4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.622+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f8ec80792f0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.622+0000 7f8ecffff700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 0x7f8eb4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.622+0000 7f8ecffff700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 0x7f8eb4061280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8ed0167590 tx=0x7f8eb8009040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.626+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ec804a8e0 con 0x7f8ed014e1f0 2023-05-10T01:46:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.796+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 --> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ed00c43d0 con 0x7f8eb405edc0 2023-05-10T01:46:17.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.799+0000 7f8eccff9700 1 -- 172.21.15.52:0/1300700455 <== mgr.8581 v2:172.21.15.172:6832/125557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70961 (secure 0 0 0) 0x7f8ed00c43d0 con 0x7f8eb405edc0 2023-05-10T01:46:17.803 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:46:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 msgr2=0x7f8eb4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 0x7f8eb4061280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8ed0167590 tx=0x7f8eb8009040).stop 2023-05-10T01:46:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 msgr2=0x7f8ed01359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f8ec800c4e0 tx=0x7f8ec8007c70).stop 2023-05-10T01:46:17.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 shutdown_connections 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7f8eb405edc0 0x7f8eb4061280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ed0158150 0x7f8ed00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ed014e1f0 0x7f8ed01359d0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 --2- 172.21.15.52:0/1300700455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed014e5d0 0x7f8ed00c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 >> 172.21.15.52:0/1300700455 conn(0x7f8ed00c7bb0 msgr2=0x7f8ed00c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 shutdown_connections 2023-05-10T01:46:17.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.801+0000 7f8ed6be9700 1 -- 172.21.15.52:0/1300700455 wait complete. 2023-05-10T01:46:17.806 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-05-10T01:46:17.815 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-05-10T01:46:16.875631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":195776,"kb_used_data":17408,"kb_used_omap":0,"kb_used_meta":178304,"kb_avail":754778944,"statfs":{"total":773094113280,"available":772893638656,"internally_reserved":0,"allocated":17825792,"data_stored":9231640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":182583296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12244,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.169526"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:56.247541+0000","last_change":"2023-05-10T01:45:56.247541+0000","last_active":"2023-05-10T01:45:56.247541+0000","last_peered":"2023-05-10T01:45:56.247541+0000","last_clean":"2023-05-10T01:45:56.247541+0000","last_became_active":"2023-05-10T01:09:49.089960+0000","last_became_peered":"2023-05-10T01:09:49.089960+0000","last_unstale":"2023-05-10T01:45:56.247541+0000","last_undegraded":"2023-05-10T01:45:56.247541+0000","last_fullsized":"2023-05-10T01:45:56.247541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:56.247441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:56.247441+0000","last_clean_scrub_stamp":"2023-05-10T01:45:56.247441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:46:04.307840+0000","last_change":"2023-05-10T01:46:04.307840+0000","last_active":"2023-05-10T01:46:04.307840+0000","last_peered":"2023-05-10T01:46:04.307840+0000","last_clean":"2023-05-10T01:46:04.307840+0000","last_became_active":"2023-05-10T01:09:48.492994+0000","last_became_peered":"2023-05-10T01:09:48.492994+0000","last_unstale":"2023-05-10T01:46:04.307840+0000","last_undegraded":"2023-05-10T01:46:04.307840+0000","last_fullsized":"2023-05-10T01:46:04.307840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:46:04.307682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:46:04.307682+0000","last_clean_scrub_stamp":"2023-05-10T01:46:04.307682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:58.444067+0000","last_change":"2023-05-10T01:45:58.444067+0000","last_active":"2023-05-10T01:45:58.444067+0000","last_peered":"2023-05-10T01:45:58.444067+0000","last_clean":"2023-05-10T01:45:58.444067+0000","last_became_active":"2023-05-10T01:09:48.486182+0000","last_became_peered":"2023-05-10T01:09:48.486182+0000","last_unstale":"2023-05-10T01:45:58.444067+0000","last_undegraded":"2023-05-10T01:45:58.444067+0000","last_fullsized":"2023-05-10T01:45:58.444067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:58.443941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:58.443941+0000","last_clean_scrub_stamp":"2023-05-10T01:45:58.443941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:46:06.291842+0000","last_change":"2023-05-10T01:46:06.291842+0000","last_active":"2023-05-10T01:46:06.291842+0000","last_peered":"2023-05-10T01:46:06.291842+0000","last_clean":"2023-05-10T01:46:06.291842+0000","last_became_active":"2023-05-10T01:09:48.490326+0000","last_became_peered":"2023-05-10T01:09:48.490326+0000","last_unstale":"2023-05-10T01:46:06.291842+0000","last_undegraded":"2023-05-10T01:46:06.291842+0000","last_fullsized":"2023-05-10T01:46:06.291842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:46:06.291711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:46:06.291711+0000","last_clean_scrub_stamp":"2023-05-10T01:46:06.291711+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":149,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:57.778623+0000","last_change":"2023-05-10T01:45:57.778623+0000","last_active":"2023-05-10T01:45:57.778623+0000","last_peered":"2023-05-10T01:45:57.778623+0000","last_clean":"2023-05-10T01:45:57.778623+0000","last_became_active":"2023-05-10T01:09:47.362072+0000","last_became_peered":"2023-05-10T01:09:47.362072+0000","last_unstale":"2023-05-10T01:45:57.778623+0000","last_undegraded":"2023-05-10T01:45:57.778623+0000","last_fullsized":"2023-05-10T01:45:57.778623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:57.778516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:57.778516+0000","last_clean_scrub_stamp":"2023-05-10T01:45:57.778516+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:58.761780+0000","last_change":"2023-05-10T01:45:58.761780+0000","last_active":"2023-05-10T01:45:58.761780+0000","last_peered":"2023-05-10T01:45:58.761780+0000","last_clean":"2023-05-10T01:45:58.761780+0000","last_became_active":"2023-05-10T01:09:48.487685+0000","last_became_peered":"2023-05-10T01:09:48.487685+0000","last_unstale":"2023-05-10T01:45:58.761780+0000","last_undegraded":"2023-05-10T01:45:58.761780+0000","last_fullsized":"2023-05-10T01:45:58.761780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:58.761666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:58.761666+0000","last_clean_scrub_stamp":"2023-05-10T01:45:58.761666+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:59.780863+0000","last_change":"2023-05-10T01:45:59.780863+0000","last_active":"2023-05-10T01:45:59.780863+0000","last_peered":"2023-05-10T01:45:59.780863+0000","last_clean":"2023-05-10T01:45:59.780863+0000","last_became_active":"2023-05-10T01:09:49.090104+0000","last_became_peered":"2023-05-10T01:09:49.090104+0000","last_unstale":"2023-05-10T01:45:59.780863+0000","last_undegraded":"2023-05-10T01:45:59.780863+0000","last_fullsized":"2023-05-10T01:45:59.780863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:59.780715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:59.780715+0000","last_clean_scrub_stamp":"2023-05-10T01:45:59.780715+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":147,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:58.177852+0000","last_change":"2023-05-10T01:45:58.177852+0000","last_active":"2023-05-10T01:45:58.177852+0000","last_peered":"2023-05-10T01:45:58.177852+0000","last_clean":"2023-05-10T01:45:58.177852+0000","last_became_active":"2023-05-10T01:09:48.493523+0000","last_became_peered":"2023-05-10T01:09:48.493523+0000","last_unstale":"2023-05-10T01:45:58.177852+0000","last_undegraded":"2023-05-10T01:45:58.177852+0000","last_fullsized":"2023-05-10T01:45:58.177852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:58.177725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:58.177725+0000","last_clean_scrub_stamp":"2023-05-10T01:45:58.177725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":178,"state":"active+clean","last_fresh":"2023-05-10T01:45:57.446758+0000","last_change":"2023-05-10T01:45:57.446758+0000","last_active":"2023-05-10T01:45:57.446758+0000","last_peered":"2023-05-10T01:45:57.446758+0000","last_clean":"2023-05-10T01:45:57.446758+0000","last_became_active":"2023-05-10T01:09:48.493505+0000","last_became_peered":"2023-05-10T01:09:48.493505+0000","last_unstale":"2023-05-10T01:45:57.446758+0000","last_undegraded":"2023-05-10T01:45:57.446758+0000","last_fullsized":"2023-05-10T01:45:57.446758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T01:45:57.446637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T01:45:57.446637+0000","last_clean_scrub_stamp":"2023-05-10T01:45:57.446637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575277,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21256,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":19072,"kb_avail":94350584,"statfs":{"total":96636764160,"available":96614998016,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19529728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58999999999999997,"15min":0.621},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.89100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.624},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81999999999999995},"last":0.625}]},{"osd":1,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":1.127},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.56000000000000005,"15min":0.58299999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66200000000000003}]},{"osd":2,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59799999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.85199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.628},"min":{"1min":0.375,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78700000000000003,"5min":0.97599999999999998,"15min":1.024},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.79100000000000004,"15min":0.84199999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":1.006,"15min":1.0620000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54600000000000004,"5min":0.68300000000000005,"15min":1.155},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.37,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.83699999999999997,"15min":1.167},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":1.597},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.496,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":0.65700000000000003,"5min":0.79100000000000004,"15min":1.292},"last":0.53800000000000003}]},{"osd":6,"last update":"Wed May 10 01:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64100000000000001,"5min":0.79500000000000004,"15min":1.1850000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76000000000000001,"5min":0.81499999999999995,"15min":1.248},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575276,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20808,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":18624,"kb_avail":94351032,"statfs":{"total":96636764160,"available":96615456768,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19070976},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":1.0660000000000001,"15min":1.1970000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.26600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77400000000000002,"5min":1.208,"15min":1.208},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83099999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68999999999999995,"5min":0.84599999999999997,"15min":1.284},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.84799999999999998,"15min":1.0129999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.3360000000000001},"last":0.38},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.81699999999999995,"15min":1.2509999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":1.1830000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":1.3620000000000001},"last":0.503}]},{"osd":7,"last update":"Wed May 10 01:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.87,"15min":1.3120000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.747,"5min":0.995,"15min":1.2729999999999999},"last":0.48499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575276,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24520,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":22336,"kb_avail":94347320,"statfs":{"total":96636764160,"available":96611655680,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22872064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.39300000000000002},"min":{"1min":0.248,"5min":0.217,"15min":0.217},"max":{"1min":0.49199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.379}]},{"osd":2,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.56399999999999995,"5min":0.752,"15min":0.752},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44}]},{"osd":3,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.29799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56699999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.435,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.69599999999999995,"15min":0.76500000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.39500000000000002},"max":{"1min":0.80300000000000005,"5min":1.1200000000000001,"15min":1.357},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79700000000000004,"5min":1.171,"15min":1.226},"last":0.55900000000000005}]},{"osd":5,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.94699999999999995,"15min":1.3380000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.623}]},{"osd":6,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":1.008,"15min":1.008},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.403},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 10 01:45:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.83999999999999997,"5min":1.1040000000000001,"15min":1.3280000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68200000000000005,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":0.86099999999999999,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575276,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24968,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":22784,"kb_avail":94346872,"statfs":{"total":96636764160,"available":96611196928,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23330816},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46300000000000002,"5min":0.60699999999999998,"15min":0.66900000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.42099999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24299999999999999},"max":{"1min":0.59599999999999997,"5min":0.65600000000000003,"15min":0.75},"last":0.375}]},{"osd":2,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40699999999999997,"15min":0.42999999999999999},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.51500000000000001,"5min":0.60699999999999998,"15min":0.70599999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.434,"15min":0.44500000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.443}]},{"osd":3,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40200000000000002,"15min":0.41799999999999998},"min":{"1min":0.27600000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60399999999999998,"5min":0.61099999999999999,"15min":0.77200000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.46200000000000002,"15min":0.48999999999999999},"min":{"1min":0.314,"5min":0.308,"15min":0.27200000000000002},"max":{"1min":0.55900000000000005,"5min":0.70199999999999996,"15min":0.76400000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61199999999999999,"15min":0.64400000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.879,"5min":1.016,"15min":1.2050000000000001},"last":0.501},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63100000000000001,"15min":0.65700000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.1699999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64900000000000002},"min":{"1min":0.41599999999999998,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0700000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0589999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65400000000000003,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90400000000000003,"5min":1.0860000000000001,"15min":1.0980000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.165},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 10 01:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66400000000000003,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.874,"5min":1.0509999999999999,"15min":1.141},"last":0.56200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575276,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26120,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":23936,"kb_avail":94345720,"statfs":{"total":96636764160,"available":96610017280,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24510464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.23599999999999999},"max":{"1min":0.503,"5min":0.68100000000000005,"15min":0.747},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26100000000000001},"max":{"1min":0.56100000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.1949999999999998,"5min":3.1949999999999998,"15min":3.1949999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.26800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.628,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.41599999999999998,"15min":0.42999999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.71099999999999997,"15min":0.76800000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.76500000000000001,"15min":0.80700000000000005},"last":0.628}]},{"osd":4,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64300000000000002,"15min":0.66600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88900000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94199999999999995,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77800000000000002,"5min":0.98299999999999998,"15min":1.0800000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.67500000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82199999999999995,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90600000000000003,"5min":1.0620000000000001,"15min":1.133},"last":0.96799999999999997}]},{"osd":7,"last update":"Wed May 10 01:45:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":1.0469999999999999,"15min":1.0820000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67400000000000004,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79100000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575276,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":30848,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31588352},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.62,"15min":0.65900000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.68600000000000005},"last":0.35899999999999999}]},{"osd":1,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.40100000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.433,"15min":0.44600000000000001},"min":{"1min":0.28000000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.72999999999999998},"last":0.313}]},{"osd":2,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.28100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":0.55000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.373},{"interface":"front","average":{"1min":0.439,"5min":0.47199999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.875,"5min":0.97999999999999998,"15min":0.98999999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.75,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82899999999999996,"5min":0.96799999999999997,"15min":0.97099999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.443,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75700000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80400000000000005,"5min":0.98299999999999998,"15min":1.008},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.048},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 10 01:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65600000000000003,"15min":0.66700000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":1.0429999999999999},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":21000,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":18816,"kb_avail":94350840,"statfs":{"total":96636764160,"available":96615260160,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19267584},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61899999999999999,"5min":0.77900000000000003,"15min":1.468},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.431},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.622,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73499999999999999,"5min":0.83699999999999997,"15min":1.51},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.72599999999999998,"5min":1.996,"15min":1.996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.58899999999999997,"15min":0.59899999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69999999999999996,"5min":0.85799999999999998,"15min":1.462},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.2370000000000001},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78400000000000003,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29499999999999998},"max":{"1min":0.66400000000000003,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":1.2470000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.504}]},{"osd":6,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52200000000000002,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1339999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":1.2989999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed May 10 01:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.56200000000000006},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1639999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24072,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":21888,"kb_avail":94347768,"statfs":{"total":96636764160,"available":96612114432,"internally_reserved":0,"allocated":2228224,"data_stored":1153955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22413312},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"last":0.627}]},{"osd":1,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.85599999999999998},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.88600000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.90800000000000003},"last":0.69099999999999995}]},{"osd":4,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26900000000000002},"max":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.79000000000000004},"last":0.45800000000000002}]},{"osd":6,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.5},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.28399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59999999999999998}]},{"osd":7,"last update":"Wed May 10 01:45:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.53600000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.89200000000000002},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T01:46:17.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-05-10T01:46:17.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 Processor -- start 2023-05-10T01:46:17.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 -- start start 2023-05-10T01:46:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff3bc0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0c94c0 con 0x7ff3bc154460 2023-05-10T01:46:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0cb7d0 con 0x7ff3bc068150 2023-05-10T01:46:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.931+0000 7ff3c29c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c88b0 con 0x7ff3bc154080 2023-05-10T01:46:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3bb7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff3bc154460 0x7ff3bc0a9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52690/0 (socket says 172.21.15.52:52690) 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3bb7fe700 1 -- 172.21.15.52:0/455419012 learned_addr learned my addr 172.21.15.52:0/455419012 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3bbfff700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff3bc0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051041193 0 0) 0x7ff3bc0c94c0 con 0x7ff3bc154460 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff39c0033f0 con 0x7ff3bc154460 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754751273 0 0) 0x7ff3bc0cb7d0 con 0x7ff3bc068150 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3bc0c94c0 con 0x7ff3bc068150 2023-05-10T01:46:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2150775271 0 0) 0x7ff39c0033f0 con 0x7ff3bc154460 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 msgr2=0x7ff3bc0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff3bc0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 >> v1:172.21.15.172:6789/0 conn(0x7ff3bc068150 legacy=0x7ff3bc068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0c8b90 con 0x7ff3bc154460 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7ff3a4001470 con 0x7ff3bc154460 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 >> v1:172.21.15.52:6789/0 conn(0x7ff3bc154460 legacy=0x7ff3bc0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff39c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c003fb0 0x7ff39c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c004b80 0x7ff39c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c88b0 con 0x7ff39c004b80 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00b990 con 0x7ff39c003fb0 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c00bb50 con 0x7ff3bc154080 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c004b80 0x7ff39c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3bbfff700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff39c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.932+0000 7ff3bb7fe700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c003fb0 0x7ff39c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 -- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 msgr2=0x7ff39c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3bc154080 0x7ff39c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 -- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c003fb0 msgr2=0x7ff39c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c003fb0 0x7ff39c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 -- 172.21.15.52:0/455419012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c0033f0 con 0x7ff39c004b80 2023-05-10T01:46:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c004b80 0x7ff39c005000 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7ff3b4001f90 tx=0x7ff3b4007f30).ready entity=mon.0 client_cookie=ccd70749bee61a59 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40020f0 con 0x7ff39c004b80 2023-05-10T01:46:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4006a20 con 0x7ff39c004b80 2023-05-10T01:46:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3baffd700 1 -- 172.21.15.52:0/455419012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4006dc0 con 0x7ff39c004b80 2023-05-10T01:46:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c29c4700 1 -- 172.21.15.52:0/455419012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c004b80 msgr2=0x7ff39c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/455419012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39c004b80 0x7ff39c005000 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7ff3b4001f90 tx=0x7ff3b4007f30).stop 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c0f61700 1 -- 172.21.15.52:0/455419012 reap_dead start 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c29c4700 1 -- 172.21.15.52:0/455419012 shutdown_connections 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.933+0000 7ff3c29c4700 1 -- 172.21.15.52:0/455419012 >> 172.21.15.52:0/455419012 conn(0x7ff3bc067910 msgr2=0x7ff3bc0cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.934+0000 7ff3c29c4700 1 -- 172.21.15.52:0/455419012 shutdown_connections 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.934+0000 7ff3c29c4700 1 -- 172.21.15.52:0/455419012 wait complete. 2023-05-10T01:46:17.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.935+0000 7ff3c29c4700 1 Processor -- start 2023-05-10T01:46:17.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.935+0000 7ff3c29c4700 1 -- start start 2023-05-10T01:46:17.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39c004b80 0x7ff3bc0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 0x7ff3bc150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c3b10 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c3fa0 con 0x7ff3bc14cea0 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c29c4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c2f00 con 0x7ff39c004b80 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43686/0 (socket says 172.21.15.52:43686) 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 -- 172.21.15.52:0/1298752853 learned_addr learned my addr 172.21.15.52:0/1298752853 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:46:17.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 0x7ff3bc150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bbfff700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39c004b80 0x7ff3bc0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 -- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39c004b80 msgr2=0x7ff3bc0c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39c004b80 0x7ff3bc0c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 -- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 msgr2=0x7ff3bc150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:17.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 0x7ff3bc150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3bb7fe700 1 -- 172.21.15.52:0/1298752853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0c31e0 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.936+0000 7ff3c0f61700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 0x7ff3bc150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3bb7fe700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7ff3a40049e0 tx=0x7ff3a4001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4001b70 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4004e50 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc0c34c0 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400fb30 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.937+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc0c2b70 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.938+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0c3960 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.939+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff3a401b030 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.939+0000 7ff3b3fff700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.939+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7ff3a40795a0 con 0x7ff3bc0afaf0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.939+0000 7ff3bbfff700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:17.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.940+0000 7ff3bbfff700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 0x7ff3a0061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff3ac006d50 tx=0x7ff3ac008040).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:17.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:17.944+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3a404e5c0 con 0x7ff3bc0afaf0 2023-05-10T01:46:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.115+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff3bc066720 con 0x7ff3bc0afaf0 2023-05-10T01:46:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.118+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3a404e5c0 con 0x7ff3bc0afaf0 2023-05-10T01:46:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.119+0000 7ff3b3fff700 1 -- 172.21.15.52:0/1298752853 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v38)=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff3a4019020 con 0x7ff3bc0afaf0 2023-05-10T01:46:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 msgr2=0x7ff3a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 0x7ff3a0061250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff3ac006d50 tx=0x7ff3ac008040).stop 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 msgr2=0x7ff3bc14c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7ff3a40049e0 tx=0x7ff3a4001e10).stop 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 shutdown_connections 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7ff3a005ed90 0x7ff3a0061250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3bc14cea0 0x7ff3bc150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39c004b80 0x7ff3bc0c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 --2- 172.21.15.52:0/1298752853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3bc0afaf0 0x7ff3bc14c9b0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 >> 172.21.15.52:0/1298752853 conn(0x7ff3bc067910 msgr2=0x7ff3bc0ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 shutdown_connections 2023-05-10T01:46:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.121+0000 7ff3c29c4700 1 -- 172.21.15.52:0/1298752853 wait complete. 2023-05-10T01:46:18.136 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T01:46:18.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T01:46:18.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.249+0000 7fd238295700 1 Processor -- start 2023-05-10T01:46:18.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.249+0000 7fd238295700 1 -- start start 2023-05-10T01:46:18.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd238295700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd230154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd238295700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd230067550 con 0x7fd230068c60 2023-05-10T01:46:18.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd238295700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300bc9a0 con 0x7fd230064ff0 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd238295700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300bcc80 con 0x7fd230153ea0 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd235830700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd230068c60 0x7fd230066e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52710/0 (socket says 172.21.15.52:52710) 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.250+0000 7fd235830700 1 -- 172.21.15.52:0/3555842122 learned_addr learned my addr 172.21.15.52:0/3555842122 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd230154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000800505 0 0) 0x7fd224001110 con 0x7fd230068c60 2023-05-10T01:46:18.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c0033f0 con 0x7fd230068c60 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985067581 0 0) 0x7fd2300bc9a0 con 0x7fd230064ff0 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224001110 con 0x7fd230064ff0 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670035209 0 0) 0x7fd21c0033f0 con 0x7fd230068c60 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 msgr2=0x7fd230154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd230154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 >> v1:172.21.15.172:6789/0 conn(0x7fd230064ff0 legacy=0x7fd2300c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300bcf60 con 0x7fd230068c60 2023-05-10T01:46:18.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 136530125 0 0) 0x7fd224001600 con 0x7fd230068c60 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 >> v1:172.21.15.52:6789/0 conn(0x7fd230068c60 legacy=0x7fd230066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd21c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd21c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd21c004b80 0x7fd21c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300bcc80 con 0x7fd21c003aa0 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c00b910 con 0x7fd21c004b80 2023-05-10T01:46:18.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c00bad0 con 0x7fd230153ea0 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd21c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd235830700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd21c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236832700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd21c004b80 0x7fd21c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 -- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 msgr2=0x7fd21c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230153ea0 0x7fd21c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 -- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd21c004b80 msgr2=0x7fd21c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T01:46:18.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd21c004b80 0x7fd21c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.251+0000 7fd236031700 1 -- 172.21.15.52:0/3555842122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0033f0 con 0x7fd21c003aa0 2023-05-10T01:46:18.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd236031700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd21c003ea0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7fd228009a80 tx=0x7fd228009060).ready entity=mon.0 client_cookie=8b758de6779a52b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:18.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228009430 con 0x7fd21c003aa0 2023-05-10T01:46:18.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd22800e640 con 0x7fd21c003aa0 2023-05-10T01:46:18.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd23502f700 1 -- 172.21.15.52:0/3555842122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800e9e0 con 0x7fd21c003aa0 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 -- 172.21.15.52:0/3555842122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 msgr2=0x7fd21c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 --2- 172.21.15.52:0/3555842122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd21c003ea0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7fd228009a80 tx=0x7fd228009060).stop 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd236832700 1 -- 172.21.15.52:0/3555842122 reap_dead start 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 -- 172.21.15.52:0/3555842122 shutdown_connections 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 -- 172.21.15.52:0/3555842122 >> 172.21.15.52:0/3555842122 conn(0x7fd2300c4420 msgr2=0x7fd2300c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 -- 172.21.15.52:0/3555842122 shutdown_connections 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.252+0000 7fd238295700 1 -- 172.21.15.52:0/3555842122 wait complete. 2023-05-10T01:46:18.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.253+0000 7fd238295700 1 Processor -- start 2023-05-10T01:46:18.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.253+0000 7fd238295700 1 -- start start 2023-05-10T01:46:18.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230158cd0 0x7fd2301501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2301506a0 0x7fd2300c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23014b1e0 con 0x7fd21c003aa0 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230150b20 con 0x7fd2301506a0 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd238295700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300a5030 con 0x7fd230158cd0 2023-05-10T01:46:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43704/0 (socket says 172.21.15.52:43704) 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 -- 172.21.15.52:0/3335094230 learned_addr learned my addr 172.21.15.52:0/3335094230 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 -- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230158cd0 msgr2=0x7fd2301501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230158cd0 0x7fd2301501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 -- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2301506a0 msgr2=0x7fd2300c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2301506a0 0x7fd2300c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:46:18.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.254+0000 7fd236031700 1 -- 172.21.15.52:0/3335094230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300a5310 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd236031700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7fd22800e4b0 tx=0x7fd228009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800ed50 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd22800eeb0 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2300a55f0 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800e9e0 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.255+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300a5bb0 con 0x7fd21c003aa0 2023-05-10T01:46:18.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.256+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23006c340 con 0x7fd21c003aa0 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.256+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 87) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd22802e070 con 0x7fd21c003aa0 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.256+0000 7fd22e7fc700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.256+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fd22807b190 con 0x7fd21c003aa0 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.257+0000 7fd235830700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.257+0000 7fd235830700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd224001e30 tx=0x7fd224007880).ready entity=mgr.8581 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T01:46:18.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.260+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd22804c800 con 0x7fd21c003aa0 2023-05-10T01:46:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.475+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2300bd240 con 0x7fd21c003aa0 2023-05-10T01:46:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.475+0000 7fd22e7fc700 1 -- 172.21.15.52:0/3335094230 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fd2300bd240 con 0x7fd21c003aa0 2023-05-10T01:46:18.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-05-10T01:46:18.479 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1025864103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1025864103},{"type":"v1","addr":"172.21.15.172:6837","nonce":1025864103}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2244425230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2244425230},{"type":"v1","addr":"172.21.15.172:6836","nonce":2244425230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/5257050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":5257050},{"type":"v1","addr":"172.21.15.52:6834","nonce":5257050}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9477,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/956105449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":956105449},{"type":"v1","addr":"172.21.15.52:6835","nonce":956105449}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-05-10T01:46:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 msgr2=0x7fd210061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd224001e30 tx=0x7fd224007880).stop 2023-05-10T01:46:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 msgr2=0x7fd2300a6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T01:46:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7fd22800e4b0 tx=0x7fd228009060).stop 2023-05-10T01:46:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 shutdown_connections 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:6832/125557,v1:172.21.15.172:6833/125557] conn(0x7fd21005ed90 0x7fd210061250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2301506a0 0x7fd2300c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd21c003aa0 0x7fd2300a6a10 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 --2- 172.21.15.52:0/3335094230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd230158cd0 0x7fd2301501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 >> 172.21.15.52:0/3335094230 conn(0x7fd2300c4420 msgr2=0x7fd2300c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 shutdown_connections 2023-05-10T01:46:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-05-10T01:46:18.477+0000 7fd238295700 1 -- 172.21.15.52:0/3335094230 wait complete. 2023-05-10T01:46:18.483 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 80 2023-05-10T01:46:18.492 DEBUG:tasks.cephfs.filesystem:already dead... 2023-05-10T01:46:18.492 INFO:teuthology.misc:Shutting down mds daemons... 2023-05-10T01:46:18.493 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T01:46:18.493 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.501 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T01:46:18.501 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T01:46:18.501 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.549 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T01:46:18.550 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T01:46:18.550 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.561 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T01:46:18.561 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T01:46:18.561 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.612 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T01:46:18.612 INFO:teuthology.misc:Shutting down osd daemons... 2023-05-10T01:46:18.612 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-05-10T01:46:18.613 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.644 INFO:tasks.ceph.osd.0:Stopped 2023-05-10T01:46:18.645 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-05-10T01:46:18.645 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.719 INFO:tasks.ceph.osd.1:Stopped 2023-05-10T01:46:18.720 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-05-10T01:46:18.720 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.790 INFO:tasks.ceph.osd.2:Stopped 2023-05-10T01:46:18.790 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-05-10T01:46:18.791 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.858 INFO:tasks.ceph.osd.3:Stopped 2023-05-10T01:46:18.859 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-05-10T01:46:18.859 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.898 INFO:tasks.ceph.osd.4:Stopped 2023-05-10T01:46:18.898 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-05-10T01:46:18.898 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:18.975 INFO:tasks.ceph.osd.5:Stopped 2023-05-10T01:46:18.976 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-05-10T01:46:18.976 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.051 INFO:tasks.ceph.osd.6:Stopped 2023-05-10T01:46:19.052 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-05-10T01:46:19.052 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.128 INFO:tasks.ceph.osd.7:Stopped 2023-05-10T01:46:19.129 INFO:teuthology.misc:Shutting down mgr daemons... 2023-05-10T01:46:19.129 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-10T01:46:19.129 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.154 INFO:tasks.ceph.mgr.y:Stopped 2023-05-10T01:46:19.155 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-10T01:46:19.155 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.198 INFO:tasks.ceph.mgr.x:Stopped 2023-05-10T01:46:19.198 INFO:teuthology.misc:Shutting down mon daemons... 2023-05-10T01:46:19.199 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-05-10T01:46:19.199 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.214 INFO:tasks.ceph.mon.a:Stopped 2023-05-10T01:46:19.214 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-05-10T01:46:19.214 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.252 INFO:tasks.ceph.mon.b:Stopped 2023-05-10T01:46:19.253 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-05-10T01:46:19.253 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T01:46:19.305 INFO:tasks.ceph.mon.c:Stopped 2023-05-10T01:46:19.306 INFO:tasks.ceph:Checking cluster log for badness... 2023-05-10T01:46:19.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-10T01:46:19.337 INFO:teuthology.orchestra.run.smithi052.stdout:2023-05-10T01:23:15.590044+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-05-10T01:46:19.337 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-05-10T01:46:19.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-10T01:46:19.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-10T01:46:19.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-10T01:46:19.547 INFO:teuthology.orchestra.run.smithi052.stdout:2023-05-10T01:23:15.590044+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-05-10T01:46:19.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:46:19.548 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-05-10T01:46:19.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:46:19.772 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-05-10T01:46:19.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:46:19.870 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-05-10T01:46:19.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:46:19.933 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-05-10T01:46:19.990 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:46:19.991 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-05-10T01:46:20.154 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:46:20.155 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-05-10T01:46:20.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:46:20.240 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-05-10T01:46:20.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:46:20.308 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-05-10T01:46:20.384 INFO:tasks.ceph:Archiving mon data... 2023-05-10T01:46:20.385 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/data/mon.a.tgz 2023-05-10T01:46:20.386 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-05-10T01:46:20.403 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.n2N1L737cm 2023-05-10T01:46:20.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.n2N1L737cm 2023-05-10T01:46:20.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.n2N1L737cm 2023-05-10T01:46:20.964 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.n2N1L737cm is 2MB 2023-05-10T01:46:21.053 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.n2N1L737cm 2023-05-10T01:46:21.068 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/data/mon.b.tgz 2023-05-10T01:46:21.068 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-05-10T01:46:21.085 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.lzmuksLnrG 2023-05-10T01:46:21.086 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lzmuksLnrG 2023-05-10T01:46:21.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.lzmuksLnrG 2023-05-10T01:46:21.656 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.lzmuksLnrG is 2MB 2023-05-10T01:46:21.772 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.lzmuksLnrG 2023-05-10T01:46:21.786 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/data/mon.c.tgz 2023-05-10T01:46:21.786 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-05-10T01:46:21.840 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.hrenNJ2gc9 2023-05-10T01:46:21.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hrenNJ2gc9 2023-05-10T01:46:22.307 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.hrenNJ2gc9 2023-05-10T01:46:22.387 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.hrenNJ2gc9 is 2MB 2023-05-10T01:46:22.501 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.hrenNJ2gc9 2023-05-10T01:46:22.515 INFO:tasks.ceph:Cleaning ceph cluster... 2023-05-10T01:46:22.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-10T01:46:22.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-10T01:46:22.578 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-05-10T01:46:22.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-10T01:46:22.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-10T01:46:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-10T01:46:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-10T01:46:22.648 INFO:tasks.ceph:Archiving crash dumps... 2023-05-10T01:46:22.649 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi052/crash 2023-05-10T01:46:22.650 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-10T01:46:22.687 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi172/crash 2023-05-10T01:46:22.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-10T01:46:22.711 INFO:tasks.ceph:Shutting down logrotate 2023-05-10T01:46:22.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:22.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:22.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:22.826 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-10T01:46:22.849 INFO:tasks.ceph:Compressing logs... 2023-05-10T01:46:22.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-10T01:46:22.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-10T01:46:30.969 INFO:tasks.ceph:Archiving logs... 2023-05-10T01:46:30.970 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi052/log 2023-05-10T01:46:30.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-10T01:46:32.052 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi172/log 2023-05-10T01:46:32.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-10T01:46:32.724 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-05-10T01:46:32.734 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-05-10T01:46:32.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-10T01:46:32.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-10T01:46:32.835 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-05-10T01:46:32.844 INFO:teuthology.task.clock:Checking final clock skew... 2023-05-10T01:46:32.844 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T01:46:32.847 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T01:46:32.860 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2023-05-10T01:46:32.862 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:210 Number of sources = 4 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 -1359us[-1378us] +/- 94ms 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -899us[ -918us] +/- 78ms 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv03.front.sepia.ceph.com 3 6 377 51 +1714us[+1695us] +/- 71ms 2023-05-10T01:46:32.864 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:210 Number of sources = 4 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 -1364us[-1364us] +/- 94ms 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -926us[ -926us] +/- 78ms 2023-05-10T01:46:32.866 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv03.front.sepia.ceph.com 3 7 377 123 +1753us[+1849us] +/- 70ms 2023-05-10T01:46:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T01:46:32.867 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-05-10T01:46:32.876 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-05-10T01:46:32.876 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-05-10T01:46:32.886 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-10T01:46:33.025 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-10T01:46:33.121 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T01:46:33.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:46:33.154 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T01:46:33.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:46:33.184 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-05-10T01:46:33.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-05-10T01:46:33.204 INFO:teuthology.task.internal:Duration was 3109.146637 seconds 2023-05-10T01:46:33.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-05-10T01:46:33.214 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-05-10T01:46:33.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-10T01:46:33.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-10T01:46:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T01:46:33.268 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T01:46:33.549 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-05-10T01:46:33.550 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2023-05-10T01:46:33.550 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-10T01:46:33.569 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-05-10T01:46:33.570 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-10T01:46:33.588 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-05-10T01:46:33.588 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-10T01:46:33.612 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-10T01:46:33.666 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-05-10T01:46:33.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-10T01:46:33.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-10T01:46:33.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-05-10T01:46:33.790 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-05-10T01:46:33.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-10T01:46:33.816 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-10T01:46:33.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-05-10T01:46:33.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-10T01:46:33.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-10T01:46:33.879 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2023-05-10T01:46:33.902 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-05-10T01:46:33.915 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-10T01:46:33.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:46:33.947 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-10T01:46:33.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T01:46:33.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-05-10T01:46:33.979 INFO:teuthology.task.internal:Transferring archived files... 2023-05-10T01:46:33.980 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi052 2023-05-10T01:46:33.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-10T01:46:34.024 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972/remote/smithi172 2023-05-10T01:46:34.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-10T01:46:34.063 INFO:teuthology.task.internal:Removing archive directory... 2023-05-10T01:46:34.063 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-10T01:46:34.066 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-10T01:46:34.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-05-10T01:46:34.118 INFO:teuthology.task.internal:Not uploading archives. 2023-05-10T01:46:34.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-05-10T01:46:34.127 INFO:teuthology.task.internal:Tidying up after the test... 2023-05-10T01:46:34.128 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-10T01:46:34.130 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-10T01:46:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 01:46 /home/ubuntu/cephtest 2023-05-10T01:46:34.160 INFO:teuthology.orchestra.run.smithi172.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 01:46 /home/ubuntu/cephtest 2023-05-10T01:46:34.161 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-05-10T01:46:34.171 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-05-10T01:46:34.192 INFO:teuthology.nuke:Checking targets against current locks 2023-05-10T01:46:34.220 DEBUG:teuthology.nuke:shortname: smithi052 2023-05-10T01:46:34.221 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-10T01:46:34.247 DEBUG:teuthology.nuke:shortname: smithi172 2023-05-10T01:46:34.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-10T01:46:34.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 00:49:07.266148', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn8M4DEYMBQSaidVZ9ULUvt4ddwZSTnajhnGeFjLTr3dHVIkJH+6t0Ei/g4hw5sxumtoQ/tCQ0FdY6enwgPfuXdv3Nj9vfIH9iciOOkGyE1CjX3Nw4GWJRu7pZlCMQrA6vbB5+A0GVr183koWPnrOFpEAYbErtOWj8Apb4AMfxKqfZ9rHk5kXD9J63AMUVUuxe/oWR3n6/4NjV/5ii9FaaaJeVCAMqy9sSCLk04+ghJOsn2EbieCohBOzWoAANzyhMO+l+jHnzvsr3BIN+jLnI7w07ULCcowJknhAIHytMBfGSyBhK3iZvvY6xtv7/b1H3A0Tl8sji6RYhFa6xDFD3cg9WUzdZH2L6Xrty3ahBpGwfrAstsAxm6xIEfgNmVv8CBH/xcHAKWAdVvLjCzQVsfXKt2yBm8GPmL3DlYKn5+GOGDjk53hwZ3SURtdlWPBBQntX9IZyZKt/1LL4cvOuO2NLcijDD94mO66A2G8Qs/16/NuZ2DUn+cxAcTssPzQU='} 2023-05-10T01:46:34.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi/7268972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 00:49:07.267944', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHRORxFf3uSeBh7H+Iem6myfyxzSL3Cg3zOXur0Bk+jd3kU0T4nrlGHnFGi7DCFReNvkn/LqSgTT3TP0gr60KTaAPRthH+8H4Fr5XdbBX+ch7gbpSROZcSn7bKcEmxDk6Mz7TX8doSB7wb17Jg1gbEjr6es3+daitdC/H4Jl62jOKCOF64xA+F6oMl4d2bi8QyxFvfefOTwtY5CffgXIZfkEL6HqceVgnONw1xvMH8EC8PUrDr7ZR4SiVtz9cCHvFwODEf0oG6XyoOCT6BFpHwLGtY3Bet6frVguKwaLpSgLN87071SAxpvxTMOMiao3AIAtBIp6NgDy2vhjZpilmtIym3p3uak63cTL5FRN8Hm+snqFna9gqwjeNYBNZ+yCl4hk/zE+5CuzWe8RGhsZZUyPgxBAQnD1/sPvRaTMWKPIRR/e8e+4k/yOqifwrxgjDcofnAQq83IkyAxvh8gkkc5Ws5mS0jxBTmI9BQlzAzPnC39VtDR/HcoXr9MGy8Ga0='} 2023-05-10T01:46:34.311 INFO:teuthology.orchestra.console:Power off smithi052 2023-05-10T01:46:34.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-10T01:46:34.332 INFO:teuthology.orchestra.console:Power off smithi172 2023-05-10T01:46:34.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-10T01:46:34.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:34.358 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:38.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:38.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:42.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:42.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-10T01:46:42.704 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-05-10T01:46:42.712 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-05-10T01:46:42.817 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3109.146636724472 failure_reason: '"2023-05-10T01:23:15.590044+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-05-10T01:46:42.818 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-10T01:46:42.902 INFO:teuthology.run:FAIL